2026-04-28 01:43:50.539958 | Job console starting 2026-04-28 01:43:50.552619 | Updating git repos 2026-04-28 01:43:50.647356 | Cloning repos into workspace 2026-04-28 01:43:50.863951 | Restoring repo states 2026-04-28 01:43:50.885268 | Merging changes 2026-04-28 01:43:50.885290 | Checking out repos 2026-04-28 01:43:51.155499 | Preparing playbooks 2026-04-28 01:43:51.824127 | Running Ansible setup 2026-04-28 01:43:56.284024 | PRE-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/pre.yaml@main] 2026-04-28 01:43:57.052727 | 2026-04-28 01:43:57.052890 | PLAY [Base pre] 2026-04-28 01:43:57.070980 | 2026-04-28 01:43:57.071121 | TASK [Setup log path fact] 2026-04-28 01:43:57.103978 | orchestrator | ok 2026-04-28 01:43:57.121726 | 2026-04-28 01:43:57.121863 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-28 01:43:57.163956 | orchestrator | ok 2026-04-28 01:43:57.177382 | 2026-04-28 01:43:57.177541 | TASK [emit-job-header : Print job information] 2026-04-28 01:43:57.229851 | # Job Information 2026-04-28 01:43:57.230025 | Ansible Version: 2.16.14 2026-04-28 01:43:57.230059 | Job: testbed-upgrade-stable-ubuntu-24.04 2026-04-28 01:43:57.230092 | Pipeline: periodic-midnight 2026-04-28 01:43:57.230115 | Executor: 521e9411259a 2026-04-28 01:43:57.230135 | Triggered by: https://github.com/osism/testbed 2026-04-28 01:43:57.230156 | Event ID: bb52a5c566ca4be88e0e6bc2aacf7122 2026-04-28 01:43:57.235910 | 2026-04-28 01:43:57.236018 | LOOP [emit-job-header : Print node information] 2026-04-28 01:43:57.356699 | orchestrator | ok: 2026-04-28 01:43:57.356950 | orchestrator | # Node Information 2026-04-28 01:43:57.356998 | orchestrator | Inventory Hostname: orchestrator 2026-04-28 01:43:57.357033 | orchestrator | Hostname: zuul-static-regiocloud-infra-1 2026-04-28 01:43:57.357065 | orchestrator | Username: zuul-testbed04 2026-04-28 01:43:57.357094 | orchestrator | Distro: Debian 12.13 2026-04-28 01:43:57.357128 | orchestrator | Provider: static-testbed 2026-04-28 01:43:57.357157 | orchestrator | Region: 2026-04-28 01:43:57.357187 | orchestrator | Label: testbed-orchestrator 2026-04-28 01:43:57.357215 | orchestrator | Product Name: OpenStack Nova 2026-04-28 01:43:57.357243 | orchestrator | Interface IP: 81.163.193.140 2026-04-28 01:43:57.386038 | 2026-04-28 01:43:57.386198 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-04-28 01:43:57.870260 | orchestrator -> localhost | changed 2026-04-28 01:43:57.889267 | 2026-04-28 01:43:57.889426 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-04-28 01:43:58.971352 | orchestrator -> localhost | changed 2026-04-28 01:43:58.994254 | 2026-04-28 01:43:58.994411 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-04-28 01:43:59.283497 | orchestrator -> localhost | ok 2026-04-28 01:43:59.298532 | 2026-04-28 01:43:59.298711 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-04-28 01:43:59.333532 | orchestrator | ok 2026-04-28 01:43:59.354581 | orchestrator | included: /var/lib/zuul/builds/e75d3019e7a7424d9936cc0c39e3d70d/trusted/project_1/github.com/osism/openinfra-zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-28 01:43:59.361939 | 2026-04-28 01:43:59.362040 | TASK [add-build-sshkey : Create Temp SSH key] 2026-04-28 01:44:00.392141 | orchestrator -> localhost | Generating public/private rsa key pair. 2026-04-28 01:44:00.392406 | orchestrator -> localhost | Your identification has been saved in /var/lib/zuul/builds/e75d3019e7a7424d9936cc0c39e3d70d/work/e75d3019e7a7424d9936cc0c39e3d70d_id_rsa 2026-04-28 01:44:00.392478 | orchestrator -> localhost | Your public key has been saved in /var/lib/zuul/builds/e75d3019e7a7424d9936cc0c39e3d70d/work/e75d3019e7a7424d9936cc0c39e3d70d_id_rsa.pub 2026-04-28 01:44:00.392508 | orchestrator -> localhost | The key fingerprint is: 2026-04-28 01:44:00.392535 | orchestrator -> localhost | SHA256:eq4c0bGWer6KAlhKHZzTxYxAsqUnB9EzxBqk6Frdn20 zuul-build-sshkey 2026-04-28 01:44:00.392559 | orchestrator -> localhost | The key's randomart image is: 2026-04-28 01:44:00.392594 | orchestrator -> localhost | +---[RSA 3072]----+ 2026-04-28 01:44:00.392618 | orchestrator -> localhost | |.=B=+ =. | 2026-04-28 01:44:00.392641 | orchestrator -> localhost | |o.*X o o | 2026-04-28 01:44:00.392663 | orchestrator -> localhost | |o++o= . | 2026-04-28 01:44:00.392684 | orchestrator -> localhost | |.o=o . . + | 2026-04-28 01:44:00.392705 | orchestrator -> localhost | |o+. . o S | 2026-04-28 01:44:00.392737 | orchestrator -> localhost | |=. * o | 2026-04-28 01:44:00.392758 | orchestrator -> localhost | |.. + = E | 2026-04-28 01:44:00.392780 | orchestrator -> localhost | | . o * . | 2026-04-28 01:44:00.392821 | orchestrator -> localhost | | .. +o+. | 2026-04-28 01:44:00.392844 | orchestrator -> localhost | +----[SHA256]-----+ 2026-04-28 01:44:00.392905 | orchestrator -> localhost | ok: Runtime: 0:00:00.514823 2026-04-28 01:44:00.400800 | 2026-04-28 01:44:00.400921 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-04-28 01:44:00.432527 | orchestrator | ok 2026-04-28 01:44:00.444349 | orchestrator | included: /var/lib/zuul/builds/e75d3019e7a7424d9936cc0c39e3d70d/trusted/project_1/github.com/osism/openinfra-zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-28 01:44:00.455154 | 2026-04-28 01:44:00.455273 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-04-28 01:44:00.479912 | orchestrator | skipping: Conditional result was False 2026-04-28 01:44:00.486922 | 2026-04-28 01:44:00.487035 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-04-28 01:44:01.105893 | orchestrator | changed 2026-04-28 01:44:01.112597 | 2026-04-28 01:44:01.113541 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-04-28 01:44:01.426091 | orchestrator | ok 2026-04-28 01:44:01.438759 | 2026-04-28 01:44:01.438945 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-04-28 01:44:01.898203 | orchestrator | ok 2026-04-28 01:44:01.908184 | 2026-04-28 01:44:01.908324 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-04-28 01:44:02.361243 | orchestrator | ok 2026-04-28 01:44:02.371080 | 2026-04-28 01:44:02.371333 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-04-28 01:44:02.396039 | orchestrator | skipping: Conditional result was False 2026-04-28 01:44:02.411528 | 2026-04-28 01:44:02.411687 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-04-28 01:44:02.863641 | orchestrator -> localhost | changed 2026-04-28 01:44:02.885810 | 2026-04-28 01:44:02.885947 | TASK [add-build-sshkey : Add back temp key] 2026-04-28 01:44:03.237193 | orchestrator -> localhost | Identity added: /var/lib/zuul/builds/e75d3019e7a7424d9936cc0c39e3d70d/work/e75d3019e7a7424d9936cc0c39e3d70d_id_rsa (zuul-build-sshkey) 2026-04-28 01:44:03.237755 | orchestrator -> localhost | ok: Runtime: 0:00:00.023476 2026-04-28 01:44:03.249672 | 2026-04-28 01:44:03.249822 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-04-28 01:44:03.682198 | orchestrator | ok 2026-04-28 01:44:03.693625 | 2026-04-28 01:44:03.693763 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-04-28 01:44:03.728694 | orchestrator | skipping: Conditional result was False 2026-04-28 01:44:03.783063 | 2026-04-28 01:44:03.783193 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-04-28 01:44:04.210968 | orchestrator | ok 2026-04-28 01:44:04.226924 | 2026-04-28 01:44:04.227061 | TASK [validate-host : Define zuul_info_dir fact] 2026-04-28 01:44:04.277166 | orchestrator | ok 2026-04-28 01:44:04.284919 | 2026-04-28 01:44:04.285061 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-04-28 01:44:04.594610 | orchestrator -> localhost | ok 2026-04-28 01:44:04.612327 | 2026-04-28 01:44:04.612561 | TASK [validate-host : Collect information about the host] 2026-04-28 01:44:05.872939 | orchestrator | ok 2026-04-28 01:44:05.886704 | 2026-04-28 01:44:05.886823 | TASK [validate-host : Sanitize hostname] 2026-04-28 01:44:05.963365 | orchestrator | ok 2026-04-28 01:44:05.973071 | 2026-04-28 01:44:05.973218 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-04-28 01:44:06.554621 | orchestrator -> localhost | changed 2026-04-28 01:44:06.567518 | 2026-04-28 01:44:06.567679 | TASK [validate-host : Collect information about zuul worker] 2026-04-28 01:44:07.013278 | orchestrator | ok 2026-04-28 01:44:07.023101 | 2026-04-28 01:44:07.023256 | TASK [validate-host : Write out all zuul information for each host] 2026-04-28 01:44:07.586508 | orchestrator -> localhost | changed 2026-04-28 01:44:07.602092 | 2026-04-28 01:44:07.602215 | TASK [prepare-workspace-log : Start zuul_console daemon.] 2026-04-28 01:44:07.903067 | orchestrator | ok 2026-04-28 01:44:07.912294 | 2026-04-28 01:44:07.912423 | TASK [prepare-workspace-log : Synchronize src repos to workspace directory.] 2026-04-28 01:44:29.266931 | orchestrator | changed: 2026-04-28 01:44:29.267174 | orchestrator | .d..t...... src/ 2026-04-28 01:44:29.267219 | orchestrator | .d..t...... src/github.com/ 2026-04-28 01:44:29.267251 | orchestrator | .d..t...... src/github.com/osism/ 2026-04-28 01:44:29.267277 | orchestrator | .d..t...... src/github.com/osism/ansible-collection-commons/ 2026-04-28 01:44:29.267303 | orchestrator | RedHat.yml 2026-04-28 01:44:29.292787 | orchestrator | .L..t...... src/github.com/osism/ansible-collection-commons/roles/repository/tasks/CentOS.yml -> RedHat.yml 2026-04-28 01:44:29.292805 | orchestrator | RedHat.yml 2026-04-28 01:44:29.292861 | orchestrator | = 1.53.0"... 2026-04-28 01:44:42.828325 | orchestrator | - Finding hashicorp/local versions matching ">= 2.2.0"... 2026-04-28 01:44:43.494864 | orchestrator | - Installing hashicorp/null v3.2.4... 2026-04-28 01:44:44.199988 | orchestrator | - Installed hashicorp/null v3.2.4 (signed, key ID 0C0AF313E5FD9F80) 2026-04-28 01:44:44.616884 | orchestrator | - Installing terraform-provider-openstack/openstack v3.4.0... 2026-04-28 01:44:45.501593 | orchestrator | - Installed terraform-provider-openstack/openstack v3.4.0 (signed, key ID 4F80527A391BEFD2) 2026-04-28 01:44:45.565681 | orchestrator | - Installing hashicorp/local v2.8.0... 2026-04-28 01:44:46.064681 | orchestrator | - Installed hashicorp/local v2.8.0 (signed, key ID 0C0AF313E5FD9F80) 2026-04-28 01:44:46.064779 | orchestrator | 2026-04-28 01:44:46.064787 | orchestrator | Providers are signed by their developers. 2026-04-28 01:44:46.064793 | orchestrator | If you'd like to know more about provider signing, you can read about it here: 2026-04-28 01:44:46.064806 | orchestrator | https://opentofu.org/docs/cli/plugins/signing/ 2026-04-28 01:44:46.064879 | orchestrator | 2026-04-28 01:44:46.064886 | orchestrator | OpenTofu has created a lock file .terraform.lock.hcl to record the provider 2026-04-28 01:44:46.064891 | orchestrator | selections it made above. Include this file in your version control repository 2026-04-28 01:44:46.064911 | orchestrator | so that OpenTofu can guarantee to make the same selections by default when 2026-04-28 01:44:46.064979 | orchestrator | you run "tofu init" in the future. 2026-04-28 01:44:46.065600 | orchestrator | 2026-04-28 01:44:46.065662 | orchestrator | OpenTofu has been successfully initialized! 2026-04-28 01:44:46.065700 | orchestrator | 2026-04-28 01:44:46.065707 | orchestrator | You may now begin working with OpenTofu. Try running "tofu plan" to see 2026-04-28 01:44:46.065712 | orchestrator | any changes that are required for your infrastructure. All OpenTofu commands 2026-04-28 01:44:46.065717 | orchestrator | should now work. 2026-04-28 01:44:46.065721 | orchestrator | 2026-04-28 01:44:46.065725 | orchestrator | If you ever set or change modules or backend configuration for OpenTofu, 2026-04-28 01:44:46.065730 | orchestrator | rerun this command to reinitialize your working directory. If you forget, other 2026-04-28 01:44:46.065746 | orchestrator | commands will detect it and remind you to do so if necessary. 2026-04-28 01:44:46.226279 | orchestrator | Created and switched to workspace "ci"! 2026-04-28 01:44:46.226444 | orchestrator | 2026-04-28 01:44:46.226464 | orchestrator | You're now on a new, empty workspace. Workspaces isolate their state, 2026-04-28 01:44:46.226484 | orchestrator | so if you run "tofu plan" OpenTofu will not see any existing state 2026-04-28 01:44:46.226501 | orchestrator | for this configuration. 2026-04-28 01:44:46.360812 | orchestrator | ci.auto.tfvars 2026-04-28 01:44:46.367070 | orchestrator | default_custom.tf 2026-04-28 01:44:47.319123 | orchestrator | data.openstack_networking_network_v2.public: Reading... 2026-04-28 01:44:47.857805 | orchestrator | data.openstack_networking_network_v2.public: Read complete after 1s [id=e6be7364-bfd8-4de7-8120-8f41c69a139a] 2026-04-28 01:44:48.123709 | orchestrator | 2026-04-28 01:44:48.123783 | orchestrator | OpenTofu used the selected providers to generate the following execution 2026-04-28 01:44:48.123797 | orchestrator | plan. Resource actions are indicated with the following symbols: 2026-04-28 01:44:48.123804 | orchestrator | + create 2026-04-28 01:44:48.123823 | orchestrator | <= read (data resources) 2026-04-28 01:44:48.123830 | orchestrator | 2026-04-28 01:44:48.123836 | orchestrator | OpenTofu will perform the following actions: 2026-04-28 01:44:48.123842 | orchestrator | 2026-04-28 01:44:48.123848 | orchestrator | # data.openstack_images_image_v2.image will be read during apply 2026-04-28 01:44:48.123854 | orchestrator | # (config refers to values not yet known) 2026-04-28 01:44:48.123860 | orchestrator | <= data "openstack_images_image_v2" "image" { 2026-04-28 01:44:48.123866 | orchestrator | + checksum = (known after apply) 2026-04-28 01:44:48.123873 | orchestrator | + created_at = (known after apply) 2026-04-28 01:44:48.123879 | orchestrator | + file = (known after apply) 2026-04-28 01:44:48.123885 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.123919 | orchestrator | + metadata = (known after apply) 2026-04-28 01:44:48.123927 | orchestrator | + min_disk_gb = (known after apply) 2026-04-28 01:44:48.123933 | orchestrator | + min_ram_mb = (known after apply) 2026-04-28 01:44:48.123939 | orchestrator | + most_recent = true 2026-04-28 01:44:48.123945 | orchestrator | + name = (known after apply) 2026-04-28 01:44:48.123951 | orchestrator | + protected = (known after apply) 2026-04-28 01:44:48.123957 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.123967 | orchestrator | + schema = (known after apply) 2026-04-28 01:44:48.123971 | orchestrator | + size_bytes = (known after apply) 2026-04-28 01:44:48.123975 | orchestrator | + tags = (known after apply) 2026-04-28 01:44:48.123979 | orchestrator | + updated_at = (known after apply) 2026-04-28 01:44:48.123983 | orchestrator | } 2026-04-28 01:44:48.123990 | orchestrator | 2026-04-28 01:44:48.123994 | orchestrator | # data.openstack_images_image_v2.image_node will be read during apply 2026-04-28 01:44:48.123999 | orchestrator | # (config refers to values not yet known) 2026-04-28 01:44:48.124003 | orchestrator | <= data "openstack_images_image_v2" "image_node" { 2026-04-28 01:44:48.124007 | orchestrator | + checksum = (known after apply) 2026-04-28 01:44:48.124011 | orchestrator | + created_at = (known after apply) 2026-04-28 01:44:48.124015 | orchestrator | + file = (known after apply) 2026-04-28 01:44:48.124019 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.124023 | orchestrator | + metadata = (known after apply) 2026-04-28 01:44:48.124027 | orchestrator | + min_disk_gb = (known after apply) 2026-04-28 01:44:48.124031 | orchestrator | + min_ram_mb = (known after apply) 2026-04-28 01:44:48.124034 | orchestrator | + most_recent = true 2026-04-28 01:44:48.124038 | orchestrator | + name = (known after apply) 2026-04-28 01:44:48.124042 | orchestrator | + protected = (known after apply) 2026-04-28 01:44:48.124046 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.124050 | orchestrator | + schema = (known after apply) 2026-04-28 01:44:48.124054 | orchestrator | + size_bytes = (known after apply) 2026-04-28 01:44:48.124058 | orchestrator | + tags = (known after apply) 2026-04-28 01:44:48.124062 | orchestrator | + updated_at = (known after apply) 2026-04-28 01:44:48.124066 | orchestrator | } 2026-04-28 01:44:48.124070 | orchestrator | 2026-04-28 01:44:48.124074 | orchestrator | # local_file.MANAGER_ADDRESS will be created 2026-04-28 01:44:48.124078 | orchestrator | + resource "local_file" "MANAGER_ADDRESS" { 2026-04-28 01:44:48.124082 | orchestrator | + content = (known after apply) 2026-04-28 01:44:48.124086 | orchestrator | + content_base64sha256 = (known after apply) 2026-04-28 01:44:48.124090 | orchestrator | + content_base64sha512 = (known after apply) 2026-04-28 01:44:48.124094 | orchestrator | + content_md5 = (known after apply) 2026-04-28 01:44:48.124098 | orchestrator | + content_sha1 = (known after apply) 2026-04-28 01:44:48.124102 | orchestrator | + content_sha256 = (known after apply) 2026-04-28 01:44:48.124105 | orchestrator | + content_sha512 = (known after apply) 2026-04-28 01:44:48.124109 | orchestrator | + directory_permission = "0777" 2026-04-28 01:44:48.124113 | orchestrator | + file_permission = "0644" 2026-04-28 01:44:48.124117 | orchestrator | + filename = ".MANAGER_ADDRESS.ci" 2026-04-28 01:44:48.124121 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.124124 | orchestrator | } 2026-04-28 01:44:48.124128 | orchestrator | 2026-04-28 01:44:48.124132 | orchestrator | # local_file.id_rsa_pub will be created 2026-04-28 01:44:48.124136 | orchestrator | + resource "local_file" "id_rsa_pub" { 2026-04-28 01:44:48.124162 | orchestrator | + content = (known after apply) 2026-04-28 01:44:48.124166 | orchestrator | + content_base64sha256 = (known after apply) 2026-04-28 01:44:48.124170 | orchestrator | + content_base64sha512 = (known after apply) 2026-04-28 01:44:48.124174 | orchestrator | + content_md5 = (known after apply) 2026-04-28 01:44:48.124177 | orchestrator | + content_sha1 = (known after apply) 2026-04-28 01:44:48.124181 | orchestrator | + content_sha256 = (known after apply) 2026-04-28 01:44:48.124185 | orchestrator | + content_sha512 = (known after apply) 2026-04-28 01:44:48.124189 | orchestrator | + directory_permission = "0777" 2026-04-28 01:44:48.124192 | orchestrator | + file_permission = "0644" 2026-04-28 01:44:48.124201 | orchestrator | + filename = ".id_rsa.ci.pub" 2026-04-28 01:44:48.124205 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.124209 | orchestrator | } 2026-04-28 01:44:48.124215 | orchestrator | 2026-04-28 01:44:48.124226 | orchestrator | # local_file.inventory will be created 2026-04-28 01:44:48.124230 | orchestrator | + resource "local_file" "inventory" { 2026-04-28 01:44:48.124234 | orchestrator | + content = (known after apply) 2026-04-28 01:44:48.124238 | orchestrator | + content_base64sha256 = (known after apply) 2026-04-28 01:44:48.124241 | orchestrator | + content_base64sha512 = (known after apply) 2026-04-28 01:44:48.124245 | orchestrator | + content_md5 = (known after apply) 2026-04-28 01:44:48.124249 | orchestrator | + content_sha1 = (known after apply) 2026-04-28 01:44:48.124253 | orchestrator | + content_sha256 = (known after apply) 2026-04-28 01:44:48.124257 | orchestrator | + content_sha512 = (known after apply) 2026-04-28 01:44:48.124260 | orchestrator | + directory_permission = "0777" 2026-04-28 01:44:48.124264 | orchestrator | + file_permission = "0644" 2026-04-28 01:44:48.124268 | orchestrator | + filename = "inventory.ci" 2026-04-28 01:44:48.124272 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.124275 | orchestrator | } 2026-04-28 01:44:48.124279 | orchestrator | 2026-04-28 01:44:48.124283 | orchestrator | # local_sensitive_file.id_rsa will be created 2026-04-28 01:44:48.124287 | orchestrator | + resource "local_sensitive_file" "id_rsa" { 2026-04-28 01:44:48.124291 | orchestrator | + content = (sensitive value) 2026-04-28 01:44:48.124294 | orchestrator | + content_base64sha256 = (known after apply) 2026-04-28 01:44:48.124298 | orchestrator | + content_base64sha512 = (known after apply) 2026-04-28 01:44:48.124302 | orchestrator | + content_md5 = (known after apply) 2026-04-28 01:44:48.124306 | orchestrator | + content_sha1 = (known after apply) 2026-04-28 01:44:48.124309 | orchestrator | + content_sha256 = (known after apply) 2026-04-28 01:44:48.124313 | orchestrator | + content_sha512 = (known after apply) 2026-04-28 01:44:48.124317 | orchestrator | + directory_permission = "0700" 2026-04-28 01:44:48.124321 | orchestrator | + file_permission = "0600" 2026-04-28 01:44:48.124324 | orchestrator | + filename = ".id_rsa.ci" 2026-04-28 01:44:48.124328 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.124332 | orchestrator | } 2026-04-28 01:44:48.124336 | orchestrator | 2026-04-28 01:44:48.124339 | orchestrator | # null_resource.node_semaphore will be created 2026-04-28 01:44:48.124343 | orchestrator | + resource "null_resource" "node_semaphore" { 2026-04-28 01:44:48.124347 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.124351 | orchestrator | } 2026-04-28 01:44:48.124355 | orchestrator | 2026-04-28 01:44:48.124358 | orchestrator | # openstack_blockstorage_volume_v3.manager_base_volume[0] will be created 2026-04-28 01:44:48.124362 | orchestrator | + resource "openstack_blockstorage_volume_v3" "manager_base_volume" { 2026-04-28 01:44:48.124366 | orchestrator | + attachment = (known after apply) 2026-04-28 01:44:48.124370 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.124374 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.124377 | orchestrator | + image_id = (known after apply) 2026-04-28 01:44:48.124381 | orchestrator | + metadata = (known after apply) 2026-04-28 01:44:48.124385 | orchestrator | + name = "testbed-volume-manager-base" 2026-04-28 01:44:48.124389 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.124393 | orchestrator | + size = 80 2026-04-28 01:44:48.124396 | orchestrator | + volume_retype_policy = "never" 2026-04-28 01:44:48.124400 | orchestrator | + volume_type = "ssd" 2026-04-28 01:44:48.124404 | orchestrator | } 2026-04-28 01:44:48.124409 | orchestrator | 2026-04-28 01:44:48.124413 | orchestrator | # openstack_blockstorage_volume_v3.node_base_volume[0] will be created 2026-04-28 01:44:48.124417 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_base_volume" { 2026-04-28 01:44:48.124421 | orchestrator | + attachment = (known after apply) 2026-04-28 01:44:48.124425 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.124428 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.124437 | orchestrator | + image_id = (known after apply) 2026-04-28 01:44:48.124441 | orchestrator | + metadata = (known after apply) 2026-04-28 01:44:48.124445 | orchestrator | + name = "testbed-volume-0-node-base" 2026-04-28 01:44:48.124449 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.124452 | orchestrator | + size = 80 2026-04-28 01:44:48.124456 | orchestrator | + volume_retype_policy = "never" 2026-04-28 01:44:48.124460 | orchestrator | + volume_type = "ssd" 2026-04-28 01:44:48.124464 | orchestrator | } 2026-04-28 01:44:48.124467 | orchestrator | 2026-04-28 01:44:48.124471 | orchestrator | # openstack_blockstorage_volume_v3.node_base_volume[1] will be created 2026-04-28 01:44:48.124475 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_base_volume" { 2026-04-28 01:44:48.124479 | orchestrator | + attachment = (known after apply) 2026-04-28 01:44:48.124483 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.124486 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.124490 | orchestrator | + image_id = (known after apply) 2026-04-28 01:44:48.124494 | orchestrator | + metadata = (known after apply) 2026-04-28 01:44:48.124498 | orchestrator | + name = "testbed-volume-1-node-base" 2026-04-28 01:44:48.124501 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.124505 | orchestrator | + size = 80 2026-04-28 01:44:48.124509 | orchestrator | + volume_retype_policy = "never" 2026-04-28 01:44:48.124513 | orchestrator | + volume_type = "ssd" 2026-04-28 01:44:48.124516 | orchestrator | } 2026-04-28 01:44:48.124520 | orchestrator | 2026-04-28 01:44:48.124524 | orchestrator | # openstack_blockstorage_volume_v3.node_base_volume[2] will be created 2026-04-28 01:44:48.124528 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_base_volume" { 2026-04-28 01:44:48.124531 | orchestrator | + attachment = (known after apply) 2026-04-28 01:44:48.124535 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.124539 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.124543 | orchestrator | + image_id = (known after apply) 2026-04-28 01:44:48.124546 | orchestrator | + metadata = (known after apply) 2026-04-28 01:44:48.124550 | orchestrator | + name = "testbed-volume-2-node-base" 2026-04-28 01:44:48.124554 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.124558 | orchestrator | + size = 80 2026-04-28 01:44:48.124561 | orchestrator | + volume_retype_policy = "never" 2026-04-28 01:44:48.124565 | orchestrator | + volume_type = "ssd" 2026-04-28 01:44:48.124569 | orchestrator | } 2026-04-28 01:44:48.124573 | orchestrator | 2026-04-28 01:44:48.124576 | orchestrator | # openstack_blockstorage_volume_v3.node_base_volume[3] will be created 2026-04-28 01:44:48.124580 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_base_volume" { 2026-04-28 01:44:48.124584 | orchestrator | + attachment = (known after apply) 2026-04-28 01:44:48.124588 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.124592 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.124595 | orchestrator | + image_id = (known after apply) 2026-04-28 01:44:48.124599 | orchestrator | + metadata = (known after apply) 2026-04-28 01:44:48.124606 | orchestrator | + name = "testbed-volume-3-node-base" 2026-04-28 01:44:48.124610 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.124613 | orchestrator | + size = 80 2026-04-28 01:44:48.124617 | orchestrator | + volume_retype_policy = "never" 2026-04-28 01:44:48.124621 | orchestrator | + volume_type = "ssd" 2026-04-28 01:44:48.124625 | orchestrator | } 2026-04-28 01:44:48.124630 | orchestrator | 2026-04-28 01:44:48.124634 | orchestrator | # openstack_blockstorage_volume_v3.node_base_volume[4] will be created 2026-04-28 01:44:48.124638 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_base_volume" { 2026-04-28 01:44:48.124641 | orchestrator | + attachment = (known after apply) 2026-04-28 01:44:48.124645 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.124649 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.124656 | orchestrator | + image_id = (known after apply) 2026-04-28 01:44:48.124660 | orchestrator | + metadata = (known after apply) 2026-04-28 01:44:48.124664 | orchestrator | + name = "testbed-volume-4-node-base" 2026-04-28 01:44:48.124668 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.124671 | orchestrator | + size = 80 2026-04-28 01:44:48.124675 | orchestrator | + volume_retype_policy = "never" 2026-04-28 01:44:48.124679 | orchestrator | + volume_type = "ssd" 2026-04-28 01:44:48.124683 | orchestrator | } 2026-04-28 01:44:48.124686 | orchestrator | 2026-04-28 01:44:48.124690 | orchestrator | # openstack_blockstorage_volume_v3.node_base_volume[5] will be created 2026-04-28 01:44:48.124694 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_base_volume" { 2026-04-28 01:44:48.124697 | orchestrator | + attachment = (known after apply) 2026-04-28 01:44:48.124701 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.124705 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.124709 | orchestrator | + image_id = (known after apply) 2026-04-28 01:44:48.124712 | orchestrator | + metadata = (known after apply) 2026-04-28 01:44:48.124716 | orchestrator | + name = "testbed-volume-5-node-base" 2026-04-28 01:44:48.124720 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.124724 | orchestrator | + size = 80 2026-04-28 01:44:48.124728 | orchestrator | + volume_retype_policy = "never" 2026-04-28 01:44:48.124731 | orchestrator | + volume_type = "ssd" 2026-04-28 01:44:48.124735 | orchestrator | } 2026-04-28 01:44:48.124739 | orchestrator | 2026-04-28 01:44:48.124743 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[0] will be created 2026-04-28 01:44:48.124746 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-28 01:44:48.124750 | orchestrator | + attachment = (known after apply) 2026-04-28 01:44:48.124754 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.124758 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.124761 | orchestrator | + metadata = (known after apply) 2026-04-28 01:44:48.124765 | orchestrator | + name = "testbed-volume-0-node-3" 2026-04-28 01:44:48.124769 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.124773 | orchestrator | + size = 20 2026-04-28 01:44:48.124777 | orchestrator | + volume_retype_policy = "never" 2026-04-28 01:44:48.124780 | orchestrator | + volume_type = "ssd" 2026-04-28 01:44:48.124784 | orchestrator | } 2026-04-28 01:44:48.124788 | orchestrator | 2026-04-28 01:44:48.124792 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[1] will be created 2026-04-28 01:44:48.124796 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-28 01:44:48.124800 | orchestrator | + attachment = (known after apply) 2026-04-28 01:44:48.124803 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.124807 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.124811 | orchestrator | + metadata = (known after apply) 2026-04-28 01:44:48.124814 | orchestrator | + name = "testbed-volume-1-node-4" 2026-04-28 01:44:48.124818 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.124822 | orchestrator | + size = 20 2026-04-28 01:44:48.124826 | orchestrator | + volume_retype_policy = "never" 2026-04-28 01:44:48.124830 | orchestrator | + volume_type = "ssd" 2026-04-28 01:44:48.124833 | orchestrator | } 2026-04-28 01:44:48.124839 | orchestrator | 2026-04-28 01:44:48.124843 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[2] will be created 2026-04-28 01:44:48.124847 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-28 01:44:48.124851 | orchestrator | + attachment = (known after apply) 2026-04-28 01:44:48.124854 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.124858 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.124862 | orchestrator | + metadata = (known after apply) 2026-04-28 01:44:48.124866 | orchestrator | + name = "testbed-volume-2-node-5" 2026-04-28 01:44:48.124869 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.124876 | orchestrator | + size = 20 2026-04-28 01:44:48.124880 | orchestrator | + volume_retype_policy = "never" 2026-04-28 01:44:48.124884 | orchestrator | + volume_type = "ssd" 2026-04-28 01:44:48.124888 | orchestrator | } 2026-04-28 01:44:48.124892 | orchestrator | 2026-04-28 01:44:48.124895 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[3] will be created 2026-04-28 01:44:48.124899 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-28 01:44:48.124903 | orchestrator | + attachment = (known after apply) 2026-04-28 01:44:48.124907 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.124910 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.124914 | orchestrator | + metadata = (known after apply) 2026-04-28 01:44:48.124918 | orchestrator | + name = "testbed-volume-3-node-3" 2026-04-28 01:44:48.124922 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.124925 | orchestrator | + size = 20 2026-04-28 01:44:48.124929 | orchestrator | + volume_retype_policy = "never" 2026-04-28 01:44:48.124933 | orchestrator | + volume_type = "ssd" 2026-04-28 01:44:48.124937 | orchestrator | } 2026-04-28 01:44:48.124940 | orchestrator | 2026-04-28 01:44:48.124944 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[4] will be created 2026-04-28 01:44:48.124948 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-28 01:44:48.124952 | orchestrator | + attachment = (known after apply) 2026-04-28 01:44:48.124955 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.124961 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.124967 | orchestrator | + metadata = (known after apply) 2026-04-28 01:44:48.124975 | orchestrator | + name = "testbed-volume-4-node-4" 2026-04-28 01:44:48.124983 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.124994 | orchestrator | + size = 20 2026-04-28 01:44:48.125000 | orchestrator | + volume_retype_policy = "never" 2026-04-28 01:44:48.125007 | orchestrator | + volume_type = "ssd" 2026-04-28 01:44:48.125012 | orchestrator | } 2026-04-28 01:44:48.125019 | orchestrator | 2026-04-28 01:44:48.125024 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[5] will be created 2026-04-28 01:44:48.125031 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-28 01:44:48.125037 | orchestrator | + attachment = (known after apply) 2026-04-28 01:44:48.125043 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.125049 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.125055 | orchestrator | + metadata = (known after apply) 2026-04-28 01:44:48.125061 | orchestrator | + name = "testbed-volume-5-node-5" 2026-04-28 01:44:48.125068 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.125074 | orchestrator | + size = 20 2026-04-28 01:44:48.125080 | orchestrator | + volume_retype_policy = "never" 2026-04-28 01:44:48.125086 | orchestrator | + volume_type = "ssd" 2026-04-28 01:44:48.125092 | orchestrator | } 2026-04-28 01:44:48.125098 | orchestrator | 2026-04-28 01:44:48.125103 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[6] will be created 2026-04-28 01:44:48.125110 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-28 01:44:48.125116 | orchestrator | + attachment = (known after apply) 2026-04-28 01:44:48.125121 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.125127 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.125134 | orchestrator | + metadata = (known after apply) 2026-04-28 01:44:48.125185 | orchestrator | + name = "testbed-volume-6-node-3" 2026-04-28 01:44:48.125191 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.125197 | orchestrator | + size = 20 2026-04-28 01:44:48.125204 | orchestrator | + volume_retype_policy = "never" 2026-04-28 01:44:48.125210 | orchestrator | + volume_type = "ssd" 2026-04-28 01:44:48.125216 | orchestrator | } 2026-04-28 01:44:48.125226 | orchestrator | 2026-04-28 01:44:48.125232 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[7] will be created 2026-04-28 01:44:48.125237 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-28 01:44:48.125251 | orchestrator | + attachment = (known after apply) 2026-04-28 01:44:48.125257 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.125263 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.125269 | orchestrator | + metadata = (known after apply) 2026-04-28 01:44:48.125274 | orchestrator | + name = "testbed-volume-7-node-4" 2026-04-28 01:44:48.125280 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.125285 | orchestrator | + size = 20 2026-04-28 01:44:48.125292 | orchestrator | + volume_retype_policy = "never" 2026-04-28 01:44:48.125297 | orchestrator | + volume_type = "ssd" 2026-04-28 01:44:48.125303 | orchestrator | } 2026-04-28 01:44:48.125309 | orchestrator | 2026-04-28 01:44:48.125316 | orchestrator | # openstack_blockstorage_volume_v3.node_volume[8] will be created 2026-04-28 01:44:48.125322 | orchestrator | + resource "openstack_blockstorage_volume_v3" "node_volume" { 2026-04-28 01:44:48.125328 | orchestrator | + attachment = (known after apply) 2026-04-28 01:44:48.125337 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.125344 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.125349 | orchestrator | + metadata = (known after apply) 2026-04-28 01:44:48.125355 | orchestrator | + name = "testbed-volume-8-node-5" 2026-04-28 01:44:48.125360 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.125366 | orchestrator | + size = 20 2026-04-28 01:44:48.125371 | orchestrator | + volume_retype_policy = "never" 2026-04-28 01:44:48.125377 | orchestrator | + volume_type = "ssd" 2026-04-28 01:44:48.125381 | orchestrator | } 2026-04-28 01:44:48.125387 | orchestrator | 2026-04-28 01:44:48.125393 | orchestrator | # openstack_compute_instance_v2.manager_server will be created 2026-04-28 01:44:48.125399 | orchestrator | + resource "openstack_compute_instance_v2" "manager_server" { 2026-04-28 01:44:48.125404 | orchestrator | + access_ip_v4 = (known after apply) 2026-04-28 01:44:48.125410 | orchestrator | + access_ip_v6 = (known after apply) 2026-04-28 01:44:48.125417 | orchestrator | + all_metadata = (known after apply) 2026-04-28 01:44:48.125423 | orchestrator | + all_tags = (known after apply) 2026-04-28 01:44:48.125428 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.125434 | orchestrator | + config_drive = true 2026-04-28 01:44:48.125440 | orchestrator | + created = (known after apply) 2026-04-28 01:44:48.125446 | orchestrator | + flavor_id = (known after apply) 2026-04-28 01:44:48.125450 | orchestrator | + flavor_name = "OSISM-4V-16" 2026-04-28 01:44:48.125453 | orchestrator | + force_delete = false 2026-04-28 01:44:48.125457 | orchestrator | + hypervisor_hostname = (known after apply) 2026-04-28 01:44:48.125461 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.125464 | orchestrator | + image_id = (known after apply) 2026-04-28 01:44:48.125468 | orchestrator | + image_name = (known after apply) 2026-04-28 01:44:48.125472 | orchestrator | + key_pair = "testbed" 2026-04-28 01:44:48.125475 | orchestrator | + name = "testbed-manager" 2026-04-28 01:44:48.125479 | orchestrator | + power_state = "active" 2026-04-28 01:44:48.125483 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.125486 | orchestrator | + security_groups = (known after apply) 2026-04-28 01:44:48.125490 | orchestrator | + stop_before_destroy = false 2026-04-28 01:44:48.125494 | orchestrator | + updated = (known after apply) 2026-04-28 01:44:48.125497 | orchestrator | + user_data = (sensitive value) 2026-04-28 01:44:48.125501 | orchestrator | 2026-04-28 01:44:48.125505 | orchestrator | + block_device { 2026-04-28 01:44:48.125509 | orchestrator | + boot_index = 0 2026-04-28 01:44:48.125513 | orchestrator | + delete_on_termination = false 2026-04-28 01:44:48.125522 | orchestrator | + destination_type = "volume" 2026-04-28 01:44:48.125525 | orchestrator | + multiattach = false 2026-04-28 01:44:48.125529 | orchestrator | + source_type = "volume" 2026-04-28 01:44:48.125533 | orchestrator | + uuid = (known after apply) 2026-04-28 01:44:48.125548 | orchestrator | } 2026-04-28 01:44:48.125552 | orchestrator | 2026-04-28 01:44:48.125556 | orchestrator | + network { 2026-04-28 01:44:48.125562 | orchestrator | + access_network = false 2026-04-28 01:44:48.125568 | orchestrator | + fixed_ip_v4 = (known after apply) 2026-04-28 01:44:48.125574 | orchestrator | + fixed_ip_v6 = (known after apply) 2026-04-28 01:44:48.125580 | orchestrator | + mac = (known after apply) 2026-04-28 01:44:48.125586 | orchestrator | + name = (known after apply) 2026-04-28 01:44:48.125592 | orchestrator | + port = (known after apply) 2026-04-28 01:44:48.125599 | orchestrator | + uuid = (known after apply) 2026-04-28 01:44:48.125603 | orchestrator | } 2026-04-28 01:44:48.125607 | orchestrator | } 2026-04-28 01:44:48.125619 | orchestrator | 2026-04-28 01:44:48.125623 | orchestrator | # openstack_compute_instance_v2.node_server[0] will be created 2026-04-28 01:44:48.125627 | orchestrator | + resource "openstack_compute_instance_v2" "node_server" { 2026-04-28 01:44:48.125631 | orchestrator | + access_ip_v4 = (known after apply) 2026-04-28 01:44:48.125635 | orchestrator | + access_ip_v6 = (known after apply) 2026-04-28 01:44:48.125638 | orchestrator | + all_metadata = (known after apply) 2026-04-28 01:44:48.125642 | orchestrator | + all_tags = (known after apply) 2026-04-28 01:44:48.125646 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.125650 | orchestrator | + config_drive = true 2026-04-28 01:44:48.125653 | orchestrator | + created = (known after apply) 2026-04-28 01:44:48.125657 | orchestrator | + flavor_id = (known after apply) 2026-04-28 01:44:48.125661 | orchestrator | + flavor_name = "OSISM-8V-32" 2026-04-28 01:44:48.125665 | orchestrator | + force_delete = false 2026-04-28 01:44:48.125668 | orchestrator | + hypervisor_hostname = (known after apply) 2026-04-28 01:44:48.125672 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.125676 | orchestrator | + image_id = (known after apply) 2026-04-28 01:44:48.125680 | orchestrator | + image_name = (known after apply) 2026-04-28 01:44:48.125683 | orchestrator | + key_pair = "testbed" 2026-04-28 01:44:48.125687 | orchestrator | + name = "testbed-node-0" 2026-04-28 01:44:48.125691 | orchestrator | + power_state = "active" 2026-04-28 01:44:48.125694 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.125698 | orchestrator | + security_groups = (known after apply) 2026-04-28 01:44:48.125702 | orchestrator | + stop_before_destroy = false 2026-04-28 01:44:48.125705 | orchestrator | + updated = (known after apply) 2026-04-28 01:44:48.125709 | orchestrator | + user_data = "ae09e46b224a6ca206a9ed4f8f8a4f8520827854" 2026-04-28 01:44:48.125713 | orchestrator | 2026-04-28 01:44:48.125717 | orchestrator | + block_device { 2026-04-28 01:44:48.125720 | orchestrator | + boot_index = 0 2026-04-28 01:44:48.125724 | orchestrator | + delete_on_termination = false 2026-04-28 01:44:48.125728 | orchestrator | + destination_type = "volume" 2026-04-28 01:44:48.125731 | orchestrator | + multiattach = false 2026-04-28 01:44:48.125735 | orchestrator | + source_type = "volume" 2026-04-28 01:44:48.125739 | orchestrator | + uuid = (known after apply) 2026-04-28 01:44:48.125743 | orchestrator | } 2026-04-28 01:44:48.125746 | orchestrator | 2026-04-28 01:44:48.125750 | orchestrator | + network { 2026-04-28 01:44:48.125754 | orchestrator | + access_network = false 2026-04-28 01:44:48.125758 | orchestrator | + fixed_ip_v4 = (known after apply) 2026-04-28 01:44:48.125761 | orchestrator | + fixed_ip_v6 = (known after apply) 2026-04-28 01:44:48.125765 | orchestrator | + mac = (known after apply) 2026-04-28 01:44:48.125769 | orchestrator | + name = (known after apply) 2026-04-28 01:44:48.125773 | orchestrator | + port = (known after apply) 2026-04-28 01:44:48.125777 | orchestrator | + uuid = (known after apply) 2026-04-28 01:44:48.125780 | orchestrator | } 2026-04-28 01:44:48.125784 | orchestrator | } 2026-04-28 01:44:48.125788 | orchestrator | 2026-04-28 01:44:48.125792 | orchestrator | # openstack_compute_instance_v2.node_server[1] will be created 2026-04-28 01:44:48.125796 | orchestrator | + resource "openstack_compute_instance_v2" "node_server" { 2026-04-28 01:44:48.125799 | orchestrator | + access_ip_v4 = (known after apply) 2026-04-28 01:44:48.125807 | orchestrator | + access_ip_v6 = (known after apply) 2026-04-28 01:44:48.125811 | orchestrator | + all_metadata = (known after apply) 2026-04-28 01:44:48.125815 | orchestrator | + all_tags = (known after apply) 2026-04-28 01:44:48.125818 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.125822 | orchestrator | + config_drive = true 2026-04-28 01:44:48.125826 | orchestrator | + created = (known after apply) 2026-04-28 01:44:48.125830 | orchestrator | + flavor_id = (known after apply) 2026-04-28 01:44:48.125833 | orchestrator | + flavor_name = "OSISM-8V-32" 2026-04-28 01:44:48.125837 | orchestrator | + force_delete = false 2026-04-28 01:44:48.125841 | orchestrator | + hypervisor_hostname = (known after apply) 2026-04-28 01:44:48.125845 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.125849 | orchestrator | + image_id = (known after apply) 2026-04-28 01:44:48.125852 | orchestrator | + image_name = (known after apply) 2026-04-28 01:44:48.125856 | orchestrator | + key_pair = "testbed" 2026-04-28 01:44:48.125860 | orchestrator | + name = "testbed-node-1" 2026-04-28 01:44:48.125864 | orchestrator | + power_state = "active" 2026-04-28 01:44:48.125867 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.125871 | orchestrator | + security_groups = (known after apply) 2026-04-28 01:44:48.125875 | orchestrator | + stop_before_destroy = false 2026-04-28 01:44:48.125879 | orchestrator | + updated = (known after apply) 2026-04-28 01:44:48.125883 | orchestrator | + user_data = "ae09e46b224a6ca206a9ed4f8f8a4f8520827854" 2026-04-28 01:44:48.125887 | orchestrator | 2026-04-28 01:44:48.125890 | orchestrator | + block_device { 2026-04-28 01:44:48.125894 | orchestrator | + boot_index = 0 2026-04-28 01:44:48.125898 | orchestrator | + delete_on_termination = false 2026-04-28 01:44:48.125902 | orchestrator | + destination_type = "volume" 2026-04-28 01:44:48.125905 | orchestrator | + multiattach = false 2026-04-28 01:44:48.125909 | orchestrator | + source_type = "volume" 2026-04-28 01:44:48.125913 | orchestrator | + uuid = (known after apply) 2026-04-28 01:44:48.125917 | orchestrator | } 2026-04-28 01:44:48.125920 | orchestrator | 2026-04-28 01:44:48.125924 | orchestrator | + network { 2026-04-28 01:44:48.125928 | orchestrator | + access_network = false 2026-04-28 01:44:48.125932 | orchestrator | + fixed_ip_v4 = (known after apply) 2026-04-28 01:44:48.125935 | orchestrator | + fixed_ip_v6 = (known after apply) 2026-04-28 01:44:48.125939 | orchestrator | + mac = (known after apply) 2026-04-28 01:44:48.125943 | orchestrator | + name = (known after apply) 2026-04-28 01:44:48.125947 | orchestrator | + port = (known after apply) 2026-04-28 01:44:48.125950 | orchestrator | + uuid = (known after apply) 2026-04-28 01:44:48.125954 | orchestrator | } 2026-04-28 01:44:48.125958 | orchestrator | } 2026-04-28 01:44:48.125962 | orchestrator | 2026-04-28 01:44:48.125966 | orchestrator | # openstack_compute_instance_v2.node_server[2] will be created 2026-04-28 01:44:48.125970 | orchestrator | + resource "openstack_compute_instance_v2" "node_server" { 2026-04-28 01:44:48.125973 | orchestrator | + access_ip_v4 = (known after apply) 2026-04-28 01:44:48.125977 | orchestrator | + access_ip_v6 = (known after apply) 2026-04-28 01:44:48.125982 | orchestrator | + all_metadata = (known after apply) 2026-04-28 01:44:48.125985 | orchestrator | + all_tags = (known after apply) 2026-04-28 01:44:48.125992 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.125996 | orchestrator | + config_drive = true 2026-04-28 01:44:48.126004 | orchestrator | + created = (known after apply) 2026-04-28 01:44:48.126008 | orchestrator | + flavor_id = (known after apply) 2026-04-28 01:44:48.126012 | orchestrator | + flavor_name = "OSISM-8V-32" 2026-04-28 01:44:48.126040 | orchestrator | + force_delete = false 2026-04-28 01:44:48.126044 | orchestrator | + hypervisor_hostname = (known after apply) 2026-04-28 01:44:48.126048 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.126052 | orchestrator | + image_id = (known after apply) 2026-04-28 01:44:48.126060 | orchestrator | + image_name = (known after apply) 2026-04-28 01:44:48.126063 | orchestrator | + key_pair = "testbed" 2026-04-28 01:44:48.126067 | orchestrator | + name = "testbed-node-2" 2026-04-28 01:44:48.126071 | orchestrator | + power_state = "active" 2026-04-28 01:44:48.126075 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.126078 | orchestrator | + security_groups = (known after apply) 2026-04-28 01:44:48.126082 | orchestrator | + stop_before_destroy = false 2026-04-28 01:44:48.126086 | orchestrator | + updated = (known after apply) 2026-04-28 01:44:48.126090 | orchestrator | + user_data = "ae09e46b224a6ca206a9ed4f8f8a4f8520827854" 2026-04-28 01:44:48.126094 | orchestrator | 2026-04-28 01:44:48.126097 | orchestrator | + block_device { 2026-04-28 01:44:48.126101 | orchestrator | + boot_index = 0 2026-04-28 01:44:48.126105 | orchestrator | + delete_on_termination = false 2026-04-28 01:44:48.126109 | orchestrator | + destination_type = "volume" 2026-04-28 01:44:48.126112 | orchestrator | + multiattach = false 2026-04-28 01:44:48.126116 | orchestrator | + source_type = "volume" 2026-04-28 01:44:48.126120 | orchestrator | + uuid = (known after apply) 2026-04-28 01:44:48.126124 | orchestrator | } 2026-04-28 01:44:48.126128 | orchestrator | 2026-04-28 01:44:48.126131 | orchestrator | + network { 2026-04-28 01:44:48.126135 | orchestrator | + access_network = false 2026-04-28 01:44:48.126163 | orchestrator | + fixed_ip_v4 = (known after apply) 2026-04-28 01:44:48.126169 | orchestrator | + fixed_ip_v6 = (known after apply) 2026-04-28 01:44:48.126175 | orchestrator | + mac = (known after apply) 2026-04-28 01:44:48.126180 | orchestrator | + name = (known after apply) 2026-04-28 01:44:48.126186 | orchestrator | + port = (known after apply) 2026-04-28 01:44:48.126192 | orchestrator | + uuid = (known after apply) 2026-04-28 01:44:48.126199 | orchestrator | } 2026-04-28 01:44:48.126203 | orchestrator | } 2026-04-28 01:44:48.126207 | orchestrator | 2026-04-28 01:44:48.126211 | orchestrator | # openstack_compute_instance_v2.node_server[3] will be created 2026-04-28 01:44:48.126215 | orchestrator | + resource "openstack_compute_instance_v2" "node_server" { 2026-04-28 01:44:48.126219 | orchestrator | + access_ip_v4 = (known after apply) 2026-04-28 01:44:48.126223 | orchestrator | + access_ip_v6 = (known after apply) 2026-04-28 01:44:48.126226 | orchestrator | + all_metadata = (known after apply) 2026-04-28 01:44:48.126230 | orchestrator | + all_tags = (known after apply) 2026-04-28 01:44:48.126234 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.126238 | orchestrator | + config_drive = true 2026-04-28 01:44:48.126241 | orchestrator | + created = (known after apply) 2026-04-28 01:44:48.126245 | orchestrator | + flavor_id = (known after apply) 2026-04-28 01:44:48.126249 | orchestrator | + flavor_name = "OSISM-8V-32" 2026-04-28 01:44:48.126253 | orchestrator | + force_delete = false 2026-04-28 01:44:48.126257 | orchestrator | + hypervisor_hostname = (known after apply) 2026-04-28 01:44:48.126260 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.126264 | orchestrator | + image_id = (known after apply) 2026-04-28 01:44:48.126268 | orchestrator | + image_name = (known after apply) 2026-04-28 01:44:48.126272 | orchestrator | + key_pair = "testbed" 2026-04-28 01:44:48.126275 | orchestrator | + name = "testbed-node-3" 2026-04-28 01:44:48.126279 | orchestrator | + power_state = "active" 2026-04-28 01:44:48.126283 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.126286 | orchestrator | + security_groups = (known after apply) 2026-04-28 01:44:48.126290 | orchestrator | + stop_before_destroy = false 2026-04-28 01:44:48.126294 | orchestrator | + updated = (known after apply) 2026-04-28 01:44:48.126298 | orchestrator | + user_data = "ae09e46b224a6ca206a9ed4f8f8a4f8520827854" 2026-04-28 01:44:48.126302 | orchestrator | 2026-04-28 01:44:48.126305 | orchestrator | + block_device { 2026-04-28 01:44:48.126313 | orchestrator | + boot_index = 0 2026-04-28 01:44:48.126317 | orchestrator | + delete_on_termination = false 2026-04-28 01:44:48.126321 | orchestrator | + destination_type = "volume" 2026-04-28 01:44:48.126329 | orchestrator | + multiattach = false 2026-04-28 01:44:48.126332 | orchestrator | + source_type = "volume" 2026-04-28 01:44:48.126336 | orchestrator | + uuid = (known after apply) 2026-04-28 01:44:48.126341 | orchestrator | } 2026-04-28 01:44:48.126346 | orchestrator | 2026-04-28 01:44:48.126352 | orchestrator | + network { 2026-04-28 01:44:48.126358 | orchestrator | + access_network = false 2026-04-28 01:44:48.126363 | orchestrator | + fixed_ip_v4 = (known after apply) 2026-04-28 01:44:48.126368 | orchestrator | + fixed_ip_v6 = (known after apply) 2026-04-28 01:44:48.126378 | orchestrator | + mac = (known after apply) 2026-04-28 01:44:48.126385 | orchestrator | + name = (known after apply) 2026-04-28 01:44:48.126391 | orchestrator | + port = (known after apply) 2026-04-28 01:44:48.126397 | orchestrator | + uuid = (known after apply) 2026-04-28 01:44:48.126403 | orchestrator | } 2026-04-28 01:44:48.126408 | orchestrator | } 2026-04-28 01:44:48.126413 | orchestrator | 2026-04-28 01:44:48.126419 | orchestrator | # openstack_compute_instance_v2.node_server[4] will be created 2026-04-28 01:44:48.126425 | orchestrator | + resource "openstack_compute_instance_v2" "node_server" { 2026-04-28 01:44:48.126431 | orchestrator | + access_ip_v4 = (known after apply) 2026-04-28 01:44:48.126436 | orchestrator | + access_ip_v6 = (known after apply) 2026-04-28 01:44:48.126442 | orchestrator | + all_metadata = (known after apply) 2026-04-28 01:44:48.126448 | orchestrator | + all_tags = (known after apply) 2026-04-28 01:44:48.126454 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.126460 | orchestrator | + config_drive = true 2026-04-28 01:44:48.126466 | orchestrator | + created = (known after apply) 2026-04-28 01:44:48.126472 | orchestrator | + flavor_id = (known after apply) 2026-04-28 01:44:48.126478 | orchestrator | + flavor_name = "OSISM-8V-32" 2026-04-28 01:44:48.126484 | orchestrator | + force_delete = false 2026-04-28 01:44:48.126490 | orchestrator | + hypervisor_hostname = (known after apply) 2026-04-28 01:44:48.126496 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.126502 | orchestrator | + image_id = (known after apply) 2026-04-28 01:44:48.126508 | orchestrator | + image_name = (known after apply) 2026-04-28 01:44:48.126514 | orchestrator | + key_pair = "testbed" 2026-04-28 01:44:48.126520 | orchestrator | + name = "testbed-node-4" 2026-04-28 01:44:48.126532 | orchestrator | + power_state = "active" 2026-04-28 01:44:48.126539 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.126545 | orchestrator | + security_groups = (known after apply) 2026-04-28 01:44:48.126551 | orchestrator | + stop_before_destroy = false 2026-04-28 01:44:48.126557 | orchestrator | + updated = (known after apply) 2026-04-28 01:44:48.126564 | orchestrator | + user_data = "ae09e46b224a6ca206a9ed4f8f8a4f8520827854" 2026-04-28 01:44:48.126569 | orchestrator | 2026-04-28 01:44:48.126576 | orchestrator | + block_device { 2026-04-28 01:44:48.126600 | orchestrator | + boot_index = 0 2026-04-28 01:44:48.126605 | orchestrator | + delete_on_termination = false 2026-04-28 01:44:48.126608 | orchestrator | + destination_type = "volume" 2026-04-28 01:44:48.126612 | orchestrator | + multiattach = false 2026-04-28 01:44:48.126616 | orchestrator | + source_type = "volume" 2026-04-28 01:44:48.126620 | orchestrator | + uuid = (known after apply) 2026-04-28 01:44:48.126624 | orchestrator | } 2026-04-28 01:44:48.126628 | orchestrator | 2026-04-28 01:44:48.126631 | orchestrator | + network { 2026-04-28 01:44:48.126635 | orchestrator | + access_network = false 2026-04-28 01:44:48.126639 | orchestrator | + fixed_ip_v4 = (known after apply) 2026-04-28 01:44:48.126643 | orchestrator | + fixed_ip_v6 = (known after apply) 2026-04-28 01:44:48.126647 | orchestrator | + mac = (known after apply) 2026-04-28 01:44:48.126651 | orchestrator | + name = (known after apply) 2026-04-28 01:44:48.126655 | orchestrator | + port = (known after apply) 2026-04-28 01:44:48.126658 | orchestrator | + uuid = (known after apply) 2026-04-28 01:44:48.126662 | orchestrator | } 2026-04-28 01:44:48.126666 | orchestrator | } 2026-04-28 01:44:48.126676 | orchestrator | 2026-04-28 01:44:48.126681 | orchestrator | # openstack_compute_instance_v2.node_server[5] will be created 2026-04-28 01:44:48.126685 | orchestrator | + resource "openstack_compute_instance_v2" "node_server" { 2026-04-28 01:44:48.126691 | orchestrator | + access_ip_v4 = (known after apply) 2026-04-28 01:44:48.126697 | orchestrator | + access_ip_v6 = (known after apply) 2026-04-28 01:44:48.126702 | orchestrator | + all_metadata = (known after apply) 2026-04-28 01:44:48.126708 | orchestrator | + all_tags = (known after apply) 2026-04-28 01:44:48.126714 | orchestrator | + availability_zone = "nova" 2026-04-28 01:44:48.126719 | orchestrator | + config_drive = true 2026-04-28 01:44:48.126725 | orchestrator | + created = (known after apply) 2026-04-28 01:44:48.126731 | orchestrator | + flavor_id = (known after apply) 2026-04-28 01:44:48.126736 | orchestrator | + flavor_name = "OSISM-8V-32" 2026-04-28 01:44:48.126742 | orchestrator | + force_delete = false 2026-04-28 01:44:48.126763 | orchestrator | + hypervisor_hostname = (known after apply) 2026-04-28 01:44:48.126769 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.126776 | orchestrator | + image_id = (known after apply) 2026-04-28 01:44:48.126782 | orchestrator | + image_name = (known after apply) 2026-04-28 01:44:48.126787 | orchestrator | + key_pair = "testbed" 2026-04-28 01:44:48.126793 | orchestrator | + name = "testbed-node-5" 2026-04-28 01:44:48.126799 | orchestrator | + power_state = "active" 2026-04-28 01:44:48.126804 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.126810 | orchestrator | + security_groups = (known after apply) 2026-04-28 01:44:48.126816 | orchestrator | + stop_before_destroy = false 2026-04-28 01:44:48.126822 | orchestrator | + updated = (known after apply) 2026-04-28 01:44:48.126828 | orchestrator | + user_data = "ae09e46b224a6ca206a9ed4f8f8a4f8520827854" 2026-04-28 01:44:48.126833 | orchestrator | 2026-04-28 01:44:48.126839 | orchestrator | + block_device { 2026-04-28 01:44:48.126845 | orchestrator | + boot_index = 0 2026-04-28 01:44:48.126850 | orchestrator | + delete_on_termination = false 2026-04-28 01:44:48.126857 | orchestrator | + destination_type = "volume" 2026-04-28 01:44:48.126863 | orchestrator | + multiattach = false 2026-04-28 01:44:48.126869 | orchestrator | + source_type = "volume" 2026-04-28 01:44:48.126875 | orchestrator | + uuid = (known after apply) 2026-04-28 01:44:48.126880 | orchestrator | } 2026-04-28 01:44:48.126886 | orchestrator | 2026-04-28 01:44:48.126892 | orchestrator | + network { 2026-04-28 01:44:48.126897 | orchestrator | + access_network = false 2026-04-28 01:44:48.126903 | orchestrator | + fixed_ip_v4 = (known after apply) 2026-04-28 01:44:48.126909 | orchestrator | + fixed_ip_v6 = (known after apply) 2026-04-28 01:44:48.126915 | orchestrator | + mac = (known after apply) 2026-04-28 01:44:48.126922 | orchestrator | + name = (known after apply) 2026-04-28 01:44:48.126928 | orchestrator | + port = (known after apply) 2026-04-28 01:44:48.126935 | orchestrator | + uuid = (known after apply) 2026-04-28 01:44:48.126940 | orchestrator | } 2026-04-28 01:44:48.126946 | orchestrator | } 2026-04-28 01:44:48.126952 | orchestrator | 2026-04-28 01:44:48.126959 | orchestrator | # openstack_compute_keypair_v2.key will be created 2026-04-28 01:44:48.126965 | orchestrator | + resource "openstack_compute_keypair_v2" "key" { 2026-04-28 01:44:48.126972 | orchestrator | + fingerprint = (known after apply) 2026-04-28 01:44:48.126978 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.126984 | orchestrator | + name = "testbed" 2026-04-28 01:44:48.126990 | orchestrator | + private_key = (sensitive value) 2026-04-28 01:44:48.126996 | orchestrator | + public_key = (known after apply) 2026-04-28 01:44:48.127003 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.127008 | orchestrator | + user_id = (known after apply) 2026-04-28 01:44:48.127015 | orchestrator | } 2026-04-28 01:44:48.127022 | orchestrator | 2026-04-28 01:44:48.127026 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[0] will be created 2026-04-28 01:44:48.127030 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-28 01:44:48.127039 | orchestrator | + device = (known after apply) 2026-04-28 01:44:48.127043 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.127047 | orchestrator | + instance_id = (known after apply) 2026-04-28 01:44:48.127051 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.127054 | orchestrator | + volume_id = (known after apply) 2026-04-28 01:44:48.127058 | orchestrator | } 2026-04-28 01:44:48.127062 | orchestrator | 2026-04-28 01:44:48.127066 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[1] will be created 2026-04-28 01:44:48.127069 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-28 01:44:48.127073 | orchestrator | + device = (known after apply) 2026-04-28 01:44:48.127077 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.127080 | orchestrator | + instance_id = (known after apply) 2026-04-28 01:44:48.127084 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.127088 | orchestrator | + volume_id = (known after apply) 2026-04-28 01:44:48.127092 | orchestrator | } 2026-04-28 01:44:48.127096 | orchestrator | 2026-04-28 01:44:48.127099 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[2] will be created 2026-04-28 01:44:48.127103 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-28 01:44:48.127111 | orchestrator | + device = (known after apply) 2026-04-28 01:44:48.127115 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.127119 | orchestrator | + instance_id = (known after apply) 2026-04-28 01:44:48.127123 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.127126 | orchestrator | + volume_id = (known after apply) 2026-04-28 01:44:48.127130 | orchestrator | } 2026-04-28 01:44:48.127134 | orchestrator | 2026-04-28 01:44:48.127151 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[3] will be created 2026-04-28 01:44:48.127156 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-28 01:44:48.127159 | orchestrator | + device = (known after apply) 2026-04-28 01:44:48.127163 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.127167 | orchestrator | + instance_id = (known after apply) 2026-04-28 01:44:48.127171 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.127174 | orchestrator | + volume_id = (known after apply) 2026-04-28 01:44:48.127178 | orchestrator | } 2026-04-28 01:44:48.127182 | orchestrator | 2026-04-28 01:44:48.127186 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[4] will be created 2026-04-28 01:44:48.127190 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-28 01:44:48.127194 | orchestrator | + device = (known after apply) 2026-04-28 01:44:48.127197 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.127201 | orchestrator | + instance_id = (known after apply) 2026-04-28 01:44:48.127209 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.127213 | orchestrator | + volume_id = (known after apply) 2026-04-28 01:44:48.127216 | orchestrator | } 2026-04-28 01:44:48.127220 | orchestrator | 2026-04-28 01:44:48.127224 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[5] will be created 2026-04-28 01:44:48.127228 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-28 01:44:48.127232 | orchestrator | + device = (known after apply) 2026-04-28 01:44:48.127236 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.127239 | orchestrator | + instance_id = (known after apply) 2026-04-28 01:44:48.127243 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.127247 | orchestrator | + volume_id = (known after apply) 2026-04-28 01:44:48.127251 | orchestrator | } 2026-04-28 01:44:48.127255 | orchestrator | 2026-04-28 01:44:48.127258 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[6] will be created 2026-04-28 01:44:48.127262 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-28 01:44:48.127266 | orchestrator | + device = (known after apply) 2026-04-28 01:44:48.127270 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.127274 | orchestrator | + instance_id = (known after apply) 2026-04-28 01:44:48.127277 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.127285 | orchestrator | + volume_id = (known after apply) 2026-04-28 01:44:48.127289 | orchestrator | } 2026-04-28 01:44:48.127293 | orchestrator | 2026-04-28 01:44:48.127297 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[7] will be created 2026-04-28 01:44:48.127301 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-28 01:44:48.127304 | orchestrator | + device = (known after apply) 2026-04-28 01:44:48.127308 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.127312 | orchestrator | + instance_id = (known after apply) 2026-04-28 01:44:48.127316 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.127320 | orchestrator | + volume_id = (known after apply) 2026-04-28 01:44:48.127323 | orchestrator | } 2026-04-28 01:44:48.127327 | orchestrator | 2026-04-28 01:44:48.127331 | orchestrator | # openstack_compute_volume_attach_v2.node_volume_attachment[8] will be created 2026-04-28 01:44:48.127335 | orchestrator | + resource "openstack_compute_volume_attach_v2" "node_volume_attachment" { 2026-04-28 01:44:48.127339 | orchestrator | + device = (known after apply) 2026-04-28 01:44:48.127342 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.127346 | orchestrator | + instance_id = (known after apply) 2026-04-28 01:44:48.127350 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.127353 | orchestrator | + volume_id = (known after apply) 2026-04-28 01:44:48.127357 | orchestrator | } 2026-04-28 01:44:48.127361 | orchestrator | 2026-04-28 01:44:48.127365 | orchestrator | # openstack_networking_floatingip_associate_v2.manager_floating_ip_association will be created 2026-04-28 01:44:48.127370 | orchestrator | + resource "openstack_networking_floatingip_associate_v2" "manager_floating_ip_association" { 2026-04-28 01:44:48.127374 | orchestrator | + fixed_ip = (known after apply) 2026-04-28 01:44:48.127378 | orchestrator | + floating_ip = (known after apply) 2026-04-28 01:44:48.127382 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.127386 | orchestrator | + port_id = (known after apply) 2026-04-28 01:44:48.127389 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.127393 | orchestrator | } 2026-04-28 01:44:48.127397 | orchestrator | 2026-04-28 01:44:48.127401 | orchestrator | # openstack_networking_floatingip_v2.manager_floating_ip will be created 2026-04-28 01:44:48.127405 | orchestrator | + resource "openstack_networking_floatingip_v2" "manager_floating_ip" { 2026-04-28 01:44:48.127408 | orchestrator | + address = (known after apply) 2026-04-28 01:44:48.127412 | orchestrator | + all_tags = (known after apply) 2026-04-28 01:44:48.127416 | orchestrator | + dns_domain = (known after apply) 2026-04-28 01:44:48.127420 | orchestrator | + dns_name = (known after apply) 2026-04-28 01:44:48.127423 | orchestrator | + fixed_ip = (known after apply) 2026-04-28 01:44:48.127427 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.127431 | orchestrator | + pool = "public" 2026-04-28 01:44:48.127435 | orchestrator | + port_id = (known after apply) 2026-04-28 01:44:48.127438 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.127442 | orchestrator | + subnet_id = (known after apply) 2026-04-28 01:44:48.127446 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.127450 | orchestrator | } 2026-04-28 01:44:48.127453 | orchestrator | 2026-04-28 01:44:48.127457 | orchestrator | # openstack_networking_network_v2.net_management will be created 2026-04-28 01:44:48.127461 | orchestrator | + resource "openstack_networking_network_v2" "net_management" { 2026-04-28 01:44:48.127465 | orchestrator | + admin_state_up = (known after apply) 2026-04-28 01:44:48.127469 | orchestrator | + all_tags = (known after apply) 2026-04-28 01:44:48.127472 | orchestrator | + availability_zone_hints = [ 2026-04-28 01:44:48.127476 | orchestrator | + "nova", 2026-04-28 01:44:48.127481 | orchestrator | ] 2026-04-28 01:44:48.127488 | orchestrator | + dns_domain = (known after apply) 2026-04-28 01:44:48.127494 | orchestrator | + external = (known after apply) 2026-04-28 01:44:48.127499 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.127505 | orchestrator | + mtu = (known after apply) 2026-04-28 01:44:48.127511 | orchestrator | + name = "net-testbed-management" 2026-04-28 01:44:48.127520 | orchestrator | + port_security_enabled = (known after apply) 2026-04-28 01:44:48.127530 | orchestrator | + qos_policy_id = (known after apply) 2026-04-28 01:44:48.127536 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.127542 | orchestrator | + shared = (known after apply) 2026-04-28 01:44:48.127548 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.127555 | orchestrator | + transparent_vlan = (known after apply) 2026-04-28 01:44:48.127560 | orchestrator | 2026-04-28 01:44:48.127566 | orchestrator | + segments (known after apply) 2026-04-28 01:44:48.127574 | orchestrator | } 2026-04-28 01:44:48.127577 | orchestrator | 2026-04-28 01:44:48.127581 | orchestrator | # openstack_networking_port_v2.manager_port_management will be created 2026-04-28 01:44:48.127585 | orchestrator | + resource "openstack_networking_port_v2" "manager_port_management" { 2026-04-28 01:44:48.127589 | orchestrator | + admin_state_up = (known after apply) 2026-04-28 01:44:48.127592 | orchestrator | + all_fixed_ips = (known after apply) 2026-04-28 01:44:48.127596 | orchestrator | + all_security_group_ids = (known after apply) 2026-04-28 01:44:48.127603 | orchestrator | + all_tags = (known after apply) 2026-04-28 01:44:48.127607 | orchestrator | + device_id = (known after apply) 2026-04-28 01:44:48.127611 | orchestrator | + device_owner = (known after apply) 2026-04-28 01:44:48.127615 | orchestrator | + dns_assignment = (known after apply) 2026-04-28 01:44:48.127618 | orchestrator | + dns_name = (known after apply) 2026-04-28 01:44:48.127622 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.127626 | orchestrator | + mac_address = (known after apply) 2026-04-28 01:44:48.127629 | orchestrator | + network_id = (known after apply) 2026-04-28 01:44:48.127633 | orchestrator | + port_security_enabled = (known after apply) 2026-04-28 01:44:48.127637 | orchestrator | + qos_policy_id = (known after apply) 2026-04-28 01:44:48.127640 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.127644 | orchestrator | + security_group_ids = (known after apply) 2026-04-28 01:44:48.127648 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.127652 | orchestrator | 2026-04-28 01:44:48.127655 | orchestrator | + allowed_address_pairs { 2026-04-28 01:44:48.127659 | orchestrator | + ip_address = "192.168.16.8/32" 2026-04-28 01:44:48.127663 | orchestrator | } 2026-04-28 01:44:48.127667 | orchestrator | 2026-04-28 01:44:48.127670 | orchestrator | + binding (known after apply) 2026-04-28 01:44:48.127674 | orchestrator | 2026-04-28 01:44:48.127678 | orchestrator | + fixed_ip { 2026-04-28 01:44:48.127682 | orchestrator | + ip_address = "192.168.16.5" 2026-04-28 01:44:48.127686 | orchestrator | + subnet_id = (known after apply) 2026-04-28 01:44:48.127689 | orchestrator | } 2026-04-28 01:44:48.127693 | orchestrator | } 2026-04-28 01:44:48.127697 | orchestrator | 2026-04-28 01:44:48.127701 | orchestrator | # openstack_networking_port_v2.node_port_management[0] will be created 2026-04-28 01:44:48.127705 | orchestrator | + resource "openstack_networking_port_v2" "node_port_management" { 2026-04-28 01:44:48.127708 | orchestrator | + admin_state_up = (known after apply) 2026-04-28 01:44:48.127712 | orchestrator | + all_fixed_ips = (known after apply) 2026-04-28 01:44:48.127716 | orchestrator | + all_security_group_ids = (known after apply) 2026-04-28 01:44:48.127720 | orchestrator | + all_tags = (known after apply) 2026-04-28 01:44:48.127724 | orchestrator | + device_id = (known after apply) 2026-04-28 01:44:48.127727 | orchestrator | + device_owner = (known after apply) 2026-04-28 01:44:48.127731 | orchestrator | + dns_assignment = (known after apply) 2026-04-28 01:44:48.127735 | orchestrator | + dns_name = (known after apply) 2026-04-28 01:44:48.127739 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.127742 | orchestrator | + mac_address = (known after apply) 2026-04-28 01:44:48.127746 | orchestrator | + network_id = (known after apply) 2026-04-28 01:44:48.127750 | orchestrator | + port_security_enabled = (known after apply) 2026-04-28 01:44:48.127754 | orchestrator | + qos_policy_id = (known after apply) 2026-04-28 01:44:48.127757 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.127765 | orchestrator | + security_group_ids = (known after apply) 2026-04-28 01:44:48.127769 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.127773 | orchestrator | 2026-04-28 01:44:48.127777 | orchestrator | + allowed_address_pairs { 2026-04-28 01:44:48.127781 | orchestrator | + ip_address = "192.168.16.254/32" 2026-04-28 01:44:48.127785 | orchestrator | } 2026-04-28 01:44:48.127789 | orchestrator | + allowed_address_pairs { 2026-04-28 01:44:48.127793 | orchestrator | + ip_address = "192.168.16.8/32" 2026-04-28 01:44:48.127796 | orchestrator | } 2026-04-28 01:44:48.127800 | orchestrator | + allowed_address_pairs { 2026-04-28 01:44:48.127804 | orchestrator | + ip_address = "192.168.16.9/32" 2026-04-28 01:44:48.127808 | orchestrator | } 2026-04-28 01:44:48.127812 | orchestrator | 2026-04-28 01:44:48.127816 | orchestrator | + binding (known after apply) 2026-04-28 01:44:48.127819 | orchestrator | 2026-04-28 01:44:48.127823 | orchestrator | + fixed_ip { 2026-04-28 01:44:48.127827 | orchestrator | + ip_address = "192.168.16.10" 2026-04-28 01:44:48.127831 | orchestrator | + subnet_id = (known after apply) 2026-04-28 01:44:48.127834 | orchestrator | } 2026-04-28 01:44:48.127838 | orchestrator | } 2026-04-28 01:44:48.127842 | orchestrator | 2026-04-28 01:44:48.127846 | orchestrator | # openstack_networking_port_v2.node_port_management[1] will be created 2026-04-28 01:44:48.127850 | orchestrator | + resource "openstack_networking_port_v2" "node_port_management" { 2026-04-28 01:44:48.127853 | orchestrator | + admin_state_up = (known after apply) 2026-04-28 01:44:48.127857 | orchestrator | + all_fixed_ips = (known after apply) 2026-04-28 01:44:48.127861 | orchestrator | + all_security_group_ids = (known after apply) 2026-04-28 01:44:48.127865 | orchestrator | + all_tags = (known after apply) 2026-04-28 01:44:48.127869 | orchestrator | + device_id = (known after apply) 2026-04-28 01:44:48.127872 | orchestrator | + device_owner = (known after apply) 2026-04-28 01:44:48.127876 | orchestrator | + dns_assignment = (known after apply) 2026-04-28 01:44:48.127880 | orchestrator | + dns_name = (known after apply) 2026-04-28 01:44:48.127884 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.127887 | orchestrator | + mac_address = (known after apply) 2026-04-28 01:44:48.127891 | orchestrator | + network_id = (known after apply) 2026-04-28 01:44:48.127896 | orchestrator | + port_security_enabled = (known after apply) 2026-04-28 01:44:48.127902 | orchestrator | + qos_policy_id = (known after apply) 2026-04-28 01:44:48.127908 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.127917 | orchestrator | + security_group_ids = (known after apply) 2026-04-28 01:44:48.127923 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.127929 | orchestrator | 2026-04-28 01:44:48.127935 | orchestrator | + allowed_address_pairs { 2026-04-28 01:44:48.127941 | orchestrator | + ip_address = "192.168.16.254/32" 2026-04-28 01:44:48.127947 | orchestrator | } 2026-04-28 01:44:48.127968 | orchestrator | + allowed_address_pairs { 2026-04-28 01:44:48.127981 | orchestrator | + ip_address = "192.168.16.8/32" 2026-04-28 01:44:48.127985 | orchestrator | } 2026-04-28 01:44:48.127989 | orchestrator | + allowed_address_pairs { 2026-04-28 01:44:48.127993 | orchestrator | + ip_address = "192.168.16.9/32" 2026-04-28 01:44:48.127999 | orchestrator | } 2026-04-28 01:44:48.128005 | orchestrator | 2026-04-28 01:44:48.128010 | orchestrator | + binding (known after apply) 2026-04-28 01:44:48.128015 | orchestrator | 2026-04-28 01:44:48.128020 | orchestrator | + fixed_ip { 2026-04-28 01:44:48.128025 | orchestrator | + ip_address = "192.168.16.11" 2026-04-28 01:44:48.128031 | orchestrator | + subnet_id = (known after apply) 2026-04-28 01:44:48.128036 | orchestrator | } 2026-04-28 01:44:48.128042 | orchestrator | } 2026-04-28 01:44:48.128048 | orchestrator | 2026-04-28 01:44:48.128054 | orchestrator | # openstack_networking_port_v2.node_port_management[2] will be created 2026-04-28 01:44:48.128060 | orchestrator | + resource "openstack_networking_port_v2" "node_port_management" { 2026-04-28 01:44:48.128067 | orchestrator | + admin_state_up = (known after apply) 2026-04-28 01:44:48.128071 | orchestrator | + all_fixed_ips = (known after apply) 2026-04-28 01:44:48.128075 | orchestrator | + all_security_group_ids = (known after apply) 2026-04-28 01:44:48.128079 | orchestrator | + all_tags = (known after apply) 2026-04-28 01:44:48.128087 | orchestrator | + device_id = (known after apply) 2026-04-28 01:44:48.128091 | orchestrator | + device_owner = (known after apply) 2026-04-28 01:44:48.128095 | orchestrator | + dns_assignment = (known after apply) 2026-04-28 01:44:48.128099 | orchestrator | + dns_name = (known after apply) 2026-04-28 01:44:48.128110 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.128113 | orchestrator | + mac_address = (known after apply) 2026-04-28 01:44:48.128117 | orchestrator | + network_id = (known after apply) 2026-04-28 01:44:48.128121 | orchestrator | + port_security_enabled = (known after apply) 2026-04-28 01:44:48.128125 | orchestrator | + qos_policy_id = (known after apply) 2026-04-28 01:44:48.128129 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.128132 | orchestrator | + security_group_ids = (known after apply) 2026-04-28 01:44:48.128136 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.128173 | orchestrator | 2026-04-28 01:44:48.128177 | orchestrator | + allowed_address_pairs { 2026-04-28 01:44:48.128181 | orchestrator | + ip_address = "192.168.16.254/32" 2026-04-28 01:44:48.128185 | orchestrator | } 2026-04-28 01:44:48.128189 | orchestrator | + allowed_address_pairs { 2026-04-28 01:44:48.128193 | orchestrator | + ip_address = "192.168.16.8/32" 2026-04-28 01:44:48.128197 | orchestrator | } 2026-04-28 01:44:48.128201 | orchestrator | + allowed_address_pairs { 2026-04-28 01:44:48.128204 | orchestrator | + ip_address = "192.168.16.9/32" 2026-04-28 01:44:48.128208 | orchestrator | } 2026-04-28 01:44:48.128212 | orchestrator | 2026-04-28 01:44:48.128216 | orchestrator | + binding (known after apply) 2026-04-28 01:44:48.128219 | orchestrator | 2026-04-28 01:44:48.128223 | orchestrator | + fixed_ip { 2026-04-28 01:44:48.128227 | orchestrator | + ip_address = "192.168.16.12" 2026-04-28 01:44:48.128231 | orchestrator | + subnet_id = (known after apply) 2026-04-28 01:44:48.128235 | orchestrator | } 2026-04-28 01:44:48.128239 | orchestrator | } 2026-04-28 01:44:48.128242 | orchestrator | 2026-04-28 01:44:48.128246 | orchestrator | # openstack_networking_port_v2.node_port_management[3] will be created 2026-04-28 01:44:48.128250 | orchestrator | + resource "openstack_networking_port_v2" "node_port_management" { 2026-04-28 01:44:48.128254 | orchestrator | + admin_state_up = (known after apply) 2026-04-28 01:44:48.128258 | orchestrator | + all_fixed_ips = (known after apply) 2026-04-28 01:44:48.128262 | orchestrator | + all_security_group_ids = (known after apply) 2026-04-28 01:44:48.128266 | orchestrator | + all_tags = (known after apply) 2026-04-28 01:44:48.128269 | orchestrator | + device_id = (known after apply) 2026-04-28 01:44:48.128273 | orchestrator | + device_owner = (known after apply) 2026-04-28 01:44:48.128277 | orchestrator | + dns_assignment = (known after apply) 2026-04-28 01:44:48.128281 | orchestrator | + dns_name = (known after apply) 2026-04-28 01:44:48.128284 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.128288 | orchestrator | + mac_address = (known after apply) 2026-04-28 01:44:48.128292 | orchestrator | + network_id = (known after apply) 2026-04-28 01:44:48.128296 | orchestrator | + port_security_enabled = (known after apply) 2026-04-28 01:44:48.128300 | orchestrator | + qos_policy_id = (known after apply) 2026-04-28 01:44:48.128303 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.128307 | orchestrator | + security_group_ids = (known after apply) 2026-04-28 01:44:48.128311 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.128315 | orchestrator | 2026-04-28 01:44:48.128319 | orchestrator | + allowed_address_pairs { 2026-04-28 01:44:48.128322 | orchestrator | + ip_address = "192.168.16.254/32" 2026-04-28 01:44:48.128326 | orchestrator | } 2026-04-28 01:44:48.128330 | orchestrator | + allowed_address_pairs { 2026-04-28 01:44:48.128334 | orchestrator | + ip_address = "192.168.16.8/32" 2026-04-28 01:44:48.128338 | orchestrator | } 2026-04-28 01:44:48.128341 | orchestrator | + allowed_address_pairs { 2026-04-28 01:44:48.128345 | orchestrator | + ip_address = "192.168.16.9/32" 2026-04-28 01:44:48.128349 | orchestrator | } 2026-04-28 01:44:48.128353 | orchestrator | 2026-04-28 01:44:48.128360 | orchestrator | + binding (known after apply) 2026-04-28 01:44:48.128364 | orchestrator | 2026-04-28 01:44:48.128368 | orchestrator | + fixed_ip { 2026-04-28 01:44:48.128372 | orchestrator | + ip_address = "192.168.16.13" 2026-04-28 01:44:48.128375 | orchestrator | + subnet_id = (known after apply) 2026-04-28 01:44:48.128379 | orchestrator | } 2026-04-28 01:44:48.128383 | orchestrator | } 2026-04-28 01:44:48.128387 | orchestrator | 2026-04-28 01:44:48.128391 | orchestrator | # openstack_networking_port_v2.node_port_management[4] will be created 2026-04-28 01:44:48.128394 | orchestrator | + resource "openstack_networking_port_v2" "node_port_management" { 2026-04-28 01:44:48.128398 | orchestrator | + admin_state_up = (known after apply) 2026-04-28 01:44:48.128403 | orchestrator | + all_fixed_ips = (known after apply) 2026-04-28 01:44:48.128406 | orchestrator | + all_security_group_ids = (known after apply) 2026-04-28 01:44:48.128410 | orchestrator | + all_tags = (known after apply) 2026-04-28 01:44:48.128414 | orchestrator | + device_id = (known after apply) 2026-04-28 01:44:48.128418 | orchestrator | + device_owner = (known after apply) 2026-04-28 01:44:48.128422 | orchestrator | + dns_assignment = (known after apply) 2026-04-28 01:44:48.128426 | orchestrator | + dns_name = (known after apply) 2026-04-28 01:44:48.128429 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.128433 | orchestrator | + mac_address = (known after apply) 2026-04-28 01:44:48.128437 | orchestrator | + network_id = (known after apply) 2026-04-28 01:44:48.128441 | orchestrator | + port_security_enabled = (known after apply) 2026-04-28 01:44:48.128444 | orchestrator | + qos_policy_id = (known after apply) 2026-04-28 01:44:48.128448 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.128452 | orchestrator | + security_group_ids = (known after apply) 2026-04-28 01:44:48.128456 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.128461 | orchestrator | 2026-04-28 01:44:48.128467 | orchestrator | + allowed_address_pairs { 2026-04-28 01:44:48.128471 | orchestrator | + ip_address = "192.168.16.254/32" 2026-04-28 01:44:48.128475 | orchestrator | } 2026-04-28 01:44:48.128479 | orchestrator | + allowed_address_pairs { 2026-04-28 01:44:48.128485 | orchestrator | + ip_address = "192.168.16.8/32" 2026-04-28 01:44:48.128491 | orchestrator | } 2026-04-28 01:44:48.128497 | orchestrator | + allowed_address_pairs { 2026-04-28 01:44:48.128503 | orchestrator | + ip_address = "192.168.16.9/32" 2026-04-28 01:44:48.128508 | orchestrator | } 2026-04-28 01:44:48.128514 | orchestrator | 2026-04-28 01:44:48.128520 | orchestrator | + binding (known after apply) 2026-04-28 01:44:48.128526 | orchestrator | 2026-04-28 01:44:48.128533 | orchestrator | + fixed_ip { 2026-04-28 01:44:48.128539 | orchestrator | + ip_address = "192.168.16.14" 2026-04-28 01:44:48.128545 | orchestrator | + subnet_id = (known after apply) 2026-04-28 01:44:48.128551 | orchestrator | } 2026-04-28 01:44:48.128557 | orchestrator | } 2026-04-28 01:44:48.128561 | orchestrator | 2026-04-28 01:44:48.128564 | orchestrator | # openstack_networking_port_v2.node_port_management[5] will be created 2026-04-28 01:44:48.128568 | orchestrator | + resource "openstack_networking_port_v2" "node_port_management" { 2026-04-28 01:44:48.128572 | orchestrator | + admin_state_up = (known after apply) 2026-04-28 01:44:48.128576 | orchestrator | + all_fixed_ips = (known after apply) 2026-04-28 01:44:48.128580 | orchestrator | + all_security_group_ids = (known after apply) 2026-04-28 01:44:48.128584 | orchestrator | + all_tags = (known after apply) 2026-04-28 01:44:48.128587 | orchestrator | + device_id = (known after apply) 2026-04-28 01:44:48.128591 | orchestrator | + device_owner = (known after apply) 2026-04-28 01:44:48.128595 | orchestrator | + dns_assignment = (known after apply) 2026-04-28 01:44:48.128599 | orchestrator | + dns_name = (known after apply) 2026-04-28 01:44:48.128603 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.128607 | orchestrator | + mac_address = (known after apply) 2026-04-28 01:44:48.128610 | orchestrator | + network_id = (known after apply) 2026-04-28 01:44:48.128614 | orchestrator | + port_security_enabled = (known after apply) 2026-04-28 01:44:48.128618 | orchestrator | + qos_policy_id = (known after apply) 2026-04-28 01:44:48.128626 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.128629 | orchestrator | + security_group_ids = (known after apply) 2026-04-28 01:44:48.128633 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.128637 | orchestrator | 2026-04-28 01:44:48.128641 | orchestrator | + allowed_address_pairs { 2026-04-28 01:44:48.128645 | orchestrator | + ip_address = "192.168.16.254/32" 2026-04-28 01:44:48.128648 | orchestrator | } 2026-04-28 01:44:48.128652 | orchestrator | + allowed_address_pairs { 2026-04-28 01:44:48.128656 | orchestrator | + ip_address = "192.168.16.8/32" 2026-04-28 01:44:48.128660 | orchestrator | } 2026-04-28 01:44:48.128664 | orchestrator | + allowed_address_pairs { 2026-04-28 01:44:48.128667 | orchestrator | + ip_address = "192.168.16.9/32" 2026-04-28 01:44:48.128671 | orchestrator | } 2026-04-28 01:44:48.128675 | orchestrator | 2026-04-28 01:44:48.128682 | orchestrator | + binding (known after apply) 2026-04-28 01:44:48.128686 | orchestrator | 2026-04-28 01:44:48.128690 | orchestrator | + fixed_ip { 2026-04-28 01:44:48.128694 | orchestrator | + ip_address = "192.168.16.15" 2026-04-28 01:44:48.128698 | orchestrator | + subnet_id = (known after apply) 2026-04-28 01:44:48.128702 | orchestrator | } 2026-04-28 01:44:48.128705 | orchestrator | } 2026-04-28 01:44:48.128709 | orchestrator | 2026-04-28 01:44:48.128713 | orchestrator | # openstack_networking_router_interface_v2.router_interface will be created 2026-04-28 01:44:48.128717 | orchestrator | + resource "openstack_networking_router_interface_v2" "router_interface" { 2026-04-28 01:44:48.128721 | orchestrator | + force_destroy = false 2026-04-28 01:44:48.128725 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.128728 | orchestrator | + port_id = (known after apply) 2026-04-28 01:44:48.128732 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.128736 | orchestrator | + router_id = (known after apply) 2026-04-28 01:44:48.128740 | orchestrator | + subnet_id = (known after apply) 2026-04-28 01:44:48.128743 | orchestrator | } 2026-04-28 01:44:48.128747 | orchestrator | 2026-04-28 01:44:48.128751 | orchestrator | # openstack_networking_router_v2.router will be created 2026-04-28 01:44:48.128758 | orchestrator | + resource "openstack_networking_router_v2" "router" { 2026-04-28 01:44:48.128763 | orchestrator | + admin_state_up = (known after apply) 2026-04-28 01:44:48.128769 | orchestrator | + all_tags = (known after apply) 2026-04-28 01:44:48.128775 | orchestrator | + availability_zone_hints = [ 2026-04-28 01:44:48.128780 | orchestrator | + "nova", 2026-04-28 01:44:48.128786 | orchestrator | ] 2026-04-28 01:44:48.128792 | orchestrator | + distributed = (known after apply) 2026-04-28 01:44:48.128797 | orchestrator | + enable_snat = (known after apply) 2026-04-28 01:44:48.128803 | orchestrator | + external_network_id = "e6be7364-bfd8-4de7-8120-8f41c69a139a" 2026-04-28 01:44:48.128809 | orchestrator | + external_qos_policy_id = (known after apply) 2026-04-28 01:44:48.128816 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.128822 | orchestrator | + name = "testbed" 2026-04-28 01:44:48.128828 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.128834 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.128840 | orchestrator | 2026-04-28 01:44:48.128846 | orchestrator | + external_fixed_ip (known after apply) 2026-04-28 01:44:48.128852 | orchestrator | } 2026-04-28 01:44:48.128859 | orchestrator | 2026-04-28 01:44:48.128864 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_management_rule1 will be created 2026-04-28 01:44:48.128872 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_management_rule1" { 2026-04-28 01:44:48.128878 | orchestrator | + description = "ssh" 2026-04-28 01:44:48.128884 | orchestrator | + direction = "ingress" 2026-04-28 01:44:48.128889 | orchestrator | + ethertype = "IPv4" 2026-04-28 01:44:48.128895 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.128901 | orchestrator | + port_range_max = 22 2026-04-28 01:44:48.128908 | orchestrator | + port_range_min = 22 2026-04-28 01:44:48.128914 | orchestrator | + protocol = "tcp" 2026-04-28 01:44:48.128920 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.128932 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-28 01:44:48.128938 | orchestrator | + remote_group_id = (known after apply) 2026-04-28 01:44:48.128945 | orchestrator | + remote_ip_prefix = "0.0.0.0/0" 2026-04-28 01:44:48.128949 | orchestrator | + security_group_id = (known after apply) 2026-04-28 01:44:48.128952 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.128956 | orchestrator | } 2026-04-28 01:44:48.128960 | orchestrator | 2026-04-28 01:44:48.128964 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_management_rule2 will be created 2026-04-28 01:44:48.128967 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_management_rule2" { 2026-04-28 01:44:48.128971 | orchestrator | + description = "wireguard" 2026-04-28 01:44:48.128975 | orchestrator | + direction = "ingress" 2026-04-28 01:44:48.128983 | orchestrator | + ethertype = "IPv4" 2026-04-28 01:44:48.128987 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.128991 | orchestrator | + port_range_max = 51820 2026-04-28 01:44:48.128995 | orchestrator | + port_range_min = 51820 2026-04-28 01:44:48.128998 | orchestrator | + protocol = "udp" 2026-04-28 01:44:48.129002 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.129006 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-28 01:44:48.129010 | orchestrator | + remote_group_id = (known after apply) 2026-04-28 01:44:48.129013 | orchestrator | + remote_ip_prefix = "0.0.0.0/0" 2026-04-28 01:44:48.129017 | orchestrator | + security_group_id = (known after apply) 2026-04-28 01:44:48.129021 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.129025 | orchestrator | } 2026-04-28 01:44:48.129028 | orchestrator | 2026-04-28 01:44:48.129032 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_management_rule3 will be created 2026-04-28 01:44:48.129036 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_management_rule3" { 2026-04-28 01:44:48.129040 | orchestrator | + direction = "ingress" 2026-04-28 01:44:48.129043 | orchestrator | + ethertype = "IPv4" 2026-04-28 01:44:48.129047 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.129051 | orchestrator | + protocol = "tcp" 2026-04-28 01:44:48.129054 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.129058 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-28 01:44:48.129062 | orchestrator | + remote_group_id = (known after apply) 2026-04-28 01:44:48.129065 | orchestrator | + remote_ip_prefix = "192.168.16.0/20" 2026-04-28 01:44:48.129069 | orchestrator | + security_group_id = (known after apply) 2026-04-28 01:44:48.129073 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.129079 | orchestrator | } 2026-04-28 01:44:48.129085 | orchestrator | 2026-04-28 01:44:48.129091 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_management_rule4 will be created 2026-04-28 01:44:48.129097 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_management_rule4" { 2026-04-28 01:44:48.129102 | orchestrator | + direction = "ingress" 2026-04-28 01:44:48.129109 | orchestrator | + ethertype = "IPv4" 2026-04-28 01:44:48.129114 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.129120 | orchestrator | + protocol = "udp" 2026-04-28 01:44:48.129126 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.129132 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-28 01:44:48.129152 | orchestrator | + remote_group_id = (known after apply) 2026-04-28 01:44:48.129159 | orchestrator | + remote_ip_prefix = "192.168.16.0/20" 2026-04-28 01:44:48.129164 | orchestrator | + security_group_id = (known after apply) 2026-04-28 01:44:48.129170 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.129175 | orchestrator | } 2026-04-28 01:44:48.129181 | orchestrator | 2026-04-28 01:44:48.129187 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_management_rule5 will be created 2026-04-28 01:44:48.129198 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_management_rule5" { 2026-04-28 01:44:48.129204 | orchestrator | + direction = "ingress" 2026-04-28 01:44:48.129210 | orchestrator | + ethertype = "IPv4" 2026-04-28 01:44:48.129217 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.129222 | orchestrator | + protocol = "icmp" 2026-04-28 01:44:48.129229 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.129235 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-28 01:44:48.129242 | orchestrator | + remote_group_id = (known after apply) 2026-04-28 01:44:48.129248 | orchestrator | + remote_ip_prefix = "0.0.0.0/0" 2026-04-28 01:44:48.129254 | orchestrator | + security_group_id = (known after apply) 2026-04-28 01:44:48.129261 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.129267 | orchestrator | } 2026-04-28 01:44:48.129273 | orchestrator | 2026-04-28 01:44:48.129279 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_node_rule1 will be created 2026-04-28 01:44:48.129285 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_node_rule1" { 2026-04-28 01:44:48.129293 | orchestrator | + direction = "ingress" 2026-04-28 01:44:48.129297 | orchestrator | + ethertype = "IPv4" 2026-04-28 01:44:48.129301 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.129304 | orchestrator | + protocol = "tcp" 2026-04-28 01:44:48.129308 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.129312 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-28 01:44:48.129320 | orchestrator | + remote_group_id = (known after apply) 2026-04-28 01:44:48.129324 | orchestrator | + remote_ip_prefix = "0.0.0.0/0" 2026-04-28 01:44:48.129328 | orchestrator | + security_group_id = (known after apply) 2026-04-28 01:44:48.129332 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.129336 | orchestrator | } 2026-04-28 01:44:48.129340 | orchestrator | 2026-04-28 01:44:48.129343 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_node_rule2 will be created 2026-04-28 01:44:48.129347 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_node_rule2" { 2026-04-28 01:44:48.129351 | orchestrator | + direction = "ingress" 2026-04-28 01:44:48.129355 | orchestrator | + ethertype = "IPv4" 2026-04-28 01:44:48.129358 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.129363 | orchestrator | + protocol = "udp" 2026-04-28 01:44:48.129366 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.129370 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-28 01:44:48.129374 | orchestrator | + remote_group_id = (known after apply) 2026-04-28 01:44:48.129378 | orchestrator | + remote_ip_prefix = "0.0.0.0/0" 2026-04-28 01:44:48.129381 | orchestrator | + security_group_id = (known after apply) 2026-04-28 01:44:48.129385 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.129389 | orchestrator | } 2026-04-28 01:44:48.129393 | orchestrator | 2026-04-28 01:44:48.129397 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_node_rule3 will be created 2026-04-28 01:44:48.129400 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_node_rule3" { 2026-04-28 01:44:48.129409 | orchestrator | + direction = "ingress" 2026-04-28 01:44:48.129415 | orchestrator | + ethertype = "IPv4" 2026-04-28 01:44:48.129419 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.129423 | orchestrator | + protocol = "icmp" 2026-04-28 01:44:48.129427 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.129431 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-28 01:44:48.129435 | orchestrator | + remote_group_id = (known after apply) 2026-04-28 01:44:48.129439 | orchestrator | + remote_ip_prefix = "0.0.0.0/0" 2026-04-28 01:44:48.129442 | orchestrator | + security_group_id = (known after apply) 2026-04-28 01:44:48.129446 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.129454 | orchestrator | } 2026-04-28 01:44:48.129458 | orchestrator | 2026-04-28 01:44:48.129462 | orchestrator | # openstack_networking_secgroup_rule_v2.security_group_rule_vrrp will be created 2026-04-28 01:44:48.129466 | orchestrator | + resource "openstack_networking_secgroup_rule_v2" "security_group_rule_vrrp" { 2026-04-28 01:44:48.129470 | orchestrator | + description = "vrrp" 2026-04-28 01:44:48.129474 | orchestrator | + direction = "ingress" 2026-04-28 01:44:48.129477 | orchestrator | + ethertype = "IPv4" 2026-04-28 01:44:48.129483 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.129489 | orchestrator | + protocol = "112" 2026-04-28 01:44:48.129495 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.129501 | orchestrator | + remote_address_group_id = (known after apply) 2026-04-28 01:44:48.129506 | orchestrator | + remote_group_id = (known after apply) 2026-04-28 01:44:48.129513 | orchestrator | + remote_ip_prefix = "0.0.0.0/0" 2026-04-28 01:44:48.129519 | orchestrator | + security_group_id = (known after apply) 2026-04-28 01:44:48.129525 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.129532 | orchestrator | } 2026-04-28 01:44:48.129538 | orchestrator | 2026-04-28 01:44:48.129544 | orchestrator | # openstack_networking_secgroup_v2.security_group_management will be created 2026-04-28 01:44:48.129550 | orchestrator | + resource "openstack_networking_secgroup_v2" "security_group_management" { 2026-04-28 01:44:48.129556 | orchestrator | + all_tags = (known after apply) 2026-04-28 01:44:48.129563 | orchestrator | + description = "management security group" 2026-04-28 01:44:48.129568 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.129575 | orchestrator | + name = "testbed-management" 2026-04-28 01:44:48.129581 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.129587 | orchestrator | + stateful = (known after apply) 2026-04-28 01:44:48.129592 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.129598 | orchestrator | } 2026-04-28 01:44:48.129604 | orchestrator | 2026-04-28 01:44:48.129610 | orchestrator | # openstack_networking_secgroup_v2.security_group_node will be created 2026-04-28 01:44:48.129615 | orchestrator | + resource "openstack_networking_secgroup_v2" "security_group_node" { 2026-04-28 01:44:48.129621 | orchestrator | + all_tags = (known after apply) 2026-04-28 01:44:48.129626 | orchestrator | + description = "node security group" 2026-04-28 01:44:48.129632 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.129638 | orchestrator | + name = "testbed-node" 2026-04-28 01:44:48.129644 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.129651 | orchestrator | + stateful = (known after apply) 2026-04-28 01:44:48.129657 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.129663 | orchestrator | } 2026-04-28 01:44:48.129669 | orchestrator | 2026-04-28 01:44:48.129675 | orchestrator | # openstack_networking_subnet_v2.subnet_management will be created 2026-04-28 01:44:48.129681 | orchestrator | + resource "openstack_networking_subnet_v2" "subnet_management" { 2026-04-28 01:44:48.129689 | orchestrator | + all_tags = (known after apply) 2026-04-28 01:44:48.129693 | orchestrator | + cidr = "192.168.16.0/20" 2026-04-28 01:44:48.129696 | orchestrator | + dns_nameservers = [ 2026-04-28 01:44:48.129700 | orchestrator | + "8.8.8.8", 2026-04-28 01:44:48.129704 | orchestrator | + "9.9.9.9", 2026-04-28 01:44:48.129708 | orchestrator | ] 2026-04-28 01:44:48.129712 | orchestrator | + enable_dhcp = true 2026-04-28 01:44:48.129716 | orchestrator | + gateway_ip = (known after apply) 2026-04-28 01:44:48.129720 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.129723 | orchestrator | + ip_version = 4 2026-04-28 01:44:48.129727 | orchestrator | + ipv6_address_mode = (known after apply) 2026-04-28 01:44:48.129731 | orchestrator | + ipv6_ra_mode = (known after apply) 2026-04-28 01:44:48.129735 | orchestrator | + name = "subnet-testbed-management" 2026-04-28 01:44:48.129739 | orchestrator | + network_id = (known after apply) 2026-04-28 01:44:48.129742 | orchestrator | + no_gateway = false 2026-04-28 01:44:48.129746 | orchestrator | + region = (known after apply) 2026-04-28 01:44:48.129750 | orchestrator | + service_types = (known after apply) 2026-04-28 01:44:48.129759 | orchestrator | + tenant_id = (known after apply) 2026-04-28 01:44:48.129762 | orchestrator | 2026-04-28 01:44:48.129766 | orchestrator | + allocation_pool { 2026-04-28 01:44:48.129770 | orchestrator | + end = "192.168.31.250" 2026-04-28 01:44:48.129774 | orchestrator | + start = "192.168.31.200" 2026-04-28 01:44:48.129778 | orchestrator | } 2026-04-28 01:44:48.129781 | orchestrator | } 2026-04-28 01:44:48.129785 | orchestrator | 2026-04-28 01:44:48.129789 | orchestrator | # terraform_data.image will be created 2026-04-28 01:44:48.129793 | orchestrator | + resource "terraform_data" "image" { 2026-04-28 01:44:48.129797 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.129800 | orchestrator | + input = "Ubuntu 24.04" 2026-04-28 01:44:48.129804 | orchestrator | + output = (known after apply) 2026-04-28 01:44:48.129808 | orchestrator | } 2026-04-28 01:44:48.129812 | orchestrator | 2026-04-28 01:44:48.129816 | orchestrator | # terraform_data.image_node will be created 2026-04-28 01:44:48.129819 | orchestrator | + resource "terraform_data" "image_node" { 2026-04-28 01:44:48.129823 | orchestrator | + id = (known after apply) 2026-04-28 01:44:48.129827 | orchestrator | + input = "Ubuntu 24.04" 2026-04-28 01:44:48.129831 | orchestrator | + output = (known after apply) 2026-04-28 01:44:48.129835 | orchestrator | } 2026-04-28 01:44:48.129838 | orchestrator | 2026-04-28 01:44:48.129842 | orchestrator | Plan: 64 to add, 0 to change, 0 to destroy. 2026-04-28 01:44:48.129846 | orchestrator | 2026-04-28 01:44:48.129850 | orchestrator | Changes to Outputs: 2026-04-28 01:44:48.129856 | orchestrator | + manager_address = (sensitive value) 2026-04-28 01:44:48.129862 | orchestrator | + private_key = (sensitive value) 2026-04-28 01:44:48.293370 | orchestrator | terraform_data.image_node: Creating... 2026-04-28 01:44:48.293692 | orchestrator | terraform_data.image_node: Creation complete after 0s [id=8d19a6cd-805b-97a8-829a-4edbd65ca683] 2026-04-28 01:44:48.361201 | orchestrator | terraform_data.image: Creating... 2026-04-28 01:44:48.361682 | orchestrator | terraform_data.image: Creation complete after 0s [id=cbac8430-9508-b342-3b86-ebf9e0e6a89d] 2026-04-28 01:44:48.395653 | orchestrator | openstack_blockstorage_volume_v3.node_volume[6]: Creating... 2026-04-28 01:44:48.396596 | orchestrator | openstack_networking_network_v2.net_management: Creating... 2026-04-28 01:44:48.397617 | orchestrator | openstack_blockstorage_volume_v3.node_volume[8]: Creating... 2026-04-28 01:44:48.398559 | orchestrator | openstack_blockstorage_volume_v3.node_volume[1]: Creating... 2026-04-28 01:44:48.398910 | orchestrator | openstack_blockstorage_volume_v3.node_volume[7]: Creating... 2026-04-28 01:44:48.402732 | orchestrator | openstack_blockstorage_volume_v3.node_volume[5]: Creating... 2026-04-28 01:44:48.404238 | orchestrator | openstack_blockstorage_volume_v3.node_volume[0]: Creating... 2026-04-28 01:44:48.405866 | orchestrator | openstack_blockstorage_volume_v3.node_volume[3]: Creating... 2026-04-28 01:44:48.407646 | orchestrator | openstack_blockstorage_volume_v3.node_volume[2]: Creating... 2026-04-28 01:44:48.409424 | orchestrator | openstack_blockstorage_volume_v3.node_volume[4]: Creating... 2026-04-28 01:44:49.523120 | orchestrator | openstack_networking_network_v2.net_management: Creation complete after 2s [id=1a4be984-dda9-41db-a2f3-e4ce70a2e679] 2026-04-28 01:44:49.527600 | orchestrator | openstack_compute_keypair_v2.key: Creating... 2026-04-28 01:44:49.661916 | orchestrator | openstack_compute_keypair_v2.key: Creation complete after 0s [id=testbed] 2026-04-28 01:44:49.850430 | orchestrator | data.openstack_images_image_v2.image: Reading... 2026-04-28 01:44:49.850478 | orchestrator | data.openstack_images_image_v2.image: Read complete after 0s [id=846820b2-039e-4b42-adad-daf72e0f8ea4] 2026-04-28 01:44:49.850484 | orchestrator | data.openstack_images_image_v2.image_node: Reading... 2026-04-28 01:44:49.850489 | orchestrator | data.openstack_images_image_v2.image_node: Read complete after 0s [id=846820b2-039e-4b42-adad-daf72e0f8ea4] 2026-04-28 01:44:49.850494 | orchestrator | openstack_networking_subnet_v2.subnet_management: Creating... 2026-04-28 01:44:50.571674 | orchestrator | openstack_networking_subnet_v2.subnet_management: Creation complete after 1s [id=4ed14fba-94a4-4b46-9559-6642f3f0ffad] 2026-04-28 01:44:50.589352 | orchestrator | local_file.id_rsa_pub: Creating... 2026-04-28 01:44:50.597797 | orchestrator | local_file.id_rsa_pub: Creation complete after 0s [id=1db3ed7ea43757088d60e4e16d29753ae4a98193] 2026-04-28 01:44:50.605508 | orchestrator | local_sensitive_file.id_rsa: Creating... 2026-04-28 01:44:50.612915 | orchestrator | local_sensitive_file.id_rsa: Creation complete after 0s [id=d8e5d4216b10b4f2c9591d3789f5c92ff1f21338] 2026-04-28 01:44:50.618359 | orchestrator | openstack_blockstorage_volume_v3.manager_base_volume[0]: Creating... 2026-04-28 01:44:51.976852 | orchestrator | openstack_blockstorage_volume_v3.node_volume[6]: Creation complete after 4s [id=46b7ee74-39f0-45ac-8133-a4f9630b6202] 2026-04-28 01:44:51.989964 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[5]: Creating... 2026-04-28 01:44:52.032292 | orchestrator | openstack_blockstorage_volume_v3.node_volume[0]: Creation complete after 4s [id=0b1dfca7-ca1b-4a54-8f84-50c64916129c] 2026-04-28 01:44:52.042731 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[3]: Creating... 2026-04-28 01:44:52.078887 | orchestrator | openstack_blockstorage_volume_v3.node_volume[1]: Creation complete after 4s [id=81043571-8916-4793-8453-c8f133401e80] 2026-04-28 01:44:52.084395 | orchestrator | openstack_blockstorage_volume_v3.node_volume[8]: Creation complete after 4s [id=eca06b16-1c2b-4006-9914-55ad19a918de] 2026-04-28 01:44:52.085349 | orchestrator | openstack_blockstorage_volume_v3.node_volume[4]: Creation complete after 4s [id=6fed6807-d741-439c-9f91-474adcad671b] 2026-04-28 01:44:52.090739 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[2]: Creating... 2026-04-28 01:44:52.093320 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[4]: Creating... 2026-04-28 01:44:52.099728 | orchestrator | openstack_blockstorage_volume_v3.node_volume[3]: Creation complete after 4s [id=f7edf0fa-df72-4a27-ba4e-1e8a72709675] 2026-04-28 01:44:52.102107 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[1]: Creating... 2026-04-28 01:44:52.104440 | orchestrator | openstack_blockstorage_volume_v3.node_volume[5]: Creation complete after 4s [id=953cbf01-df11-44f0-95ad-2441de21fe89] 2026-04-28 01:44:52.104924 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[0]: Creating... 2026-04-28 01:44:52.116311 | orchestrator | openstack_networking_router_v2.router: Creating... 2026-04-28 01:44:52.116654 | orchestrator | openstack_blockstorage_volume_v3.node_volume[2]: Creation complete after 4s [id=0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79] 2026-04-28 01:44:52.125599 | orchestrator | openstack_blockstorage_volume_v3.node_volume[7]: Creation complete after 4s [id=f49158cb-7d22-4543-817c-5ac821d1ceba] 2026-04-28 01:44:53.943067 | orchestrator | openstack_blockstorage_volume_v3.manager_base_volume[0]: Creation complete after 3s [id=5ea701e6-1739-4314-8940-18827c834622] 2026-04-28 01:44:55.166737 | orchestrator | openstack_networking_router_v2.router: Creation complete after 3s [id=d399d641-0bc0-481b-94db-641c365f0524] 2026-04-28 01:44:55.173238 | orchestrator | openstack_networking_secgroup_v2.security_group_management: Creating... 2026-04-28 01:44:55.174654 | orchestrator | openstack_networking_secgroup_v2.security_group_node: Creating... 2026-04-28 01:44:55.175823 | orchestrator | openstack_networking_router_interface_v2.router_interface: Creating... 2026-04-28 01:44:55.358757 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[5]: Creation complete after 3s [id=4c7fe216-c7b7-453a-b900-b915aea67c50] 2026-04-28 01:44:55.372361 | orchestrator | openstack_networking_secgroup_v2.security_group_management: Creation complete after 0s [id=a995f346-8206-4f78-b6ab-d63e4a474539] 2026-04-28 01:44:55.377869 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule5: Creating... 2026-04-28 01:44:55.378377 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule3: Creating... 2026-04-28 01:44:55.378985 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule1: Creating... 2026-04-28 01:44:55.414922 | orchestrator | openstack_networking_secgroup_v2.security_group_node: Creation complete after 0s [id=d6176dac-8144-4904-87b6-3eb17fbead34] 2026-04-28 01:44:55.421502 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule2: Creating... 2026-04-28 01:44:55.504587 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[4]: Creation complete after 4s [id=46815659-874f-4607-872f-4275fd1627fb] 2026-04-28 01:44:55.515412 | orchestrator | openstack_networking_port_v2.manager_port_management: Creating... 2026-04-28 01:44:55.517121 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[2]: Creation complete after 4s [id=46c58400-f4df-4002-8b02-dacbe7336f25] 2026-04-28 01:44:55.519465 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[1]: Creation complete after 4s [id=16596406-df52-44b5-ad95-4abccf821828] 2026-04-28 01:44:55.525527 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[3]: Creation complete after 4s [id=3fe92a08-106b-4716-8c84-89d856c2d73e] 2026-04-28 01:44:55.527757 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule4: Creating... 2026-04-28 01:44:55.528864 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_node_rule2: Creating... 2026-04-28 01:44:55.533255 | orchestrator | openstack_networking_port_v2.node_port_management[3]: Creating... 2026-04-28 01:44:55.539259 | orchestrator | openstack_blockstorage_volume_v3.node_base_volume[0]: Creation complete after 4s [id=12b9c610-e3be-4093-9151-0aff94d13d7f] 2026-04-28 01:44:55.545511 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule5: Creation complete after 1s [id=1af5110b-039b-4038-b582-2f0b87d279bb] 2026-04-28 01:44:55.546230 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_rule_vrrp: Creating... 2026-04-28 01:44:55.553626 | orchestrator | openstack_networking_port_v2.node_port_management[4]: Creating... 2026-04-28 01:44:55.789079 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_node_rule2: Creation complete after 0s [id=9165302a-8964-4fb7-b4d0-19d9a8bcf5fa] 2026-04-28 01:44:55.802867 | orchestrator | openstack_networking_port_v2.node_port_management[5]: Creating... 2026-04-28 01:44:55.987418 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule1: Creation complete after 1s [id=aa7863bc-9787-4271-b2a6-9a821dc12847] 2026-04-28 01:44:55.997859 | orchestrator | openstack_networking_port_v2.node_port_management[0]: Creating... 2026-04-28 01:44:56.019810 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_rule_vrrp: Creation complete after 0s [id=5cf47916-ee72-4f27-a993-202db38b311e] 2026-04-28 01:44:56.033133 | orchestrator | openstack_networking_port_v2.node_port_management[2]: Creating... 2026-04-28 01:44:56.237186 | orchestrator | openstack_networking_port_v2.node_port_management[3]: Creation complete after 0s [id=c88f9753-e3cd-4f35-a236-9a93a3aa0064] 2026-04-28 01:44:56.247827 | orchestrator | openstack_networking_port_v2.node_port_management[1]: Creating... 2026-04-28 01:44:56.257674 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule3: Creation complete after 1s [id=8d994ffb-2c52-4f70-ac3f-48f9bde8c9b8] 2026-04-28 01:44:56.262788 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_node_rule1: Creating... 2026-04-28 01:44:56.373416 | orchestrator | openstack_networking_port_v2.node_port_management[4]: Creation complete after 0s [id=81a664d2-1c16-40cd-be9e-36388910efa9] 2026-04-28 01:44:56.379239 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_node_rule3: Creating... 2026-04-28 01:44:56.413734 | orchestrator | openstack_networking_port_v2.node_port_management[5]: Creation complete after 0s [id=8f420148-9dd1-4921-a97f-54181205d83b] 2026-04-28 01:44:56.482761 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_node_rule1: Creation complete after 0s [id=cb6a9dec-91f9-45ba-bdf4-bce4e1636ae9] 2026-04-28 01:44:56.485321 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule2: Creation complete after 1s [id=d0f97f80-3d14-4f21-92c3-c88ffd898808] 2026-04-28 01:44:56.645346 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_node_rule3: Creation complete after 1s [id=bc7a98a2-356b-43fc-a28a-1c5913478470] 2026-04-28 01:44:56.709481 | orchestrator | openstack_networking_port_v2.node_port_management[0]: Creation complete after 1s [id=98fce35f-75a6-4ef5-8dbc-c896e422703a] 2026-04-28 01:44:56.720745 | orchestrator | openstack_networking_secgroup_rule_v2.security_group_management_rule4: Creation complete after 1s [id=ac005ffd-03e4-4ffa-a61f-04a1e7f2a927] 2026-04-28 01:44:56.850690 | orchestrator | openstack_networking_port_v2.manager_port_management: Creation complete after 1s [id=f4e754dc-1c5a-422e-8ce8-9e5cc9d382d3] 2026-04-28 01:44:56.883186 | orchestrator | openstack_networking_port_v2.node_port_management[1]: Creation complete after 1s [id=36a62201-26b3-46b2-bf4e-18dca2481df1] 2026-04-28 01:44:57.280715 | orchestrator | openstack_networking_port_v2.node_port_management[2]: Creation complete after 1s [id=19c62469-817e-4e9a-a7f7-06c0c524f2fd] 2026-04-28 01:44:58.676762 | orchestrator | openstack_networking_router_interface_v2.router_interface: Creation complete after 4s [id=383eb65f-4212-4196-8d08-a3dc22c480dd] 2026-04-28 01:44:58.693838 | orchestrator | openstack_networking_floatingip_v2.manager_floating_ip: Creating... 2026-04-28 01:44:58.712092 | orchestrator | openstack_compute_instance_v2.node_server[1]: Creating... 2026-04-28 01:44:58.715109 | orchestrator | openstack_compute_instance_v2.node_server[0]: Creating... 2026-04-28 01:44:58.716767 | orchestrator | openstack_compute_instance_v2.node_server[2]: Creating... 2026-04-28 01:44:58.720597 | orchestrator | openstack_compute_instance_v2.node_server[3]: Creating... 2026-04-28 01:44:58.720889 | orchestrator | openstack_compute_instance_v2.node_server[5]: Creating... 2026-04-28 01:44:58.726035 | orchestrator | openstack_compute_instance_v2.node_server[4]: Creating... 2026-04-28 01:45:00.119209 | orchestrator | openstack_networking_floatingip_v2.manager_floating_ip: Creation complete after 1s [id=cdcc2b21-6df3-4b96-aeee-197ae6f9c0c5] 2026-04-28 01:45:00.128864 | orchestrator | local_file.MANAGER_ADDRESS: Creating... 2026-04-28 01:45:00.128936 | orchestrator | openstack_networking_floatingip_associate_v2.manager_floating_ip_association: Creating... 2026-04-28 01:45:00.131499 | orchestrator | local_file.MANAGER_ADDRESS: Creation complete after 0s [id=bca4606d1e377c4b4f65a702690e048209191548] 2026-04-28 01:45:00.131971 | orchestrator | local_file.inventory: Creating... 2026-04-28 01:45:00.135934 | orchestrator | local_file.inventory: Creation complete after 0s [id=499ad5404d54ef5e7c8d2a9f106c532c28a163fd] 2026-04-28 01:45:01.027949 | orchestrator | openstack_networking_floatingip_associate_v2.manager_floating_ip_association: Creation complete after 1s [id=cdcc2b21-6df3-4b96-aeee-197ae6f9c0c5] 2026-04-28 01:45:08.713667 | orchestrator | openstack_compute_instance_v2.node_server[1]: Still creating... [10s elapsed] 2026-04-28 01:45:08.715906 | orchestrator | openstack_compute_instance_v2.node_server[0]: Still creating... [10s elapsed] 2026-04-28 01:45:08.717144 | orchestrator | openstack_compute_instance_v2.node_server[2]: Still creating... [10s elapsed] 2026-04-28 01:45:08.725780 | orchestrator | openstack_compute_instance_v2.node_server[3]: Still creating... [10s elapsed] 2026-04-28 01:45:08.725849 | orchestrator | openstack_compute_instance_v2.node_server[5]: Still creating... [10s elapsed] 2026-04-28 01:45:08.728556 | orchestrator | openstack_compute_instance_v2.node_server[4]: Still creating... [10s elapsed] 2026-04-28 01:45:18.714348 | orchestrator | openstack_compute_instance_v2.node_server[1]: Still creating... [20s elapsed] 2026-04-28 01:45:18.716747 | orchestrator | openstack_compute_instance_v2.node_server[0]: Still creating... [20s elapsed] 2026-04-28 01:45:18.717947 | orchestrator | openstack_compute_instance_v2.node_server[2]: Still creating... [20s elapsed] 2026-04-28 01:45:18.726841 | orchestrator | openstack_compute_instance_v2.node_server[3]: Still creating... [20s elapsed] 2026-04-28 01:45:18.726969 | orchestrator | openstack_compute_instance_v2.node_server[5]: Still creating... [20s elapsed] 2026-04-28 01:45:18.729275 | orchestrator | openstack_compute_instance_v2.node_server[4]: Still creating... [20s elapsed] 2026-04-28 01:45:19.161295 | orchestrator | openstack_compute_instance_v2.node_server[2]: Creation complete after 20s [id=b291c2fb-7c4a-4d4b-aae1-3dabb76b2811] 2026-04-28 01:45:19.183642 | orchestrator | openstack_compute_instance_v2.node_server[1]: Creation complete after 20s [id=1e898e3a-a6a1-41c8-a65f-00858283cc58] 2026-04-28 01:45:19.251055 | orchestrator | openstack_compute_instance_v2.node_server[4]: Creation complete after 20s [id=22a8fd48-b4e0-4737-b22a-059443deb4c4] 2026-04-28 01:45:19.322716 | orchestrator | openstack_compute_instance_v2.node_server[5]: Creation complete after 20s [id=cefce5e3-77e1-4644-a07d-80948aaf6b07] 2026-04-28 01:45:28.725956 | orchestrator | openstack_compute_instance_v2.node_server[0]: Still creating... [30s elapsed] 2026-04-28 01:45:28.727098 | orchestrator | openstack_compute_instance_v2.node_server[3]: Still creating... [30s elapsed] 2026-04-28 01:45:29.523264 | orchestrator | openstack_compute_instance_v2.node_server[3]: Creation complete after 31s [id=a6505c26-ab34-4e82-a2ab-3be5cea4d7d2] 2026-04-28 01:45:29.788012 | orchestrator | openstack_compute_instance_v2.node_server[0]: Creation complete after 31s [id=0b25cbe7-2560-42ad-a754-68bc67dd17c5] 2026-04-28 01:45:29.797598 | orchestrator | null_resource.node_semaphore: Creating... 2026-04-28 01:45:29.804960 | orchestrator | null_resource.node_semaphore: Creation complete after 0s [id=5530515617787535416] 2026-04-28 01:45:29.817484 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[0]: Creating... 2026-04-28 01:45:29.821308 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[6]: Creating... 2026-04-28 01:45:29.823497 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[1]: Creating... 2026-04-28 01:45:29.830809 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[8]: Creating... 2026-04-28 01:45:29.834134 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[4]: Creating... 2026-04-28 01:45:29.834197 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[7]: Creating... 2026-04-28 01:45:29.834337 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[3]: Creating... 2026-04-28 01:45:29.838949 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[5]: Creating... 2026-04-28 01:45:29.845471 | orchestrator | openstack_compute_instance_v2.manager_server: Creating... 2026-04-28 01:45:29.847614 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[2]: Creating... 2026-04-28 01:45:33.218187 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[0]: Creation complete after 3s [id=a6505c26-ab34-4e82-a2ab-3be5cea4d7d2/0b1dfca7-ca1b-4a54-8f84-50c64916129c] 2026-04-28 01:45:33.230319 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[1]: Creation complete after 3s [id=22a8fd48-b4e0-4737-b22a-059443deb4c4/81043571-8916-4793-8453-c8f133401e80] 2026-04-28 01:45:33.249743 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[8]: Creation complete after 3s [id=cefce5e3-77e1-4644-a07d-80948aaf6b07/eca06b16-1c2b-4006-9914-55ad19a918de] 2026-04-28 01:45:33.251758 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[7]: Creation complete after 3s [id=22a8fd48-b4e0-4737-b22a-059443deb4c4/f49158cb-7d22-4543-817c-5ac821d1ceba] 2026-04-28 01:45:33.261824 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[3]: Creation complete after 3s [id=a6505c26-ab34-4e82-a2ab-3be5cea4d7d2/f7edf0fa-df72-4a27-ba4e-1e8a72709675] 2026-04-28 01:45:33.268010 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[5]: Creation complete after 3s [id=cefce5e3-77e1-4644-a07d-80948aaf6b07/953cbf01-df11-44f0-95ad-2441de21fe89] 2026-04-28 01:45:39.351942 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[4]: Creation complete after 9s [id=22a8fd48-b4e0-4737-b22a-059443deb4c4/6fed6807-d741-439c-9f91-474adcad671b] 2026-04-28 01:45:39.369079 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[2]: Creation complete after 9s [id=cefce5e3-77e1-4644-a07d-80948aaf6b07/0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79] 2026-04-28 01:45:39.553754 | orchestrator | openstack_compute_volume_attach_v2.node_volume_attachment[6]: Creation complete after 10s [id=a6505c26-ab34-4e82-a2ab-3be5cea4d7d2/46b7ee74-39f0-45ac-8133-a4f9630b6202] 2026-04-28 01:45:39.848451 | orchestrator | openstack_compute_instance_v2.manager_server: Still creating... [10s elapsed] 2026-04-28 01:45:49.857607 | orchestrator | openstack_compute_instance_v2.manager_server: Still creating... [20s elapsed] 2026-04-28 01:45:50.713906 | orchestrator | openstack_compute_instance_v2.manager_server: Creation complete after 21s [id=63bed3bf-24ab-49a3-8bc8-d2f92a850dbf] 2026-04-28 01:45:50.730719 | orchestrator | 2026-04-28 01:45:50.730781 | orchestrator | Apply complete! Resources: 64 added, 0 changed, 0 destroyed. 2026-04-28 01:45:50.730837 | orchestrator | 2026-04-28 01:45:50.730846 | orchestrator | Outputs: 2026-04-28 01:45:50.730852 | orchestrator | 2026-04-28 01:45:50.730918 | orchestrator | manager_address = 2026-04-28 01:45:50.730926 | orchestrator | private_key = 2026-04-28 01:45:51.144183 | orchestrator | ok: Runtime: 0:01:08.222641 2026-04-28 01:45:51.176889 | 2026-04-28 01:45:51.177035 | TASK [Fetch manager address] 2026-04-28 01:45:51.623175 | orchestrator | ok 2026-04-28 01:45:51.633393 | 2026-04-28 01:45:51.633577 | TASK [Set manager_host address] 2026-04-28 01:45:51.715060 | orchestrator | ok 2026-04-28 01:45:51.725951 | 2026-04-28 01:45:51.726087 | LOOP [Update ansible collections] 2026-04-28 01:45:54.507147 | orchestrator | [WARNING]: Collection osism.services does not support Ansible version 2.15.2 2026-04-28 01:45:54.507517 | orchestrator | [WARNING]: Collection osism.commons does not support Ansible version 2.15.2 2026-04-28 01:45:54.507571 | orchestrator | Starting galaxy collection install process 2026-04-28 01:45:54.507602 | orchestrator | Process install dependency map 2026-04-28 01:45:54.507634 | orchestrator | Starting collection install process 2026-04-28 01:45:54.507660 | orchestrator | Installing 'osism.commons:999.0.0' to '/home/zuul-testbed04/.ansible/collections/ansible_collections/osism/commons' 2026-04-28 01:45:54.507688 | orchestrator | Created collection for osism.commons:999.0.0 at /home/zuul-testbed04/.ansible/collections/ansible_collections/osism/commons 2026-04-28 01:45:54.507718 | orchestrator | osism.commons:999.0.0 was installed successfully 2026-04-28 01:45:54.507780 | orchestrator | ok: Item: commons Runtime: 0:00:02.439919 2026-04-28 01:45:55.498314 | orchestrator | [WARNING]: Collection osism.services does not support Ansible version 2.15.2 2026-04-28 01:45:55.498559 | orchestrator | [WARNING]: Collection osism.commons does not support Ansible version 2.15.2 2026-04-28 01:45:55.498625 | orchestrator | Starting galaxy collection install process 2026-04-28 01:45:55.498666 | orchestrator | Process install dependency map 2026-04-28 01:45:55.498703 | orchestrator | Starting collection install process 2026-04-28 01:45:55.498738 | orchestrator | Installing 'osism.services:999.0.0' to '/home/zuul-testbed04/.ansible/collections/ansible_collections/osism/services' 2026-04-28 01:45:55.498773 | orchestrator | Created collection for osism.services:999.0.0 at /home/zuul-testbed04/.ansible/collections/ansible_collections/osism/services 2026-04-28 01:45:55.498806 | orchestrator | osism.services:999.0.0 was installed successfully 2026-04-28 01:45:55.498889 | orchestrator | ok: Item: services Runtime: 0:00:00.708255 2026-04-28 01:45:55.519971 | 2026-04-28 01:45:55.520129 | TASK [Wait up to 300 seconds for port 22 to become open and contain "OpenSSH"] 2026-04-28 01:46:07.086624 | orchestrator | ok 2026-04-28 01:46:07.096177 | 2026-04-28 01:46:07.096312 | TASK [Wait a little longer for the manager so that everything is ready] 2026-04-28 01:47:07.145903 | orchestrator | ok 2026-04-28 01:47:07.155782 | 2026-04-28 01:47:07.155901 | TASK [Fetch manager ssh hostkey] 2026-04-28 01:47:08.727893 | orchestrator | Output suppressed because no_log was given 2026-04-28 01:47:08.741905 | 2026-04-28 01:47:08.742059 | TASK [Get ssh keypair from terraform environment] 2026-04-28 01:47:09.278227 | orchestrator | ok: Runtime: 0:00:00.007125 2026-04-28 01:47:09.294136 | 2026-04-28 01:47:09.294295 | TASK [Point out that the following task takes some time and does not give any output] 2026-04-28 01:47:09.342349 | orchestrator | ok: The task 'Run manager part 0' runs an Ansible playbook on the manager. There is no further output of this here. It takes a few minutes for this task to complete. 2026-04-28 01:47:09.352528 | 2026-04-28 01:47:09.352655 | TASK [Run manager part 0] 2026-04-28 01:47:10.422182 | orchestrator | [WARNING]: Collection osism.commons does not support Ansible version 2.15.2 2026-04-28 01:47:10.494490 | orchestrator | 2026-04-28 01:47:10.494549 | orchestrator | PLAY [Wait for cloud-init to finish] ******************************************* 2026-04-28 01:47:10.494557 | orchestrator | 2026-04-28 01:47:10.494574 | orchestrator | TASK [Check /var/lib/cloud/instance/boot-finished] ***************************** 2026-04-28 01:47:12.400997 | orchestrator | ok: [testbed-manager] 2026-04-28 01:47:12.401061 | orchestrator | 2026-04-28 01:47:12.401086 | orchestrator | PLAY [Run manager part 0] ****************************************************** 2026-04-28 01:47:12.401099 | orchestrator | 2026-04-28 01:47:12.401107 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-28 01:47:14.501015 | orchestrator | ok: [testbed-manager] 2026-04-28 01:47:14.501072 | orchestrator | 2026-04-28 01:47:14.501082 | orchestrator | TASK [Get home directory of ansible user] ************************************** 2026-04-28 01:47:15.224609 | orchestrator | ok: [testbed-manager] 2026-04-28 01:47:15.224755 | orchestrator | 2026-04-28 01:47:15.224773 | orchestrator | TASK [Set repo_path fact] ****************************************************** 2026-04-28 01:47:15.278102 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:47:15.278222 | orchestrator | 2026-04-28 01:47:15.278246 | orchestrator | TASK [Fail if Ubuntu version is lower than 24.04] ****************************** 2026-04-28 01:47:15.325366 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:47:15.325418 | orchestrator | 2026-04-28 01:47:15.325426 | orchestrator | TASK [Fail if Debian version is lower than 12] ********************************* 2026-04-28 01:47:15.362049 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:47:15.362103 | orchestrator | 2026-04-28 01:47:15.362109 | orchestrator | TASK [Set APT options on manager] ********************************************** 2026-04-28 01:47:16.215401 | orchestrator | changed: [testbed-manager] 2026-04-28 01:47:16.215454 | orchestrator | 2026-04-28 01:47:16.215466 | orchestrator | TASK [Update APT cache and run dist-upgrade] *********************************** 2026-04-28 01:50:27.816507 | orchestrator | changed: [testbed-manager] 2026-04-28 01:50:27.816651 | orchestrator | 2026-04-28 01:50:27.816668 | orchestrator | TASK [Install HWE kernel package on Ubuntu] ************************************ 2026-04-28 01:52:49.472118 | orchestrator | changed: [testbed-manager] 2026-04-28 01:52:49.472210 | orchestrator | 2026-04-28 01:52:49.472275 | orchestrator | TASK [Install required packages] *********************************************** 2026-04-28 01:53:15.865971 | orchestrator | changed: [testbed-manager] 2026-04-28 01:53:15.866110 | orchestrator | 2026-04-28 01:53:15.866133 | orchestrator | TASK [Remove some python packages] ********************************************* 2026-04-28 01:53:26.205439 | orchestrator | changed: [testbed-manager] 2026-04-28 01:53:26.205560 | orchestrator | 2026-04-28 01:53:26.205623 | orchestrator | TASK [Set venv_command fact (Debian)] ****************************************** 2026-04-28 01:53:26.244378 | orchestrator | ok: [testbed-manager] 2026-04-28 01:53:26.244438 | orchestrator | 2026-04-28 01:53:26.244447 | orchestrator | TASK [Get current user] ******************************************************** 2026-04-28 01:53:27.163099 | orchestrator | ok: [testbed-manager] 2026-04-28 01:53:27.163849 | orchestrator | 2026-04-28 01:53:27.163902 | orchestrator | TASK [Create venv directory] *************************************************** 2026-04-28 01:53:27.956402 | orchestrator | changed: [testbed-manager] 2026-04-28 01:53:27.956507 | orchestrator | 2026-04-28 01:53:27.956532 | orchestrator | TASK [Install netaddr in venv] ************************************************* 2026-04-28 01:53:35.087307 | orchestrator | changed: [testbed-manager] 2026-04-28 01:53:35.087375 | orchestrator | 2026-04-28 01:53:35.087382 | orchestrator | TASK [Install ansible-core in venv] ******************************************** 2026-04-28 01:53:42.007965 | orchestrator | changed: [testbed-manager] 2026-04-28 01:53:42.008091 | orchestrator | 2026-04-28 01:53:42.008118 | orchestrator | TASK [Install requests >= 2.32.2] ********************************************** 2026-04-28 01:53:45.057376 | orchestrator | changed: [testbed-manager] 2026-04-28 01:53:45.057495 | orchestrator | 2026-04-28 01:53:45.057523 | orchestrator | TASK [Install docker >= 7.1.0] ************************************************* 2026-04-28 01:53:47.049377 | orchestrator | changed: [testbed-manager] 2026-04-28 01:53:47.050199 | orchestrator | 2026-04-28 01:53:47.050246 | orchestrator | TASK [Create directories in /opt/src] ****************************************** 2026-04-28 01:53:48.290657 | orchestrator | changed: [testbed-manager] => (item=osism/ansible-collection-commons) 2026-04-28 01:53:48.290827 | orchestrator | changed: [testbed-manager] => (item=osism/ansible-collection-services) 2026-04-28 01:53:48.290844 | orchestrator | 2026-04-28 01:53:48.290858 | orchestrator | TASK [Sync sources in /opt/src] ************************************************ 2026-04-28 01:53:48.329026 | orchestrator | [DEPRECATION WARNING]: The connection's stdin object is deprecated. Call 2026-04-28 01:53:48.329115 | orchestrator | display.prompt_until(msg) instead. This feature will be removed in version 2026-04-28 01:53:48.329133 | orchestrator | 2.19. Deprecation warnings can be disabled by setting 2026-04-28 01:53:48.329150 | orchestrator | deprecation_warnings=False in ansible.cfg. 2026-04-28 01:53:54.379907 | orchestrator | changed: [testbed-manager] => (item=osism/ansible-collection-commons) 2026-04-28 01:53:54.379963 | orchestrator | changed: [testbed-manager] => (item=osism/ansible-collection-services) 2026-04-28 01:53:54.379971 | orchestrator | 2026-04-28 01:53:54.379978 | orchestrator | TASK [Create /usr/share/ansible directory] ************************************* 2026-04-28 01:53:54.982085 | orchestrator | changed: [testbed-manager] 2026-04-28 01:53:54.982184 | orchestrator | 2026-04-28 01:53:54.982201 | orchestrator | TASK [Install collections from Ansible galaxy] ********************************* 2026-04-28 01:54:17.637854 | orchestrator | changed: [testbed-manager] => (item=ansible.netcommon) 2026-04-28 01:54:17.637980 | orchestrator | changed: [testbed-manager] => (item=ansible.posix) 2026-04-28 01:54:17.638006 | orchestrator | changed: [testbed-manager] => (item=community.docker>=3.10.2) 2026-04-28 01:54:17.638077 | orchestrator | 2026-04-28 01:54:17.638107 | orchestrator | TASK [Install local collections] *********************************************** 2026-04-28 01:54:20.142000 | orchestrator | changed: [testbed-manager] => (item=ansible-collection-commons) 2026-04-28 01:54:20.142145 | orchestrator | changed: [testbed-manager] => (item=ansible-collection-services) 2026-04-28 01:54:20.142159 | orchestrator | 2026-04-28 01:54:20.142171 | orchestrator | PLAY [Create operator user] **************************************************** 2026-04-28 01:54:20.142181 | orchestrator | 2026-04-28 01:54:20.142191 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-28 01:54:21.623555 | orchestrator | ok: [testbed-manager] 2026-04-28 01:54:21.623624 | orchestrator | 2026-04-28 01:54:21.623634 | orchestrator | TASK [osism.commons.operator : Gather variables for each operating system] ***** 2026-04-28 01:54:21.659136 | orchestrator | ok: [testbed-manager] 2026-04-28 01:54:21.659203 | orchestrator | 2026-04-28 01:54:21.659216 | orchestrator | TASK [osism.commons.operator : Set operator_groups variable to default value] *** 2026-04-28 01:54:21.721979 | orchestrator | ok: [testbed-manager] 2026-04-28 01:54:21.722058 | orchestrator | 2026-04-28 01:54:21.722064 | orchestrator | TASK [osism.commons.operator : Create operator group] ************************** 2026-04-28 01:54:22.582415 | orchestrator | changed: [testbed-manager] 2026-04-28 01:54:22.582478 | orchestrator | 2026-04-28 01:54:22.582488 | orchestrator | TASK [osism.commons.operator : Create user] ************************************ 2026-04-28 01:54:23.364338 | orchestrator | changed: [testbed-manager] 2026-04-28 01:54:23.364416 | orchestrator | 2026-04-28 01:54:23.364426 | orchestrator | TASK [osism.commons.operator : Add user to additional groups] ****************** 2026-04-28 01:54:24.870830 | orchestrator | changed: [testbed-manager] => (item=adm) 2026-04-28 01:54:24.870918 | orchestrator | changed: [testbed-manager] => (item=sudo) 2026-04-28 01:54:24.870932 | orchestrator | 2026-04-28 01:54:24.870945 | orchestrator | TASK [osism.commons.operator : Copy user sudoers file] ************************* 2026-04-28 01:54:26.384983 | orchestrator | changed: [testbed-manager] 2026-04-28 01:54:26.385055 | orchestrator | 2026-04-28 01:54:26.385064 | orchestrator | TASK [osism.commons.operator : Set language variables in .bashrc configuration file] *** 2026-04-28 01:54:28.294989 | orchestrator | changed: [testbed-manager] => (item=export LANGUAGE=C.UTF-8) 2026-04-28 01:54:28.295092 | orchestrator | changed: [testbed-manager] => (item=export LANG=C.UTF-8) 2026-04-28 01:54:28.295125 | orchestrator | changed: [testbed-manager] => (item=export LC_ALL=C.UTF-8) 2026-04-28 01:54:28.295138 | orchestrator | 2026-04-28 01:54:28.295152 | orchestrator | TASK [osism.commons.operator : Set custom environment variables in .bashrc configuration file] *** 2026-04-28 01:54:28.356106 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:54:28.356168 | orchestrator | 2026-04-28 01:54:28.356175 | orchestrator | TASK [osism.commons.operator : Set custom PS1 prompt in .bashrc configuration file] *** 2026-04-28 01:54:28.430913 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:54:28.431013 | orchestrator | 2026-04-28 01:54:28.431038 | orchestrator | TASK [osism.commons.operator : Create .ssh directory] ************************** 2026-04-28 01:54:29.046495 | orchestrator | changed: [testbed-manager] 2026-04-28 01:54:29.046548 | orchestrator | 2026-04-28 01:54:29.046559 | orchestrator | TASK [osism.commons.operator : Check number of SSH authorized keys] ************ 2026-04-28 01:54:29.108338 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:54:29.108379 | orchestrator | 2026-04-28 01:54:29.108386 | orchestrator | TASK [osism.commons.operator : Set ssh authorized keys] ************************ 2026-04-28 01:54:30.087772 | orchestrator | changed: [testbed-manager] => (item=None) 2026-04-28 01:54:30.087822 | orchestrator | changed: [testbed-manager] 2026-04-28 01:54:30.087833 | orchestrator | 2026-04-28 01:54:30.087841 | orchestrator | TASK [osism.commons.operator : Delete ssh authorized keys] ********************* 2026-04-28 01:54:30.126271 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:54:30.126338 | orchestrator | 2026-04-28 01:54:30.126347 | orchestrator | TASK [osism.commons.operator : Set authorized GitHub accounts] ***************** 2026-04-28 01:54:30.173150 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:54:30.173259 | orchestrator | 2026-04-28 01:54:30.173284 | orchestrator | TASK [osism.commons.operator : Delete authorized GitHub accounts] ************** 2026-04-28 01:54:30.209337 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:54:30.209429 | orchestrator | 2026-04-28 01:54:30.209447 | orchestrator | TASK [osism.commons.operator : Set password] *********************************** 2026-04-28 01:54:30.292181 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:54:30.292239 | orchestrator | 2026-04-28 01:54:30.292255 | orchestrator | TASK [osism.commons.operator : Unset & lock password] ************************** 2026-04-28 01:54:31.076527 | orchestrator | ok: [testbed-manager] 2026-04-28 01:54:31.076579 | orchestrator | 2026-04-28 01:54:31.076592 | orchestrator | PLAY [Run manager part 0] ****************************************************** 2026-04-28 01:54:31.076605 | orchestrator | 2026-04-28 01:54:31.076617 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-28 01:54:32.567842 | orchestrator | ok: [testbed-manager] 2026-04-28 01:54:32.567879 | orchestrator | 2026-04-28 01:54:32.567885 | orchestrator | TASK [Recursively change ownership of /opt/venv] ******************************* 2026-04-28 01:54:33.662248 | orchestrator | changed: [testbed-manager] 2026-04-28 01:54:33.662333 | orchestrator | 2026-04-28 01:54:33.662348 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 01:54:33.662359 | orchestrator | testbed-manager : ok=33 changed=23 unreachable=0 failed=0 skipped=10 rescued=0 ignored=0 2026-04-28 01:54:33.662369 | orchestrator | 2026-04-28 01:54:34.181745 | orchestrator | ok: Runtime: 0:07:24.124139 2026-04-28 01:54:34.194035 | 2026-04-28 01:54:34.194177 | TASK [Point out that the log in on the manager is now possible] 2026-04-28 01:54:34.239697 | orchestrator | ok: It is now already possible to log in to the manager with 'make login'. 2026-04-28 01:54:34.250298 | 2026-04-28 01:54:34.250420 | TASK [Point out that the following task takes some time and does not give any output] 2026-04-28 01:54:34.298524 | orchestrator | ok: The task 'Run manager part 1 + 2' runs an Ansible playbook on the manager. There is no further output of this here. It takes a few minuts for this task to complete. 2026-04-28 01:54:34.308784 | 2026-04-28 01:54:34.308908 | TASK [Run manager part 1 + 2] 2026-04-28 01:54:35.219887 | orchestrator | [WARNING]: Collection osism.commons does not support Ansible version 2.15.2 2026-04-28 01:54:35.286039 | orchestrator | 2026-04-28 01:54:35.286093 | orchestrator | PLAY [Run manager part 1] ****************************************************** 2026-04-28 01:54:35.286101 | orchestrator | 2026-04-28 01:54:35.286115 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-28 01:54:38.071918 | orchestrator | ok: [testbed-manager] 2026-04-28 01:54:38.071972 | orchestrator | 2026-04-28 01:54:38.071995 | orchestrator | TASK [Set venv_command fact (RedHat)] ****************************************** 2026-04-28 01:54:38.113410 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:54:38.113466 | orchestrator | 2026-04-28 01:54:38.113476 | orchestrator | TASK [Set venv_command fact (Debian)] ****************************************** 2026-04-28 01:54:38.157949 | orchestrator | ok: [testbed-manager] 2026-04-28 01:54:38.158007 | orchestrator | 2026-04-28 01:54:38.158043 | orchestrator | TASK [osism.commons.repository : Gather variables for each operating system] *** 2026-04-28 01:54:38.200080 | orchestrator | ok: [testbed-manager] 2026-04-28 01:54:38.200135 | orchestrator | 2026-04-28 01:54:38.200144 | orchestrator | TASK [osism.commons.repository : Set repository_default fact to default value] *** 2026-04-28 01:54:38.273143 | orchestrator | ok: [testbed-manager] 2026-04-28 01:54:38.273222 | orchestrator | 2026-04-28 01:54:38.273237 | orchestrator | TASK [osism.commons.repository : Set repositories to default] ****************** 2026-04-28 01:54:38.349607 | orchestrator | ok: [testbed-manager] 2026-04-28 01:54:38.349678 | orchestrator | 2026-04-28 01:54:38.349695 | orchestrator | TASK [osism.commons.repository : Include distribution specific repository tasks] *** 2026-04-28 01:54:38.396807 | orchestrator | included: /home/zuul-testbed04/.ansible/collections/ansible_collections/osism/commons/roles/repository/tasks/Ubuntu.yml for testbed-manager 2026-04-28 01:54:38.396870 | orchestrator | 2026-04-28 01:54:38.396879 | orchestrator | TASK [osism.commons.repository : Create /etc/apt/sources.list.d directory] ***** 2026-04-28 01:54:39.193577 | orchestrator | ok: [testbed-manager] 2026-04-28 01:54:39.193651 | orchestrator | 2026-04-28 01:54:39.193666 | orchestrator | TASK [osism.commons.repository : Include tasks for Ubuntu < 24.04] ************* 2026-04-28 01:54:39.250581 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:54:39.250644 | orchestrator | 2026-04-28 01:54:39.250652 | orchestrator | TASK [osism.commons.repository : Copy 99osism apt configuration] *************** 2026-04-28 01:54:40.720680 | orchestrator | changed: [testbed-manager] 2026-04-28 01:54:40.720768 | orchestrator | 2026-04-28 01:54:40.720779 | orchestrator | TASK [osism.commons.repository : Remove sources.list file] ********************* 2026-04-28 01:54:41.342760 | orchestrator | ok: [testbed-manager] 2026-04-28 01:54:41.342820 | orchestrator | 2026-04-28 01:54:41.342828 | orchestrator | TASK [osism.commons.repository : Copy ubuntu.sources file] ********************* 2026-04-28 01:54:42.571602 | orchestrator | changed: [testbed-manager] 2026-04-28 01:54:42.571698 | orchestrator | 2026-04-28 01:54:42.571770 | orchestrator | TASK [osism.commons.repository : Update package cache] ************************* 2026-04-28 01:54:59.870445 | orchestrator | changed: [testbed-manager] 2026-04-28 01:54:59.870496 | orchestrator | 2026-04-28 01:54:59.870502 | orchestrator | TASK [Get home directory of ansible user] ************************************** 2026-04-28 01:55:00.571533 | orchestrator | ok: [testbed-manager] 2026-04-28 01:55:00.571577 | orchestrator | 2026-04-28 01:55:00.571587 | orchestrator | TASK [Set repo_path fact] ****************************************************** 2026-04-28 01:55:00.621213 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:55:00.621259 | orchestrator | 2026-04-28 01:55:00.621267 | orchestrator | TASK [Copy SSH public key] ***************************************************** 2026-04-28 01:55:01.617105 | orchestrator | changed: [testbed-manager] 2026-04-28 01:55:01.617162 | orchestrator | 2026-04-28 01:55:01.617174 | orchestrator | TASK [Copy SSH private key] **************************************************** 2026-04-28 01:55:02.620407 | orchestrator | changed: [testbed-manager] 2026-04-28 01:55:02.620464 | orchestrator | 2026-04-28 01:55:02.620473 | orchestrator | TASK [Create configuration directory] ****************************************** 2026-04-28 01:55:03.242077 | orchestrator | changed: [testbed-manager] 2026-04-28 01:55:03.242141 | orchestrator | 2026-04-28 01:55:03.242156 | orchestrator | TASK [Copy testbed repo] ******************************************************* 2026-04-28 01:55:03.286115 | orchestrator | [DEPRECATION WARNING]: The connection's stdin object is deprecated. Call 2026-04-28 01:55:03.286239 | orchestrator | display.prompt_until(msg) instead. This feature will be removed in version 2026-04-28 01:55:03.286261 | orchestrator | 2.19. Deprecation warnings can be disabled by setting 2026-04-28 01:55:03.286273 | orchestrator | deprecation_warnings=False in ansible.cfg. 2026-04-28 01:55:06.123478 | orchestrator | changed: [testbed-manager] 2026-04-28 01:55:06.123596 | orchestrator | 2026-04-28 01:55:06.123622 | orchestrator | TASK [Install python requirements in venv] ************************************* 2026-04-28 01:55:16.013052 | orchestrator | ok: [testbed-manager] => (item=Jinja2) 2026-04-28 01:55:16.013156 | orchestrator | ok: [testbed-manager] => (item=PyYAML) 2026-04-28 01:55:16.013174 | orchestrator | ok: [testbed-manager] => (item=packaging) 2026-04-28 01:55:16.013186 | orchestrator | changed: [testbed-manager] => (item=python-gilt==1.2.3) 2026-04-28 01:55:16.013208 | orchestrator | ok: [testbed-manager] => (item=requests>=2.32.2) 2026-04-28 01:55:16.013219 | orchestrator | ok: [testbed-manager] => (item=docker>=7.1.0) 2026-04-28 01:55:16.013241 | orchestrator | 2026-04-28 01:55:16.013255 | orchestrator | TASK [Copy testbed custom CA certificate on Debian/Ubuntu] ********************* 2026-04-28 01:55:17.099174 | orchestrator | changed: [testbed-manager] 2026-04-28 01:55:17.099258 | orchestrator | 2026-04-28 01:55:17.099267 | orchestrator | TASK [Run update-ca-certificates on Debian/Ubuntu] ***************************** 2026-04-28 01:55:20.486235 | orchestrator | changed: [testbed-manager] 2026-04-28 01:55:20.486316 | orchestrator | 2026-04-28 01:55:20.486328 | orchestrator | TASK [Run update-ca-trust on RedHat] ******************************************* 2026-04-28 01:55:20.526380 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:55:20.526467 | orchestrator | 2026-04-28 01:55:20.526480 | orchestrator | TASK [Run manager part 2] ****************************************************** 2026-04-28 01:57:16.487629 | orchestrator | changed: [testbed-manager] 2026-04-28 01:57:16.487669 | orchestrator | 2026-04-28 01:57:16.487675 | orchestrator | RUNNING HANDLER [osism.commons.repository : Force update of package cache] ***** 2026-04-28 01:57:17.809606 | orchestrator | ok: [testbed-manager] 2026-04-28 01:57:17.809686 | orchestrator | 2026-04-28 01:57:17.809702 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 01:57:17.809714 | orchestrator | testbed-manager : ok=21 changed=11 unreachable=0 failed=0 skipped=4 rescued=0 ignored=0 2026-04-28 01:57:17.809725 | orchestrator | 2026-04-28 01:57:17.987533 | orchestrator | ok: Runtime: 0:02:43.305202 2026-04-28 01:57:17.998057 | 2026-04-28 01:57:17.998182 | TASK [Reboot manager] 2026-04-28 01:57:19.531663 | orchestrator | ok: Runtime: 0:00:01.066683 2026-04-28 01:57:19.549125 | 2026-04-28 01:57:19.549290 | TASK [Wait up to 300 seconds for port 22 to become open and contain "OpenSSH"] 2026-04-28 01:57:36.929900 | orchestrator | ok 2026-04-28 01:57:36.940122 | 2026-04-28 01:57:36.940244 | TASK [Wait a little longer for the manager so that everything is ready] 2026-04-28 01:58:36.984673 | orchestrator | ok 2026-04-28 01:58:36.993960 | 2026-04-28 01:58:36.994081 | TASK [Deploy manager + bootstrap nodes] 2026-04-28 01:58:39.988822 | orchestrator | 2026-04-28 01:58:39.989015 | orchestrator | # DEPLOY MANAGER 2026-04-28 01:58:39.989032 | orchestrator | 2026-04-28 01:58:39.989040 | orchestrator | + set -e 2026-04-28 01:58:39.989048 | orchestrator | + echo 2026-04-28 01:58:39.989056 | orchestrator | + echo '# DEPLOY MANAGER' 2026-04-28 01:58:39.989067 | orchestrator | + echo 2026-04-28 01:58:39.989099 | orchestrator | + cat /opt/manager-vars.sh 2026-04-28 01:58:39.992822 | orchestrator | export NUMBER_OF_NODES=6 2026-04-28 01:58:39.992872 | orchestrator | 2026-04-28 01:58:39.992881 | orchestrator | export CEPH_VERSION=reef 2026-04-28 01:58:39.992890 | orchestrator | export CONFIGURATION_VERSION=main 2026-04-28 01:58:39.992898 | orchestrator | export MANAGER_VERSION=9.5.0 2026-04-28 01:58:39.992915 | orchestrator | export OPENSTACK_VERSION=2024.2 2026-04-28 01:58:39.992946 | orchestrator | 2026-04-28 01:58:39.992958 | orchestrator | export ARA=false 2026-04-28 01:58:39.992965 | orchestrator | export DEPLOY_MODE=manager 2026-04-28 01:58:39.992976 | orchestrator | export TEMPEST=false 2026-04-28 01:58:39.992982 | orchestrator | export IS_ZUUL=true 2026-04-28 01:58:39.992989 | orchestrator | 2026-04-28 01:58:39.993000 | orchestrator | export MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 01:58:39.993007 | orchestrator | export EXTERNAL_API=false 2026-04-28 01:58:39.993014 | orchestrator | 2026-04-28 01:58:39.993020 | orchestrator | export IMAGE_USER=ubuntu 2026-04-28 01:58:39.993028 | orchestrator | export IMAGE_NODE_USER=ubuntu 2026-04-28 01:58:39.993035 | orchestrator | 2026-04-28 01:58:39.993041 | orchestrator | export CEPH_STACK=ceph-ansible 2026-04-28 01:58:39.993047 | orchestrator | 2026-04-28 01:58:39.993053 | orchestrator | + echo 2026-04-28 01:58:39.993061 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-28 01:58:39.994546 | orchestrator | ++ export INTERACTIVE=false 2026-04-28 01:58:39.994590 | orchestrator | ++ INTERACTIVE=false 2026-04-28 01:58:39.994601 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-28 01:58:39.994611 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-28 01:58:39.994618 | orchestrator | + source /opt/manager-vars.sh 2026-04-28 01:58:39.994625 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-28 01:58:39.994631 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-28 01:58:39.994637 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-28 01:58:39.994643 | orchestrator | ++ CEPH_VERSION=reef 2026-04-28 01:58:39.994650 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-28 01:58:39.994658 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-28 01:58:39.994664 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-28 01:58:39.994671 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-28 01:58:39.994677 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-28 01:58:39.994693 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-28 01:58:39.994700 | orchestrator | ++ export ARA=false 2026-04-28 01:58:39.994706 | orchestrator | ++ ARA=false 2026-04-28 01:58:39.994712 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-28 01:58:39.994718 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-28 01:58:39.994724 | orchestrator | ++ export TEMPEST=false 2026-04-28 01:58:39.994731 | orchestrator | ++ TEMPEST=false 2026-04-28 01:58:39.994738 | orchestrator | ++ export IS_ZUUL=true 2026-04-28 01:58:39.994745 | orchestrator | ++ IS_ZUUL=true 2026-04-28 01:58:39.994752 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 01:58:39.994759 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 01:58:39.994766 | orchestrator | ++ export EXTERNAL_API=false 2026-04-28 01:58:39.994773 | orchestrator | ++ EXTERNAL_API=false 2026-04-28 01:58:39.994780 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-28 01:58:39.994787 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-28 01:58:39.994794 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-28 01:58:39.994801 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-28 01:58:39.994808 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-28 01:58:39.994815 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-28 01:58:39.994823 | orchestrator | + sudo ln -sf /opt/configuration/contrib/semver2.sh /usr/local/bin/semver 2026-04-28 01:58:40.058095 | orchestrator | + docker version 2026-04-28 01:58:40.158595 | orchestrator | Client: Docker Engine - Community 2026-04-28 01:58:40.158676 | orchestrator | Version: 27.5.1 2026-04-28 01:58:40.158686 | orchestrator | API version: 1.47 2026-04-28 01:58:40.158694 | orchestrator | Go version: go1.22.11 2026-04-28 01:58:40.158701 | orchestrator | Git commit: 9f9e405 2026-04-28 01:58:40.158707 | orchestrator | Built: Wed Jan 22 13:41:48 2025 2026-04-28 01:58:40.158716 | orchestrator | OS/Arch: linux/amd64 2026-04-28 01:58:40.158723 | orchestrator | Context: default 2026-04-28 01:58:40.158729 | orchestrator | 2026-04-28 01:58:40.158736 | orchestrator | Server: Docker Engine - Community 2026-04-28 01:58:40.158742 | orchestrator | Engine: 2026-04-28 01:58:40.158749 | orchestrator | Version: 27.5.1 2026-04-28 01:58:40.158756 | orchestrator | API version: 1.47 (minimum version 1.24) 2026-04-28 01:58:40.158785 | orchestrator | Go version: go1.22.11 2026-04-28 01:58:40.158791 | orchestrator | Git commit: 4c9b3b0 2026-04-28 01:58:40.158798 | orchestrator | Built: Wed Jan 22 13:41:48 2025 2026-04-28 01:58:40.158804 | orchestrator | OS/Arch: linux/amd64 2026-04-28 01:58:40.158810 | orchestrator | Experimental: false 2026-04-28 01:58:40.158817 | orchestrator | containerd: 2026-04-28 01:58:40.158823 | orchestrator | Version: v2.2.3 2026-04-28 01:58:40.158830 | orchestrator | GitCommit: 77c84241c7cbdd9b4eca2591793e3d4f4317c590 2026-04-28 01:58:40.158837 | orchestrator | runc: 2026-04-28 01:58:40.158843 | orchestrator | Version: 1.3.5 2026-04-28 01:58:40.158861 | orchestrator | GitCommit: v1.3.5-0-g488fc13e 2026-04-28 01:58:40.158867 | orchestrator | docker-init: 2026-04-28 01:58:40.158874 | orchestrator | Version: 0.19.0 2026-04-28 01:58:40.158880 | orchestrator | GitCommit: de40ad0 2026-04-28 01:58:40.162345 | orchestrator | + sh -c /opt/configuration/scripts/deploy/000-manager.sh 2026-04-28 01:58:40.171667 | orchestrator | + set -e 2026-04-28 01:58:40.171742 | orchestrator | + source /opt/manager-vars.sh 2026-04-28 01:58:40.171752 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-28 01:58:40.171759 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-28 01:58:40.171765 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-28 01:58:40.171776 | orchestrator | ++ CEPH_VERSION=reef 2026-04-28 01:58:40.171786 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-28 01:58:40.171802 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-28 01:58:40.171818 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-28 01:58:40.171827 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-28 01:58:40.171836 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-28 01:58:40.171847 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-28 01:58:40.171856 | orchestrator | ++ export ARA=false 2026-04-28 01:58:40.171866 | orchestrator | ++ ARA=false 2026-04-28 01:58:40.171875 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-28 01:58:40.171884 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-28 01:58:40.171905 | orchestrator | ++ export TEMPEST=false 2026-04-28 01:58:40.171947 | orchestrator | ++ TEMPEST=false 2026-04-28 01:58:40.171958 | orchestrator | ++ export IS_ZUUL=true 2026-04-28 01:58:40.171966 | orchestrator | ++ IS_ZUUL=true 2026-04-28 01:58:40.171976 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 01:58:40.171986 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 01:58:40.171996 | orchestrator | ++ export EXTERNAL_API=false 2026-04-28 01:58:40.172006 | orchestrator | ++ EXTERNAL_API=false 2026-04-28 01:58:40.172014 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-28 01:58:40.172023 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-28 01:58:40.172034 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-28 01:58:40.172046 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-28 01:58:40.172055 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-28 01:58:40.172065 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-28 01:58:40.172075 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-28 01:58:40.172085 | orchestrator | ++ export INTERACTIVE=false 2026-04-28 01:58:40.172094 | orchestrator | ++ INTERACTIVE=false 2026-04-28 01:58:40.172104 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-28 01:58:40.172120 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-28 01:58:40.172131 | orchestrator | + [[ 9.5.0 != \l\a\t\e\s\t ]] 2026-04-28 01:58:40.172141 | orchestrator | + /opt/configuration/scripts/set-manager-version.sh 9.5.0 2026-04-28 01:58:40.181431 | orchestrator | + set -e 2026-04-28 01:58:40.181514 | orchestrator | + VERSION=9.5.0 2026-04-28 01:58:40.181528 | orchestrator | + sed -i 's/manager_version: .*/manager_version: 9.5.0/g' /opt/configuration/environments/manager/configuration.yml 2026-04-28 01:58:40.190535 | orchestrator | + [[ 9.5.0 != \l\a\t\e\s\t ]] 2026-04-28 01:58:40.190603 | orchestrator | + sed -i /ceph_version:/d /opt/configuration/environments/manager/configuration.yml 2026-04-28 01:58:40.195075 | orchestrator | + sed -i /openstack_version:/d /opt/configuration/environments/manager/configuration.yml 2026-04-28 01:58:40.200581 | orchestrator | + sh -c /opt/configuration/scripts/sync-configuration-repository.sh 2026-04-28 01:58:40.210516 | orchestrator | /opt/configuration ~ 2026-04-28 01:58:40.210585 | orchestrator | + set -e 2026-04-28 01:58:40.210591 | orchestrator | + pushd /opt/configuration 2026-04-28 01:58:40.210598 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-28 01:58:40.213082 | orchestrator | + source /opt/venv/bin/activate 2026-04-28 01:58:40.214156 | orchestrator | ++ deactivate nondestructive 2026-04-28 01:58:40.214230 | orchestrator | ++ '[' -n '' ']' 2026-04-28 01:58:40.214247 | orchestrator | ++ '[' -n '' ']' 2026-04-28 01:58:40.214303 | orchestrator | ++ hash -r 2026-04-28 01:58:40.214326 | orchestrator | ++ '[' -n '' ']' 2026-04-28 01:58:40.214338 | orchestrator | ++ unset VIRTUAL_ENV 2026-04-28 01:58:40.214356 | orchestrator | ++ unset VIRTUAL_ENV_PROMPT 2026-04-28 01:58:40.214375 | orchestrator | ++ '[' '!' nondestructive = nondestructive ']' 2026-04-28 01:58:40.214423 | orchestrator | ++ '[' linux-gnu = cygwin ']' 2026-04-28 01:58:40.214443 | orchestrator | ++ '[' linux-gnu = msys ']' 2026-04-28 01:58:40.214463 | orchestrator | ++ export VIRTUAL_ENV=/opt/venv 2026-04-28 01:58:40.214484 | orchestrator | ++ VIRTUAL_ENV=/opt/venv 2026-04-28 01:58:40.214505 | orchestrator | ++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-28 01:58:40.214523 | orchestrator | ++ PATH=/opt/venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-28 01:58:40.214542 | orchestrator | ++ export PATH 2026-04-28 01:58:40.214559 | orchestrator | ++ '[' -n '' ']' 2026-04-28 01:58:40.214570 | orchestrator | ++ '[' -z '' ']' 2026-04-28 01:58:40.214582 | orchestrator | ++ _OLD_VIRTUAL_PS1= 2026-04-28 01:58:40.214592 | orchestrator | ++ PS1='(venv) ' 2026-04-28 01:58:40.214603 | orchestrator | ++ export PS1 2026-04-28 01:58:40.214614 | orchestrator | ++ VIRTUAL_ENV_PROMPT='(venv) ' 2026-04-28 01:58:40.214625 | orchestrator | ++ export VIRTUAL_ENV_PROMPT 2026-04-28 01:58:40.214635 | orchestrator | ++ hash -r 2026-04-28 01:58:40.214650 | orchestrator | + pip3 install --no-cache-dir python-gilt==1.2.3 requests Jinja2 PyYAML packaging 2026-04-28 01:58:41.631077 | orchestrator | Requirement already satisfied: python-gilt==1.2.3 in /opt/venv/lib/python3.12/site-packages (1.2.3) 2026-04-28 01:58:41.632302 | orchestrator | Requirement already satisfied: requests in /opt/venv/lib/python3.12/site-packages (2.33.1) 2026-04-28 01:58:41.633653 | orchestrator | Requirement already satisfied: Jinja2 in /opt/venv/lib/python3.12/site-packages (3.1.6) 2026-04-28 01:58:41.635063 | orchestrator | Requirement already satisfied: PyYAML in /opt/venv/lib/python3.12/site-packages (6.0.3) 2026-04-28 01:58:41.636291 | orchestrator | Requirement already satisfied: packaging in /opt/venv/lib/python3.12/site-packages (26.2) 2026-04-28 01:58:41.648656 | orchestrator | Requirement already satisfied: click in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (8.3.3) 2026-04-28 01:58:41.649849 | orchestrator | Requirement already satisfied: colorama in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (0.4.6) 2026-04-28 01:58:41.650725 | orchestrator | Requirement already satisfied: fasteners in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (0.20) 2026-04-28 01:58:41.652327 | orchestrator | Requirement already satisfied: sh in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (2.2.2) 2026-04-28 01:58:41.691583 | orchestrator | Requirement already satisfied: charset_normalizer<4,>=2 in /opt/venv/lib/python3.12/site-packages (from requests) (3.4.7) 2026-04-28 01:58:41.693111 | orchestrator | Requirement already satisfied: idna<4,>=2.5 in /opt/venv/lib/python3.12/site-packages (from requests) (3.13) 2026-04-28 01:58:41.695807 | orchestrator | Requirement already satisfied: urllib3<3,>=1.26 in /opt/venv/lib/python3.12/site-packages (from requests) (2.6.3) 2026-04-28 01:58:41.697084 | orchestrator | Requirement already satisfied: certifi>=2023.5.7 in /opt/venv/lib/python3.12/site-packages (from requests) (2026.4.22) 2026-04-28 01:58:41.701641 | orchestrator | Requirement already satisfied: MarkupSafe>=2.0 in /opt/venv/lib/python3.12/site-packages (from Jinja2) (3.0.3) 2026-04-28 01:58:41.926300 | orchestrator | ++ which gilt 2026-04-28 01:58:41.932875 | orchestrator | + GILT=/opt/venv/bin/gilt 2026-04-28 01:58:41.933037 | orchestrator | + /opt/venv/bin/gilt overlay 2026-04-28 01:58:42.240154 | orchestrator | osism.generics: 2026-04-28 01:58:42.421991 | orchestrator | - copied (v0.20251130.0) /home/dragon/.gilt/clone/github.com/osism.generics/environments/manager/images.yml to /opt/configuration/environments/manager/ 2026-04-28 01:58:42.422135 | orchestrator | - copied (v0.20251130.0) /home/dragon/.gilt/clone/github.com/osism.generics/src/render-images.py to /opt/configuration/environments/manager/ 2026-04-28 01:58:42.422172 | orchestrator | - copied (v0.20251130.0) /home/dragon/.gilt/clone/github.com/osism.generics/src/set-versions.py to /opt/configuration/environments/ 2026-04-28 01:58:42.422191 | orchestrator | - running `/opt/configuration/scripts/wrapper-gilt.sh render-images` in /opt/configuration/environments/manager/ 2026-04-28 01:58:43.286752 | orchestrator | - running `rm render-images.py` in /opt/configuration/environments/manager/ 2026-04-28 01:58:43.298468 | orchestrator | - running `/opt/configuration/scripts/wrapper-gilt.sh set-versions` in /opt/configuration/environments/ 2026-04-28 01:58:43.687880 | orchestrator | - running `rm set-versions.py` in /opt/configuration/environments/ 2026-04-28 01:58:43.742625 | orchestrator | ~ 2026-04-28 01:58:43.742705 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-28 01:58:43.742714 | orchestrator | + deactivate 2026-04-28 01:58:43.742721 | orchestrator | + '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin ']' 2026-04-28 01:58:43.742729 | orchestrator | + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-28 01:58:43.742734 | orchestrator | + export PATH 2026-04-28 01:58:43.742740 | orchestrator | + unset _OLD_VIRTUAL_PATH 2026-04-28 01:58:43.742746 | orchestrator | + '[' -n '' ']' 2026-04-28 01:58:43.742753 | orchestrator | + hash -r 2026-04-28 01:58:43.742758 | orchestrator | + '[' -n '' ']' 2026-04-28 01:58:43.742764 | orchestrator | + unset VIRTUAL_ENV 2026-04-28 01:58:43.742769 | orchestrator | + unset VIRTUAL_ENV_PROMPT 2026-04-28 01:58:43.742774 | orchestrator | + '[' '!' '' = nondestructive ']' 2026-04-28 01:58:43.742779 | orchestrator | + unset -f deactivate 2026-04-28 01:58:43.742785 | orchestrator | + popd 2026-04-28 01:58:43.743689 | orchestrator | + [[ 9.5.0 == \l\a\t\e\s\t ]] 2026-04-28 01:58:43.743791 | orchestrator | + [[ ceph-ansible == \r\o\o\k ]] 2026-04-28 01:58:43.744244 | orchestrator | ++ semver 9.5.0 7.0.0 2026-04-28 01:58:43.801027 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-28 01:58:43.801138 | orchestrator | + echo 'enable_osism_kubernetes: true' 2026-04-28 01:58:43.801162 | orchestrator | + [[ 9.5.0 == \l\a\t\e\s\t ]] 2026-04-28 01:58:43.801856 | orchestrator | ++ semver 9.5.0 10.0.0-0 2026-04-28 01:58:43.874237 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-28 01:58:43.875386 | orchestrator | ++ semver 2024.2 2025.1 2026-04-28 01:58:43.939222 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-28 01:58:43.939325 | orchestrator | + /opt/configuration/scripts/enable-resource-nodes.sh 2026-04-28 01:58:44.041409 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-28 01:58:44.041544 | orchestrator | + source /opt/venv/bin/activate 2026-04-28 01:58:44.041554 | orchestrator | ++ deactivate nondestructive 2026-04-28 01:58:44.041561 | orchestrator | ++ '[' -n '' ']' 2026-04-28 01:58:44.041568 | orchestrator | ++ '[' -n '' ']' 2026-04-28 01:58:44.041574 | orchestrator | ++ hash -r 2026-04-28 01:58:44.041590 | orchestrator | ++ '[' -n '' ']' 2026-04-28 01:58:44.041596 | orchestrator | ++ unset VIRTUAL_ENV 2026-04-28 01:58:44.041602 | orchestrator | ++ unset VIRTUAL_ENV_PROMPT 2026-04-28 01:58:44.041608 | orchestrator | ++ '[' '!' nondestructive = nondestructive ']' 2026-04-28 01:58:44.041616 | orchestrator | ++ '[' linux-gnu = cygwin ']' 2026-04-28 01:58:44.041622 | orchestrator | ++ '[' linux-gnu = msys ']' 2026-04-28 01:58:44.041628 | orchestrator | ++ export VIRTUAL_ENV=/opt/venv 2026-04-28 01:58:44.041648 | orchestrator | ++ VIRTUAL_ENV=/opt/venv 2026-04-28 01:58:44.041655 | orchestrator | ++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-28 01:58:44.041686 | orchestrator | ++ PATH=/opt/venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-28 01:58:44.041693 | orchestrator | ++ export PATH 2026-04-28 01:58:44.041750 | orchestrator | ++ '[' -n '' ']' 2026-04-28 01:58:44.041869 | orchestrator | ++ '[' -z '' ']' 2026-04-28 01:58:44.041878 | orchestrator | ++ _OLD_VIRTUAL_PS1= 2026-04-28 01:58:44.041884 | orchestrator | ++ PS1='(venv) ' 2026-04-28 01:58:44.041890 | orchestrator | ++ export PS1 2026-04-28 01:58:44.041914 | orchestrator | ++ VIRTUAL_ENV_PROMPT='(venv) ' 2026-04-28 01:58:44.041945 | orchestrator | ++ export VIRTUAL_ENV_PROMPT 2026-04-28 01:58:44.041951 | orchestrator | ++ hash -r 2026-04-28 01:58:44.042044 | orchestrator | + ansible-playbook -i testbed-manager, --vault-password-file /opt/configuration/environments/.vault_pass /opt/configuration/ansible/manager-part-3.yml 2026-04-28 01:58:45.516673 | orchestrator | 2026-04-28 01:58:45.516781 | orchestrator | PLAY [Copy custom facts] ******************************************************* 2026-04-28 01:58:45.516796 | orchestrator | 2026-04-28 01:58:45.516807 | orchestrator | TASK [Create custom facts directory] ******************************************* 2026-04-28 01:58:46.166221 | orchestrator | ok: [testbed-manager] 2026-04-28 01:58:46.166325 | orchestrator | 2026-04-28 01:58:46.166351 | orchestrator | TASK [Copy fact files] ********************************************************* 2026-04-28 01:58:47.275417 | orchestrator | changed: [testbed-manager] 2026-04-28 01:58:47.275499 | orchestrator | 2026-04-28 01:58:47.275528 | orchestrator | PLAY [Before the deployment of the manager] ************************************ 2026-04-28 01:58:47.275534 | orchestrator | 2026-04-28 01:58:47.275542 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-28 01:58:50.049588 | orchestrator | ok: [testbed-manager] 2026-04-28 01:58:50.049703 | orchestrator | 2026-04-28 01:58:50.049766 | orchestrator | TASK [Get /opt/manager-vars.sh] ************************************************ 2026-04-28 01:58:50.109473 | orchestrator | ok: [testbed-manager] 2026-04-28 01:58:50.109572 | orchestrator | 2026-04-28 01:58:50.109587 | orchestrator | TASK [Add ara_server_mariadb_volume_type parameter] **************************** 2026-04-28 01:58:50.639181 | orchestrator | changed: [testbed-manager] 2026-04-28 01:58:50.639291 | orchestrator | 2026-04-28 01:58:50.639310 | orchestrator | TASK [Add netbox_enable parameter] ********************************************* 2026-04-28 01:58:50.672442 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:58:50.672537 | orchestrator | 2026-04-28 01:58:50.672552 | orchestrator | TASK [Install HWE kernel package on Ubuntu] ************************************ 2026-04-28 01:58:51.094208 | orchestrator | changed: [testbed-manager] 2026-04-28 01:58:51.094336 | orchestrator | 2026-04-28 01:58:51.094364 | orchestrator | TASK [Check if /etc/OTC_region exist] ****************************************** 2026-04-28 01:58:51.525910 | orchestrator | ok: [testbed-manager] 2026-04-28 01:58:51.526012 | orchestrator | 2026-04-28 01:58:51.526074 | orchestrator | TASK [Add nova_compute_virt_type parameter] ************************************ 2026-04-28 01:58:51.675445 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:58:51.675561 | orchestrator | 2026-04-28 01:58:51.675582 | orchestrator | PLAY [Apply role traefik] ****************************************************** 2026-04-28 01:58:51.675599 | orchestrator | 2026-04-28 01:58:51.675613 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-28 01:58:53.883723 | orchestrator | ok: [testbed-manager] 2026-04-28 01:58:53.883820 | orchestrator | 2026-04-28 01:58:53.883834 | orchestrator | TASK [Apply traefik role] ****************************************************** 2026-04-28 01:58:54.000071 | orchestrator | included: osism.services.traefik for testbed-manager 2026-04-28 01:58:54.000142 | orchestrator | 2026-04-28 01:58:54.000151 | orchestrator | TASK [osism.services.traefik : Include config tasks] *************************** 2026-04-28 01:58:54.086492 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/traefik/tasks/config.yml for testbed-manager 2026-04-28 01:58:54.086568 | orchestrator | 2026-04-28 01:58:54.086577 | orchestrator | TASK [osism.services.traefik : Create required directories] ******************** 2026-04-28 01:58:55.455566 | orchestrator | changed: [testbed-manager] => (item=/opt/traefik) 2026-04-28 01:58:55.455661 | orchestrator | changed: [testbed-manager] => (item=/opt/traefik/certificates) 2026-04-28 01:58:55.455673 | orchestrator | changed: [testbed-manager] => (item=/opt/traefik/configuration) 2026-04-28 01:58:55.455681 | orchestrator | 2026-04-28 01:58:55.455692 | orchestrator | TASK [osism.services.traefik : Copy configuration files] *********************** 2026-04-28 01:58:57.513772 | orchestrator | changed: [testbed-manager] => (item=traefik.yml) 2026-04-28 01:58:57.513892 | orchestrator | changed: [testbed-manager] => (item=traefik.env) 2026-04-28 01:58:57.513963 | orchestrator | changed: [testbed-manager] => (item=certificates.yml) 2026-04-28 01:58:57.513992 | orchestrator | 2026-04-28 01:58:57.514006 | orchestrator | TASK [osism.services.traefik : Copy certificate cert files] ******************** 2026-04-28 01:58:58.240228 | orchestrator | changed: [testbed-manager] => (item=None) 2026-04-28 01:58:58.240309 | orchestrator | changed: [testbed-manager] 2026-04-28 01:58:58.240319 | orchestrator | 2026-04-28 01:58:58.240327 | orchestrator | TASK [osism.services.traefik : Copy certificate key files] ********************* 2026-04-28 01:58:58.979993 | orchestrator | changed: [testbed-manager] => (item=None) 2026-04-28 01:58:58.980076 | orchestrator | changed: [testbed-manager] 2026-04-28 01:58:58.980087 | orchestrator | 2026-04-28 01:58:58.980095 | orchestrator | TASK [osism.services.traefik : Copy dynamic configuration] ********************* 2026-04-28 01:58:59.043297 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:58:59.043407 | orchestrator | 2026-04-28 01:58:59.043429 | orchestrator | TASK [osism.services.traefik : Remove dynamic configuration] ******************* 2026-04-28 01:58:59.442213 | orchestrator | ok: [testbed-manager] 2026-04-28 01:58:59.442282 | orchestrator | 2026-04-28 01:58:59.442289 | orchestrator | TASK [osism.services.traefik : Include service tasks] ************************** 2026-04-28 01:58:59.531996 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/traefik/tasks/service.yml for testbed-manager 2026-04-28 01:58:59.532089 | orchestrator | 2026-04-28 01:58:59.532101 | orchestrator | TASK [osism.services.traefik : Create traefik external network] **************** 2026-04-28 01:59:00.736969 | orchestrator | changed: [testbed-manager] 2026-04-28 01:59:00.737087 | orchestrator | 2026-04-28 01:59:00.737107 | orchestrator | TASK [osism.services.traefik : Copy docker-compose.yml file] ******************* 2026-04-28 01:59:01.638082 | orchestrator | changed: [testbed-manager] 2026-04-28 01:59:01.638178 | orchestrator | 2026-04-28 01:59:01.638190 | orchestrator | TASK [osism.services.traefik : Manage traefik service] ************************* 2026-04-28 01:59:20.364190 | orchestrator | changed: [testbed-manager] 2026-04-28 01:59:20.364316 | orchestrator | 2026-04-28 01:59:20.364337 | orchestrator | RUNNING HANDLER [osism.services.traefik : Restart traefik service] ************* 2026-04-28 01:59:20.435490 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:59:20.435598 | orchestrator | 2026-04-28 01:59:20.435645 | orchestrator | PLAY [Deploy manager service] ************************************************** 2026-04-28 01:59:20.435666 | orchestrator | 2026-04-28 01:59:20.435682 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-28 01:59:22.450512 | orchestrator | ok: [testbed-manager] 2026-04-28 01:59:22.450639 | orchestrator | 2026-04-28 01:59:22.450654 | orchestrator | TASK [Apply manager role] ****************************************************** 2026-04-28 01:59:22.588137 | orchestrator | included: osism.services.manager for testbed-manager 2026-04-28 01:59:22.588224 | orchestrator | 2026-04-28 01:59:22.588236 | orchestrator | TASK [osism.services.manager : Include install tasks] ************************** 2026-04-28 01:59:22.671090 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/install-Debian-family.yml for testbed-manager 2026-04-28 01:59:22.671183 | orchestrator | 2026-04-28 01:59:22.671197 | orchestrator | TASK [osism.services.manager : Install required packages] ********************** 2026-04-28 01:59:25.449380 | orchestrator | ok: [testbed-manager] 2026-04-28 01:59:25.449504 | orchestrator | 2026-04-28 01:59:25.449524 | orchestrator | TASK [osism.services.manager : Gather variables for each operating system] ***** 2026-04-28 01:59:25.508364 | orchestrator | ok: [testbed-manager] 2026-04-28 01:59:25.508457 | orchestrator | 2026-04-28 01:59:25.508476 | orchestrator | TASK [osism.services.manager : Include config tasks] *************************** 2026-04-28 01:59:25.661440 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config.yml for testbed-manager 2026-04-28 01:59:25.661528 | orchestrator | 2026-04-28 01:59:25.661539 | orchestrator | TASK [osism.services.manager : Create required directories] ******************** 2026-04-28 01:59:28.789441 | orchestrator | changed: [testbed-manager] => (item=/opt/ansible) 2026-04-28 01:59:28.789529 | orchestrator | changed: [testbed-manager] => (item=/opt/archive) 2026-04-28 01:59:28.789540 | orchestrator | changed: [testbed-manager] => (item=/opt/manager/configuration) 2026-04-28 01:59:28.789550 | orchestrator | changed: [testbed-manager] => (item=/opt/manager/data) 2026-04-28 01:59:28.789558 | orchestrator | ok: [testbed-manager] => (item=/opt/manager) 2026-04-28 01:59:28.789567 | orchestrator | changed: [testbed-manager] => (item=/opt/manager/secrets) 2026-04-28 01:59:28.789575 | orchestrator | changed: [testbed-manager] => (item=/opt/ansible/secrets) 2026-04-28 01:59:28.789583 | orchestrator | changed: [testbed-manager] => (item=/opt/state) 2026-04-28 01:59:28.789591 | orchestrator | 2026-04-28 01:59:28.789601 | orchestrator | TASK [osism.services.manager : Copy all environment file] ********************** 2026-04-28 01:59:29.511615 | orchestrator | changed: [testbed-manager] 2026-04-28 01:59:29.511737 | orchestrator | 2026-04-28 01:59:29.511757 | orchestrator | TASK [osism.services.manager : Copy client environment file] ******************* 2026-04-28 01:59:30.237176 | orchestrator | changed: [testbed-manager] 2026-04-28 01:59:30.237258 | orchestrator | 2026-04-28 01:59:30.237269 | orchestrator | TASK [osism.services.manager : Include ara config tasks] *********************** 2026-04-28 01:59:30.336140 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-ara.yml for testbed-manager 2026-04-28 01:59:30.336238 | orchestrator | 2026-04-28 01:59:30.336282 | orchestrator | TASK [osism.services.manager : Copy ARA environment files] ********************* 2026-04-28 01:59:31.675865 | orchestrator | changed: [testbed-manager] => (item=ara) 2026-04-28 01:59:31.675999 | orchestrator | changed: [testbed-manager] => (item=ara-server) 2026-04-28 01:59:31.676011 | orchestrator | 2026-04-28 01:59:31.676021 | orchestrator | TASK [osism.services.manager : Copy MariaDB environment file] ****************** 2026-04-28 01:59:32.362766 | orchestrator | changed: [testbed-manager] 2026-04-28 01:59:32.362894 | orchestrator | 2026-04-28 01:59:32.362977 | orchestrator | TASK [osism.services.manager : Include vault config tasks] ********************* 2026-04-28 01:59:32.428350 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:59:32.428444 | orchestrator | 2026-04-28 01:59:32.428458 | orchestrator | TASK [osism.services.manager : Include frontend config tasks] ****************** 2026-04-28 01:59:32.514252 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-frontend.yml for testbed-manager 2026-04-28 01:59:32.514339 | orchestrator | 2026-04-28 01:59:32.514352 | orchestrator | TASK [osism.services.manager : Copy frontend environment file] ***************** 2026-04-28 01:59:33.188469 | orchestrator | changed: [testbed-manager] 2026-04-28 01:59:33.188577 | orchestrator | 2026-04-28 01:59:33.188592 | orchestrator | TASK [osism.services.manager : Include ansible config tasks] ******************* 2026-04-28 01:59:33.254111 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-ansible.yml for testbed-manager 2026-04-28 01:59:33.254212 | orchestrator | 2026-04-28 01:59:33.254229 | orchestrator | TASK [osism.services.manager : Copy private ssh keys] ************************** 2026-04-28 01:59:34.784835 | orchestrator | changed: [testbed-manager] => (item=None) 2026-04-28 01:59:34.784943 | orchestrator | changed: [testbed-manager] => (item=None) 2026-04-28 01:59:34.784951 | orchestrator | changed: [testbed-manager] 2026-04-28 01:59:34.784957 | orchestrator | 2026-04-28 01:59:34.784962 | orchestrator | TASK [osism.services.manager : Copy ansible environment file] ****************** 2026-04-28 01:59:35.518447 | orchestrator | changed: [testbed-manager] 2026-04-28 01:59:35.518550 | orchestrator | 2026-04-28 01:59:35.518568 | orchestrator | TASK [osism.services.manager : Include netbox config tasks] ******************** 2026-04-28 01:59:35.575232 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:59:35.575324 | orchestrator | 2026-04-28 01:59:35.575334 | orchestrator | TASK [osism.services.manager : Include celery config tasks] ******************** 2026-04-28 01:59:35.685854 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-celery.yml for testbed-manager 2026-04-28 01:59:35.685987 | orchestrator | 2026-04-28 01:59:35.686000 | orchestrator | TASK [osism.services.manager : Set fs.inotify.max_user_watches] **************** 2026-04-28 01:59:36.310834 | orchestrator | changed: [testbed-manager] 2026-04-28 01:59:36.310971 | orchestrator | 2026-04-28 01:59:36.310986 | orchestrator | TASK [osism.services.manager : Set fs.inotify.max_user_instances] ************** 2026-04-28 01:59:36.767813 | orchestrator | changed: [testbed-manager] 2026-04-28 01:59:36.768068 | orchestrator | 2026-04-28 01:59:36.768102 | orchestrator | TASK [osism.services.manager : Copy celery environment files] ****************** 2026-04-28 01:59:38.156507 | orchestrator | changed: [testbed-manager] => (item=conductor) 2026-04-28 01:59:38.156586 | orchestrator | changed: [testbed-manager] => (item=openstack) 2026-04-28 01:59:38.156596 | orchestrator | 2026-04-28 01:59:38.156605 | orchestrator | TASK [osism.services.manager : Copy listener environment file] ***************** 2026-04-28 01:59:38.870878 | orchestrator | changed: [testbed-manager] 2026-04-28 01:59:38.871070 | orchestrator | 2026-04-28 01:59:38.871093 | orchestrator | TASK [osism.services.manager : Check for conductor.yml] ************************ 2026-04-28 01:59:39.298686 | orchestrator | ok: [testbed-manager] 2026-04-28 01:59:39.298792 | orchestrator | 2026-04-28 01:59:39.298808 | orchestrator | TASK [osism.services.manager : Copy conductor configuration file] ************** 2026-04-28 01:59:39.713406 | orchestrator | changed: [testbed-manager] 2026-04-28 01:59:39.713478 | orchestrator | 2026-04-28 01:59:39.713487 | orchestrator | TASK [osism.services.manager : Copy empty conductor configuration file] ******** 2026-04-28 01:59:39.762804 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:59:39.762980 | orchestrator | 2026-04-28 01:59:39.763017 | orchestrator | TASK [osism.services.manager : Include wrapper config tasks] ******************* 2026-04-28 01:59:39.853157 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-wrapper.yml for testbed-manager 2026-04-28 01:59:39.853275 | orchestrator | 2026-04-28 01:59:39.853292 | orchestrator | TASK [osism.services.manager : Include wrapper vars file] ********************** 2026-04-28 01:59:39.904443 | orchestrator | ok: [testbed-manager] 2026-04-28 01:59:39.904554 | orchestrator | 2026-04-28 01:59:39.904571 | orchestrator | TASK [osism.services.manager : Copy wrapper scripts] *************************** 2026-04-28 01:59:42.106577 | orchestrator | changed: [testbed-manager] => (item=osism) 2026-04-28 01:59:42.106716 | orchestrator | changed: [testbed-manager] => (item=osism-update-docker) 2026-04-28 01:59:42.106744 | orchestrator | changed: [testbed-manager] => (item=osism-update-manager) 2026-04-28 01:59:42.106764 | orchestrator | 2026-04-28 01:59:42.106785 | orchestrator | TASK [osism.services.manager : Copy cilium wrapper script] ********************* 2026-04-28 01:59:42.997640 | orchestrator | changed: [testbed-manager] 2026-04-28 01:59:42.997742 | orchestrator | 2026-04-28 01:59:42.997757 | orchestrator | TASK [osism.services.manager : Copy hubble wrapper script] ********************* 2026-04-28 01:59:43.837405 | orchestrator | changed: [testbed-manager] 2026-04-28 01:59:43.837478 | orchestrator | 2026-04-28 01:59:43.837485 | orchestrator | TASK [osism.services.manager : Copy flux wrapper script] *********************** 2026-04-28 01:59:44.642147 | orchestrator | changed: [testbed-manager] 2026-04-28 01:59:44.642242 | orchestrator | 2026-04-28 01:59:44.642255 | orchestrator | TASK [osism.services.manager : Include scripts config tasks] ******************* 2026-04-28 01:59:44.722439 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-scripts.yml for testbed-manager 2026-04-28 01:59:44.722514 | orchestrator | 2026-04-28 01:59:44.722525 | orchestrator | TASK [osism.services.manager : Include scripts vars file] ********************** 2026-04-28 01:59:44.777065 | orchestrator | ok: [testbed-manager] 2026-04-28 01:59:44.777138 | orchestrator | 2026-04-28 01:59:44.777145 | orchestrator | TASK [osism.services.manager : Copy scripts] *********************************** 2026-04-28 01:59:45.552387 | orchestrator | changed: [testbed-manager] => (item=osism-include) 2026-04-28 01:59:45.552461 | orchestrator | 2026-04-28 01:59:45.552468 | orchestrator | TASK [osism.services.manager : Include service tasks] ************************** 2026-04-28 01:59:45.656600 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/service.yml for testbed-manager 2026-04-28 01:59:45.656678 | orchestrator | 2026-04-28 01:59:45.656687 | orchestrator | TASK [osism.services.manager : Copy manager systemd unit file] ***************** 2026-04-28 01:59:46.457643 | orchestrator | changed: [testbed-manager] 2026-04-28 01:59:46.457771 | orchestrator | 2026-04-28 01:59:46.457800 | orchestrator | TASK [osism.services.manager : Create traefik external network] **************** 2026-04-28 01:59:47.229320 | orchestrator | ok: [testbed-manager] 2026-04-28 01:59:47.229399 | orchestrator | 2026-04-28 01:59:47.229407 | orchestrator | TASK [osism.services.manager : Set mariadb healthcheck for mariadb < 11.0.0] *** 2026-04-28 01:59:47.276020 | orchestrator | skipping: [testbed-manager] 2026-04-28 01:59:47.276129 | orchestrator | 2026-04-28 01:59:47.276142 | orchestrator | TASK [osism.services.manager : Set mariadb healthcheck for mariadb >= 11.0.0] *** 2026-04-28 01:59:47.343480 | orchestrator | ok: [testbed-manager] 2026-04-28 01:59:47.343593 | orchestrator | 2026-04-28 01:59:47.343608 | orchestrator | TASK [osism.services.manager : Copy docker-compose.yml file] ******************* 2026-04-28 01:59:48.261456 | orchestrator | changed: [testbed-manager] 2026-04-28 01:59:48.261567 | orchestrator | 2026-04-28 01:59:48.261588 | orchestrator | TASK [osism.services.manager : Pull container images] ************************** 2026-04-28 02:01:10.845543 | orchestrator | changed: [testbed-manager] 2026-04-28 02:01:10.845690 | orchestrator | 2026-04-28 02:01:10.845712 | orchestrator | TASK [osism.services.manager : Stop and disable old service docker-compose@manager] *** 2026-04-28 02:01:12.065110 | orchestrator | ok: [testbed-manager] 2026-04-28 02:01:12.065237 | orchestrator | 2026-04-28 02:01:12.065255 | orchestrator | TASK [osism.services.manager : Do a manual start of the manager service] ******* 2026-04-28 02:01:12.138506 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:01:12.138611 | orchestrator | 2026-04-28 02:01:12.138628 | orchestrator | TASK [osism.services.manager : Manage manager service] ************************* 2026-04-28 02:01:22.849534 | orchestrator | changed: [testbed-manager] 2026-04-28 02:01:22.849662 | orchestrator | 2026-04-28 02:01:22.849677 | orchestrator | TASK [osism.services.manager : Register that manager service was started] ****** 2026-04-28 02:01:22.977888 | orchestrator | ok: [testbed-manager] 2026-04-28 02:01:22.978086 | orchestrator | 2026-04-28 02:01:22.978107 | orchestrator | TASK [osism.services.manager : Flush handlers] ********************************* 2026-04-28 02:01:22.978119 | orchestrator | 2026-04-28 02:01:22.978130 | orchestrator | RUNNING HANDLER [osism.services.manager : Restart manager service] ************* 2026-04-28 02:01:23.044539 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:01:23.044626 | orchestrator | 2026-04-28 02:01:23.044637 | orchestrator | RUNNING HANDLER [osism.services.manager : Wait for manager service to start] *** 2026-04-28 02:02:23.111150 | orchestrator | Pausing for 60 seconds 2026-04-28 02:02:23.111240 | orchestrator | changed: [testbed-manager] 2026-04-28 02:02:23.111250 | orchestrator | 2026-04-28 02:02:23.111258 | orchestrator | RUNNING HANDLER [osism.services.manager : Ensure that all containers are up] *** 2026-04-28 02:02:26.354879 | orchestrator | changed: [testbed-manager] 2026-04-28 02:02:26.354987 | orchestrator | 2026-04-28 02:02:26.354999 | orchestrator | RUNNING HANDLER [osism.services.manager : Wait for an healthy manager service] *** 2026-04-28 02:03:28.689870 | orchestrator | FAILED - RETRYING: [testbed-manager]: Wait for an healthy manager service (50 retries left). 2026-04-28 02:03:28.690067 | orchestrator | FAILED - RETRYING: [testbed-manager]: Wait for an healthy manager service (49 retries left). 2026-04-28 02:03:28.690107 | orchestrator | FAILED - RETRYING: [testbed-manager]: Wait for an healthy manager service (48 retries left). 2026-04-28 02:03:28.690134 | orchestrator | changed: [testbed-manager] 2026-04-28 02:03:28.690159 | orchestrator | 2026-04-28 02:03:28.690171 | orchestrator | RUNNING HANDLER [osism.services.manager : Copy osismclient bash completion script] *** 2026-04-28 02:03:41.143324 | orchestrator | changed: [testbed-manager] 2026-04-28 02:03:41.143471 | orchestrator | 2026-04-28 02:03:41.143501 | orchestrator | TASK [osism.services.manager : Include initialize tasks] *********************** 2026-04-28 02:03:41.253580 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/initialize.yml for testbed-manager 2026-04-28 02:03:41.253649 | orchestrator | 2026-04-28 02:03:41.253656 | orchestrator | TASK [osism.services.manager : Flush handlers] ********************************* 2026-04-28 02:03:41.253662 | orchestrator | 2026-04-28 02:03:41.253666 | orchestrator | TASK [osism.services.manager : Include vault initialize tasks] ***************** 2026-04-28 02:03:41.308863 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:03:41.308939 | orchestrator | 2026-04-28 02:03:41.308989 | orchestrator | TASK [osism.services.manager : Include version verification tasks] ************* 2026-04-28 02:03:41.388348 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/manager/tasks/verify-versions.yml for testbed-manager 2026-04-28 02:03:41.388558 | orchestrator | 2026-04-28 02:03:41.388584 | orchestrator | TASK [osism.services.manager : Deploy service manager version check script] **** 2026-04-28 02:03:42.250511 | orchestrator | changed: [testbed-manager] 2026-04-28 02:03:42.250628 | orchestrator | 2026-04-28 02:03:42.250654 | orchestrator | TASK [osism.services.manager : Execute service manager version check] ********** 2026-04-28 02:03:45.654644 | orchestrator | ok: [testbed-manager] 2026-04-28 02:03:45.654778 | orchestrator | 2026-04-28 02:03:45.654805 | orchestrator | TASK [osism.services.manager : Display version check results] ****************** 2026-04-28 02:03:45.726386 | orchestrator | ok: [testbed-manager] => { 2026-04-28 02:03:45.726495 | orchestrator | "version_check_result.stdout_lines": [ 2026-04-28 02:03:45.726522 | orchestrator | "=== OSISM Container Version Check ===", 2026-04-28 02:03:45.726543 | orchestrator | "Checking running containers against expected versions...", 2026-04-28 02:03:45.726564 | orchestrator | "", 2026-04-28 02:03:45.726579 | orchestrator | "Checking service: inventory_reconciler (Inventory Reconciler Service)", 2026-04-28 02:03:45.726591 | orchestrator | " Expected: registry.osism.tech/osism/inventory-reconciler:0.20251130.0", 2026-04-28 02:03:45.726603 | orchestrator | " Enabled: true", 2026-04-28 02:03:45.726614 | orchestrator | " Running: registry.osism.tech/osism/inventory-reconciler:0.20251130.0", 2026-04-28 02:03:45.726625 | orchestrator | " Status: ✅ MATCH", 2026-04-28 02:03:45.726636 | orchestrator | "", 2026-04-28 02:03:45.726647 | orchestrator | "Checking service: osism-ansible (OSISM Ansible Service)", 2026-04-28 02:03:45.726685 | orchestrator | " Expected: registry.osism.tech/osism/osism-ansible:0.20251130.0", 2026-04-28 02:03:45.726697 | orchestrator | " Enabled: true", 2026-04-28 02:03:45.726709 | orchestrator | " Running: registry.osism.tech/osism/osism-ansible:0.20251130.0", 2026-04-28 02:03:45.726720 | orchestrator | " Status: ✅ MATCH", 2026-04-28 02:03:45.726730 | orchestrator | "", 2026-04-28 02:03:45.726741 | orchestrator | "Checking service: osism-kubernetes (Osism-Kubernetes Service)", 2026-04-28 02:03:45.726752 | orchestrator | " Expected: registry.osism.tech/osism/osism-kubernetes:0.20251130.0", 2026-04-28 02:03:45.726763 | orchestrator | " Enabled: true", 2026-04-28 02:03:45.726774 | orchestrator | " Running: registry.osism.tech/osism/osism-kubernetes:0.20251130.0", 2026-04-28 02:03:45.726785 | orchestrator | " Status: ✅ MATCH", 2026-04-28 02:03:45.726795 | orchestrator | "", 2026-04-28 02:03:45.726806 | orchestrator | "Checking service: ceph-ansible (Ceph-Ansible Service)", 2026-04-28 02:03:45.726818 | orchestrator | " Expected: registry.osism.tech/osism/ceph-ansible:0.20251130.0", 2026-04-28 02:03:45.726828 | orchestrator | " Enabled: true", 2026-04-28 02:03:45.726839 | orchestrator | " Running: registry.osism.tech/osism/ceph-ansible:0.20251130.0", 2026-04-28 02:03:45.726850 | orchestrator | " Status: ✅ MATCH", 2026-04-28 02:03:45.726861 | orchestrator | "", 2026-04-28 02:03:45.726874 | orchestrator | "Checking service: kolla-ansible (Kolla-Ansible Service)", 2026-04-28 02:03:45.726885 | orchestrator | " Expected: registry.osism.tech/osism/kolla-ansible:0.20251130.0", 2026-04-28 02:03:45.726896 | orchestrator | " Enabled: true", 2026-04-28 02:03:45.726907 | orchestrator | " Running: registry.osism.tech/osism/kolla-ansible:0.20251130.0", 2026-04-28 02:03:45.726919 | orchestrator | " Status: ✅ MATCH", 2026-04-28 02:03:45.726932 | orchestrator | "", 2026-04-28 02:03:45.726967 | orchestrator | "Checking service: osismclient (OSISM Client)", 2026-04-28 02:03:45.726980 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-28 02:03:45.726993 | orchestrator | " Enabled: true", 2026-04-28 02:03:45.727007 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-28 02:03:45.727019 | orchestrator | " Status: ✅ MATCH", 2026-04-28 02:03:45.727031 | orchestrator | "", 2026-04-28 02:03:45.727044 | orchestrator | "Checking service: ara-server (ARA Server)", 2026-04-28 02:03:45.727056 | orchestrator | " Expected: registry.osism.tech/osism/ara-server:1.7.3", 2026-04-28 02:03:45.727069 | orchestrator | " Enabled: true", 2026-04-28 02:03:45.727081 | orchestrator | " Running: registry.osism.tech/osism/ara-server:1.7.3", 2026-04-28 02:03:45.727094 | orchestrator | " Status: ✅ MATCH", 2026-04-28 02:03:45.727107 | orchestrator | "", 2026-04-28 02:03:45.727119 | orchestrator | "Checking service: mariadb (MariaDB for ARA)", 2026-04-28 02:03:45.727132 | orchestrator | " Expected: registry.osism.tech/dockerhub/library/mariadb:11.8.4", 2026-04-28 02:03:45.727152 | orchestrator | " Enabled: true", 2026-04-28 02:03:45.727173 | orchestrator | " Running: registry.osism.tech/dockerhub/library/mariadb:11.8.4", 2026-04-28 02:03:45.727192 | orchestrator | " Status: ✅ MATCH", 2026-04-28 02:03:45.727213 | orchestrator | "", 2026-04-28 02:03:45.727236 | orchestrator | "Checking service: frontend (OSISM Frontend)", 2026-04-28 02:03:45.727253 | orchestrator | " Expected: registry.osism.tech/osism/osism-frontend:0.20251130.1", 2026-04-28 02:03:45.727267 | orchestrator | " Enabled: true", 2026-04-28 02:03:45.727280 | orchestrator | " Running: registry.osism.tech/osism/osism-frontend:0.20251130.1", 2026-04-28 02:03:45.727291 | orchestrator | " Status: ✅ MATCH", 2026-04-28 02:03:45.727301 | orchestrator | "", 2026-04-28 02:03:45.727312 | orchestrator | "Checking service: redis (Redis Cache)", 2026-04-28 02:03:45.727323 | orchestrator | " Expected: registry.osism.tech/dockerhub/library/redis:7.4.7-alpine", 2026-04-28 02:03:45.727334 | orchestrator | " Enabled: true", 2026-04-28 02:03:45.727345 | orchestrator | " Running: registry.osism.tech/dockerhub/library/redis:7.4.7-alpine", 2026-04-28 02:03:45.727356 | orchestrator | " Status: ✅ MATCH", 2026-04-28 02:03:45.727367 | orchestrator | "", 2026-04-28 02:03:45.727378 | orchestrator | "Checking service: api (OSISM API Service)", 2026-04-28 02:03:45.727399 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-28 02:03:45.727410 | orchestrator | " Enabled: true", 2026-04-28 02:03:45.727421 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-28 02:03:45.727432 | orchestrator | " Status: ✅ MATCH", 2026-04-28 02:03:45.727442 | orchestrator | "", 2026-04-28 02:03:45.727453 | orchestrator | "Checking service: listener (OpenStack Event Listener)", 2026-04-28 02:03:45.727464 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-28 02:03:45.727475 | orchestrator | " Enabled: true", 2026-04-28 02:03:45.727486 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-28 02:03:45.727498 | orchestrator | " Status: ✅ MATCH", 2026-04-28 02:03:45.727509 | orchestrator | "", 2026-04-28 02:03:45.727520 | orchestrator | "Checking service: openstack (OpenStack Integration)", 2026-04-28 02:03:45.727531 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-28 02:03:45.727542 | orchestrator | " Enabled: true", 2026-04-28 02:03:45.727553 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-28 02:03:45.727563 | orchestrator | " Status: ✅ MATCH", 2026-04-28 02:03:45.727574 | orchestrator | "", 2026-04-28 02:03:45.727585 | orchestrator | "Checking service: beat (Celery Beat Scheduler)", 2026-04-28 02:03:45.727596 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-28 02:03:45.727607 | orchestrator | " Enabled: true", 2026-04-28 02:03:45.727618 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-28 02:03:45.727647 | orchestrator | " Status: ✅ MATCH", 2026-04-28 02:03:45.727658 | orchestrator | "", 2026-04-28 02:03:45.727669 | orchestrator | "Checking service: flower (Celery Flower Monitor)", 2026-04-28 02:03:45.727680 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-28 02:03:45.727700 | orchestrator | " Enabled: true", 2026-04-28 02:03:45.727712 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20251130.1", 2026-04-28 02:03:45.727722 | orchestrator | " Status: ✅ MATCH", 2026-04-28 02:03:45.727733 | orchestrator | "", 2026-04-28 02:03:45.727744 | orchestrator | "=== Summary ===", 2026-04-28 02:03:45.727755 | orchestrator | "Errors (version mismatches): 0", 2026-04-28 02:03:45.727766 | orchestrator | "Warnings (expected containers not running): 0", 2026-04-28 02:03:45.727777 | orchestrator | "", 2026-04-28 02:03:45.727788 | orchestrator | "✅ All running containers match expected versions!" 2026-04-28 02:03:45.727799 | orchestrator | ] 2026-04-28 02:03:45.727810 | orchestrator | } 2026-04-28 02:03:45.727821 | orchestrator | 2026-04-28 02:03:45.727833 | orchestrator | TASK [osism.services.manager : Skip version check due to service configuration] *** 2026-04-28 02:03:45.789809 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:03:45.789910 | orchestrator | 2026-04-28 02:03:45.789925 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:03:45.789941 | orchestrator | testbed-manager : ok=70 changed=37 unreachable=0 failed=0 skipped=12 rescued=0 ignored=0 2026-04-28 02:03:45.789976 | orchestrator | 2026-04-28 02:03:45.926651 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-28 02:03:45.926728 | orchestrator | + deactivate 2026-04-28 02:03:45.926739 | orchestrator | + '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin ']' 2026-04-28 02:03:45.926748 | orchestrator | + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-28 02:03:45.926755 | orchestrator | + export PATH 2026-04-28 02:03:45.926761 | orchestrator | + unset _OLD_VIRTUAL_PATH 2026-04-28 02:03:45.926767 | orchestrator | + '[' -n '' ']' 2026-04-28 02:03:45.926773 | orchestrator | + hash -r 2026-04-28 02:03:45.926780 | orchestrator | + '[' -n '' ']' 2026-04-28 02:03:45.926787 | orchestrator | + unset VIRTUAL_ENV 2026-04-28 02:03:45.926793 | orchestrator | + unset VIRTUAL_ENV_PROMPT 2026-04-28 02:03:45.926800 | orchestrator | + '[' '!' '' = nondestructive ']' 2026-04-28 02:03:45.926806 | orchestrator | + unset -f deactivate 2026-04-28 02:03:45.926815 | orchestrator | + cp /home/dragon/.ssh/id_rsa.pub /opt/ansible/secrets/id_rsa.operator.pub 2026-04-28 02:03:45.936506 | orchestrator | + [[ ceph-ansible == \c\e\p\h\-\a\n\s\i\b\l\e ]] 2026-04-28 02:03:45.936581 | orchestrator | + wait_for_container_healthy 60 ceph-ansible 2026-04-28 02:03:45.936586 | orchestrator | + local max_attempts=60 2026-04-28 02:03:45.936591 | orchestrator | + local name=ceph-ansible 2026-04-28 02:03:45.936595 | orchestrator | + local attempt_num=1 2026-04-28 02:03:45.937428 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-28 02:03:45.981164 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-28 02:03:45.981263 | orchestrator | + wait_for_container_healthy 60 kolla-ansible 2026-04-28 02:03:45.981274 | orchestrator | + local max_attempts=60 2026-04-28 02:03:45.981281 | orchestrator | + local name=kolla-ansible 2026-04-28 02:03:45.981287 | orchestrator | + local attempt_num=1 2026-04-28 02:03:45.982088 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' kolla-ansible 2026-04-28 02:03:46.023464 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-28 02:03:46.023554 | orchestrator | + wait_for_container_healthy 60 osism-ansible 2026-04-28 02:03:46.023567 | orchestrator | + local max_attempts=60 2026-04-28 02:03:46.023577 | orchestrator | + local name=osism-ansible 2026-04-28 02:03:46.023586 | orchestrator | + local attempt_num=1 2026-04-28 02:03:46.023703 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' osism-ansible 2026-04-28 02:03:46.059661 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-28 02:03:46.059757 | orchestrator | + [[ true == \t\r\u\e ]] 2026-04-28 02:03:46.059771 | orchestrator | + sh -c /opt/configuration/scripts/disable-ara.sh 2026-04-28 02:03:46.771748 | orchestrator | + docker compose --project-directory /opt/manager ps 2026-04-28 02:03:46.972509 | orchestrator | NAME IMAGE COMMAND SERVICE CREATED STATUS PORTS 2026-04-28 02:03:46.972630 | orchestrator | ceph-ansible registry.osism.tech/osism/ceph-ansible:0.20251130.0 "/entrypoint.sh osis…" ceph-ansible 2 minutes ago Up About a minute (healthy) 2026-04-28 02:03:46.972655 | orchestrator | kolla-ansible registry.osism.tech/osism/kolla-ansible:0.20251130.0 "/entrypoint.sh osis…" kolla-ansible 2 minutes ago Up About a minute (healthy) 2026-04-28 02:03:46.972675 | orchestrator | manager-api-1 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" api 2 minutes ago Up 2 minutes (healthy) 192.168.16.5:8000->8000/tcp 2026-04-28 02:03:46.972693 | orchestrator | manager-ara-server-1 registry.osism.tech/osism/ara-server:1.7.3 "sh -c '/wait && /ru…" ara-server 2 minutes ago Up 2 minutes (healthy) 8000/tcp 2026-04-28 02:03:46.972736 | orchestrator | manager-beat-1 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" beat 2 minutes ago Up 2 minutes (healthy) 2026-04-28 02:03:46.972753 | orchestrator | manager-flower-1 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" flower 2 minutes ago Up 2 minutes (healthy) 2026-04-28 02:03:46.972771 | orchestrator | manager-inventory_reconciler-1 registry.osism.tech/osism/inventory-reconciler:0.20251130.0 "/sbin/tini -- /entr…" inventory_reconciler 2 minutes ago Up About a minute (healthy) 2026-04-28 02:03:46.972790 | orchestrator | manager-listener-1 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" listener 2 minutes ago Up 2 minutes (healthy) 2026-04-28 02:03:46.972806 | orchestrator | manager-mariadb-1 registry.osism.tech/dockerhub/library/mariadb:11.8.4 "docker-entrypoint.s…" mariadb 2 minutes ago Up 2 minutes (healthy) 3306/tcp 2026-04-28 02:03:46.972822 | orchestrator | manager-openstack-1 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" openstack 2 minutes ago Up 2 minutes (healthy) 2026-04-28 02:03:46.972839 | orchestrator | manager-redis-1 registry.osism.tech/dockerhub/library/redis:7.4.7-alpine "docker-entrypoint.s…" redis 2 minutes ago Up 2 minutes (healthy) 6379/tcp 2026-04-28 02:03:46.972883 | orchestrator | osism-ansible registry.osism.tech/osism/osism-ansible:0.20251130.0 "/entrypoint.sh osis…" osism-ansible 2 minutes ago Up About a minute (healthy) 2026-04-28 02:03:46.972901 | orchestrator | osism-frontend registry.osism.tech/osism/osism-frontend:0.20251130.1 "docker-entrypoint.s…" frontend 2 minutes ago Up 2 minutes 192.168.16.5:3000->3000/tcp 2026-04-28 02:03:46.972920 | orchestrator | osism-kubernetes registry.osism.tech/osism/osism-kubernetes:0.20251130.0 "/entrypoint.sh osis…" osism-kubernetes 2 minutes ago Up About a minute (healthy) 2026-04-28 02:03:46.972938 | orchestrator | osismclient registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- sleep…" osismclient 2 minutes ago Up 2 minutes (healthy) 2026-04-28 02:03:46.979455 | orchestrator | ++ semver 9.5.0 7.0.0 2026-04-28 02:03:47.039820 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-28 02:03:47.040044 | orchestrator | + sed -i s/community.general.yaml/osism.commons.still_alive/ /opt/configuration/environments/ansible.cfg 2026-04-28 02:03:47.045780 | orchestrator | + osism apply resolvconf -l testbed-manager 2026-04-28 02:03:59.585517 | orchestrator | 2026-04-28 02:03:59 | INFO  | Task 7cfdf4e5-ea5a-41f1-a650-7afca0a3951a (resolvconf) was prepared for execution. 2026-04-28 02:03:59.585594 | orchestrator | 2026-04-28 02:03:59 | INFO  | It takes a moment until task 7cfdf4e5-ea5a-41f1-a650-7afca0a3951a (resolvconf) has been started and output is visible here. 2026-04-28 02:04:14.988050 | orchestrator | 2026-04-28 02:04:14.988194 | orchestrator | PLAY [Apply role resolvconf] *************************************************** 2026-04-28 02:04:14.988223 | orchestrator | 2026-04-28 02:04:14.988243 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-28 02:04:14.988264 | orchestrator | Tuesday 28 April 2026 02:04:04 +0000 (0:00:00.169) 0:00:00.169 ********* 2026-04-28 02:04:14.988285 | orchestrator | ok: [testbed-manager] 2026-04-28 02:04:14.988303 | orchestrator | 2026-04-28 02:04:14.988314 | orchestrator | TASK [osism.commons.resolvconf : Check minimum and maximum number of name servers] *** 2026-04-28 02:04:14.988327 | orchestrator | Tuesday 28 April 2026 02:04:08 +0000 (0:00:04.056) 0:00:04.225 ********* 2026-04-28 02:04:14.988338 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:04:14.988351 | orchestrator | 2026-04-28 02:04:14.988362 | orchestrator | TASK [osism.commons.resolvconf : Include resolvconf tasks] ********************* 2026-04-28 02:04:14.988373 | orchestrator | Tuesday 28 April 2026 02:04:08 +0000 (0:00:00.078) 0:00:04.304 ********* 2026-04-28 02:04:14.988385 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/resolvconf/tasks/configure-resolv.yml for testbed-manager 2026-04-28 02:04:14.988396 | orchestrator | 2026-04-28 02:04:14.988407 | orchestrator | TASK [osism.commons.resolvconf : Include distribution specific installation tasks] *** 2026-04-28 02:04:14.988426 | orchestrator | Tuesday 28 April 2026 02:04:08 +0000 (0:00:00.093) 0:00:04.398 ********* 2026-04-28 02:04:14.988469 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/resolvconf/tasks/install-Debian-family.yml for testbed-manager 2026-04-28 02:04:14.988489 | orchestrator | 2026-04-28 02:04:14.988510 | orchestrator | TASK [osism.commons.resolvconf : Remove packages configuring /etc/resolv.conf] *** 2026-04-28 02:04:14.988529 | orchestrator | Tuesday 28 April 2026 02:04:08 +0000 (0:00:00.081) 0:00:04.480 ********* 2026-04-28 02:04:14.988549 | orchestrator | ok: [testbed-manager] 2026-04-28 02:04:14.988569 | orchestrator | 2026-04-28 02:04:14.988588 | orchestrator | TASK [osism.commons.resolvconf : Install package systemd-resolved] ************* 2026-04-28 02:04:14.988602 | orchestrator | Tuesday 28 April 2026 02:04:09 +0000 (0:00:01.279) 0:00:05.760 ********* 2026-04-28 02:04:14.988616 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:04:14.988629 | orchestrator | 2026-04-28 02:04:14.988642 | orchestrator | TASK [osism.commons.resolvconf : Retrieve file status of /etc/resolv.conf] ***** 2026-04-28 02:04:14.988655 | orchestrator | Tuesday 28 April 2026 02:04:09 +0000 (0:00:00.061) 0:00:05.821 ********* 2026-04-28 02:04:14.988692 | orchestrator | ok: [testbed-manager] 2026-04-28 02:04:14.988712 | orchestrator | 2026-04-28 02:04:14.988730 | orchestrator | TASK [osism.commons.resolvconf : Archive existing file /etc/resolv.conf] ******* 2026-04-28 02:04:14.988748 | orchestrator | Tuesday 28 April 2026 02:04:10 +0000 (0:00:00.595) 0:00:06.417 ********* 2026-04-28 02:04:14.988767 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:04:14.988787 | orchestrator | 2026-04-28 02:04:14.988808 | orchestrator | TASK [osism.commons.resolvconf : Link /run/systemd/resolve/stub-resolv.conf to /etc/resolv.conf] *** 2026-04-28 02:04:14.988830 | orchestrator | Tuesday 28 April 2026 02:04:10 +0000 (0:00:00.093) 0:00:06.510 ********* 2026-04-28 02:04:14.988844 | orchestrator | changed: [testbed-manager] 2026-04-28 02:04:14.988857 | orchestrator | 2026-04-28 02:04:14.988869 | orchestrator | TASK [osism.commons.resolvconf : Copy configuration files] ********************* 2026-04-28 02:04:14.988883 | orchestrator | Tuesday 28 April 2026 02:04:11 +0000 (0:00:00.608) 0:00:07.119 ********* 2026-04-28 02:04:14.988895 | orchestrator | changed: [testbed-manager] 2026-04-28 02:04:14.988906 | orchestrator | 2026-04-28 02:04:14.988917 | orchestrator | TASK [osism.commons.resolvconf : Start/enable systemd-resolved service] ******** 2026-04-28 02:04:14.988928 | orchestrator | Tuesday 28 April 2026 02:04:12 +0000 (0:00:01.189) 0:00:08.308 ********* 2026-04-28 02:04:14.988939 | orchestrator | ok: [testbed-manager] 2026-04-28 02:04:14.988996 | orchestrator | 2026-04-28 02:04:14.989007 | orchestrator | TASK [osism.commons.resolvconf : Include distribution specific configuration tasks] *** 2026-04-28 02:04:14.989019 | orchestrator | Tuesday 28 April 2026 02:04:13 +0000 (0:00:01.100) 0:00:09.409 ********* 2026-04-28 02:04:14.989030 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/resolvconf/tasks/configure-Debian-family.yml for testbed-manager 2026-04-28 02:04:14.989041 | orchestrator | 2026-04-28 02:04:14.989052 | orchestrator | TASK [osism.commons.resolvconf : Restart systemd-resolved service] ************* 2026-04-28 02:04:14.989063 | orchestrator | Tuesday 28 April 2026 02:04:13 +0000 (0:00:00.101) 0:00:09.510 ********* 2026-04-28 02:04:14.989074 | orchestrator | changed: [testbed-manager] 2026-04-28 02:04:14.989085 | orchestrator | 2026-04-28 02:04:14.989103 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:04:14.989134 | orchestrator | testbed-manager : ok=10  changed=3  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-28 02:04:14.989154 | orchestrator | 2026-04-28 02:04:14.989171 | orchestrator | 2026-04-28 02:04:14.989188 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:04:14.989205 | orchestrator | Tuesday 28 April 2026 02:04:14 +0000 (0:00:01.272) 0:00:10.783 ********* 2026-04-28 02:04:14.989222 | orchestrator | =============================================================================== 2026-04-28 02:04:14.989240 | orchestrator | Gathering Facts --------------------------------------------------------- 4.06s 2026-04-28 02:04:14.989258 | orchestrator | osism.commons.resolvconf : Remove packages configuring /etc/resolv.conf --- 1.28s 2026-04-28 02:04:14.989277 | orchestrator | osism.commons.resolvconf : Restart systemd-resolved service ------------- 1.27s 2026-04-28 02:04:14.989296 | orchestrator | osism.commons.resolvconf : Copy configuration files --------------------- 1.19s 2026-04-28 02:04:14.989313 | orchestrator | osism.commons.resolvconf : Start/enable systemd-resolved service -------- 1.10s 2026-04-28 02:04:14.989331 | orchestrator | osism.commons.resolvconf : Link /run/systemd/resolve/stub-resolv.conf to /etc/resolv.conf --- 0.61s 2026-04-28 02:04:14.989365 | orchestrator | osism.commons.resolvconf : Retrieve file status of /etc/resolv.conf ----- 0.60s 2026-04-28 02:04:14.989376 | orchestrator | osism.commons.resolvconf : Include distribution specific configuration tasks --- 0.10s 2026-04-28 02:04:14.989387 | orchestrator | osism.commons.resolvconf : Include resolvconf tasks --------------------- 0.09s 2026-04-28 02:04:14.989398 | orchestrator | osism.commons.resolvconf : Archive existing file /etc/resolv.conf ------- 0.09s 2026-04-28 02:04:14.989409 | orchestrator | osism.commons.resolvconf : Include distribution specific installation tasks --- 0.08s 2026-04-28 02:04:14.989434 | orchestrator | osism.commons.resolvconf : Check minimum and maximum number of name servers --- 0.08s 2026-04-28 02:04:14.989445 | orchestrator | osism.commons.resolvconf : Install package systemd-resolved ------------- 0.06s 2026-04-28 02:04:15.377748 | orchestrator | + osism apply sshconfig 2026-04-28 02:04:27.663808 | orchestrator | 2026-04-28 02:04:27 | INFO  | Task a9766ab6-edbc-4eca-a7dd-e6cf749b85f6 (sshconfig) was prepared for execution. 2026-04-28 02:04:27.663927 | orchestrator | 2026-04-28 02:04:27 | INFO  | It takes a moment until task a9766ab6-edbc-4eca-a7dd-e6cf749b85f6 (sshconfig) has been started and output is visible here. 2026-04-28 02:04:40.468107 | orchestrator | 2026-04-28 02:04:40.468252 | orchestrator | PLAY [Apply role sshconfig] **************************************************** 2026-04-28 02:04:40.468279 | orchestrator | 2026-04-28 02:04:40.468347 | orchestrator | TASK [osism.commons.sshconfig : Get home directory of operator user] *********** 2026-04-28 02:04:40.468364 | orchestrator | Tuesday 28 April 2026 02:04:32 +0000 (0:00:00.174) 0:00:00.174 ********* 2026-04-28 02:04:40.468374 | orchestrator | ok: [testbed-manager] 2026-04-28 02:04:40.468385 | orchestrator | 2026-04-28 02:04:40.468395 | orchestrator | TASK [osism.commons.sshconfig : Ensure .ssh/config.d exist] ******************** 2026-04-28 02:04:40.468405 | orchestrator | Tuesday 28 April 2026 02:04:32 +0000 (0:00:00.574) 0:00:00.749 ********* 2026-04-28 02:04:40.468415 | orchestrator | changed: [testbed-manager] 2026-04-28 02:04:40.468426 | orchestrator | 2026-04-28 02:04:40.468436 | orchestrator | TASK [osism.commons.sshconfig : Ensure config for each host exist] ************* 2026-04-28 02:04:40.468446 | orchestrator | Tuesday 28 April 2026 02:04:33 +0000 (0:00:00.563) 0:00:01.312 ********* 2026-04-28 02:04:40.468462 | orchestrator | changed: [testbed-manager] => (item=testbed-manager) 2026-04-28 02:04:40.468479 | orchestrator | changed: [testbed-manager] => (item=testbed-node-0) 2026-04-28 02:04:40.468495 | orchestrator | changed: [testbed-manager] => (item=testbed-node-1) 2026-04-28 02:04:40.468511 | orchestrator | changed: [testbed-manager] => (item=testbed-node-2) 2026-04-28 02:04:40.468526 | orchestrator | changed: [testbed-manager] => (item=testbed-node-3) 2026-04-28 02:04:40.468543 | orchestrator | changed: [testbed-manager] => (item=testbed-node-4) 2026-04-28 02:04:40.468561 | orchestrator | changed: [testbed-manager] => (item=testbed-node-5) 2026-04-28 02:04:40.468578 | orchestrator | 2026-04-28 02:04:40.468596 | orchestrator | TASK [osism.commons.sshconfig : Add extra config] ****************************** 2026-04-28 02:04:40.468612 | orchestrator | Tuesday 28 April 2026 02:04:39 +0000 (0:00:06.102) 0:00:07.414 ********* 2026-04-28 02:04:40.468625 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:04:40.468636 | orchestrator | 2026-04-28 02:04:40.468648 | orchestrator | TASK [osism.commons.sshconfig : Assemble ssh config] *************************** 2026-04-28 02:04:40.468659 | orchestrator | Tuesday 28 April 2026 02:04:39 +0000 (0:00:00.099) 0:00:07.514 ********* 2026-04-28 02:04:40.468670 | orchestrator | changed: [testbed-manager] 2026-04-28 02:04:40.468682 | orchestrator | 2026-04-28 02:04:40.468693 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:04:40.468706 | orchestrator | testbed-manager : ok=4  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 02:04:40.468718 | orchestrator | 2026-04-28 02:04:40.468729 | orchestrator | 2026-04-28 02:04:40.468741 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:04:40.468752 | orchestrator | Tuesday 28 April 2026 02:04:40 +0000 (0:00:00.585) 0:00:08.099 ********* 2026-04-28 02:04:40.468764 | orchestrator | =============================================================================== 2026-04-28 02:04:40.468780 | orchestrator | osism.commons.sshconfig : Ensure config for each host exist ------------- 6.10s 2026-04-28 02:04:40.468799 | orchestrator | osism.commons.sshconfig : Assemble ssh config --------------------------- 0.59s 2026-04-28 02:04:40.468816 | orchestrator | osism.commons.sshconfig : Get home directory of operator user ----------- 0.57s 2026-04-28 02:04:40.468830 | orchestrator | osism.commons.sshconfig : Ensure .ssh/config.d exist -------------------- 0.56s 2026-04-28 02:04:40.468869 | orchestrator | osism.commons.sshconfig : Add extra config ------------------------------ 0.10s 2026-04-28 02:04:40.849282 | orchestrator | + osism apply known-hosts 2026-04-28 02:04:53.057584 | orchestrator | 2026-04-28 02:04:53 | INFO  | Task 2f30df91-840d-4d01-b2c3-725d665b7867 (known-hosts) was prepared for execution. 2026-04-28 02:04:53.057679 | orchestrator | 2026-04-28 02:04:53 | INFO  | It takes a moment until task 2f30df91-840d-4d01-b2c3-725d665b7867 (known-hosts) has been started and output is visible here. 2026-04-28 02:05:11.414551 | orchestrator | 2026-04-28 02:05:11.414696 | orchestrator | PLAY [Apply role known_hosts] ************************************************** 2026-04-28 02:05:11.414714 | orchestrator | 2026-04-28 02:05:11.414727 | orchestrator | TASK [osism.commons.known_hosts : Run ssh-keyscan for all hosts with hostname] *** 2026-04-28 02:05:11.414739 | orchestrator | Tuesday 28 April 2026 02:04:57 +0000 (0:00:00.196) 0:00:00.196 ********* 2026-04-28 02:05:11.414751 | orchestrator | ok: [testbed-manager] => (item=testbed-manager) 2026-04-28 02:05:11.414763 | orchestrator | ok: [testbed-manager] => (item=testbed-node-3) 2026-04-28 02:05:11.414775 | orchestrator | ok: [testbed-manager] => (item=testbed-node-4) 2026-04-28 02:05:11.414786 | orchestrator | ok: [testbed-manager] => (item=testbed-node-5) 2026-04-28 02:05:11.414797 | orchestrator | ok: [testbed-manager] => (item=testbed-node-0) 2026-04-28 02:05:11.414808 | orchestrator | ok: [testbed-manager] => (item=testbed-node-1) 2026-04-28 02:05:11.414818 | orchestrator | ok: [testbed-manager] => (item=testbed-node-2) 2026-04-28 02:05:11.414829 | orchestrator | 2026-04-28 02:05:11.414841 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries for all hosts with hostname] *** 2026-04-28 02:05:11.414852 | orchestrator | Tuesday 28 April 2026 02:05:03 +0000 (0:00:06.227) 0:00:06.423 ********* 2026-04-28 02:05:11.414864 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-manager) 2026-04-28 02:05:11.414879 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-3) 2026-04-28 02:05:11.414897 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-4) 2026-04-28 02:05:11.414923 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-5) 2026-04-28 02:05:11.414944 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-0) 2026-04-28 02:05:11.415002 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-1) 2026-04-28 02:05:11.415023 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-2) 2026-04-28 02:05:11.415041 | orchestrator | 2026-04-28 02:05:11.415060 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-28 02:05:11.415077 | orchestrator | Tuesday 28 April 2026 02:05:04 +0000 (0:00:00.178) 0:00:06.602 ********* 2026-04-28 02:05:11.415094 | orchestrator | changed: [testbed-manager] => (item=testbed-manager ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJzU8n4nFKkEAwHjHZTNgn3oyrWuedIRuNf3onZM5izu) 2026-04-28 02:05:11.415127 | orchestrator | changed: [testbed-manager] => (item=testbed-manager ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD10KngVVU/HTPJ5LrW+LQAYlBUnn2XTy3i86Vuf7QkQB6MUuT+viQlmB2b29Oa7Z0bsxV4ZMDyNmnTh9vgw6nYUPwk+9okmGZ0ZQyEKn3vZOt9OOGCEzPGZV3SV5X3MNbX+cCql3IRVP0AiBrNhKaZAUirHpxndt/JeuKLWGmkaLyAMyMf58vjiiwTYxVYOAKjwhljjKnHNZIV9ABu8ouifGlmEb8AbvrU7nE3Ny1xi380vGc9R7x2sGtKVB/lWHyHL2kqoZPvMndgaecL0w1lmm056z7at+SNeMP7yFs4w3nQRYBQHciVoznWrTj3E0MVECx+Lv1BVd6uVrHXoJYm6wpRHKWK4ZZn2hoyBwQkgCgXsGScJFYptAGwT6Jjn2TdfDdbB4gB2M+uyUZ0dhtF96ww9F5oW1LGJTRDtXJecSX49Onwbzj4QoY3uqE5r9J/WkW20DEi0GUCfk7s/wqqDPszibBBMHz+TPyC2a0/WL/upRT0r9ADwlNV9o++gEU=) 2026-04-28 02:05:11.415186 | orchestrator | changed: [testbed-manager] => (item=testbed-manager ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDYlkj7hsgz1qMnCUke52IA4oyZuzlkDykWQg70IQtqQ0072lE7Xo78r9YAM3IMqjzl0fC+x6ckZ3iJTQEe7dmc=) 2026-04-28 02:05:11.415210 | orchestrator | 2026-04-28 02:05:11.415230 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-28 02:05:11.415258 | orchestrator | Tuesday 28 April 2026 02:05:05 +0000 (0:00:01.327) 0:00:07.929 ********* 2026-04-28 02:05:11.415309 | orchestrator | changed: [testbed-manager] => (item=testbed-node-3 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCn2bRXqJSSwxSrWR8TKPVNL6Kpbw+POQM3hbAuFE65lS0d94aev8fJ2IIDyMdWlrveoMs72xiY9zkYrUDlfQxSU94gjfdnvqqXZkzVgFHn7DS0ptgrqu/L76zlrkGnes4NdztJXbEytFoOVNV40cZ7HE/1GdldBr+uzqcxUUIbuEZ/IXdaOsIgzuxPvaQ+wthUzZyx+SNyJAIkwJnC7y094F9TdN6PF8H+djIqR37oMa/1C2mX8u2yI8dlYHsIsXy77oePiDKjktB3J2LPnpmX8bneP93beAX87/HjQI5TjXK5HOWFl3Ogmuk86iWfxB0t5OBTMmjsXLjvlzvwYIoblOXNOI7RDbFGdjiMiwyUFvI+MTISyQNGxvt+GRTSN+bOpeN9lEfArsRaGfuUdpZ+TPp+4lli6XKIrmDnw32HyTR71GVVL13EEn1xReFjdxbTCwZYajewGtWBk0gpMT2t7F1PgLzKOgQ7fATRIBXoB75fsO4W0wdy+7ZSVhttbec=) 2026-04-28 02:05:11.415332 | orchestrator | changed: [testbed-manager] => (item=testbed-node-3 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOYWKbekFRYiHXhI+srye/FUtv7TXUvxcJV1buv7onGGtcJ/t/y4urtzF4kvF2JubAaMVet5g96lSyjuVtWrqpQ=) 2026-04-28 02:05:11.415353 | orchestrator | changed: [testbed-manager] => (item=testbed-node-3 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMztImwGtEkWfsFC7UdFCCeHp0Y4kJ2JPvez1lVZJDfv) 2026-04-28 02:05:11.415373 | orchestrator | 2026-04-28 02:05:11.415393 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-28 02:05:11.415415 | orchestrator | Tuesday 28 April 2026 02:05:06 +0000 (0:00:01.192) 0:00:09.121 ********* 2026-04-28 02:05:11.415436 | orchestrator | changed: [testbed-manager] => (item=testbed-node-4 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+22wOAalAFGQ7POg231SaIFUhYkMUae+E+blSs+KEm8vUU7pyRJVzZru2WeVJDx0wIbn6T3+ItdEPOMsmXYQDAmWjDE+mOTbzZ8FPBjVvjsBEoAAuIHxcXY+xiABjRgbzBBiXBLP6J+10FZEyB1pzNFs45Z+REMiX2GlY7Ugqnq4F9fwOcw3ch2y6VPScDam1DswUlysOBXKlyv9hzQypHyuvZvCcsHz8OxOJ2DdEERtbsQTf/6eJVDur50IJ3XDtUrhUZ/5v/h420SEGtg4zMDXjGsgQUphjRH2ZDkQ7fWFoq7JXyPnQbPa08+7YI95Pe0lI+QYsGwv7lrUshbY1+QpI1grRC13zTMWwVFsDljx++L9ir0J7iGmvKUlJ+hOLbbt627kRKy45++QN66uIjtNPKDWZMBZSODVSG9/HMLmdE6htiUoY9cBh0b762O7mrFNCWntOKX3sf7+N/ksmeOt8gO94Xq7/mhW0AdcgRtUA6UnWK4Yr0/NuCkOLYk8=) 2026-04-28 02:05:11.415458 | orchestrator | changed: [testbed-manager] => (item=testbed-node-4 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGrfGQoH75svA303Zc87v50dYtoSIqSzFLjdzNAeo1vNsTuhBCn++xUmUU0OGmVXHL4voYWzkpzXpxEWvhBii+Y=) 2026-04-28 02:05:11.415471 | orchestrator | changed: [testbed-manager] => (item=testbed-node-4 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILuBzKd+m0ZOQNbMK9F1Sw1et339oEAW0UJlDvvyzGtU) 2026-04-28 02:05:11.415482 | orchestrator | 2026-04-28 02:05:11.415493 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-28 02:05:11.415504 | orchestrator | Tuesday 28 April 2026 02:05:07 +0000 (0:00:01.244) 0:00:10.366 ********* 2026-04-28 02:05:11.415515 | orchestrator | changed: [testbed-manager] => (item=testbed-node-5 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLDspsylO3lgMOF8QYYoHq0Ro3tARPgi0JIhbOFfofbliNjrvIgqxrG1ol5ieJsuvkbuUSY7CyVD1qQGIRrB5MA=) 2026-04-28 02:05:11.415526 | orchestrator | changed: [testbed-manager] => (item=testbed-node-5 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCGBPnapGbjs78BBoWdUXTSr0e86aljG2b5/6GSzZrqt1Iwot/GYtH2uuUgvIHiy6yK6KAKil3O1GS7xsiI3n494mPFOyyorczIwsWjLhVDYUtfZb6hbBom2jp58gJNo8pKudgWPdM5Xj8Z63BbiLYWMKhFaa5fnPAWqUYo/w85BZxMzNKI51PgT4fyoV8pimm/Rexl90ZXSedllNkZCh1a4u3eD5iTZ+lCuGkOG995stD2xQ4j6J5MfGcpbPpLBi/UX2RYkny9Utvozu8fqUx3Lvh/eaunvslkvpnZt53mLD+3clix02DYudbaPtnt976CGz1QGmDwr4Ik1lKPRg1dGkCB4/fQ3z/rhVw4GEfz4j+iO02F8uF2KYmM7lif0Hg8Xj6WUN8uyCIMVB4W2RTgu8o3Be+vXaA+0yUnqMFCffee+4JMVQ4cTDRz2istcM+ufyYLWPUmLz2irKRD9C3s2gOgu+q+3RoQPY+9BcG1NKYACMf4oBnjLbw8hWenFpU=) 2026-04-28 02:05:11.415550 | orchestrator | changed: [testbed-manager] => (item=testbed-node-5 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDGuGuaBJvXdR6FoeOqvOHog6KOieOhWeIAwwIOdAOA/) 2026-04-28 02:05:11.415561 | orchestrator | 2026-04-28 02:05:11.415572 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-28 02:05:11.415583 | orchestrator | Tuesday 28 April 2026 02:05:09 +0000 (0:00:01.144) 0:00:11.510 ********* 2026-04-28 02:05:11.415672 | orchestrator | changed: [testbed-manager] => (item=testbed-node-0 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCeN4OS/U1HHq9uuTtU+KSr8o10avTz7uwINTYbSyXkWs3GbWFOH6/uwxJitsECL5ISR3xZOE4webaAgJc8QpKgARm1eofuvwQ3MjKzxCZd3TPiQHhtli+Oql0C0qQnzqPK3o+SH23BML84+JZqlvKMAV3lk9EaCUWiI9YMwkQFuMSLUvoi9J7exZ/IbuvFJrMj/vUvuYxMZ7xw3EJBcncKLiOp0oFnCkmjPCVnWXAtC0GOeH9/9iurlMqW9PVXT+n8Rm1hzoAZY1csxW1P3SZu2m1qJh02N9FAQx3MxiSgIB+33e7Gt95UAIop14OF+Nh00F9tvlhcgBeMx7wjYGUEmB60ZYDNNGFISYsIMh0qqMp3tN3o/VOXbI5ELjBsDUx3nURFYCFtcO2B0kHThd4+3OdSjagLIcIUNDMjwbDGl7YzaeA5XdxVUKqYGwX4Km8fTGIVulD6Mlb/b5bj2DvTqHMYP4uLR1lM6vKQUCpsXlgLwTqbRFY4QG8S0A13Zk=) 2026-04-28 02:05:11.415685 | orchestrator | changed: [testbed-manager] => (item=testbed-node-0 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIcM+V6nIC5jcpfb2bnWbGn4kBwdhuvP7Tr86q4qM6H6rDTVpi4KO5l1qsSPLhmDviwLNzcFPblgcjXbULJyQBI=) 2026-04-28 02:05:11.415696 | orchestrator | changed: [testbed-manager] => (item=testbed-node-0 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJNU1oldLvDuaA0mFQ0j0pXzdqQgFn9qpfqnSgwmYrjd) 2026-04-28 02:05:11.415707 | orchestrator | 2026-04-28 02:05:11.415718 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-28 02:05:11.415729 | orchestrator | Tuesday 28 April 2026 02:05:10 +0000 (0:00:01.213) 0:00:12.724 ********* 2026-04-28 02:05:11.415750 | orchestrator | changed: [testbed-manager] => (item=testbed-node-1 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEDwlzci0jG+lY+udvgDCoTFJ0xguasB7huMrbK5W6yI) 2026-04-28 02:05:23.203272 | orchestrator | changed: [testbed-manager] => (item=testbed-node-1 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSp4XcO2reLjw9EWAbRuW5pv7b+4T9EhITVbULYu5cKOjhJuQsfzAQhpeaDLnoPLrB1q5gZgL3BGQC2ACu7NXXrUHgDcldkimcqKp8T9RllhcM5Ta+0kCNQacb+wxk/pADCEr1/aBFeKs+/zVF2kJwCVs0LDFpH4Ve4ZXEYrQrUiWdLRNTateXh6D9BcnRrmX/vnn2bJv5wVyw5eWI3riEFYtdPqd4XX6ev2owyC2CWXRJxT+974DT/Bbm3UsYfiVzEaGPno0UEb2ibAB9CEL5O6kus2+fIm4sv7KjukXmQPjP4Ik20ZM0+wDz6d6mdYd98iBgvgHoFt1d4za+OkRIXhuSHjBWb+5X77r3guAGPu+N6OIYJMcvhra+AdHmCXJlbgGW6Fpra8zMAkpMu53spTypjarTkdwRF03BA9OTpQrMukfLzrqH6f2iUOocCYj5wA6sFahWovPenK+Iwk0rl6FXyp7xh2d/P1yJlt9eJND69sME0B9IBuA8plFfMj0=) 2026-04-28 02:05:23.203430 | orchestrator | changed: [testbed-manager] => (item=testbed-node-1 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOHcHkR9T44yPtN8JKM93RNMJesHhf7Qqg97cuuHiADqtW7kYMQMgoMyurb1erA9JE+UtZuN/Bv/w91lovjkT3Q=) 2026-04-28 02:05:23.203457 | orchestrator | 2026-04-28 02:05:23.203474 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-28 02:05:23.203491 | orchestrator | Tuesday 28 April 2026 02:05:11 +0000 (0:00:01.150) 0:00:13.874 ********* 2026-04-28 02:05:23.203507 | orchestrator | changed: [testbed-manager] => (item=testbed-node-2 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD1RSPdN105n3ow3/KDVNMCmTCJBhIfyALwW5yKmWEQz4JuR5YfPmNFkVbL4RBa1F12AFiDnPYTGDntHydmWEmGvWkGBBjLa9PYwxrni8l5gabTWNveu4PflR488g9kzz3dm/XXOQYWJzHXf6Cy/IkalD6m1l+NHSi10eekNGjfzYebO3J98P1k2IeRYExqAFO9PoNonhPnj9rnb7F4cYWFO57gg8H10n/aokS5fxAw1D1pNK4Q9ef77wcuFE6Jx8o+s/SxGcWSuvqylNb624+fGXU2CZsHivsXzrqv6C8P2gCd0Gh4mcSFcAdBKkbr90BpGeNFurEo3VhcbUi5MSlNMrAd6ICJWbNRB8Jxp+i+whtQkaS84gkjlMnWW4JcOa5vwC/TBqHJP/drXZU60PHuDQiysJQ4IACMFtGkl4WWI5W6V9df3MjVVrBjp3uJ0vVtglqB3yPkiRCCIJGJh5Hk3bLljuP4Dla02eDphBh/t6gza/7EmijZK46G8ah+cq0=) 2026-04-28 02:05:23.203524 | orchestrator | changed: [testbed-manager] => (item=testbed-node-2 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDYMZeXOesxQp+4mig6vLoH1RgnoBhkyBGGk3PlDEQ99) 2026-04-28 02:05:23.203571 | orchestrator | changed: [testbed-manager] => (item=testbed-node-2 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCE3BV/HSVoP2hTbAYcli/WZQ7VET8gHZAGO8mfRN1mOC+YE3CkzNJq5P/sjTfBCTe7XQs3PxbcEVn8jUHfolrM=) 2026-04-28 02:05:23.203582 | orchestrator | 2026-04-28 02:05:23.203591 | orchestrator | TASK [osism.commons.known_hosts : Run ssh-keyscan for all hosts with ansible_host] *** 2026-04-28 02:05:23.203601 | orchestrator | Tuesday 28 April 2026 02:05:12 +0000 (0:00:01.139) 0:00:15.014 ********* 2026-04-28 02:05:23.203610 | orchestrator | ok: [testbed-manager] => (item=testbed-manager) 2026-04-28 02:05:23.203619 | orchestrator | ok: [testbed-manager] => (item=testbed-node-3) 2026-04-28 02:05:23.203628 | orchestrator | ok: [testbed-manager] => (item=testbed-node-4) 2026-04-28 02:05:23.203636 | orchestrator | ok: [testbed-manager] => (item=testbed-node-5) 2026-04-28 02:05:23.203645 | orchestrator | ok: [testbed-manager] => (item=testbed-node-0) 2026-04-28 02:05:23.203654 | orchestrator | ok: [testbed-manager] => (item=testbed-node-1) 2026-04-28 02:05:23.203662 | orchestrator | ok: [testbed-manager] => (item=testbed-node-2) 2026-04-28 02:05:23.203671 | orchestrator | 2026-04-28 02:05:23.203679 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries for all hosts with ansible_host] *** 2026-04-28 02:05:23.203690 | orchestrator | Tuesday 28 April 2026 02:05:18 +0000 (0:00:05.667) 0:00:20.681 ********* 2026-04-28 02:05:23.203700 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-manager) 2026-04-28 02:05:23.203711 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-3) 2026-04-28 02:05:23.203719 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-4) 2026-04-28 02:05:23.203728 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-5) 2026-04-28 02:05:23.203737 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-0) 2026-04-28 02:05:23.203745 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-1) 2026-04-28 02:05:23.203754 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/known_hosts/tasks/write-scanned.yml for testbed-manager => (item=Scanned entries of testbed-node-2) 2026-04-28 02:05:23.203763 | orchestrator | 2026-04-28 02:05:23.203788 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-28 02:05:23.203799 | orchestrator | Tuesday 28 April 2026 02:05:18 +0000 (0:00:00.201) 0:00:20.882 ********* 2026-04-28 02:05:23.203809 | orchestrator | changed: [testbed-manager] => (item=192.168.16.5 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJzU8n4nFKkEAwHjHZTNgn3oyrWuedIRuNf3onZM5izu) 2026-04-28 02:05:23.203821 | orchestrator | changed: [testbed-manager] => (item=192.168.16.5 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD10KngVVU/HTPJ5LrW+LQAYlBUnn2XTy3i86Vuf7QkQB6MUuT+viQlmB2b29Oa7Z0bsxV4ZMDyNmnTh9vgw6nYUPwk+9okmGZ0ZQyEKn3vZOt9OOGCEzPGZV3SV5X3MNbX+cCql3IRVP0AiBrNhKaZAUirHpxndt/JeuKLWGmkaLyAMyMf58vjiiwTYxVYOAKjwhljjKnHNZIV9ABu8ouifGlmEb8AbvrU7nE3Ny1xi380vGc9R7x2sGtKVB/lWHyHL2kqoZPvMndgaecL0w1lmm056z7at+SNeMP7yFs4w3nQRYBQHciVoznWrTj3E0MVECx+Lv1BVd6uVrHXoJYm6wpRHKWK4ZZn2hoyBwQkgCgXsGScJFYptAGwT6Jjn2TdfDdbB4gB2M+uyUZ0dhtF96ww9F5oW1LGJTRDtXJecSX49Onwbzj4QoY3uqE5r9J/WkW20DEi0GUCfk7s/wqqDPszibBBMHz+TPyC2a0/WL/upRT0r9ADwlNV9o++gEU=) 2026-04-28 02:05:23.203846 | orchestrator | changed: [testbed-manager] => (item=192.168.16.5 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDYlkj7hsgz1qMnCUke52IA4oyZuzlkDykWQg70IQtqQ0072lE7Xo78r9YAM3IMqjzl0fC+x6ckZ3iJTQEe7dmc=) 2026-04-28 02:05:23.203857 | orchestrator | 2026-04-28 02:05:23.203867 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-28 02:05:23.203877 | orchestrator | Tuesday 28 April 2026 02:05:19 +0000 (0:00:01.277) 0:00:22.160 ********* 2026-04-28 02:05:23.203888 | orchestrator | changed: [testbed-manager] => (item=192.168.16.13 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCn2bRXqJSSwxSrWR8TKPVNL6Kpbw+POQM3hbAuFE65lS0d94aev8fJ2IIDyMdWlrveoMs72xiY9zkYrUDlfQxSU94gjfdnvqqXZkzVgFHn7DS0ptgrqu/L76zlrkGnes4NdztJXbEytFoOVNV40cZ7HE/1GdldBr+uzqcxUUIbuEZ/IXdaOsIgzuxPvaQ+wthUzZyx+SNyJAIkwJnC7y094F9TdN6PF8H+djIqR37oMa/1C2mX8u2yI8dlYHsIsXy77oePiDKjktB3J2LPnpmX8bneP93beAX87/HjQI5TjXK5HOWFl3Ogmuk86iWfxB0t5OBTMmjsXLjvlzvwYIoblOXNOI7RDbFGdjiMiwyUFvI+MTISyQNGxvt+GRTSN+bOpeN9lEfArsRaGfuUdpZ+TPp+4lli6XKIrmDnw32HyTR71GVVL13EEn1xReFjdxbTCwZYajewGtWBk0gpMT2t7F1PgLzKOgQ7fATRIBXoB75fsO4W0wdy+7ZSVhttbec=) 2026-04-28 02:05:23.203899 | orchestrator | changed: [testbed-manager] => (item=192.168.16.13 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOYWKbekFRYiHXhI+srye/FUtv7TXUvxcJV1buv7onGGtcJ/t/y4urtzF4kvF2JubAaMVet5g96lSyjuVtWrqpQ=) 2026-04-28 02:05:23.203910 | orchestrator | changed: [testbed-manager] => (item=192.168.16.13 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMztImwGtEkWfsFC7UdFCCeHp0Y4kJ2JPvez1lVZJDfv) 2026-04-28 02:05:23.203920 | orchestrator | 2026-04-28 02:05:23.203928 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-28 02:05:23.203937 | orchestrator | Tuesday 28 April 2026 02:05:20 +0000 (0:00:01.164) 0:00:23.324 ********* 2026-04-28 02:05:23.203946 | orchestrator | changed: [testbed-manager] => (item=192.168.16.14 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGrfGQoH75svA303Zc87v50dYtoSIqSzFLjdzNAeo1vNsTuhBCn++xUmUU0OGmVXHL4voYWzkpzXpxEWvhBii+Y=) 2026-04-28 02:05:23.203955 | orchestrator | changed: [testbed-manager] => (item=192.168.16.14 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+22wOAalAFGQ7POg231SaIFUhYkMUae+E+blSs+KEm8vUU7pyRJVzZru2WeVJDx0wIbn6T3+ItdEPOMsmXYQDAmWjDE+mOTbzZ8FPBjVvjsBEoAAuIHxcXY+xiABjRgbzBBiXBLP6J+10FZEyB1pzNFs45Z+REMiX2GlY7Ugqnq4F9fwOcw3ch2y6VPScDam1DswUlysOBXKlyv9hzQypHyuvZvCcsHz8OxOJ2DdEERtbsQTf/6eJVDur50IJ3XDtUrhUZ/5v/h420SEGtg4zMDXjGsgQUphjRH2ZDkQ7fWFoq7JXyPnQbPa08+7YI95Pe0lI+QYsGwv7lrUshbY1+QpI1grRC13zTMWwVFsDljx++L9ir0J7iGmvKUlJ+hOLbbt627kRKy45++QN66uIjtNPKDWZMBZSODVSG9/HMLmdE6htiUoY9cBh0b762O7mrFNCWntOKX3sf7+N/ksmeOt8gO94Xq7/mhW0AdcgRtUA6UnWK4Yr0/NuCkOLYk8=) 2026-04-28 02:05:23.203964 | orchestrator | changed: [testbed-manager] => (item=192.168.16.14 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILuBzKd+m0ZOQNbMK9F1Sw1et339oEAW0UJlDvvyzGtU) 2026-04-28 02:05:23.203973 | orchestrator | 2026-04-28 02:05:23.203982 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-28 02:05:23.203990 | orchestrator | Tuesday 28 April 2026 02:05:22 +0000 (0:00:01.179) 0:00:24.504 ********* 2026-04-28 02:05:23.204047 | orchestrator | changed: [testbed-manager] => (item=192.168.16.15 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDGuGuaBJvXdR6FoeOqvOHog6KOieOhWeIAwwIOdAOA/) 2026-04-28 02:05:23.204074 | orchestrator | changed: [testbed-manager] => (item=192.168.16.15 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCGBPnapGbjs78BBoWdUXTSr0e86aljG2b5/6GSzZrqt1Iwot/GYtH2uuUgvIHiy6yK6KAKil3O1GS7xsiI3n494mPFOyyorczIwsWjLhVDYUtfZb6hbBom2jp58gJNo8pKudgWPdM5Xj8Z63BbiLYWMKhFaa5fnPAWqUYo/w85BZxMzNKI51PgT4fyoV8pimm/Rexl90ZXSedllNkZCh1a4u3eD5iTZ+lCuGkOG995stD2xQ4j6J5MfGcpbPpLBi/UX2RYkny9Utvozu8fqUx3Lvh/eaunvslkvpnZt53mLD+3clix02DYudbaPtnt976CGz1QGmDwr4Ik1lKPRg1dGkCB4/fQ3z/rhVw4GEfz4j+iO02F8uF2KYmM7lif0Hg8Xj6WUN8uyCIMVB4W2RTgu8o3Be+vXaA+0yUnqMFCffee+4JMVQ4cTDRz2istcM+ufyYLWPUmLz2irKRD9C3s2gOgu+q+3RoQPY+9BcG1NKYACMf4oBnjLbw8hWenFpU=) 2026-04-28 02:05:28.082948 | orchestrator | changed: [testbed-manager] => (item=192.168.16.15 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLDspsylO3lgMOF8QYYoHq0Ro3tARPgi0JIhbOFfofbliNjrvIgqxrG1ol5ieJsuvkbuUSY7CyVD1qQGIRrB5MA=) 2026-04-28 02:05:28.083133 | orchestrator | 2026-04-28 02:05:28.083155 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-28 02:05:28.083168 | orchestrator | Tuesday 28 April 2026 02:05:23 +0000 (0:00:01.155) 0:00:25.660 ********* 2026-04-28 02:05:28.083180 | orchestrator | changed: [testbed-manager] => (item=192.168.16.10 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIcM+V6nIC5jcpfb2bnWbGn4kBwdhuvP7Tr86q4qM6H6rDTVpi4KO5l1qsSPLhmDviwLNzcFPblgcjXbULJyQBI=) 2026-04-28 02:05:28.083195 | orchestrator | changed: [testbed-manager] => (item=192.168.16.10 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCeN4OS/U1HHq9uuTtU+KSr8o10avTz7uwINTYbSyXkWs3GbWFOH6/uwxJitsECL5ISR3xZOE4webaAgJc8QpKgARm1eofuvwQ3MjKzxCZd3TPiQHhtli+Oql0C0qQnzqPK3o+SH23BML84+JZqlvKMAV3lk9EaCUWiI9YMwkQFuMSLUvoi9J7exZ/IbuvFJrMj/vUvuYxMZ7xw3EJBcncKLiOp0oFnCkmjPCVnWXAtC0GOeH9/9iurlMqW9PVXT+n8Rm1hzoAZY1csxW1P3SZu2m1qJh02N9FAQx3MxiSgIB+33e7Gt95UAIop14OF+Nh00F9tvlhcgBeMx7wjYGUEmB60ZYDNNGFISYsIMh0qqMp3tN3o/VOXbI5ELjBsDUx3nURFYCFtcO2B0kHThd4+3OdSjagLIcIUNDMjwbDGl7YzaeA5XdxVUKqYGwX4Km8fTGIVulD6Mlb/b5bj2DvTqHMYP4uLR1lM6vKQUCpsXlgLwTqbRFY4QG8S0A13Zk=) 2026-04-28 02:05:28.083210 | orchestrator | changed: [testbed-manager] => (item=192.168.16.10 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJNU1oldLvDuaA0mFQ0j0pXzdqQgFn9qpfqnSgwmYrjd) 2026-04-28 02:05:28.083222 | orchestrator | 2026-04-28 02:05:28.083234 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-28 02:05:28.083246 | orchestrator | Tuesday 28 April 2026 02:05:24 +0000 (0:00:01.200) 0:00:26.860 ********* 2026-04-28 02:05:28.083258 | orchestrator | changed: [testbed-manager] => (item=192.168.16.11 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSp4XcO2reLjw9EWAbRuW5pv7b+4T9EhITVbULYu5cKOjhJuQsfzAQhpeaDLnoPLrB1q5gZgL3BGQC2ACu7NXXrUHgDcldkimcqKp8T9RllhcM5Ta+0kCNQacb+wxk/pADCEr1/aBFeKs+/zVF2kJwCVs0LDFpH4Ve4ZXEYrQrUiWdLRNTateXh6D9BcnRrmX/vnn2bJv5wVyw5eWI3riEFYtdPqd4XX6ev2owyC2CWXRJxT+974DT/Bbm3UsYfiVzEaGPno0UEb2ibAB9CEL5O6kus2+fIm4sv7KjukXmQPjP4Ik20ZM0+wDz6d6mdYd98iBgvgHoFt1d4za+OkRIXhuSHjBWb+5X77r3guAGPu+N6OIYJMcvhra+AdHmCXJlbgGW6Fpra8zMAkpMu53spTypjarTkdwRF03BA9OTpQrMukfLzrqH6f2iUOocCYj5wA6sFahWovPenK+Iwk0rl6FXyp7xh2d/P1yJlt9eJND69sME0B9IBuA8plFfMj0=) 2026-04-28 02:05:28.083270 | orchestrator | changed: [testbed-manager] => (item=192.168.16.11 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOHcHkR9T44yPtN8JKM93RNMJesHhf7Qqg97cuuHiADqtW7kYMQMgoMyurb1erA9JE+UtZuN/Bv/w91lovjkT3Q=) 2026-04-28 02:05:28.083281 | orchestrator | changed: [testbed-manager] => (item=192.168.16.11 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEDwlzci0jG+lY+udvgDCoTFJ0xguasB7huMrbK5W6yI) 2026-04-28 02:05:28.083292 | orchestrator | 2026-04-28 02:05:28.083303 | orchestrator | TASK [osism.commons.known_hosts : Write scanned known_hosts entries] *********** 2026-04-28 02:05:28.083315 | orchestrator | Tuesday 28 April 2026 02:05:25 +0000 (0:00:01.165) 0:00:28.025 ********* 2026-04-28 02:05:28.083326 | orchestrator | changed: [testbed-manager] => (item=192.168.16.12 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDYMZeXOesxQp+4mig6vLoH1RgnoBhkyBGGk3PlDEQ99) 2026-04-28 02:05:28.083354 | orchestrator | changed: [testbed-manager] => (item=192.168.16.12 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD1RSPdN105n3ow3/KDVNMCmTCJBhIfyALwW5yKmWEQz4JuR5YfPmNFkVbL4RBa1F12AFiDnPYTGDntHydmWEmGvWkGBBjLa9PYwxrni8l5gabTWNveu4PflR488g9kzz3dm/XXOQYWJzHXf6Cy/IkalD6m1l+NHSi10eekNGjfzYebO3J98P1k2IeRYExqAFO9PoNonhPnj9rnb7F4cYWFO57gg8H10n/aokS5fxAw1D1pNK4Q9ef77wcuFE6Jx8o+s/SxGcWSuvqylNb624+fGXU2CZsHivsXzrqv6C8P2gCd0Gh4mcSFcAdBKkbr90BpGeNFurEo3VhcbUi5MSlNMrAd6ICJWbNRB8Jxp+i+whtQkaS84gkjlMnWW4JcOa5vwC/TBqHJP/drXZU60PHuDQiysJQ4IACMFtGkl4WWI5W6V9df3MjVVrBjp3uJ0vVtglqB3yPkiRCCIJGJh5Hk3bLljuP4Dla02eDphBh/t6gza/7EmijZK46G8ah+cq0=) 2026-04-28 02:05:28.083366 | orchestrator | changed: [testbed-manager] => (item=192.168.16.12 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCE3BV/HSVoP2hTbAYcli/WZQ7VET8gHZAGO8mfRN1mOC+YE3CkzNJq5P/sjTfBCTe7XQs3PxbcEVn8jUHfolrM=) 2026-04-28 02:05:28.083377 | orchestrator | 2026-04-28 02:05:28.083397 | orchestrator | TASK [osism.commons.known_hosts : Write static known_hosts entries] ************ 2026-04-28 02:05:28.083408 | orchestrator | Tuesday 28 April 2026 02:05:26 +0000 (0:00:01.180) 0:00:29.206 ********* 2026-04-28 02:05:28.083420 | orchestrator | skipping: [testbed-manager] => (item=testbed-manager)  2026-04-28 02:05:28.083431 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-3)  2026-04-28 02:05:28.083442 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-4)  2026-04-28 02:05:28.083453 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-5)  2026-04-28 02:05:28.083483 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-0)  2026-04-28 02:05:28.083502 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-1)  2026-04-28 02:05:28.083527 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-2)  2026-04-28 02:05:28.083552 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:05:28.083570 | orchestrator | 2026-04-28 02:05:28.083589 | orchestrator | TASK [osism.commons.known_hosts : Write extra known_hosts entries] ************* 2026-04-28 02:05:28.083606 | orchestrator | Tuesday 28 April 2026 02:05:26 +0000 (0:00:00.185) 0:00:29.392 ********* 2026-04-28 02:05:28.083623 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:05:28.083642 | orchestrator | 2026-04-28 02:05:28.083660 | orchestrator | TASK [osism.commons.known_hosts : Delete known_hosts entries] ****************** 2026-04-28 02:05:28.083689 | orchestrator | Tuesday 28 April 2026 02:05:26 +0000 (0:00:00.057) 0:00:29.450 ********* 2026-04-28 02:05:28.083709 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:05:28.083728 | orchestrator | 2026-04-28 02:05:28.083748 | orchestrator | TASK [osism.commons.known_hosts : Set file permissions] ************************ 2026-04-28 02:05:28.083764 | orchestrator | Tuesday 28 April 2026 02:05:27 +0000 (0:00:00.065) 0:00:29.516 ********* 2026-04-28 02:05:28.083778 | orchestrator | changed: [testbed-manager] 2026-04-28 02:05:28.083792 | orchestrator | 2026-04-28 02:05:28.083804 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:05:28.083818 | orchestrator | testbed-manager : ok=31  changed=15  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-28 02:05:28.083834 | orchestrator | 2026-04-28 02:05:28.083844 | orchestrator | 2026-04-28 02:05:28.083855 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:05:28.083866 | orchestrator | Tuesday 28 April 2026 02:05:27 +0000 (0:00:00.784) 0:00:30.300 ********* 2026-04-28 02:05:28.083877 | orchestrator | =============================================================================== 2026-04-28 02:05:28.083888 | orchestrator | osism.commons.known_hosts : Run ssh-keyscan for all hosts with hostname --- 6.23s 2026-04-28 02:05:28.083899 | orchestrator | osism.commons.known_hosts : Run ssh-keyscan for all hosts with ansible_host --- 5.67s 2026-04-28 02:05:28.083911 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.33s 2026-04-28 02:05:28.083922 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.28s 2026-04-28 02:05:28.083933 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.24s 2026-04-28 02:05:28.083943 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.21s 2026-04-28 02:05:28.083954 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.20s 2026-04-28 02:05:28.083965 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.19s 2026-04-28 02:05:28.083975 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.18s 2026-04-28 02:05:28.083986 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.18s 2026-04-28 02:05:28.083997 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.17s 2026-04-28 02:05:28.084007 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.16s 2026-04-28 02:05:28.084114 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.16s 2026-04-28 02:05:28.084127 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.15s 2026-04-28 02:05:28.084149 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.14s 2026-04-28 02:05:28.084160 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries ----------- 1.14s 2026-04-28 02:05:28.084171 | orchestrator | osism.commons.known_hosts : Set file permissions ------------------------ 0.78s 2026-04-28 02:05:28.084183 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries for all hosts with ansible_host --- 0.20s 2026-04-28 02:05:28.084194 | orchestrator | osism.commons.known_hosts : Write static known_hosts entries ------------ 0.19s 2026-04-28 02:05:28.084205 | orchestrator | osism.commons.known_hosts : Write scanned known_hosts entries for all hosts with hostname --- 0.18s 2026-04-28 02:05:28.459179 | orchestrator | + osism apply squid 2026-04-28 02:05:40.670374 | orchestrator | 2026-04-28 02:05:40 | INFO  | Task c13b6fc5-f5ca-4bb3-90d9-0da4e7f967de (squid) was prepared for execution. 2026-04-28 02:05:40.670517 | orchestrator | 2026-04-28 02:05:40 | INFO  | It takes a moment until task c13b6fc5-f5ca-4bb3-90d9-0da4e7f967de (squid) has been started and output is visible here. 2026-04-28 02:08:14.518292 | orchestrator | 2026-04-28 02:08:14.518418 | orchestrator | PLAY [Apply role squid] ******************************************************** 2026-04-28 02:08:14.518445 | orchestrator | 2026-04-28 02:08:14.518464 | orchestrator | TASK [osism.services.squid : Include install tasks] **************************** 2026-04-28 02:08:14.518484 | orchestrator | Tuesday 28 April 2026 02:05:45 +0000 (0:00:00.196) 0:00:00.196 ********* 2026-04-28 02:08:14.518600 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/squid/tasks/install-Debian-family.yml for testbed-manager 2026-04-28 02:08:14.518624 | orchestrator | 2026-04-28 02:08:14.518641 | orchestrator | TASK [osism.services.squid : Install required packages] ************************ 2026-04-28 02:08:14.518653 | orchestrator | Tuesday 28 April 2026 02:05:45 +0000 (0:00:00.087) 0:00:00.284 ********* 2026-04-28 02:08:14.518664 | orchestrator | ok: [testbed-manager] 2026-04-28 02:08:14.518677 | orchestrator | 2026-04-28 02:08:14.518688 | orchestrator | TASK [osism.services.squid : Create required directories] ********************** 2026-04-28 02:08:14.518699 | orchestrator | Tuesday 28 April 2026 02:05:47 +0000 (0:00:01.686) 0:00:01.971 ********* 2026-04-28 02:08:14.518711 | orchestrator | changed: [testbed-manager] => (item=/opt/squid/configuration) 2026-04-28 02:08:14.518722 | orchestrator | changed: [testbed-manager] => (item=/opt/squid/configuration/conf.d) 2026-04-28 02:08:14.518733 | orchestrator | ok: [testbed-manager] => (item=/opt/squid) 2026-04-28 02:08:14.518744 | orchestrator | 2026-04-28 02:08:14.518755 | orchestrator | TASK [osism.services.squid : Copy squid configuration files] ******************* 2026-04-28 02:08:14.518766 | orchestrator | Tuesday 28 April 2026 02:05:48 +0000 (0:00:01.298) 0:00:03.270 ********* 2026-04-28 02:08:14.518777 | orchestrator | changed: [testbed-manager] => (item=osism.conf) 2026-04-28 02:08:14.518788 | orchestrator | 2026-04-28 02:08:14.518799 | orchestrator | TASK [osism.services.squid : Remove osism_allow_list.conf configuration file] *** 2026-04-28 02:08:14.518810 | orchestrator | Tuesday 28 April 2026 02:05:49 +0000 (0:00:01.211) 0:00:04.482 ********* 2026-04-28 02:08:14.518821 | orchestrator | ok: [testbed-manager] 2026-04-28 02:08:14.518834 | orchestrator | 2026-04-28 02:08:14.518848 | orchestrator | TASK [osism.services.squid : Copy docker-compose.yml file] ********************* 2026-04-28 02:08:14.518862 | orchestrator | Tuesday 28 April 2026 02:05:50 +0000 (0:00:00.406) 0:00:04.889 ********* 2026-04-28 02:08:14.518875 | orchestrator | changed: [testbed-manager] 2026-04-28 02:08:14.518888 | orchestrator | 2026-04-28 02:08:14.518902 | orchestrator | TASK [osism.services.squid : Manage squid service] ***************************** 2026-04-28 02:08:14.518915 | orchestrator | Tuesday 28 April 2026 02:05:51 +0000 (0:00:01.005) 0:00:05.894 ********* 2026-04-28 02:08:14.518932 | orchestrator | FAILED - RETRYING: [testbed-manager]: Manage squid service (10 retries left). 2026-04-28 02:08:14.518945 | orchestrator | ok: [testbed-manager] 2026-04-28 02:08:14.518958 | orchestrator | 2026-04-28 02:08:14.518970 | orchestrator | RUNNING HANDLER [osism.services.squid : Restart squid service] ***************** 2026-04-28 02:08:14.519014 | orchestrator | Tuesday 28 April 2026 02:06:53 +0000 (0:01:02.635) 0:01:08.530 ********* 2026-04-28 02:08:14.519028 | orchestrator | changed: [testbed-manager] 2026-04-28 02:08:14.519040 | orchestrator | 2026-04-28 02:08:14.519053 | orchestrator | RUNNING HANDLER [osism.services.squid : Wait for squid service to start] ******* 2026-04-28 02:08:14.519066 | orchestrator | Tuesday 28 April 2026 02:07:13 +0000 (0:00:19.716) 0:01:28.247 ********* 2026-04-28 02:08:14.519079 | orchestrator | Pausing for 60 seconds 2026-04-28 02:08:14.519092 | orchestrator | changed: [testbed-manager] 2026-04-28 02:08:14.519104 | orchestrator | 2026-04-28 02:08:14.519117 | orchestrator | RUNNING HANDLER [osism.services.squid : Register that squid service was restarted] *** 2026-04-28 02:08:14.519130 | orchestrator | Tuesday 28 April 2026 02:08:13 +0000 (0:01:00.105) 0:02:28.352 ********* 2026-04-28 02:08:14.519143 | orchestrator | ok: [testbed-manager] 2026-04-28 02:08:14.519155 | orchestrator | 2026-04-28 02:08:14.519167 | orchestrator | RUNNING HANDLER [osism.services.squid : Wait for an healthy squid service] ***** 2026-04-28 02:08:14.519180 | orchestrator | Tuesday 28 April 2026 02:08:13 +0000 (0:00:00.057) 0:02:28.410 ********* 2026-04-28 02:08:14.519193 | orchestrator | changed: [testbed-manager] 2026-04-28 02:08:14.519206 | orchestrator | 2026-04-28 02:08:14.519217 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:08:14.519228 | orchestrator | testbed-manager : ok=11  changed=6  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:08:14.519239 | orchestrator | 2026-04-28 02:08:14.519249 | orchestrator | 2026-04-28 02:08:14.519260 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:08:14.519271 | orchestrator | Tuesday 28 April 2026 02:08:14 +0000 (0:00:00.657) 0:02:29.068 ********* 2026-04-28 02:08:14.519281 | orchestrator | =============================================================================== 2026-04-28 02:08:14.519292 | orchestrator | osism.services.squid : Manage squid service ---------------------------- 62.64s 2026-04-28 02:08:14.519303 | orchestrator | osism.services.squid : Wait for squid service to start ----------------- 60.10s 2026-04-28 02:08:14.519333 | orchestrator | osism.services.squid : Restart squid service --------------------------- 19.72s 2026-04-28 02:08:14.519345 | orchestrator | osism.services.squid : Install required packages ------------------------ 1.69s 2026-04-28 02:08:14.519395 | orchestrator | osism.services.squid : Create required directories ---------------------- 1.30s 2026-04-28 02:08:14.519415 | orchestrator | osism.services.squid : Copy squid configuration files ------------------- 1.21s 2026-04-28 02:08:14.519435 | orchestrator | osism.services.squid : Copy docker-compose.yml file --------------------- 1.01s 2026-04-28 02:08:14.519453 | orchestrator | osism.services.squid : Wait for an healthy squid service ---------------- 0.66s 2026-04-28 02:08:14.519470 | orchestrator | osism.services.squid : Remove osism_allow_list.conf configuration file --- 0.41s 2026-04-28 02:08:14.519480 | orchestrator | osism.services.squid : Include install tasks ---------------------------- 0.09s 2026-04-28 02:08:14.519491 | orchestrator | osism.services.squid : Register that squid service was restarted -------- 0.06s 2026-04-28 02:08:14.897763 | orchestrator | + [[ 9.5.0 != \l\a\t\e\s\t ]] 2026-04-28 02:08:14.897891 | orchestrator | ++ semver 9.5.0 10.0.0-0 2026-04-28 02:08:14.956879 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-28 02:08:14.956969 | orchestrator | + /opt/configuration/scripts/set-kolla-namespace.sh kolla/release 2026-04-28 02:08:14.963148 | orchestrator | + set -e 2026-04-28 02:08:14.963242 | orchestrator | + NAMESPACE=kolla/release 2026-04-28 02:08:14.963258 | orchestrator | + sed -i 's#docker_namespace: .*#docker_namespace: kolla/release#g' /opt/configuration/inventory/group_vars/all/kolla.yml 2026-04-28 02:08:14.969106 | orchestrator | ++ semver 9.5.0 9.0.0 2026-04-28 02:08:15.052960 | orchestrator | + [[ 1 -lt 0 ]] 2026-04-28 02:08:15.053616 | orchestrator | + osism apply operator -u ubuntu -l testbed-nodes 2026-04-28 02:08:27.340715 | orchestrator | 2026-04-28 02:08:27 | INFO  | Task 152799b3-356d-497d-b1e2-d20cb1f4c488 (operator) was prepared for execution. 2026-04-28 02:08:27.340823 | orchestrator | 2026-04-28 02:08:27 | INFO  | It takes a moment until task 152799b3-356d-497d-b1e2-d20cb1f4c488 (operator) has been started and output is visible here. 2026-04-28 02:08:44.276505 | orchestrator | 2026-04-28 02:08:44.276705 | orchestrator | PLAY [Make ssh pipelining working] ********************************************* 2026-04-28 02:08:44.276737 | orchestrator | 2026-04-28 02:08:44.276757 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-28 02:08:44.276778 | orchestrator | Tuesday 28 April 2026 02:08:31 +0000 (0:00:00.159) 0:00:00.159 ********* 2026-04-28 02:08:44.276797 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:08:44.276818 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:08:44.276837 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:08:44.276851 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:08:44.276862 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:08:44.276873 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:08:44.276884 | orchestrator | 2026-04-28 02:08:44.276895 | orchestrator | TASK [Do not require tty for all users] **************************************** 2026-04-28 02:08:44.276906 | orchestrator | Tuesday 28 April 2026 02:08:35 +0000 (0:00:03.450) 0:00:03.610 ********* 2026-04-28 02:08:44.276917 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:08:44.276928 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:08:44.276958 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:08:44.276984 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:08:44.276995 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:08:44.277006 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:08:44.277019 | orchestrator | 2026-04-28 02:08:44.277031 | orchestrator | PLAY [Apply role operator] ***************************************************** 2026-04-28 02:08:44.277044 | orchestrator | 2026-04-28 02:08:44.277057 | orchestrator | TASK [osism.commons.operator : Gather variables for each operating system] ***** 2026-04-28 02:08:44.277069 | orchestrator | Tuesday 28 April 2026 02:08:36 +0000 (0:00:00.844) 0:00:04.454 ********* 2026-04-28 02:08:44.277082 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:08:44.277094 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:08:44.277106 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:08:44.277119 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:08:44.277134 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:08:44.277146 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:08:44.277160 | orchestrator | 2026-04-28 02:08:44.277181 | orchestrator | TASK [osism.commons.operator : Set operator_groups variable to default value] *** 2026-04-28 02:08:44.277199 | orchestrator | Tuesday 28 April 2026 02:08:36 +0000 (0:00:00.193) 0:00:04.648 ********* 2026-04-28 02:08:44.277228 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:08:44.277251 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:08:44.277271 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:08:44.277290 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:08:44.277309 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:08:44.277332 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:08:44.277351 | orchestrator | 2026-04-28 02:08:44.277371 | orchestrator | TASK [osism.commons.operator : Create operator group] ************************** 2026-04-28 02:08:44.277388 | orchestrator | Tuesday 28 April 2026 02:08:36 +0000 (0:00:00.202) 0:00:04.851 ********* 2026-04-28 02:08:44.277407 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:08:44.277428 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:08:44.277449 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:08:44.277471 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:08:44.277490 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:08:44.277510 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:08:44.277529 | orchestrator | 2026-04-28 02:08:44.277549 | orchestrator | TASK [osism.commons.operator : Create user] ************************************ 2026-04-28 02:08:44.277567 | orchestrator | Tuesday 28 April 2026 02:08:37 +0000 (0:00:00.675) 0:00:05.526 ********* 2026-04-28 02:08:44.277620 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:08:44.277639 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:08:44.277656 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:08:44.277674 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:08:44.277693 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:08:44.277712 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:08:44.277764 | orchestrator | 2026-04-28 02:08:44.277784 | orchestrator | TASK [osism.commons.operator : Add user to additional groups] ****************** 2026-04-28 02:08:44.277802 | orchestrator | Tuesday 28 April 2026 02:08:38 +0000 (0:00:00.854) 0:00:06.381 ********* 2026-04-28 02:08:44.277821 | orchestrator | changed: [testbed-node-0] => (item=adm) 2026-04-28 02:08:44.277838 | orchestrator | changed: [testbed-node-1] => (item=adm) 2026-04-28 02:08:44.277856 | orchestrator | changed: [testbed-node-2] => (item=adm) 2026-04-28 02:08:44.277867 | orchestrator | changed: [testbed-node-3] => (item=adm) 2026-04-28 02:08:44.277878 | orchestrator | changed: [testbed-node-4] => (item=adm) 2026-04-28 02:08:44.277888 | orchestrator | changed: [testbed-node-5] => (item=adm) 2026-04-28 02:08:44.277899 | orchestrator | changed: [testbed-node-0] => (item=sudo) 2026-04-28 02:08:44.277910 | orchestrator | changed: [testbed-node-1] => (item=sudo) 2026-04-28 02:08:44.277920 | orchestrator | changed: [testbed-node-3] => (item=sudo) 2026-04-28 02:08:44.277931 | orchestrator | changed: [testbed-node-2] => (item=sudo) 2026-04-28 02:08:44.277942 | orchestrator | changed: [testbed-node-4] => (item=sudo) 2026-04-28 02:08:44.277952 | orchestrator | changed: [testbed-node-5] => (item=sudo) 2026-04-28 02:08:44.277969 | orchestrator | 2026-04-28 02:08:44.277987 | orchestrator | TASK [osism.commons.operator : Copy user sudoers file] ************************* 2026-04-28 02:08:44.278006 | orchestrator | Tuesday 28 April 2026 02:08:39 +0000 (0:00:01.179) 0:00:07.560 ********* 2026-04-28 02:08:44.278098 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:08:44.278118 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:08:44.278137 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:08:44.278156 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:08:44.278174 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:08:44.278195 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:08:44.278215 | orchestrator | 2026-04-28 02:08:44.278235 | orchestrator | TASK [osism.commons.operator : Set language variables in .bashrc configuration file] *** 2026-04-28 02:08:44.278257 | orchestrator | Tuesday 28 April 2026 02:08:40 +0000 (0:00:01.260) 0:00:08.820 ********* 2026-04-28 02:08:44.278276 | orchestrator | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-04-28 02:08:44.278295 | orchestrator | with a mode of 0700, this may cause issues when running as another user. To 2026-04-28 02:08:44.278315 | orchestrator | avoid this, create the remote_tmp dir with the correct permissions manually 2026-04-28 02:08:44.278332 | orchestrator | changed: [testbed-node-0] => (item=export LANGUAGE=C.UTF-8) 2026-04-28 02:08:44.278379 | orchestrator | changed: [testbed-node-5] => (item=export LANGUAGE=C.UTF-8) 2026-04-28 02:08:44.278397 | orchestrator | changed: [testbed-node-4] => (item=export LANGUAGE=C.UTF-8) 2026-04-28 02:08:44.278414 | orchestrator | changed: [testbed-node-3] => (item=export LANGUAGE=C.UTF-8) 2026-04-28 02:08:44.278432 | orchestrator | changed: [testbed-node-2] => (item=export LANGUAGE=C.UTF-8) 2026-04-28 02:08:44.278449 | orchestrator | changed: [testbed-node-1] => (item=export LANGUAGE=C.UTF-8) 2026-04-28 02:08:44.278467 | orchestrator | changed: [testbed-node-0] => (item=export LANG=C.UTF-8) 2026-04-28 02:08:44.278484 | orchestrator | changed: [testbed-node-4] => (item=export LANG=C.UTF-8) 2026-04-28 02:08:44.278501 | orchestrator | changed: [testbed-node-5] => (item=export LANG=C.UTF-8) 2026-04-28 02:08:44.278520 | orchestrator | changed: [testbed-node-3] => (item=export LANG=C.UTF-8) 2026-04-28 02:08:44.278539 | orchestrator | changed: [testbed-node-1] => (item=export LANG=C.UTF-8) 2026-04-28 02:08:44.278557 | orchestrator | changed: [testbed-node-2] => (item=export LANG=C.UTF-8) 2026-04-28 02:08:44.278575 | orchestrator | changed: [testbed-node-0] => (item=export LC_ALL=C.UTF-8) 2026-04-28 02:08:44.278629 | orchestrator | changed: [testbed-node-4] => (item=export LC_ALL=C.UTF-8) 2026-04-28 02:08:44.278647 | orchestrator | changed: [testbed-node-5] => (item=export LC_ALL=C.UTF-8) 2026-04-28 02:08:44.278664 | orchestrator | changed: [testbed-node-1] => (item=export LC_ALL=C.UTF-8) 2026-04-28 02:08:44.278675 | orchestrator | changed: [testbed-node-3] => (item=export LC_ALL=C.UTF-8) 2026-04-28 02:08:44.278702 | orchestrator | changed: [testbed-node-2] => (item=export LC_ALL=C.UTF-8) 2026-04-28 02:08:44.278713 | orchestrator | 2026-04-28 02:08:44.278724 | orchestrator | TASK [osism.commons.operator : Set custom environment variables in .bashrc configuration file] *** 2026-04-28 02:08:44.278736 | orchestrator | Tuesday 28 April 2026 02:08:41 +0000 (0:00:01.308) 0:00:10.129 ********* 2026-04-28 02:08:44.278747 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:08:44.278758 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:08:44.278769 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:08:44.278780 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:08:44.278791 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:08:44.278802 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:08:44.278812 | orchestrator | 2026-04-28 02:08:44.278823 | orchestrator | TASK [osism.commons.operator : Set custom PS1 prompt in .bashrc configuration file] *** 2026-04-28 02:08:44.278834 | orchestrator | Tuesday 28 April 2026 02:08:42 +0000 (0:00:00.185) 0:00:10.314 ********* 2026-04-28 02:08:44.278845 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:08:44.278856 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:08:44.278866 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:08:44.278877 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:08:44.278888 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:08:44.278898 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:08:44.278909 | orchestrator | 2026-04-28 02:08:44.278920 | orchestrator | TASK [osism.commons.operator : Create .ssh directory] ************************** 2026-04-28 02:08:44.278931 | orchestrator | Tuesday 28 April 2026 02:08:42 +0000 (0:00:00.243) 0:00:10.557 ********* 2026-04-28 02:08:44.278941 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:08:44.278952 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:08:44.278962 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:08:44.278973 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:08:44.278984 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:08:44.278994 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:08:44.279005 | orchestrator | 2026-04-28 02:08:44.279016 | orchestrator | TASK [osism.commons.operator : Check number of SSH authorized keys] ************ 2026-04-28 02:08:44.279027 | orchestrator | Tuesday 28 April 2026 02:08:42 +0000 (0:00:00.616) 0:00:11.174 ********* 2026-04-28 02:08:44.279037 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:08:44.279048 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:08:44.279059 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:08:44.279069 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:08:44.279080 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:08:44.279090 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:08:44.279101 | orchestrator | 2026-04-28 02:08:44.279112 | orchestrator | TASK [osism.commons.operator : Set ssh authorized keys] ************************ 2026-04-28 02:08:44.279137 | orchestrator | Tuesday 28 April 2026 02:08:43 +0000 (0:00:00.204) 0:00:11.378 ********* 2026-04-28 02:08:44.279149 | orchestrator | changed: [testbed-node-5] => (item=None) 2026-04-28 02:08:44.279161 | orchestrator | changed: [testbed-node-2] => (item=None) 2026-04-28 02:08:44.279171 | orchestrator | changed: [testbed-node-3] => (item=None) 2026-04-28 02:08:44.279182 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-28 02:08:44.279193 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:08:44.279204 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:08:44.279214 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:08:44.279225 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:08:44.279236 | orchestrator | changed: [testbed-node-4] => (item=None) 2026-04-28 02:08:44.279247 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:08:44.279257 | orchestrator | changed: [testbed-node-1] => (item=None) 2026-04-28 02:08:44.279268 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:08:44.279279 | orchestrator | 2026-04-28 02:08:44.279290 | orchestrator | TASK [osism.commons.operator : Delete ssh authorized keys] ********************* 2026-04-28 02:08:44.279301 | orchestrator | Tuesday 28 April 2026 02:08:43 +0000 (0:00:00.751) 0:00:12.130 ********* 2026-04-28 02:08:44.279319 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:08:44.279329 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:08:44.279340 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:08:44.279357 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:08:44.279374 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:08:44.279391 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:08:44.279408 | orchestrator | 2026-04-28 02:08:44.279424 | orchestrator | TASK [osism.commons.operator : Set authorized GitHub accounts] ***************** 2026-04-28 02:08:44.279440 | orchestrator | Tuesday 28 April 2026 02:08:44 +0000 (0:00:00.188) 0:00:12.319 ********* 2026-04-28 02:08:44.279457 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:08:44.279474 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:08:44.279494 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:08:44.279513 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:08:44.279550 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:08:45.709296 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:08:45.709400 | orchestrator | 2026-04-28 02:08:45.709419 | orchestrator | TASK [osism.commons.operator : Delete authorized GitHub accounts] ************** 2026-04-28 02:08:45.709432 | orchestrator | Tuesday 28 April 2026 02:08:44 +0000 (0:00:00.179) 0:00:12.498 ********* 2026-04-28 02:08:45.709444 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:08:45.709455 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:08:45.709467 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:08:45.709478 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:08:45.709489 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:08:45.709500 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:08:45.709511 | orchestrator | 2026-04-28 02:08:45.709523 | orchestrator | TASK [osism.commons.operator : Set password] *********************************** 2026-04-28 02:08:45.709534 | orchestrator | Tuesday 28 April 2026 02:08:44 +0000 (0:00:00.172) 0:00:12.671 ********* 2026-04-28 02:08:45.709546 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:08:45.709574 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:08:45.709644 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:08:45.709656 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:08:45.709667 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:08:45.709678 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:08:45.709689 | orchestrator | 2026-04-28 02:08:45.709700 | orchestrator | TASK [osism.commons.operator : Unset & lock password] ************************** 2026-04-28 02:08:45.709711 | orchestrator | Tuesday 28 April 2026 02:08:45 +0000 (0:00:00.709) 0:00:13.381 ********* 2026-04-28 02:08:45.709722 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:08:45.709734 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:08:45.709745 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:08:45.709756 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:08:45.709767 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:08:45.709778 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:08:45.709789 | orchestrator | 2026-04-28 02:08:45.709800 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:08:45.709813 | orchestrator | testbed-node-0 : ok=12  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-28 02:08:45.709826 | orchestrator | testbed-node-1 : ok=12  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-28 02:08:45.709839 | orchestrator | testbed-node-2 : ok=12  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-28 02:08:45.709853 | orchestrator | testbed-node-3 : ok=12  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-28 02:08:45.709865 | orchestrator | testbed-node-4 : ok=12  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-28 02:08:45.709899 | orchestrator | testbed-node-5 : ok=12  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-28 02:08:45.709913 | orchestrator | 2026-04-28 02:08:45.709925 | orchestrator | 2026-04-28 02:08:45.709938 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:08:45.709950 | orchestrator | Tuesday 28 April 2026 02:08:45 +0000 (0:00:00.261) 0:00:13.642 ********* 2026-04-28 02:08:45.709963 | orchestrator | =============================================================================== 2026-04-28 02:08:45.709975 | orchestrator | Gathering Facts --------------------------------------------------------- 3.45s 2026-04-28 02:08:45.709988 | orchestrator | osism.commons.operator : Set language variables in .bashrc configuration file --- 1.31s 2026-04-28 02:08:45.710002 | orchestrator | osism.commons.operator : Copy user sudoers file ------------------------- 1.26s 2026-04-28 02:08:45.710014 | orchestrator | osism.commons.operator : Add user to additional groups ------------------ 1.18s 2026-04-28 02:08:45.710079 | orchestrator | osism.commons.operator : Create user ------------------------------------ 0.85s 2026-04-28 02:08:45.710093 | orchestrator | Do not require tty for all users ---------------------------------------- 0.84s 2026-04-28 02:08:45.710105 | orchestrator | osism.commons.operator : Set ssh authorized keys ------------------------ 0.75s 2026-04-28 02:08:45.710118 | orchestrator | osism.commons.operator : Set password ----------------------------------- 0.71s 2026-04-28 02:08:45.710131 | orchestrator | osism.commons.operator : Create operator group -------------------------- 0.68s 2026-04-28 02:08:45.710143 | orchestrator | osism.commons.operator : Create .ssh directory -------------------------- 0.62s 2026-04-28 02:08:45.710155 | orchestrator | osism.commons.operator : Unset & lock password -------------------------- 0.26s 2026-04-28 02:08:45.710169 | orchestrator | osism.commons.operator : Set custom PS1 prompt in .bashrc configuration file --- 0.24s 2026-04-28 02:08:45.710182 | orchestrator | osism.commons.operator : Check number of SSH authorized keys ------------ 0.20s 2026-04-28 02:08:45.710194 | orchestrator | osism.commons.operator : Set operator_groups variable to default value --- 0.20s 2026-04-28 02:08:45.710213 | orchestrator | osism.commons.operator : Gather variables for each operating system ----- 0.19s 2026-04-28 02:08:45.710231 | orchestrator | osism.commons.operator : Delete ssh authorized keys --------------------- 0.19s 2026-04-28 02:08:45.710251 | orchestrator | osism.commons.operator : Set custom environment variables in .bashrc configuration file --- 0.19s 2026-04-28 02:08:45.710269 | orchestrator | osism.commons.operator : Set authorized GitHub accounts ----------------- 0.18s 2026-04-28 02:08:45.710286 | orchestrator | osism.commons.operator : Delete authorized GitHub accounts -------------- 0.17s 2026-04-28 02:08:46.064031 | orchestrator | + osism apply --environment custom facts 2026-04-28 02:08:48.128301 | orchestrator | 2026-04-28 02:08:48 | INFO  | Trying to run play facts in environment custom 2026-04-28 02:08:58.210578 | orchestrator | 2026-04-28 02:08:58 | INFO  | Task d618d1ae-ca52-4ffc-bda5-173e098356ae (facts) was prepared for execution. 2026-04-28 02:08:58.210716 | orchestrator | 2026-04-28 02:08:58 | INFO  | It takes a moment until task d618d1ae-ca52-4ffc-bda5-173e098356ae (facts) has been started and output is visible here. 2026-04-28 02:09:45.578377 | orchestrator | 2026-04-28 02:09:45.578478 | orchestrator | PLAY [Copy custom network devices fact] **************************************** 2026-04-28 02:09:45.578492 | orchestrator | 2026-04-28 02:09:45.578502 | orchestrator | TASK [Create custom facts directory] ******************************************* 2026-04-28 02:09:45.578512 | orchestrator | Tuesday 28 April 2026 02:09:02 +0000 (0:00:00.103) 0:00:00.103 ********* 2026-04-28 02:09:45.578520 | orchestrator | ok: [testbed-manager] 2026-04-28 02:09:45.578530 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:09:45.578540 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:09:45.578549 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:09:45.578557 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:09:45.578565 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:09:45.578596 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:09:45.578606 | orchestrator | 2026-04-28 02:09:45.578614 | orchestrator | TASK [Copy fact file] ********************************************************** 2026-04-28 02:09:45.578623 | orchestrator | Tuesday 28 April 2026 02:09:04 +0000 (0:00:01.432) 0:00:01.535 ********* 2026-04-28 02:09:45.578631 | orchestrator | ok: [testbed-manager] 2026-04-28 02:09:45.578639 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:09:45.578647 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:09:45.578655 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:09:45.578663 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:09:45.578671 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:09:45.578678 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:09:45.578686 | orchestrator | 2026-04-28 02:09:45.578693 | orchestrator | PLAY [Copy custom ceph devices facts] ****************************************** 2026-04-28 02:09:45.578700 | orchestrator | 2026-04-28 02:09:45.578708 | orchestrator | TASK [osism.commons.repository : Gather variables for each operating system] *** 2026-04-28 02:09:45.578716 | orchestrator | Tuesday 28 April 2026 02:09:05 +0000 (0:00:01.254) 0:00:02.790 ********* 2026-04-28 02:09:45.578724 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:09:45.578732 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:09:45.578740 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:09:45.578748 | orchestrator | 2026-04-28 02:09:45.578756 | orchestrator | TASK [osism.commons.repository : Set repository_default fact to default value] *** 2026-04-28 02:09:45.578765 | orchestrator | Tuesday 28 April 2026 02:09:05 +0000 (0:00:00.135) 0:00:02.926 ********* 2026-04-28 02:09:45.578829 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:09:45.578839 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:09:45.578847 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:09:45.578854 | orchestrator | 2026-04-28 02:09:45.578862 | orchestrator | TASK [osism.commons.repository : Set repositories to default] ****************** 2026-04-28 02:09:45.578871 | orchestrator | Tuesday 28 April 2026 02:09:05 +0000 (0:00:00.235) 0:00:03.162 ********* 2026-04-28 02:09:45.578878 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:09:45.578886 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:09:45.578894 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:09:45.578902 | orchestrator | 2026-04-28 02:09:45.578910 | orchestrator | TASK [osism.commons.repository : Include distribution specific repository tasks] *** 2026-04-28 02:09:45.578919 | orchestrator | Tuesday 28 April 2026 02:09:06 +0000 (0:00:00.274) 0:00:03.436 ********* 2026-04-28 02:09:45.578929 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/repository/tasks/Ubuntu.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 02:09:45.578939 | orchestrator | 2026-04-28 02:09:45.578948 | orchestrator | TASK [osism.commons.repository : Create /etc/apt/sources.list.d directory] ***** 2026-04-28 02:09:45.578957 | orchestrator | Tuesday 28 April 2026 02:09:06 +0000 (0:00:00.201) 0:00:03.638 ********* 2026-04-28 02:09:45.578965 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:09:45.578973 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:09:45.578981 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:09:45.578990 | orchestrator | 2026-04-28 02:09:45.578998 | orchestrator | TASK [osism.commons.repository : Include tasks for Ubuntu < 24.04] ************* 2026-04-28 02:09:45.579007 | orchestrator | Tuesday 28 April 2026 02:09:06 +0000 (0:00:00.491) 0:00:04.129 ********* 2026-04-28 02:09:45.579015 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:09:45.579023 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:09:45.579031 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:09:45.579039 | orchestrator | 2026-04-28 02:09:45.579048 | orchestrator | TASK [osism.commons.repository : Copy 99osism apt configuration] *************** 2026-04-28 02:09:45.579056 | orchestrator | Tuesday 28 April 2026 02:09:07 +0000 (0:00:00.161) 0:00:04.291 ********* 2026-04-28 02:09:45.579064 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:09:45.579073 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:09:45.579081 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:09:45.579090 | orchestrator | 2026-04-28 02:09:45.579098 | orchestrator | TASK [osism.commons.repository : Remove sources.list file] ********************* 2026-04-28 02:09:45.579113 | orchestrator | Tuesday 28 April 2026 02:09:08 +0000 (0:00:01.105) 0:00:05.397 ********* 2026-04-28 02:09:45.579122 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:09:45.579130 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:09:45.579138 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:09:45.579146 | orchestrator | 2026-04-28 02:09:45.579154 | orchestrator | TASK [osism.commons.repository : Copy ubuntu.sources file] ********************* 2026-04-28 02:09:45.579162 | orchestrator | Tuesday 28 April 2026 02:09:08 +0000 (0:00:00.487) 0:00:05.884 ********* 2026-04-28 02:09:45.579170 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:09:45.579178 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:09:45.579186 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:09:45.579194 | orchestrator | 2026-04-28 02:09:45.579247 | orchestrator | TASK [osism.commons.repository : Update package cache] ************************* 2026-04-28 02:09:45.579256 | orchestrator | Tuesday 28 April 2026 02:09:09 +0000 (0:00:01.062) 0:00:06.947 ********* 2026-04-28 02:09:45.579263 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:09:45.579271 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:09:45.579279 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:09:45.579287 | orchestrator | 2026-04-28 02:09:45.579294 | orchestrator | TASK [Install required packages (RedHat)] ************************************** 2026-04-28 02:09:45.579302 | orchestrator | Tuesday 28 April 2026 02:09:26 +0000 (0:00:17.050) 0:00:23.998 ********* 2026-04-28 02:09:45.579311 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:09:45.579319 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:09:45.579327 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:09:45.579335 | orchestrator | 2026-04-28 02:09:45.579343 | orchestrator | TASK [Install required packages (Debian)] ************************************** 2026-04-28 02:09:45.579366 | orchestrator | Tuesday 28 April 2026 02:09:26 +0000 (0:00:00.127) 0:00:24.125 ********* 2026-04-28 02:09:45.579375 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:09:45.579383 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:09:45.579391 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:09:45.579398 | orchestrator | 2026-04-28 02:09:45.579409 | orchestrator | TASK [Create custom facts directory] ******************************************* 2026-04-28 02:09:45.579417 | orchestrator | Tuesday 28 April 2026 02:09:35 +0000 (0:00:08.400) 0:00:32.525 ********* 2026-04-28 02:09:45.579425 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:09:45.579432 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:09:45.579440 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:09:45.579447 | orchestrator | 2026-04-28 02:09:45.579455 | orchestrator | TASK [Copy fact files] ********************************************************* 2026-04-28 02:09:45.579463 | orchestrator | Tuesday 28 April 2026 02:09:35 +0000 (0:00:00.461) 0:00:32.987 ********* 2026-04-28 02:09:45.579471 | orchestrator | changed: [testbed-node-3] => (item=testbed_ceph_devices) 2026-04-28 02:09:45.579479 | orchestrator | changed: [testbed-node-4] => (item=testbed_ceph_devices) 2026-04-28 02:09:45.579487 | orchestrator | changed: [testbed-node-5] => (item=testbed_ceph_devices) 2026-04-28 02:09:45.579494 | orchestrator | changed: [testbed-node-3] => (item=testbed_ceph_devices_all) 2026-04-28 02:09:45.579502 | orchestrator | changed: [testbed-node-5] => (item=testbed_ceph_devices_all) 2026-04-28 02:09:45.579510 | orchestrator | changed: [testbed-node-4] => (item=testbed_ceph_devices_all) 2026-04-28 02:09:45.579517 | orchestrator | changed: [testbed-node-3] => (item=testbed_ceph_osd_devices) 2026-04-28 02:09:45.579524 | orchestrator | changed: [testbed-node-5] => (item=testbed_ceph_osd_devices) 2026-04-28 02:09:45.579532 | orchestrator | changed: [testbed-node-4] => (item=testbed_ceph_osd_devices) 2026-04-28 02:09:45.579540 | orchestrator | changed: [testbed-node-5] => (item=testbed_ceph_osd_devices_all) 2026-04-28 02:09:45.579548 | orchestrator | changed: [testbed-node-3] => (item=testbed_ceph_osd_devices_all) 2026-04-28 02:09:45.579555 | orchestrator | changed: [testbed-node-4] => (item=testbed_ceph_osd_devices_all) 2026-04-28 02:09:45.579563 | orchestrator | 2026-04-28 02:09:45.579576 | orchestrator | RUNNING HANDLER [osism.commons.repository : Force update of package cache] ***** 2026-04-28 02:09:45.579584 | orchestrator | Tuesday 28 April 2026 02:09:39 +0000 (0:00:03.587) 0:00:36.574 ********* 2026-04-28 02:09:45.579592 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:09:45.579598 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:09:45.579605 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:09:45.579612 | orchestrator | 2026-04-28 02:09:45.579619 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-28 02:09:45.579627 | orchestrator | 2026-04-28 02:09:45.579635 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-28 02:09:45.579642 | orchestrator | Tuesday 28 April 2026 02:09:40 +0000 (0:00:01.422) 0:00:37.996 ********* 2026-04-28 02:09:45.579650 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:09:45.579657 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:09:45.579665 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:09:45.579672 | orchestrator | ok: [testbed-manager] 2026-04-28 02:09:45.579680 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:09:45.579688 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:09:45.579695 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:09:45.579703 | orchestrator | 2026-04-28 02:09:45.579710 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:09:45.579718 | orchestrator | testbed-manager : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:09:45.579725 | orchestrator | testbed-node-0 : ok=3  changed=2  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:09:45.579734 | orchestrator | testbed-node-1 : ok=3  changed=2  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:09:45.579741 | orchestrator | testbed-node-2 : ok=3  changed=2  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:09:45.579747 | orchestrator | testbed-node-3 : ok=16  changed=7  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:09:45.579755 | orchestrator | testbed-node-4 : ok=16  changed=7  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:09:45.579764 | orchestrator | testbed-node-5 : ok=16  changed=7  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:09:45.579784 | orchestrator | 2026-04-28 02:09:45.579794 | orchestrator | 2026-04-28 02:09:45.579802 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:09:45.579809 | orchestrator | Tuesday 28 April 2026 02:09:45 +0000 (0:00:04.762) 0:00:42.759 ********* 2026-04-28 02:09:45.579817 | orchestrator | =============================================================================== 2026-04-28 02:09:45.579825 | orchestrator | osism.commons.repository : Update package cache ------------------------ 17.05s 2026-04-28 02:09:45.579833 | orchestrator | Install required packages (Debian) -------------------------------------- 8.40s 2026-04-28 02:09:45.579841 | orchestrator | Gathers facts about hosts ----------------------------------------------- 4.76s 2026-04-28 02:09:45.579849 | orchestrator | Copy fact files --------------------------------------------------------- 3.59s 2026-04-28 02:09:45.579854 | orchestrator | Create custom facts directory ------------------------------------------- 1.43s 2026-04-28 02:09:45.579858 | orchestrator | osism.commons.repository : Force update of package cache ---------------- 1.42s 2026-04-28 02:09:45.579869 | orchestrator | Copy fact file ---------------------------------------------------------- 1.25s 2026-04-28 02:09:45.898899 | orchestrator | osism.commons.repository : Copy 99osism apt configuration --------------- 1.11s 2026-04-28 02:09:45.899003 | orchestrator | osism.commons.repository : Copy ubuntu.sources file --------------------- 1.06s 2026-04-28 02:09:45.899033 | orchestrator | osism.commons.repository : Create /etc/apt/sources.list.d directory ----- 0.49s 2026-04-28 02:09:45.899060 | orchestrator | osism.commons.repository : Remove sources.list file --------------------- 0.49s 2026-04-28 02:09:45.899067 | orchestrator | Create custom facts directory ------------------------------------------- 0.46s 2026-04-28 02:09:45.899075 | orchestrator | osism.commons.repository : Set repositories to default ------------------ 0.27s 2026-04-28 02:09:45.899082 | orchestrator | osism.commons.repository : Set repository_default fact to default value --- 0.24s 2026-04-28 02:09:45.899089 | orchestrator | osism.commons.repository : Include distribution specific repository tasks --- 0.20s 2026-04-28 02:09:45.899097 | orchestrator | osism.commons.repository : Include tasks for Ubuntu < 24.04 ------------- 0.16s 2026-04-28 02:09:45.899104 | orchestrator | osism.commons.repository : Gather variables for each operating system --- 0.14s 2026-04-28 02:09:45.899112 | orchestrator | Install required packages (RedHat) -------------------------------------- 0.13s 2026-04-28 02:09:46.341218 | orchestrator | + osism apply bootstrap 2026-04-28 02:09:58.573959 | orchestrator | 2026-04-28 02:09:58 | INFO  | Task db845591-c7ed-4d06-aec4-abe21296977f (bootstrap) was prepared for execution. 2026-04-28 02:09:58.574102 | orchestrator | 2026-04-28 02:09:58 | INFO  | It takes a moment until task db845591-c7ed-4d06-aec4-abe21296977f (bootstrap) has been started and output is visible here. 2026-04-28 02:10:15.540482 | orchestrator | 2026-04-28 02:10:15.540583 | orchestrator | PLAY [Group hosts based on state bootstrap] ************************************ 2026-04-28 02:10:15.540601 | orchestrator | 2026-04-28 02:10:15.540614 | orchestrator | TASK [Group hosts based on state bootstrap] ************************************ 2026-04-28 02:10:15.540624 | orchestrator | Tuesday 28 April 2026 02:10:03 +0000 (0:00:00.165) 0:00:00.165 ********* 2026-04-28 02:10:15.540634 | orchestrator | ok: [testbed-manager] 2026-04-28 02:10:15.540646 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:10:15.540656 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:10:15.540667 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:10:15.540678 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:10:15.540688 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:10:15.540699 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:10:15.540709 | orchestrator | 2026-04-28 02:10:15.540719 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-28 02:10:15.540726 | orchestrator | 2026-04-28 02:10:15.540732 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-28 02:10:15.540739 | orchestrator | Tuesday 28 April 2026 02:10:03 +0000 (0:00:00.278) 0:00:00.444 ********* 2026-04-28 02:10:15.540745 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:10:15.540755 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:10:15.540765 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:10:15.540775 | orchestrator | ok: [testbed-manager] 2026-04-28 02:10:15.540785 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:10:15.540794 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:10:15.540804 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:10:15.540814 | orchestrator | 2026-04-28 02:10:15.540825 | orchestrator | PLAY [Gather facts for all hosts (if using --limit)] *************************** 2026-04-28 02:10:15.540835 | orchestrator | 2026-04-28 02:10:15.540846 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-28 02:10:15.540856 | orchestrator | Tuesday 28 April 2026 02:10:07 +0000 (0:00:03.711) 0:00:04.156 ********* 2026-04-28 02:10:15.540899 | orchestrator | skipping: [testbed-manager] => (item=testbed-manager)  2026-04-28 02:10:15.540907 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-3)  2026-04-28 02:10:15.540913 | orchestrator | skipping: [testbed-node-3] => (item=testbed-manager)  2026-04-28 02:10:15.540919 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-4)  2026-04-28 02:10:15.540926 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 02:10:15.540932 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-5)  2026-04-28 02:10:15.540938 | orchestrator | skipping: [testbed-node-4] => (item=testbed-manager)  2026-04-28 02:10:15.540945 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 02:10:15.540970 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-0)  2026-04-28 02:10:15.540977 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-28 02:10:15.540983 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 02:10:15.540989 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-28 02:10:15.540995 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-1)  2026-04-28 02:10:15.541001 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-28 02:10:15.541008 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-28 02:10:15.541014 | orchestrator | skipping: [testbed-node-5] => (item=testbed-manager)  2026-04-28 02:10:15.541021 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-2)  2026-04-28 02:10:15.541027 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-28 02:10:15.541033 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:10:15.541049 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-28 02:10:15.541065 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-28 02:10:15.541072 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-28 02:10:15.541079 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-28 02:10:15.541086 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:10:15.541093 | orchestrator | skipping: [testbed-node-0] => (item=testbed-manager)  2026-04-28 02:10:15.541100 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-28 02:10:15.541107 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-28 02:10:15.541114 | orchestrator | skipping: [testbed-node-1] => (item=testbed-manager)  2026-04-28 02:10:15.541121 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:10:15.541129 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-28 02:10:15.541135 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-28 02:10:15.541142 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-28 02:10:15.541149 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-28 02:10:15.541156 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-28 02:10:15.541163 | orchestrator | skipping: [testbed-node-2] => (item=testbed-manager)  2026-04-28 02:10:15.541170 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-28 02:10:15.541177 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-28 02:10:15.541184 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-28 02:10:15.541191 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-28 02:10:15.541199 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-28 02:10:15.541209 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-28 02:10:15.541221 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:10:15.541229 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-28 02:10:15.541236 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-28 02:10:15.541243 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-28 02:10:15.541251 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-28 02:10:15.541273 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-28 02:10:15.541281 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-28 02:10:15.541288 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-28 02:10:15.541295 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:10:15.541302 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-28 02:10:15.541310 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-28 02:10:15.541317 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-28 02:10:15.541344 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-28 02:10:15.541352 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:10:15.541359 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:10:15.541366 | orchestrator | 2026-04-28 02:10:15.541373 | orchestrator | PLAY [Apply bootstrap roles part 1] ******************************************** 2026-04-28 02:10:15.541380 | orchestrator | 2026-04-28 02:10:15.541388 | orchestrator | TASK [osism.commons.hostname : Set hostname] *********************************** 2026-04-28 02:10:15.541395 | orchestrator | Tuesday 28 April 2026 02:10:07 +0000 (0:00:00.576) 0:00:04.732 ********* 2026-04-28 02:10:15.541402 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:10:15.541410 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:10:15.541417 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:10:15.541424 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:10:15.541432 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:10:15.541438 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:10:15.541445 | orchestrator | ok: [testbed-manager] 2026-04-28 02:10:15.541452 | orchestrator | 2026-04-28 02:10:15.541460 | orchestrator | TASK [osism.commons.hostname : Copy /etc/hostname] ***************************** 2026-04-28 02:10:15.541467 | orchestrator | Tuesday 28 April 2026 02:10:09 +0000 (0:00:01.302) 0:00:06.035 ********* 2026-04-28 02:10:15.541474 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:10:15.541481 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:10:15.541488 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:10:15.541494 | orchestrator | ok: [testbed-manager] 2026-04-28 02:10:15.541500 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:10:15.541506 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:10:15.541512 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:10:15.541518 | orchestrator | 2026-04-28 02:10:15.541525 | orchestrator | TASK [osism.commons.hosts : Include type specific tasks] *********************** 2026-04-28 02:10:15.541531 | orchestrator | Tuesday 28 April 2026 02:10:10 +0000 (0:00:01.299) 0:00:07.335 ********* 2026-04-28 02:10:15.541538 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/hosts/tasks/type-template.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:10:15.541546 | orchestrator | 2026-04-28 02:10:15.541553 | orchestrator | TASK [osism.commons.hosts : Copy /etc/hosts file] ****************************** 2026-04-28 02:10:15.541559 | orchestrator | Tuesday 28 April 2026 02:10:10 +0000 (0:00:00.346) 0:00:07.681 ********* 2026-04-28 02:10:15.541565 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:10:15.541571 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:10:15.541577 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:10:15.541583 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:10:15.541589 | orchestrator | changed: [testbed-manager] 2026-04-28 02:10:15.541595 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:10:15.541601 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:10:15.541607 | orchestrator | 2026-04-28 02:10:15.541625 | orchestrator | TASK [osism.commons.proxy : Include distribution specific tasks] *************** 2026-04-28 02:10:15.541632 | orchestrator | Tuesday 28 April 2026 02:10:12 +0000 (0:00:02.246) 0:00:09.928 ********* 2026-04-28 02:10:15.541638 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:10:15.541645 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/proxy/tasks/Debian-family.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:10:15.541661 | orchestrator | 2026-04-28 02:10:15.541667 | orchestrator | TASK [osism.commons.proxy : Configure proxy parameters for apt] **************** 2026-04-28 02:10:15.541673 | orchestrator | Tuesday 28 April 2026 02:10:13 +0000 (0:00:00.302) 0:00:10.230 ********* 2026-04-28 02:10:15.541680 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:10:15.541686 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:10:15.541692 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:10:15.541698 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:10:15.541704 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:10:15.541716 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:10:15.541722 | orchestrator | 2026-04-28 02:10:15.541731 | orchestrator | TASK [osism.commons.proxy : Set system wide settings in environment file] ****** 2026-04-28 02:10:15.541738 | orchestrator | Tuesday 28 April 2026 02:10:14 +0000 (0:00:01.052) 0:00:11.283 ********* 2026-04-28 02:10:15.541746 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:10:15.541757 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:10:15.541767 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:10:15.541778 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:10:15.541788 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:10:15.541798 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:10:15.541809 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:10:15.541820 | orchestrator | 2026-04-28 02:10:15.541831 | orchestrator | TASK [osism.commons.proxy : Remove system wide settings in environment file] *** 2026-04-28 02:10:15.541841 | orchestrator | Tuesday 28 April 2026 02:10:14 +0000 (0:00:00.589) 0:00:11.873 ********* 2026-04-28 02:10:15.541850 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:10:15.541860 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:10:15.541891 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:10:15.541901 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:10:15.541910 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:10:15.541920 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:10:15.541929 | orchestrator | ok: [testbed-manager] 2026-04-28 02:10:15.541938 | orchestrator | 2026-04-28 02:10:15.541947 | orchestrator | TASK [osism.commons.resolvconf : Check minimum and maximum number of name servers] *** 2026-04-28 02:10:15.541957 | orchestrator | Tuesday 28 April 2026 02:10:15 +0000 (0:00:00.468) 0:00:12.342 ********* 2026-04-28 02:10:15.541966 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:10:15.541976 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:10:15.541995 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:10:28.696751 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:10:28.696824 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:10:28.696830 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:10:28.696834 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:10:28.696839 | orchestrator | 2026-04-28 02:10:28.696844 | orchestrator | TASK [osism.commons.resolvconf : Include resolvconf tasks] ********************* 2026-04-28 02:10:28.696850 | orchestrator | Tuesday 28 April 2026 02:10:15 +0000 (0:00:00.254) 0:00:12.596 ********* 2026-04-28 02:10:28.696856 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/resolvconf/tasks/configure-resolv.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:10:28.696871 | orchestrator | 2026-04-28 02:10:28.696876 | orchestrator | TASK [osism.commons.resolvconf : Include distribution specific installation tasks] *** 2026-04-28 02:10:28.696881 | orchestrator | Tuesday 28 April 2026 02:10:15 +0000 (0:00:00.333) 0:00:12.930 ********* 2026-04-28 02:10:28.696885 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/resolvconf/tasks/install-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:10:28.696889 | orchestrator | 2026-04-28 02:10:28.696894 | orchestrator | TASK [osism.commons.resolvconf : Remove packages configuring /etc/resolv.conf] *** 2026-04-28 02:10:28.696898 | orchestrator | Tuesday 28 April 2026 02:10:16 +0000 (0:00:00.354) 0:00:13.284 ********* 2026-04-28 02:10:28.696929 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:10:28.696934 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:10:28.696937 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:10:28.696942 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:10:28.696945 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:10:28.696949 | orchestrator | ok: [testbed-manager] 2026-04-28 02:10:28.696953 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:10:28.696957 | orchestrator | 2026-04-28 02:10:28.696961 | orchestrator | TASK [osism.commons.resolvconf : Install package systemd-resolved] ************* 2026-04-28 02:10:28.696983 | orchestrator | Tuesday 28 April 2026 02:10:17 +0000 (0:00:01.547) 0:00:14.832 ********* 2026-04-28 02:10:28.696987 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:10:28.696991 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:10:28.696995 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:10:28.696999 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:10:28.697003 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:10:28.697006 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:10:28.697010 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:10:28.697014 | orchestrator | 2026-04-28 02:10:28.697018 | orchestrator | TASK [osism.commons.resolvconf : Retrieve file status of /etc/resolv.conf] ***** 2026-04-28 02:10:28.697022 | orchestrator | Tuesday 28 April 2026 02:10:18 +0000 (0:00:00.383) 0:00:15.215 ********* 2026-04-28 02:10:28.697026 | orchestrator | ok: [testbed-manager] 2026-04-28 02:10:28.697030 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:10:28.697034 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:10:28.697037 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:10:28.697041 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:10:28.697045 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:10:28.697049 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:10:28.697052 | orchestrator | 2026-04-28 02:10:28.697056 | orchestrator | TASK [osism.commons.resolvconf : Archive existing file /etc/resolv.conf] ******* 2026-04-28 02:10:28.697060 | orchestrator | Tuesday 28 April 2026 02:10:18 +0000 (0:00:00.610) 0:00:15.826 ********* 2026-04-28 02:10:28.697064 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:10:28.697068 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:10:28.697071 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:10:28.697075 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:10:28.697079 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:10:28.697083 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:10:28.697087 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:10:28.697090 | orchestrator | 2026-04-28 02:10:28.697094 | orchestrator | TASK [osism.commons.resolvconf : Link /run/systemd/resolve/stub-resolv.conf to /etc/resolv.conf] *** 2026-04-28 02:10:28.697099 | orchestrator | Tuesday 28 April 2026 02:10:19 +0000 (0:00:00.284) 0:00:16.110 ********* 2026-04-28 02:10:28.697103 | orchestrator | ok: [testbed-manager] 2026-04-28 02:10:28.697107 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:10:28.697111 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:10:28.697114 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:10:28.697118 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:10:28.697127 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:10:28.697131 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:10:28.697135 | orchestrator | 2026-04-28 02:10:28.697138 | orchestrator | TASK [osism.commons.resolvconf : Copy configuration files] ********************* 2026-04-28 02:10:28.697142 | orchestrator | Tuesday 28 April 2026 02:10:19 +0000 (0:00:00.563) 0:00:16.673 ********* 2026-04-28 02:10:28.697146 | orchestrator | ok: [testbed-manager] 2026-04-28 02:10:28.697150 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:10:28.697153 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:10:28.697157 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:10:28.697161 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:10:28.697165 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:10:28.697169 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:10:28.697172 | orchestrator | 2026-04-28 02:10:28.697176 | orchestrator | TASK [osism.commons.resolvconf : Start/enable systemd-resolved service] ******** 2026-04-28 02:10:28.697180 | orchestrator | Tuesday 28 April 2026 02:10:20 +0000 (0:00:01.193) 0:00:17.867 ********* 2026-04-28 02:10:28.697184 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:10:28.697188 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:10:28.697191 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:10:28.697195 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:10:28.697199 | orchestrator | ok: [testbed-manager] 2026-04-28 02:10:28.697203 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:10:28.697206 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:10:28.697215 | orchestrator | 2026-04-28 02:10:28.697219 | orchestrator | TASK [osism.commons.resolvconf : Include distribution specific configuration tasks] *** 2026-04-28 02:10:28.697223 | orchestrator | Tuesday 28 April 2026 02:10:22 +0000 (0:00:01.113) 0:00:18.980 ********* 2026-04-28 02:10:28.697237 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/resolvconf/tasks/configure-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:10:28.697241 | orchestrator | 2026-04-28 02:10:28.697245 | orchestrator | TASK [osism.commons.resolvconf : Restart systemd-resolved service] ************* 2026-04-28 02:10:28.697249 | orchestrator | Tuesday 28 April 2026 02:10:22 +0000 (0:00:00.331) 0:00:19.312 ********* 2026-04-28 02:10:28.697252 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:10:28.697256 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:10:28.697260 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:10:28.697264 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:10:28.697268 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:10:28.697271 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:10:28.697275 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:10:28.697279 | orchestrator | 2026-04-28 02:10:28.697283 | orchestrator | TASK [osism.commons.repository : Gather variables for each operating system] *** 2026-04-28 02:10:28.697286 | orchestrator | Tuesday 28 April 2026 02:10:23 +0000 (0:00:01.321) 0:00:20.634 ********* 2026-04-28 02:10:28.697290 | orchestrator | ok: [testbed-manager] 2026-04-28 02:10:28.697294 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:10:28.697298 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:10:28.697302 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:10:28.697306 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:10:28.697309 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:10:28.697313 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:10:28.697317 | orchestrator | 2026-04-28 02:10:28.697321 | orchestrator | TASK [osism.commons.repository : Set repository_default fact to default value] *** 2026-04-28 02:10:28.697325 | orchestrator | Tuesday 28 April 2026 02:10:23 +0000 (0:00:00.279) 0:00:20.914 ********* 2026-04-28 02:10:28.697328 | orchestrator | ok: [testbed-manager] 2026-04-28 02:10:28.697332 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:10:28.697336 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:10:28.697340 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:10:28.697344 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:10:28.697347 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:10:28.697351 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:10:28.697355 | orchestrator | 2026-04-28 02:10:28.697359 | orchestrator | TASK [osism.commons.repository : Set repositories to default] ****************** 2026-04-28 02:10:28.697362 | orchestrator | Tuesday 28 April 2026 02:10:24 +0000 (0:00:00.283) 0:00:21.197 ********* 2026-04-28 02:10:28.697366 | orchestrator | ok: [testbed-manager] 2026-04-28 02:10:28.697370 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:10:28.697374 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:10:28.697378 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:10:28.697381 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:10:28.697385 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:10:28.697389 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:10:28.697393 | orchestrator | 2026-04-28 02:10:28.697396 | orchestrator | TASK [osism.commons.repository : Include distribution specific repository tasks] *** 2026-04-28 02:10:28.697400 | orchestrator | Tuesday 28 April 2026 02:10:24 +0000 (0:00:00.250) 0:00:21.447 ********* 2026-04-28 02:10:28.697405 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/repository/tasks/Ubuntu.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:10:28.697410 | orchestrator | 2026-04-28 02:10:28.697414 | orchestrator | TASK [osism.commons.repository : Create /etc/apt/sources.list.d directory] ***** 2026-04-28 02:10:28.697418 | orchestrator | Tuesday 28 April 2026 02:10:24 +0000 (0:00:00.357) 0:00:21.805 ********* 2026-04-28 02:10:28.697421 | orchestrator | ok: [testbed-manager] 2026-04-28 02:10:28.697428 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:10:28.697432 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:10:28.697436 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:10:28.697440 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:10:28.697444 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:10:28.697448 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:10:28.697451 | orchestrator | 2026-04-28 02:10:28.697455 | orchestrator | TASK [osism.commons.repository : Include tasks for Ubuntu < 24.04] ************* 2026-04-28 02:10:28.697459 | orchestrator | Tuesday 28 April 2026 02:10:25 +0000 (0:00:00.554) 0:00:22.360 ********* 2026-04-28 02:10:28.697463 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:10:28.697467 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:10:28.697470 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:10:28.697474 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:10:28.697478 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:10:28.697482 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:10:28.697486 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:10:28.697489 | orchestrator | 2026-04-28 02:10:28.697493 | orchestrator | TASK [osism.commons.repository : Copy 99osism apt configuration] *************** 2026-04-28 02:10:28.697497 | orchestrator | Tuesday 28 April 2026 02:10:25 +0000 (0:00:00.287) 0:00:22.648 ********* 2026-04-28 02:10:28.697501 | orchestrator | ok: [testbed-manager] 2026-04-28 02:10:28.697505 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:10:28.697509 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:10:28.697513 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:10:28.697517 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:10:28.697521 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:10:28.697525 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:10:28.697528 | orchestrator | 2026-04-28 02:10:28.697532 | orchestrator | TASK [osism.commons.repository : Remove sources.list file] ********************* 2026-04-28 02:10:28.697536 | orchestrator | Tuesday 28 April 2026 02:10:26 +0000 (0:00:01.147) 0:00:23.795 ********* 2026-04-28 02:10:28.697540 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:10:28.697544 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:10:28.697547 | orchestrator | ok: [testbed-manager] 2026-04-28 02:10:28.697551 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:10:28.697555 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:10:28.697559 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:10:28.697562 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:10:28.697566 | orchestrator | 2026-04-28 02:10:28.697570 | orchestrator | TASK [osism.commons.repository : Copy ubuntu.sources file] ********************* 2026-04-28 02:10:28.697574 | orchestrator | Tuesday 28 April 2026 02:10:27 +0000 (0:00:00.658) 0:00:24.453 ********* 2026-04-28 02:10:28.697582 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:10:28.697585 | orchestrator | ok: [testbed-manager] 2026-04-28 02:10:28.697589 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:10:28.697593 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:10:28.697599 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:11:13.651605 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:11:13.651752 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:11:13.651779 | orchestrator | 2026-04-28 02:11:13.651802 | orchestrator | TASK [osism.commons.repository : Update package cache] ************************* 2026-04-28 02:11:13.651823 | orchestrator | Tuesday 28 April 2026 02:10:28 +0000 (0:00:01.188) 0:00:25.641 ********* 2026-04-28 02:11:13.651842 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:11:13.651862 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:11:13.651904 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:11:13.651924 | orchestrator | changed: [testbed-manager] 2026-04-28 02:11:13.651943 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:11:13.651961 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:11:13.651981 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:11:13.651999 | orchestrator | 2026-04-28 02:11:13.652018 | orchestrator | TASK [osism.services.rsyslog : Gather variables for each operating system] ***** 2026-04-28 02:11:13.652067 | orchestrator | Tuesday 28 April 2026 02:10:45 +0000 (0:00:16.496) 0:00:42.138 ********* 2026-04-28 02:11:13.652123 | orchestrator | ok: [testbed-manager] 2026-04-28 02:11:13.652144 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:11:13.652162 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:11:13.652181 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:11:13.652199 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:11:13.652217 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:11:13.652236 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:11:13.652254 | orchestrator | 2026-04-28 02:11:13.652272 | orchestrator | TASK [osism.services.rsyslog : Set rsyslog_user variable to default value] ***** 2026-04-28 02:11:13.652290 | orchestrator | Tuesday 28 April 2026 02:10:45 +0000 (0:00:00.267) 0:00:42.405 ********* 2026-04-28 02:11:13.652308 | orchestrator | ok: [testbed-manager] 2026-04-28 02:11:13.652326 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:11:13.652345 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:11:13.652363 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:11:13.652380 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:11:13.652398 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:11:13.652416 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:11:13.652435 | orchestrator | 2026-04-28 02:11:13.652454 | orchestrator | TASK [osism.services.rsyslog : Set rsyslog_workdir variable to default value] *** 2026-04-28 02:11:13.652472 | orchestrator | Tuesday 28 April 2026 02:10:45 +0000 (0:00:00.291) 0:00:42.697 ********* 2026-04-28 02:11:13.652490 | orchestrator | ok: [testbed-manager] 2026-04-28 02:11:13.652507 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:11:13.652525 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:11:13.652542 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:11:13.652560 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:11:13.652578 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:11:13.652596 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:11:13.652615 | orchestrator | 2026-04-28 02:11:13.652635 | orchestrator | TASK [osism.services.rsyslog : Include distribution specific install tasks] **** 2026-04-28 02:11:13.652654 | orchestrator | Tuesday 28 April 2026 02:10:45 +0000 (0:00:00.250) 0:00:42.948 ********* 2026-04-28 02:11:13.652673 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/rsyslog/tasks/install-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:11:13.652688 | orchestrator | 2026-04-28 02:11:13.652699 | orchestrator | TASK [osism.services.rsyslog : Install rsyslog package] ************************ 2026-04-28 02:11:13.652710 | orchestrator | Tuesday 28 April 2026 02:10:46 +0000 (0:00:00.390) 0:00:43.338 ********* 2026-04-28 02:11:13.652721 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:11:13.652731 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:11:13.652749 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:11:13.652767 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:11:13.652785 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:11:13.652803 | orchestrator | ok: [testbed-manager] 2026-04-28 02:11:13.652819 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:11:13.652837 | orchestrator | 2026-04-28 02:11:13.652857 | orchestrator | TASK [osism.services.rsyslog : Copy rsyslog.conf configuration file] *********** 2026-04-28 02:11:13.652877 | orchestrator | Tuesday 28 April 2026 02:10:48 +0000 (0:00:01.785) 0:00:45.124 ********* 2026-04-28 02:11:13.652895 | orchestrator | changed: [testbed-manager] 2026-04-28 02:11:13.652915 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:11:13.652933 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:11:13.652950 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:11:13.652969 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:11:13.652985 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:11:13.653004 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:11:13.653105 | orchestrator | 2026-04-28 02:11:13.653130 | orchestrator | TASK [osism.services.rsyslog : Manage rsyslog service] ************************* 2026-04-28 02:11:13.653169 | orchestrator | Tuesday 28 April 2026 02:10:49 +0000 (0:00:01.185) 0:00:46.309 ********* 2026-04-28 02:11:13.653190 | orchestrator | ok: [testbed-manager] 2026-04-28 02:11:13.653209 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:11:13.653245 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:11:13.653266 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:11:13.653286 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:11:13.653304 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:11:13.653324 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:11:13.653344 | orchestrator | 2026-04-28 02:11:13.653364 | orchestrator | TASK [osism.services.rsyslog : Include fluentd tasks] ************************** 2026-04-28 02:11:13.653384 | orchestrator | Tuesday 28 April 2026 02:10:50 +0000 (0:00:00.823) 0:00:47.133 ********* 2026-04-28 02:11:13.653405 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/rsyslog/tasks/fluentd.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:11:13.653426 | orchestrator | 2026-04-28 02:11:13.653445 | orchestrator | TASK [osism.services.rsyslog : Forward syslog message to local fluentd daemon] *** 2026-04-28 02:11:13.653465 | orchestrator | Tuesday 28 April 2026 02:10:50 +0000 (0:00:00.377) 0:00:47.510 ********* 2026-04-28 02:11:13.653484 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:11:13.653505 | orchestrator | changed: [testbed-manager] 2026-04-28 02:11:13.653521 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:11:13.653538 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:11:13.653555 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:11:13.653571 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:11:13.653589 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:11:13.653606 | orchestrator | 2026-04-28 02:11:13.653651 | orchestrator | TASK [osism.services.rsyslog : Include additional log server tasks] ************ 2026-04-28 02:11:13.653670 | orchestrator | Tuesday 28 April 2026 02:10:51 +0000 (0:00:01.066) 0:00:48.577 ********* 2026-04-28 02:11:13.653687 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:11:13.653703 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:11:13.653720 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:11:13.653737 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:11:13.653753 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:11:13.653769 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:11:13.653780 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:11:13.653789 | orchestrator | 2026-04-28 02:11:13.653799 | orchestrator | TASK [osism.services.rsyslog : Include logrotate tasks] ************************ 2026-04-28 02:11:13.653809 | orchestrator | Tuesday 28 April 2026 02:10:51 +0000 (0:00:00.290) 0:00:48.868 ********* 2026-04-28 02:11:13.653819 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/rsyslog/tasks/logrotate.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:11:13.653829 | orchestrator | 2026-04-28 02:11:13.653839 | orchestrator | TASK [osism.services.rsyslog : Ensure logrotate package is installed] ********** 2026-04-28 02:11:13.653848 | orchestrator | Tuesday 28 April 2026 02:10:52 +0000 (0:00:00.388) 0:00:49.256 ********* 2026-04-28 02:11:13.653858 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:11:13.653867 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:11:13.653877 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:11:13.653886 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:11:13.653896 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:11:13.653905 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:11:13.653915 | orchestrator | ok: [testbed-manager] 2026-04-28 02:11:13.653924 | orchestrator | 2026-04-28 02:11:13.653934 | orchestrator | TASK [osism.services.rsyslog : Configure logrotate for rsyslog] **************** 2026-04-28 02:11:13.653943 | orchestrator | Tuesday 28 April 2026 02:10:54 +0000 (0:00:01.985) 0:00:51.241 ********* 2026-04-28 02:11:13.653953 | orchestrator | changed: [testbed-manager] 2026-04-28 02:11:13.653963 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:11:13.653972 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:11:13.653982 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:11:13.653991 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:11:13.654001 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:11:13.654107 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:11:13.654122 | orchestrator | 2026-04-28 02:11:13.654131 | orchestrator | TASK [osism.commons.systohc : Install util-linux-extra package] **************** 2026-04-28 02:11:13.654141 | orchestrator | Tuesday 28 April 2026 02:10:55 +0000 (0:00:01.212) 0:00:52.453 ********* 2026-04-28 02:11:13.654151 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:11:13.654160 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:11:13.654170 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:11:13.654179 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:11:13.654189 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:11:13.654198 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:11:13.654207 | orchestrator | changed: [testbed-manager] 2026-04-28 02:11:13.654217 | orchestrator | 2026-04-28 02:11:13.654227 | orchestrator | TASK [osism.commons.systohc : Sync hardware clock] ***************************** 2026-04-28 02:11:13.654236 | orchestrator | Tuesday 28 April 2026 02:11:10 +0000 (0:00:15.153) 0:01:07.606 ********* 2026-04-28 02:11:13.654246 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:11:13.654255 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:11:13.654265 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:11:13.654275 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:11:13.654284 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:11:13.654294 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:11:13.654303 | orchestrator | ok: [testbed-manager] 2026-04-28 02:11:13.654312 | orchestrator | 2026-04-28 02:11:13.654322 | orchestrator | TASK [osism.commons.configfs : Start sys-kernel-config mount] ****************** 2026-04-28 02:11:13.654332 | orchestrator | Tuesday 28 April 2026 02:11:11 +0000 (0:00:01.061) 0:01:08.667 ********* 2026-04-28 02:11:13.654341 | orchestrator | ok: [testbed-manager] 2026-04-28 02:11:13.654351 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:11:13.654360 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:11:13.654370 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:11:13.654379 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:11:13.654388 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:11:13.654398 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:11:13.654407 | orchestrator | 2026-04-28 02:11:13.654417 | orchestrator | TASK [osism.commons.packages : Gather variables for each operating system] ***** 2026-04-28 02:11:13.654434 | orchestrator | Tuesday 28 April 2026 02:11:12 +0000 (0:00:01.016) 0:01:09.684 ********* 2026-04-28 02:11:13.654444 | orchestrator | ok: [testbed-manager] 2026-04-28 02:11:13.654453 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:11:13.654463 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:11:13.654472 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:11:13.654482 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:11:13.654491 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:11:13.654501 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:11:13.654510 | orchestrator | 2026-04-28 02:11:13.654520 | orchestrator | TASK [osism.commons.packages : Set required_packages_distribution variable to default value] *** 2026-04-28 02:11:13.654529 | orchestrator | Tuesday 28 April 2026 02:11:12 +0000 (0:00:00.255) 0:01:09.939 ********* 2026-04-28 02:11:13.654539 | orchestrator | ok: [testbed-manager] 2026-04-28 02:11:13.654548 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:11:13.654558 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:11:13.654567 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:11:13.654576 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:11:13.654586 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:11:13.654595 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:11:13.654605 | orchestrator | 2026-04-28 02:11:13.654614 | orchestrator | TASK [osism.commons.packages : Include distribution specific package tasks] **** 2026-04-28 02:11:13.654624 | orchestrator | Tuesday 28 April 2026 02:11:13 +0000 (0:00:00.293) 0:01:10.233 ********* 2026-04-28 02:11:13.654635 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/packages/tasks/package-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:11:13.654645 | orchestrator | 2026-04-28 02:11:13.654664 | orchestrator | TASK [osism.commons.packages : Install needrestart package] ******************** 2026-04-28 02:13:40.475148 | orchestrator | Tuesday 28 April 2026 02:11:13 +0000 (0:00:00.368) 0:01:10.601 ********* 2026-04-28 02:13:40.475254 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:13:40.475267 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:13:40.475278 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:13:40.475287 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:13:40.475297 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:13:40.475307 | orchestrator | ok: [testbed-manager] 2026-04-28 02:13:40.475316 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:13:40.475326 | orchestrator | 2026-04-28 02:13:40.475393 | orchestrator | TASK [osism.commons.packages : Set needrestart mode] *************************** 2026-04-28 02:13:40.475405 | orchestrator | Tuesday 28 April 2026 02:11:15 +0000 (0:00:01.729) 0:01:12.331 ********* 2026-04-28 02:13:40.475415 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:13:40.475425 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:13:40.475435 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:13:40.475444 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:13:40.475454 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:13:40.475464 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:13:40.475475 | orchestrator | changed: [testbed-manager] 2026-04-28 02:13:40.475491 | orchestrator | 2026-04-28 02:13:40.475508 | orchestrator | TASK [osism.commons.packages : Set apt_cache_valid_time variable to default value] *** 2026-04-28 02:13:40.475524 | orchestrator | Tuesday 28 April 2026 02:11:16 +0000 (0:00:00.632) 0:01:12.963 ********* 2026-04-28 02:13:40.475540 | orchestrator | ok: [testbed-manager] 2026-04-28 02:13:40.475556 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:13:40.475571 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:13:40.475584 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:13:40.475599 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:13:40.475615 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:13:40.475631 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:13:40.475649 | orchestrator | 2026-04-28 02:13:40.475665 | orchestrator | TASK [osism.commons.packages : Update package cache] *************************** 2026-04-28 02:13:40.475682 | orchestrator | Tuesday 28 April 2026 02:11:16 +0000 (0:00:00.310) 0:01:13.273 ********* 2026-04-28 02:13:40.475700 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:13:40.475716 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:13:40.475728 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:13:40.475739 | orchestrator | ok: [testbed-manager] 2026-04-28 02:13:40.475749 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:13:40.475759 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:13:40.475769 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:13:40.475778 | orchestrator | 2026-04-28 02:13:40.475788 | orchestrator | TASK [osism.commons.packages : Download upgrade packages] ********************** 2026-04-28 02:13:40.475798 | orchestrator | Tuesday 28 April 2026 02:11:17 +0000 (0:00:01.304) 0:01:14.578 ********* 2026-04-28 02:13:40.475807 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:13:40.475817 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:13:40.475827 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:13:40.475836 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:13:40.475846 | orchestrator | changed: [testbed-manager] 2026-04-28 02:13:40.475855 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:13:40.475865 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:13:40.475878 | orchestrator | 2026-04-28 02:13:40.475888 | orchestrator | TASK [osism.commons.packages : Upgrade packages] ******************************* 2026-04-28 02:13:40.475897 | orchestrator | Tuesday 28 April 2026 02:11:19 +0000 (0:00:01.934) 0:01:16.512 ********* 2026-04-28 02:13:40.475907 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:13:40.475916 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:13:40.475926 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:13:40.475935 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:13:40.475945 | orchestrator | ok: [testbed-manager] 2026-04-28 02:13:40.475966 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:13:40.475976 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:13:40.476012 | orchestrator | 2026-04-28 02:13:40.476023 | orchestrator | TASK [osism.commons.packages : Download required packages] ********************* 2026-04-28 02:13:40.476032 | orchestrator | Tuesday 28 April 2026 02:11:22 +0000 (0:00:02.783) 0:01:19.296 ********* 2026-04-28 02:13:40.476042 | orchestrator | ok: [testbed-manager] 2026-04-28 02:13:40.476051 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:13:40.476061 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:13:40.476070 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:13:40.476079 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:13:40.476089 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:13:40.476098 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:13:40.476108 | orchestrator | 2026-04-28 02:13:40.476117 | orchestrator | TASK [osism.commons.packages : Install required packages] ********************** 2026-04-28 02:13:40.476127 | orchestrator | Tuesday 28 April 2026 02:12:03 +0000 (0:00:41.101) 0:02:00.397 ********* 2026-04-28 02:13:40.476136 | orchestrator | changed: [testbed-manager] 2026-04-28 02:13:40.476146 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:13:40.476155 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:13:40.476165 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:13:40.476174 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:13:40.476184 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:13:40.476193 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:13:40.476202 | orchestrator | 2026-04-28 02:13:40.476212 | orchestrator | TASK [osism.commons.packages : Remove useless packages from the cache] ********* 2026-04-28 02:13:40.476222 | orchestrator | Tuesday 28 April 2026 02:13:22 +0000 (0:01:19.237) 0:03:19.634 ********* 2026-04-28 02:13:40.476231 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:13:40.476241 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:13:40.476250 | orchestrator | ok: [testbed-manager] 2026-04-28 02:13:40.476260 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:13:40.476269 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:13:40.476279 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:13:40.476288 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:13:40.476297 | orchestrator | 2026-04-28 02:13:40.476307 | orchestrator | TASK [osism.commons.packages : Remove dependencies that are no longer required] *** 2026-04-28 02:13:40.476317 | orchestrator | Tuesday 28 April 2026 02:13:24 +0000 (0:00:01.838) 0:03:21.472 ********* 2026-04-28 02:13:40.476326 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:13:40.476357 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:13:40.476366 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:13:40.476376 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:13:40.476385 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:13:40.476394 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:13:40.476404 | orchestrator | changed: [testbed-manager] 2026-04-28 02:13:40.476414 | orchestrator | 2026-04-28 02:13:40.476423 | orchestrator | TASK [osism.commons.sysctl : Include sysctl tasks] ***************************** 2026-04-28 02:13:40.476433 | orchestrator | Tuesday 28 April 2026 02:13:39 +0000 (0:00:14.631) 0:03:36.104 ********* 2026-04-28 02:13:40.476476 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/sysctl/tasks/sysctl.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 => (item={'key': 'elasticsearch', 'value': [{'name': 'vm.max_map_count', 'value': 262144}]}) 2026-04-28 02:13:40.476501 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/sysctl/tasks/sysctl.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 => (item={'key': 'rabbitmq', 'value': [{'name': 'net.ipv4.tcp_keepalive_time', 'value': 6}, {'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3}, {'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3}, {'name': 'net.core.wmem_max', 'value': 16777216}, {'name': 'net.core.rmem_max', 'value': 16777216}, {'name': 'net.ipv4.tcp_fin_timeout', 'value': 20}, {'name': 'net.ipv4.tcp_tw_reuse', 'value': 1}, {'name': 'net.core.somaxconn', 'value': 4096}, {'name': 'net.ipv4.tcp_syncookies', 'value': 0}, {'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192}]}) 2026-04-28 02:13:40.476522 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/sysctl/tasks/sysctl.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 => (item={'key': 'generic', 'value': [{'name': 'vm.swappiness', 'value': 1}]}) 2026-04-28 02:13:40.476535 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/sysctl/tasks/sysctl.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 => (item={'key': 'compute', 'value': [{'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}]}) 2026-04-28 02:13:40.476545 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/sysctl/tasks/sysctl.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 => (item={'key': 'network', 'value': [{'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}]}) 2026-04-28 02:13:40.476554 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/sysctl/tasks/sysctl.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 => (item={'key': 'k3s_node', 'value': [{'name': 'fs.inotify.max_user_instances', 'value': 1024}]}) 2026-04-28 02:13:40.476564 | orchestrator | 2026-04-28 02:13:40.476574 | orchestrator | TASK [osism.commons.sysctl : Set sysctl parameters on elasticsearch] *********** 2026-04-28 02:13:40.476583 | orchestrator | Tuesday 28 April 2026 02:13:39 +0000 (0:00:00.469) 0:03:36.574 ********* 2026-04-28 02:13:40.476593 | orchestrator | skipping: [testbed-manager] => (item={'name': 'vm.max_map_count', 'value': 262144})  2026-04-28 02:13:40.476602 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:13:40.476612 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'vm.max_map_count', 'value': 262144})  2026-04-28 02:13:40.476622 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'vm.max_map_count', 'value': 262144})  2026-04-28 02:13:40.476631 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:13:40.476645 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:13:40.476655 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'vm.max_map_count', 'value': 262144})  2026-04-28 02:13:40.476665 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:13:40.476683 | orchestrator | changed: [testbed-node-0] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-28 02:13:40.476700 | orchestrator | changed: [testbed-node-1] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-28 02:13:40.476716 | orchestrator | changed: [testbed-node-2] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-28 02:13:40.476731 | orchestrator | 2026-04-28 02:13:40.476746 | orchestrator | TASK [osism.commons.sysctl : Set sysctl parameters on rabbitmq] **************** 2026-04-28 02:13:40.476762 | orchestrator | Tuesday 28 April 2026 02:13:40 +0000 (0:00:00.769) 0:03:37.344 ********* 2026-04-28 02:13:40.476778 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.ipv4.tcp_keepalive_time', 'value': 6})  2026-04-28 02:13:40.476796 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3})  2026-04-28 02:13:40.476814 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3})  2026-04-28 02:13:40.476831 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.core.wmem_max', 'value': 16777216})  2026-04-28 02:13:40.476850 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.core.rmem_max', 'value': 16777216})  2026-04-28 02:13:40.476877 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.ipv4.tcp_fin_timeout', 'value': 20})  2026-04-28 02:13:45.322112 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.ipv4.tcp_tw_reuse', 'value': 1})  2026-04-28 02:13:45.322227 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.core.somaxconn', 'value': 4096})  2026-04-28 02:13:45.322267 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.ipv4.tcp_syncookies', 'value': 0})  2026-04-28 02:13:45.322280 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192})  2026-04-28 02:13:45.322293 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.ipv4.tcp_keepalive_time', 'value': 6})  2026-04-28 02:13:45.322304 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3})  2026-04-28 02:13:45.322315 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3})  2026-04-28 02:13:45.322326 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.core.wmem_max', 'value': 16777216})  2026-04-28 02:13:45.322387 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.core.rmem_max', 'value': 16777216})  2026-04-28 02:13:45.322400 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.ipv4.tcp_fin_timeout', 'value': 20})  2026-04-28 02:13:45.322412 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.ipv4.tcp_tw_reuse', 'value': 1})  2026-04-28 02:13:45.322424 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.ipv4.tcp_keepalive_time', 'value': 6})  2026-04-28 02:13:45.322435 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.core.somaxconn', 'value': 4096})  2026-04-28 02:13:45.322446 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.ipv4.tcp_syncookies', 'value': 0})  2026-04-28 02:13:45.322457 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:13:45.322469 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3})  2026-04-28 02:13:45.322480 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192})  2026-04-28 02:13:45.322491 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3})  2026-04-28 02:13:45.322502 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.core.wmem_max', 'value': 16777216})  2026-04-28 02:13:45.322513 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.core.rmem_max', 'value': 16777216})  2026-04-28 02:13:45.322524 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.ipv4.tcp_fin_timeout', 'value': 20})  2026-04-28 02:13:45.322535 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.ipv4.tcp_tw_reuse', 'value': 1})  2026-04-28 02:13:45.322546 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.core.somaxconn', 'value': 4096})  2026-04-28 02:13:45.322557 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.ipv4.tcp_syncookies', 'value': 0})  2026-04-28 02:13:45.322567 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192})  2026-04-28 02:13:45.322578 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.ipv4.tcp_keepalive_time', 'value': 6})  2026-04-28 02:13:45.322589 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3})  2026-04-28 02:13:45.322600 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3})  2026-04-28 02:13:45.322611 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.core.wmem_max', 'value': 16777216})  2026-04-28 02:13:45.322638 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.core.rmem_max', 'value': 16777216})  2026-04-28 02:13:45.322649 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.ipv4.tcp_fin_timeout', 'value': 20})  2026-04-28 02:13:45.322660 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.ipv4.tcp_tw_reuse', 'value': 1})  2026-04-28 02:13:45.322671 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.core.somaxconn', 'value': 4096})  2026-04-28 02:13:45.322681 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:13:45.322693 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.ipv4.tcp_syncookies', 'value': 0})  2026-04-28 02:13:45.322712 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192})  2026-04-28 02:13:45.322724 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:13:45.322734 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:13:45.322745 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_keepalive_time', 'value': 6}) 2026-04-28 02:13:45.322756 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_keepalive_time', 'value': 6}) 2026-04-28 02:13:45.322767 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_keepalive_time', 'value': 6}) 2026-04-28 02:13:45.322778 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3}) 2026-04-28 02:13:45.322788 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3}) 2026-04-28 02:13:45.322819 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_keepalive_intvl', 'value': 3}) 2026-04-28 02:13:45.322831 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3}) 2026-04-28 02:13:45.322842 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3}) 2026-04-28 02:13:45.322853 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_keepalive_probes', 'value': 3}) 2026-04-28 02:13:45.322863 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.core.wmem_max', 'value': 16777216}) 2026-04-28 02:13:45.322874 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.core.wmem_max', 'value': 16777216}) 2026-04-28 02:13:45.322885 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.core.wmem_max', 'value': 16777216}) 2026-04-28 02:13:45.322896 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.core.rmem_max', 'value': 16777216}) 2026-04-28 02:13:45.322907 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.core.rmem_max', 'value': 16777216}) 2026-04-28 02:13:45.322918 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.core.rmem_max', 'value': 16777216}) 2026-04-28 02:13:45.322928 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_fin_timeout', 'value': 20}) 2026-04-28 02:13:45.322939 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_fin_timeout', 'value': 20}) 2026-04-28 02:13:45.322950 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_fin_timeout', 'value': 20}) 2026-04-28 02:13:45.322961 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_tw_reuse', 'value': 1}) 2026-04-28 02:13:45.322972 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_tw_reuse', 'value': 1}) 2026-04-28 02:13:45.322983 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_tw_reuse', 'value': 1}) 2026-04-28 02:13:45.322994 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.core.somaxconn', 'value': 4096}) 2026-04-28 02:13:45.323004 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.core.somaxconn', 'value': 4096}) 2026-04-28 02:13:45.323015 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.core.somaxconn', 'value': 4096}) 2026-04-28 02:13:45.323026 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_syncookies', 'value': 0}) 2026-04-28 02:13:45.323037 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_syncookies', 'value': 0}) 2026-04-28 02:13:45.323047 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_syncookies', 'value': 0}) 2026-04-28 02:13:45.323058 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192}) 2026-04-28 02:13:45.323070 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192}) 2026-04-28 02:13:45.323081 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_max_syn_backlog', 'value': 8192}) 2026-04-28 02:13:45.323099 | orchestrator | 2026-04-28 02:13:45.323110 | orchestrator | TASK [osism.commons.sysctl : Set sysctl parameters on generic] ***************** 2026-04-28 02:13:45.323121 | orchestrator | Tuesday 28 April 2026 02:13:44 +0000 (0:00:03.757) 0:03:41.101 ********* 2026-04-28 02:13:45.323132 | orchestrator | changed: [testbed-manager] => (item={'name': 'vm.swappiness', 'value': 1}) 2026-04-28 02:13:45.323144 | orchestrator | changed: [testbed-node-3] => (item={'name': 'vm.swappiness', 'value': 1}) 2026-04-28 02:13:45.323154 | orchestrator | changed: [testbed-node-4] => (item={'name': 'vm.swappiness', 'value': 1}) 2026-04-28 02:13:45.323165 | orchestrator | changed: [testbed-node-5] => (item={'name': 'vm.swappiness', 'value': 1}) 2026-04-28 02:13:45.323181 | orchestrator | changed: [testbed-node-0] => (item={'name': 'vm.swappiness', 'value': 1}) 2026-04-28 02:13:45.323193 | orchestrator | changed: [testbed-node-1] => (item={'name': 'vm.swappiness', 'value': 1}) 2026-04-28 02:13:45.323204 | orchestrator | changed: [testbed-node-2] => (item={'name': 'vm.swappiness', 'value': 1}) 2026-04-28 02:13:45.323215 | orchestrator | 2026-04-28 02:13:45.323226 | orchestrator | TASK [osism.commons.sysctl : Set sysctl parameters on compute] ***************** 2026-04-28 02:13:45.323237 | orchestrator | Tuesday 28 April 2026 02:13:44 +0000 (0:00:00.611) 0:03:41.712 ********* 2026-04-28 02:13:45.323247 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-28 02:13:45.323258 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:13:45.323269 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-28 02:13:45.323280 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-28 02:13:45.323291 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:13:45.323302 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:13:45.323313 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-28 02:13:45.323324 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:13:45.323335 | orchestrator | changed: [testbed-node-3] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}) 2026-04-28 02:13:45.323367 | orchestrator | changed: [testbed-node-4] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}) 2026-04-28 02:13:45.323385 | orchestrator | changed: [testbed-node-5] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}) 2026-04-28 02:13:59.353717 | orchestrator | 2026-04-28 02:13:59.353795 | orchestrator | TASK [osism.commons.sysctl : Set sysctl parameters on network] ***************** 2026-04-28 02:13:59.353805 | orchestrator | Tuesday 28 April 2026 02:13:45 +0000 (0:00:00.554) 0:03:42.267 ********* 2026-04-28 02:13:59.353812 | orchestrator | skipping: [testbed-manager] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-28 02:13:59.353820 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-28 02:13:59.353825 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:13:59.353832 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-28 02:13:59.353838 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:13:59.353843 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576})  2026-04-28 02:13:59.353848 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:13:59.353854 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:13:59.353859 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}) 2026-04-28 02:13:59.353865 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}) 2026-04-28 02:13:59.353870 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.netfilter.nf_conntrack_max', 'value': 1048576}) 2026-04-28 02:13:59.353876 | orchestrator | 2026-04-28 02:13:59.353896 | orchestrator | TASK [osism.commons.sysctl : Set sysctl parameters on k3s_node] **************** 2026-04-28 02:13:59.353902 | orchestrator | Tuesday 28 April 2026 02:13:46 +0000 (0:00:00.728) 0:03:42.995 ********* 2026-04-28 02:13:59.353908 | orchestrator | skipping: [testbed-manager] => (item={'name': 'fs.inotify.max_user_instances', 'value': 1024})  2026-04-28 02:13:59.353913 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:13:59.353918 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'fs.inotify.max_user_instances', 'value': 1024})  2026-04-28 02:13:59.353924 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'fs.inotify.max_user_instances', 'value': 1024})  2026-04-28 02:13:59.353929 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:13:59.353935 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:13:59.353940 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'fs.inotify.max_user_instances', 'value': 1024})  2026-04-28 02:13:59.353945 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:13:59.353951 | orchestrator | changed: [testbed-node-3] => (item={'name': 'fs.inotify.max_user_instances', 'value': 1024}) 2026-04-28 02:13:59.353956 | orchestrator | changed: [testbed-node-4] => (item={'name': 'fs.inotify.max_user_instances', 'value': 1024}) 2026-04-28 02:13:59.353962 | orchestrator | changed: [testbed-node-5] => (item={'name': 'fs.inotify.max_user_instances', 'value': 1024}) 2026-04-28 02:13:59.353967 | orchestrator | 2026-04-28 02:13:59.353973 | orchestrator | TASK [osism.commons.limits : Include limits tasks] ***************************** 2026-04-28 02:13:59.353978 | orchestrator | Tuesday 28 April 2026 02:13:46 +0000 (0:00:00.623) 0:03:43.619 ********* 2026-04-28 02:13:59.353984 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:13:59.353989 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:13:59.353994 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:13:59.353999 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:13:59.354005 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:13:59.354010 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:13:59.354057 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:13:59.354064 | orchestrator | 2026-04-28 02:13:59.354070 | orchestrator | TASK [osism.commons.services : Populate service facts] ************************* 2026-04-28 02:13:59.354076 | orchestrator | Tuesday 28 April 2026 02:13:46 +0000 (0:00:00.332) 0:03:43.952 ********* 2026-04-28 02:13:59.354081 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:13:59.354088 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:13:59.354093 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:13:59.354099 | orchestrator | ok: [testbed-manager] 2026-04-28 02:13:59.354104 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:13:59.354110 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:13:59.354115 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:13:59.354120 | orchestrator | 2026-04-28 02:13:59.354126 | orchestrator | TASK [osism.commons.services : Check services] ********************************* 2026-04-28 02:13:59.354132 | orchestrator | Tuesday 28 April 2026 02:13:52 +0000 (0:00:05.945) 0:03:49.897 ********* 2026-04-28 02:13:59.354137 | orchestrator | skipping: [testbed-manager] => (item=nscd)  2026-04-28 02:13:59.354143 | orchestrator | skipping: [testbed-node-3] => (item=nscd)  2026-04-28 02:13:59.354148 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:13:59.354154 | orchestrator | skipping: [testbed-node-4] => (item=nscd)  2026-04-28 02:13:59.354159 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:13:59.354165 | orchestrator | skipping: [testbed-node-5] => (item=nscd)  2026-04-28 02:13:59.354170 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:13:59.354176 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:13:59.354181 | orchestrator | skipping: [testbed-node-0] => (item=nscd)  2026-04-28 02:13:59.354187 | orchestrator | skipping: [testbed-node-1] => (item=nscd)  2026-04-28 02:13:59.354207 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:13:59.354213 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:13:59.354219 | orchestrator | skipping: [testbed-node-2] => (item=nscd)  2026-04-28 02:13:59.354224 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:13:59.354235 | orchestrator | 2026-04-28 02:13:59.354240 | orchestrator | TASK [osism.commons.services : Start/enable required services] ***************** 2026-04-28 02:13:59.354246 | orchestrator | Tuesday 28 April 2026 02:13:53 +0000 (0:00:00.359) 0:03:50.256 ********* 2026-04-28 02:13:59.354251 | orchestrator | ok: [testbed-manager] => (item=cron) 2026-04-28 02:13:59.354257 | orchestrator | ok: [testbed-node-3] => (item=cron) 2026-04-28 02:13:59.354262 | orchestrator | ok: [testbed-node-4] => (item=cron) 2026-04-28 02:13:59.354279 | orchestrator | ok: [testbed-node-5] => (item=cron) 2026-04-28 02:13:59.354286 | orchestrator | ok: [testbed-node-0] => (item=cron) 2026-04-28 02:13:59.354293 | orchestrator | ok: [testbed-node-1] => (item=cron) 2026-04-28 02:13:59.354299 | orchestrator | ok: [testbed-node-2] => (item=cron) 2026-04-28 02:13:59.354305 | orchestrator | 2026-04-28 02:13:59.354311 | orchestrator | TASK [osism.commons.motd : Include distribution specific configure tasks] ****** 2026-04-28 02:13:59.354318 | orchestrator | Tuesday 28 April 2026 02:13:54 +0000 (0:00:01.250) 0:03:51.507 ********* 2026-04-28 02:13:59.354325 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/motd/tasks/configure-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:13:59.354333 | orchestrator | 2026-04-28 02:13:59.354339 | orchestrator | TASK [osism.commons.motd : Remove update-motd package] ************************* 2026-04-28 02:13:59.354345 | orchestrator | Tuesday 28 April 2026 02:13:55 +0000 (0:00:00.480) 0:03:51.987 ********* 2026-04-28 02:13:59.354351 | orchestrator | ok: [testbed-manager] 2026-04-28 02:13:59.354357 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:13:59.354378 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:13:59.354384 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:13:59.354390 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:13:59.354396 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:13:59.354402 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:13:59.354408 | orchestrator | 2026-04-28 02:13:59.354415 | orchestrator | TASK [osism.commons.motd : Check if /etc/default/motd-news exists] ************* 2026-04-28 02:13:59.354421 | orchestrator | Tuesday 28 April 2026 02:13:56 +0000 (0:00:01.281) 0:03:53.269 ********* 2026-04-28 02:13:59.354427 | orchestrator | ok: [testbed-manager] 2026-04-28 02:13:59.354433 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:13:59.354439 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:13:59.354445 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:13:59.354451 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:13:59.354457 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:13:59.354463 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:13:59.354469 | orchestrator | 2026-04-28 02:13:59.354475 | orchestrator | TASK [osism.commons.motd : Disable the dynamic motd-news service] ************** 2026-04-28 02:13:59.354482 | orchestrator | Tuesday 28 April 2026 02:13:56 +0000 (0:00:00.679) 0:03:53.948 ********* 2026-04-28 02:13:59.354488 | orchestrator | changed: [testbed-manager] 2026-04-28 02:13:59.354494 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:13:59.354500 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:13:59.354506 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:13:59.354512 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:13:59.354518 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:13:59.354524 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:13:59.354531 | orchestrator | 2026-04-28 02:13:59.354537 | orchestrator | TASK [osism.commons.motd : Get all configuration files in /etc/pam.d] ********** 2026-04-28 02:13:59.354543 | orchestrator | Tuesday 28 April 2026 02:13:57 +0000 (0:00:00.678) 0:03:54.627 ********* 2026-04-28 02:13:59.354549 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:13:59.354555 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:13:59.354561 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:13:59.354568 | orchestrator | ok: [testbed-manager] 2026-04-28 02:13:59.354574 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:13:59.354580 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:13:59.354586 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:13:59.354598 | orchestrator | 2026-04-28 02:13:59.354604 | orchestrator | TASK [osism.commons.motd : Remove pam_motd.so rule] **************************** 2026-04-28 02:13:59.354610 | orchestrator | Tuesday 28 April 2026 02:13:58 +0000 (0:00:00.725) 0:03:55.352 ********* 2026-04-28 02:13:59.354622 | orchestrator | changed: [testbed-manager] => (item={'path': '/etc/pam.d/sshd', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2133, 'inode': 567, 'dev': 2049, 'nlink': 1, 'atime': 1777340830.790861, 'mtime': 1740432309.0, 'ctime': 1743685035.2598536, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 02:13:59.354631 | orchestrator | changed: [testbed-node-3] => (item={'path': '/etc/pam.d/sshd', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2133, 'inode': 567, 'dev': 2049, 'nlink': 1, 'atime': 1777340854.0169337, 'mtime': 1740432309.0, 'ctime': 1743685035.2598536, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 02:13:59.354637 | orchestrator | changed: [testbed-node-5] => (item={'path': '/etc/pam.d/sshd', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2133, 'inode': 567, 'dev': 2049, 'nlink': 1, 'atime': 1777340859.3467228, 'mtime': 1740432309.0, 'ctime': 1743685035.2598536, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 02:13:59.354657 | orchestrator | changed: [testbed-node-1] => (item={'path': '/etc/pam.d/sshd', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2133, 'inode': 567, 'dev': 2049, 'nlink': 1, 'atime': 1777340842.659046, 'mtime': 1740432309.0, 'ctime': 1743685035.2598536, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 02:14:04.759187 | orchestrator | changed: [testbed-node-4] => (item={'path': '/etc/pam.d/sshd', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2133, 'inode': 567, 'dev': 2049, 'nlink': 1, 'atime': 1777340849.6726959, 'mtime': 1740432309.0, 'ctime': 1743685035.2598536, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 02:14:04.759299 | orchestrator | changed: [testbed-node-0] => (item={'path': '/etc/pam.d/sshd', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2133, 'inode': 567, 'dev': 2049, 'nlink': 1, 'atime': 1777340853.0009465, 'mtime': 1740432309.0, 'ctime': 1743685035.2598536, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 02:14:04.759317 | orchestrator | changed: [testbed-node-2] => (item={'path': '/etc/pam.d/sshd', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2133, 'inode': 567, 'dev': 2049, 'nlink': 1, 'atime': 1777340852.3527699, 'mtime': 1740432309.0, 'ctime': 1743685035.2598536, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 02:14:04.759351 | orchestrator | changed: [testbed-node-3] => (item={'path': '/etc/pam.d/login', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 4118, 'inode': 554, 'dev': 2049, 'nlink': 1, 'atime': 1743684808.8363404, 'mtime': 1712646062.0, 'ctime': 1743685035.2588537, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 02:14:04.759423 | orchestrator | changed: [testbed-node-1] => (item={'path': '/etc/pam.d/login', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 4118, 'inode': 554, 'dev': 2049, 'nlink': 1, 'atime': 1743684808.8363404, 'mtime': 1712646062.0, 'ctime': 1743685035.2588537, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 02:14:04.759439 | orchestrator | changed: [testbed-node-5] => (item={'path': '/etc/pam.d/login', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 4118, 'inode': 554, 'dev': 2049, 'nlink': 1, 'atime': 1743684808.8363404, 'mtime': 1712646062.0, 'ctime': 1743685035.2588537, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 02:14:04.759452 | orchestrator | changed: [testbed-node-4] => (item={'path': '/etc/pam.d/login', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 4118, 'inode': 554, 'dev': 2049, 'nlink': 1, 'atime': 1743684808.8363404, 'mtime': 1712646062.0, 'ctime': 1743685035.2588537, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 02:14:04.759490 | orchestrator | changed: [testbed-node-0] => (item={'path': '/etc/pam.d/login', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 4118, 'inode': 554, 'dev': 2049, 'nlink': 1, 'atime': 1743684808.8363404, 'mtime': 1712646062.0, 'ctime': 1743685035.2588537, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 02:14:04.759503 | orchestrator | changed: [testbed-node-2] => (item={'path': '/etc/pam.d/login', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 4118, 'inode': 554, 'dev': 2049, 'nlink': 1, 'atime': 1743684808.8363404, 'mtime': 1712646062.0, 'ctime': 1743685035.2588537, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 02:14:04.759514 | orchestrator | changed: [testbed-manager] => (item={'path': '/etc/pam.d/login', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 4118, 'inode': 554, 'dev': 2049, 'nlink': 1, 'atime': 1743684808.8363404, 'mtime': 1712646062.0, 'ctime': 1743685035.2588537, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 02:14:04.759534 | orchestrator | 2026-04-28 02:14:04.759547 | orchestrator | TASK [osism.commons.motd : Copy motd file] ************************************* 2026-04-28 02:14:04.759561 | orchestrator | Tuesday 28 April 2026 02:13:59 +0000 (0:00:00.946) 0:03:56.299 ********* 2026-04-28 02:14:04.759572 | orchestrator | changed: [testbed-manager] 2026-04-28 02:14:04.759584 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:14:04.759593 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:14:04.759605 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:14:04.759616 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:14:04.759627 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:14:04.759639 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:14:04.759650 | orchestrator | 2026-04-28 02:14:04.759661 | orchestrator | TASK [osism.commons.motd : Copy issue file] ************************************ 2026-04-28 02:14:04.759673 | orchestrator | Tuesday 28 April 2026 02:14:00 +0000 (0:00:01.185) 0:03:57.484 ********* 2026-04-28 02:14:04.759684 | orchestrator | changed: [testbed-manager] 2026-04-28 02:14:04.759694 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:14:04.759704 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:14:04.759715 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:14:04.759726 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:14:04.759737 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:14:04.759748 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:14:04.759760 | orchestrator | 2026-04-28 02:14:04.759777 | orchestrator | TASK [osism.commons.motd : Copy issue.net file] ******************************** 2026-04-28 02:14:04.759787 | orchestrator | Tuesday 28 April 2026 02:14:01 +0000 (0:00:01.193) 0:03:58.677 ********* 2026-04-28 02:14:04.759797 | orchestrator | changed: [testbed-manager] 2026-04-28 02:14:04.759807 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:14:04.759817 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:14:04.759828 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:14:04.759839 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:14:04.759850 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:14:04.759862 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:14:04.759919 | orchestrator | 2026-04-28 02:14:04.759932 | orchestrator | TASK [osism.commons.motd : Configure SSH to print the motd] ******************** 2026-04-28 02:14:04.759943 | orchestrator | Tuesday 28 April 2026 02:14:02 +0000 (0:00:01.226) 0:03:59.904 ********* 2026-04-28 02:14:04.759954 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:14:04.759965 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:14:04.759976 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:14:04.759987 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:14:04.759998 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:14:04.760007 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:14:04.760016 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:14:04.760025 | orchestrator | 2026-04-28 02:14:04.760036 | orchestrator | TASK [osism.commons.motd : Configure SSH to not print the motd] **************** 2026-04-28 02:14:04.760046 | orchestrator | Tuesday 28 April 2026 02:14:03 +0000 (0:00:00.337) 0:04:00.242 ********* 2026-04-28 02:14:04.760057 | orchestrator | ok: [testbed-manager] 2026-04-28 02:14:04.760068 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:14:04.760079 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:14:04.760090 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:14:04.760101 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:14:04.760111 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:14:04.760121 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:14:04.760130 | orchestrator | 2026-04-28 02:14:04.760140 | orchestrator | TASK [osism.services.rng : Include distribution specific install tasks] ******** 2026-04-28 02:14:04.760151 | orchestrator | Tuesday 28 April 2026 02:14:04 +0000 (0:00:00.940) 0:04:01.183 ********* 2026-04-28 02:14:04.760163 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/rng/tasks/install-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:14:04.760186 | orchestrator | 2026-04-28 02:14:04.760197 | orchestrator | TASK [osism.services.rng : Install rng package] ******************************** 2026-04-28 02:14:04.760217 | orchestrator | Tuesday 28 April 2026 02:14:04 +0000 (0:00:00.524) 0:04:01.707 ********* 2026-04-28 02:15:27.089416 | orchestrator | ok: [testbed-manager] 2026-04-28 02:15:27.089620 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:15:27.089652 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:15:27.089671 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:15:27.089689 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:15:27.089706 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:15:27.089723 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:15:27.089741 | orchestrator | 2026-04-28 02:15:27.089760 | orchestrator | TASK [osism.services.rng : Remove haveged package] ***************************** 2026-04-28 02:15:27.089779 | orchestrator | Tuesday 28 April 2026 02:14:13 +0000 (0:00:08.502) 0:04:10.209 ********* 2026-04-28 02:15:27.089796 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:15:27.089814 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:15:27.089832 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:15:27.089849 | orchestrator | ok: [testbed-manager] 2026-04-28 02:15:27.089865 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:15:27.089881 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:15:27.089898 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:15:27.089915 | orchestrator | 2026-04-28 02:15:27.089957 | orchestrator | TASK [osism.services.rng : Manage rng service] ********************************* 2026-04-28 02:15:27.089976 | orchestrator | Tuesday 28 April 2026 02:14:14 +0000 (0:00:01.275) 0:04:11.485 ********* 2026-04-28 02:15:27.089995 | orchestrator | ok: [testbed-manager] 2026-04-28 02:15:27.090131 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:15:27.090164 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:15:27.090185 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:15:27.090206 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:15:27.090227 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:15:27.090248 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:15:27.090269 | orchestrator | 2026-04-28 02:15:27.090291 | orchestrator | TASK [osism.commons.cleanup : Gather variables for each operating system] ****** 2026-04-28 02:15:27.090312 | orchestrator | Tuesday 28 April 2026 02:14:15 +0000 (0:00:01.170) 0:04:12.656 ********* 2026-04-28 02:15:27.090332 | orchestrator | ok: [testbed-manager] 2026-04-28 02:15:27.090352 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:15:27.090373 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:15:27.090395 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:15:27.090417 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:15:27.090437 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:15:27.090455 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:15:27.090474 | orchestrator | 2026-04-28 02:15:27.090540 | orchestrator | TASK [osism.commons.cleanup : Set cleanup_packages_distribution variable to default value] *** 2026-04-28 02:15:27.090563 | orchestrator | Tuesday 28 April 2026 02:14:16 +0000 (0:00:00.339) 0:04:12.995 ********* 2026-04-28 02:15:27.090581 | orchestrator | ok: [testbed-manager] 2026-04-28 02:15:27.090602 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:15:27.090621 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:15:27.090643 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:15:27.090663 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:15:27.090682 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:15:27.090702 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:15:27.090721 | orchestrator | 2026-04-28 02:15:27.090741 | orchestrator | TASK [osism.commons.cleanup : Set cleanup_services_distribution variable to default value] *** 2026-04-28 02:15:27.090762 | orchestrator | Tuesday 28 April 2026 02:14:16 +0000 (0:00:00.376) 0:04:13.372 ********* 2026-04-28 02:15:27.090782 | orchestrator | ok: [testbed-manager] 2026-04-28 02:15:27.090799 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:15:27.090818 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:15:27.090879 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:15:27.090898 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:15:27.090917 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:15:27.090936 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:15:27.090954 | orchestrator | 2026-04-28 02:15:27.090974 | orchestrator | TASK [osism.commons.cleanup : Populate service facts] ************************** 2026-04-28 02:15:27.090993 | orchestrator | Tuesday 28 April 2026 02:14:16 +0000 (0:00:00.330) 0:04:13.703 ********* 2026-04-28 02:15:27.091011 | orchestrator | ok: [testbed-manager] 2026-04-28 02:15:27.091029 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:15:27.091048 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:15:27.091067 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:15:27.091086 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:15:27.091105 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:15:27.091124 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:15:27.091143 | orchestrator | 2026-04-28 02:15:27.091161 | orchestrator | TASK [osism.commons.cleanup : Include distribution specific timer tasks] ******* 2026-04-28 02:15:27.091178 | orchestrator | Tuesday 28 April 2026 02:14:22 +0000 (0:00:05.910) 0:04:19.613 ********* 2026-04-28 02:15:27.091198 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/cleanup/tasks/timers-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:15:27.091219 | orchestrator | 2026-04-28 02:15:27.091236 | orchestrator | TASK [osism.commons.cleanup : Disable apt-daily timers] ************************ 2026-04-28 02:15:27.091255 | orchestrator | Tuesday 28 April 2026 02:14:23 +0000 (0:00:00.460) 0:04:20.074 ********* 2026-04-28 02:15:27.091273 | orchestrator | skipping: [testbed-manager] => (item=apt-daily-upgrade)  2026-04-28 02:15:27.091290 | orchestrator | skipping: [testbed-manager] => (item=apt-daily)  2026-04-28 02:15:27.091309 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:15:27.091329 | orchestrator | skipping: [testbed-node-3] => (item=apt-daily-upgrade)  2026-04-28 02:15:27.091346 | orchestrator | skipping: [testbed-node-3] => (item=apt-daily)  2026-04-28 02:15:27.091364 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:15:27.091406 | orchestrator | skipping: [testbed-node-4] => (item=apt-daily-upgrade)  2026-04-28 02:15:27.091426 | orchestrator | skipping: [testbed-node-4] => (item=apt-daily)  2026-04-28 02:15:27.091445 | orchestrator | skipping: [testbed-node-5] => (item=apt-daily-upgrade)  2026-04-28 02:15:27.091463 | orchestrator | skipping: [testbed-node-5] => (item=apt-daily)  2026-04-28 02:15:27.091482 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:15:27.091593 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:15:27.091612 | orchestrator | skipping: [testbed-node-0] => (item=apt-daily-upgrade)  2026-04-28 02:15:27.091646 | orchestrator | skipping: [testbed-node-0] => (item=apt-daily)  2026-04-28 02:15:27.091667 | orchestrator | skipping: [testbed-node-1] => (item=apt-daily-upgrade)  2026-04-28 02:15:27.091685 | orchestrator | skipping: [testbed-node-1] => (item=apt-daily)  2026-04-28 02:15:27.091737 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:15:27.091756 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:15:27.091774 | orchestrator | skipping: [testbed-node-2] => (item=apt-daily-upgrade)  2026-04-28 02:15:27.091792 | orchestrator | skipping: [testbed-node-2] => (item=apt-daily)  2026-04-28 02:15:27.091811 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:15:27.091829 | orchestrator | 2026-04-28 02:15:27.091847 | orchestrator | TASK [osism.commons.cleanup : Include service tasks] *************************** 2026-04-28 02:15:27.091866 | orchestrator | Tuesday 28 April 2026 02:14:23 +0000 (0:00:00.417) 0:04:20.492 ********* 2026-04-28 02:15:27.091887 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/cleanup/tasks/services-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:15:27.091907 | orchestrator | 2026-04-28 02:15:27.091928 | orchestrator | TASK [osism.commons.cleanup : Cleanup services] ******************************** 2026-04-28 02:15:27.091966 | orchestrator | Tuesday 28 April 2026 02:14:23 +0000 (0:00:00.463) 0:04:20.956 ********* 2026-04-28 02:15:27.091984 | orchestrator | skipping: [testbed-manager] => (item=ModemManager.service)  2026-04-28 02:15:27.092002 | orchestrator | skipping: [testbed-node-3] => (item=ModemManager.service)  2026-04-28 02:15:27.092020 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:15:27.092037 | orchestrator | skipping: [testbed-node-4] => (item=ModemManager.service)  2026-04-28 02:15:27.092055 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:15:27.092073 | orchestrator | skipping: [testbed-node-5] => (item=ModemManager.service)  2026-04-28 02:15:27.092090 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:15:27.092108 | orchestrator | skipping: [testbed-node-0] => (item=ModemManager.service)  2026-04-28 02:15:27.092123 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:15:27.092138 | orchestrator | skipping: [testbed-node-1] => (item=ModemManager.service)  2026-04-28 02:15:27.092154 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:15:27.092170 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:15:27.092186 | orchestrator | skipping: [testbed-node-2] => (item=ModemManager.service)  2026-04-28 02:15:27.092202 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:15:27.092219 | orchestrator | 2026-04-28 02:15:27.092238 | orchestrator | TASK [osism.commons.cleanup : Include packages tasks] ************************** 2026-04-28 02:15:27.092256 | orchestrator | Tuesday 28 April 2026 02:14:24 +0000 (0:00:00.396) 0:04:21.352 ********* 2026-04-28 02:15:27.092274 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/cleanup/tasks/packages-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:15:27.092291 | orchestrator | 2026-04-28 02:15:27.092306 | orchestrator | TASK [osism.commons.cleanup : Cleanup installed packages] ********************** 2026-04-28 02:15:27.092322 | orchestrator | Tuesday 28 April 2026 02:14:24 +0000 (0:00:00.497) 0:04:21.850 ********* 2026-04-28 02:15:27.092337 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:15:27.092354 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:15:27.092370 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:15:27.092398 | orchestrator | changed: [testbed-manager] 2026-04-28 02:15:27.092415 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:15:27.092431 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:15:27.092447 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:15:27.092463 | orchestrator | 2026-04-28 02:15:27.092478 | orchestrator | TASK [osism.commons.cleanup : Remove cloudinit package] ************************ 2026-04-28 02:15:27.092560 | orchestrator | Tuesday 28 April 2026 02:15:00 +0000 (0:00:35.701) 0:04:57.551 ********* 2026-04-28 02:15:27.092575 | orchestrator | changed: [testbed-manager] 2026-04-28 02:15:27.092585 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:15:27.092594 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:15:27.092630 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:15:27.092647 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:15:27.092663 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:15:27.092681 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:15:27.092715 | orchestrator | 2026-04-28 02:15:27.092730 | orchestrator | TASK [osism.commons.cleanup : Uninstall unattended-upgrades package] *********** 2026-04-28 02:15:27.092747 | orchestrator | Tuesday 28 April 2026 02:15:09 +0000 (0:00:08.895) 0:05:06.447 ********* 2026-04-28 02:15:27.092765 | orchestrator | changed: [testbed-manager] 2026-04-28 02:15:27.092781 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:15:27.092791 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:15:27.092805 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:15:27.092823 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:15:27.092840 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:15:27.092858 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:15:27.092875 | orchestrator | 2026-04-28 02:15:27.092893 | orchestrator | TASK [osism.commons.cleanup : Remove useless packages from the cache] ********** 2026-04-28 02:15:27.092927 | orchestrator | Tuesday 28 April 2026 02:15:18 +0000 (0:00:08.846) 0:05:15.294 ********* 2026-04-28 02:15:27.092945 | orchestrator | ok: [testbed-manager] 2026-04-28 02:15:27.092961 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:15:27.092978 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:15:27.092995 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:15:27.093011 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:15:27.093030 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:15:27.093054 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:15:27.093069 | orchestrator | 2026-04-28 02:15:27.093085 | orchestrator | TASK [osism.commons.cleanup : Remove dependencies that are no longer required] *** 2026-04-28 02:15:27.093101 | orchestrator | Tuesday 28 April 2026 02:15:20 +0000 (0:00:02.119) 0:05:17.413 ********* 2026-04-28 02:15:27.093117 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:15:27.093131 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:15:27.093148 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:15:27.093164 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:15:27.093179 | orchestrator | changed: [testbed-manager] 2026-04-28 02:15:27.093214 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:15:27.093231 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:15:27.093248 | orchestrator | 2026-04-28 02:15:27.093287 | orchestrator | TASK [osism.commons.cleanup : Include cloudinit tasks] ************************* 2026-04-28 02:15:39.476106 | orchestrator | Tuesday 28 April 2026 02:15:27 +0000 (0:00:06.619) 0:05:24.033 ********* 2026-04-28 02:15:39.476242 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/cleanup/tasks/cloudinit.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:15:39.476263 | orchestrator | 2026-04-28 02:15:39.476276 | orchestrator | TASK [osism.commons.cleanup : Remove cloud-init configuration directory] ******* 2026-04-28 02:15:39.476288 | orchestrator | Tuesday 28 April 2026 02:15:27 +0000 (0:00:00.463) 0:05:24.497 ********* 2026-04-28 02:15:39.476299 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:15:39.476311 | orchestrator | changed: [testbed-manager] 2026-04-28 02:15:39.476323 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:15:39.476334 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:15:39.476344 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:15:39.476355 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:15:39.476366 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:15:39.476377 | orchestrator | 2026-04-28 02:15:39.476388 | orchestrator | TASK [osism.commons.timezone : Install tzdata package] ************************* 2026-04-28 02:15:39.476399 | orchestrator | Tuesday 28 April 2026 02:15:28 +0000 (0:00:00.874) 0:05:25.372 ********* 2026-04-28 02:15:39.476410 | orchestrator | ok: [testbed-manager] 2026-04-28 02:15:39.476422 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:15:39.476432 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:15:39.476443 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:15:39.476454 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:15:39.476464 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:15:39.476475 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:15:39.476486 | orchestrator | 2026-04-28 02:15:39.476542 | orchestrator | TASK [osism.commons.timezone : Set timezone to UTC] **************************** 2026-04-28 02:15:39.476555 | orchestrator | Tuesday 28 April 2026 02:15:30 +0000 (0:00:02.078) 0:05:27.451 ********* 2026-04-28 02:15:39.476566 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:15:39.476577 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:15:39.476588 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:15:39.476598 | orchestrator | changed: [testbed-manager] 2026-04-28 02:15:39.476610 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:15:39.476620 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:15:39.476631 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:15:39.476642 | orchestrator | 2026-04-28 02:15:39.476653 | orchestrator | TASK [osism.commons.timezone : Create /etc/adjtime file] *********************** 2026-04-28 02:15:39.476688 | orchestrator | Tuesday 28 April 2026 02:15:31 +0000 (0:00:00.822) 0:05:28.273 ********* 2026-04-28 02:15:39.476735 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:15:39.476747 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:15:39.476763 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:15:39.476781 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:15:39.476798 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:15:39.476815 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:15:39.476835 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:15:39.476848 | orchestrator | 2026-04-28 02:15:39.476859 | orchestrator | TASK [osism.commons.timezone : Ensure UTC in /etc/adjtime] ********************* 2026-04-28 02:15:39.476870 | orchestrator | Tuesday 28 April 2026 02:15:31 +0000 (0:00:00.357) 0:05:28.631 ********* 2026-04-28 02:15:39.476881 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:15:39.476892 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:15:39.476918 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:15:39.476929 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:15:39.476940 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:15:39.476951 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:15:39.476961 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:15:39.476972 | orchestrator | 2026-04-28 02:15:39.476983 | orchestrator | TASK [osism.services.docker : Gather variables for each operating system] ****** 2026-04-28 02:15:39.476994 | orchestrator | Tuesday 28 April 2026 02:15:32 +0000 (0:00:00.481) 0:05:29.113 ********* 2026-04-28 02:15:39.477004 | orchestrator | ok: [testbed-manager] 2026-04-28 02:15:39.477015 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:15:39.477026 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:15:39.477037 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:15:39.477048 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:15:39.477058 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:15:39.477069 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:15:39.477080 | orchestrator | 2026-04-28 02:15:39.477090 | orchestrator | TASK [osism.services.docker : Set docker_version variable to default value] **** 2026-04-28 02:15:39.477101 | orchestrator | Tuesday 28 April 2026 02:15:32 +0000 (0:00:00.362) 0:05:29.475 ********* 2026-04-28 02:15:39.477112 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:15:39.477123 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:15:39.477133 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:15:39.477144 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:15:39.477155 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:15:39.477165 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:15:39.477176 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:15:39.477186 | orchestrator | 2026-04-28 02:15:39.477197 | orchestrator | TASK [osism.services.docker : Set docker_cli_version variable to default value] *** 2026-04-28 02:15:39.477209 | orchestrator | Tuesday 28 April 2026 02:15:32 +0000 (0:00:00.327) 0:05:29.803 ********* 2026-04-28 02:15:39.477220 | orchestrator | ok: [testbed-manager] 2026-04-28 02:15:39.477231 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:15:39.477241 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:15:39.477252 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:15:39.477263 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:15:39.477273 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:15:39.477284 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:15:39.477295 | orchestrator | 2026-04-28 02:15:39.477306 | orchestrator | TASK [osism.services.docker : Print used docker version] *********************** 2026-04-28 02:15:39.477317 | orchestrator | Tuesday 28 April 2026 02:15:33 +0000 (0:00:00.322) 0:05:30.125 ********* 2026-04-28 02:15:39.477328 | orchestrator | ok: [testbed-manager] =>  2026-04-28 02:15:39.477338 | orchestrator |  docker_version: 5:27.5.1 2026-04-28 02:15:39.477349 | orchestrator | ok: [testbed-node-3] =>  2026-04-28 02:15:39.477360 | orchestrator |  docker_version: 5:27.5.1 2026-04-28 02:15:39.477371 | orchestrator | ok: [testbed-node-4] =>  2026-04-28 02:15:39.477381 | orchestrator |  docker_version: 5:27.5.1 2026-04-28 02:15:39.477392 | orchestrator | ok: [testbed-node-5] =>  2026-04-28 02:15:39.477403 | orchestrator |  docker_version: 5:27.5.1 2026-04-28 02:15:39.477443 | orchestrator | ok: [testbed-node-0] =>  2026-04-28 02:15:39.477455 | orchestrator |  docker_version: 5:27.5.1 2026-04-28 02:15:39.477466 | orchestrator | ok: [testbed-node-1] =>  2026-04-28 02:15:39.477477 | orchestrator |  docker_version: 5:27.5.1 2026-04-28 02:15:39.477487 | orchestrator | ok: [testbed-node-2] =>  2026-04-28 02:15:39.477525 | orchestrator |  docker_version: 5:27.5.1 2026-04-28 02:15:39.477537 | orchestrator | 2026-04-28 02:15:39.477548 | orchestrator | TASK [osism.services.docker : Print used docker cli version] ******************* 2026-04-28 02:15:39.477559 | orchestrator | Tuesday 28 April 2026 02:15:33 +0000 (0:00:00.290) 0:05:30.416 ********* 2026-04-28 02:15:39.477570 | orchestrator | ok: [testbed-manager] =>  2026-04-28 02:15:39.477581 | orchestrator |  docker_cli_version: 5:27.5.1 2026-04-28 02:15:39.477591 | orchestrator | ok: [testbed-node-3] =>  2026-04-28 02:15:39.477602 | orchestrator |  docker_cli_version: 5:27.5.1 2026-04-28 02:15:39.477613 | orchestrator | ok: [testbed-node-4] =>  2026-04-28 02:15:39.477623 | orchestrator |  docker_cli_version: 5:27.5.1 2026-04-28 02:15:39.477634 | orchestrator | ok: [testbed-node-5] =>  2026-04-28 02:15:39.477645 | orchestrator |  docker_cli_version: 5:27.5.1 2026-04-28 02:15:39.477655 | orchestrator | ok: [testbed-node-0] =>  2026-04-28 02:15:39.477666 | orchestrator |  docker_cli_version: 5:27.5.1 2026-04-28 02:15:39.477676 | orchestrator | ok: [testbed-node-1] =>  2026-04-28 02:15:39.477687 | orchestrator |  docker_cli_version: 5:27.5.1 2026-04-28 02:15:39.477698 | orchestrator | ok: [testbed-node-2] =>  2026-04-28 02:15:39.477709 | orchestrator |  docker_cli_version: 5:27.5.1 2026-04-28 02:15:39.477719 | orchestrator | 2026-04-28 02:15:39.477730 | orchestrator | TASK [osism.services.docker : Include block storage tasks] ********************* 2026-04-28 02:15:39.477741 | orchestrator | Tuesday 28 April 2026 02:15:33 +0000 (0:00:00.339) 0:05:30.755 ********* 2026-04-28 02:15:39.477752 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:15:39.477770 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:15:39.477788 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:15:39.477807 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:15:39.477824 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:15:39.477843 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:15:39.477862 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:15:39.477881 | orchestrator | 2026-04-28 02:15:39.477912 | orchestrator | TASK [osism.services.docker : Include zram storage tasks] ********************** 2026-04-28 02:15:39.477924 | orchestrator | Tuesday 28 April 2026 02:15:34 +0000 (0:00:00.310) 0:05:31.066 ********* 2026-04-28 02:15:39.477934 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:15:39.477945 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:15:39.477956 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:15:39.477966 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:15:39.477977 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:15:39.477988 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:15:39.477998 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:15:39.478009 | orchestrator | 2026-04-28 02:15:39.478079 | orchestrator | TASK [osism.services.docker : Include docker install tasks] ******************** 2026-04-28 02:15:39.478092 | orchestrator | Tuesday 28 April 2026 02:15:34 +0000 (0:00:00.315) 0:05:31.382 ********* 2026-04-28 02:15:39.478105 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/docker/tasks/install-docker-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:15:39.478118 | orchestrator | 2026-04-28 02:15:39.478136 | orchestrator | TASK [osism.services.docker : Remove old architecture-dependent repository] **** 2026-04-28 02:15:39.478147 | orchestrator | Tuesday 28 April 2026 02:15:34 +0000 (0:00:00.487) 0:05:31.870 ********* 2026-04-28 02:15:39.478158 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:15:39.478169 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:15:39.478180 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:15:39.478191 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:15:39.478210 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:15:39.478221 | orchestrator | ok: [testbed-manager] 2026-04-28 02:15:39.478231 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:15:39.478242 | orchestrator | 2026-04-28 02:15:39.478253 | orchestrator | TASK [osism.services.docker : Gather package facts] **************************** 2026-04-28 02:15:39.478264 | orchestrator | Tuesday 28 April 2026 02:15:35 +0000 (0:00:01.032) 0:05:32.902 ********* 2026-04-28 02:15:39.478275 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:15:39.478286 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:15:39.478296 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:15:39.478307 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:15:39.478318 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:15:39.478328 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:15:39.478339 | orchestrator | ok: [testbed-manager] 2026-04-28 02:15:39.478350 | orchestrator | 2026-04-28 02:15:39.478361 | orchestrator | TASK [osism.services.docker : Check whether packages are installed that should not be installed] *** 2026-04-28 02:15:39.478373 | orchestrator | Tuesday 28 April 2026 02:15:39 +0000 (0:00:03.072) 0:05:35.974 ********* 2026-04-28 02:15:39.478384 | orchestrator | skipping: [testbed-manager] => (item=containerd)  2026-04-28 02:15:39.478395 | orchestrator | skipping: [testbed-manager] => (item=docker.io)  2026-04-28 02:15:39.478406 | orchestrator | skipping: [testbed-manager] => (item=docker-engine)  2026-04-28 02:15:39.478417 | orchestrator | skipping: [testbed-node-3] => (item=containerd)  2026-04-28 02:15:39.478428 | orchestrator | skipping: [testbed-node-3] => (item=docker.io)  2026-04-28 02:15:39.478439 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:15:39.478450 | orchestrator | skipping: [testbed-node-3] => (item=docker-engine)  2026-04-28 02:15:39.478461 | orchestrator | skipping: [testbed-node-4] => (item=containerd)  2026-04-28 02:15:39.478471 | orchestrator | skipping: [testbed-node-4] => (item=docker.io)  2026-04-28 02:15:39.478482 | orchestrator | skipping: [testbed-node-4] => (item=docker-engine)  2026-04-28 02:15:39.478493 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:15:39.478546 | orchestrator | skipping: [testbed-node-5] => (item=containerd)  2026-04-28 02:15:39.478556 | orchestrator | skipping: [testbed-node-5] => (item=docker.io)  2026-04-28 02:15:39.478567 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:15:39.478578 | orchestrator | skipping: [testbed-node-5] => (item=docker-engine)  2026-04-28 02:15:39.478589 | orchestrator | skipping: [testbed-node-0] => (item=containerd)  2026-04-28 02:15:39.478611 | orchestrator | skipping: [testbed-node-0] => (item=docker.io)  2026-04-28 02:16:45.800967 | orchestrator | skipping: [testbed-node-0] => (item=docker-engine)  2026-04-28 02:16:45.801076 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:16:45.801094 | orchestrator | skipping: [testbed-node-1] => (item=containerd)  2026-04-28 02:16:45.801105 | orchestrator | skipping: [testbed-node-1] => (item=docker.io)  2026-04-28 02:16:45.801114 | orchestrator | skipping: [testbed-node-1] => (item=docker-engine)  2026-04-28 02:16:45.801124 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:16:45.801134 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:16:45.801143 | orchestrator | skipping: [testbed-node-2] => (item=containerd)  2026-04-28 02:16:45.801153 | orchestrator | skipping: [testbed-node-2] => (item=docker.io)  2026-04-28 02:16:45.801163 | orchestrator | skipping: [testbed-node-2] => (item=docker-engine)  2026-04-28 02:16:45.801173 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:16:45.801183 | orchestrator | 2026-04-28 02:16:45.801194 | orchestrator | TASK [osism.services.docker : Install apt-transport-https package] ************* 2026-04-28 02:16:45.801206 | orchestrator | Tuesday 28 April 2026 02:15:39 +0000 (0:00:00.691) 0:05:36.665 ********* 2026-04-28 02:16:45.801215 | orchestrator | ok: [testbed-manager] 2026-04-28 02:16:45.801225 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:16:45.801235 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:16:45.801245 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:16:45.801255 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:16:45.801264 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:16:45.801301 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:16:45.801312 | orchestrator | 2026-04-28 02:16:45.801322 | orchestrator | TASK [osism.services.docker : Add repository gpg key] ************************** 2026-04-28 02:16:45.801332 | orchestrator | Tuesday 28 April 2026 02:15:47 +0000 (0:00:07.995) 0:05:44.660 ********* 2026-04-28 02:16:45.801342 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:16:45.801351 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:16:45.801361 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:16:45.801370 | orchestrator | ok: [testbed-manager] 2026-04-28 02:16:45.801380 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:16:45.801389 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:16:45.801399 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:16:45.801408 | orchestrator | 2026-04-28 02:16:45.801418 | orchestrator | TASK [osism.services.docker : Add repository] ********************************** 2026-04-28 02:16:45.801429 | orchestrator | Tuesday 28 April 2026 02:15:48 +0000 (0:00:01.133) 0:05:45.794 ********* 2026-04-28 02:16:45.801446 | orchestrator | ok: [testbed-manager] 2026-04-28 02:16:45.801462 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:16:45.801479 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:16:45.801495 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:16:45.801541 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:16:45.801559 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:16:45.801574 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:16:45.801590 | orchestrator | 2026-04-28 02:16:45.801607 | orchestrator | TASK [osism.services.docker : Update package cache] **************************** 2026-04-28 02:16:45.801625 | orchestrator | Tuesday 28 April 2026 02:15:58 +0000 (0:00:09.180) 0:05:54.975 ********* 2026-04-28 02:16:45.801643 | orchestrator | changed: [testbed-manager] 2026-04-28 02:16:45.801660 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:16:45.801675 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:16:45.801691 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:16:45.801702 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:16:45.801712 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:16:45.801721 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:16:45.801730 | orchestrator | 2026-04-28 02:16:45.801740 | orchestrator | TASK [osism.services.docker : Pin docker package version] ********************** 2026-04-28 02:16:45.801750 | orchestrator | Tuesday 28 April 2026 02:16:01 +0000 (0:00:03.702) 0:05:58.678 ********* 2026-04-28 02:16:45.801759 | orchestrator | ok: [testbed-manager] 2026-04-28 02:16:45.801769 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:16:45.801778 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:16:45.801788 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:16:45.801797 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:16:45.801807 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:16:45.801816 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:16:45.801826 | orchestrator | 2026-04-28 02:16:45.801835 | orchestrator | TASK [osism.services.docker : Pin docker-cli package version] ****************** 2026-04-28 02:16:45.801845 | orchestrator | Tuesday 28 April 2026 02:16:03 +0000 (0:00:01.547) 0:06:00.225 ********* 2026-04-28 02:16:45.801855 | orchestrator | ok: [testbed-manager] 2026-04-28 02:16:45.801864 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:16:45.801874 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:16:45.801883 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:16:45.801893 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:16:45.801902 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:16:45.801912 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:16:45.801921 | orchestrator | 2026-04-28 02:16:45.801931 | orchestrator | TASK [osism.services.docker : Unlock containerd package] *********************** 2026-04-28 02:16:45.801941 | orchestrator | Tuesday 28 April 2026 02:16:05 +0000 (0:00:01.763) 0:06:01.988 ********* 2026-04-28 02:16:45.801950 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:16:45.801960 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:16:45.801969 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:16:45.801989 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:16:45.801998 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:16:45.802007 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:16:45.802066 | orchestrator | changed: [testbed-manager] 2026-04-28 02:16:45.802079 | orchestrator | 2026-04-28 02:16:45.802089 | orchestrator | TASK [osism.services.docker : Install containerd package] ********************** 2026-04-28 02:16:45.802099 | orchestrator | Tuesday 28 April 2026 02:16:05 +0000 (0:00:00.643) 0:06:02.631 ********* 2026-04-28 02:16:45.802109 | orchestrator | ok: [testbed-manager] 2026-04-28 02:16:45.802119 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:16:45.802128 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:16:45.802138 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:16:45.802148 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:16:45.802157 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:16:45.802167 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:16:45.802176 | orchestrator | 2026-04-28 02:16:45.802186 | orchestrator | TASK [osism.services.docker : Lock containerd package] ************************* 2026-04-28 02:16:45.802215 | orchestrator | Tuesday 28 April 2026 02:16:15 +0000 (0:00:10.008) 0:06:12.640 ********* 2026-04-28 02:16:45.802225 | orchestrator | changed: [testbed-manager] 2026-04-28 02:16:45.802235 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:16:45.802244 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:16:45.802254 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:16:45.802263 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:16:45.802273 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:16:45.802282 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:16:45.802292 | orchestrator | 2026-04-28 02:16:45.802302 | orchestrator | TASK [osism.services.docker : Install docker-cli package] ********************** 2026-04-28 02:16:45.802313 | orchestrator | Tuesday 28 April 2026 02:16:16 +0000 (0:00:00.965) 0:06:13.605 ********* 2026-04-28 02:16:45.802324 | orchestrator | ok: [testbed-manager] 2026-04-28 02:16:45.802333 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:16:45.802343 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:16:45.802352 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:16:45.802362 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:16:45.802371 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:16:45.802381 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:16:45.802390 | orchestrator | 2026-04-28 02:16:45.802400 | orchestrator | TASK [osism.services.docker : Install docker package] ************************** 2026-04-28 02:16:45.802410 | orchestrator | Tuesday 28 April 2026 02:16:26 +0000 (0:00:09.901) 0:06:23.507 ********* 2026-04-28 02:16:45.802420 | orchestrator | ok: [testbed-manager] 2026-04-28 02:16:45.802429 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:16:45.802439 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:16:45.802448 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:16:45.802458 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:16:45.802468 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:16:45.802478 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:16:45.802487 | orchestrator | 2026-04-28 02:16:45.802497 | orchestrator | TASK [osism.services.docker : Unblock installation of python docker packages] *** 2026-04-28 02:16:45.802506 | orchestrator | Tuesday 28 April 2026 02:16:38 +0000 (0:00:11.783) 0:06:35.290 ********* 2026-04-28 02:16:45.802596 | orchestrator | ok: [testbed-node-3] => (item=python3-docker) 2026-04-28 02:16:45.802607 | orchestrator | ok: [testbed-manager] => (item=python3-docker) 2026-04-28 02:16:45.802616 | orchestrator | ok: [testbed-node-4] => (item=python3-docker) 2026-04-28 02:16:45.802626 | orchestrator | ok: [testbed-node-5] => (item=python3-docker) 2026-04-28 02:16:45.802636 | orchestrator | ok: [testbed-node-0] => (item=python3-docker) 2026-04-28 02:16:45.802656 | orchestrator | ok: [testbed-node-3] => (item=python-docker) 2026-04-28 02:16:45.802666 | orchestrator | ok: [testbed-node-1] => (item=python3-docker) 2026-04-28 02:16:45.802675 | orchestrator | ok: [testbed-manager] => (item=python-docker) 2026-04-28 02:16:45.802685 | orchestrator | ok: [testbed-node-4] => (item=python-docker) 2026-04-28 02:16:45.802703 | orchestrator | ok: [testbed-node-5] => (item=python-docker) 2026-04-28 02:16:45.802712 | orchestrator | ok: [testbed-node-2] => (item=python3-docker) 2026-04-28 02:16:45.802767 | orchestrator | ok: [testbed-node-0] => (item=python-docker) 2026-04-28 02:16:45.802779 | orchestrator | ok: [testbed-node-1] => (item=python-docker) 2026-04-28 02:16:45.802788 | orchestrator | ok: [testbed-node-2] => (item=python-docker) 2026-04-28 02:16:45.802798 | orchestrator | 2026-04-28 02:16:45.802808 | orchestrator | TASK [osism.services.docker : Install python3 docker package] ****************** 2026-04-28 02:16:45.802822 | orchestrator | Tuesday 28 April 2026 02:16:39 +0000 (0:00:01.380) 0:06:36.671 ********* 2026-04-28 02:16:45.802832 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:16:45.802842 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:16:45.802851 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:16:45.802861 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:16:45.802870 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:16:45.802880 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:16:45.802889 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:16:45.802898 | orchestrator | 2026-04-28 02:16:45.802908 | orchestrator | TASK [osism.services.docker : Install python3 docker package from Debian Sid] *** 2026-04-28 02:16:45.802918 | orchestrator | Tuesday 28 April 2026 02:16:40 +0000 (0:00:00.672) 0:06:37.344 ********* 2026-04-28 02:16:45.802927 | orchestrator | ok: [testbed-manager] 2026-04-28 02:16:45.802937 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:16:45.802947 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:16:45.802956 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:16:45.802966 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:16:45.802976 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:16:45.802985 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:16:45.802994 | orchestrator | 2026-04-28 02:16:45.803004 | orchestrator | TASK [osism.services.docker : Remove python docker packages (install python bindings from pip)] *** 2026-04-28 02:16:45.803015 | orchestrator | Tuesday 28 April 2026 02:16:44 +0000 (0:00:04.257) 0:06:41.602 ********* 2026-04-28 02:16:45.803025 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:16:45.803034 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:16:45.803044 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:16:45.803053 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:16:45.803063 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:16:45.803072 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:16:45.803082 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:16:45.803091 | orchestrator | 2026-04-28 02:16:45.803102 | orchestrator | TASK [osism.services.docker : Block installation of python docker packages (install python bindings from pip)] *** 2026-04-28 02:16:45.803112 | orchestrator | Tuesday 28 April 2026 02:16:45 +0000 (0:00:00.616) 0:06:42.219 ********* 2026-04-28 02:16:45.803122 | orchestrator | skipping: [testbed-manager] => (item=python3-docker)  2026-04-28 02:16:45.803132 | orchestrator | skipping: [testbed-manager] => (item=python-docker)  2026-04-28 02:16:45.803141 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:16:45.803151 | orchestrator | skipping: [testbed-node-3] => (item=python3-docker)  2026-04-28 02:16:45.803161 | orchestrator | skipping: [testbed-node-3] => (item=python-docker)  2026-04-28 02:16:45.803170 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:16:45.803180 | orchestrator | skipping: [testbed-node-4] => (item=python3-docker)  2026-04-28 02:16:45.803189 | orchestrator | skipping: [testbed-node-4] => (item=python-docker)  2026-04-28 02:16:45.803199 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:16:45.803218 | orchestrator | skipping: [testbed-node-5] => (item=python3-docker)  2026-04-28 02:17:07.506300 | orchestrator | skipping: [testbed-node-5] => (item=python-docker)  2026-04-28 02:17:07.506381 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:17:07.506388 | orchestrator | skipping: [testbed-node-0] => (item=python3-docker)  2026-04-28 02:17:07.506392 | orchestrator | skipping: [testbed-node-0] => (item=python-docker)  2026-04-28 02:17:07.506425 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:17:07.506429 | orchestrator | skipping: [testbed-node-1] => (item=python3-docker)  2026-04-28 02:17:07.506433 | orchestrator | skipping: [testbed-node-1] => (item=python-docker)  2026-04-28 02:17:07.506437 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:17:07.506441 | orchestrator | skipping: [testbed-node-2] => (item=python3-docker)  2026-04-28 02:17:07.506445 | orchestrator | skipping: [testbed-node-2] => (item=python-docker)  2026-04-28 02:17:07.506449 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:17:07.506453 | orchestrator | 2026-04-28 02:17:07.506459 | orchestrator | TASK [osism.services.docker : Install python3-pip package (install python bindings from pip)] *** 2026-04-28 02:17:07.506464 | orchestrator | Tuesday 28 April 2026 02:16:46 +0000 (0:00:00.862) 0:06:43.081 ********* 2026-04-28 02:17:07.506468 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:17:07.506472 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:17:07.506476 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:17:07.506480 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:17:07.506483 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:17:07.506487 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:17:07.506491 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:17:07.506495 | orchestrator | 2026-04-28 02:17:07.506499 | orchestrator | TASK [osism.services.docker : Install docker packages (install python bindings from pip)] *** 2026-04-28 02:17:07.506503 | orchestrator | Tuesday 28 April 2026 02:16:46 +0000 (0:00:00.586) 0:06:43.668 ********* 2026-04-28 02:17:07.506507 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:17:07.506551 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:17:07.506555 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:17:07.506558 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:17:07.506562 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:17:07.506566 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:17:07.506570 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:17:07.506573 | orchestrator | 2026-04-28 02:17:07.506577 | orchestrator | TASK [osism.services.docker : Install packages required by docker login] ******* 2026-04-28 02:17:07.506581 | orchestrator | Tuesday 28 April 2026 02:16:47 +0000 (0:00:00.575) 0:06:44.244 ********* 2026-04-28 02:17:07.506585 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:17:07.506588 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:17:07.506592 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:17:07.506596 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:17:07.506600 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:17:07.506603 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:17:07.506607 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:17:07.506611 | orchestrator | 2026-04-28 02:17:07.506615 | orchestrator | TASK [osism.services.docker : Ensure that some packages are not installed] ***** 2026-04-28 02:17:07.506618 | orchestrator | Tuesday 28 April 2026 02:16:47 +0000 (0:00:00.611) 0:06:44.855 ********* 2026-04-28 02:17:07.506622 | orchestrator | ok: [testbed-manager] 2026-04-28 02:17:07.506626 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:17:07.506630 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:17:07.506634 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:17:07.506638 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:17:07.506642 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:17:07.506645 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:17:07.506649 | orchestrator | 2026-04-28 02:17:07.506653 | orchestrator | TASK [osism.services.docker : Include config tasks] **************************** 2026-04-28 02:17:07.506657 | orchestrator | Tuesday 28 April 2026 02:16:50 +0000 (0:00:02.174) 0:06:47.030 ********* 2026-04-28 02:17:07.506662 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/docker/tasks/config.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:17:07.506668 | orchestrator | 2026-04-28 02:17:07.506672 | orchestrator | TASK [osism.services.docker : Create plugins directory] ************************ 2026-04-28 02:17:07.506684 | orchestrator | Tuesday 28 April 2026 02:16:51 +0000 (0:00:00.963) 0:06:47.993 ********* 2026-04-28 02:17:07.506688 | orchestrator | ok: [testbed-manager] 2026-04-28 02:17:07.506692 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:17:07.506696 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:17:07.506700 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:17:07.506704 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:17:07.506707 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:17:07.506711 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:17:07.506715 | orchestrator | 2026-04-28 02:17:07.506718 | orchestrator | TASK [osism.services.docker : Create systemd overlay directory] **************** 2026-04-28 02:17:07.506722 | orchestrator | Tuesday 28 April 2026 02:16:51 +0000 (0:00:00.919) 0:06:48.912 ********* 2026-04-28 02:17:07.506726 | orchestrator | ok: [testbed-manager] 2026-04-28 02:17:07.506730 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:17:07.506733 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:17:07.506737 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:17:07.506741 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:17:07.506744 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:17:07.506748 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:17:07.506752 | orchestrator | 2026-04-28 02:17:07.506756 | orchestrator | TASK [osism.services.docker : Copy systemd overlay file] *********************** 2026-04-28 02:17:07.506759 | orchestrator | Tuesday 28 April 2026 02:16:53 +0000 (0:00:01.059) 0:06:49.972 ********* 2026-04-28 02:17:07.506763 | orchestrator | ok: [testbed-manager] 2026-04-28 02:17:07.506767 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:17:07.506771 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:17:07.506774 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:17:07.506778 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:17:07.506782 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:17:07.506785 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:17:07.506789 | orchestrator | 2026-04-28 02:17:07.506793 | orchestrator | TASK [osism.services.docker : Reload systemd daemon if systemd overlay file is changed] *** 2026-04-28 02:17:07.506808 | orchestrator | Tuesday 28 April 2026 02:16:54 +0000 (0:00:01.774) 0:06:51.747 ********* 2026-04-28 02:17:07.506812 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:17:07.506816 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:17:07.506819 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:17:07.506823 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:17:07.506827 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:17:07.506831 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:17:07.506834 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:17:07.506838 | orchestrator | 2026-04-28 02:17:07.506842 | orchestrator | TASK [osism.services.docker : Copy limits configuration file] ****************** 2026-04-28 02:17:07.506846 | orchestrator | Tuesday 28 April 2026 02:16:56 +0000 (0:00:01.473) 0:06:53.221 ********* 2026-04-28 02:17:07.506850 | orchestrator | ok: [testbed-manager] 2026-04-28 02:17:07.506853 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:17:07.506857 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:17:07.506861 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:17:07.506865 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:17:07.506869 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:17:07.506872 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:17:07.506876 | orchestrator | 2026-04-28 02:17:07.506880 | orchestrator | TASK [osism.services.docker : Copy daemon.json configuration file] ************* 2026-04-28 02:17:07.506884 | orchestrator | Tuesday 28 April 2026 02:16:57 +0000 (0:00:01.447) 0:06:54.668 ********* 2026-04-28 02:17:07.506887 | orchestrator | changed: [testbed-manager] 2026-04-28 02:17:07.506891 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:17:07.506895 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:17:07.506899 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:17:07.506902 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:17:07.506906 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:17:07.506910 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:17:07.506918 | orchestrator | 2026-04-28 02:17:07.506922 | orchestrator | TASK [osism.services.docker : Include service tasks] *************************** 2026-04-28 02:17:07.506926 | orchestrator | Tuesday 28 April 2026 02:16:59 +0000 (0:00:01.693) 0:06:56.362 ********* 2026-04-28 02:17:07.506930 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/docker/tasks/service.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:17:07.506933 | orchestrator | 2026-04-28 02:17:07.506937 | orchestrator | TASK [osism.services.docker : Reload systemd daemon] *************************** 2026-04-28 02:17:07.506941 | orchestrator | Tuesday 28 April 2026 02:17:00 +0000 (0:00:01.191) 0:06:57.553 ********* 2026-04-28 02:17:07.506945 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:17:07.506949 | orchestrator | ok: [testbed-manager] 2026-04-28 02:17:07.506952 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:17:07.506956 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:17:07.506960 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:17:07.506964 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:17:07.506968 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:17:07.506971 | orchestrator | 2026-04-28 02:17:07.506975 | orchestrator | TASK [osism.services.docker : Manage service] ********************************** 2026-04-28 02:17:07.506979 | orchestrator | Tuesday 28 April 2026 02:17:02 +0000 (0:00:01.473) 0:06:59.027 ********* 2026-04-28 02:17:07.506983 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:17:07.506987 | orchestrator | ok: [testbed-manager] 2026-04-28 02:17:07.506991 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:17:07.506994 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:17:07.507008 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:17:07.507012 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:17:07.507016 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:17:07.507019 | orchestrator | 2026-04-28 02:17:07.507023 | orchestrator | TASK [osism.services.docker : Manage docker socket service] ******************** 2026-04-28 02:17:07.507027 | orchestrator | Tuesday 28 April 2026 02:17:03 +0000 (0:00:01.264) 0:07:00.291 ********* 2026-04-28 02:17:07.507031 | orchestrator | ok: [testbed-manager] 2026-04-28 02:17:07.507035 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:17:07.507039 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:17:07.507042 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:17:07.507046 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:17:07.507050 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:17:07.507054 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:17:07.507058 | orchestrator | 2026-04-28 02:17:07.507061 | orchestrator | TASK [osism.services.docker : Manage containerd service] *********************** 2026-04-28 02:17:07.507065 | orchestrator | Tuesday 28 April 2026 02:17:04 +0000 (0:00:01.228) 0:07:01.520 ********* 2026-04-28 02:17:07.507069 | orchestrator | ok: [testbed-manager] 2026-04-28 02:17:07.507073 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:17:07.507077 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:17:07.507080 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:17:07.507084 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:17:07.507088 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:17:07.507092 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:17:07.507095 | orchestrator | 2026-04-28 02:17:07.507099 | orchestrator | TASK [osism.services.docker : Include bootstrap tasks] ************************* 2026-04-28 02:17:07.507103 | orchestrator | Tuesday 28 April 2026 02:17:06 +0000 (0:00:01.537) 0:07:03.058 ********* 2026-04-28 02:17:07.507107 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/docker/tasks/bootstrap.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:17:07.507111 | orchestrator | 2026-04-28 02:17:07.507115 | orchestrator | TASK [osism.services.docker : Flush handlers] ********************************** 2026-04-28 02:17:07.507118 | orchestrator | Tuesday 28 April 2026 02:17:07 +0000 (0:00:01.023) 0:07:04.081 ********* 2026-04-28 02:17:07.507122 | orchestrator | 2026-04-28 02:17:07.507126 | orchestrator | TASK [osism.services.docker : Flush handlers] ********************************** 2026-04-28 02:17:07.507133 | orchestrator | Tuesday 28 April 2026 02:17:07 +0000 (0:00:00.054) 0:07:04.135 ********* 2026-04-28 02:17:07.507137 | orchestrator | 2026-04-28 02:17:07.507141 | orchestrator | TASK [osism.services.docker : Flush handlers] ********************************** 2026-04-28 02:17:07.507145 | orchestrator | Tuesday 28 April 2026 02:17:07 +0000 (0:00:00.046) 0:07:04.181 ********* 2026-04-28 02:17:07.507149 | orchestrator | 2026-04-28 02:17:07.507152 | orchestrator | TASK [osism.services.docker : Flush handlers] ********************************** 2026-04-28 02:17:07.507159 | orchestrator | Tuesday 28 April 2026 02:17:07 +0000 (0:00:00.064) 0:07:04.246 ********* 2026-04-28 02:17:33.742670 | orchestrator | 2026-04-28 02:17:33.742795 | orchestrator | TASK [osism.services.docker : Flush handlers] ********************************** 2026-04-28 02:17:33.742814 | orchestrator | Tuesday 28 April 2026 02:17:07 +0000 (0:00:00.046) 0:07:04.293 ********* 2026-04-28 02:17:33.742826 | orchestrator | 2026-04-28 02:17:33.742837 | orchestrator | TASK [osism.services.docker : Flush handlers] ********************************** 2026-04-28 02:17:33.742849 | orchestrator | Tuesday 28 April 2026 02:17:07 +0000 (0:00:00.045) 0:07:04.338 ********* 2026-04-28 02:17:33.742873 | orchestrator | 2026-04-28 02:17:33.742885 | orchestrator | TASK [osism.services.docker : Flush handlers] ********************************** 2026-04-28 02:17:33.742896 | orchestrator | Tuesday 28 April 2026 02:17:07 +0000 (0:00:00.064) 0:07:04.403 ********* 2026-04-28 02:17:33.742907 | orchestrator | 2026-04-28 02:17:33.742918 | orchestrator | RUNNING HANDLER [osism.commons.repository : Force update of package cache] ***** 2026-04-28 02:17:33.742928 | orchestrator | Tuesday 28 April 2026 02:17:07 +0000 (0:00:00.045) 0:07:04.448 ********* 2026-04-28 02:17:33.742940 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:17:33.742952 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:17:33.742963 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:17:33.742974 | orchestrator | 2026-04-28 02:17:33.742986 | orchestrator | RUNNING HANDLER [osism.services.rsyslog : Restart rsyslog service] ************* 2026-04-28 02:17:33.742997 | orchestrator | Tuesday 28 April 2026 02:17:08 +0000 (0:00:01.261) 0:07:05.710 ********* 2026-04-28 02:17:33.743007 | orchestrator | changed: [testbed-manager] 2026-04-28 02:17:33.743026 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:17:33.743049 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:17:33.743078 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:17:33.743097 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:17:33.743116 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:17:33.743138 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:17:33.743155 | orchestrator | 2026-04-28 02:17:33.743174 | orchestrator | RUNNING HANDLER [osism.services.rsyslog : Restart logrotate service] *********** 2026-04-28 02:17:33.743194 | orchestrator | Tuesday 28 April 2026 02:17:10 +0000 (0:00:01.711) 0:07:07.421 ********* 2026-04-28 02:17:33.743212 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:17:33.743232 | orchestrator | changed: [testbed-manager] 2026-04-28 02:17:33.743253 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:17:33.743274 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:17:33.743293 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:17:33.743313 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:17:33.743333 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:17:33.743352 | orchestrator | 2026-04-28 02:17:33.743370 | orchestrator | RUNNING HANDLER [osism.services.docker : Restart docker service] *************** 2026-04-28 02:17:33.743392 | orchestrator | Tuesday 28 April 2026 02:17:11 +0000 (0:00:01.269) 0:07:08.691 ********* 2026-04-28 02:17:33.743413 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:17:33.743433 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:17:33.743454 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:17:33.743476 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:17:33.743497 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:17:33.743604 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:17:33.743619 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:17:33.743631 | orchestrator | 2026-04-28 02:17:33.743642 | orchestrator | RUNNING HANDLER [osism.services.docker : Wait after docker service restart] **** 2026-04-28 02:17:33.743680 | orchestrator | Tuesday 28 April 2026 02:17:14 +0000 (0:00:02.487) 0:07:11.179 ********* 2026-04-28 02:17:33.743710 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:17:33.743722 | orchestrator | 2026-04-28 02:17:33.743733 | orchestrator | TASK [osism.services.docker : Add user to docker group] ************************ 2026-04-28 02:17:33.743744 | orchestrator | Tuesday 28 April 2026 02:17:14 +0000 (0:00:00.111) 0:07:11.290 ********* 2026-04-28 02:17:33.743755 | orchestrator | ok: [testbed-manager] 2026-04-28 02:17:33.743766 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:17:33.743777 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:17:33.743788 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:17:33.743798 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:17:33.743809 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:17:33.743820 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:17:33.743831 | orchestrator | 2026-04-28 02:17:33.743842 | orchestrator | TASK [osism.services.docker : Log into private registry and force re-authorization] *** 2026-04-28 02:17:33.743854 | orchestrator | Tuesday 28 April 2026 02:17:15 +0000 (0:00:01.048) 0:07:12.338 ********* 2026-04-28 02:17:33.743865 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:17:33.743876 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:17:33.743887 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:17:33.743897 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:17:33.743910 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:17:33.743928 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:17:33.743949 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:17:33.743975 | orchestrator | 2026-04-28 02:17:33.743994 | orchestrator | TASK [osism.services.docker : Include facts tasks] ***************************** 2026-04-28 02:17:33.744014 | orchestrator | Tuesday 28 April 2026 02:17:15 +0000 (0:00:00.598) 0:07:12.936 ********* 2026-04-28 02:17:33.744034 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/docker/tasks/facts.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:17:33.744055 | orchestrator | 2026-04-28 02:17:33.744074 | orchestrator | TASK [osism.services.docker : Create facts directory] ************************** 2026-04-28 02:17:33.744086 | orchestrator | Tuesday 28 April 2026 02:17:17 +0000 (0:00:01.293) 0:07:14.230 ********* 2026-04-28 02:17:33.744097 | orchestrator | ok: [testbed-manager] 2026-04-28 02:17:33.744108 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:17:33.744118 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:17:33.744129 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:17:33.744139 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:17:33.744150 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:17:33.744161 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:17:33.744172 | orchestrator | 2026-04-28 02:17:33.744182 | orchestrator | TASK [osism.services.docker : Copy docker fact files] ************************** 2026-04-28 02:17:33.744193 | orchestrator | Tuesday 28 April 2026 02:17:18 +0000 (0:00:00.905) 0:07:15.135 ********* 2026-04-28 02:17:33.744204 | orchestrator | ok: [testbed-manager] => (item=docker_containers) 2026-04-28 02:17:33.744236 | orchestrator | changed: [testbed-node-3] => (item=docker_containers) 2026-04-28 02:17:33.744248 | orchestrator | changed: [testbed-node-4] => (item=docker_containers) 2026-04-28 02:17:33.744264 | orchestrator | changed: [testbed-node-5] => (item=docker_containers) 2026-04-28 02:17:33.744291 | orchestrator | changed: [testbed-node-0] => (item=docker_containers) 2026-04-28 02:17:33.744311 | orchestrator | changed: [testbed-node-1] => (item=docker_containers) 2026-04-28 02:17:33.744329 | orchestrator | changed: [testbed-node-2] => (item=docker_containers) 2026-04-28 02:17:33.744347 | orchestrator | ok: [testbed-manager] => (item=docker_images) 2026-04-28 02:17:33.744366 | orchestrator | changed: [testbed-node-3] => (item=docker_images) 2026-04-28 02:17:33.744384 | orchestrator | changed: [testbed-node-4] => (item=docker_images) 2026-04-28 02:17:33.744402 | orchestrator | changed: [testbed-node-5] => (item=docker_images) 2026-04-28 02:17:33.744419 | orchestrator | changed: [testbed-node-0] => (item=docker_images) 2026-04-28 02:17:33.744452 | orchestrator | changed: [testbed-node-1] => (item=docker_images) 2026-04-28 02:17:33.744470 | orchestrator | changed: [testbed-node-2] => (item=docker_images) 2026-04-28 02:17:33.744485 | orchestrator | 2026-04-28 02:17:33.744496 | orchestrator | TASK [osism.commons.docker_compose : This install type is not supported] ******* 2026-04-28 02:17:33.744507 | orchestrator | Tuesday 28 April 2026 02:17:20 +0000 (0:00:02.597) 0:07:17.733 ********* 2026-04-28 02:17:33.744547 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:17:33.744560 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:17:33.744571 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:17:33.744581 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:17:33.744592 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:17:33.744603 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:17:33.744613 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:17:33.744624 | orchestrator | 2026-04-28 02:17:33.744635 | orchestrator | TASK [osism.commons.docker_compose : Include distribution specific install tasks] *** 2026-04-28 02:17:33.744646 | orchestrator | Tuesday 28 April 2026 02:17:21 +0000 (0:00:00.826) 0:07:18.560 ********* 2026-04-28 02:17:33.744660 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/docker_compose/tasks/install-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:17:33.744673 | orchestrator | 2026-04-28 02:17:33.744684 | orchestrator | TASK [osism.commons.docker_compose : Remove docker-compose apt preferences file] *** 2026-04-28 02:17:33.744694 | orchestrator | Tuesday 28 April 2026 02:17:22 +0000 (0:00:00.926) 0:07:19.486 ********* 2026-04-28 02:17:33.744705 | orchestrator | ok: [testbed-manager] 2026-04-28 02:17:33.744716 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:17:33.744731 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:17:33.744757 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:17:33.744777 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:17:33.744793 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:17:33.744809 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:17:33.744825 | orchestrator | 2026-04-28 02:17:33.744842 | orchestrator | TASK [osism.commons.docker_compose : Get checksum of docker-compose file] ****** 2026-04-28 02:17:33.744869 | orchestrator | Tuesday 28 April 2026 02:17:23 +0000 (0:00:00.915) 0:07:20.401 ********* 2026-04-28 02:17:33.744887 | orchestrator | ok: [testbed-manager] 2026-04-28 02:17:33.744905 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:17:33.744924 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:17:33.744943 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:17:33.744962 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:17:33.744979 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:17:33.744997 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:17:33.745016 | orchestrator | 2026-04-28 02:17:33.745033 | orchestrator | TASK [osism.commons.docker_compose : Remove docker-compose binary] ************* 2026-04-28 02:17:33.745051 | orchestrator | Tuesday 28 April 2026 02:17:24 +0000 (0:00:01.140) 0:07:21.542 ********* 2026-04-28 02:17:33.745069 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:17:33.745084 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:17:33.745100 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:17:33.745118 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:17:33.745135 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:17:33.745152 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:17:33.745169 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:17:33.745186 | orchestrator | 2026-04-28 02:17:33.745202 | orchestrator | TASK [osism.commons.docker_compose : Uninstall docker-compose package] ********* 2026-04-28 02:17:33.745219 | orchestrator | Tuesday 28 April 2026 02:17:25 +0000 (0:00:00.567) 0:07:22.109 ********* 2026-04-28 02:17:33.745236 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:17:33.745253 | orchestrator | ok: [testbed-manager] 2026-04-28 02:17:33.745269 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:17:33.745287 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:17:33.745321 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:17:33.745341 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:17:33.745360 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:17:33.745376 | orchestrator | 2026-04-28 02:17:33.745396 | orchestrator | TASK [osism.commons.docker_compose : Copy docker-compose script] *************** 2026-04-28 02:17:33.745410 | orchestrator | Tuesday 28 April 2026 02:17:26 +0000 (0:00:01.452) 0:07:23.562 ********* 2026-04-28 02:17:33.745421 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:17:33.745431 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:17:33.745442 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:17:33.745452 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:17:33.745463 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:17:33.745474 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:17:33.745484 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:17:33.745495 | orchestrator | 2026-04-28 02:17:33.745507 | orchestrator | TASK [osism.commons.docker_compose : Install docker-compose-plugin package] **** 2026-04-28 02:17:33.745550 | orchestrator | Tuesday 28 April 2026 02:17:27 +0000 (0:00:00.537) 0:07:24.100 ********* 2026-04-28 02:17:33.745562 | orchestrator | ok: [testbed-manager] 2026-04-28 02:17:33.745573 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:17:33.745584 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:17:33.745595 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:17:33.745605 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:17:33.745616 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:17:33.745642 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:18:07.731836 | orchestrator | 2026-04-28 02:18:07.731982 | orchestrator | TASK [osism.commons.docker_compose : Copy osism.target systemd file] *********** 2026-04-28 02:18:07.732012 | orchestrator | Tuesday 28 April 2026 02:17:33 +0000 (0:00:06.578) 0:07:30.679 ********* 2026-04-28 02:18:07.732032 | orchestrator | ok: [testbed-manager] 2026-04-28 02:18:07.732054 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:18:07.732074 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:18:07.732093 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:18:07.732111 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:18:07.732130 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:18:07.732147 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:18:07.732163 | orchestrator | 2026-04-28 02:18:07.732181 | orchestrator | TASK [osism.commons.docker_compose : Enable osism.target] ********************** 2026-04-28 02:18:07.732198 | orchestrator | Tuesday 28 April 2026 02:17:35 +0000 (0:00:01.580) 0:07:32.260 ********* 2026-04-28 02:18:07.732215 | orchestrator | ok: [testbed-manager] 2026-04-28 02:18:07.732230 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:18:07.732247 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:18:07.732265 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:18:07.732282 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:18:07.732300 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:18:07.732318 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:18:07.732334 | orchestrator | 2026-04-28 02:18:07.732353 | orchestrator | TASK [osism.commons.docker_compose : Copy docker-compose systemd unit file] **** 2026-04-28 02:18:07.732372 | orchestrator | Tuesday 28 April 2026 02:17:36 +0000 (0:00:01.681) 0:07:33.941 ********* 2026-04-28 02:18:07.732408 | orchestrator | ok: [testbed-manager] 2026-04-28 02:18:07.732428 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:18:07.732447 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:18:07.732466 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:18:07.732484 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:18:07.732574 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:18:07.732594 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:18:07.732611 | orchestrator | 2026-04-28 02:18:07.732629 | orchestrator | TASK [osism.commons.facts : Create custom facts directory] ********************* 2026-04-28 02:18:07.732648 | orchestrator | Tuesday 28 April 2026 02:17:38 +0000 (0:00:01.672) 0:07:35.614 ********* 2026-04-28 02:18:07.732666 | orchestrator | ok: [testbed-manager] 2026-04-28 02:18:07.732684 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:18:07.732759 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:18:07.732777 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:18:07.732795 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:18:07.732813 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:18:07.732831 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:18:07.732850 | orchestrator | 2026-04-28 02:18:07.732868 | orchestrator | TASK [osism.commons.facts : Copy fact files] *********************************** 2026-04-28 02:18:07.732887 | orchestrator | Tuesday 28 April 2026 02:17:39 +0000 (0:00:00.913) 0:07:36.527 ********* 2026-04-28 02:18:07.732905 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:18:07.732924 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:18:07.732943 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:18:07.732962 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:18:07.732980 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:18:07.732999 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:18:07.733012 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:18:07.733029 | orchestrator | 2026-04-28 02:18:07.733048 | orchestrator | TASK [osism.services.chrony : Check minimum and maximum number of servers] ***** 2026-04-28 02:18:07.733066 | orchestrator | Tuesday 28 April 2026 02:17:40 +0000 (0:00:01.174) 0:07:37.702 ********* 2026-04-28 02:18:07.733085 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:18:07.733104 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:18:07.733123 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:18:07.733143 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:18:07.733161 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:18:07.733181 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:18:07.733200 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:18:07.733218 | orchestrator | 2026-04-28 02:18:07.733237 | orchestrator | TASK [osism.services.chrony : Gather variables for each operating system] ****** 2026-04-28 02:18:07.733251 | orchestrator | Tuesday 28 April 2026 02:17:41 +0000 (0:00:00.736) 0:07:38.439 ********* 2026-04-28 02:18:07.733267 | orchestrator | ok: [testbed-manager] 2026-04-28 02:18:07.733309 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:18:07.733326 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:18:07.733342 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:18:07.733359 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:18:07.733375 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:18:07.733392 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:18:07.733409 | orchestrator | 2026-04-28 02:18:07.733428 | orchestrator | TASK [osism.services.chrony : Set chrony_conf_file variable to default value] *** 2026-04-28 02:18:07.733445 | orchestrator | Tuesday 28 April 2026 02:17:42 +0000 (0:00:00.565) 0:07:39.004 ********* 2026-04-28 02:18:07.733464 | orchestrator | ok: [testbed-manager] 2026-04-28 02:18:07.733481 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:18:07.733500 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:18:07.733518 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:18:07.733573 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:18:07.733666 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:18:07.733683 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:18:07.733694 | orchestrator | 2026-04-28 02:18:07.733706 | orchestrator | TASK [osism.services.chrony : Set chrony_key_file variable to default value] *** 2026-04-28 02:18:07.733717 | orchestrator | Tuesday 28 April 2026 02:17:42 +0000 (0:00:00.573) 0:07:39.578 ********* 2026-04-28 02:18:07.733728 | orchestrator | ok: [testbed-manager] 2026-04-28 02:18:07.733738 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:18:07.733750 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:18:07.733760 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:18:07.733771 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:18:07.733782 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:18:07.733793 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:18:07.733803 | orchestrator | 2026-04-28 02:18:07.733814 | orchestrator | TASK [osism.services.chrony : Populate service facts] ************************** 2026-04-28 02:18:07.733825 | orchestrator | Tuesday 28 April 2026 02:17:43 +0000 (0:00:00.857) 0:07:40.435 ********* 2026-04-28 02:18:07.733836 | orchestrator | ok: [testbed-manager] 2026-04-28 02:18:07.733863 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:18:07.733874 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:18:07.733885 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:18:07.733895 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:18:07.733906 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:18:07.733917 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:18:07.733928 | orchestrator | 2026-04-28 02:18:07.733966 | orchestrator | TASK [osism.services.chrony : Manage timesyncd service] ************************ 2026-04-28 02:18:07.733978 | orchestrator | Tuesday 28 April 2026 02:17:49 +0000 (0:00:05.735) 0:07:46.170 ********* 2026-04-28 02:18:07.733989 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:18:07.734074 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:18:07.734096 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:18:07.734118 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:18:07.734165 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:18:07.734183 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:18:07.734202 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:18:07.734219 | orchestrator | 2026-04-28 02:18:07.734238 | orchestrator | TASK [osism.services.chrony : Include distribution specific install tasks] ***** 2026-04-28 02:18:07.734257 | orchestrator | Tuesday 28 April 2026 02:17:49 +0000 (0:00:00.604) 0:07:46.774 ********* 2026-04-28 02:18:07.734279 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/tasks/install-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:18:07.734301 | orchestrator | 2026-04-28 02:18:07.734321 | orchestrator | TASK [osism.services.chrony : Install package] ********************************* 2026-04-28 02:18:07.734340 | orchestrator | Tuesday 28 April 2026 02:17:50 +0000 (0:00:01.099) 0:07:47.875 ********* 2026-04-28 02:18:07.734358 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:18:07.734377 | orchestrator | ok: [testbed-manager] 2026-04-28 02:18:07.734395 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:18:07.734414 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:18:07.734434 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:18:07.734454 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:18:07.734473 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:18:07.734491 | orchestrator | 2026-04-28 02:18:07.734502 | orchestrator | TASK [osism.services.chrony : Manage chrony service] *************************** 2026-04-28 02:18:07.734513 | orchestrator | Tuesday 28 April 2026 02:17:52 +0000 (0:00:01.917) 0:07:49.792 ********* 2026-04-28 02:18:07.734559 | orchestrator | ok: [testbed-manager] 2026-04-28 02:18:07.734571 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:18:07.734582 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:18:07.734592 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:18:07.734603 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:18:07.734616 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:18:07.734634 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:18:07.734666 | orchestrator | 2026-04-28 02:18:07.734770 | orchestrator | TASK [osism.services.chrony : Check if configuration file exists] ************** 2026-04-28 02:18:07.734793 | orchestrator | Tuesday 28 April 2026 02:17:54 +0000 (0:00:01.175) 0:07:50.967 ********* 2026-04-28 02:18:07.734811 | orchestrator | ok: [testbed-manager] 2026-04-28 02:18:07.734830 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:18:07.734848 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:18:07.734865 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:18:07.734883 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:18:07.734900 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:18:07.734919 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:18:07.734937 | orchestrator | 2026-04-28 02:18:07.734956 | orchestrator | TASK [osism.services.chrony : Copy configuration file] ************************* 2026-04-28 02:18:07.734974 | orchestrator | Tuesday 28 April 2026 02:17:54 +0000 (0:00:00.968) 0:07:51.935 ********* 2026-04-28 02:18:07.735004 | orchestrator | changed: [testbed-manager] => (item=/usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/templates/chrony.conf.j2) 2026-04-28 02:18:07.735019 | orchestrator | changed: [testbed-node-3] => (item=/usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/templates/chrony.conf.j2) 2026-04-28 02:18:07.735043 | orchestrator | changed: [testbed-node-4] => (item=/usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/templates/chrony.conf.j2) 2026-04-28 02:18:07.735054 | orchestrator | changed: [testbed-node-5] => (item=/usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/templates/chrony.conf.j2) 2026-04-28 02:18:07.735065 | orchestrator | changed: [testbed-node-0] => (item=/usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/templates/chrony.conf.j2) 2026-04-28 02:18:07.735076 | orchestrator | changed: [testbed-node-1] => (item=/usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/templates/chrony.conf.j2) 2026-04-28 02:18:07.735087 | orchestrator | changed: [testbed-node-2] => (item=/usr/share/ansible/collections/ansible_collections/osism/services/roles/chrony/templates/chrony.conf.j2) 2026-04-28 02:18:07.735098 | orchestrator | 2026-04-28 02:18:07.735109 | orchestrator | TASK [osism.services.lldpd : Include distribution specific install tasks] ****** 2026-04-28 02:18:07.735120 | orchestrator | Tuesday 28 April 2026 02:17:57 +0000 (0:00:02.053) 0:07:53.989 ********* 2026-04-28 02:18:07.735131 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/lldpd/tasks/install-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:18:07.735144 | orchestrator | 2026-04-28 02:18:07.735155 | orchestrator | TASK [osism.services.lldpd : Install lldpd package] **************************** 2026-04-28 02:18:07.735166 | orchestrator | Tuesday 28 April 2026 02:17:57 +0000 (0:00:00.963) 0:07:54.953 ********* 2026-04-28 02:18:07.735177 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:18:07.735188 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:18:07.735199 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:18:07.735210 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:18:07.735221 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:18:07.735232 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:18:07.735243 | orchestrator | changed: [testbed-manager] 2026-04-28 02:18:07.735254 | orchestrator | 2026-04-28 02:18:07.735281 | orchestrator | TASK [osism.services.lldpd : Manage lldpd service] ***************************** 2026-04-28 02:18:41.213152 | orchestrator | Tuesday 28 April 2026 02:18:07 +0000 (0:00:09.716) 0:08:04.669 ********* 2026-04-28 02:18:41.213251 | orchestrator | ok: [testbed-manager] 2026-04-28 02:18:41.213263 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:18:41.213271 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:18:41.213279 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:18:41.213288 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:18:41.213296 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:18:41.213320 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:18:41.213338 | orchestrator | 2026-04-28 02:18:41.213347 | orchestrator | RUNNING HANDLER [osism.commons.docker_compose : Reload systemd daemon] ********* 2026-04-28 02:18:41.213356 | orchestrator | Tuesday 28 April 2026 02:18:09 +0000 (0:00:02.164) 0:08:06.834 ********* 2026-04-28 02:18:41.213364 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:18:41.213372 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:18:41.213380 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:18:41.213388 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:18:41.213396 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:18:41.213404 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:18:41.213424 | orchestrator | 2026-04-28 02:18:41.213433 | orchestrator | RUNNING HANDLER [osism.services.chrony : Restart chrony service] *************** 2026-04-28 02:18:41.213441 | orchestrator | Tuesday 28 April 2026 02:18:11 +0000 (0:00:01.433) 0:08:08.267 ********* 2026-04-28 02:18:41.213450 | orchestrator | changed: [testbed-manager] 2026-04-28 02:18:41.213459 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:18:41.213467 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:18:41.213474 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:18:41.213506 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:18:41.213514 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:18:41.213522 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:18:41.213565 | orchestrator | 2026-04-28 02:18:41.213578 | orchestrator | PLAY [Apply bootstrap role part 2] ********************************************* 2026-04-28 02:18:41.213592 | orchestrator | 2026-04-28 02:18:41.213605 | orchestrator | TASK [Include hardening role] ************************************************** 2026-04-28 02:18:41.213620 | orchestrator | Tuesday 28 April 2026 02:18:12 +0000 (0:00:01.430) 0:08:09.698 ********* 2026-04-28 02:18:41.213634 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:18:41.213648 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:18:41.213661 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:18:41.213674 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:18:41.213692 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:18:41.213711 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:18:41.213723 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:18:41.213736 | orchestrator | 2026-04-28 02:18:41.213749 | orchestrator | PLAY [Apply bootstrap roles part 3] ******************************************** 2026-04-28 02:18:41.213761 | orchestrator | 2026-04-28 02:18:41.213773 | orchestrator | TASK [osism.services.journald : Copy configuration file] *********************** 2026-04-28 02:18:41.213786 | orchestrator | Tuesday 28 April 2026 02:18:13 +0000 (0:00:00.862) 0:08:10.560 ********* 2026-04-28 02:18:41.213798 | orchestrator | changed: [testbed-manager] 2026-04-28 02:18:41.213811 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:18:41.213824 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:18:41.213836 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:18:41.213849 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:18:41.213861 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:18:41.213875 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:18:41.213887 | orchestrator | 2026-04-28 02:18:41.213918 | orchestrator | TASK [osism.services.journald : Manage journald service] *********************** 2026-04-28 02:18:41.213932 | orchestrator | Tuesday 28 April 2026 02:18:15 +0000 (0:00:01.494) 0:08:12.055 ********* 2026-04-28 02:18:41.213940 | orchestrator | ok: [testbed-manager] 2026-04-28 02:18:41.213948 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:18:41.213956 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:18:41.213964 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:18:41.213971 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:18:41.213979 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:18:41.213987 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:18:41.213995 | orchestrator | 2026-04-28 02:18:41.214003 | orchestrator | TASK [Include auditd role] ***************************************************** 2026-04-28 02:18:41.214011 | orchestrator | Tuesday 28 April 2026 02:18:16 +0000 (0:00:01.629) 0:08:13.684 ********* 2026-04-28 02:18:41.214071 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:18:41.214079 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:18:41.214087 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:18:41.214095 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:18:41.214102 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:18:41.214110 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:18:41.214118 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:18:41.214126 | orchestrator | 2026-04-28 02:18:41.214161 | orchestrator | TASK [Include smartd role] ***************************************************** 2026-04-28 02:18:41.214171 | orchestrator | Tuesday 28 April 2026 02:18:17 +0000 (0:00:00.558) 0:08:14.242 ********* 2026-04-28 02:18:41.214179 | orchestrator | included: osism.services.smartd for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:18:41.214190 | orchestrator | 2026-04-28 02:18:41.214198 | orchestrator | TASK [osism.services.smartd : Include distribution specific install tasks] ***** 2026-04-28 02:18:41.214205 | orchestrator | Tuesday 28 April 2026 02:18:18 +0000 (0:00:01.152) 0:08:15.395 ********* 2026-04-28 02:18:41.214216 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/smartd/tasks/install-Debian-family.yml for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:18:41.214236 | orchestrator | 2026-04-28 02:18:41.214244 | orchestrator | TASK [osism.services.smartd : Install smartmontools package] ******************* 2026-04-28 02:18:41.214252 | orchestrator | Tuesday 28 April 2026 02:18:19 +0000 (0:00:00.892) 0:08:16.288 ********* 2026-04-28 02:18:41.214260 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:18:41.214268 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:18:41.214276 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:18:41.214283 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:18:41.214291 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:18:41.214299 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:18:41.214307 | orchestrator | changed: [testbed-manager] 2026-04-28 02:18:41.214315 | orchestrator | 2026-04-28 02:18:41.214341 | orchestrator | TASK [osism.services.smartd : Create /var/log/smartd directory] **************** 2026-04-28 02:18:41.214349 | orchestrator | Tuesday 28 April 2026 02:18:28 +0000 (0:00:08.950) 0:08:25.239 ********* 2026-04-28 02:18:41.214357 | orchestrator | changed: [testbed-manager] 2026-04-28 02:18:41.214365 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:18:41.214373 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:18:41.214381 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:18:41.214388 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:18:41.214396 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:18:41.214404 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:18:41.214412 | orchestrator | 2026-04-28 02:18:41.214420 | orchestrator | TASK [osism.services.smartd : Copy smartmontools configuration file] *********** 2026-04-28 02:18:41.214428 | orchestrator | Tuesday 28 April 2026 02:18:29 +0000 (0:00:01.246) 0:08:26.485 ********* 2026-04-28 02:18:41.214436 | orchestrator | changed: [testbed-manager] 2026-04-28 02:18:41.214444 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:18:41.214451 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:18:41.214459 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:18:41.214467 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:18:41.214475 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:18:41.214483 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:18:41.214490 | orchestrator | 2026-04-28 02:18:41.214498 | orchestrator | TASK [osism.services.smartd : Manage smartd service] *************************** 2026-04-28 02:18:41.214506 | orchestrator | Tuesday 28 April 2026 02:18:31 +0000 (0:00:01.513) 0:08:27.999 ********* 2026-04-28 02:18:41.214514 | orchestrator | changed: [testbed-manager] 2026-04-28 02:18:41.214522 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:18:41.214673 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:18:41.214692 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:18:41.214701 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:18:41.214708 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:18:41.214716 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:18:41.214724 | orchestrator | 2026-04-28 02:18:41.214733 | orchestrator | RUNNING HANDLER [osism.services.journald : Restart journald service] *********** 2026-04-28 02:18:41.214741 | orchestrator | Tuesday 28 April 2026 02:18:33 +0000 (0:00:02.061) 0:08:30.060 ********* 2026-04-28 02:18:41.214749 | orchestrator | changed: [testbed-manager] 2026-04-28 02:18:41.214756 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:18:41.214764 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:18:41.214772 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:18:41.214780 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:18:41.214788 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:18:41.214795 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:18:41.214803 | orchestrator | 2026-04-28 02:18:41.214811 | orchestrator | RUNNING HANDLER [osism.services.smartd : Restart smartd service] *************** 2026-04-28 02:18:41.214819 | orchestrator | Tuesday 28 April 2026 02:18:34 +0000 (0:00:01.289) 0:08:31.349 ********* 2026-04-28 02:18:41.214827 | orchestrator | changed: [testbed-manager] 2026-04-28 02:18:41.214834 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:18:41.214853 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:18:41.214861 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:18:41.214868 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:18:41.214876 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:18:41.214884 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:18:41.214892 | orchestrator | 2026-04-28 02:18:41.214900 | orchestrator | PLAY [Set state bootstrap] ***************************************************** 2026-04-28 02:18:41.214908 | orchestrator | 2026-04-28 02:18:41.214921 | orchestrator | TASK [Set osism.bootstrap.status fact] ***************************************** 2026-04-28 02:18:41.214930 | orchestrator | Tuesday 28 April 2026 02:18:35 +0000 (0:00:01.177) 0:08:32.527 ********* 2026-04-28 02:18:41.214938 | orchestrator | included: osism.commons.state for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:18:41.214946 | orchestrator | 2026-04-28 02:18:41.214954 | orchestrator | TASK [osism.commons.state : Create custom facts directory] ********************* 2026-04-28 02:18:41.214962 | orchestrator | Tuesday 28 April 2026 02:18:36 +0000 (0:00:00.987) 0:08:33.515 ********* 2026-04-28 02:18:41.214970 | orchestrator | ok: [testbed-manager] 2026-04-28 02:18:41.214977 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:18:41.214985 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:18:41.214993 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:18:41.215001 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:18:41.215009 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:18:41.215017 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:18:41.215024 | orchestrator | 2026-04-28 02:18:41.215032 | orchestrator | TASK [osism.commons.state : Write state into file] ***************************** 2026-04-28 02:18:41.215041 | orchestrator | Tuesday 28 April 2026 02:18:37 +0000 (0:00:01.201) 0:08:34.716 ********* 2026-04-28 02:18:41.215048 | orchestrator | changed: [testbed-manager] 2026-04-28 02:18:41.215056 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:18:41.215064 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:18:41.215072 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:18:41.215080 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:18:41.215088 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:18:41.215095 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:18:41.215103 | orchestrator | 2026-04-28 02:18:41.215111 | orchestrator | TASK [Set osism.bootstrap.timestamp fact] ************************************** 2026-04-28 02:18:41.215119 | orchestrator | Tuesday 28 April 2026 02:18:39 +0000 (0:00:01.278) 0:08:35.995 ********* 2026-04-28 02:18:41.215127 | orchestrator | included: osism.commons.state for testbed-manager, testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:18:41.215135 | orchestrator | 2026-04-28 02:18:41.215143 | orchestrator | TASK [osism.commons.state : Create custom facts directory] ********************* 2026-04-28 02:18:41.215151 | orchestrator | Tuesday 28 April 2026 02:18:39 +0000 (0:00:00.920) 0:08:36.916 ********* 2026-04-28 02:18:41.215159 | orchestrator | ok: [testbed-manager] 2026-04-28 02:18:41.215167 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:18:41.215175 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:18:41.215183 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:18:41.215191 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:18:41.215198 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:18:41.215206 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:18:41.215214 | orchestrator | 2026-04-28 02:18:41.215233 | orchestrator | TASK [osism.commons.state : Write state into file] ***************************** 2026-04-28 02:18:42.994895 | orchestrator | Tuesday 28 April 2026 02:18:41 +0000 (0:00:01.237) 0:08:38.153 ********* 2026-04-28 02:18:42.995019 | orchestrator | changed: [testbed-manager] 2026-04-28 02:18:42.995046 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:18:42.995058 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:18:42.995069 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:18:42.995080 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:18:42.995091 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:18:42.995131 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:18:42.995143 | orchestrator | 2026-04-28 02:18:42.995155 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:18:42.995167 | orchestrator | testbed-manager : ok=168  changed=40  unreachable=0 failed=0 skipped=42  rescued=0 ignored=0 2026-04-28 02:18:42.995180 | orchestrator | testbed-node-0 : ok=177  changed=69  unreachable=0 failed=0 skipped=36  rescued=0 ignored=0 2026-04-28 02:18:42.995191 | orchestrator | testbed-node-1 : ok=177  changed=69  unreachable=0 failed=0 skipped=36  rescued=0 ignored=0 2026-04-28 02:18:42.995202 | orchestrator | testbed-node-2 : ok=177  changed=69  unreachable=0 failed=0 skipped=36  rescued=0 ignored=0 2026-04-28 02:18:42.995212 | orchestrator | testbed-node-3 : ok=175  changed=65  unreachable=0 failed=0 skipped=38  rescued=0 ignored=0 2026-04-28 02:18:42.995223 | orchestrator | testbed-node-4 : ok=175  changed=65  unreachable=0 failed=0 skipped=37  rescued=0 ignored=0 2026-04-28 02:18:42.995234 | orchestrator | testbed-node-5 : ok=175  changed=65  unreachable=0 failed=0 skipped=37  rescued=0 ignored=0 2026-04-28 02:18:42.995245 | orchestrator | 2026-04-28 02:18:42.995256 | orchestrator | 2026-04-28 02:18:42.995266 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:18:42.995277 | orchestrator | Tuesday 28 April 2026 02:18:42 +0000 (0:00:01.188) 0:08:39.341 ********* 2026-04-28 02:18:42.995288 | orchestrator | =============================================================================== 2026-04-28 02:18:42.995299 | orchestrator | osism.commons.packages : Install required packages --------------------- 79.24s 2026-04-28 02:18:42.995309 | orchestrator | osism.commons.packages : Download required packages -------------------- 41.10s 2026-04-28 02:18:42.995320 | orchestrator | osism.commons.cleanup : Cleanup installed packages --------------------- 35.70s 2026-04-28 02:18:42.995331 | orchestrator | osism.commons.repository : Update package cache ------------------------ 16.50s 2026-04-28 02:18:42.995358 | orchestrator | osism.commons.systohc : Install util-linux-extra package --------------- 15.15s 2026-04-28 02:18:42.995369 | orchestrator | osism.commons.packages : Remove dependencies that are no longer required -- 14.63s 2026-04-28 02:18:42.995384 | orchestrator | osism.services.docker : Install docker package ------------------------- 11.78s 2026-04-28 02:18:42.995397 | orchestrator | osism.services.docker : Install containerd package --------------------- 10.01s 2026-04-28 02:18:42.995409 | orchestrator | osism.services.docker : Install docker-cli package ---------------------- 9.90s 2026-04-28 02:18:42.995421 | orchestrator | osism.services.lldpd : Install lldpd package ---------------------------- 9.72s 2026-04-28 02:18:42.995433 | orchestrator | osism.services.docker : Add repository ---------------------------------- 9.18s 2026-04-28 02:18:42.995445 | orchestrator | osism.services.smartd : Install smartmontools package ------------------- 8.95s 2026-04-28 02:18:42.995457 | orchestrator | osism.commons.cleanup : Remove cloudinit package ------------------------ 8.90s 2026-04-28 02:18:42.995470 | orchestrator | osism.commons.cleanup : Uninstall unattended-upgrades package ----------- 8.85s 2026-04-28 02:18:42.995483 | orchestrator | osism.services.rng : Install rng package -------------------------------- 8.50s 2026-04-28 02:18:42.995495 | orchestrator | osism.services.docker : Install apt-transport-https package ------------- 8.00s 2026-04-28 02:18:42.995508 | orchestrator | osism.commons.cleanup : Remove dependencies that are no longer required --- 6.62s 2026-04-28 02:18:42.995519 | orchestrator | osism.commons.docker_compose : Install docker-compose-plugin package ---- 6.58s 2026-04-28 02:18:42.995611 | orchestrator | osism.commons.services : Populate service facts ------------------------- 5.95s 2026-04-28 02:18:42.995624 | orchestrator | osism.commons.cleanup : Populate service facts -------------------------- 5.91s 2026-04-28 02:18:43.383166 | orchestrator | + osism apply fail2ban 2026-04-28 02:18:56.811846 | orchestrator | 2026-04-28 02:18:56 | INFO  | Task af8d566d-5bab-4f23-9196-ee8ba8467859 (fail2ban) was prepared for execution. 2026-04-28 02:18:56.811944 | orchestrator | 2026-04-28 02:18:56 | INFO  | It takes a moment until task af8d566d-5bab-4f23-9196-ee8ba8467859 (fail2ban) has been started and output is visible here. 2026-04-28 02:19:21.117048 | orchestrator | 2026-04-28 02:19:21.117263 | orchestrator | PLAY [Apply role fail2ban] ***************************************************** 2026-04-28 02:19:21.117295 | orchestrator | 2026-04-28 02:19:21.117332 | orchestrator | TASK [osism.services.fail2ban : Include distribution specific install tasks] *** 2026-04-28 02:19:21.117354 | orchestrator | Tuesday 28 April 2026 02:19:02 +0000 (0:00:00.316) 0:00:00.316 ********* 2026-04-28 02:19:21.117376 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/fail2ban/tasks/install-Debian-family.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 02:19:21.117400 | orchestrator | 2026-04-28 02:19:21.117420 | orchestrator | TASK [osism.services.fail2ban : Install fail2ban package] ********************** 2026-04-28 02:19:21.117439 | orchestrator | Tuesday 28 April 2026 02:19:03 +0000 (0:00:01.222) 0:00:01.538 ********* 2026-04-28 02:19:21.117459 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:19:21.117479 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:19:21.117498 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:19:21.117517 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:19:21.117564 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:19:21.117586 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:19:21.117605 | orchestrator | changed: [testbed-manager] 2026-04-28 02:19:21.117623 | orchestrator | 2026-04-28 02:19:21.117643 | orchestrator | TASK [osism.services.fail2ban : Copy configuration files] ********************** 2026-04-28 02:19:21.117664 | orchestrator | Tuesday 28 April 2026 02:19:15 +0000 (0:00:11.974) 0:00:13.513 ********* 2026-04-28 02:19:21.117683 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:19:21.117697 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:19:21.117709 | orchestrator | changed: [testbed-manager] 2026-04-28 02:19:21.117722 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:19:21.117735 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:19:21.117748 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:19:21.117760 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:19:21.117773 | orchestrator | 2026-04-28 02:19:21.117786 | orchestrator | TASK [osism.services.fail2ban : Manage fail2ban service] *********************** 2026-04-28 02:19:21.117799 | orchestrator | Tuesday 28 April 2026 02:19:16 +0000 (0:00:01.559) 0:00:15.072 ********* 2026-04-28 02:19:21.117812 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:19:21.117826 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:19:21.117838 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:19:21.117851 | orchestrator | ok: [testbed-manager] 2026-04-28 02:19:21.117864 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:19:21.117876 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:19:21.117889 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:19:21.117902 | orchestrator | 2026-04-28 02:19:21.117914 | orchestrator | TASK [osism.services.fail2ban : Reload fail2ban configuration] ***************** 2026-04-28 02:19:21.117925 | orchestrator | Tuesday 28 April 2026 02:19:18 +0000 (0:00:01.723) 0:00:16.796 ********* 2026-04-28 02:19:21.117936 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:19:21.117947 | orchestrator | changed: [testbed-manager] 2026-04-28 02:19:21.117958 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:19:21.117969 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:19:21.117980 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:19:21.117991 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:19:21.118002 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:19:21.118013 | orchestrator | 2026-04-28 02:19:21.118077 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:19:21.118124 | orchestrator | testbed-manager : ok=5  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:19:21.118179 | orchestrator | testbed-node-0 : ok=5  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:19:21.118198 | orchestrator | testbed-node-1 : ok=5  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:19:21.118218 | orchestrator | testbed-node-2 : ok=5  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:19:21.118240 | orchestrator | testbed-node-3 : ok=5  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:19:21.118256 | orchestrator | testbed-node-4 : ok=5  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:19:21.118272 | orchestrator | testbed-node-5 : ok=5  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:19:21.118287 | orchestrator | 2026-04-28 02:19:21.118303 | orchestrator | 2026-04-28 02:19:21.118321 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:19:21.118337 | orchestrator | Tuesday 28 April 2026 02:19:20 +0000 (0:00:01.906) 0:00:18.703 ********* 2026-04-28 02:19:21.118354 | orchestrator | =============================================================================== 2026-04-28 02:19:21.118370 | orchestrator | osism.services.fail2ban : Install fail2ban package --------------------- 11.97s 2026-04-28 02:19:21.118385 | orchestrator | osism.services.fail2ban : Reload fail2ban configuration ----------------- 1.91s 2026-04-28 02:19:21.118396 | orchestrator | osism.services.fail2ban : Manage fail2ban service ----------------------- 1.72s 2026-04-28 02:19:21.118405 | orchestrator | osism.services.fail2ban : Copy configuration files ---------------------- 1.56s 2026-04-28 02:19:21.118415 | orchestrator | osism.services.fail2ban : Include distribution specific install tasks --- 1.22s 2026-04-28 02:19:21.563728 | orchestrator | + osism apply network 2026-04-28 02:19:33.985683 | orchestrator | 2026-04-28 02:19:33 | INFO  | Task 1f6dc7ad-a5c1-40c6-8a78-8ac37ce2505a (network) was prepared for execution. 2026-04-28 02:19:33.985773 | orchestrator | 2026-04-28 02:19:33 | INFO  | It takes a moment until task 1f6dc7ad-a5c1-40c6-8a78-8ac37ce2505a (network) has been started and output is visible here. 2026-04-28 02:20:05.784012 | orchestrator | 2026-04-28 02:20:05.784125 | orchestrator | PLAY [Apply role network] ****************************************************** 2026-04-28 02:20:05.784142 | orchestrator | 2026-04-28 02:20:05.784154 | orchestrator | TASK [osism.commons.network : Gather variables for each operating system] ****** 2026-04-28 02:20:05.784166 | orchestrator | Tuesday 28 April 2026 02:19:38 +0000 (0:00:00.296) 0:00:00.296 ********* 2026-04-28 02:20:05.784180 | orchestrator | ok: [testbed-manager] 2026-04-28 02:20:05.784201 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:20:05.784229 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:20:05.784248 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:20:05.784266 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:20:05.784284 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:20:05.784301 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:20:05.784319 | orchestrator | 2026-04-28 02:20:05.784336 | orchestrator | TASK [osism.commons.network : Include type specific tasks] ********************* 2026-04-28 02:20:05.784356 | orchestrator | Tuesday 28 April 2026 02:19:39 +0000 (0:00:00.832) 0:00:01.129 ********* 2026-04-28 02:20:05.784377 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/network/tasks/netplan-Debian-family.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 02:20:05.784402 | orchestrator | 2026-04-28 02:20:05.784422 | orchestrator | TASK [osism.commons.network : Install required packages] *********************** 2026-04-28 02:20:05.784471 | orchestrator | Tuesday 28 April 2026 02:19:40 +0000 (0:00:01.300) 0:00:02.429 ********* 2026-04-28 02:20:05.784492 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:20:05.784511 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:20:05.784531 | orchestrator | ok: [testbed-manager] 2026-04-28 02:20:05.784551 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:20:05.784642 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:20:05.784657 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:20:05.784669 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:20:05.784682 | orchestrator | 2026-04-28 02:20:05.784695 | orchestrator | TASK [osism.commons.network : Remove ifupdown package] ************************* 2026-04-28 02:20:05.784709 | orchestrator | Tuesday 28 April 2026 02:19:43 +0000 (0:00:02.195) 0:00:04.624 ********* 2026-04-28 02:20:05.784722 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:20:05.784734 | orchestrator | ok: [testbed-manager] 2026-04-28 02:20:05.784749 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:20:05.784761 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:20:05.784773 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:20:05.784785 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:20:05.784797 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:20:05.784811 | orchestrator | 2026-04-28 02:20:05.784823 | orchestrator | TASK [osism.commons.network : Create required directories] ********************* 2026-04-28 02:20:05.784835 | orchestrator | Tuesday 28 April 2026 02:19:45 +0000 (0:00:02.220) 0:00:06.845 ********* 2026-04-28 02:20:05.784848 | orchestrator | ok: [testbed-node-0] => (item=/etc/netplan) 2026-04-28 02:20:05.784861 | orchestrator | ok: [testbed-node-1] => (item=/etc/netplan) 2026-04-28 02:20:05.784874 | orchestrator | ok: [testbed-manager] => (item=/etc/netplan) 2026-04-28 02:20:05.784887 | orchestrator | ok: [testbed-node-2] => (item=/etc/netplan) 2026-04-28 02:20:05.784900 | orchestrator | ok: [testbed-node-3] => (item=/etc/netplan) 2026-04-28 02:20:05.784911 | orchestrator | ok: [testbed-node-4] => (item=/etc/netplan) 2026-04-28 02:20:05.784924 | orchestrator | ok: [testbed-node-5] => (item=/etc/netplan) 2026-04-28 02:20:05.784949 | orchestrator | 2026-04-28 02:20:05.784995 | orchestrator | TASK [osism.commons.network : Prepare netplan configuration template] ********** 2026-04-28 02:20:05.785021 | orchestrator | Tuesday 28 April 2026 02:19:46 +0000 (0:00:01.106) 0:00:07.952 ********* 2026-04-28 02:20:05.785039 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 02:20:05.785059 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-28 02:20:05.785077 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-28 02:20:05.785096 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 02:20:05.785115 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-28 02:20:05.785132 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 02:20:05.785151 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 02:20:05.785162 | orchestrator | 2026-04-28 02:20:05.785173 | orchestrator | TASK [osism.commons.network : Copy netplan configuration] ********************** 2026-04-28 02:20:05.785184 | orchestrator | Tuesday 28 April 2026 02:19:50 +0000 (0:00:03.776) 0:00:11.728 ********* 2026-04-28 02:20:05.785195 | orchestrator | changed: [testbed-manager] 2026-04-28 02:20:05.785206 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:20:05.785217 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:20:05.785227 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:20:05.785238 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:20:05.785249 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:20:05.785259 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:20:05.785270 | orchestrator | 2026-04-28 02:20:05.785281 | orchestrator | TASK [osism.commons.network : Remove netplan configuration template] *********** 2026-04-28 02:20:05.785292 | orchestrator | Tuesday 28 April 2026 02:19:51 +0000 (0:00:01.720) 0:00:13.449 ********* 2026-04-28 02:20:05.785302 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 02:20:05.785313 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-28 02:20:05.785323 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-28 02:20:05.785334 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-28 02:20:05.785357 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 02:20:05.785367 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 02:20:05.785378 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 02:20:05.785389 | orchestrator | 2026-04-28 02:20:05.785399 | orchestrator | TASK [osism.commons.network : Check if path for interface file exists] ********* 2026-04-28 02:20:05.785410 | orchestrator | Tuesday 28 April 2026 02:19:53 +0000 (0:00:01.916) 0:00:15.365 ********* 2026-04-28 02:20:05.785421 | orchestrator | ok: [testbed-manager] 2026-04-28 02:20:05.785432 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:20:05.785442 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:20:05.785453 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:20:05.785464 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:20:05.785475 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:20:05.785485 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:20:05.785496 | orchestrator | 2026-04-28 02:20:05.785507 | orchestrator | TASK [osism.commons.network : Copy interfaces file] **************************** 2026-04-28 02:20:05.785539 | orchestrator | Tuesday 28 April 2026 02:19:55 +0000 (0:00:01.264) 0:00:16.630 ********* 2026-04-28 02:20:05.785551 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:20:05.785562 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:20:05.785615 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:20:05.785627 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:20:05.785637 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:20:05.785648 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:20:05.785659 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:20:05.785669 | orchestrator | 2026-04-28 02:20:05.785680 | orchestrator | TASK [osism.commons.network : Install package networkd-dispatcher] ************* 2026-04-28 02:20:05.785691 | orchestrator | Tuesday 28 April 2026 02:19:55 +0000 (0:00:00.731) 0:00:17.361 ********* 2026-04-28 02:20:05.785702 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:20:05.785713 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:20:05.785724 | orchestrator | ok: [testbed-manager] 2026-04-28 02:20:05.785734 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:20:05.785745 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:20:05.785756 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:20:05.785767 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:20:05.785777 | orchestrator | 2026-04-28 02:20:05.785788 | orchestrator | TASK [osism.commons.network : Copy dispatcher scripts] ************************* 2026-04-28 02:20:05.785799 | orchestrator | Tuesday 28 April 2026 02:19:58 +0000 (0:00:02.285) 0:00:19.647 ********* 2026-04-28 02:20:05.785810 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:20:05.785821 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:20:05.785831 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:20:05.785842 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:20:05.785853 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:20:05.785863 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:20:05.785876 | orchestrator | changed: [testbed-manager] => (item={'dest': 'routable.d/iptables.sh', 'src': '/opt/configuration/network/iptables.sh'}) 2026-04-28 02:20:05.785888 | orchestrator | 2026-04-28 02:20:05.785900 | orchestrator | TASK [osism.commons.network : Manage service networkd-dispatcher] ************** 2026-04-28 02:20:05.785910 | orchestrator | Tuesday 28 April 2026 02:19:59 +0000 (0:00:01.039) 0:00:20.686 ********* 2026-04-28 02:20:05.785921 | orchestrator | ok: [testbed-manager] 2026-04-28 02:20:05.785932 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:20:05.785943 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:20:05.785954 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:20:05.785965 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:20:05.785975 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:20:05.785986 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:20:05.785997 | orchestrator | 2026-04-28 02:20:05.786008 | orchestrator | TASK [osism.commons.network : Include cleanup tasks] *************************** 2026-04-28 02:20:05.786080 | orchestrator | Tuesday 28 April 2026 02:20:00 +0000 (0:00:01.782) 0:00:22.468 ********* 2026-04-28 02:20:05.786093 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/network/tasks/cleanup-netplan.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 02:20:05.786115 | orchestrator | 2026-04-28 02:20:05.786164 | orchestrator | TASK [osism.commons.network : List existing configuration files] *************** 2026-04-28 02:20:05.786192 | orchestrator | Tuesday 28 April 2026 02:20:02 +0000 (0:00:01.399) 0:00:23.868 ********* 2026-04-28 02:20:05.786216 | orchestrator | ok: [testbed-manager] 2026-04-28 02:20:05.786233 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:20:05.786251 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:20:05.786270 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:20:05.786296 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:20:05.786316 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:20:05.786333 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:20:05.786352 | orchestrator | 2026-04-28 02:20:05.786370 | orchestrator | TASK [osism.commons.network : Set network_configured_files fact] *************** 2026-04-28 02:20:05.786389 | orchestrator | Tuesday 28 April 2026 02:20:03 +0000 (0:00:01.048) 0:00:24.917 ********* 2026-04-28 02:20:05.786409 | orchestrator | ok: [testbed-manager] 2026-04-28 02:20:05.786427 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:20:05.786441 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:20:05.786451 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:20:05.786462 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:20:05.786473 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:20:05.786483 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:20:05.786494 | orchestrator | 2026-04-28 02:20:05.786505 | orchestrator | TASK [osism.commons.network : Remove unused configuration files] *************** 2026-04-28 02:20:05.786516 | orchestrator | Tuesday 28 April 2026 02:20:04 +0000 (0:00:00.959) 0:00:25.876 ********* 2026-04-28 02:20:05.786527 | orchestrator | skipping: [testbed-manager] => (item=/etc/netplan/01-osism.yaml)  2026-04-28 02:20:05.786538 | orchestrator | skipping: [testbed-node-0] => (item=/etc/netplan/01-osism.yaml)  2026-04-28 02:20:05.786549 | orchestrator | skipping: [testbed-node-1] => (item=/etc/netplan/01-osism.yaml)  2026-04-28 02:20:05.786560 | orchestrator | skipping: [testbed-node-2] => (item=/etc/netplan/01-osism.yaml)  2026-04-28 02:20:05.786639 | orchestrator | changed: [testbed-manager] => (item=/etc/netplan/50-cloud-init.yaml) 2026-04-28 02:20:05.786651 | orchestrator | skipping: [testbed-node-3] => (item=/etc/netplan/01-osism.yaml)  2026-04-28 02:20:05.786662 | orchestrator | changed: [testbed-node-0] => (item=/etc/netplan/50-cloud-init.yaml) 2026-04-28 02:20:05.786673 | orchestrator | skipping: [testbed-node-4] => (item=/etc/netplan/01-osism.yaml)  2026-04-28 02:20:05.786684 | orchestrator | changed: [testbed-node-1] => (item=/etc/netplan/50-cloud-init.yaml) 2026-04-28 02:20:05.786695 | orchestrator | changed: [testbed-node-2] => (item=/etc/netplan/50-cloud-init.yaml) 2026-04-28 02:20:05.786706 | orchestrator | changed: [testbed-node-3] => (item=/etc/netplan/50-cloud-init.yaml) 2026-04-28 02:20:05.786716 | orchestrator | changed: [testbed-node-4] => (item=/etc/netplan/50-cloud-init.yaml) 2026-04-28 02:20:05.786727 | orchestrator | skipping: [testbed-node-5] => (item=/etc/netplan/01-osism.yaml)  2026-04-28 02:20:05.786738 | orchestrator | changed: [testbed-node-5] => (item=/etc/netplan/50-cloud-init.yaml) 2026-04-28 02:20:05.786749 | orchestrator | 2026-04-28 02:20:05.786773 | orchestrator | TASK [osism.commons.network : Include dummy interfaces] ************************ 2026-04-28 02:20:25.564567 | orchestrator | Tuesday 28 April 2026 02:20:05 +0000 (0:00:01.370) 0:00:27.247 ********* 2026-04-28 02:20:25.564703 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:20:25.564714 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:20:25.564721 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:20:25.564727 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:20:25.564733 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:20:25.564739 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:20:25.564745 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:20:25.564751 | orchestrator | 2026-04-28 02:20:25.564761 | orchestrator | TASK [osism.commons.network : Include vxlan interfaces] ************************ 2026-04-28 02:20:25.564796 | orchestrator | Tuesday 28 April 2026 02:20:06 +0000 (0:00:01.013) 0:00:28.260 ********* 2026-04-28 02:20:25.564808 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/network/tasks/vxlan-interfaces.yml for testbed-node-0, testbed-manager, testbed-node-1, testbed-node-5, testbed-node-2, testbed-node-3, testbed-node-4 2026-04-28 02:20:25.564820 | orchestrator | 2026-04-28 02:20:25.564831 | orchestrator | TASK [osism.commons.network : Create systemd networkd netdev files] ************ 2026-04-28 02:20:25.564841 | orchestrator | Tuesday 28 April 2026 02:20:12 +0000 (0:00:05.632) 0:00:33.893 ********* 2026-04-28 02:20:25.564852 | orchestrator | changed: [testbed-manager] => (item={'key': 'vxlan0', 'value': {'addresses': ['192.168.112.5/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15'], 'local_ip': '192.168.16.5', 'mtu': 1350, 'vni': 42}}) 2026-04-28 02:20:25.564865 | orchestrator | changed: [testbed-node-1] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.11', 'mtu': 1350, 'vni': 42}}) 2026-04-28 02:20:25.564875 | orchestrator | changed: [testbed-node-0] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.10', 'mtu': 1350, 'vni': 42}}) 2026-04-28 02:20:25.564887 | orchestrator | changed: [testbed-node-2] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.12', 'mtu': 1350, 'vni': 42}}) 2026-04-28 02:20:25.564897 | orchestrator | changed: [testbed-manager] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.5/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15'], 'local_ip': '192.168.16.5', 'mtu': 1350, 'vni': 23}}) 2026-04-28 02:20:25.564935 | orchestrator | changed: [testbed-node-3] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.13', 'mtu': 1350, 'vni': 42}}) 2026-04-28 02:20:25.564947 | orchestrator | changed: [testbed-node-4] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.14', 'mtu': 1350, 'vni': 42}}) 2026-04-28 02:20:25.564958 | orchestrator | changed: [testbed-node-1] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.11/20'], 'dests': ['192.168.16.10', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.11', 'mtu': 1350, 'vni': 23}}) 2026-04-28 02:20:25.564976 | orchestrator | changed: [testbed-node-0] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.10/20'], 'dests': ['192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.10', 'mtu': 1350, 'vni': 23}}) 2026-04-28 02:20:25.564987 | orchestrator | changed: [testbed-node-5] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.5'], 'local_ip': '192.168.16.15', 'mtu': 1350, 'vni': 42}}) 2026-04-28 02:20:25.564999 | orchestrator | changed: [testbed-node-2] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.12/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.12', 'mtu': 1350, 'vni': 23}}) 2026-04-28 02:20:25.565024 | orchestrator | changed: [testbed-node-3] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.13/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.13', 'mtu': 1350, 'vni': 23}}) 2026-04-28 02:20:25.565038 | orchestrator | changed: [testbed-node-4] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.14/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.14', 'mtu': 1350, 'vni': 23}}) 2026-04-28 02:20:25.565045 | orchestrator | changed: [testbed-node-5] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.15/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.5'], 'local_ip': '192.168.16.15', 'mtu': 1350, 'vni': 23}}) 2026-04-28 02:20:25.565051 | orchestrator | 2026-04-28 02:20:25.565058 | orchestrator | TASK [osism.commons.network : Create systemd networkd network files] *********** 2026-04-28 02:20:25.565065 | orchestrator | Tuesday 28 April 2026 02:20:19 +0000 (0:00:06.731) 0:00:40.624 ********* 2026-04-28 02:20:25.565071 | orchestrator | changed: [testbed-manager] => (item={'key': 'vxlan0', 'value': {'addresses': ['192.168.112.5/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15'], 'local_ip': '192.168.16.5', 'mtu': 1350, 'vni': 42}}) 2026-04-28 02:20:25.565077 | orchestrator | changed: [testbed-node-0] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.10', 'mtu': 1350, 'vni': 42}}) 2026-04-28 02:20:25.565084 | orchestrator | changed: [testbed-node-3] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.13', 'mtu': 1350, 'vni': 42}}) 2026-04-28 02:20:25.565090 | orchestrator | changed: [testbed-node-1] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.11', 'mtu': 1350, 'vni': 42}}) 2026-04-28 02:20:25.565097 | orchestrator | changed: [testbed-node-0] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.10/20'], 'dests': ['192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.10', 'mtu': 1350, 'vni': 23}}) 2026-04-28 02:20:25.565106 | orchestrator | changed: [testbed-manager] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.5/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15'], 'local_ip': '192.168.16.5', 'mtu': 1350, 'vni': 23}}) 2026-04-28 02:20:25.565113 | orchestrator | changed: [testbed-node-2] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.12', 'mtu': 1350, 'vni': 42}}) 2026-04-28 02:20:25.565119 | orchestrator | changed: [testbed-node-5] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.5'], 'local_ip': '192.168.16.15', 'mtu': 1350, 'vni': 42}}) 2026-04-28 02:20:25.565127 | orchestrator | changed: [testbed-node-4] => (item={'key': 'vxlan0', 'value': {'addresses': [], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.14', 'mtu': 1350, 'vni': 42}}) 2026-04-28 02:20:25.565134 | orchestrator | changed: [testbed-node-3] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.13/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.13', 'mtu': 1350, 'vni': 23}}) 2026-04-28 02:20:25.565142 | orchestrator | changed: [testbed-node-1] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.11/20'], 'dests': ['192.168.16.10', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.11', 'mtu': 1350, 'vni': 23}}) 2026-04-28 02:20:25.565153 | orchestrator | changed: [testbed-node-2] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.12/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.13', '192.168.16.14', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.12', 'mtu': 1350, 'vni': 23}}) 2026-04-28 02:20:25.565166 | orchestrator | changed: [testbed-node-5] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.15/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.14', '192.168.16.5'], 'local_ip': '192.168.16.15', 'mtu': 1350, 'vni': 23}}) 2026-04-28 02:20:33.247869 | orchestrator | changed: [testbed-node-4] => (item={'key': 'vxlan1', 'value': {'addresses': ['192.168.128.14/20'], 'dests': ['192.168.16.10', '192.168.16.11', '192.168.16.12', '192.168.16.13', '192.168.16.15', '192.168.16.5'], 'local_ip': '192.168.16.14', 'mtu': 1350, 'vni': 23}}) 2026-04-28 02:20:33.247968 | orchestrator | 2026-04-28 02:20:33.247986 | orchestrator | TASK [osism.commons.network : Include networkd cleanup tasks] ****************** 2026-04-28 02:20:33.247998 | orchestrator | Tuesday 28 April 2026 02:20:25 +0000 (0:00:06.400) 0:00:47.025 ********* 2026-04-28 02:20:33.248011 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/commons/roles/network/tasks/cleanup-networkd.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 02:20:33.248021 | orchestrator | 2026-04-28 02:20:33.248031 | orchestrator | TASK [osism.commons.network : List existing configuration files] *************** 2026-04-28 02:20:33.248042 | orchestrator | Tuesday 28 April 2026 02:20:27 +0000 (0:00:01.630) 0:00:48.656 ********* 2026-04-28 02:20:33.248052 | orchestrator | ok: [testbed-manager] 2026-04-28 02:20:33.248065 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:20:33.248075 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:20:33.248085 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:20:33.248096 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:20:33.248106 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:20:33.248118 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:20:33.248124 | orchestrator | 2026-04-28 02:20:33.248130 | orchestrator | TASK [osism.commons.network : Remove unused configuration files] *************** 2026-04-28 02:20:33.248136 | orchestrator | Tuesday 28 April 2026 02:20:28 +0000 (0:00:01.493) 0:00:50.149 ********* 2026-04-28 02:20:33.248142 | orchestrator | skipping: [testbed-manager] => (item=/etc/systemd/network/30-vxlan1.network)  2026-04-28 02:20:33.248149 | orchestrator | skipping: [testbed-manager] => (item=/etc/systemd/network/30-vxlan0.network)  2026-04-28 02:20:33.248155 | orchestrator | skipping: [testbed-manager] => (item=/etc/systemd/network/30-vxlan1.netdev)  2026-04-28 02:20:33.248161 | orchestrator | skipping: [testbed-manager] => (item=/etc/systemd/network/30-vxlan0.netdev)  2026-04-28 02:20:33.248167 | orchestrator | skipping: [testbed-node-0] => (item=/etc/systemd/network/30-vxlan1.network)  2026-04-28 02:20:33.248173 | orchestrator | skipping: [testbed-node-0] => (item=/etc/systemd/network/30-vxlan0.network)  2026-04-28 02:20:33.248179 | orchestrator | skipping: [testbed-node-0] => (item=/etc/systemd/network/30-vxlan1.netdev)  2026-04-28 02:20:33.248185 | orchestrator | skipping: [testbed-node-0] => (item=/etc/systemd/network/30-vxlan0.netdev)  2026-04-28 02:20:33.248191 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:20:33.248198 | orchestrator | skipping: [testbed-node-1] => (item=/etc/systemd/network/30-vxlan1.network)  2026-04-28 02:20:33.248203 | orchestrator | skipping: [testbed-node-1] => (item=/etc/systemd/network/30-vxlan0.network)  2026-04-28 02:20:33.248223 | orchestrator | skipping: [testbed-node-1] => (item=/etc/systemd/network/30-vxlan1.netdev)  2026-04-28 02:20:33.248229 | orchestrator | skipping: [testbed-node-1] => (item=/etc/systemd/network/30-vxlan0.netdev)  2026-04-28 02:20:33.248235 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:20:33.248256 | orchestrator | skipping: [testbed-node-2] => (item=/etc/systemd/network/30-vxlan1.network)  2026-04-28 02:20:33.248262 | orchestrator | skipping: [testbed-node-2] => (item=/etc/systemd/network/30-vxlan0.network)  2026-04-28 02:20:33.248268 | orchestrator | skipping: [testbed-node-2] => (item=/etc/systemd/network/30-vxlan1.netdev)  2026-04-28 02:20:33.248274 | orchestrator | skipping: [testbed-node-2] => (item=/etc/systemd/network/30-vxlan0.netdev)  2026-04-28 02:20:33.248279 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:20:33.248285 | orchestrator | skipping: [testbed-node-3] => (item=/etc/systemd/network/30-vxlan1.network)  2026-04-28 02:20:33.248291 | orchestrator | skipping: [testbed-node-3] => (item=/etc/systemd/network/30-vxlan0.network)  2026-04-28 02:20:33.248297 | orchestrator | skipping: [testbed-node-3] => (item=/etc/systemd/network/30-vxlan1.netdev)  2026-04-28 02:20:33.248303 | orchestrator | skipping: [testbed-node-3] => (item=/etc/systemd/network/30-vxlan0.netdev)  2026-04-28 02:20:33.248309 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:20:33.248314 | orchestrator | skipping: [testbed-node-4] => (item=/etc/systemd/network/30-vxlan1.network)  2026-04-28 02:20:33.248320 | orchestrator | skipping: [testbed-node-4] => (item=/etc/systemd/network/30-vxlan0.network)  2026-04-28 02:20:33.248326 | orchestrator | skipping: [testbed-node-4] => (item=/etc/systemd/network/30-vxlan1.netdev)  2026-04-28 02:20:33.248331 | orchestrator | skipping: [testbed-node-4] => (item=/etc/systemd/network/30-vxlan0.netdev)  2026-04-28 02:20:33.248337 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:20:33.248343 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:20:33.248349 | orchestrator | skipping: [testbed-node-5] => (item=/etc/systemd/network/30-vxlan1.network)  2026-04-28 02:20:33.248354 | orchestrator | skipping: [testbed-node-5] => (item=/etc/systemd/network/30-vxlan0.network)  2026-04-28 02:20:33.248360 | orchestrator | skipping: [testbed-node-5] => (item=/etc/systemd/network/30-vxlan1.netdev)  2026-04-28 02:20:33.248366 | orchestrator | skipping: [testbed-node-5] => (item=/etc/systemd/network/30-vxlan0.netdev)  2026-04-28 02:20:33.248371 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:20:33.248377 | orchestrator | 2026-04-28 02:20:33.248383 | orchestrator | RUNNING HANDLER [osism.commons.network : Reload systemd-networkd] ************** 2026-04-28 02:20:33.248403 | orchestrator | Tuesday 28 April 2026 02:20:31 +0000 (0:00:02.587) 0:00:52.736 ********* 2026-04-28 02:20:33.248409 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:20:33.248415 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:20:33.248421 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:20:33.248428 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:20:33.248435 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:20:33.248441 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:20:33.248448 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:20:33.248455 | orchestrator | 2026-04-28 02:20:33.248461 | orchestrator | RUNNING HANDLER [osism.commons.network : Netplan configuration changed] ******** 2026-04-28 02:20:33.248484 | orchestrator | Tuesday 28 April 2026 02:20:31 +0000 (0:00:00.708) 0:00:53.445 ********* 2026-04-28 02:20:33.248499 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:20:33.248505 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:20:33.248512 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:20:33.248519 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:20:33.248526 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:20:33.248532 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:20:33.248539 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:20:33.248545 | orchestrator | 2026-04-28 02:20:33.248552 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:20:33.248560 | orchestrator | testbed-manager : ok=21  changed=5  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 02:20:33.248569 | orchestrator | testbed-node-0 : ok=20  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 02:20:33.248582 | orchestrator | testbed-node-1 : ok=20  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 02:20:33.248608 | orchestrator | testbed-node-2 : ok=20  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 02:20:33.248615 | orchestrator | testbed-node-3 : ok=20  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 02:20:33.248622 | orchestrator | testbed-node-4 : ok=20  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 02:20:33.248629 | orchestrator | testbed-node-5 : ok=20  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 02:20:33.248635 | orchestrator | 2026-04-28 02:20:33.248642 | orchestrator | 2026-04-28 02:20:33.248648 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:20:33.248655 | orchestrator | Tuesday 28 April 2026 02:20:32 +0000 (0:00:00.801) 0:00:54.246 ********* 2026-04-28 02:20:33.248665 | orchestrator | =============================================================================== 2026-04-28 02:20:33.248672 | orchestrator | osism.commons.network : Create systemd networkd netdev files ------------ 6.73s 2026-04-28 02:20:33.248679 | orchestrator | osism.commons.network : Create systemd networkd network files ----------- 6.40s 2026-04-28 02:20:33.248685 | orchestrator | osism.commons.network : Include vxlan interfaces ------------------------ 5.63s 2026-04-28 02:20:33.248691 | orchestrator | osism.commons.network : Prepare netplan configuration template ---------- 3.78s 2026-04-28 02:20:33.248698 | orchestrator | osism.commons.network : Remove unused configuration files --------------- 2.59s 2026-04-28 02:20:33.248704 | orchestrator | osism.commons.network : Install package networkd-dispatcher ------------- 2.29s 2026-04-28 02:20:33.248711 | orchestrator | osism.commons.network : Remove ifupdown package ------------------------- 2.22s 2026-04-28 02:20:33.248717 | orchestrator | osism.commons.network : Install required packages ----------------------- 2.20s 2026-04-28 02:20:33.248724 | orchestrator | osism.commons.network : Remove netplan configuration template ----------- 1.92s 2026-04-28 02:20:33.248731 | orchestrator | osism.commons.network : Manage service networkd-dispatcher -------------- 1.78s 2026-04-28 02:20:33.248737 | orchestrator | osism.commons.network : Copy netplan configuration ---------------------- 1.72s 2026-04-28 02:20:33.248744 | orchestrator | osism.commons.network : Include networkd cleanup tasks ------------------ 1.63s 2026-04-28 02:20:33.248750 | orchestrator | osism.commons.network : List existing configuration files --------------- 1.49s 2026-04-28 02:20:33.248757 | orchestrator | osism.commons.network : Include cleanup tasks --------------------------- 1.40s 2026-04-28 02:20:33.248763 | orchestrator | osism.commons.network : Remove unused configuration files --------------- 1.37s 2026-04-28 02:20:33.248770 | orchestrator | osism.commons.network : Include type specific tasks --------------------- 1.30s 2026-04-28 02:20:33.248776 | orchestrator | osism.commons.network : Check if path for interface file exists --------- 1.26s 2026-04-28 02:20:33.248783 | orchestrator | osism.commons.network : Create required directories --------------------- 1.11s 2026-04-28 02:20:33.248789 | orchestrator | osism.commons.network : List existing configuration files --------------- 1.05s 2026-04-28 02:20:33.248795 | orchestrator | osism.commons.network : Copy dispatcher scripts ------------------------- 1.04s 2026-04-28 02:20:33.609907 | orchestrator | + osism apply wireguard 2026-04-28 02:20:45.837371 | orchestrator | 2026-04-28 02:20:45 | INFO  | Task 554ff436-42a4-4df9-be55-4a1dcf983267 (wireguard) was prepared for execution. 2026-04-28 02:20:45.837514 | orchestrator | 2026-04-28 02:20:45 | INFO  | It takes a moment until task 554ff436-42a4-4df9-be55-4a1dcf983267 (wireguard) has been started and output is visible here. 2026-04-28 02:21:08.574508 | orchestrator | 2026-04-28 02:21:08.574683 | orchestrator | PLAY [Apply role wireguard] **************************************************** 2026-04-28 02:21:08.574739 | orchestrator | 2026-04-28 02:21:08.574755 | orchestrator | TASK [osism.services.wireguard : Install iptables package] ********************* 2026-04-28 02:21:08.574769 | orchestrator | Tuesday 28 April 2026 02:20:50 +0000 (0:00:00.251) 0:00:00.251 ********* 2026-04-28 02:21:08.574781 | orchestrator | ok: [testbed-manager] 2026-04-28 02:21:08.574795 | orchestrator | 2026-04-28 02:21:08.574806 | orchestrator | TASK [osism.services.wireguard : Install wireguard package] ******************** 2026-04-28 02:21:08.574816 | orchestrator | Tuesday 28 April 2026 02:20:52 +0000 (0:00:01.729) 0:00:01.981 ********* 2026-04-28 02:21:08.574823 | orchestrator | changed: [testbed-manager] 2026-04-28 02:21:08.574835 | orchestrator | 2026-04-28 02:21:08.574842 | orchestrator | TASK [osism.services.wireguard : Create public and private key - server] ******* 2026-04-28 02:21:08.574849 | orchestrator | Tuesday 28 April 2026 02:21:00 +0000 (0:00:07.816) 0:00:09.798 ********* 2026-04-28 02:21:08.574855 | orchestrator | changed: [testbed-manager] 2026-04-28 02:21:08.574862 | orchestrator | 2026-04-28 02:21:08.574869 | orchestrator | TASK [osism.services.wireguard : Create preshared key] ************************* 2026-04-28 02:21:08.574876 | orchestrator | Tuesday 28 April 2026 02:21:00 +0000 (0:00:00.611) 0:00:10.409 ********* 2026-04-28 02:21:08.574883 | orchestrator | changed: [testbed-manager] 2026-04-28 02:21:08.574889 | orchestrator | 2026-04-28 02:21:08.574896 | orchestrator | TASK [osism.services.wireguard : Get preshared key] **************************** 2026-04-28 02:21:08.574903 | orchestrator | Tuesday 28 April 2026 02:21:01 +0000 (0:00:00.466) 0:00:10.876 ********* 2026-04-28 02:21:08.574909 | orchestrator | ok: [testbed-manager] 2026-04-28 02:21:08.574916 | orchestrator | 2026-04-28 02:21:08.574923 | orchestrator | TASK [osism.services.wireguard : Get public key - server] ********************** 2026-04-28 02:21:08.574930 | orchestrator | Tuesday 28 April 2026 02:21:02 +0000 (0:00:00.720) 0:00:11.596 ********* 2026-04-28 02:21:08.574936 | orchestrator | ok: [testbed-manager] 2026-04-28 02:21:08.574943 | orchestrator | 2026-04-28 02:21:08.574950 | orchestrator | TASK [osism.services.wireguard : Get private key - server] ********************* 2026-04-28 02:21:08.574957 | orchestrator | Tuesday 28 April 2026 02:21:02 +0000 (0:00:00.453) 0:00:12.050 ********* 2026-04-28 02:21:08.574963 | orchestrator | ok: [testbed-manager] 2026-04-28 02:21:08.574970 | orchestrator | 2026-04-28 02:21:08.574977 | orchestrator | TASK [osism.services.wireguard : Copy wg0.conf configuration file] ************* 2026-04-28 02:21:08.574983 | orchestrator | Tuesday 28 April 2026 02:21:02 +0000 (0:00:00.465) 0:00:12.516 ********* 2026-04-28 02:21:08.574990 | orchestrator | changed: [testbed-manager] 2026-04-28 02:21:08.574997 | orchestrator | 2026-04-28 02:21:08.575004 | orchestrator | TASK [osism.services.wireguard : Copy client configuration files] ************** 2026-04-28 02:21:08.575010 | orchestrator | Tuesday 28 April 2026 02:21:04 +0000 (0:00:01.250) 0:00:13.767 ********* 2026-04-28 02:21:08.575017 | orchestrator | changed: [testbed-manager] => (item=None) 2026-04-28 02:21:08.575024 | orchestrator | changed: [testbed-manager] 2026-04-28 02:21:08.575031 | orchestrator | 2026-04-28 02:21:08.575037 | orchestrator | TASK [osism.services.wireguard : Manage wg-quick@wg0.service service] ********** 2026-04-28 02:21:08.575044 | orchestrator | Tuesday 28 April 2026 02:21:05 +0000 (0:00:01.042) 0:00:14.810 ********* 2026-04-28 02:21:08.575051 | orchestrator | changed: [testbed-manager] 2026-04-28 02:21:08.575058 | orchestrator | 2026-04-28 02:21:08.575065 | orchestrator | RUNNING HANDLER [osism.services.wireguard : Restart wg0 service] *************** 2026-04-28 02:21:08.575072 | orchestrator | Tuesday 28 April 2026 02:21:07 +0000 (0:00:01.872) 0:00:16.682 ********* 2026-04-28 02:21:08.575079 | orchestrator | changed: [testbed-manager] 2026-04-28 02:21:08.575086 | orchestrator | 2026-04-28 02:21:08.575092 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:21:08.575099 | orchestrator | testbed-manager : ok=11  changed=7  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:21:08.575108 | orchestrator | 2026-04-28 02:21:08.575114 | orchestrator | 2026-04-28 02:21:08.575121 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:21:08.575136 | orchestrator | Tuesday 28 April 2026 02:21:08 +0000 (0:00:01.013) 0:00:17.695 ********* 2026-04-28 02:21:08.575142 | orchestrator | =============================================================================== 2026-04-28 02:21:08.575149 | orchestrator | osism.services.wireguard : Install wireguard package -------------------- 7.82s 2026-04-28 02:21:08.575156 | orchestrator | osism.services.wireguard : Manage wg-quick@wg0.service service ---------- 1.87s 2026-04-28 02:21:08.575163 | orchestrator | osism.services.wireguard : Install iptables package --------------------- 1.73s 2026-04-28 02:21:08.575169 | orchestrator | osism.services.wireguard : Copy wg0.conf configuration file ------------- 1.25s 2026-04-28 02:21:08.575176 | orchestrator | osism.services.wireguard : Copy client configuration files -------------- 1.04s 2026-04-28 02:21:08.575183 | orchestrator | osism.services.wireguard : Restart wg0 service -------------------------- 1.01s 2026-04-28 02:21:08.575189 | orchestrator | osism.services.wireguard : Get preshared key ---------------------------- 0.72s 2026-04-28 02:21:08.575196 | orchestrator | osism.services.wireguard : Create public and private key - server ------- 0.61s 2026-04-28 02:21:08.575203 | orchestrator | osism.services.wireguard : Create preshared key ------------------------- 0.47s 2026-04-28 02:21:08.575209 | orchestrator | osism.services.wireguard : Get private key - server --------------------- 0.47s 2026-04-28 02:21:08.575216 | orchestrator | osism.services.wireguard : Get public key - server ---------------------- 0.45s 2026-04-28 02:21:08.945551 | orchestrator | + sh -c /opt/configuration/scripts/prepare-wireguard-configuration.sh 2026-04-28 02:21:08.977403 | orchestrator | % Total % Received % Xferd Average Speed Time Time Time Current 2026-04-28 02:21:08.977506 | orchestrator | Dload Upload Total Spent Left Speed 2026-04-28 02:21:09.058373 | orchestrator | 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 15 100 15 0 0 183 0 --:--:-- --:--:-- --:--:-- 185 2026-04-28 02:21:09.071956 | orchestrator | + osism apply --environment custom workarounds 2026-04-28 02:21:11.237752 | orchestrator | 2026-04-28 02:21:11 | INFO  | Trying to run play workarounds in environment custom 2026-04-28 02:21:21.397740 | orchestrator | 2026-04-28 02:21:21 | INFO  | Task 649fc7c9-76ee-4e25-8b09-de931fb808fa (workarounds) was prepared for execution. 2026-04-28 02:21:21.397860 | orchestrator | 2026-04-28 02:21:21 | INFO  | It takes a moment until task 649fc7c9-76ee-4e25-8b09-de931fb808fa (workarounds) has been started and output is visible here. 2026-04-28 02:21:49.149512 | orchestrator | 2026-04-28 02:21:49.149585 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 02:21:49.149591 | orchestrator | 2026-04-28 02:21:49.149596 | orchestrator | TASK [Group hosts based on virtualization_role] ******************************** 2026-04-28 02:21:49.149600 | orchestrator | Tuesday 28 April 2026 02:21:26 +0000 (0:00:00.152) 0:00:00.152 ********* 2026-04-28 02:21:49.149605 | orchestrator | changed: [testbed-node-0] => (item=virtualization_role_guest) 2026-04-28 02:21:49.149610 | orchestrator | changed: [testbed-node-1] => (item=virtualization_role_guest) 2026-04-28 02:21:49.149614 | orchestrator | changed: [testbed-node-2] => (item=virtualization_role_guest) 2026-04-28 02:21:49.149618 | orchestrator | changed: [testbed-node-3] => (item=virtualization_role_guest) 2026-04-28 02:21:49.149622 | orchestrator | changed: [testbed-node-4] => (item=virtualization_role_guest) 2026-04-28 02:21:49.149626 | orchestrator | changed: [testbed-node-5] => (item=virtualization_role_guest) 2026-04-28 02:21:49.149630 | orchestrator | changed: [testbed-manager] => (item=virtualization_role_guest) 2026-04-28 02:21:49.149633 | orchestrator | 2026-04-28 02:21:49.149637 | orchestrator | PLAY [Apply netplan configuration on the manager node] ************************* 2026-04-28 02:21:49.149666 | orchestrator | 2026-04-28 02:21:49.149670 | orchestrator | TASK [Apply netplan configuration] ********************************************* 2026-04-28 02:21:49.149674 | orchestrator | Tuesday 28 April 2026 02:21:27 +0000 (0:00:00.938) 0:00:01.090 ********* 2026-04-28 02:21:49.149678 | orchestrator | ok: [testbed-manager] 2026-04-28 02:21:49.149695 | orchestrator | 2026-04-28 02:21:49.149699 | orchestrator | PLAY [Apply netplan configuration on all other nodes] ************************** 2026-04-28 02:21:49.149703 | orchestrator | 2026-04-28 02:21:49.149707 | orchestrator | TASK [Apply netplan configuration] ********************************************* 2026-04-28 02:21:49.149711 | orchestrator | Tuesday 28 April 2026 02:21:29 +0000 (0:00:02.755) 0:00:03.845 ********* 2026-04-28 02:21:49.149715 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:21:49.149719 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:21:49.149722 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:21:49.149726 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:21:49.149730 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:21:49.149734 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:21:49.149737 | orchestrator | 2026-04-28 02:21:49.149741 | orchestrator | PLAY [Add custom CA certificates to non-manager nodes] ************************* 2026-04-28 02:21:49.149745 | orchestrator | 2026-04-28 02:21:49.149749 | orchestrator | TASK [Copy custom CA certificates] ********************************************* 2026-04-28 02:21:49.149757 | orchestrator | Tuesday 28 April 2026 02:21:31 +0000 (0:00:01.982) 0:00:05.828 ********* 2026-04-28 02:21:49.149762 | orchestrator | changed: [testbed-node-4] => (item=/opt/configuration/environments/kolla/certificates/ca/testbed.crt) 2026-04-28 02:21:49.149767 | orchestrator | changed: [testbed-node-2] => (item=/opt/configuration/environments/kolla/certificates/ca/testbed.crt) 2026-04-28 02:21:49.149771 | orchestrator | changed: [testbed-node-0] => (item=/opt/configuration/environments/kolla/certificates/ca/testbed.crt) 2026-04-28 02:21:49.149775 | orchestrator | changed: [testbed-node-1] => (item=/opt/configuration/environments/kolla/certificates/ca/testbed.crt) 2026-04-28 02:21:49.149779 | orchestrator | changed: [testbed-node-3] => (item=/opt/configuration/environments/kolla/certificates/ca/testbed.crt) 2026-04-28 02:21:49.149782 | orchestrator | changed: [testbed-node-5] => (item=/opt/configuration/environments/kolla/certificates/ca/testbed.crt) 2026-04-28 02:21:49.149786 | orchestrator | 2026-04-28 02:21:49.149790 | orchestrator | TASK [Run update-ca-certificates] ********************************************** 2026-04-28 02:21:49.149794 | orchestrator | Tuesday 28 April 2026 02:21:33 +0000 (0:00:01.592) 0:00:07.421 ********* 2026-04-28 02:21:49.149798 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:21:49.149802 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:21:49.149805 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:21:49.149809 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:21:49.149813 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:21:49.149818 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:21:49.149823 | orchestrator | 2026-04-28 02:21:49.149831 | orchestrator | TASK [Run update-ca-trust] ***************************************************** 2026-04-28 02:21:49.149835 | orchestrator | Tuesday 28 April 2026 02:21:37 +0000 (0:00:03.956) 0:00:11.377 ********* 2026-04-28 02:21:49.149839 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:21:49.149843 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:21:49.149847 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:21:49.149851 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:21:49.149855 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:21:49.149858 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:21:49.149862 | orchestrator | 2026-04-28 02:21:49.149866 | orchestrator | PLAY [Add a workaround service] ************************************************ 2026-04-28 02:21:49.149870 | orchestrator | 2026-04-28 02:21:49.149874 | orchestrator | TASK [Copy workarounds.sh scripts] ********************************************* 2026-04-28 02:21:49.149878 | orchestrator | Tuesday 28 April 2026 02:21:38 +0000 (0:00:00.800) 0:00:12.177 ********* 2026-04-28 02:21:49.149881 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:21:49.149885 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:21:49.149889 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:21:49.149893 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:21:49.149896 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:21:49.149900 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:21:49.149907 | orchestrator | changed: [testbed-manager] 2026-04-28 02:21:49.149911 | orchestrator | 2026-04-28 02:21:49.149915 | orchestrator | TASK [Copy workarounds systemd unit file] ************************************** 2026-04-28 02:21:49.149918 | orchestrator | Tuesday 28 April 2026 02:21:39 +0000 (0:00:01.710) 0:00:13.888 ********* 2026-04-28 02:21:49.149922 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:21:49.149926 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:21:49.149930 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:21:49.149933 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:21:49.149937 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:21:49.149941 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:21:49.149954 | orchestrator | changed: [testbed-manager] 2026-04-28 02:21:49.149958 | orchestrator | 2026-04-28 02:21:49.149962 | orchestrator | TASK [Reload systemd daemon] *************************************************** 2026-04-28 02:21:49.149966 | orchestrator | Tuesday 28 April 2026 02:21:41 +0000 (0:00:01.744) 0:00:15.633 ********* 2026-04-28 02:21:49.149970 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:21:49.149974 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:21:49.149977 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:21:49.149981 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:21:49.149985 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:21:49.149991 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:21:49.149997 | orchestrator | ok: [testbed-manager] 2026-04-28 02:21:49.150002 | orchestrator | 2026-04-28 02:21:49.150008 | orchestrator | TASK [Enable workarounds.service (Debian)] ************************************* 2026-04-28 02:21:49.150071 | orchestrator | Tuesday 28 April 2026 02:21:43 +0000 (0:00:01.637) 0:00:17.271 ********* 2026-04-28 02:21:49.150078 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:21:49.150085 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:21:49.150091 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:21:49.150097 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:21:49.150104 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:21:49.150111 | orchestrator | changed: [testbed-manager] 2026-04-28 02:21:49.150117 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:21:49.150124 | orchestrator | 2026-04-28 02:21:49.150130 | orchestrator | TASK [Enable and start workarounds.service (RedHat)] *************************** 2026-04-28 02:21:49.150135 | orchestrator | Tuesday 28 April 2026 02:21:45 +0000 (0:00:02.077) 0:00:19.348 ********* 2026-04-28 02:21:49.150139 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:21:49.150143 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:21:49.150147 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:21:49.150152 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:21:49.150156 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:21:49.150160 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:21:49.150164 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:21:49.150169 | orchestrator | 2026-04-28 02:21:49.150173 | orchestrator | PLAY [On Ubuntu 24.04 install python3-docker from Debian Sid] ****************** 2026-04-28 02:21:49.150177 | orchestrator | 2026-04-28 02:21:49.150181 | orchestrator | TASK [Install python3-docker] ************************************************** 2026-04-28 02:21:49.150185 | orchestrator | Tuesday 28 April 2026 02:21:45 +0000 (0:00:00.668) 0:00:20.016 ********* 2026-04-28 02:21:49.150190 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:21:49.150194 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:21:49.150198 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:21:49.150203 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:21:49.150207 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:21:49.150214 | orchestrator | ok: [testbed-manager] 2026-04-28 02:21:49.150218 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:21:49.150222 | orchestrator | 2026-04-28 02:21:49.150226 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:21:49.150232 | orchestrator | testbed-manager : ok=7  changed=4  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 02:21:49.150238 | orchestrator | testbed-node-0 : ok=9  changed=6  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:21:49.150247 | orchestrator | testbed-node-1 : ok=9  changed=6  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:21:49.150251 | orchestrator | testbed-node-2 : ok=9  changed=6  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:21:49.150256 | orchestrator | testbed-node-3 : ok=9  changed=6  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:21:49.150260 | orchestrator | testbed-node-4 : ok=9  changed=6  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:21:49.150264 | orchestrator | testbed-node-5 : ok=9  changed=6  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:21:49.150269 | orchestrator | 2026-04-28 02:21:49.150273 | orchestrator | 2026-04-28 02:21:49.150277 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:21:49.150281 | orchestrator | Tuesday 28 April 2026 02:21:49 +0000 (0:00:03.148) 0:00:23.165 ********* 2026-04-28 02:21:49.150286 | orchestrator | =============================================================================== 2026-04-28 02:21:49.150290 | orchestrator | Run update-ca-certificates ---------------------------------------------- 3.96s 2026-04-28 02:21:49.150294 | orchestrator | Install python3-docker -------------------------------------------------- 3.15s 2026-04-28 02:21:49.150298 | orchestrator | Apply netplan configuration --------------------------------------------- 2.75s 2026-04-28 02:21:49.150303 | orchestrator | Enable workarounds.service (Debian) ------------------------------------- 2.08s 2026-04-28 02:21:49.150307 | orchestrator | Apply netplan configuration --------------------------------------------- 1.98s 2026-04-28 02:21:49.150311 | orchestrator | Copy workarounds systemd unit file -------------------------------------- 1.74s 2026-04-28 02:21:49.150315 | orchestrator | Copy workarounds.sh scripts --------------------------------------------- 1.71s 2026-04-28 02:21:49.150320 | orchestrator | Reload systemd daemon --------------------------------------------------- 1.64s 2026-04-28 02:21:49.150324 | orchestrator | Copy custom CA certificates --------------------------------------------- 1.59s 2026-04-28 02:21:49.150328 | orchestrator | Group hosts based on virtualization_role -------------------------------- 0.94s 2026-04-28 02:21:49.150332 | orchestrator | Run update-ca-trust ----------------------------------------------------- 0.80s 2026-04-28 02:21:49.150341 | orchestrator | Enable and start workarounds.service (RedHat) --------------------------- 0.67s 2026-04-28 02:21:49.935572 | orchestrator | + osism apply reboot -l testbed-nodes -e ireallymeanit=yes 2026-04-28 02:22:02.330977 | orchestrator | 2026-04-28 02:22:02 | INFO  | Task 20b77890-8e2c-4fa8-bf86-7d9da92be5d9 (reboot) was prepared for execution. 2026-04-28 02:22:02.331066 | orchestrator | 2026-04-28 02:22:02 | INFO  | It takes a moment until task 20b77890-8e2c-4fa8-bf86-7d9da92be5d9 (reboot) has been started and output is visible here. 2026-04-28 02:22:13.450974 | orchestrator | 2026-04-28 02:22:13.451110 | orchestrator | PLAY [Reboot systems] ********************************************************** 2026-04-28 02:22:13.451128 | orchestrator | 2026-04-28 02:22:13.451140 | orchestrator | TASK [Exit playbook, if user did not mean to reboot systems] ******************* 2026-04-28 02:22:13.451152 | orchestrator | Tuesday 28 April 2026 02:22:07 +0000 (0:00:00.244) 0:00:00.244 ********* 2026-04-28 02:22:13.451163 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:22:13.451175 | orchestrator | 2026-04-28 02:22:13.451190 | orchestrator | TASK [Reboot system - do not wait for the reboot to complete] ****************** 2026-04-28 02:22:13.451208 | orchestrator | Tuesday 28 April 2026 02:22:07 +0000 (0:00:00.114) 0:00:00.359 ********* 2026-04-28 02:22:13.451227 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:22:13.451252 | orchestrator | 2026-04-28 02:22:13.451274 | orchestrator | TASK [Reboot system - wait for the reboot to complete] ************************* 2026-04-28 02:22:13.451322 | orchestrator | Tuesday 28 April 2026 02:22:08 +0000 (0:00:00.991) 0:00:01.350 ********* 2026-04-28 02:22:13.451342 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:22:13.451360 | orchestrator | 2026-04-28 02:22:13.451378 | orchestrator | PLAY [Reboot systems] ********************************************************** 2026-04-28 02:22:13.451389 | orchestrator | 2026-04-28 02:22:13.451407 | orchestrator | TASK [Exit playbook, if user did not mean to reboot systems] ******************* 2026-04-28 02:22:13.451424 | orchestrator | Tuesday 28 April 2026 02:22:08 +0000 (0:00:00.119) 0:00:01.469 ********* 2026-04-28 02:22:13.451442 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:22:13.451458 | orchestrator | 2026-04-28 02:22:13.451475 | orchestrator | TASK [Reboot system - do not wait for the reboot to complete] ****************** 2026-04-28 02:22:13.451494 | orchestrator | Tuesday 28 April 2026 02:22:08 +0000 (0:00:00.111) 0:00:01.581 ********* 2026-04-28 02:22:13.451512 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:22:13.451529 | orchestrator | 2026-04-28 02:22:13.451547 | orchestrator | TASK [Reboot system - wait for the reboot to complete] ************************* 2026-04-28 02:22:13.451584 | orchestrator | Tuesday 28 April 2026 02:22:09 +0000 (0:00:00.687) 0:00:02.269 ********* 2026-04-28 02:22:13.451602 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:22:13.451688 | orchestrator | 2026-04-28 02:22:13.451710 | orchestrator | PLAY [Reboot systems] ********************************************************** 2026-04-28 02:22:13.451728 | orchestrator | 2026-04-28 02:22:13.451745 | orchestrator | TASK [Exit playbook, if user did not mean to reboot systems] ******************* 2026-04-28 02:22:13.451763 | orchestrator | Tuesday 28 April 2026 02:22:09 +0000 (0:00:00.121) 0:00:02.390 ********* 2026-04-28 02:22:13.451780 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:22:13.451798 | orchestrator | 2026-04-28 02:22:13.451814 | orchestrator | TASK [Reboot system - do not wait for the reboot to complete] ****************** 2026-04-28 02:22:13.451832 | orchestrator | Tuesday 28 April 2026 02:22:09 +0000 (0:00:00.249) 0:00:02.641 ********* 2026-04-28 02:22:13.451850 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:22:13.451869 | orchestrator | 2026-04-28 02:22:13.451885 | orchestrator | TASK [Reboot system - wait for the reboot to complete] ************************* 2026-04-28 02:22:13.451901 | orchestrator | Tuesday 28 April 2026 02:22:10 +0000 (0:00:00.663) 0:00:03.304 ********* 2026-04-28 02:22:13.451917 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:22:13.451934 | orchestrator | 2026-04-28 02:22:13.451950 | orchestrator | PLAY [Reboot systems] ********************************************************** 2026-04-28 02:22:13.451968 | orchestrator | 2026-04-28 02:22:13.451985 | orchestrator | TASK [Exit playbook, if user did not mean to reboot systems] ******************* 2026-04-28 02:22:13.452003 | orchestrator | Tuesday 28 April 2026 02:22:10 +0000 (0:00:00.135) 0:00:03.440 ********* 2026-04-28 02:22:13.452020 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:22:13.452038 | orchestrator | 2026-04-28 02:22:13.452055 | orchestrator | TASK [Reboot system - do not wait for the reboot to complete] ****************** 2026-04-28 02:22:13.452073 | orchestrator | Tuesday 28 April 2026 02:22:10 +0000 (0:00:00.099) 0:00:03.539 ********* 2026-04-28 02:22:13.452091 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:22:13.452107 | orchestrator | 2026-04-28 02:22:13.452125 | orchestrator | TASK [Reboot system - wait for the reboot to complete] ************************* 2026-04-28 02:22:13.452143 | orchestrator | Tuesday 28 April 2026 02:22:11 +0000 (0:00:00.666) 0:00:04.206 ********* 2026-04-28 02:22:13.452159 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:22:13.452178 | orchestrator | 2026-04-28 02:22:13.452195 | orchestrator | PLAY [Reboot systems] ********************************************************** 2026-04-28 02:22:13.452213 | orchestrator | 2026-04-28 02:22:13.452231 | orchestrator | TASK [Exit playbook, if user did not mean to reboot systems] ******************* 2026-04-28 02:22:13.452249 | orchestrator | Tuesday 28 April 2026 02:22:11 +0000 (0:00:00.116) 0:00:04.323 ********* 2026-04-28 02:22:13.452267 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:22:13.452284 | orchestrator | 2026-04-28 02:22:13.452302 | orchestrator | TASK [Reboot system - do not wait for the reboot to complete] ****************** 2026-04-28 02:22:13.452337 | orchestrator | Tuesday 28 April 2026 02:22:11 +0000 (0:00:00.123) 0:00:04.447 ********* 2026-04-28 02:22:13.452354 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:22:13.452372 | orchestrator | 2026-04-28 02:22:13.452389 | orchestrator | TASK [Reboot system - wait for the reboot to complete] ************************* 2026-04-28 02:22:13.452406 | orchestrator | Tuesday 28 April 2026 02:22:11 +0000 (0:00:00.701) 0:00:05.148 ********* 2026-04-28 02:22:13.452424 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:22:13.452442 | orchestrator | 2026-04-28 02:22:13.452461 | orchestrator | PLAY [Reboot systems] ********************************************************** 2026-04-28 02:22:13.452478 | orchestrator | 2026-04-28 02:22:13.452495 | orchestrator | TASK [Exit playbook, if user did not mean to reboot systems] ******************* 2026-04-28 02:22:13.452513 | orchestrator | Tuesday 28 April 2026 02:22:12 +0000 (0:00:00.122) 0:00:05.271 ********* 2026-04-28 02:22:13.452531 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:22:13.452548 | orchestrator | 2026-04-28 02:22:13.452565 | orchestrator | TASK [Reboot system - do not wait for the reboot to complete] ****************** 2026-04-28 02:22:13.452583 | orchestrator | Tuesday 28 April 2026 02:22:12 +0000 (0:00:00.105) 0:00:05.377 ********* 2026-04-28 02:22:13.452600 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:22:13.452617 | orchestrator | 2026-04-28 02:22:13.452701 | orchestrator | TASK [Reboot system - wait for the reboot to complete] ************************* 2026-04-28 02:22:13.452719 | orchestrator | Tuesday 28 April 2026 02:22:12 +0000 (0:00:00.701) 0:00:06.078 ********* 2026-04-28 02:22:13.452767 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:22:13.452785 | orchestrator | 2026-04-28 02:22:13.452803 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:22:13.452822 | orchestrator | testbed-node-0 : ok=1  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:22:13.452841 | orchestrator | testbed-node-1 : ok=1  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:22:13.452859 | orchestrator | testbed-node-2 : ok=1  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:22:13.452876 | orchestrator | testbed-node-3 : ok=1  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:22:13.452893 | orchestrator | testbed-node-4 : ok=1  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:22:13.452911 | orchestrator | testbed-node-5 : ok=1  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:22:13.452928 | orchestrator | 2026-04-28 02:22:13.452946 | orchestrator | 2026-04-28 02:22:13.452963 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:22:13.452981 | orchestrator | Tuesday 28 April 2026 02:22:12 +0000 (0:00:00.035) 0:00:06.114 ********* 2026-04-28 02:22:13.453008 | orchestrator | =============================================================================== 2026-04-28 02:22:13.453027 | orchestrator | Reboot system - do not wait for the reboot to complete ------------------ 4.41s 2026-04-28 02:22:13.453044 | orchestrator | Exit playbook, if user did not mean to reboot systems ------------------- 0.80s 2026-04-28 02:22:13.453061 | orchestrator | Reboot system - wait for the reboot to complete ------------------------- 0.65s 2026-04-28 02:22:13.825202 | orchestrator | + osism apply wait-for-connection -l testbed-nodes -e ireallymeanit=yes 2026-04-28 02:22:26.172359 | orchestrator | 2026-04-28 02:22:26 | INFO  | Task e4ed0150-e961-41e0-8d52-eadabe05f623 (wait-for-connection) was prepared for execution. 2026-04-28 02:22:26.172433 | orchestrator | 2026-04-28 02:22:26 | INFO  | It takes a moment until task e4ed0150-e961-41e0-8d52-eadabe05f623 (wait-for-connection) has been started and output is visible here. 2026-04-28 02:22:42.840919 | orchestrator | 2026-04-28 02:22:42.841037 | orchestrator | PLAY [Wait until remote systems are reachable] ********************************* 2026-04-28 02:22:42.841055 | orchestrator | 2026-04-28 02:22:42.841067 | orchestrator | TASK [Wait until remote system is reachable] *********************************** 2026-04-28 02:22:42.841079 | orchestrator | Tuesday 28 April 2026 02:22:30 +0000 (0:00:00.256) 0:00:00.256 ********* 2026-04-28 02:22:42.841091 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:22:42.841103 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:22:42.841113 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:22:42.841124 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:22:42.841135 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:22:42.841145 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:22:42.841156 | orchestrator | 2026-04-28 02:22:42.841167 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:22:42.841179 | orchestrator | testbed-node-0 : ok=1  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:22:42.841192 | orchestrator | testbed-node-1 : ok=1  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:22:42.841203 | orchestrator | testbed-node-2 : ok=1  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:22:42.841214 | orchestrator | testbed-node-3 : ok=1  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:22:42.841225 | orchestrator | testbed-node-4 : ok=1  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:22:42.841236 | orchestrator | testbed-node-5 : ok=1  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:22:42.841247 | orchestrator | 2026-04-28 02:22:42.841259 | orchestrator | 2026-04-28 02:22:42.841270 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:22:42.841281 | orchestrator | Tuesday 28 April 2026 02:22:42 +0000 (0:00:11.570) 0:00:11.826 ********* 2026-04-28 02:22:42.841292 | orchestrator | =============================================================================== 2026-04-28 02:22:42.841303 | orchestrator | Wait until remote system is reachable ---------------------------------- 11.57s 2026-04-28 02:22:43.226253 | orchestrator | + osism apply hddtemp 2026-04-28 02:22:55.446085 | orchestrator | 2026-04-28 02:22:55 | INFO  | Task e095f20b-39dd-4896-b26a-eb6ba7eaae34 (hddtemp) was prepared for execution. 2026-04-28 02:22:55.446212 | orchestrator | 2026-04-28 02:22:55 | INFO  | It takes a moment until task e095f20b-39dd-4896-b26a-eb6ba7eaae34 (hddtemp) has been started and output is visible here. 2026-04-28 02:23:25.104954 | orchestrator | 2026-04-28 02:23:25.105050 | orchestrator | PLAY [Apply role hddtemp] ****************************************************** 2026-04-28 02:23:25.105058 | orchestrator | 2026-04-28 02:23:25.105064 | orchestrator | TASK [osism.services.hddtemp : Gather variables for each operating system] ***** 2026-04-28 02:23:25.105069 | orchestrator | Tuesday 28 April 2026 02:23:00 +0000 (0:00:00.288) 0:00:00.288 ********* 2026-04-28 02:23:25.105074 | orchestrator | ok: [testbed-manager] 2026-04-28 02:23:25.105080 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:23:25.105085 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:23:25.105090 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:23:25.105095 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:23:25.105100 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:23:25.105104 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:23:25.105109 | orchestrator | 2026-04-28 02:23:25.105114 | orchestrator | TASK [osism.services.hddtemp : Include distribution specific install tasks] **** 2026-04-28 02:23:25.105119 | orchestrator | Tuesday 28 April 2026 02:23:01 +0000 (0:00:00.822) 0:00:01.111 ********* 2026-04-28 02:23:25.105125 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/hddtemp/tasks/install-Debian-family.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 02:23:25.105149 | orchestrator | 2026-04-28 02:23:25.105154 | orchestrator | TASK [osism.services.hddtemp : Remove hddtemp package] ************************* 2026-04-28 02:23:25.105158 | orchestrator | Tuesday 28 April 2026 02:23:02 +0000 (0:00:01.370) 0:00:02.481 ********* 2026-04-28 02:23:25.105163 | orchestrator | ok: [testbed-manager] 2026-04-28 02:23:25.105168 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:23:25.105172 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:23:25.105177 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:23:25.105182 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:23:25.105186 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:23:25.105191 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:23:25.105220 | orchestrator | 2026-04-28 02:23:25.105225 | orchestrator | TASK [osism.services.hddtemp : Enable Kernel Module drivetemp] ***************** 2026-04-28 02:23:25.105246 | orchestrator | Tuesday 28 April 2026 02:23:04 +0000 (0:00:01.940) 0:00:04.421 ********* 2026-04-28 02:23:25.105251 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:23:25.105257 | orchestrator | changed: [testbed-manager] 2026-04-28 02:23:25.105261 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:23:25.105275 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:23:25.105280 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:23:25.105285 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:23:25.105289 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:23:25.105294 | orchestrator | 2026-04-28 02:23:25.105299 | orchestrator | TASK [osism.services.hddtemp : Check if drivetemp module is available] ********* 2026-04-28 02:23:25.105303 | orchestrator | Tuesday 28 April 2026 02:23:05 +0000 (0:00:01.312) 0:00:05.734 ********* 2026-04-28 02:23:25.105308 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:23:25.105313 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:23:25.105317 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:23:25.105322 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:23:25.105327 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:23:25.105331 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:23:25.105338 | orchestrator | ok: [testbed-manager] 2026-04-28 02:23:25.105345 | orchestrator | 2026-04-28 02:23:25.105353 | orchestrator | TASK [osism.services.hddtemp : Load Kernel Module drivetemp] ******************* 2026-04-28 02:23:25.105371 | orchestrator | Tuesday 28 April 2026 02:23:07 +0000 (0:00:01.361) 0:00:07.095 ********* 2026-04-28 02:23:25.105381 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:23:25.105389 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:23:25.105396 | orchestrator | changed: [testbed-manager] 2026-04-28 02:23:25.105403 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:23:25.105410 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:23:25.105416 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:23:25.105422 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:23:25.105429 | orchestrator | 2026-04-28 02:23:25.105437 | orchestrator | TASK [osism.services.hddtemp : Install lm-sensors] ***************************** 2026-04-28 02:23:25.105445 | orchestrator | Tuesday 28 April 2026 02:23:07 +0000 (0:00:00.981) 0:00:08.077 ********* 2026-04-28 02:23:25.105452 | orchestrator | changed: [testbed-manager] 2026-04-28 02:23:25.105459 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:23:25.105467 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:23:25.105474 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:23:25.105482 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:23:25.105489 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:23:25.105496 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:23:25.105504 | orchestrator | 2026-04-28 02:23:25.105512 | orchestrator | TASK [osism.services.hddtemp : Include distribution specific service tasks] **** 2026-04-28 02:23:25.105520 | orchestrator | Tuesday 28 April 2026 02:23:21 +0000 (0:00:13.109) 0:00:21.186 ********* 2026-04-28 02:23:25.105529 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/hddtemp/tasks/service-Debian-family.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 02:23:25.105545 | orchestrator | 2026-04-28 02:23:25.105551 | orchestrator | TASK [osism.services.hddtemp : Manage lm-sensors service] ********************** 2026-04-28 02:23:25.105557 | orchestrator | Tuesday 28 April 2026 02:23:22 +0000 (0:00:01.407) 0:00:22.593 ********* 2026-04-28 02:23:25.105562 | orchestrator | changed: [testbed-manager] 2026-04-28 02:23:25.105568 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:23:25.105573 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:23:25.105578 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:23:25.105583 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:23:25.105588 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:23:25.105593 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:23:25.105599 | orchestrator | 2026-04-28 02:23:25.105621 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:23:25.105627 | orchestrator | testbed-manager : ok=9  changed=4  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:23:25.105647 | orchestrator | testbed-node-0 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 02:23:25.105653 | orchestrator | testbed-node-1 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 02:23:25.105658 | orchestrator | testbed-node-2 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 02:23:25.105664 | orchestrator | testbed-node-3 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 02:23:25.105669 | orchestrator | testbed-node-4 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 02:23:25.105674 | orchestrator | testbed-node-5 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 02:23:25.105680 | orchestrator | 2026-04-28 02:23:25.105688 | orchestrator | 2026-04-28 02:23:25.105699 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:23:25.105722 | orchestrator | Tuesday 28 April 2026 02:23:24 +0000 (0:00:02.087) 0:00:24.680 ********* 2026-04-28 02:23:25.105730 | orchestrator | =============================================================================== 2026-04-28 02:23:25.105737 | orchestrator | osism.services.hddtemp : Install lm-sensors ---------------------------- 13.11s 2026-04-28 02:23:25.105744 | orchestrator | osism.services.hddtemp : Manage lm-sensors service ---------------------- 2.09s 2026-04-28 02:23:25.105751 | orchestrator | osism.services.hddtemp : Remove hddtemp package ------------------------- 1.94s 2026-04-28 02:23:25.105765 | orchestrator | osism.services.hddtemp : Include distribution specific service tasks ---- 1.41s 2026-04-28 02:23:25.105773 | orchestrator | osism.services.hddtemp : Include distribution specific install tasks ---- 1.37s 2026-04-28 02:23:25.105781 | orchestrator | osism.services.hddtemp : Check if drivetemp module is available --------- 1.36s 2026-04-28 02:23:25.105789 | orchestrator | osism.services.hddtemp : Enable Kernel Module drivetemp ----------------- 1.31s 2026-04-28 02:23:25.105806 | orchestrator | osism.services.hddtemp : Load Kernel Module drivetemp ------------------- 0.98s 2026-04-28 02:23:25.105814 | orchestrator | osism.services.hddtemp : Gather variables for each operating system ----- 0.82s 2026-04-28 02:23:25.471022 | orchestrator | ++ semver 9.5.0 7.1.1 2026-04-28 02:23:25.516240 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-28 02:23:25.516318 | orchestrator | + sudo systemctl restart manager.service 2026-04-28 02:23:46.688032 | orchestrator | + [[ ceph-ansible == \c\e\p\h\-\a\n\s\i\b\l\e ]] 2026-04-28 02:23:46.688178 | orchestrator | + wait_for_container_healthy 60 ceph-ansible 2026-04-28 02:23:46.688206 | orchestrator | + local max_attempts=60 2026-04-28 02:23:46.688221 | orchestrator | + local name=ceph-ansible 2026-04-28 02:23:46.688232 | orchestrator | + local attempt_num=1 2026-04-28 02:23:46.688244 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-28 02:23:46.727020 | orchestrator | + [[ unhealthy == \h\e\a\l\t\h\y ]] 2026-04-28 02:23:46.727109 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-28 02:23:46.727120 | orchestrator | + sleep 5 2026-04-28 02:23:51.730482 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-28 02:23:51.800715 | orchestrator | + [[ unhealthy == \h\e\a\l\t\h\y ]] 2026-04-28 02:23:51.800836 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-28 02:23:51.800858 | orchestrator | + sleep 5 2026-04-28 02:23:56.803093 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-28 02:23:56.911179 | orchestrator | + [[ unhealthy == \h\e\a\l\t\h\y ]] 2026-04-28 02:23:56.911265 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-28 02:23:56.911275 | orchestrator | + sleep 5 2026-04-28 02:24:01.914050 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-28 02:24:01.942806 | orchestrator | + [[ unhealthy == \h\e\a\l\t\h\y ]] 2026-04-28 02:24:01.942886 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-28 02:24:01.942895 | orchestrator | + sleep 5 2026-04-28 02:24:06.947507 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-28 02:24:06.986413 | orchestrator | + [[ unhealthy == \h\e\a\l\t\h\y ]] 2026-04-28 02:24:06.986537 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-28 02:24:06.986559 | orchestrator | + sleep 5 2026-04-28 02:24:11.992890 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-28 02:24:12.035515 | orchestrator | + [[ unhealthy == \h\e\a\l\t\h\y ]] 2026-04-28 02:24:12.035686 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-28 02:24:12.035705 | orchestrator | + sleep 5 2026-04-28 02:24:17.039052 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-28 02:24:17.078912 | orchestrator | + [[ unhealthy == \h\e\a\l\t\h\y ]] 2026-04-28 02:24:17.078992 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-28 02:24:17.079001 | orchestrator | + sleep 5 2026-04-28 02:24:22.085786 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-28 02:24:22.141771 | orchestrator | + [[ starting == \h\e\a\l\t\h\y ]] 2026-04-28 02:24:22.141861 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-28 02:24:22.141869 | orchestrator | + sleep 5 2026-04-28 02:24:27.145282 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-28 02:24:27.182798 | orchestrator | + [[ starting == \h\e\a\l\t\h\y ]] 2026-04-28 02:24:27.182874 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-28 02:24:27.182886 | orchestrator | + sleep 5 2026-04-28 02:24:32.186575 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-28 02:24:32.227505 | orchestrator | + [[ starting == \h\e\a\l\t\h\y ]] 2026-04-28 02:24:32.227621 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-28 02:24:32.227636 | orchestrator | + sleep 5 2026-04-28 02:24:37.231916 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-28 02:24:37.265911 | orchestrator | + [[ starting == \h\e\a\l\t\h\y ]] 2026-04-28 02:24:37.266116 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-28 02:24:37.266145 | orchestrator | + sleep 5 2026-04-28 02:24:42.271075 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-28 02:24:42.308033 | orchestrator | + [[ starting == \h\e\a\l\t\h\y ]] 2026-04-28 02:24:42.308121 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-28 02:24:42.308130 | orchestrator | + sleep 5 2026-04-28 02:24:47.313117 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-28 02:24:47.348325 | orchestrator | + [[ starting == \h\e\a\l\t\h\y ]] 2026-04-28 02:24:47.348420 | orchestrator | + (( attempt_num++ == max_attempts )) 2026-04-28 02:24:47.348434 | orchestrator | + sleep 5 2026-04-28 02:24:52.353455 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' ceph-ansible 2026-04-28 02:24:52.396024 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-28 02:24:52.396140 | orchestrator | + wait_for_container_healthy 60 kolla-ansible 2026-04-28 02:24:52.396160 | orchestrator | + local max_attempts=60 2026-04-28 02:24:52.396177 | orchestrator | + local name=kolla-ansible 2026-04-28 02:24:52.396192 | orchestrator | + local attempt_num=1 2026-04-28 02:24:52.396532 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' kolla-ansible 2026-04-28 02:24:52.438254 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-28 02:24:52.438379 | orchestrator | + wait_for_container_healthy 60 osism-ansible 2026-04-28 02:24:52.438470 | orchestrator | + local max_attempts=60 2026-04-28 02:24:52.438508 | orchestrator | + local name=osism-ansible 2026-04-28 02:24:52.438527 | orchestrator | + local attempt_num=1 2026-04-28 02:24:52.439270 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' osism-ansible 2026-04-28 02:24:52.481751 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-28 02:24:52.481863 | orchestrator | + [[ true == \t\r\u\e ]] 2026-04-28 02:24:52.481879 | orchestrator | + sh -c /opt/configuration/scripts/disable-ara.sh 2026-04-28 02:24:52.668804 | orchestrator | ARA in ceph-ansible already disabled. 2026-04-28 02:24:52.852512 | orchestrator | ARA in kolla-ansible already disabled. 2026-04-28 02:24:53.030197 | orchestrator | ARA in osism-ansible already disabled. 2026-04-28 02:24:53.211586 | orchestrator | ARA in osism-kubernetes already disabled. 2026-04-28 02:24:53.212086 | orchestrator | + osism apply gather-facts 2026-04-28 02:25:05.708449 | orchestrator | 2026-04-28 02:25:05 | INFO  | Task ba0b49a6-aaf1-4833-8023-17d401f20250 (gather-facts) was prepared for execution. 2026-04-28 02:25:05.708549 | orchestrator | 2026-04-28 02:25:05 | INFO  | It takes a moment until task ba0b49a6-aaf1-4833-8023-17d401f20250 (gather-facts) has been started and output is visible here. 2026-04-28 02:25:20.022445 | orchestrator | 2026-04-28 02:25:20.022535 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-28 02:25:20.022545 | orchestrator | 2026-04-28 02:25:20.022552 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-28 02:25:20.022559 | orchestrator | Tuesday 28 April 2026 02:25:10 +0000 (0:00:00.259) 0:00:00.259 ********* 2026-04-28 02:25:20.022566 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:25:20.022573 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:25:20.022579 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:25:20.022585 | orchestrator | ok: [testbed-manager] 2026-04-28 02:25:20.022591 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:25:20.022597 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:25:20.022602 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:25:20.022608 | orchestrator | 2026-04-28 02:25:20.022614 | orchestrator | PLAY [Gather facts for all hosts if using --limit] ***************************** 2026-04-28 02:25:20.022620 | orchestrator | 2026-04-28 02:25:20.022626 | orchestrator | TASK [Gather facts for all hosts] ********************************************** 2026-04-28 02:25:20.022632 | orchestrator | Tuesday 28 April 2026 02:25:18 +0000 (0:00:08.536) 0:00:08.796 ********* 2026-04-28 02:25:20.022638 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:25:20.022645 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:25:20.022650 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:25:20.022656 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:25:20.022662 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:25:20.022667 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:25:20.022704 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:25:20.022711 | orchestrator | 2026-04-28 02:25:20.022717 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:25:20.022723 | orchestrator | testbed-manager : ok=1  changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 02:25:20.022731 | orchestrator | testbed-node-0 : ok=1  changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 02:25:20.022737 | orchestrator | testbed-node-1 : ok=1  changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 02:25:20.022743 | orchestrator | testbed-node-2 : ok=1  changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 02:25:20.022748 | orchestrator | testbed-node-3 : ok=1  changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 02:25:20.022754 | orchestrator | testbed-node-4 : ok=1  changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 02:25:20.022786 | orchestrator | testbed-node-5 : ok=1  changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 02:25:20.022800 | orchestrator | 2026-04-28 02:25:20.022806 | orchestrator | 2026-04-28 02:25:20.022812 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:25:20.022818 | orchestrator | Tuesday 28 April 2026 02:25:19 +0000 (0:00:00.627) 0:00:09.423 ********* 2026-04-28 02:25:20.022824 | orchestrator | =============================================================================== 2026-04-28 02:25:20.022834 | orchestrator | Gathers facts about hosts ----------------------------------------------- 8.54s 2026-04-28 02:25:20.022843 | orchestrator | Gather facts for all hosts ---------------------------------------------- 0.63s 2026-04-28 02:25:20.449064 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/001-helpers.sh /usr/local/bin/deploy-helper 2026-04-28 02:25:20.460861 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/100-ceph-with-ansible.sh /usr/local/bin/deploy-ceph-with-ansible 2026-04-28 02:25:20.472223 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/100-ceph-with-rook.sh /usr/local/bin/deploy-ceph-with-rook 2026-04-28 02:25:20.484855 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/200-infrastructure.sh /usr/local/bin/deploy-infrastructure 2026-04-28 02:25:20.496133 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/300-openstack.sh /usr/local/bin/deploy-openstack 2026-04-28 02:25:20.508430 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/320-openstack-minimal.sh /usr/local/bin/deploy-openstack-minimal 2026-04-28 02:25:20.522314 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/400-monitoring.sh /usr/local/bin/deploy-monitoring 2026-04-28 02:25:20.537144 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/500-kubernetes.sh /usr/local/bin/deploy-kubernetes 2026-04-28 02:25:20.551107 | orchestrator | + sudo ln -sf /opt/configuration/scripts/deploy/510-clusterapi.sh /usr/local/bin/deploy-kubernetes-clusterapi 2026-04-28 02:25:20.576651 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade-manager.sh /usr/local/bin/upgrade-manager 2026-04-28 02:25:20.596182 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/100-ceph-with-ansible.sh /usr/local/bin/upgrade-ceph-with-ansible 2026-04-28 02:25:20.618792 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/100-ceph-with-rook.sh /usr/local/bin/upgrade-ceph-with-rook 2026-04-28 02:25:20.638941 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/200-infrastructure.sh /usr/local/bin/upgrade-infrastructure 2026-04-28 02:25:20.659488 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/300-openstack.sh /usr/local/bin/upgrade-openstack 2026-04-28 02:25:20.679423 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/320-openstack-minimal.sh /usr/local/bin/upgrade-openstack-minimal 2026-04-28 02:25:20.703449 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/400-monitoring.sh /usr/local/bin/upgrade-monitoring 2026-04-28 02:25:20.722166 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/500-kubernetes.sh /usr/local/bin/upgrade-kubernetes 2026-04-28 02:25:20.734458 | orchestrator | + sudo ln -sf /opt/configuration/scripts/upgrade/510-clusterapi.sh /usr/local/bin/upgrade-kubernetes-clusterapi 2026-04-28 02:25:20.748719 | orchestrator | + sudo ln -sf /opt/configuration/scripts/bootstrap/300-openstack.sh /usr/local/bin/bootstrap-openstack 2026-04-28 02:25:20.772123 | orchestrator | + sudo ln -sf /opt/configuration/scripts/bootstrap/301-openstack-octavia-amphora-image.sh /usr/local/bin/bootstrap-octavia 2026-04-28 02:25:20.790262 | orchestrator | + sudo ln -sf /opt/configuration/scripts/bootstrap/302-openstack-k8s-clusterapi-images.sh /usr/local/bin/bootstrap-clusterapi 2026-04-28 02:25:20.806332 | orchestrator | + sudo ln -sf /opt/configuration/scripts/disable-local-registry.sh /usr/local/bin/disable-local-registry 2026-04-28 02:25:20.830792 | orchestrator | + sudo ln -sf /opt/configuration/scripts/pull-images.sh /usr/local/bin/pull-images 2026-04-28 02:25:20.850283 | orchestrator | + [[ false == \t\r\u\e ]] 2026-04-28 02:25:21.160185 | orchestrator | ok: Runtime: 0:26:43.138643 2026-04-28 02:25:21.276983 | 2026-04-28 02:25:21.277127 | TASK [Deploy services] 2026-04-28 02:25:22.041496 | orchestrator | 2026-04-28 02:25:22.041668 | orchestrator | # DEPLOY SERVICES 2026-04-28 02:25:22.041722 | orchestrator | 2026-04-28 02:25:22.041734 | orchestrator | + set -e 2026-04-28 02:25:22.041744 | orchestrator | + echo 2026-04-28 02:25:22.041755 | orchestrator | + echo '# DEPLOY SERVICES' 2026-04-28 02:25:22.041766 | orchestrator | + echo 2026-04-28 02:25:22.041802 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-28 02:25:22.041818 | orchestrator | ++ export INTERACTIVE=false 2026-04-28 02:25:22.041829 | orchestrator | ++ INTERACTIVE=false 2026-04-28 02:25:22.041839 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-28 02:25:22.041855 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-28 02:25:22.041864 | orchestrator | + source /opt/manager-vars.sh 2026-04-28 02:25:22.041875 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-28 02:25:22.041883 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-28 02:25:22.041896 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-28 02:25:22.041904 | orchestrator | ++ CEPH_VERSION=reef 2026-04-28 02:25:22.041915 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-28 02:25:22.041924 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-28 02:25:22.041935 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-28 02:25:22.041943 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-28 02:25:22.041952 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-28 02:25:22.041961 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-28 02:25:22.041969 | orchestrator | ++ export ARA=false 2026-04-28 02:25:22.041978 | orchestrator | ++ ARA=false 2026-04-28 02:25:22.041986 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-28 02:25:22.041995 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-28 02:25:22.042003 | orchestrator | ++ export TEMPEST=false 2026-04-28 02:25:22.042011 | orchestrator | ++ TEMPEST=false 2026-04-28 02:25:22.042061 | orchestrator | ++ export IS_ZUUL=true 2026-04-28 02:25:22.042069 | orchestrator | ++ IS_ZUUL=true 2026-04-28 02:25:22.042078 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 02:25:22.042087 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 02:25:22.042096 | orchestrator | ++ export EXTERNAL_API=false 2026-04-28 02:25:22.042105 | orchestrator | ++ EXTERNAL_API=false 2026-04-28 02:25:22.042113 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-28 02:25:22.042121 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-28 02:25:22.042130 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-28 02:25:22.042139 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-28 02:25:22.042147 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-28 02:25:22.042164 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-28 02:25:22.042174 | orchestrator | + sh -c /opt/configuration/scripts/pull-images.sh 2026-04-28 02:25:22.049099 | orchestrator | 2026-04-28 02:25:22.049200 | orchestrator | # PULL IMAGES 2026-04-28 02:25:22.049211 | orchestrator | 2026-04-28 02:25:22.049217 | orchestrator | + set -e 2026-04-28 02:25:22.049222 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-28 02:25:22.049231 | orchestrator | ++ export INTERACTIVE=false 2026-04-28 02:25:22.049236 | orchestrator | ++ INTERACTIVE=false 2026-04-28 02:25:22.049242 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-28 02:25:22.049247 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-28 02:25:22.049252 | orchestrator | + source /opt/manager-vars.sh 2026-04-28 02:25:22.049256 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-28 02:25:22.049261 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-28 02:25:22.049267 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-28 02:25:22.049271 | orchestrator | ++ CEPH_VERSION=reef 2026-04-28 02:25:22.049276 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-28 02:25:22.049281 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-28 02:25:22.049286 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-28 02:25:22.049292 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-28 02:25:22.049297 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-28 02:25:22.049304 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-28 02:25:22.049314 | orchestrator | ++ export ARA=false 2026-04-28 02:25:22.049326 | orchestrator | ++ ARA=false 2026-04-28 02:25:22.049337 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-28 02:25:22.049345 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-28 02:25:22.049353 | orchestrator | ++ export TEMPEST=false 2026-04-28 02:25:22.049359 | orchestrator | ++ TEMPEST=false 2026-04-28 02:25:22.049367 | orchestrator | ++ export IS_ZUUL=true 2026-04-28 02:25:22.049375 | orchestrator | ++ IS_ZUUL=true 2026-04-28 02:25:22.049384 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 02:25:22.049392 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 02:25:22.049399 | orchestrator | ++ export EXTERNAL_API=false 2026-04-28 02:25:22.049406 | orchestrator | ++ EXTERNAL_API=false 2026-04-28 02:25:22.049414 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-28 02:25:22.049422 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-28 02:25:22.049450 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-28 02:25:22.049455 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-28 02:25:22.049460 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-28 02:25:22.049464 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-28 02:25:22.049469 | orchestrator | + echo 2026-04-28 02:25:22.049474 | orchestrator | + echo '# PULL IMAGES' 2026-04-28 02:25:22.049478 | orchestrator | + echo 2026-04-28 02:25:22.050182 | orchestrator | ++ semver 9.5.0 7.0.0 2026-04-28 02:25:22.096296 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-28 02:25:22.096386 | orchestrator | + osism apply --no-wait -r 2 -e custom pull-images 2026-04-28 02:25:24.178839 | orchestrator | 2026-04-28 02:25:24 | INFO  | Trying to run play pull-images in environment custom 2026-04-28 02:25:34.295066 | orchestrator | 2026-04-28 02:25:34 | INFO  | Task 11256b33-47a0-427a-9e3b-044f311e4b24 (pull-images) was prepared for execution. 2026-04-28 02:25:34.295250 | orchestrator | 2026-04-28 02:25:34 | INFO  | Task 11256b33-47a0-427a-9e3b-044f311e4b24 is running in background. No more output. Check ARA for logs. 2026-04-28 02:25:34.693196 | orchestrator | + sh -c /opt/configuration/scripts/deploy/001-helpers.sh 2026-04-28 02:25:46.877204 | orchestrator | 2026-04-28 02:25:46 | INFO  | Task 24742d55-4bf7-4c5b-b5cd-368ffe357ca2 (cgit) was prepared for execution. 2026-04-28 02:25:46.877333 | orchestrator | 2026-04-28 02:25:46 | INFO  | Task 24742d55-4bf7-4c5b-b5cd-368ffe357ca2 is running in background. No more output. Check ARA for logs. 2026-04-28 02:25:59.824173 | orchestrator | 2026-04-28 02:25:59 | INFO  | Task df155cd8-87e1-4033-9dfa-1d99e1fc3005 (dotfiles) was prepared for execution. 2026-04-28 02:25:59.824266 | orchestrator | 2026-04-28 02:25:59 | INFO  | Task df155cd8-87e1-4033-9dfa-1d99e1fc3005 is running in background. No more output. Check ARA for logs. 2026-04-28 02:26:12.476421 | orchestrator | 2026-04-28 02:26:12 | INFO  | Task 5d6ff664-9009-4556-9887-aa731204f36e (homer) was prepared for execution. 2026-04-28 02:26:12.476506 | orchestrator | 2026-04-28 02:26:12 | INFO  | Task 5d6ff664-9009-4556-9887-aa731204f36e is running in background. No more output. Check ARA for logs. 2026-04-28 02:26:25.381474 | orchestrator | 2026-04-28 02:26:25 | INFO  | Task 24bd31ed-3807-4031-8970-24f597227c35 (phpmyadmin) was prepared for execution. 2026-04-28 02:26:25.381587 | orchestrator | 2026-04-28 02:26:25 | INFO  | Task 24bd31ed-3807-4031-8970-24f597227c35 is running in background. No more output. Check ARA for logs. 2026-04-28 02:26:38.519729 | orchestrator | 2026-04-28 02:26:38 | INFO  | Task 4258ba90-50b2-4533-b91a-3492c79bcf5e (sosreport) was prepared for execution. 2026-04-28 02:26:38.519929 | orchestrator | 2026-04-28 02:26:38 | INFO  | Task 4258ba90-50b2-4533-b91a-3492c79bcf5e is running in background. No more output. Check ARA for logs. 2026-04-28 02:26:38.881060 | orchestrator | + sh -c /opt/configuration/scripts/deploy/500-kubernetes.sh 2026-04-28 02:26:38.891864 | orchestrator | + set -e 2026-04-28 02:26:38.891959 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-28 02:26:38.891974 | orchestrator | ++ export INTERACTIVE=false 2026-04-28 02:26:38.891986 | orchestrator | ++ INTERACTIVE=false 2026-04-28 02:26:38.891999 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-28 02:26:38.892009 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-28 02:26:38.892019 | orchestrator | + source /opt/manager-vars.sh 2026-04-28 02:26:38.892029 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-28 02:26:38.892039 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-28 02:26:38.892049 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-28 02:26:38.892059 | orchestrator | ++ CEPH_VERSION=reef 2026-04-28 02:26:38.892069 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-28 02:26:38.892079 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-28 02:26:38.892089 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-28 02:26:38.892099 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-28 02:26:38.892109 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-28 02:26:38.892119 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-28 02:26:38.892129 | orchestrator | ++ export ARA=false 2026-04-28 02:26:38.892139 | orchestrator | ++ ARA=false 2026-04-28 02:26:38.892149 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-28 02:26:38.892188 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-28 02:26:38.892198 | orchestrator | ++ export TEMPEST=false 2026-04-28 02:26:38.892208 | orchestrator | ++ TEMPEST=false 2026-04-28 02:26:38.892218 | orchestrator | ++ export IS_ZUUL=true 2026-04-28 02:26:38.892228 | orchestrator | ++ IS_ZUUL=true 2026-04-28 02:26:38.892252 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 02:26:38.892267 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 02:26:38.892277 | orchestrator | ++ export EXTERNAL_API=false 2026-04-28 02:26:38.892286 | orchestrator | ++ EXTERNAL_API=false 2026-04-28 02:26:38.892296 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-28 02:26:38.892305 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-28 02:26:38.892315 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-28 02:26:38.892325 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-28 02:26:38.892334 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-28 02:26:38.892344 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-28 02:26:38.893000 | orchestrator | ++ semver 9.5.0 8.0.3 2026-04-28 02:26:38.963133 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-28 02:26:38.963227 | orchestrator | + osism apply frr 2026-04-28 02:26:51.346301 | orchestrator | 2026-04-28 02:26:51 | INFO  | Task 07a78b38-8029-42c7-b50e-cd1f6fc77d11 (frr) was prepared for execution. 2026-04-28 02:26:51.346401 | orchestrator | 2026-04-28 02:26:51 | INFO  | It takes a moment until task 07a78b38-8029-42c7-b50e-cd1f6fc77d11 (frr) has been started and output is visible here. 2026-04-28 02:27:28.935227 | orchestrator | 2026-04-28 02:27:28.935308 | orchestrator | PLAY [Apply role frr] ********************************************************** 2026-04-28 02:27:28.935317 | orchestrator | 2026-04-28 02:27:28.935322 | orchestrator | TASK [osism.services.frr : Include distribution specific install tasks] ******** 2026-04-28 02:27:28.935332 | orchestrator | Tuesday 28 April 2026 02:26:58 +0000 (0:00:00.705) 0:00:00.705 ********* 2026-04-28 02:27:28.935338 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/frr/tasks/install-Debian-family.yml for testbed-manager 2026-04-28 02:27:28.935344 | orchestrator | 2026-04-28 02:27:28.935349 | orchestrator | TASK [osism.services.frr : Pin frr package version] **************************** 2026-04-28 02:27:28.935354 | orchestrator | Tuesday 28 April 2026 02:26:58 +0000 (0:00:00.676) 0:00:01.382 ********* 2026-04-28 02:27:28.935359 | orchestrator | changed: [testbed-manager] 2026-04-28 02:27:28.935365 | orchestrator | 2026-04-28 02:27:28.935380 | orchestrator | TASK [osism.services.frr : Install frr package] ******************************** 2026-04-28 02:27:28.935386 | orchestrator | Tuesday 28 April 2026 02:27:00 +0000 (0:00:01.963) 0:00:03.346 ********* 2026-04-28 02:27:28.935398 | orchestrator | changed: [testbed-manager] 2026-04-28 02:27:28.935402 | orchestrator | 2026-04-28 02:27:28.935407 | orchestrator | TASK [osism.services.frr : Copy file: /etc/frr/vtysh.conf] ********************* 2026-04-28 02:27:28.935412 | orchestrator | Tuesday 28 April 2026 02:27:15 +0000 (0:00:15.059) 0:00:18.405 ********* 2026-04-28 02:27:28.935417 | orchestrator | ok: [testbed-manager] 2026-04-28 02:27:28.935422 | orchestrator | 2026-04-28 02:27:28.935427 | orchestrator | TASK [osism.services.frr : Copy file: /etc/frr/daemons] ************************ 2026-04-28 02:27:28.935432 | orchestrator | Tuesday 28 April 2026 02:27:16 +0000 (0:00:01.108) 0:00:19.514 ********* 2026-04-28 02:27:28.935437 | orchestrator | changed: [testbed-manager] 2026-04-28 02:27:28.935441 | orchestrator | 2026-04-28 02:27:28.935446 | orchestrator | TASK [osism.services.frr : Set _frr_uplinks fact] ****************************** 2026-04-28 02:27:28.935451 | orchestrator | Tuesday 28 April 2026 02:27:18 +0000 (0:00:01.177) 0:00:20.692 ********* 2026-04-28 02:27:28.935455 | orchestrator | ok: [testbed-manager] 2026-04-28 02:27:28.935460 | orchestrator | 2026-04-28 02:27:28.935465 | orchestrator | TASK [osism.services.frr : Check for frr.conf file in the configuration repository] *** 2026-04-28 02:27:28.935471 | orchestrator | Tuesday 28 April 2026 02:27:19 +0000 (0:00:01.538) 0:00:22.231 ********* 2026-04-28 02:27:28.935475 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:27:28.935480 | orchestrator | 2026-04-28 02:27:28.935484 | orchestrator | TASK [osism.services.frr : Copy frr.conf file from the configuration repository] *** 2026-04-28 02:27:28.935489 | orchestrator | Tuesday 28 April 2026 02:27:19 +0000 (0:00:00.175) 0:00:22.406 ********* 2026-04-28 02:27:28.935508 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:27:28.935513 | orchestrator | 2026-04-28 02:27:28.935518 | orchestrator | TASK [osism.services.frr : Copy default frr.conf file of type k3s_cilium] ****** 2026-04-28 02:27:28.935522 | orchestrator | Tuesday 28 April 2026 02:27:19 +0000 (0:00:00.200) 0:00:22.606 ********* 2026-04-28 02:27:28.935527 | orchestrator | changed: [testbed-manager] 2026-04-28 02:27:28.935531 | orchestrator | 2026-04-28 02:27:28.935536 | orchestrator | TASK [osism.services.frr : Set sysctl parameters] ****************************** 2026-04-28 02:27:28.935540 | orchestrator | Tuesday 28 April 2026 02:27:21 +0000 (0:00:01.276) 0:00:23.883 ********* 2026-04-28 02:27:28.935545 | orchestrator | changed: [testbed-manager] => (item={'name': 'net.ipv4.ip_forward', 'value': 1}) 2026-04-28 02:27:28.935549 | orchestrator | changed: [testbed-manager] => (item={'name': 'net.ipv4.conf.all.send_redirects', 'value': 0}) 2026-04-28 02:27:28.935556 | orchestrator | changed: [testbed-manager] => (item={'name': 'net.ipv4.conf.all.accept_redirects', 'value': 0}) 2026-04-28 02:27:28.935560 | orchestrator | changed: [testbed-manager] => (item={'name': 'net.ipv4.fib_multipath_hash_policy', 'value': 1}) 2026-04-28 02:27:28.935565 | orchestrator | changed: [testbed-manager] => (item={'name': 'net.ipv4.conf.default.ignore_routes_with_linkdown', 'value': 1}) 2026-04-28 02:27:28.935569 | orchestrator | changed: [testbed-manager] => (item={'name': 'net.ipv4.conf.all.rp_filter', 'value': 2}) 2026-04-28 02:27:28.935574 | orchestrator | 2026-04-28 02:27:28.935578 | orchestrator | TASK [osism.services.frr : Manage frr service] ********************************* 2026-04-28 02:27:28.935583 | orchestrator | Tuesday 28 April 2026 02:27:24 +0000 (0:00:03.244) 0:00:27.127 ********* 2026-04-28 02:27:28.935588 | orchestrator | ok: [testbed-manager] 2026-04-28 02:27:28.935592 | orchestrator | 2026-04-28 02:27:28.935597 | orchestrator | RUNNING HANDLER [osism.services.frr : Restart frr service] ********************* 2026-04-28 02:27:28.935601 | orchestrator | Tuesday 28 April 2026 02:27:26 +0000 (0:00:02.080) 0:00:29.208 ********* 2026-04-28 02:27:28.935606 | orchestrator | changed: [testbed-manager] 2026-04-28 02:27:28.935610 | orchestrator | 2026-04-28 02:27:28.935615 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:27:28.935620 | orchestrator | testbed-manager : ok=10  changed=6  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:27:28.935624 | orchestrator | 2026-04-28 02:27:28.935629 | orchestrator | 2026-04-28 02:27:28.935637 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:27:28.935642 | orchestrator | Tuesday 28 April 2026 02:27:28 +0000 (0:00:01.854) 0:00:31.063 ********* 2026-04-28 02:27:28.935646 | orchestrator | =============================================================================== 2026-04-28 02:27:28.935651 | orchestrator | osism.services.frr : Install frr package ------------------------------- 15.06s 2026-04-28 02:27:28.935655 | orchestrator | osism.services.frr : Set sysctl parameters ------------------------------ 3.24s 2026-04-28 02:27:28.935660 | orchestrator | osism.services.frr : Manage frr service --------------------------------- 2.08s 2026-04-28 02:27:28.935665 | orchestrator | osism.services.frr : Pin frr package version ---------------------------- 1.96s 2026-04-28 02:27:28.935669 | orchestrator | osism.services.frr : Restart frr service -------------------------------- 1.86s 2026-04-28 02:27:28.935683 | orchestrator | osism.services.frr : Set _frr_uplinks fact ------------------------------ 1.54s 2026-04-28 02:27:28.935688 | orchestrator | osism.services.frr : Copy default frr.conf file of type k3s_cilium ------ 1.28s 2026-04-28 02:27:28.935693 | orchestrator | osism.services.frr : Copy file: /etc/frr/daemons ------------------------ 1.18s 2026-04-28 02:27:28.935697 | orchestrator | osism.services.frr : Copy file: /etc/frr/vtysh.conf --------------------- 1.11s 2026-04-28 02:27:28.935702 | orchestrator | osism.services.frr : Include distribution specific install tasks -------- 0.68s 2026-04-28 02:27:28.935707 | orchestrator | osism.services.frr : Copy frr.conf file from the configuration repository --- 0.20s 2026-04-28 02:27:28.935711 | orchestrator | osism.services.frr : Check for frr.conf file in the configuration repository --- 0.18s 2026-04-28 02:27:29.384787 | orchestrator | + osism apply kubernetes 2026-04-28 02:27:32.055489 | orchestrator | 2026-04-28 02:27:32 | INFO  | Task b5424be3-0dd0-4ac0-8d36-2e215b405f60 (kubernetes) was prepared for execution. 2026-04-28 02:27:32.055563 | orchestrator | 2026-04-28 02:27:32 | INFO  | It takes a moment until task b5424be3-0dd0-4ac0-8d36-2e215b405f60 (kubernetes) has been started and output is visible here. 2026-04-28 02:27:58.398590 | orchestrator | 2026-04-28 02:27:58.398666 | orchestrator | PLAY [Prepare all k3s nodes] *************************************************** 2026-04-28 02:27:58.398674 | orchestrator | 2026-04-28 02:27:58.398680 | orchestrator | TASK [k3s_prereq : Validating arguments against arg spec 'main' - Prerequisites] *** 2026-04-28 02:27:58.398687 | orchestrator | Tuesday 28 April 2026 02:27:37 +0000 (0:00:00.195) 0:00:00.195 ********* 2026-04-28 02:27:58.398692 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:27:58.398698 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:27:58.398703 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:27:58.398709 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:27:58.398714 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:27:58.398719 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:27:58.398724 | orchestrator | 2026-04-28 02:27:58.398730 | orchestrator | TASK [k3s_prereq : Set same timezone on every Server] ************************** 2026-04-28 02:27:58.398735 | orchestrator | Tuesday 28 April 2026 02:27:38 +0000 (0:00:00.744) 0:00:00.939 ********* 2026-04-28 02:27:58.398741 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:27:58.398747 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:27:58.398752 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:27:58.398757 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:27:58.398762 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:27:58.398767 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:27:58.398772 | orchestrator | 2026-04-28 02:27:58.398777 | orchestrator | TASK [k3s_prereq : Set SELinux to disabled state] ****************************** 2026-04-28 02:27:58.398784 | orchestrator | Tuesday 28 April 2026 02:27:38 +0000 (0:00:00.613) 0:00:01.553 ********* 2026-04-28 02:27:58.398789 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:27:58.398794 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:27:58.398799 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:27:58.398804 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:27:58.398809 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:27:58.398814 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:27:58.398819 | orchestrator | 2026-04-28 02:27:58.398824 | orchestrator | TASK [k3s_prereq : Enable IPv4 forwarding] ************************************* 2026-04-28 02:27:58.398829 | orchestrator | Tuesday 28 April 2026 02:27:39 +0000 (0:00:00.740) 0:00:02.294 ********* 2026-04-28 02:27:58.398870 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:27:58.398877 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:27:58.398882 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:27:58.398889 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:27:58.398895 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:27:58.398900 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:27:58.398905 | orchestrator | 2026-04-28 02:27:58.398910 | orchestrator | TASK [k3s_prereq : Enable IPv6 forwarding] ************************************* 2026-04-28 02:27:58.398916 | orchestrator | Tuesday 28 April 2026 02:27:41 +0000 (0:00:01.614) 0:00:03.908 ********* 2026-04-28 02:27:58.398921 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:27:58.398927 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:27:58.398932 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:27:58.398937 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:27:58.398942 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:27:58.398947 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:27:58.398952 | orchestrator | 2026-04-28 02:27:58.398957 | orchestrator | TASK [k3s_prereq : Enable IPv6 router advertisements] ************************** 2026-04-28 02:27:58.398962 | orchestrator | Tuesday 28 April 2026 02:27:42 +0000 (0:00:01.434) 0:00:05.342 ********* 2026-04-28 02:27:58.398967 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:27:58.398988 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:27:58.398993 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:27:58.398998 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:27:58.399003 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:27:58.399008 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:27:58.399013 | orchestrator | 2026-04-28 02:27:58.399024 | orchestrator | TASK [k3s_prereq : Add br_netfilter to /etc/modules-load.d/] ******************* 2026-04-28 02:27:58.399030 | orchestrator | Tuesday 28 April 2026 02:27:43 +0000 (0:00:01.165) 0:00:06.508 ********* 2026-04-28 02:27:58.399035 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:27:58.399040 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:27:58.399045 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:27:58.399050 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:27:58.399055 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:27:58.399060 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:27:58.399065 | orchestrator | 2026-04-28 02:27:58.399070 | orchestrator | TASK [k3s_prereq : Load br_netfilter] ****************************************** 2026-04-28 02:27:58.399075 | orchestrator | Tuesday 28 April 2026 02:27:44 +0000 (0:00:00.679) 0:00:07.187 ********* 2026-04-28 02:27:58.399080 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:27:58.399085 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:27:58.399090 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:27:58.399095 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:27:58.399100 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:27:58.399105 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:27:58.399110 | orchestrator | 2026-04-28 02:27:58.399115 | orchestrator | TASK [k3s_prereq : Set bridge-nf-call-iptables (just to be sure)] ************** 2026-04-28 02:27:58.399120 | orchestrator | Tuesday 28 April 2026 02:27:45 +0000 (0:00:00.918) 0:00:08.106 ********* 2026-04-28 02:27:58.399125 | orchestrator | skipping: [testbed-node-3] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-28 02:27:58.399130 | orchestrator | skipping: [testbed-node-3] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-28 02:27:58.399135 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:27:58.399140 | orchestrator | skipping: [testbed-node-4] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-28 02:27:58.399146 | orchestrator | skipping: [testbed-node-4] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-28 02:27:58.399152 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:27:58.399157 | orchestrator | skipping: [testbed-node-5] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-28 02:27:58.399163 | orchestrator | skipping: [testbed-node-5] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-28 02:27:58.399169 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:27:58.399175 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-28 02:27:58.399193 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-28 02:27:58.399199 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:27:58.399205 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-28 02:27:58.399211 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-28 02:27:58.399216 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:27:58.399223 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-28 02:27:58.399228 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-28 02:27:58.399234 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:27:58.399240 | orchestrator | 2026-04-28 02:27:58.399245 | orchestrator | TASK [k3s_prereq : Add /usr/local/bin to sudo secure_path] ********************* 2026-04-28 02:27:58.399250 | orchestrator | Tuesday 28 April 2026 02:27:46 +0000 (0:00:00.695) 0:00:08.801 ********* 2026-04-28 02:27:58.399255 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:27:58.399260 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:27:58.399266 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:27:58.399275 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:27:58.399280 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:27:58.399285 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:27:58.399290 | orchestrator | 2026-04-28 02:27:58.399296 | orchestrator | TASK [k3s_download : Validating arguments against arg spec 'main' - Manage the downloading of K3S binaries] *** 2026-04-28 02:27:58.399302 | orchestrator | Tuesday 28 April 2026 02:27:47 +0000 (0:00:01.319) 0:00:10.121 ********* 2026-04-28 02:27:58.399307 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:27:58.399312 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:27:58.399317 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:27:58.399322 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:27:58.399327 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:27:58.399332 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:27:58.399337 | orchestrator | 2026-04-28 02:27:58.399342 | orchestrator | TASK [k3s_download : Download k3s binary x64] ********************************** 2026-04-28 02:27:58.399347 | orchestrator | Tuesday 28 April 2026 02:27:48 +0000 (0:00:00.971) 0:00:11.093 ********* 2026-04-28 02:27:58.399352 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:27:58.399358 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:27:58.399363 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:27:58.399368 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:27:58.399373 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:27:58.399378 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:27:58.399383 | orchestrator | 2026-04-28 02:27:58.399388 | orchestrator | TASK [k3s_download : Download k3s binary arm64] ******************************** 2026-04-28 02:27:58.399393 | orchestrator | Tuesday 28 April 2026 02:27:53 +0000 (0:00:05.170) 0:00:16.263 ********* 2026-04-28 02:27:58.399400 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:27:58.399413 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:27:58.399421 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:27:58.399429 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:27:58.399436 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:27:58.399444 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:27:58.399452 | orchestrator | 2026-04-28 02:27:58.399460 | orchestrator | TASK [k3s_download : Download k3s binary armhf] ******************************** 2026-04-28 02:27:58.399469 | orchestrator | Tuesday 28 April 2026 02:27:54 +0000 (0:00:01.029) 0:00:17.293 ********* 2026-04-28 02:27:58.399476 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:27:58.399484 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:27:58.399493 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:27:58.399500 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:27:58.399508 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:27:58.399516 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:27:58.399524 | orchestrator | 2026-04-28 02:27:58.399533 | orchestrator | TASK [k3s_custom_registries : Validating arguments against arg spec 'main' - Configure the use of a custom container registry] *** 2026-04-28 02:27:58.399544 | orchestrator | Tuesday 28 April 2026 02:27:56 +0000 (0:00:01.738) 0:00:19.032 ********* 2026-04-28 02:27:58.399552 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:27:58.399561 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:27:58.399566 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:27:58.399571 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:27:58.399576 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:27:58.399581 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:27:58.399586 | orchestrator | 2026-04-28 02:27:58.399591 | orchestrator | TASK [k3s_custom_registries : Create directory /etc/rancher/k3s] *************** 2026-04-28 02:27:58.399596 | orchestrator | Tuesday 28 April 2026 02:27:57 +0000 (0:00:00.691) 0:00:19.723 ********* 2026-04-28 02:27:58.399601 | orchestrator | skipping: [testbed-node-3] => (item=rancher)  2026-04-28 02:27:58.399611 | orchestrator | skipping: [testbed-node-3] => (item=rancher/k3s)  2026-04-28 02:27:58.399616 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:27:58.399621 | orchestrator | skipping: [testbed-node-4] => (item=rancher)  2026-04-28 02:27:58.399632 | orchestrator | skipping: [testbed-node-4] => (item=rancher/k3s)  2026-04-28 02:27:58.399637 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:27:58.399642 | orchestrator | skipping: [testbed-node-5] => (item=rancher)  2026-04-28 02:27:58.399647 | orchestrator | skipping: [testbed-node-5] => (item=rancher/k3s)  2026-04-28 02:27:58.399652 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:27:58.399657 | orchestrator | skipping: [testbed-node-0] => (item=rancher)  2026-04-28 02:27:58.399662 | orchestrator | skipping: [testbed-node-0] => (item=rancher/k3s)  2026-04-28 02:27:58.399667 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:27:58.399672 | orchestrator | skipping: [testbed-node-1] => (item=rancher)  2026-04-28 02:27:58.399677 | orchestrator | skipping: [testbed-node-1] => (item=rancher/k3s)  2026-04-28 02:27:58.399682 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:27:58.399687 | orchestrator | skipping: [testbed-node-2] => (item=rancher)  2026-04-28 02:27:58.399692 | orchestrator | skipping: [testbed-node-2] => (item=rancher/k3s)  2026-04-28 02:27:58.399697 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:27:58.399702 | orchestrator | 2026-04-28 02:27:58.399707 | orchestrator | TASK [k3s_custom_registries : Insert registries into /etc/rancher/k3s/registries.yaml] *** 2026-04-28 02:27:58.399718 | orchestrator | Tuesday 28 April 2026 02:27:58 +0000 (0:00:01.255) 0:00:20.978 ********* 2026-04-28 02:29:17.761105 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:29:17.761219 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:29:17.761233 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:29:17.761243 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:29:17.761252 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:29:17.761261 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:29:17.761270 | orchestrator | 2026-04-28 02:29:17.761280 | orchestrator | TASK [k3s_custom_registries : Remove /etc/rancher/k3s/registries.yaml when no registries configured] *** 2026-04-28 02:29:17.761291 | orchestrator | Tuesday 28 April 2026 02:27:59 +0000 (0:00:00.684) 0:00:21.663 ********* 2026-04-28 02:29:17.761311 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:29:17.761320 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:29:17.761329 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:29:17.761338 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:29:17.761346 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:29:17.761355 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:29:17.761363 | orchestrator | 2026-04-28 02:29:17.761372 | orchestrator | PLAY [Deploy k3s master nodes] ************************************************* 2026-04-28 02:29:17.761381 | orchestrator | 2026-04-28 02:29:17.761389 | orchestrator | TASK [k3s_server : Validating arguments against arg spec 'main' - Setup k3s servers] *** 2026-04-28 02:29:17.761399 | orchestrator | Tuesday 28 April 2026 02:28:00 +0000 (0:00:01.428) 0:00:23.092 ********* 2026-04-28 02:29:17.761407 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:29:17.761417 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:29:17.761426 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:29:17.761435 | orchestrator | 2026-04-28 02:29:17.761443 | orchestrator | TASK [k3s_server : Stop k3s-init] ********************************************** 2026-04-28 02:29:17.761452 | orchestrator | Tuesday 28 April 2026 02:28:02 +0000 (0:00:01.871) 0:00:24.963 ********* 2026-04-28 02:29:17.761461 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:29:17.761469 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:29:17.761478 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:29:17.761486 | orchestrator | 2026-04-28 02:29:17.761495 | orchestrator | TASK [k3s_server : Stop k3s] *************************************************** 2026-04-28 02:29:17.761504 | orchestrator | Tuesday 28 April 2026 02:28:03 +0000 (0:00:01.382) 0:00:26.346 ********* 2026-04-28 02:29:17.761512 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:29:17.761521 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:29:17.761530 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:29:17.761539 | orchestrator | 2026-04-28 02:29:17.761548 | orchestrator | TASK [k3s_server : Clean previous runs of k3s-init] **************************** 2026-04-28 02:29:17.761575 | orchestrator | Tuesday 28 April 2026 02:28:04 +0000 (0:00:00.989) 0:00:27.335 ********* 2026-04-28 02:29:17.761585 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:29:17.761593 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:29:17.761601 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:29:17.761610 | orchestrator | 2026-04-28 02:29:17.761618 | orchestrator | TASK [k3s_server : Deploy K3s http_proxy conf] ********************************* 2026-04-28 02:29:17.761627 | orchestrator | Tuesday 28 April 2026 02:28:05 +0000 (0:00:00.931) 0:00:28.266 ********* 2026-04-28 02:29:17.761636 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:29:17.761644 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:29:17.761652 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:29:17.761661 | orchestrator | 2026-04-28 02:29:17.761670 | orchestrator | TASK [k3s_server : Create /etc/rancher/k3s directory] ************************** 2026-04-28 02:29:17.761694 | orchestrator | Tuesday 28 April 2026 02:28:06 +0000 (0:00:00.358) 0:00:28.625 ********* 2026-04-28 02:29:17.761703 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:29:17.761711 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:29:17.761720 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:29:17.761728 | orchestrator | 2026-04-28 02:29:17.761737 | orchestrator | TASK [k3s_server : Create custom resolv.conf for k3s] ************************** 2026-04-28 02:29:17.761746 | orchestrator | Tuesday 28 April 2026 02:28:07 +0000 (0:00:00.983) 0:00:29.609 ********* 2026-04-28 02:29:17.761754 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:29:17.761763 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:29:17.761771 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:29:17.761780 | orchestrator | 2026-04-28 02:29:17.761788 | orchestrator | TASK [k3s_server : Deploy vip manifest] **************************************** 2026-04-28 02:29:17.761797 | orchestrator | Tuesday 28 April 2026 02:28:08 +0000 (0:00:01.873) 0:00:31.483 ********* 2026-04-28 02:29:17.761805 | orchestrator | included: /ansible/roles/k3s_server/tasks/vip.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:29:17.761814 | orchestrator | 2026-04-28 02:29:17.761823 | orchestrator | TASK [k3s_server : Set _kube_vip_bgp_peers fact] ******************************* 2026-04-28 02:29:17.761832 | orchestrator | Tuesday 28 April 2026 02:28:09 +0000 (0:00:00.553) 0:00:32.036 ********* 2026-04-28 02:29:17.761840 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:29:17.761849 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:29:17.761857 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:29:17.761867 | orchestrator | 2026-04-28 02:29:17.761880 | orchestrator | TASK [k3s_server : Create manifests directory on first master] ***************** 2026-04-28 02:29:17.761894 | orchestrator | Tuesday 28 April 2026 02:28:11 +0000 (0:00:02.426) 0:00:34.463 ********* 2026-04-28 02:29:17.761908 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:29:17.761961 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:29:17.761978 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:29:17.761992 | orchestrator | 2026-04-28 02:29:17.762007 | orchestrator | TASK [k3s_server : Download vip rbac manifest to first master] ***************** 2026-04-28 02:29:17.762093 | orchestrator | Tuesday 28 April 2026 02:28:12 +0000 (0:00:00.608) 0:00:35.072 ********* 2026-04-28 02:29:17.762103 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:29:17.762112 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:29:17.762120 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:29:17.762129 | orchestrator | 2026-04-28 02:29:17.762138 | orchestrator | TASK [k3s_server : Copy vip manifest to first master] ************************** 2026-04-28 02:29:17.762146 | orchestrator | Tuesday 28 April 2026 02:28:13 +0000 (0:00:00.884) 0:00:35.956 ********* 2026-04-28 02:29:17.762155 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:29:17.762164 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:29:17.762172 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:29:17.762181 | orchestrator | 2026-04-28 02:29:17.762190 | orchestrator | TASK [k3s_server : Deploy metallb manifest] ************************************ 2026-04-28 02:29:17.762219 | orchestrator | Tuesday 28 April 2026 02:28:14 +0000 (0:00:01.558) 0:00:37.515 ********* 2026-04-28 02:29:17.762228 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:29:17.762248 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:29:17.762256 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:29:17.762265 | orchestrator | 2026-04-28 02:29:17.762274 | orchestrator | TASK [k3s_server : Deploy kube-vip manifest] *********************************** 2026-04-28 02:29:17.762282 | orchestrator | Tuesday 28 April 2026 02:28:15 +0000 (0:00:00.935) 0:00:38.451 ********* 2026-04-28 02:29:17.762291 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:29:17.762299 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:29:17.762308 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:29:17.762316 | orchestrator | 2026-04-28 02:29:17.762325 | orchestrator | TASK [k3s_server : Init cluster inside the transient k3s-init service] ********* 2026-04-28 02:29:17.762334 | orchestrator | Tuesday 28 April 2026 02:28:16 +0000 (0:00:00.433) 0:00:38.885 ********* 2026-04-28 02:29:17.762342 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:29:17.762351 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:29:17.762360 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:29:17.762368 | orchestrator | 2026-04-28 02:29:17.762384 | orchestrator | TASK [k3s_server : Detect Kubernetes version for label compatibility] ********** 2026-04-28 02:29:17.762393 | orchestrator | Tuesday 28 April 2026 02:28:17 +0000 (0:00:01.708) 0:00:40.593 ********* 2026-04-28 02:29:17.762401 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:29:17.762410 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:29:17.762419 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:29:17.762427 | orchestrator | 2026-04-28 02:29:17.762436 | orchestrator | TASK [k3s_server : Set node role label selector based on Kubernetes version] *** 2026-04-28 02:29:17.762445 | orchestrator | Tuesday 28 April 2026 02:28:21 +0000 (0:00:03.109) 0:00:43.703 ********* 2026-04-28 02:29:17.762453 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:29:17.762462 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:29:17.762470 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:29:17.762483 | orchestrator | 2026-04-28 02:29:17.762492 | orchestrator | TASK [k3s_server : Verify that all nodes actually joined (check k3s-init.service if this fails)] *** 2026-04-28 02:29:17.762501 | orchestrator | Tuesday 28 April 2026 02:28:21 +0000 (0:00:00.389) 0:00:44.093 ********* 2026-04-28 02:29:17.762510 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (20 retries left). 2026-04-28 02:29:17.762519 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (20 retries left). 2026-04-28 02:29:17.762528 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (20 retries left). 2026-04-28 02:29:17.762537 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (19 retries left). 2026-04-28 02:29:17.762546 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (19 retries left). 2026-04-28 02:29:17.762554 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (19 retries left). 2026-04-28 02:29:17.762563 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (18 retries left). 2026-04-28 02:29:17.762572 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (18 retries left). 2026-04-28 02:29:17.762580 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (18 retries left). 2026-04-28 02:29:17.762589 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (17 retries left). 2026-04-28 02:29:17.762598 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (17 retries left). 2026-04-28 02:29:17.762612 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (17 retries left). 2026-04-28 02:29:17.762621 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (16 retries left). 2026-04-28 02:29:17.762629 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:29:17.762638 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:29:17.762647 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:29:17.762655 | orchestrator | 2026-04-28 02:29:17.762664 | orchestrator | TASK [k3s_server : Save logs of k3s-init.service] ****************************** 2026-04-28 02:29:17.762673 | orchestrator | Tuesday 28 April 2026 02:29:15 +0000 (0:00:53.658) 0:01:37.751 ********* 2026-04-28 02:29:17.762681 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:29:17.762690 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:29:17.762699 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:29:17.762707 | orchestrator | 2026-04-28 02:29:17.762716 | orchestrator | TASK [k3s_server : Kill the temporary service used for initialization] ********* 2026-04-28 02:29:17.762729 | orchestrator | Tuesday 28 April 2026 02:29:15 +0000 (0:00:00.349) 0:01:38.101 ********* 2026-04-28 02:29:17.762738 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:29:17.762747 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:29:17.762755 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:29:17.762764 | orchestrator | 2026-04-28 02:29:17.762772 | orchestrator | TASK [k3s_server : Copy K3s service file] ************************************** 2026-04-28 02:29:17.762781 | orchestrator | Tuesday 28 April 2026 02:29:16 +0000 (0:00:00.984) 0:01:39.086 ********* 2026-04-28 02:29:17.762796 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:29:59.078625 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:29:59.078715 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:29:59.078727 | orchestrator | 2026-04-28 02:29:59.078737 | orchestrator | TASK [k3s_server : Enable and check K3s service] ******************************* 2026-04-28 02:29:59.078747 | orchestrator | Tuesday 28 April 2026 02:29:17 +0000 (0:00:01.263) 0:01:40.349 ********* 2026-04-28 02:29:59.078755 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:29:59.078763 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:29:59.078771 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:29:59.078778 | orchestrator | 2026-04-28 02:29:59.078787 | orchestrator | TASK [k3s_server : Wait for node-token] **************************************** 2026-04-28 02:29:59.078794 | orchestrator | Tuesday 28 April 2026 02:29:43 +0000 (0:00:25.283) 0:02:05.633 ********* 2026-04-28 02:29:59.078803 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:29:59.078811 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:29:59.078819 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:29:59.078827 | orchestrator | 2026-04-28 02:29:59.078835 | orchestrator | TASK [k3s_server : Register node-token file access mode] *********************** 2026-04-28 02:29:59.078843 | orchestrator | Tuesday 28 April 2026 02:29:43 +0000 (0:00:00.802) 0:02:06.435 ********* 2026-04-28 02:29:59.078850 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:29:59.078858 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:29:59.078866 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:29:59.078874 | orchestrator | 2026-04-28 02:29:59.078882 | orchestrator | TASK [k3s_server : Change file access node-token] ****************************** 2026-04-28 02:29:59.078890 | orchestrator | Tuesday 28 April 2026 02:29:44 +0000 (0:00:00.709) 0:02:07.145 ********* 2026-04-28 02:29:59.078898 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:29:59.078906 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:29:59.078914 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:29:59.078922 | orchestrator | 2026-04-28 02:29:59.078930 | orchestrator | TASK [k3s_server : Read node-token from master] ******************************** 2026-04-28 02:29:59.078938 | orchestrator | Tuesday 28 April 2026 02:29:45 +0000 (0:00:00.624) 0:02:07.769 ********* 2026-04-28 02:29:59.078945 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:29:59.078953 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:29:59.079012 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:29:59.079020 | orchestrator | 2026-04-28 02:29:59.079048 | orchestrator | TASK [k3s_server : Store Master node-token] ************************************ 2026-04-28 02:29:59.079056 | orchestrator | Tuesday 28 April 2026 02:29:46 +0000 (0:00:00.910) 0:02:08.679 ********* 2026-04-28 02:29:59.079064 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:29:59.079072 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:29:59.079080 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:29:59.079087 | orchestrator | 2026-04-28 02:29:59.079095 | orchestrator | TASK [k3s_server : Restore node-token file access] ***************************** 2026-04-28 02:29:59.079103 | orchestrator | Tuesday 28 April 2026 02:29:46 +0000 (0:00:00.350) 0:02:09.030 ********* 2026-04-28 02:29:59.079111 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:29:59.079119 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:29:59.079127 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:29:59.079134 | orchestrator | 2026-04-28 02:29:59.079142 | orchestrator | TASK [k3s_server : Create directory .kube] ************************************* 2026-04-28 02:29:59.079150 | orchestrator | Tuesday 28 April 2026 02:29:47 +0000 (0:00:00.731) 0:02:09.762 ********* 2026-04-28 02:29:59.079158 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:29:59.079165 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:29:59.079173 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:29:59.079182 | orchestrator | 2026-04-28 02:29:59.079192 | orchestrator | TASK [k3s_server : Copy config file to user home directory] ******************** 2026-04-28 02:29:59.079201 | orchestrator | Tuesday 28 April 2026 02:29:47 +0000 (0:00:00.644) 0:02:10.407 ********* 2026-04-28 02:29:59.079210 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:29:59.079219 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:29:59.079229 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:29:59.079237 | orchestrator | 2026-04-28 02:29:59.079246 | orchestrator | TASK [k3s_server : Configure kubectl cluster to https://192.168.16.8:6443] ***** 2026-04-28 02:29:59.079256 | orchestrator | Tuesday 28 April 2026 02:29:48 +0000 (0:00:00.910) 0:02:11.317 ********* 2026-04-28 02:29:59.079264 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:29:59.079273 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:29:59.079283 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:29:59.079292 | orchestrator | 2026-04-28 02:29:59.079302 | orchestrator | TASK [k3s_server : Create kubectl symlink] ************************************* 2026-04-28 02:29:59.079311 | orchestrator | Tuesday 28 April 2026 02:29:49 +0000 (0:00:01.117) 0:02:12.435 ********* 2026-04-28 02:29:59.079320 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:29:59.079329 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:29:59.079341 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:29:59.079350 | orchestrator | 2026-04-28 02:29:59.079359 | orchestrator | TASK [k3s_server : Create crictl symlink] ************************************** 2026-04-28 02:29:59.079368 | orchestrator | Tuesday 28 April 2026 02:29:50 +0000 (0:00:00.311) 0:02:12.746 ********* 2026-04-28 02:29:59.079377 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:29:59.079386 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:29:59.079395 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:29:59.079404 | orchestrator | 2026-04-28 02:29:59.079413 | orchestrator | TASK [k3s_server : Get contents of manifests folder] *************************** 2026-04-28 02:29:59.079422 | orchestrator | Tuesday 28 April 2026 02:29:50 +0000 (0:00:00.352) 0:02:13.098 ********* 2026-04-28 02:29:59.079431 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:29:59.079440 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:29:59.079449 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:29:59.079458 | orchestrator | 2026-04-28 02:29:59.079467 | orchestrator | TASK [k3s_server : Get sub dirs of manifests folder] *************************** 2026-04-28 02:29:59.079476 | orchestrator | Tuesday 28 April 2026 02:29:51 +0000 (0:00:00.647) 0:02:13.745 ********* 2026-04-28 02:29:59.079485 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:29:59.079494 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:29:59.079502 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:29:59.079511 | orchestrator | 2026-04-28 02:29:59.079521 | orchestrator | TASK [k3s_server : Remove manifests and folders that are only needed for bootstrapping cluster so k3s doesn't auto apply on start] *** 2026-04-28 02:29:59.079539 | orchestrator | Tuesday 28 April 2026 02:29:52 +0000 (0:00:00.876) 0:02:14.621 ********* 2026-04-28 02:29:59.079561 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/rolebindings.yaml) 2026-04-28 02:29:59.079571 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/rolebindings.yaml) 2026-04-28 02:29:59.079581 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/rolebindings.yaml) 2026-04-28 02:29:59.079590 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/local-storage.yaml) 2026-04-28 02:29:59.079599 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/local-storage.yaml) 2026-04-28 02:29:59.079607 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/local-storage.yaml) 2026-04-28 02:29:59.079615 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/coredns.yaml) 2026-04-28 02:29:59.079623 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/coredns.yaml) 2026-04-28 02:29:59.079631 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/coredns.yaml) 2026-04-28 02:29:59.079639 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/runtimes.yaml) 2026-04-28 02:29:59.079647 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/vip.yaml) 2026-04-28 02:29:59.079655 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/runtimes.yaml) 2026-04-28 02:29:59.079662 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/vip-rbac.yaml) 2026-04-28 02:29:59.079670 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/ccm.yaml) 2026-04-28 02:29:59.079678 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/ccm.yaml) 2026-04-28 02:29:59.079686 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/metrics-server) 2026-04-28 02:29:59.079693 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/runtimes.yaml) 2026-04-28 02:29:59.079701 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/metrics-server) 2026-04-28 02:29:59.079709 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/ccm.yaml) 2026-04-28 02:29:59.079716 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/metrics-server) 2026-04-28 02:29:59.079724 | orchestrator | 2026-04-28 02:29:59.079732 | orchestrator | PLAY [Deploy k3s worker nodes] ************************************************* 2026-04-28 02:29:59.079740 | orchestrator | 2026-04-28 02:29:59.079748 | orchestrator | TASK [k3s_agent : Validating arguments against arg spec 'main' - Setup k3s agents] *** 2026-04-28 02:29:59.079758 | orchestrator | Tuesday 28 April 2026 02:29:55 +0000 (0:00:03.058) 0:02:17.680 ********* 2026-04-28 02:29:59.079771 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:29:59.079783 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:29:59.079796 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:29:59.079808 | orchestrator | 2026-04-28 02:29:59.079821 | orchestrator | TASK [k3s_agent : Check if system is PXE-booted] ******************************* 2026-04-28 02:29:59.079834 | orchestrator | Tuesday 28 April 2026 02:29:55 +0000 (0:00:00.363) 0:02:18.044 ********* 2026-04-28 02:29:59.079846 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:29:59.079858 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:29:59.079869 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:29:59.079882 | orchestrator | 2026-04-28 02:29:59.079894 | orchestrator | TASK [k3s_agent : Set fact for PXE-booted system] ****************************** 2026-04-28 02:29:59.079923 | orchestrator | Tuesday 28 April 2026 02:29:56 +0000 (0:00:00.883) 0:02:18.928 ********* 2026-04-28 02:29:59.079937 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:29:59.079951 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:29:59.079992 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:29:59.080007 | orchestrator | 2026-04-28 02:29:59.080027 | orchestrator | TASK [k3s_agent : Include http_proxy configuration tasks] ********************** 2026-04-28 02:29:59.080039 | orchestrator | Tuesday 28 April 2026 02:29:56 +0000 (0:00:00.357) 0:02:19.285 ********* 2026-04-28 02:29:59.080053 | orchestrator | included: /ansible/roles/k3s_agent/tasks/http_proxy.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 02:29:59.080067 | orchestrator | 2026-04-28 02:29:59.080080 | orchestrator | TASK [k3s_agent : Create k3s-node.service.d directory] ************************* 2026-04-28 02:29:59.080094 | orchestrator | Tuesday 28 April 2026 02:29:57 +0000 (0:00:00.497) 0:02:19.783 ********* 2026-04-28 02:29:59.080107 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:29:59.080121 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:29:59.080135 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:29:59.080148 | orchestrator | 2026-04-28 02:29:59.080161 | orchestrator | TASK [k3s_agent : Copy K3s http_proxy conf file] ******************************* 2026-04-28 02:29:59.080174 | orchestrator | Tuesday 28 April 2026 02:29:57 +0000 (0:00:00.548) 0:02:20.331 ********* 2026-04-28 02:29:59.080188 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:29:59.080201 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:29:59.080214 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:29:59.080227 | orchestrator | 2026-04-28 02:29:59.080240 | orchestrator | TASK [k3s_agent : Deploy K3s http_proxy conf] ********************************** 2026-04-28 02:29:59.080255 | orchestrator | Tuesday 28 April 2026 02:29:58 +0000 (0:00:00.323) 0:02:20.654 ********* 2026-04-28 02:29:59.080268 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:29:59.080282 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:29:59.080295 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:29:59.080308 | orchestrator | 2026-04-28 02:29:59.080321 | orchestrator | TASK [k3s_agent : Create /etc/rancher/k3s directory] *************************** 2026-04-28 02:29:59.080334 | orchestrator | Tuesday 28 April 2026 02:29:58 +0000 (0:00:00.353) 0:02:21.007 ********* 2026-04-28 02:29:59.080359 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:32:00.776020 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:32:00.776111 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:32:00.776121 | orchestrator | 2026-04-28 02:32:00.776129 | orchestrator | TASK [k3s_agent : Create custom resolv.conf for k3s] *************************** 2026-04-28 02:32:00.776136 | orchestrator | Tuesday 28 April 2026 02:29:59 +0000 (0:00:00.657) 0:02:21.665 ********* 2026-04-28 02:32:00.776140 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:32:00.776144 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:32:00.776148 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:32:00.776152 | orchestrator | 2026-04-28 02:32:00.776157 | orchestrator | TASK [k3s_agent : Configure the k3s service] *********************************** 2026-04-28 02:32:00.776161 | orchestrator | Tuesday 28 April 2026 02:30:00 +0000 (0:00:01.348) 0:02:23.013 ********* 2026-04-28 02:32:00.776165 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:32:00.776169 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:32:00.776173 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:32:00.776177 | orchestrator | 2026-04-28 02:32:00.776181 | orchestrator | TASK [k3s_agent : Manage k3s service] ****************************************** 2026-04-28 02:32:00.776184 | orchestrator | Tuesday 28 April 2026 02:30:01 +0000 (0:00:01.270) 0:02:24.284 ********* 2026-04-28 02:32:00.776188 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:32:00.776192 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:32:00.776196 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:32:00.776200 | orchestrator | 2026-04-28 02:32:00.776204 | orchestrator | PLAY [Prepare kubeconfig file] ************************************************* 2026-04-28 02:32:00.776207 | orchestrator | 2026-04-28 02:32:00.776211 | orchestrator | TASK [Get home directory of operator user] ************************************* 2026-04-28 02:32:00.776215 | orchestrator | Tuesday 28 April 2026 02:30:12 +0000 (0:00:10.352) 0:02:34.636 ********* 2026-04-28 02:32:00.776219 | orchestrator | ok: [testbed-manager] 2026-04-28 02:32:00.776238 | orchestrator | 2026-04-28 02:32:00.776242 | orchestrator | TASK [Create .kube directory] ************************************************** 2026-04-28 02:32:00.776246 | orchestrator | Tuesday 28 April 2026 02:30:12 +0000 (0:00:00.850) 0:02:35.487 ********* 2026-04-28 02:32:00.776250 | orchestrator | changed: [testbed-manager] 2026-04-28 02:32:00.776254 | orchestrator | 2026-04-28 02:32:00.776258 | orchestrator | TASK [Get kubeconfig file] ***************************************************** 2026-04-28 02:32:00.776262 | orchestrator | Tuesday 28 April 2026 02:30:13 +0000 (0:00:00.748) 0:02:36.235 ********* 2026-04-28 02:32:00.776265 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] 2026-04-28 02:32:00.776269 | orchestrator | 2026-04-28 02:32:00.776273 | orchestrator | TASK [Write kubeconfig file] *************************************************** 2026-04-28 02:32:00.776277 | orchestrator | Tuesday 28 April 2026 02:30:14 +0000 (0:00:00.556) 0:02:36.791 ********* 2026-04-28 02:32:00.776281 | orchestrator | changed: [testbed-manager] 2026-04-28 02:32:00.776285 | orchestrator | 2026-04-28 02:32:00.776288 | orchestrator | TASK [Change server address in the kubeconfig] ********************************* 2026-04-28 02:32:00.776292 | orchestrator | Tuesday 28 April 2026 02:30:15 +0000 (0:00:00.946) 0:02:37.738 ********* 2026-04-28 02:32:00.776296 | orchestrator | changed: [testbed-manager] 2026-04-28 02:32:00.776300 | orchestrator | 2026-04-28 02:32:00.776304 | orchestrator | TASK [Make kubeconfig available for use inside the manager service] ************ 2026-04-28 02:32:00.776307 | orchestrator | Tuesday 28 April 2026 02:30:15 +0000 (0:00:00.654) 0:02:38.393 ********* 2026-04-28 02:32:00.776311 | orchestrator | changed: [testbed-manager -> localhost] 2026-04-28 02:32:00.776315 | orchestrator | 2026-04-28 02:32:00.776319 | orchestrator | TASK [Change server address in the kubeconfig inside the manager service] ****** 2026-04-28 02:32:00.776323 | orchestrator | Tuesday 28 April 2026 02:30:17 +0000 (0:00:01.805) 0:02:40.199 ********* 2026-04-28 02:32:00.776327 | orchestrator | changed: [testbed-manager -> localhost] 2026-04-28 02:32:00.776331 | orchestrator | 2026-04-28 02:32:00.776335 | orchestrator | TASK [Set KUBECONFIG environment variable] ************************************* 2026-04-28 02:32:00.776338 | orchestrator | Tuesday 28 April 2026 02:30:18 +0000 (0:00:00.888) 0:02:41.087 ********* 2026-04-28 02:32:00.776342 | orchestrator | changed: [testbed-manager] 2026-04-28 02:32:00.776346 | orchestrator | 2026-04-28 02:32:00.776350 | orchestrator | TASK [Enable kubectl command line completion] ********************************** 2026-04-28 02:32:00.776353 | orchestrator | Tuesday 28 April 2026 02:30:19 +0000 (0:00:00.569) 0:02:41.657 ********* 2026-04-28 02:32:00.776370 | orchestrator | changed: [testbed-manager] 2026-04-28 02:32:00.776374 | orchestrator | 2026-04-28 02:32:00.776378 | orchestrator | PLAY [Apply role kubectl] ****************************************************** 2026-04-28 02:32:00.776382 | orchestrator | 2026-04-28 02:32:00.776386 | orchestrator | TASK [kubectl : Gather variables for each operating system] ******************** 2026-04-28 02:32:00.776390 | orchestrator | Tuesday 28 April 2026 02:30:19 +0000 (0:00:00.511) 0:02:42.168 ********* 2026-04-28 02:32:00.776394 | orchestrator | ok: [testbed-manager] 2026-04-28 02:32:00.776398 | orchestrator | 2026-04-28 02:32:00.776402 | orchestrator | TASK [kubectl : Include distribution specific install tasks] ******************* 2026-04-28 02:32:00.776406 | orchestrator | Tuesday 28 April 2026 02:30:19 +0000 (0:00:00.171) 0:02:42.339 ********* 2026-04-28 02:32:00.776410 | orchestrator | included: /ansible/roles/kubectl/tasks/install-Debian-family.yml for testbed-manager 2026-04-28 02:32:00.776414 | orchestrator | 2026-04-28 02:32:00.776418 | orchestrator | TASK [kubectl : Remove old architecture-dependent repository] ****************** 2026-04-28 02:32:00.776422 | orchestrator | Tuesday 28 April 2026 02:30:20 +0000 (0:00:00.478) 0:02:42.817 ********* 2026-04-28 02:32:00.776426 | orchestrator | ok: [testbed-manager] 2026-04-28 02:32:00.776429 | orchestrator | 2026-04-28 02:32:00.776433 | orchestrator | TASK [kubectl : Install apt-transport-https package] *************************** 2026-04-28 02:32:00.776437 | orchestrator | Tuesday 28 April 2026 02:30:21 +0000 (0:00:00.924) 0:02:43.742 ********* 2026-04-28 02:32:00.776443 | orchestrator | ok: [testbed-manager] 2026-04-28 02:32:00.776449 | orchestrator | 2026-04-28 02:32:00.776456 | orchestrator | TASK [kubectl : Add repository gpg key] **************************************** 2026-04-28 02:32:00.776467 | orchestrator | Tuesday 28 April 2026 02:30:22 +0000 (0:00:01.773) 0:02:45.515 ********* 2026-04-28 02:32:00.776472 | orchestrator | changed: [testbed-manager] 2026-04-28 02:32:00.776478 | orchestrator | 2026-04-28 02:32:00.776484 | orchestrator | TASK [kubectl : Set permissions of gpg key] ************************************ 2026-04-28 02:32:00.776503 | orchestrator | Tuesday 28 April 2026 02:30:23 +0000 (0:00:00.851) 0:02:46.367 ********* 2026-04-28 02:32:00.776509 | orchestrator | ok: [testbed-manager] 2026-04-28 02:32:00.776515 | orchestrator | 2026-04-28 02:32:00.776520 | orchestrator | TASK [kubectl : Add repository Debian] ***************************************** 2026-04-28 02:32:00.776526 | orchestrator | Tuesday 28 April 2026 02:30:24 +0000 (0:00:00.512) 0:02:46.879 ********* 2026-04-28 02:32:00.776531 | orchestrator | changed: [testbed-manager] 2026-04-28 02:32:00.776537 | orchestrator | 2026-04-28 02:32:00.776542 | orchestrator | TASK [kubectl : Install required packages] ************************************* 2026-04-28 02:32:00.776548 | orchestrator | Tuesday 28 April 2026 02:30:32 +0000 (0:00:08.565) 0:02:55.445 ********* 2026-04-28 02:32:00.776553 | orchestrator | changed: [testbed-manager] 2026-04-28 02:32:00.776558 | orchestrator | 2026-04-28 02:32:00.776564 | orchestrator | TASK [kubectl : Remove kubectl symlink] **************************************** 2026-04-28 02:32:00.776570 | orchestrator | Tuesday 28 April 2026 02:30:46 +0000 (0:00:13.417) 0:03:08.863 ********* 2026-04-28 02:32:00.776576 | orchestrator | ok: [testbed-manager] 2026-04-28 02:32:00.776582 | orchestrator | 2026-04-28 02:32:00.776588 | orchestrator | PLAY [Run post actions on master nodes] **************************************** 2026-04-28 02:32:00.776593 | orchestrator | 2026-04-28 02:32:00.776599 | orchestrator | TASK [k3s_server_post : Validating arguments against arg spec 'main' - Configure k3s cluster] *** 2026-04-28 02:32:00.776605 | orchestrator | Tuesday 28 April 2026 02:30:47 +0000 (0:00:00.804) 0:03:09.667 ********* 2026-04-28 02:32:00.776611 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:32:00.776618 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:32:00.776624 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:32:00.776630 | orchestrator | 2026-04-28 02:32:00.776636 | orchestrator | TASK [k3s_server_post : Deploy calico] ***************************************** 2026-04-28 02:32:00.776643 | orchestrator | Tuesday 28 April 2026 02:30:47 +0000 (0:00:00.347) 0:03:10.014 ********* 2026-04-28 02:32:00.776649 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:32:00.776654 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:32:00.776659 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:32:00.776663 | orchestrator | 2026-04-28 02:32:00.776667 | orchestrator | TASK [k3s_server_post : Deploy cilium] ***************************************** 2026-04-28 02:32:00.776672 | orchestrator | Tuesday 28 April 2026 02:30:47 +0000 (0:00:00.336) 0:03:10.351 ********* 2026-04-28 02:32:00.776677 | orchestrator | included: /ansible/roles/k3s_server_post/tasks/cilium.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:32:00.776681 | orchestrator | 2026-04-28 02:32:00.776686 | orchestrator | TASK [k3s_server_post : Create tmp directory on first master] ****************** 2026-04-28 02:32:00.776690 | orchestrator | Tuesday 28 April 2026 02:30:48 +0000 (0:00:00.764) 0:03:11.115 ********* 2026-04-28 02:32:00.776695 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-28 02:32:00.776699 | orchestrator | 2026-04-28 02:32:00.776704 | orchestrator | TASK [k3s_server_post : Wait for connectivity to kube VIP] ********************* 2026-04-28 02:32:00.776708 | orchestrator | Tuesday 28 April 2026 02:30:49 +0000 (0:00:00.982) 0:03:12.098 ********* 2026-04-28 02:32:00.776712 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 02:32:00.776717 | orchestrator | 2026-04-28 02:32:00.776721 | orchestrator | TASK [k3s_server_post : Fail if kube VIP not reachable] ************************ 2026-04-28 02:32:00.776725 | orchestrator | Tuesday 28 April 2026 02:30:50 +0000 (0:00:00.915) 0:03:13.013 ********* 2026-04-28 02:32:00.776729 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:32:00.776734 | orchestrator | 2026-04-28 02:32:00.776738 | orchestrator | TASK [k3s_server_post : Test for existing Cilium install] ********************** 2026-04-28 02:32:00.776743 | orchestrator | Tuesday 28 April 2026 02:30:50 +0000 (0:00:00.135) 0:03:13.149 ********* 2026-04-28 02:32:00.776753 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 02:32:00.776757 | orchestrator | 2026-04-28 02:32:00.776761 | orchestrator | TASK [k3s_server_post : Check Cilium version] ********************************** 2026-04-28 02:32:00.776766 | orchestrator | Tuesday 28 April 2026 02:30:51 +0000 (0:00:01.103) 0:03:14.252 ********* 2026-04-28 02:32:00.776770 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:32:00.776775 | orchestrator | 2026-04-28 02:32:00.776779 | orchestrator | TASK [k3s_server_post : Parse installed Cilium version] ************************ 2026-04-28 02:32:00.776784 | orchestrator | Tuesday 28 April 2026 02:30:51 +0000 (0:00:00.133) 0:03:14.386 ********* 2026-04-28 02:32:00.776788 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:32:00.776792 | orchestrator | 2026-04-28 02:32:00.776797 | orchestrator | TASK [k3s_server_post : Determine if Cilium needs update] ********************** 2026-04-28 02:32:00.776801 | orchestrator | Tuesday 28 April 2026 02:30:51 +0000 (0:00:00.144) 0:03:14.530 ********* 2026-04-28 02:32:00.776805 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:32:00.776810 | orchestrator | 2026-04-28 02:32:00.776814 | orchestrator | TASK [k3s_server_post : Log result] ******************************************** 2026-04-28 02:32:00.776819 | orchestrator | Tuesday 28 April 2026 02:30:52 +0000 (0:00:00.139) 0:03:14.669 ********* 2026-04-28 02:32:00.776823 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:32:00.776827 | orchestrator | 2026-04-28 02:32:00.776832 | orchestrator | TASK [k3s_server_post : Install Cilium] **************************************** 2026-04-28 02:32:00.776836 | orchestrator | Tuesday 28 April 2026 02:30:52 +0000 (0:00:00.124) 0:03:14.793 ********* 2026-04-28 02:32:00.776841 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-28 02:32:00.776845 | orchestrator | 2026-04-28 02:32:00.776854 | orchestrator | TASK [k3s_server_post : Wait for Cilium resources] ***************************** 2026-04-28 02:32:00.776859 | orchestrator | Tuesday 28 April 2026 02:30:57 +0000 (0:00:05.602) 0:03:20.396 ********* 2026-04-28 02:32:00.776864 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=deployment/cilium-operator) 2026-04-28 02:32:00.776868 | orchestrator | FAILED - RETRYING: [testbed-node-0 -> localhost]: Wait for Cilium resources (30 retries left). 2026-04-28 02:32:00.776874 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=daemonset/cilium) 2026-04-28 02:32:00.776878 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=deployment/hubble-relay) 2026-04-28 02:32:00.776883 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=deployment/hubble-ui) 2026-04-28 02:32:00.776887 | orchestrator | 2026-04-28 02:32:00.776892 | orchestrator | TASK [k3s_server_post : Set _cilium_bgp_neighbors fact] ************************ 2026-04-28 02:32:00.776901 | orchestrator | Tuesday 28 April 2026 02:32:00 +0000 (0:01:02.961) 0:04:23.358 ********* 2026-04-28 02:32:25.403554 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 02:32:25.403636 | orchestrator | 2026-04-28 02:32:25.403646 | orchestrator | TASK [k3s_server_post : Copy BGP manifests to first master] ******************** 2026-04-28 02:32:25.403653 | orchestrator | Tuesday 28 April 2026 02:32:02 +0000 (0:00:01.368) 0:04:24.727 ********* 2026-04-28 02:32:25.403659 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-28 02:32:25.403665 | orchestrator | 2026-04-28 02:32:25.403670 | orchestrator | TASK [k3s_server_post : Apply BGP manifests] *********************************** 2026-04-28 02:32:25.403676 | orchestrator | Tuesday 28 April 2026 02:32:03 +0000 (0:00:01.679) 0:04:26.406 ********* 2026-04-28 02:32:25.403682 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-28 02:32:25.403687 | orchestrator | 2026-04-28 02:32:25.403693 | orchestrator | TASK [k3s_server_post : Print error message if BGP manifests application fails] *** 2026-04-28 02:32:25.403699 | orchestrator | Tuesday 28 April 2026 02:32:05 +0000 (0:00:01.345) 0:04:27.751 ********* 2026-04-28 02:32:25.403705 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:32:25.403710 | orchestrator | 2026-04-28 02:32:25.403716 | orchestrator | TASK [k3s_server_post : Test for BGP config resources] ************************* 2026-04-28 02:32:25.403721 | orchestrator | Tuesday 28 April 2026 02:32:05 +0000 (0:00:00.121) 0:04:27.872 ********* 2026-04-28 02:32:25.403745 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=kubectl get CiliumBGPPeeringPolicy.cilium.io) 2026-04-28 02:32:25.403752 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=kubectl get CiliumLoadBalancerIPPool.cilium.io) 2026-04-28 02:32:25.403758 | orchestrator | 2026-04-28 02:32:25.403763 | orchestrator | TASK [k3s_server_post : Deploy metallb pool] *********************************** 2026-04-28 02:32:25.403769 | orchestrator | Tuesday 28 April 2026 02:32:07 +0000 (0:00:01.926) 0:04:29.799 ********* 2026-04-28 02:32:25.403774 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:32:25.403779 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:32:25.403785 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:32:25.403790 | orchestrator | 2026-04-28 02:32:25.403796 | orchestrator | TASK [k3s_server_post : Remove tmp directory used for manifests] *************** 2026-04-28 02:32:25.403801 | orchestrator | Tuesday 28 April 2026 02:32:07 +0000 (0:00:00.341) 0:04:30.141 ********* 2026-04-28 02:32:25.403806 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:32:25.403812 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:32:25.403817 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:32:25.403822 | orchestrator | 2026-04-28 02:32:25.403828 | orchestrator | PLAY [Apply role k9s] ********************************************************** 2026-04-28 02:32:25.403833 | orchestrator | 2026-04-28 02:32:25.403839 | orchestrator | TASK [k9s : Gather variables for each operating system] ************************ 2026-04-28 02:32:25.403844 | orchestrator | Tuesday 28 April 2026 02:32:08 +0000 (0:00:00.911) 0:04:31.052 ********* 2026-04-28 02:32:25.403850 | orchestrator | ok: [testbed-manager] 2026-04-28 02:32:25.403855 | orchestrator | 2026-04-28 02:32:25.403861 | orchestrator | TASK [k9s : Include distribution specific install tasks] *********************** 2026-04-28 02:32:25.403866 | orchestrator | Tuesday 28 April 2026 02:32:08 +0000 (0:00:00.362) 0:04:31.415 ********* 2026-04-28 02:32:25.403872 | orchestrator | included: /ansible/roles/k9s/tasks/install-Debian-family.yml for testbed-manager 2026-04-28 02:32:25.403877 | orchestrator | 2026-04-28 02:32:25.403883 | orchestrator | TASK [k9s : Install k9s packages] ********************************************** 2026-04-28 02:32:25.403888 | orchestrator | Tuesday 28 April 2026 02:32:09 +0000 (0:00:00.285) 0:04:31.701 ********* 2026-04-28 02:32:25.403894 | orchestrator | changed: [testbed-manager] 2026-04-28 02:32:25.403899 | orchestrator | 2026-04-28 02:32:25.403904 | orchestrator | PLAY [Manage labels, annotations, and taints on all k3s nodes] ***************** 2026-04-28 02:32:25.403910 | orchestrator | 2026-04-28 02:32:25.403915 | orchestrator | TASK [Merge labels, annotations, and taints] *********************************** 2026-04-28 02:32:25.403920 | orchestrator | Tuesday 28 April 2026 02:32:14 +0000 (0:00:05.622) 0:04:37.323 ********* 2026-04-28 02:32:25.403926 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:32:25.403931 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:32:25.403937 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:32:25.403942 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:32:25.403947 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:32:25.403953 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:32:25.403958 | orchestrator | 2026-04-28 02:32:25.403964 | orchestrator | TASK [Manage labels] *********************************************************** 2026-04-28 02:32:25.403969 | orchestrator | Tuesday 28 April 2026 02:32:15 +0000 (0:00:00.625) 0:04:37.949 ********* 2026-04-28 02:32:25.403975 | orchestrator | ok: [testbed-node-3 -> localhost] => (item=node-role.osism.tech/compute-plane=true) 2026-04-28 02:32:25.403981 | orchestrator | ok: [testbed-node-5 -> localhost] => (item=node-role.osism.tech/compute-plane=true) 2026-04-28 02:32:25.403986 | orchestrator | ok: [testbed-node-4 -> localhost] => (item=node-role.osism.tech/compute-plane=true) 2026-04-28 02:32:25.403991 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/control-plane=true) 2026-04-28 02:32:25.403997 | orchestrator | ok: [testbed-node-3 -> localhost] => (item=node-role.kubernetes.io/worker=worker) 2026-04-28 02:32:25.404002 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/control-plane=true) 2026-04-28 02:32:25.404007 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/control-plane=true) 2026-04-28 02:32:25.404017 | orchestrator | ok: [testbed-node-5 -> localhost] => (item=node-role.kubernetes.io/worker=worker) 2026-04-28 02:32:25.404022 | orchestrator | ok: [testbed-node-3 -> localhost] => (item=node-role.osism.tech/rook-osd=true) 2026-04-28 02:32:25.404028 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=openstack-control-plane=enabled) 2026-04-28 02:32:25.404033 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=openstack-control-plane=enabled) 2026-04-28 02:32:25.404038 | orchestrator | ok: [testbed-node-4 -> localhost] => (item=node-role.kubernetes.io/worker=worker) 2026-04-28 02:32:25.404055 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=openstack-control-plane=enabled) 2026-04-28 02:32:25.404061 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/network-plane=true) 2026-04-28 02:32:25.404066 | orchestrator | ok: [testbed-node-5 -> localhost] => (item=node-role.osism.tech/rook-osd=true) 2026-04-28 02:32:25.404072 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/network-plane=true) 2026-04-28 02:32:25.404077 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/network-plane=true) 2026-04-28 02:32:25.404082 | orchestrator | ok: [testbed-node-4 -> localhost] => (item=node-role.osism.tech/rook-osd=true) 2026-04-28 02:32:25.404088 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-mds=true) 2026-04-28 02:32:25.404106 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-mds=true) 2026-04-28 02:32:25.404112 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-mds=true) 2026-04-28 02:32:25.404117 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-mgr=true) 2026-04-28 02:32:25.404150 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-mgr=true) 2026-04-28 02:32:25.404156 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-mgr=true) 2026-04-28 02:32:25.404161 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-mon=true) 2026-04-28 02:32:25.404167 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-mon=true) 2026-04-28 02:32:25.404172 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-mon=true) 2026-04-28 02:32:25.404177 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-rgw=true) 2026-04-28 02:32:25.404182 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-rgw=true) 2026-04-28 02:32:25.404188 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-rgw=true) 2026-04-28 02:32:25.404193 | orchestrator | 2026-04-28 02:32:25.404198 | orchestrator | TASK [Manage annotations] ****************************************************** 2026-04-28 02:32:25.404204 | orchestrator | Tuesday 28 April 2026 02:32:24 +0000 (0:00:08.705) 0:04:46.654 ********* 2026-04-28 02:32:25.404209 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:32:25.404214 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:32:25.404220 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:32:25.404225 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:32:25.404230 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:32:25.404236 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:32:25.404241 | orchestrator | 2026-04-28 02:32:25.404246 | orchestrator | TASK [Manage taints] *********************************************************** 2026-04-28 02:32:25.404252 | orchestrator | Tuesday 28 April 2026 02:32:24 +0000 (0:00:00.595) 0:04:47.249 ********* 2026-04-28 02:32:25.404257 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:32:25.404262 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:32:25.404268 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:32:25.404273 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:32:25.404278 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:32:25.404284 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:32:25.404294 | orchestrator | 2026-04-28 02:32:25.404299 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:32:25.404305 | orchestrator | testbed-manager : ok=21  changed=11  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:32:25.404313 | orchestrator | testbed-node-0 : ok=50  changed=23  unreachable=0 failed=0 skipped=28  rescued=0 ignored=0 2026-04-28 02:32:25.404319 | orchestrator | testbed-node-1 : ok=38  changed=16  unreachable=0 failed=0 skipped=25  rescued=0 ignored=0 2026-04-28 02:32:25.404324 | orchestrator | testbed-node-2 : ok=38  changed=16  unreachable=0 failed=0 skipped=25  rescued=0 ignored=0 2026-04-28 02:32:25.404329 | orchestrator | testbed-node-3 : ok=16  changed=8  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-28 02:32:25.404335 | orchestrator | testbed-node-4 : ok=16  changed=8  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-28 02:32:25.404340 | orchestrator | testbed-node-5 : ok=16  changed=8  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-28 02:32:25.404345 | orchestrator | 2026-04-28 02:32:25.404351 | orchestrator | 2026-04-28 02:32:25.404356 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:32:25.404362 | orchestrator | Tuesday 28 April 2026 02:32:25 +0000 (0:00:00.723) 0:04:47.973 ********* 2026-04-28 02:32:25.404367 | orchestrator | =============================================================================== 2026-04-28 02:32:25.404372 | orchestrator | k3s_server_post : Wait for Cilium resources ---------------------------- 62.96s 2026-04-28 02:32:25.404378 | orchestrator | k3s_server : Verify that all nodes actually joined (check k3s-init.service if this fails) -- 53.66s 2026-04-28 02:32:25.404383 | orchestrator | k3s_server : Enable and check K3s service ------------------------------ 25.28s 2026-04-28 02:32:25.404392 | orchestrator | kubectl : Install required packages ------------------------------------ 13.42s 2026-04-28 02:32:25.813059 | orchestrator | k3s_agent : Manage k3s service ----------------------------------------- 10.35s 2026-04-28 02:32:25.813166 | orchestrator | Manage labels ----------------------------------------------------------- 8.71s 2026-04-28 02:32:25.813178 | orchestrator | kubectl : Add repository Debian ----------------------------------------- 8.57s 2026-04-28 02:32:25.813185 | orchestrator | k9s : Install k9s packages ---------------------------------------------- 5.62s 2026-04-28 02:32:25.813192 | orchestrator | k3s_server_post : Install Cilium ---------------------------------------- 5.60s 2026-04-28 02:32:25.813199 | orchestrator | k3s_download : Download k3s binary x64 ---------------------------------- 5.17s 2026-04-28 02:32:25.813206 | orchestrator | k3s_server : Detect Kubernetes version for label compatibility ---------- 3.11s 2026-04-28 02:32:25.813214 | orchestrator | k3s_server : Remove manifests and folders that are only needed for bootstrapping cluster so k3s doesn't auto apply on start --- 3.06s 2026-04-28 02:32:25.813223 | orchestrator | k3s_server : Set _kube_vip_bgp_peers fact ------------------------------- 2.43s 2026-04-28 02:32:25.813231 | orchestrator | k3s_server_post : Test for BGP config resources ------------------------- 1.93s 2026-04-28 02:32:25.813239 | orchestrator | k3s_server : Create custom resolv.conf for k3s -------------------------- 1.87s 2026-04-28 02:32:25.813246 | orchestrator | k3s_server : Validating arguments against arg spec 'main' - Setup k3s servers --- 1.87s 2026-04-28 02:32:25.813253 | orchestrator | Make kubeconfig available for use inside the manager service ------------ 1.81s 2026-04-28 02:32:25.813260 | orchestrator | kubectl : Install apt-transport-https package --------------------------- 1.77s 2026-04-28 02:32:25.813267 | orchestrator | k3s_download : Download k3s binary armhf -------------------------------- 1.74s 2026-04-28 02:32:25.813275 | orchestrator | k3s_server : Init cluster inside the transient k3s-init service --------- 1.71s 2026-04-28 02:32:26.226408 | orchestrator | + osism apply copy-kubeconfig 2026-04-28 02:32:38.459380 | orchestrator | 2026-04-28 02:32:38 | INFO  | Task 759020d9-06f8-45d8-b8ab-695553f511b6 (copy-kubeconfig) was prepared for execution. 2026-04-28 02:32:38.459505 | orchestrator | 2026-04-28 02:32:38 | INFO  | It takes a moment until task 759020d9-06f8-45d8-b8ab-695553f511b6 (copy-kubeconfig) has been started and output is visible here. 2026-04-28 02:32:45.931248 | orchestrator | 2026-04-28 02:32:45.931337 | orchestrator | PLAY [Copy kubeconfig to the configuration repository] ************************* 2026-04-28 02:32:45.931349 | orchestrator | 2026-04-28 02:32:45.931358 | orchestrator | TASK [Get kubeconfig file] ***************************************************** 2026-04-28 02:32:45.931367 | orchestrator | Tuesday 28 April 2026 02:32:43 +0000 (0:00:00.177) 0:00:00.177 ********* 2026-04-28 02:32:45.931376 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] 2026-04-28 02:32:45.931384 | orchestrator | 2026-04-28 02:32:45.931393 | orchestrator | TASK [Write kubeconfig file] *************************************************** 2026-04-28 02:32:45.931401 | orchestrator | Tuesday 28 April 2026 02:32:43 +0000 (0:00:00.753) 0:00:00.931 ********* 2026-04-28 02:32:45.931408 | orchestrator | changed: [testbed-manager] 2026-04-28 02:32:45.931417 | orchestrator | 2026-04-28 02:32:45.931425 | orchestrator | TASK [Change server address in the kubeconfig file] **************************** 2026-04-28 02:32:45.931434 | orchestrator | Tuesday 28 April 2026 02:32:45 +0000 (0:00:01.314) 0:00:02.246 ********* 2026-04-28 02:32:45.931442 | orchestrator | changed: [testbed-manager] 2026-04-28 02:32:45.931451 | orchestrator | 2026-04-28 02:32:45.931459 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:32:45.931486 | orchestrator | testbed-manager : ok=3  changed=2  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:32:45.931499 | orchestrator | 2026-04-28 02:32:45.931508 | orchestrator | 2026-04-28 02:32:45.931520 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:32:45.931528 | orchestrator | Tuesday 28 April 2026 02:32:45 +0000 (0:00:00.503) 0:00:02.750 ********* 2026-04-28 02:32:45.931537 | orchestrator | =============================================================================== 2026-04-28 02:32:45.931545 | orchestrator | Write kubeconfig file --------------------------------------------------- 1.32s 2026-04-28 02:32:45.931553 | orchestrator | Get kubeconfig file ----------------------------------------------------- 0.75s 2026-04-28 02:32:45.931561 | orchestrator | Change server address in the kubeconfig file ---------------------------- 0.50s 2026-04-28 02:32:46.305644 | orchestrator | + sh -c /opt/configuration/scripts/deploy/200-infrastructure.sh 2026-04-28 02:32:58.591630 | orchestrator | 2026-04-28 02:32:58 | INFO  | Task b94286fe-0bc7-477d-b566-790920d8fa67 (openstackclient) was prepared for execution. 2026-04-28 02:32:58.591742 | orchestrator | 2026-04-28 02:32:58 | INFO  | It takes a moment until task b94286fe-0bc7-477d-b566-790920d8fa67 (openstackclient) has been started and output is visible here. 2026-04-28 02:33:47.564909 | orchestrator | 2026-04-28 02:33:47.565006 | orchestrator | PLAY [Apply role openstackclient] ********************************************** 2026-04-28 02:33:47.565017 | orchestrator | 2026-04-28 02:33:47.565024 | orchestrator | TASK [osism.services.openstackclient : Include tasks] ************************** 2026-04-28 02:33:47.565031 | orchestrator | Tuesday 28 April 2026 02:33:03 +0000 (0:00:00.260) 0:00:00.260 ********* 2026-04-28 02:33:47.565040 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/openstackclient/tasks/container-Debian-family.yml for testbed-manager 2026-04-28 02:33:47.565048 | orchestrator | 2026-04-28 02:33:47.565054 | orchestrator | TASK [osism.services.openstackclient : Create required directories] ************ 2026-04-28 02:33:47.565060 | orchestrator | Tuesday 28 April 2026 02:33:03 +0000 (0:00:00.253) 0:00:00.513 ********* 2026-04-28 02:33:47.565067 | orchestrator | changed: [testbed-manager] => (item=/opt/configuration/environments/openstack) 2026-04-28 02:33:47.565100 | orchestrator | changed: [testbed-manager] => (item=/opt/openstackclient/data) 2026-04-28 02:33:47.565107 | orchestrator | ok: [testbed-manager] => (item=/opt/openstackclient) 2026-04-28 02:33:47.565113 | orchestrator | 2026-04-28 02:33:47.565120 | orchestrator | TASK [osism.services.openstackclient : Copy docker-compose.yml file] *********** 2026-04-28 02:33:47.565126 | orchestrator | Tuesday 28 April 2026 02:33:04 +0000 (0:00:01.354) 0:00:01.868 ********* 2026-04-28 02:33:47.565132 | orchestrator | changed: [testbed-manager] 2026-04-28 02:33:47.565139 | orchestrator | 2026-04-28 02:33:47.565192 | orchestrator | TASK [osism.services.openstackclient : Manage openstackclient service] ********* 2026-04-28 02:33:47.565198 | orchestrator | Tuesday 28 April 2026 02:33:06 +0000 (0:00:01.558) 0:00:03.426 ********* 2026-04-28 02:33:47.565204 | orchestrator | FAILED - RETRYING: [testbed-manager]: Manage openstackclient service (10 retries left). 2026-04-28 02:33:47.565211 | orchestrator | ok: [testbed-manager] 2026-04-28 02:33:47.565218 | orchestrator | 2026-04-28 02:33:47.565223 | orchestrator | TASK [osism.services.openstackclient : Copy openstack wrapper script] ********** 2026-04-28 02:33:47.565229 | orchestrator | Tuesday 28 April 2026 02:33:42 +0000 (0:00:35.774) 0:00:39.201 ********* 2026-04-28 02:33:47.565235 | orchestrator | changed: [testbed-manager] 2026-04-28 02:33:47.565241 | orchestrator | 2026-04-28 02:33:47.565246 | orchestrator | TASK [osism.services.openstackclient : Remove ospurge wrapper script] ********** 2026-04-28 02:33:47.565253 | orchestrator | Tuesday 28 April 2026 02:33:43 +0000 (0:00:00.990) 0:00:40.192 ********* 2026-04-28 02:33:47.565259 | orchestrator | ok: [testbed-manager] 2026-04-28 02:33:47.565265 | orchestrator | 2026-04-28 02:33:47.565272 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Restart openstackclient service] *** 2026-04-28 02:33:47.565278 | orchestrator | Tuesday 28 April 2026 02:33:43 +0000 (0:00:00.682) 0:00:40.874 ********* 2026-04-28 02:33:47.565284 | orchestrator | changed: [testbed-manager] 2026-04-28 02:33:47.565291 | orchestrator | 2026-04-28 02:33:47.565297 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Ensure that all containers are up] *** 2026-04-28 02:33:47.565303 | orchestrator | Tuesday 28 April 2026 02:33:45 +0000 (0:00:01.531) 0:00:42.406 ********* 2026-04-28 02:33:47.565310 | orchestrator | changed: [testbed-manager] 2026-04-28 02:33:47.565316 | orchestrator | 2026-04-28 02:33:47.565323 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Wait for an healthy service] *** 2026-04-28 02:33:47.565328 | orchestrator | Tuesday 28 April 2026 02:33:46 +0000 (0:00:00.774) 0:00:43.181 ********* 2026-04-28 02:33:47.565334 | orchestrator | changed: [testbed-manager] 2026-04-28 02:33:47.565340 | orchestrator | 2026-04-28 02:33:47.565347 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Copy bash completion script] *** 2026-04-28 02:33:47.565353 | orchestrator | Tuesday 28 April 2026 02:33:46 +0000 (0:00:00.597) 0:00:43.778 ********* 2026-04-28 02:33:47.565359 | orchestrator | ok: [testbed-manager] 2026-04-28 02:33:47.565366 | orchestrator | 2026-04-28 02:33:47.565372 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:33:47.565378 | orchestrator | testbed-manager : ok=10  changed=6  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:33:47.565385 | orchestrator | 2026-04-28 02:33:47.565392 | orchestrator | 2026-04-28 02:33:47.565398 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:33:47.565404 | orchestrator | Tuesday 28 April 2026 02:33:47 +0000 (0:00:00.416) 0:00:44.195 ********* 2026-04-28 02:33:47.565410 | orchestrator | =============================================================================== 2026-04-28 02:33:47.565416 | orchestrator | osism.services.openstackclient : Manage openstackclient service -------- 35.77s 2026-04-28 02:33:47.565422 | orchestrator | osism.services.openstackclient : Copy docker-compose.yml file ----------- 1.56s 2026-04-28 02:33:47.565429 | orchestrator | osism.services.openstackclient : Restart openstackclient service -------- 1.53s 2026-04-28 02:33:47.565435 | orchestrator | osism.services.openstackclient : Create required directories ------------ 1.35s 2026-04-28 02:33:47.565442 | orchestrator | osism.services.openstackclient : Copy openstack wrapper script ---------- 0.99s 2026-04-28 02:33:47.565458 | orchestrator | osism.services.openstackclient : Ensure that all containers are up ------ 0.77s 2026-04-28 02:33:47.565464 | orchestrator | osism.services.openstackclient : Remove ospurge wrapper script ---------- 0.68s 2026-04-28 02:33:47.565471 | orchestrator | osism.services.openstackclient : Wait for an healthy service ------------ 0.60s 2026-04-28 02:33:47.565477 | orchestrator | osism.services.openstackclient : Copy bash completion script ------------ 0.42s 2026-04-28 02:33:47.565484 | orchestrator | osism.services.openstackclient : Include tasks -------------------------- 0.25s 2026-04-28 02:33:50.078594 | orchestrator | 2026-04-28 02:33:50 | INFO  | Task f5c56ced-060d-4703-9b79-4b4c8e078c46 (common) was prepared for execution. 2026-04-28 02:33:50.078678 | orchestrator | 2026-04-28 02:33:50 | INFO  | It takes a moment until task f5c56ced-060d-4703-9b79-4b4c8e078c46 (common) has been started and output is visible here. 2026-04-28 02:34:03.159806 | orchestrator | 2026-04-28 02:34:03.159885 | orchestrator | PLAY [Apply role common] ******************************************************* 2026-04-28 02:34:03.159897 | orchestrator | 2026-04-28 02:34:03.159908 | orchestrator | TASK [common : include_tasks] ************************************************** 2026-04-28 02:34:03.159917 | orchestrator | Tuesday 28 April 2026 02:33:54 +0000 (0:00:00.330) 0:00:00.330 ********* 2026-04-28 02:34:03.159927 | orchestrator | included: /ansible/roles/common/tasks/deploy.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 02:34:03.159937 | orchestrator | 2026-04-28 02:34:03.159946 | orchestrator | TASK [common : Ensuring config directories exist] ****************************** 2026-04-28 02:34:03.159955 | orchestrator | Tuesday 28 April 2026 02:33:55 +0000 (0:00:01.407) 0:00:01.737 ********* 2026-04-28 02:34:03.159963 | orchestrator | changed: [testbed-node-0] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-28 02:34:03.159972 | orchestrator | changed: [testbed-manager] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-28 02:34:03.159981 | orchestrator | changed: [testbed-node-1] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-28 02:34:03.159990 | orchestrator | changed: [testbed-node-0] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-28 02:34:03.159999 | orchestrator | changed: [testbed-node-2] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-28 02:34:03.160007 | orchestrator | changed: [testbed-node-3] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-28 02:34:03.160016 | orchestrator | changed: [testbed-node-4] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-28 02:34:03.160024 | orchestrator | changed: [testbed-manager] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-28 02:34:03.160033 | orchestrator | changed: [testbed-node-1] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-28 02:34:03.160042 | orchestrator | changed: [testbed-node-0] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-28 02:34:03.160052 | orchestrator | changed: [testbed-node-5] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-28 02:34:03.160060 | orchestrator | changed: [testbed-node-2] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-28 02:34:03.160069 | orchestrator | changed: [testbed-node-3] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-28 02:34:03.160077 | orchestrator | changed: [testbed-node-4] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-28 02:34:03.160103 | orchestrator | changed: [testbed-manager] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-28 02:34:03.160113 | orchestrator | changed: [testbed-node-1] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-28 02:34:03.160122 | orchestrator | changed: [testbed-node-5] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-28 02:34:03.160131 | orchestrator | changed: [testbed-node-2] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-28 02:34:03.160139 | orchestrator | changed: [testbed-node-3] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-28 02:34:03.160192 | orchestrator | changed: [testbed-node-4] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-28 02:34:03.160222 | orchestrator | changed: [testbed-node-5] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-28 02:34:03.160231 | orchestrator | 2026-04-28 02:34:03.160240 | orchestrator | TASK [common : include_tasks] ************************************************** 2026-04-28 02:34:03.160249 | orchestrator | Tuesday 28 April 2026 02:33:58 +0000 (0:00:02.819) 0:00:04.557 ********* 2026-04-28 02:34:03.160258 | orchestrator | included: /ansible/roles/common/tasks/copy-certs.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 02:34:03.160268 | orchestrator | 2026-04-28 02:34:03.160277 | orchestrator | TASK [service-cert-copy : common | Copying over extra CA certificates] ********* 2026-04-28 02:34:03.160285 | orchestrator | Tuesday 28 April 2026 02:34:00 +0000 (0:00:01.520) 0:00:06.077 ********* 2026-04-28 02:34:03.160302 | orchestrator | changed: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:03.160314 | orchestrator | changed: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:03.160345 | orchestrator | changed: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:03.160356 | orchestrator | changed: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:03.160368 | orchestrator | changed: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:03.160378 | orchestrator | changed: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:03.160395 | orchestrator | changed: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:03.160406 | orchestrator | changed: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:03.160416 | orchestrator | changed: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:03.160433 | orchestrator | changed: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:04.368287 | orchestrator | changed: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:04.368552 | orchestrator | changed: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:04.368573 | orchestrator | changed: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:04.368607 | orchestrator | changed: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:04.368621 | orchestrator | changed: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:04.368652 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:04.368664 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:04.368701 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:04.368713 | orchestrator | changed: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:04.368725 | orchestrator | changed: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:04.368736 | orchestrator | changed: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:04.368758 | orchestrator | 2026-04-28 02:34:04.368774 | orchestrator | TASK [service-cert-copy : common | Copying over backend internal TLS certificate] *** 2026-04-28 02:34:04.368788 | orchestrator | Tuesday 28 April 2026 02:34:04 +0000 (0:00:03.712) 0:00:09.790 ********* 2026-04-28 02:34:04.368804 | orchestrator | skipping: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 02:34:04.368818 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:04.368832 | orchestrator | skipping: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:04.368846 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 02:34:04.368872 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:05.031675 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:05.031762 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:34:05.031793 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 02:34:05.031840 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:05.031848 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:05.031855 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:34:05.031861 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 02:34:05.031871 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:05.031878 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:05.031885 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:34:05.031911 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 02:34:05.031925 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:05.031932 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:05.031939 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:34:05.031945 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:34:05.031951 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 02:34:05.031958 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:05.031964 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:05.031970 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:34:05.031980 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 02:34:05.031992 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:05.976346 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:05.976443 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:34:05.976460 | orchestrator | 2026-04-28 02:34:05.976473 | orchestrator | TASK [service-cert-copy : common | Copying over backend internal TLS key] ****** 2026-04-28 02:34:05.976485 | orchestrator | Tuesday 28 April 2026 02:34:05 +0000 (0:00:00.977) 0:00:10.767 ********* 2026-04-28 02:34:05.976498 | orchestrator | skipping: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 02:34:05.976513 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:05.976525 | orchestrator | skipping: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:05.976537 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 02:34:05.976549 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:34:05.976579 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:05.976592 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:05.976626 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:34:05.976665 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 02:34:05.976678 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:05.976689 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:05.976700 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:34:05.976712 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 02:34:05.976723 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:05.976740 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:05.976751 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:34:05.976763 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 02:34:05.976800 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:11.264207 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:11.264307 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:34:11.264326 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 02:34:11.264346 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:11.264359 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:11.264369 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:34:11.264380 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 02:34:11.264390 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:11.264427 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:11.264438 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:34:11.264448 | orchestrator | 2026-04-28 02:34:11.264460 | orchestrator | TASK [common : Copying over /run subdirectories conf] ************************** 2026-04-28 02:34:11.264473 | orchestrator | Tuesday 28 April 2026 02:34:06 +0000 (0:00:01.884) 0:00:12.652 ********* 2026-04-28 02:34:11.264483 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:34:11.264493 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:34:11.264504 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:34:11.264514 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:34:11.264537 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:34:11.264544 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:34:11.264551 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:34:11.264561 | orchestrator | 2026-04-28 02:34:11.264571 | orchestrator | TASK [common : Restart systemd-tmpfiles] *************************************** 2026-04-28 02:34:11.264582 | orchestrator | Tuesday 28 April 2026 02:34:07 +0000 (0:00:00.745) 0:00:13.397 ********* 2026-04-28 02:34:11.264591 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:34:11.264602 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:34:11.264611 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:34:11.264621 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:34:11.264632 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:34:11.264642 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:34:11.264653 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:34:11.264663 | orchestrator | 2026-04-28 02:34:11.264674 | orchestrator | TASK [common : Copying over config.json files for services] ******************** 2026-04-28 02:34:11.264685 | orchestrator | Tuesday 28 April 2026 02:34:08 +0000 (0:00:00.945) 0:00:14.343 ********* 2026-04-28 02:34:11.264697 | orchestrator | changed: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:11.264708 | orchestrator | changed: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:11.264732 | orchestrator | changed: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:11.264752 | orchestrator | changed: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:11.264760 | orchestrator | changed: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:11.264767 | orchestrator | changed: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:11.264783 | orchestrator | changed: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:14.106519 | orchestrator | changed: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:14.106647 | orchestrator | changed: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:14.106675 | orchestrator | changed: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:14.106752 | orchestrator | changed: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:14.106778 | orchestrator | changed: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:14.106800 | orchestrator | changed: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:14.106858 | orchestrator | changed: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:14.106879 | orchestrator | changed: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:14.106902 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:14.106922 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:14.106953 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:14.106973 | orchestrator | changed: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:14.106993 | orchestrator | changed: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:14.107012 | orchestrator | changed: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:14.107032 | orchestrator | 2026-04-28 02:34:14.107054 | orchestrator | TASK [common : Find custom fluentd input config files] ************************* 2026-04-28 02:34:14.107075 | orchestrator | Tuesday 28 April 2026 02:34:12 +0000 (0:00:03.486) 0:00:17.829 ********* 2026-04-28 02:34:14.107096 | orchestrator | [WARNING]: Skipped 2026-04-28 02:34:14.107118 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/input' path due 2026-04-28 02:34:14.107139 | orchestrator | to this access issue: 2026-04-28 02:34:14.107189 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/input' is not a 2026-04-28 02:34:14.107212 | orchestrator | directory 2026-04-28 02:34:14.107233 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-28 02:34:14.107255 | orchestrator | 2026-04-28 02:34:14.107275 | orchestrator | TASK [common : Find custom fluentd filter config files] ************************ 2026-04-28 02:34:14.107295 | orchestrator | Tuesday 28 April 2026 02:34:13 +0000 (0:00:00.998) 0:00:18.828 ********* 2026-04-28 02:34:14.107315 | orchestrator | [WARNING]: Skipped 2026-04-28 02:34:14.107348 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/filter' path due 2026-04-28 02:34:24.729715 | orchestrator | to this access issue: 2026-04-28 02:34:24.729857 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/filter' is not a 2026-04-28 02:34:24.729884 | orchestrator | directory 2026-04-28 02:34:24.729905 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-28 02:34:24.729927 | orchestrator | 2026-04-28 02:34:24.729946 | orchestrator | TASK [common : Find custom fluentd format config files] ************************ 2026-04-28 02:34:24.729966 | orchestrator | Tuesday 28 April 2026 02:34:14 +0000 (0:00:01.341) 0:00:20.169 ********* 2026-04-28 02:34:24.729984 | orchestrator | [WARNING]: Skipped 2026-04-28 02:34:24.730003 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/format' path due 2026-04-28 02:34:24.730092 | orchestrator | to this access issue: 2026-04-28 02:34:24.730135 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/format' is not a 2026-04-28 02:34:24.730179 | orchestrator | directory 2026-04-28 02:34:24.730199 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-28 02:34:24.730211 | orchestrator | 2026-04-28 02:34:24.730224 | orchestrator | TASK [common : Find custom fluentd output config files] ************************ 2026-04-28 02:34:24.730237 | orchestrator | Tuesday 28 April 2026 02:34:15 +0000 (0:00:00.932) 0:00:21.102 ********* 2026-04-28 02:34:24.730249 | orchestrator | [WARNING]: Skipped 2026-04-28 02:34:24.730262 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/output' path due 2026-04-28 02:34:24.730275 | orchestrator | to this access issue: 2026-04-28 02:34:24.730288 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/output' is not a 2026-04-28 02:34:24.730300 | orchestrator | directory 2026-04-28 02:34:24.730312 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-28 02:34:24.730324 | orchestrator | 2026-04-28 02:34:24.730336 | orchestrator | TASK [common : Copying over fluentd.conf] ************************************** 2026-04-28 02:34:24.730349 | orchestrator | Tuesday 28 April 2026 02:34:16 +0000 (0:00:00.892) 0:00:21.994 ********* 2026-04-28 02:34:24.730361 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:34:24.730374 | orchestrator | changed: [testbed-manager] 2026-04-28 02:34:24.730386 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:34:24.730398 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:34:24.730411 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:34:24.730423 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:34:24.730435 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:34:24.730448 | orchestrator | 2026-04-28 02:34:24.730460 | orchestrator | TASK [common : Copying over cron logrotate config file] ************************ 2026-04-28 02:34:24.730472 | orchestrator | Tuesday 28 April 2026 02:34:19 +0000 (0:00:02.839) 0:00:24.834 ********* 2026-04-28 02:34:24.730484 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-28 02:34:24.730498 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-28 02:34:24.730511 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-28 02:34:24.730540 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-28 02:34:24.730553 | orchestrator | changed: [testbed-node-3] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-28 02:34:24.730566 | orchestrator | changed: [testbed-node-5] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-28 02:34:24.730583 | orchestrator | changed: [testbed-node-4] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-28 02:34:24.730600 | orchestrator | 2026-04-28 02:34:24.730618 | orchestrator | TASK [common : Ensure RabbitMQ Erlang cookie exists] *************************** 2026-04-28 02:34:24.730636 | orchestrator | Tuesday 28 April 2026 02:34:21 +0000 (0:00:02.242) 0:00:27.077 ********* 2026-04-28 02:34:24.730654 | orchestrator | changed: [testbed-manager] 2026-04-28 02:34:24.730672 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:34:24.730690 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:34:24.730706 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:34:24.730722 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:34:24.730739 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:34:24.730755 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:34:24.730774 | orchestrator | 2026-04-28 02:34:24.730793 | orchestrator | TASK [common : Ensuring config directories have correct owner and permission] *** 2026-04-28 02:34:24.730813 | orchestrator | Tuesday 28 April 2026 02:34:23 +0000 (0:00:01.962) 0:00:29.040 ********* 2026-04-28 02:34:24.730834 | orchestrator | ok: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:24.730897 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:24.730918 | orchestrator | ok: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:24.730938 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:24.730957 | orchestrator | ok: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:24.730976 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:24.731003 | orchestrator | ok: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:24.731021 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:24.731064 | orchestrator | ok: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:24.731100 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:30.845344 | orchestrator | ok: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:30.845426 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:30.845434 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:30.845453 | orchestrator | ok: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:30.845459 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:30.845479 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:30.845484 | orchestrator | ok: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:30.845507 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:34:30.845512 | orchestrator | ok: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:30.845518 | orchestrator | ok: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:30.845522 | orchestrator | ok: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:30.845527 | orchestrator | 2026-04-28 02:34:30.845533 | orchestrator | TASK [common : Copy rabbitmq-env.conf to kolla toolbox] ************************ 2026-04-28 02:34:30.845540 | orchestrator | Tuesday 28 April 2026 02:34:24 +0000 (0:00:01.630) 0:00:30.670 ********* 2026-04-28 02:34:30.845544 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-28 02:34:30.845550 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-28 02:34:30.845555 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-28 02:34:30.845562 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-28 02:34:30.845570 | orchestrator | changed: [testbed-node-3] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-28 02:34:30.845583 | orchestrator | changed: [testbed-node-4] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-28 02:34:30.845590 | orchestrator | changed: [testbed-node-5] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-28 02:34:30.845598 | orchestrator | 2026-04-28 02:34:30.845605 | orchestrator | TASK [common : Copy rabbitmq erl_inetrc to kolla toolbox] ********************** 2026-04-28 02:34:30.845613 | orchestrator | Tuesday 28 April 2026 02:34:26 +0000 (0:00:02.073) 0:00:32.743 ********* 2026-04-28 02:34:30.845620 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-28 02:34:30.845628 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-28 02:34:30.845635 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-28 02:34:30.845643 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-28 02:34:30.845651 | orchestrator | changed: [testbed-node-3] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-28 02:34:30.845658 | orchestrator | changed: [testbed-node-4] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-28 02:34:30.845665 | orchestrator | changed: [testbed-node-5] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-28 02:34:30.845673 | orchestrator | 2026-04-28 02:34:30.845680 | orchestrator | TASK [common : Check common containers] **************************************** 2026-04-28 02:34:30.845688 | orchestrator | Tuesday 28 April 2026 02:34:28 +0000 (0:00:01.805) 0:00:34.549 ********* 2026-04-28 02:34:30.845702 | orchestrator | changed: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:30.845718 | orchestrator | changed: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:31.432195 | orchestrator | changed: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:31.432294 | orchestrator | changed: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:31.432309 | orchestrator | changed: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:31.432355 | orchestrator | changed: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:31.432361 | orchestrator | changed: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 02:34:31.432367 | orchestrator | changed: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:31.432373 | orchestrator | changed: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:31.432395 | orchestrator | changed: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:31.432400 | orchestrator | changed: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:31.432412 | orchestrator | changed: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:31.432421 | orchestrator | changed: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:31.432427 | orchestrator | changed: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:31.432433 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:31.432440 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:34:31.432451 | orchestrator | changed: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:36:01.897836 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:36:01.897968 | orchestrator | changed: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:36:01.898080 | orchestrator | changed: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:36:01.898122 | orchestrator | changed: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:36:01.898145 | orchestrator | 2026-04-28 02:36:01.898165 | orchestrator | TASK [common : Creating log volume] ******************************************** 2026-04-28 02:36:01.898215 | orchestrator | Tuesday 28 April 2026 02:34:31 +0000 (0:00:02.613) 0:00:37.163 ********* 2026-04-28 02:36:01.898234 | orchestrator | changed: [testbed-manager] 2026-04-28 02:36:01.898254 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:36:01.898272 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:36:01.898289 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:36:01.898306 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:36:01.898325 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:36:01.898353 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:36:01.898384 | orchestrator | 2026-04-28 02:36:01.898417 | orchestrator | TASK [common : Link kolla_logs volume to /var/log/kolla] *********************** 2026-04-28 02:36:01.898455 | orchestrator | Tuesday 28 April 2026 02:34:32 +0000 (0:00:01.502) 0:00:38.666 ********* 2026-04-28 02:36:01.898487 | orchestrator | changed: [testbed-manager] 2026-04-28 02:36:01.898505 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:36:01.898523 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:36:01.898540 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:36:01.898558 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:36:01.898576 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:36:01.898594 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:36:01.898612 | orchestrator | 2026-04-28 02:36:01.898630 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-28 02:36:01.898648 | orchestrator | Tuesday 28 April 2026 02:34:34 +0000 (0:00:01.129) 0:00:39.795 ********* 2026-04-28 02:36:01.898666 | orchestrator | 2026-04-28 02:36:01.898684 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-28 02:36:01.898702 | orchestrator | Tuesday 28 April 2026 02:34:34 +0000 (0:00:00.068) 0:00:39.864 ********* 2026-04-28 02:36:01.898719 | orchestrator | 2026-04-28 02:36:01.898737 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-28 02:36:01.898755 | orchestrator | Tuesday 28 April 2026 02:34:34 +0000 (0:00:00.069) 0:00:39.934 ********* 2026-04-28 02:36:01.898773 | orchestrator | 2026-04-28 02:36:01.898791 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-28 02:36:01.898809 | orchestrator | Tuesday 28 April 2026 02:34:34 +0000 (0:00:00.065) 0:00:39.999 ********* 2026-04-28 02:36:01.898827 | orchestrator | 2026-04-28 02:36:01.898845 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-28 02:36:01.898863 | orchestrator | Tuesday 28 April 2026 02:34:34 +0000 (0:00:00.242) 0:00:40.242 ********* 2026-04-28 02:36:01.898881 | orchestrator | 2026-04-28 02:36:01.898899 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-28 02:36:01.898917 | orchestrator | Tuesday 28 April 2026 02:34:34 +0000 (0:00:00.067) 0:00:40.309 ********* 2026-04-28 02:36:01.898952 | orchestrator | 2026-04-28 02:36:01.898970 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-28 02:36:01.898988 | orchestrator | Tuesday 28 April 2026 02:34:34 +0000 (0:00:00.084) 0:00:40.394 ********* 2026-04-28 02:36:01.899007 | orchestrator | 2026-04-28 02:36:01.899025 | orchestrator | RUNNING HANDLER [common : Restart fluentd container] *************************** 2026-04-28 02:36:01.899044 | orchestrator | Tuesday 28 April 2026 02:34:34 +0000 (0:00:00.107) 0:00:40.502 ********* 2026-04-28 02:36:01.899062 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:36:01.899081 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:36:01.899099 | orchestrator | changed: [testbed-manager] 2026-04-28 02:36:01.899117 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:36:01.899136 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:36:01.899206 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:36:01.899227 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:36:01.899245 | orchestrator | 2026-04-28 02:36:01.899263 | orchestrator | RUNNING HANDLER [common : Restart kolla-toolbox container] ********************* 2026-04-28 02:36:01.899281 | orchestrator | Tuesday 28 April 2026 02:35:14 +0000 (0:00:39.935) 0:01:20.437 ********* 2026-04-28 02:36:01.899299 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:36:01.899318 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:36:01.899335 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:36:01.899352 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:36:01.899368 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:36:01.899385 | orchestrator | changed: [testbed-manager] 2026-04-28 02:36:01.899403 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:36:01.899422 | orchestrator | 2026-04-28 02:36:01.899440 | orchestrator | RUNNING HANDLER [common : Initializing toolbox container using normal user] **** 2026-04-28 02:36:01.899459 | orchestrator | Tuesday 28 April 2026 02:35:51 +0000 (0:00:36.439) 0:01:56.876 ********* 2026-04-28 02:36:01.899477 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:36:01.899497 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:36:01.899515 | orchestrator | ok: [testbed-manager] 2026-04-28 02:36:01.899534 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:36:01.899553 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:36:01.899571 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:36:01.899589 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:36:01.899608 | orchestrator | 2026-04-28 02:36:01.899626 | orchestrator | RUNNING HANDLER [common : Restart cron container] ****************************** 2026-04-28 02:36:01.899645 | orchestrator | Tuesday 28 April 2026 02:35:53 +0000 (0:00:02.106) 0:01:58.983 ********* 2026-04-28 02:36:01.899663 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:36:01.899681 | orchestrator | changed: [testbed-manager] 2026-04-28 02:36:01.899700 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:36:01.899719 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:36:01.899737 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:36:01.899756 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:36:01.899774 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:36:01.899793 | orchestrator | 2026-04-28 02:36:01.899811 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:36:01.899830 | orchestrator | testbed-manager : ok=22  changed=14  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-28 02:36:01.899851 | orchestrator | testbed-node-0 : ok=18  changed=14  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-28 02:36:01.899870 | orchestrator | testbed-node-1 : ok=18  changed=14  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-28 02:36:01.899889 | orchestrator | testbed-node-2 : ok=18  changed=14  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-28 02:36:01.899907 | orchestrator | testbed-node-3 : ok=18  changed=14  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-28 02:36:01.899943 | orchestrator | testbed-node-4 : ok=18  changed=14  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-28 02:36:01.899963 | orchestrator | testbed-node-5 : ok=18  changed=14  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-28 02:36:01.899981 | orchestrator | 2026-04-28 02:36:01.899999 | orchestrator | 2026-04-28 02:36:01.900018 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:36:01.900038 | orchestrator | Tuesday 28 April 2026 02:36:01 +0000 (0:00:08.628) 0:02:07.611 ********* 2026-04-28 02:36:01.900057 | orchestrator | =============================================================================== 2026-04-28 02:36:01.900091 | orchestrator | common : Restart fluentd container ------------------------------------- 39.94s 2026-04-28 02:36:01.900111 | orchestrator | common : Restart kolla-toolbox container ------------------------------- 36.44s 2026-04-28 02:36:01.900130 | orchestrator | common : Restart cron container ----------------------------------------- 8.63s 2026-04-28 02:36:01.900148 | orchestrator | service-cert-copy : common | Copying over extra CA certificates --------- 3.71s 2026-04-28 02:36:01.900168 | orchestrator | common : Copying over config.json files for services -------------------- 3.49s 2026-04-28 02:36:01.900212 | orchestrator | common : Copying over fluentd.conf -------------------------------------- 2.84s 2026-04-28 02:36:01.900232 | orchestrator | common : Ensuring config directories exist ------------------------------ 2.82s 2026-04-28 02:36:01.900250 | orchestrator | common : Check common containers ---------------------------------------- 2.61s 2026-04-28 02:36:01.900268 | orchestrator | common : Copying over cron logrotate config file ------------------------ 2.24s 2026-04-28 02:36:01.900286 | orchestrator | common : Initializing toolbox container using normal user --------------- 2.11s 2026-04-28 02:36:01.900304 | orchestrator | common : Copy rabbitmq-env.conf to kolla toolbox ------------------------ 2.07s 2026-04-28 02:36:01.900321 | orchestrator | common : Ensure RabbitMQ Erlang cookie exists --------------------------- 1.96s 2026-04-28 02:36:01.900339 | orchestrator | service-cert-copy : common | Copying over backend internal TLS key ------ 1.88s 2026-04-28 02:36:01.900356 | orchestrator | common : Copy rabbitmq erl_inetrc to kolla toolbox ---------------------- 1.81s 2026-04-28 02:36:01.900373 | orchestrator | common : Ensuring config directories have correct owner and permission --- 1.63s 2026-04-28 02:36:01.900391 | orchestrator | common : include_tasks -------------------------------------------------- 1.52s 2026-04-28 02:36:01.900426 | orchestrator | common : Creating log volume -------------------------------------------- 1.50s 2026-04-28 02:36:02.371164 | orchestrator | common : include_tasks -------------------------------------------------- 1.41s 2026-04-28 02:36:02.371323 | orchestrator | common : Find custom fluentd filter config files ------------------------ 1.34s 2026-04-28 02:36:02.371341 | orchestrator | common : Link kolla_logs volume to /var/log/kolla ----------------------- 1.13s 2026-04-28 02:36:04.903450 | orchestrator | 2026-04-28 02:36:04 | INFO  | Task 066cc0c0-055f-4537-ae7c-5828e80a5260 (loadbalancer) was prepared for execution. 2026-04-28 02:36:04.903537 | orchestrator | 2026-04-28 02:36:04 | INFO  | It takes a moment until task 066cc0c0-055f-4537-ae7c-5828e80a5260 (loadbalancer) has been started and output is visible here. 2026-04-28 02:36:20.435394 | orchestrator | 2026-04-28 02:36:20.435489 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 02:36:20.435500 | orchestrator | 2026-04-28 02:36:20.435508 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 02:36:20.435516 | orchestrator | Tuesday 28 April 2026 02:36:09 +0000 (0:00:00.282) 0:00:00.282 ********* 2026-04-28 02:36:20.435523 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:36:20.435531 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:36:20.435537 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:36:20.435545 | orchestrator | 2026-04-28 02:36:20.435551 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 02:36:20.435578 | orchestrator | Tuesday 28 April 2026 02:36:09 +0000 (0:00:00.320) 0:00:00.602 ********* 2026-04-28 02:36:20.435586 | orchestrator | ok: [testbed-node-0] => (item=enable_loadbalancer_True) 2026-04-28 02:36:20.435593 | orchestrator | ok: [testbed-node-1] => (item=enable_loadbalancer_True) 2026-04-28 02:36:20.435599 | orchestrator | ok: [testbed-node-2] => (item=enable_loadbalancer_True) 2026-04-28 02:36:20.435606 | orchestrator | 2026-04-28 02:36:20.435612 | orchestrator | PLAY [Apply role loadbalancer] ************************************************* 2026-04-28 02:36:20.435617 | orchestrator | 2026-04-28 02:36:20.435623 | orchestrator | TASK [loadbalancer : include_tasks] ******************************************** 2026-04-28 02:36:20.435630 | orchestrator | Tuesday 28 April 2026 02:36:10 +0000 (0:00:00.497) 0:00:01.099 ********* 2026-04-28 02:36:20.435650 | orchestrator | included: /ansible/roles/loadbalancer/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:36:20.435657 | orchestrator | 2026-04-28 02:36:20.435664 | orchestrator | TASK [loadbalancer : Check IPv6 support] *************************************** 2026-04-28 02:36:20.435670 | orchestrator | Tuesday 28 April 2026 02:36:10 +0000 (0:00:00.546) 0:00:01.645 ********* 2026-04-28 02:36:20.435676 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:36:20.435681 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:36:20.435688 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:36:20.435694 | orchestrator | 2026-04-28 02:36:20.435700 | orchestrator | TASK [Setting sysctl values] *************************************************** 2026-04-28 02:36:20.435706 | orchestrator | Tuesday 28 April 2026 02:36:11 +0000 (0:00:00.594) 0:00:02.239 ********* 2026-04-28 02:36:20.435712 | orchestrator | included: sysctl for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:36:20.435718 | orchestrator | 2026-04-28 02:36:20.435724 | orchestrator | TASK [sysctl : Check IPv6 support] ********************************************* 2026-04-28 02:36:20.435731 | orchestrator | Tuesday 28 April 2026 02:36:12 +0000 (0:00:00.732) 0:00:02.971 ********* 2026-04-28 02:36:20.435738 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:36:20.435745 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:36:20.435751 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:36:20.435758 | orchestrator | 2026-04-28 02:36:20.435765 | orchestrator | TASK [sysctl : Setting sysctl values] ****************************************** 2026-04-28 02:36:20.435771 | orchestrator | Tuesday 28 April 2026 02:36:12 +0000 (0:00:00.636) 0:00:03.608 ********* 2026-04-28 02:36:20.435777 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv6.ip_nonlocal_bind', 'value': 1}) 2026-04-28 02:36:20.435783 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv6.ip_nonlocal_bind', 'value': 1}) 2026-04-28 02:36:20.435789 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv6.ip_nonlocal_bind', 'value': 1}) 2026-04-28 02:36:20.435795 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.ipv4.ip_nonlocal_bind', 'value': 1}) 2026-04-28 02:36:20.435801 | orchestrator | ok: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_retries2', 'value': 'KOLLA_UNSET'}) 2026-04-28 02:36:20.435809 | orchestrator | changed: [testbed-node-2] => (item={'name': 'net.unix.max_dgram_qlen', 'value': 128}) 2026-04-28 02:36:20.435815 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.ipv4.ip_nonlocal_bind', 'value': 1}) 2026-04-28 02:36:20.435821 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.ipv4.ip_nonlocal_bind', 'value': 1}) 2026-04-28 02:36:20.435827 | orchestrator | ok: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_retries2', 'value': 'KOLLA_UNSET'}) 2026-04-28 02:36:20.435833 | orchestrator | ok: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_retries2', 'value': 'KOLLA_UNSET'}) 2026-04-28 02:36:20.435839 | orchestrator | changed: [testbed-node-1] => (item={'name': 'net.unix.max_dgram_qlen', 'value': 128}) 2026-04-28 02:36:20.435845 | orchestrator | changed: [testbed-node-0] => (item={'name': 'net.unix.max_dgram_qlen', 'value': 128}) 2026-04-28 02:36:20.435852 | orchestrator | 2026-04-28 02:36:20.435857 | orchestrator | TASK [module-load : Load modules] ********************************************** 2026-04-28 02:36:20.435869 | orchestrator | Tuesday 28 April 2026 02:36:15 +0000 (0:00:03.169) 0:00:06.778 ********* 2026-04-28 02:36:20.435875 | orchestrator | changed: [testbed-node-0] => (item=ip_vs) 2026-04-28 02:36:20.435882 | orchestrator | changed: [testbed-node-1] => (item=ip_vs) 2026-04-28 02:36:20.435889 | orchestrator | changed: [testbed-node-2] => (item=ip_vs) 2026-04-28 02:36:20.435895 | orchestrator | 2026-04-28 02:36:20.435902 | orchestrator | TASK [module-load : Persist modules via modules-load.d] ************************ 2026-04-28 02:36:20.435908 | orchestrator | Tuesday 28 April 2026 02:36:16 +0000 (0:00:00.811) 0:00:07.589 ********* 2026-04-28 02:36:20.435915 | orchestrator | changed: [testbed-node-0] => (item=ip_vs) 2026-04-28 02:36:20.435921 | orchestrator | changed: [testbed-node-2] => (item=ip_vs) 2026-04-28 02:36:20.435927 | orchestrator | changed: [testbed-node-1] => (item=ip_vs) 2026-04-28 02:36:20.435933 | orchestrator | 2026-04-28 02:36:20.435940 | orchestrator | TASK [module-load : Drop module persistence] *********************************** 2026-04-28 02:36:20.435946 | orchestrator | Tuesday 28 April 2026 02:36:17 +0000 (0:00:01.280) 0:00:08.870 ********* 2026-04-28 02:36:20.435953 | orchestrator | skipping: [testbed-node-0] => (item=ip_vs)  2026-04-28 02:36:20.435959 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:36:20.435981 | orchestrator | skipping: [testbed-node-1] => (item=ip_vs)  2026-04-28 02:36:20.435990 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:36:20.435998 | orchestrator | skipping: [testbed-node-2] => (item=ip_vs)  2026-04-28 02:36:20.436008 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:36:20.436016 | orchestrator | 2026-04-28 02:36:20.436023 | orchestrator | TASK [loadbalancer : Ensuring config directories exist] ************************ 2026-04-28 02:36:20.436030 | orchestrator | Tuesday 28 April 2026 02:36:18 +0000 (0:00:00.561) 0:00:09.431 ********* 2026-04-28 02:36:20.436039 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-28 02:36:20.436057 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-28 02:36:20.436065 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-28 02:36:20.436073 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 02:36:20.436086 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 02:36:20.436099 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 02:36:26.242478 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 02:36:26.242591 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 02:36:26.242609 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 02:36:26.242619 | orchestrator | 2026-04-28 02:36:26.242630 | orchestrator | TASK [loadbalancer : Ensuring haproxy service config subdir exists] ************ 2026-04-28 02:36:26.242642 | orchestrator | Tuesday 28 April 2026 02:36:20 +0000 (0:00:01.862) 0:00:11.294 ********* 2026-04-28 02:36:26.242651 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:36:26.242676 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:36:26.243591 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:36:26.243633 | orchestrator | 2026-04-28 02:36:26.243643 | orchestrator | TASK [loadbalancer : Ensuring proxysql service config subdirectories exist] **** 2026-04-28 02:36:26.243653 | orchestrator | Tuesday 28 April 2026 02:36:21 +0000 (0:00:00.963) 0:00:12.258 ********* 2026-04-28 02:36:26.243692 | orchestrator | changed: [testbed-node-0] => (item=users) 2026-04-28 02:36:26.243705 | orchestrator | changed: [testbed-node-1] => (item=users) 2026-04-28 02:36:26.243715 | orchestrator | changed: [testbed-node-2] => (item=users) 2026-04-28 02:36:26.243725 | orchestrator | changed: [testbed-node-0] => (item=rules) 2026-04-28 02:36:26.243735 | orchestrator | changed: [testbed-node-1] => (item=rules) 2026-04-28 02:36:26.243745 | orchestrator | changed: [testbed-node-2] => (item=rules) 2026-04-28 02:36:26.243757 | orchestrator | 2026-04-28 02:36:26.243763 | orchestrator | TASK [loadbalancer : Ensuring keepalived checks subdir exists] ***************** 2026-04-28 02:36:26.243770 | orchestrator | Tuesday 28 April 2026 02:36:22 +0000 (0:00:01.562) 0:00:13.820 ********* 2026-04-28 02:36:26.243776 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:36:26.243782 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:36:26.243788 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:36:26.243794 | orchestrator | 2026-04-28 02:36:26.243801 | orchestrator | TASK [loadbalancer : Remove mariadb.cfg if proxysql enabled] ******************* 2026-04-28 02:36:26.243807 | orchestrator | Tuesday 28 April 2026 02:36:23 +0000 (0:00:01.029) 0:00:14.850 ********* 2026-04-28 02:36:26.243813 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:36:26.243819 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:36:26.243826 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:36:26.243832 | orchestrator | 2026-04-28 02:36:26.243838 | orchestrator | TASK [loadbalancer : Removing checks for services which are disabled] ********** 2026-04-28 02:36:26.243844 | orchestrator | Tuesday 28 April 2026 02:36:25 +0000 (0:00:01.549) 0:00:16.399 ********* 2026-04-28 02:36:26.243853 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-28 02:36:26.243881 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:26.243889 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:26.243897 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/haproxy-ssh:9.6.20251130', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__47884d6e76878e29389c0597c3e1bf28b1f656e7', '__omit_place_holder__47884d6e76878e29389c0597c3e1bf28b1f656e7'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-28 02:36:26.243912 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:36:26.243923 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-28 02:36:26.243934 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:26.243945 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:26.243998 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/haproxy-ssh:9.6.20251130', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__47884d6e76878e29389c0597c3e1bf28b1f656e7', '__omit_place_holder__47884d6e76878e29389c0597c3e1bf28b1f656e7'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-28 02:36:26.244011 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:36:26.244031 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-28 02:36:29.102401 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:29.102520 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:29.102533 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/haproxy-ssh:9.6.20251130', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__47884d6e76878e29389c0597c3e1bf28b1f656e7', '__omit_place_holder__47884d6e76878e29389c0597c3e1bf28b1f656e7'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-28 02:36:29.102542 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:36:29.102553 | orchestrator | 2026-04-28 02:36:29.102562 | orchestrator | TASK [loadbalancer : Copying checks for services which are enabled] ************ 2026-04-28 02:36:29.102571 | orchestrator | Tuesday 28 April 2026 02:36:26 +0000 (0:00:00.704) 0:00:17.103 ********* 2026-04-28 02:36:29.102580 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-28 02:36:29.102589 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-28 02:36:29.102597 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-28 02:36:29.102622 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 02:36:29.102637 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:29.102646 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 02:36:29.102654 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/haproxy-ssh:9.6.20251130', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__47884d6e76878e29389c0597c3e1bf28b1f656e7', '__omit_place_holder__47884d6e76878e29389c0597c3e1bf28b1f656e7'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-28 02:36:29.102662 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:29.102670 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/haproxy-ssh:9.6.20251130', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__47884d6e76878e29389c0597c3e1bf28b1f656e7', '__omit_place_holder__47884d6e76878e29389c0597c3e1bf28b1f656e7'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-28 02:36:29.102690 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 02:36:38.063495 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:38.063578 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/haproxy-ssh:9.6.20251130', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__47884d6e76878e29389c0597c3e1bf28b1f656e7', '__omit_place_holder__47884d6e76878e29389c0597c3e1bf28b1f656e7'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-28 02:36:38.063587 | orchestrator | 2026-04-28 02:36:38.063594 | orchestrator | TASK [loadbalancer : Copying over config.json files for services] ************** 2026-04-28 02:36:38.063601 | orchestrator | Tuesday 28 April 2026 02:36:29 +0000 (0:00:02.857) 0:00:19.961 ********* 2026-04-28 02:36:38.063607 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-28 02:36:38.063614 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-28 02:36:38.063619 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-28 02:36:38.063625 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 02:36:38.063666 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 02:36:38.063673 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 02:36:38.063678 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 02:36:38.063684 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 02:36:38.063689 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 02:36:38.063695 | orchestrator | 2026-04-28 02:36:38.063700 | orchestrator | TASK [loadbalancer : Copying over haproxy.cfg] ********************************* 2026-04-28 02:36:38.063705 | orchestrator | Tuesday 28 April 2026 02:36:32 +0000 (0:00:03.278) 0:00:23.239 ********* 2026-04-28 02:36:38.063711 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_main.cfg.j2) 2026-04-28 02:36:38.063717 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_main.cfg.j2) 2026-04-28 02:36:38.063727 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_main.cfg.j2) 2026-04-28 02:36:38.063732 | orchestrator | 2026-04-28 02:36:38.063737 | orchestrator | TASK [loadbalancer : Copying over proxysql config] ***************************** 2026-04-28 02:36:38.063742 | orchestrator | Tuesday 28 April 2026 02:36:34 +0000 (0:00:01.954) 0:00:25.194 ********* 2026-04-28 02:36:38.063748 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql.yaml.j2) 2026-04-28 02:36:38.063753 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql.yaml.j2) 2026-04-28 02:36:38.063758 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql.yaml.j2) 2026-04-28 02:36:38.063763 | orchestrator | 2026-04-28 02:36:38.063768 | orchestrator | TASK [loadbalancer : Copying over haproxy single external frontend config] ***** 2026-04-28 02:36:38.063773 | orchestrator | Tuesday 28 April 2026 02:36:37 +0000 (0:00:03.154) 0:00:28.349 ********* 2026-04-28 02:36:38.063778 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:36:38.063785 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:36:38.063790 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:36:38.063795 | orchestrator | 2026-04-28 02:36:38.063804 | orchestrator | TASK [loadbalancer : Copying over custom haproxy services configuration] ******* 2026-04-28 02:36:50.104663 | orchestrator | Tuesday 28 April 2026 02:36:38 +0000 (0:00:00.581) 0:00:28.930 ********* 2026-04-28 02:36:50.104759 | orchestrator | changed: [testbed-node-0] => (item=/opt/configuration/environments/kolla/files/overlays/haproxy/services.d/haproxy.cfg) 2026-04-28 02:36:50.104787 | orchestrator | changed: [testbed-node-1] => (item=/opt/configuration/environments/kolla/files/overlays/haproxy/services.d/haproxy.cfg) 2026-04-28 02:36:50.104798 | orchestrator | changed: [testbed-node-2] => (item=/opt/configuration/environments/kolla/files/overlays/haproxy/services.d/haproxy.cfg) 2026-04-28 02:36:50.104807 | orchestrator | 2026-04-28 02:36:50.104818 | orchestrator | TASK [loadbalancer : Copying over keepalived.conf] ***************************** 2026-04-28 02:36:50.104828 | orchestrator | Tuesday 28 April 2026 02:36:40 +0000 (0:00:02.156) 0:00:31.087 ********* 2026-04-28 02:36:50.104839 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/keepalived/keepalived.conf.j2) 2026-04-28 02:36:50.104849 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/keepalived/keepalived.conf.j2) 2026-04-28 02:36:50.104859 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/keepalived/keepalived.conf.j2) 2026-04-28 02:36:50.104868 | orchestrator | 2026-04-28 02:36:50.104878 | orchestrator | TASK [loadbalancer : Copying over haproxy.pem] ********************************* 2026-04-28 02:36:50.104888 | orchestrator | Tuesday 28 April 2026 02:36:42 +0000 (0:00:02.169) 0:00:33.256 ********* 2026-04-28 02:36:50.104898 | orchestrator | changed: [testbed-node-0] => (item=haproxy.pem) 2026-04-28 02:36:50.104908 | orchestrator | changed: [testbed-node-1] => (item=haproxy.pem) 2026-04-28 02:36:50.104917 | orchestrator | changed: [testbed-node-2] => (item=haproxy.pem) 2026-04-28 02:36:50.104927 | orchestrator | 2026-04-28 02:36:50.104936 | orchestrator | TASK [loadbalancer : Copying over haproxy-internal.pem] ************************ 2026-04-28 02:36:50.104946 | orchestrator | Tuesday 28 April 2026 02:36:43 +0000 (0:00:01.517) 0:00:34.773 ********* 2026-04-28 02:36:50.104957 | orchestrator | changed: [testbed-node-0] => (item=haproxy-internal.pem) 2026-04-28 02:36:50.104967 | orchestrator | changed: [testbed-node-1] => (item=haproxy-internal.pem) 2026-04-28 02:36:50.104976 | orchestrator | changed: [testbed-node-2] => (item=haproxy-internal.pem) 2026-04-28 02:36:50.104986 | orchestrator | 2026-04-28 02:36:50.104995 | orchestrator | TASK [loadbalancer : include_tasks] ******************************************** 2026-04-28 02:36:50.105005 | orchestrator | Tuesday 28 April 2026 02:36:45 +0000 (0:00:01.488) 0:00:36.261 ********* 2026-04-28 02:36:50.105015 | orchestrator | included: /ansible/roles/loadbalancer/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:36:50.105047 | orchestrator | 2026-04-28 02:36:50.105057 | orchestrator | TASK [service-cert-copy : loadbalancer | Copying over extra CA certificates] *** 2026-04-28 02:36:50.105066 | orchestrator | Tuesday 28 April 2026 02:36:45 +0000 (0:00:00.566) 0:00:36.828 ********* 2026-04-28 02:36:50.105090 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-28 02:36:50.105105 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-28 02:36:50.105120 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-28 02:36:50.105149 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 02:36:50.105160 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 02:36:50.105170 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 02:36:50.105188 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 02:36:50.105198 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 02:36:50.105237 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 02:36:50.105253 | orchestrator | 2026-04-28 02:36:50.105270 | orchestrator | TASK [service-cert-copy : loadbalancer | Copying over backend internal TLS certificate] *** 2026-04-28 02:36:50.105287 | orchestrator | Tuesday 28 April 2026 02:36:49 +0000 (0:00:03.557) 0:00:40.385 ********* 2026-04-28 02:36:50.105332 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-28 02:36:50.973082 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:50.973174 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:50.973253 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:36:50.973265 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-28 02:36:50.973273 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:50.973281 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:50.973288 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:36:50.973296 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-28 02:36:50.973333 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:50.973339 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:50.973344 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:36:50.973349 | orchestrator | 2026-04-28 02:36:50.973354 | orchestrator | TASK [service-cert-copy : loadbalancer | Copying over backend internal TLS key] *** 2026-04-28 02:36:50.973365 | orchestrator | Tuesday 28 April 2026 02:36:50 +0000 (0:00:00.587) 0:00:40.972 ********* 2026-04-28 02:36:50.973371 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-28 02:36:50.973375 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:50.973380 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:50.973384 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:36:50.973389 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-28 02:36:50.973406 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:51.910314 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:51.910421 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:36:51.910433 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-28 02:36:51.910441 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:51.910446 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:51.910451 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:36:51.910456 | orchestrator | 2026-04-28 02:36:51.910462 | orchestrator | TASK [service-cert-copy : mariadb | Copying over extra CA certificates] ******** 2026-04-28 02:36:51.910468 | orchestrator | Tuesday 28 April 2026 02:36:50 +0000 (0:00:00.861) 0:00:41.834 ********* 2026-04-28 02:36:51.910473 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-28 02:36:51.910490 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:51.910509 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:51.910519 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:36:51.910524 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-28 02:36:51.910529 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:51.910534 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:51.910539 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:36:51.910544 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-28 02:36:51.910549 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:51.910554 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:51.910562 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:36:53.353022 | orchestrator | 2026-04-28 02:36:53.353139 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS certificate] *** 2026-04-28 02:36:53.353156 | orchestrator | Tuesday 28 April 2026 02:36:51 +0000 (0:00:00.921) 0:00:42.756 ********* 2026-04-28 02:36:53.353194 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-28 02:36:53.353931 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:53.353973 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:53.353986 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:36:53.353999 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-28 02:36:53.354010 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:53.354081 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:53.354116 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:36:53.354162 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-28 02:36:53.354173 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:53.354183 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:53.354192 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:36:53.354235 | orchestrator | 2026-04-28 02:36:53.354248 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS key] ***** 2026-04-28 02:36:53.354259 | orchestrator | Tuesday 28 April 2026 02:36:52 +0000 (0:00:00.584) 0:00:43.340 ********* 2026-04-28 02:36:53.354269 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-28 02:36:53.354279 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:53.354290 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:53.354315 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:36:53.354349 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-28 02:36:54.458395 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:54.458472 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:54.458480 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:36:54.458489 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-28 02:36:54.458496 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:54.458501 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:54.458525 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:36:54.458532 | orchestrator | 2026-04-28 02:36:54.458539 | orchestrator | TASK [service-cert-copy : proxysql | Copying over extra CA certificates] ******* 2026-04-28 02:36:54.458546 | orchestrator | Tuesday 28 April 2026 02:36:53 +0000 (0:00:00.878) 0:00:44.218 ********* 2026-04-28 02:36:54.458564 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-28 02:36:54.458583 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:54.458590 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:54.458596 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:36:54.458602 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-28 02:36:54.458608 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:54.458614 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:54.458625 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:36:54.458635 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-28 02:36:54.458645 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:55.987461 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:55.987562 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:36:55.987579 | orchestrator | 2026-04-28 02:36:55.987592 | orchestrator | TASK [service-cert-copy : proxysql | Copying over backend internal TLS certificate] *** 2026-04-28 02:36:55.987604 | orchestrator | Tuesday 28 April 2026 02:36:54 +0000 (0:00:01.100) 0:00:45.319 ********* 2026-04-28 02:36:55.987617 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-28 02:36:55.987630 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:55.987642 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:55.987679 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:36:55.987691 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-28 02:36:55.987725 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:55.987755 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:55.987767 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:36:55.987779 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-28 02:36:55.987790 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:55.987805 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:36:55.987836 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:36:55.987856 | orchestrator | 2026-04-28 02:36:55.987874 | orchestrator | TASK [service-cert-copy : proxysql | Copying over backend internal TLS key] **** 2026-04-28 02:36:55.987893 | orchestrator | Tuesday 28 April 2026 02:36:55 +0000 (0:00:00.649) 0:00:45.969 ********* 2026-04-28 02:36:55.987913 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-28 02:36:55.987932 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:36:55.987958 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:37:02.971459 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:37:02.971537 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-28 02:37:02.971562 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:37:02.971570 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:37:02.971597 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:37:02.971603 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-28 02:37:02.971610 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 02:37:02.971621 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 02:37:02.971627 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:37:02.971634 | orchestrator | 2026-04-28 02:37:02.971641 | orchestrator | TASK [loadbalancer : Copying over haproxy start script] ************************ 2026-04-28 02:37:02.971648 | orchestrator | Tuesday 28 April 2026 02:36:55 +0000 (0:00:00.883) 0:00:46.852 ********* 2026-04-28 02:37:02.971654 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_run.sh.j2) 2026-04-28 02:37:02.971673 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_run.sh.j2) 2026-04-28 02:37:02.971679 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_run.sh.j2) 2026-04-28 02:37:02.971686 | orchestrator | 2026-04-28 02:37:02.971693 | orchestrator | TASK [loadbalancer : Copying over proxysql start script] *********************** 2026-04-28 02:37:02.971699 | orchestrator | Tuesday 28 April 2026 02:36:57 +0000 (0:00:01.878) 0:00:48.730 ********* 2026-04-28 02:37:02.971706 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql_run.sh.j2) 2026-04-28 02:37:02.971712 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql_run.sh.j2) 2026-04-28 02:37:02.971716 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql_run.sh.j2) 2026-04-28 02:37:02.971720 | orchestrator | 2026-04-28 02:37:02.971726 | orchestrator | TASK [loadbalancer : Copying files for haproxy-ssh] **************************** 2026-04-28 02:37:02.971732 | orchestrator | Tuesday 28 April 2026 02:36:59 +0000 (0:00:01.767) 0:00:50.497 ********* 2026-04-28 02:37:02.971737 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'haproxy-ssh/sshd_config.j2', 'dest': 'sshd_config'})  2026-04-28 02:37:02.971754 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'haproxy-ssh/sshd_config.j2', 'dest': 'sshd_config'})  2026-04-28 02:37:02.971763 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'haproxy-ssh/sshd_config.j2', 'dest': 'sshd_config'})  2026-04-28 02:37:02.971769 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'haproxy-ssh/id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-28 02:37:02.971774 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:37:02.971780 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'haproxy-ssh/id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-28 02:37:02.971785 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:37:02.971791 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'haproxy-ssh/id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-28 02:37:02.971797 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:37:02.971802 | orchestrator | 2026-04-28 02:37:02.971808 | orchestrator | TASK [loadbalancer : Check loadbalancer containers] **************************** 2026-04-28 02:37:02.971813 | orchestrator | Tuesday 28 April 2026 02:37:00 +0000 (0:00:00.873) 0:00:51.371 ********* 2026-04-28 02:37:02.971819 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-28 02:37:02.971825 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-28 02:37:02.971836 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/haproxy:2.8.15.20251130', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-28 02:37:02.971850 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 02:37:07.428837 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 02:37:07.428940 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/proxysql:3.0.3.20251130', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 02:37:07.428950 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 02:37:07.428957 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 02:37:07.428963 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keepalived:2.2.8.20251130', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 02:37:07.428970 | orchestrator | 2026-04-28 02:37:07.428977 | orchestrator | TASK [include_role : aodh] ***************************************************** 2026-04-28 02:37:07.429009 | orchestrator | Tuesday 28 April 2026 02:37:02 +0000 (0:00:02.467) 0:00:53.839 ********* 2026-04-28 02:37:07.429024 | orchestrator | included: aodh for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:37:07.429030 | orchestrator | 2026-04-28 02:37:07.429036 | orchestrator | TASK [haproxy-config : Copying over aodh haproxy config] *********************** 2026-04-28 02:37:07.429041 | orchestrator | Tuesday 28 April 2026 02:37:03 +0000 (0:00:00.863) 0:00:54.702 ********* 2026-04-28 02:37:07.429061 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-28 02:37:07.429074 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 02:37:07.429081 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 02:37:07.429087 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 02:37:07.429093 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-28 02:37:07.429103 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 02:37:07.429108 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 02:37:07.429131 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-28 02:37:08.116708 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 02:37:08.116804 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 02:37:08.116817 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 02:37:08.116843 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 02:37:08.116853 | orchestrator | 2026-04-28 02:37:08.116863 | orchestrator | TASK [haproxy-config : Add configuration for aodh when using single external frontend] *** 2026-04-28 02:37:08.116874 | orchestrator | Tuesday 28 April 2026 02:37:07 +0000 (0:00:03.589) 0:00:58.292 ********* 2026-04-28 02:37:08.116884 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-28 02:37:08.116915 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 02:37:08.116941 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 02:37:08.116952 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 02:37:08.116962 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:37:08.116973 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-28 02:37:08.116988 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 02:37:08.116997 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 02:37:08.117014 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 02:37:08.117024 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:37:08.117040 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-28 02:37:17.208336 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 02:37:17.208442 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 02:37:17.208457 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 02:37:17.208465 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:37:17.208474 | orchestrator | 2026-04-28 02:37:17.208483 | orchestrator | TASK [haproxy-config : Configuring firewall for aodh] ************************** 2026-04-28 02:37:17.208512 | orchestrator | Tuesday 28 April 2026 02:37:08 +0000 (0:00:00.687) 0:00:58.979 ********* 2026-04-28 02:37:17.208521 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}})  2026-04-28 02:37:17.208530 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}})  2026-04-28 02:37:17.208540 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:37:17.208548 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}})  2026-04-28 02:37:17.208555 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}})  2026-04-28 02:37:17.208563 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:37:17.208570 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}})  2026-04-28 02:37:17.208577 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}})  2026-04-28 02:37:17.208585 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:37:17.208589 | orchestrator | 2026-04-28 02:37:17.208594 | orchestrator | TASK [proxysql-config : Copying over aodh ProxySQL users config] *************** 2026-04-28 02:37:17.208599 | orchestrator | Tuesday 28 April 2026 02:37:09 +0000 (0:00:01.222) 0:01:00.202 ********* 2026-04-28 02:37:17.208606 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:37:17.208613 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:37:17.208620 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:37:17.208627 | orchestrator | 2026-04-28 02:37:17.208634 | orchestrator | TASK [proxysql-config : Copying over aodh ProxySQL rules config] *************** 2026-04-28 02:37:17.208640 | orchestrator | Tuesday 28 April 2026 02:37:10 +0000 (0:00:01.356) 0:01:01.558 ********* 2026-04-28 02:37:17.208649 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:37:17.208656 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:37:17.208662 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:37:17.208669 | orchestrator | 2026-04-28 02:37:17.208676 | orchestrator | TASK [include_role : barbican] ************************************************* 2026-04-28 02:37:17.208700 | orchestrator | Tuesday 28 April 2026 02:37:12 +0000 (0:00:02.142) 0:01:03.701 ********* 2026-04-28 02:37:17.208708 | orchestrator | included: barbican for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:37:17.208716 | orchestrator | 2026-04-28 02:37:17.208737 | orchestrator | TASK [haproxy-config : Copying over barbican haproxy config] ******************* 2026-04-28 02:37:17.208742 | orchestrator | Tuesday 28 April 2026 02:37:13 +0000 (0:00:00.691) 0:01:04.392 ********* 2026-04-28 02:37:17.208749 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-28 02:37:17.208765 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 02:37:17.208771 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 02:37:17.208777 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-28 02:37:17.208785 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 02:37:17.208800 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 02:37:17.916366 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-28 02:37:17.916494 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 02:37:17.916507 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 02:37:17.916515 | orchestrator | 2026-04-28 02:37:17.916523 | orchestrator | TASK [haproxy-config : Add configuration for barbican when using single external frontend] *** 2026-04-28 02:37:17.916530 | orchestrator | Tuesday 28 April 2026 02:37:17 +0000 (0:00:03.676) 0:01:08.069 ********* 2026-04-28 02:37:17.916539 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-28 02:37:17.916545 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 02:37:17.916567 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 02:37:17.916583 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:37:17.916600 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-28 02:37:17.916605 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 02:37:17.916609 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 02:37:17.916613 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:37:17.916617 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-28 02:37:17.916626 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 02:37:28.402846 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 02:37:28.402959 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:37:28.402977 | orchestrator | 2026-04-28 02:37:28.402990 | orchestrator | TASK [haproxy-config : Configuring firewall for barbican] ********************** 2026-04-28 02:37:28.403003 | orchestrator | Tuesday 28 April 2026 02:37:17 +0000 (0:00:00.710) 0:01:08.780 ********* 2026-04-28 02:37:28.403032 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}})  2026-04-28 02:37:28.403046 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}})  2026-04-28 02:37:28.403059 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:37:28.403070 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}})  2026-04-28 02:37:28.403081 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}})  2026-04-28 02:37:28.403093 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:37:28.403103 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}})  2026-04-28 02:37:28.403115 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}})  2026-04-28 02:37:28.403126 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:37:28.403137 | orchestrator | 2026-04-28 02:37:28.403148 | orchestrator | TASK [proxysql-config : Copying over barbican ProxySQL users config] *********** 2026-04-28 02:37:28.403159 | orchestrator | Tuesday 28 April 2026 02:37:18 +0000 (0:00:00.928) 0:01:09.709 ********* 2026-04-28 02:37:28.403170 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:37:28.403180 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:37:28.403191 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:37:28.403202 | orchestrator | 2026-04-28 02:37:28.403214 | orchestrator | TASK [proxysql-config : Copying over barbican ProxySQL rules config] *********** 2026-04-28 02:37:28.403257 | orchestrator | Tuesday 28 April 2026 02:37:20 +0000 (0:00:01.654) 0:01:11.364 ********* 2026-04-28 02:37:28.403269 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:37:28.403280 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:37:28.403291 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:37:28.403302 | orchestrator | 2026-04-28 02:37:28.403312 | orchestrator | TASK [include_role : blazar] *************************************************** 2026-04-28 02:37:28.403346 | orchestrator | Tuesday 28 April 2026 02:37:22 +0000 (0:00:02.189) 0:01:13.554 ********* 2026-04-28 02:37:28.403357 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:37:28.403368 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:37:28.403379 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:37:28.403390 | orchestrator | 2026-04-28 02:37:28.403401 | orchestrator | TASK [include_role : ceph-rgw] ************************************************* 2026-04-28 02:37:28.403412 | orchestrator | Tuesday 28 April 2026 02:37:23 +0000 (0:00:00.336) 0:01:13.891 ********* 2026-04-28 02:37:28.403423 | orchestrator | included: ceph-rgw for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:37:28.403434 | orchestrator | 2026-04-28 02:37:28.403445 | orchestrator | TASK [haproxy-config : Copying over ceph-rgw haproxy config] ******************* 2026-04-28 02:37:28.403455 | orchestrator | Tuesday 28 April 2026 02:37:23 +0000 (0:00:00.726) 0:01:14.617 ********* 2026-04-28 02:37:28.403487 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}}}}) 2026-04-28 02:37:28.403521 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}}}}) 2026-04-28 02:37:28.403533 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}}}}) 2026-04-28 02:37:28.403545 | orchestrator | 2026-04-28 02:37:28.403556 | orchestrator | TASK [haproxy-config : Add configuration for ceph-rgw when using single external frontend] *** 2026-04-28 02:37:28.403567 | orchestrator | Tuesday 28 April 2026 02:37:26 +0000 (0:00:03.063) 0:01:17.681 ********* 2026-04-28 02:37:28.403579 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}}}})  2026-04-28 02:37:28.403599 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:37:28.403610 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}}}})  2026-04-28 02:37:28.403622 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:37:28.403641 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}}}})  2026-04-28 02:37:36.808865 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:37:36.808957 | orchestrator | 2026-04-28 02:37:36.808970 | orchestrator | TASK [haproxy-config : Configuring firewall for ceph-rgw] ********************** 2026-04-28 02:37:36.808980 | orchestrator | Tuesday 28 April 2026 02:37:28 +0000 (0:00:01.582) 0:01:19.263 ********* 2026-04-28 02:37:36.809007 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'radosgw', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}})  2026-04-28 02:37:36.809018 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'radosgw_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}})  2026-04-28 02:37:36.809028 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:37:36.809036 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'radosgw', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}})  2026-04-28 02:37:36.809063 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'radosgw_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}})  2026-04-28 02:37:36.809071 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:37:36.809079 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'radosgw', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}})  2026-04-28 02:37:36.809088 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'radosgw_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:8081 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:8081 check inter 2000 rise 2 fall 5']}})  2026-04-28 02:37:36.809096 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:37:36.809104 | orchestrator | 2026-04-28 02:37:36.809112 | orchestrator | TASK [proxysql-config : Copying over ceph-rgw ProxySQL users config] *********** 2026-04-28 02:37:36.809120 | orchestrator | Tuesday 28 April 2026 02:37:30 +0000 (0:00:01.827) 0:01:21.091 ********* 2026-04-28 02:37:36.809128 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:37:36.809136 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:37:36.809144 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:37:36.809151 | orchestrator | 2026-04-28 02:37:36.809159 | orchestrator | TASK [proxysql-config : Copying over ceph-rgw ProxySQL rules config] *********** 2026-04-28 02:37:36.809167 | orchestrator | Tuesday 28 April 2026 02:37:30 +0000 (0:00:00.473) 0:01:21.565 ********* 2026-04-28 02:37:36.809178 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:37:36.809187 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:37:36.809194 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:37:36.809202 | orchestrator | 2026-04-28 02:37:36.809210 | orchestrator | TASK [include_role : cinder] *************************************************** 2026-04-28 02:37:36.809218 | orchestrator | Tuesday 28 April 2026 02:37:32 +0000 (0:00:01.425) 0:01:22.990 ********* 2026-04-28 02:37:36.809324 | orchestrator | included: cinder for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:37:36.809341 | orchestrator | 2026-04-28 02:37:36.809354 | orchestrator | TASK [haproxy-config : Copying over cinder haproxy config] ********************* 2026-04-28 02:37:36.809362 | orchestrator | Tuesday 28 April 2026 02:37:33 +0000 (0:00:01.044) 0:01:24.035 ********* 2026-04-28 02:37:36.809400 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-28 02:37:36.809420 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 02:37:36.809446 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 02:37:36.809462 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 02:37:36.809472 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-28 02:37:36.809490 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-28 02:37:37.559033 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 02:37:37.559901 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 02:37:37.559948 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 02:37:37.559956 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 02:37:37.559963 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 02:37:37.559987 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 02:37:37.560000 | orchestrator | 2026-04-28 02:37:37.560012 | orchestrator | TASK [haproxy-config : Add configuration for cinder when using single external frontend] *** 2026-04-28 02:37:37.560020 | orchestrator | Tuesday 28 April 2026 02:37:36 +0000 (0:00:03.745) 0:01:27.780 ********* 2026-04-28 02:37:37.560028 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-28 02:37:37.560035 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 02:37:37.560042 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 02:37:37.560048 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 02:37:37.560055 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:37:37.560063 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-28 02:37:37.560087 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 02:37:47.664145 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 02:37:47.664329 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 02:37:47.664349 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:37:47.664365 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-28 02:37:47.664378 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 02:37:47.664409 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 02:37:47.664467 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 02:37:47.664481 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:37:47.664493 | orchestrator | 2026-04-28 02:37:47.664505 | orchestrator | TASK [haproxy-config : Configuring firewall for cinder] ************************ 2026-04-28 02:37:47.664548 | orchestrator | Tuesday 28 April 2026 02:37:37 +0000 (0:00:00.766) 0:01:28.547 ********* 2026-04-28 02:37:47.664561 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}})  2026-04-28 02:37:47.664575 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}})  2026-04-28 02:37:47.664588 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:37:47.664599 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}})  2026-04-28 02:37:47.664610 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}})  2026-04-28 02:37:47.664621 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:37:47.664632 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}})  2026-04-28 02:37:47.664646 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}})  2026-04-28 02:37:47.664659 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:37:47.664671 | orchestrator | 2026-04-28 02:37:47.664683 | orchestrator | TASK [proxysql-config : Copying over cinder ProxySQL users config] ************* 2026-04-28 02:37:47.664696 | orchestrator | Tuesday 28 April 2026 02:37:38 +0000 (0:00:01.281) 0:01:29.829 ********* 2026-04-28 02:37:47.664708 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:37:47.664721 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:37:47.664733 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:37:47.664745 | orchestrator | 2026-04-28 02:37:47.664757 | orchestrator | TASK [proxysql-config : Copying over cinder ProxySQL rules config] ************* 2026-04-28 02:37:47.664769 | orchestrator | Tuesday 28 April 2026 02:37:40 +0000 (0:00:01.317) 0:01:31.147 ********* 2026-04-28 02:37:47.664791 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:37:47.664803 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:37:47.664816 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:37:47.664828 | orchestrator | 2026-04-28 02:37:47.664840 | orchestrator | TASK [include_role : cloudkitty] *********************************************** 2026-04-28 02:37:47.664852 | orchestrator | Tuesday 28 April 2026 02:37:42 +0000 (0:00:02.111) 0:01:33.258 ********* 2026-04-28 02:37:47.664865 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:37:47.664877 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:37:47.664889 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:37:47.664901 | orchestrator | 2026-04-28 02:37:47.664913 | orchestrator | TASK [include_role : cyborg] *************************************************** 2026-04-28 02:37:47.664925 | orchestrator | Tuesday 28 April 2026 02:37:42 +0000 (0:00:00.334) 0:01:33.592 ********* 2026-04-28 02:37:47.664937 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:37:47.664950 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:37:47.664962 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:37:47.664974 | orchestrator | 2026-04-28 02:37:47.664986 | orchestrator | TASK [include_role : designate] ************************************************ 2026-04-28 02:37:47.664999 | orchestrator | Tuesday 28 April 2026 02:37:43 +0000 (0:00:00.335) 0:01:33.928 ********* 2026-04-28 02:37:47.665011 | orchestrator | included: designate for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:37:47.665022 | orchestrator | 2026-04-28 02:37:47.665033 | orchestrator | TASK [haproxy-config : Copying over designate haproxy config] ****************** 2026-04-28 02:37:47.665044 | orchestrator | Tuesday 28 April 2026 02:37:44 +0000 (0:00:01.070) 0:01:34.998 ********* 2026-04-28 02:37:47.665070 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-28 02:37:47.918932 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 02:37:47.919116 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 02:37:47.919147 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 02:37:47.919217 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 02:37:47.919272 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 02:37:47.919317 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/designate-sink:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-28 02:37:47.919362 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-28 02:37:47.919381 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 02:37:47.919400 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 02:37:47.919435 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 02:37:47.919455 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-28 02:37:47.919483 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 02:37:47.919517 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 02:37:48.667043 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 02:37:48.667167 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 02:37:48.667182 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/designate-sink:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-28 02:37:48.667193 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 02:37:48.667217 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 02:37:48.667228 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 02:37:48.667309 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/designate-sink:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-28 02:37:48.667321 | orchestrator | 2026-04-28 02:37:48.667331 | orchestrator | TASK [haproxy-config : Add configuration for designate when using single external frontend] *** 2026-04-28 02:37:48.667340 | orchestrator | Tuesday 28 April 2026 02:37:47 +0000 (0:00:03.784) 0:01:38.782 ********* 2026-04-28 02:37:48.667360 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-28 02:37:48.667369 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 02:37:48.667377 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 02:37:48.667392 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 02:37:48.667400 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 02:37:48.667417 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 02:37:49.119868 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/designate-sink:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-28 02:37:49.121010 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:37:49.121087 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-28 02:37:49.121111 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 02:37:49.121129 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 02:37:49.121148 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 02:37:49.121770 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 02:37:49.121837 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 02:37:49.121855 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/designate-sink:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-28 02:37:49.121866 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:37:49.121877 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-28 02:37:49.121888 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 02:37:49.121899 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 02:37:49.121909 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 02:37:49.121956 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 02:38:00.204375 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 02:38:00.204478 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/designate-sink:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-28 02:38:00.204494 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:38:00.204506 | orchestrator | 2026-04-28 02:38:00.204516 | orchestrator | TASK [haproxy-config : Configuring firewall for designate] ********************* 2026-04-28 02:38:00.204526 | orchestrator | Tuesday 28 April 2026 02:37:49 +0000 (0:00:01.200) 0:01:39.983 ********* 2026-04-28 02:38:00.204536 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}})  2026-04-28 02:38:00.204548 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}})  2026-04-28 02:38:00.204558 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:38:00.204567 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}})  2026-04-28 02:38:00.204575 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}})  2026-04-28 02:38:00.204584 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}})  2026-04-28 02:38:00.204593 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:38:00.204601 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}})  2026-04-28 02:38:00.204610 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:38:00.204641 | orchestrator | 2026-04-28 02:38:00.204651 | orchestrator | TASK [proxysql-config : Copying over designate ProxySQL users config] ********** 2026-04-28 02:38:00.204659 | orchestrator | Tuesday 28 April 2026 02:37:50 +0000 (0:00:01.376) 0:01:41.359 ********* 2026-04-28 02:38:00.204668 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:38:00.204677 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:38:00.204686 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:38:00.204696 | orchestrator | 2026-04-28 02:38:00.204705 | orchestrator | TASK [proxysql-config : Copying over designate ProxySQL rules config] ********** 2026-04-28 02:38:00.204713 | orchestrator | Tuesday 28 April 2026 02:37:51 +0000 (0:00:01.434) 0:01:42.794 ********* 2026-04-28 02:38:00.204722 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:38:00.204731 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:38:00.204739 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:38:00.204749 | orchestrator | 2026-04-28 02:38:00.204954 | orchestrator | TASK [include_role : etcd] ***************************************************** 2026-04-28 02:38:00.204971 | orchestrator | Tuesday 28 April 2026 02:37:54 +0000 (0:00:02.205) 0:01:45.000 ********* 2026-04-28 02:38:00.204982 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:38:00.204992 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:38:00.205002 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:38:00.205011 | orchestrator | 2026-04-28 02:38:00.205021 | orchestrator | TASK [include_role : glance] *************************************************** 2026-04-28 02:38:00.205031 | orchestrator | Tuesday 28 April 2026 02:37:54 +0000 (0:00:00.331) 0:01:45.331 ********* 2026-04-28 02:38:00.205041 | orchestrator | included: glance for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:38:00.205051 | orchestrator | 2026-04-28 02:38:00.205060 | orchestrator | TASK [haproxy-config : Copying over glance haproxy config] ********************* 2026-04-28 02:38:00.205069 | orchestrator | Tuesday 28 April 2026 02:37:55 +0000 (0:00:01.163) 0:01:46.495 ********* 2026-04-28 02:38:00.205115 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 02:38:00.205128 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/glance-tls-proxy:29.0.1.20251130', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-28 02:38:00.205163 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 02:38:03.456032 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/glance-tls-proxy:29.0.1.20251130', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-28 02:38:03.456183 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 02:38:03.456224 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/glance-tls-proxy:29.0.1.20251130', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-28 02:38:03.456312 | orchestrator | 2026-04-28 02:38:03.456334 | orchestrator | TASK [haproxy-config : Add configuration for glance when using single external frontend] *** 2026-04-28 02:38:03.456354 | orchestrator | Tuesday 28 April 2026 02:38:00 +0000 (0:00:04.692) 0:01:51.188 ********* 2026-04-28 02:38:03.456375 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-28 02:38:03.456417 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-28 02:38:07.276623 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/glance-tls-proxy:29.0.1.20251130', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-28 02:38:07.276721 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/glance-tls-proxy:29.0.1.20251130', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-28 02:38:07.276757 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:38:07.276765 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:38:07.276790 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-28 02:38:07.276801 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/glance-tls-proxy:29.0.1.20251130', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-28 02:38:07.276807 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:38:07.276813 | orchestrator | 2026-04-28 02:38:07.276819 | orchestrator | TASK [haproxy-config : Configuring firewall for glance] ************************ 2026-04-28 02:38:07.276830 | orchestrator | Tuesday 28 April 2026 02:38:03 +0000 (0:00:03.236) 0:01:54.425 ********* 2026-04-28 02:38:07.276898 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-28 02:38:07.276911 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-28 02:38:16.003692 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:38:16.003823 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-28 02:38:16.003853 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-28 02:38:16.003872 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:38:16.003887 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-28 02:38:16.003925 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-28 02:38:16.003941 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:38:16.003983 | orchestrator | 2026-04-28 02:38:16.004000 | orchestrator | TASK [proxysql-config : Copying over glance ProxySQL users config] ************* 2026-04-28 02:38:16.004017 | orchestrator | Tuesday 28 April 2026 02:38:07 +0000 (0:00:03.717) 0:01:58.142 ********* 2026-04-28 02:38:16.004033 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:38:16.004048 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:38:16.004063 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:38:16.004078 | orchestrator | 2026-04-28 02:38:16.004093 | orchestrator | TASK [proxysql-config : Copying over glance ProxySQL rules config] ************* 2026-04-28 02:38:16.004140 | orchestrator | Tuesday 28 April 2026 02:38:08 +0000 (0:00:01.350) 0:01:59.493 ********* 2026-04-28 02:38:16.004156 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:38:16.004173 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:38:16.004189 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:38:16.004206 | orchestrator | 2026-04-28 02:38:16.004223 | orchestrator | TASK [include_role : gnocchi] ************************************************** 2026-04-28 02:38:16.004241 | orchestrator | Tuesday 28 April 2026 02:38:10 +0000 (0:00:02.105) 0:02:01.598 ********* 2026-04-28 02:38:16.004288 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:38:16.004305 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:38:16.004323 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:38:16.004340 | orchestrator | 2026-04-28 02:38:16.004355 | orchestrator | TASK [include_role : grafana] ************************************************** 2026-04-28 02:38:16.004371 | orchestrator | Tuesday 28 April 2026 02:38:11 +0000 (0:00:00.335) 0:02:01.933 ********* 2026-04-28 02:38:16.004387 | orchestrator | included: grafana for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:38:16.004403 | orchestrator | 2026-04-28 02:38:16.004419 | orchestrator | TASK [haproxy-config : Copying over grafana haproxy config] ******************** 2026-04-28 02:38:16.004436 | orchestrator | Tuesday 28 April 2026 02:38:12 +0000 (0:00:01.106) 0:02:03.040 ********* 2026-04-28 02:38:16.004480 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-28 02:38:16.004503 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-28 02:38:16.004522 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-28 02:38:16.004541 | orchestrator | 2026-04-28 02:38:16.004560 | orchestrator | TASK [haproxy-config : Add configuration for grafana when using single external frontend] *** 2026-04-28 02:38:16.004577 | orchestrator | Tuesday 28 April 2026 02:38:15 +0000 (0:00:03.134) 0:02:06.174 ********* 2026-04-28 02:38:16.004595 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-28 02:38:16.004629 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:38:16.004648 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-28 02:38:16.004668 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:38:16.004686 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-28 02:38:16.004703 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:38:16.004719 | orchestrator | 2026-04-28 02:38:16.004735 | orchestrator | TASK [haproxy-config : Configuring firewall for grafana] *********************** 2026-04-28 02:38:16.004751 | orchestrator | Tuesday 28 April 2026 02:38:15 +0000 (0:00:00.483) 0:02:06.658 ********* 2026-04-28 02:38:16.004768 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana_server', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}})  2026-04-28 02:38:16.004797 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}})  2026-04-28 02:38:25.309583 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:38:25.310650 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana_server', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}})  2026-04-28 02:38:25.310744 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}})  2026-04-28 02:38:25.310773 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:38:25.310795 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana_server', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}})  2026-04-28 02:38:25.310893 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}})  2026-04-28 02:38:25.310914 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:38:25.310926 | orchestrator | 2026-04-28 02:38:25.310938 | orchestrator | TASK [proxysql-config : Copying over grafana ProxySQL users config] ************ 2026-04-28 02:38:25.310970 | orchestrator | Tuesday 28 April 2026 02:38:16 +0000 (0:00:00.917) 0:02:07.575 ********* 2026-04-28 02:38:25.310981 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:38:25.310992 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:38:25.311003 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:38:25.311014 | orchestrator | 2026-04-28 02:38:25.311025 | orchestrator | TASK [proxysql-config : Copying over grafana ProxySQL rules config] ************ 2026-04-28 02:38:25.311036 | orchestrator | Tuesday 28 April 2026 02:38:18 +0000 (0:00:01.346) 0:02:08.921 ********* 2026-04-28 02:38:25.311046 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:38:25.311057 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:38:25.311068 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:38:25.311078 | orchestrator | 2026-04-28 02:38:25.311089 | orchestrator | TASK [include_role : heat] ***************************************************** 2026-04-28 02:38:25.311100 | orchestrator | Tuesday 28 April 2026 02:38:20 +0000 (0:00:02.174) 0:02:11.096 ********* 2026-04-28 02:38:25.311111 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:38:25.311122 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:38:25.311132 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:38:25.311143 | orchestrator | 2026-04-28 02:38:25.311154 | orchestrator | TASK [include_role : horizon] ************************************************** 2026-04-28 02:38:25.311171 | orchestrator | Tuesday 28 April 2026 02:38:20 +0000 (0:00:00.334) 0:02:11.431 ********* 2026-04-28 02:38:25.311182 | orchestrator | included: horizon for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:38:25.311193 | orchestrator | 2026-04-28 02:38:25.311203 | orchestrator | TASK [haproxy-config : Copying over horizon haproxy config] ******************** 2026-04-28 02:38:25.311214 | orchestrator | Tuesday 28 April 2026 02:38:21 +0000 (0:00:01.256) 0:02:12.687 ********* 2026-04-28 02:38:25.311259 | orchestrator | changed: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 02:38:25.311352 | orchestrator | changed: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 02:38:25.311401 | orchestrator | changed: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 02:38:27.125798 | orchestrator | 2026-04-28 02:38:27.125874 | orchestrator | TASK [haproxy-config : Add configuration for horizon when using single external frontend] *** 2026-04-28 02:38:27.125884 | orchestrator | Tuesday 28 April 2026 02:38:25 +0000 (0:00:03.487) 0:02:16.175 ********* 2026-04-28 02:38:27.125908 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-28 02:38:27.125917 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:38:27.125936 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-28 02:38:27.125959 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:38:27.125970 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-28 02:38:27.125976 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:38:27.125982 | orchestrator | 2026-04-28 02:38:27.125987 | orchestrator | TASK [haproxy-config : Configuring firewall for horizon] *********************** 2026-04-28 02:38:27.125992 | orchestrator | Tuesday 28 April 2026 02:38:25 +0000 (0:00:00.658) 0:02:16.833 ********* 2026-04-28 02:38:27.125999 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}})  2026-04-28 02:38:27.126007 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-28 02:38:27.126059 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}})  2026-04-28 02:38:27.126071 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon_external_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-28 02:38:36.379840 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'acme_client', 'value': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}})  2026-04-28 02:38:36.379944 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:38:36.379963 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}})  2026-04-28 02:38:36.379978 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-28 02:38:36.379992 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}})  2026-04-28 02:38:36.380021 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon_external_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-28 02:38:36.380034 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'acme_client', 'value': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}})  2026-04-28 02:38:36.380046 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:38:36.380057 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}})  2026-04-28 02:38:36.380068 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-28 02:38:36.380080 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}})  2026-04-28 02:38:36.380091 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon_external_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-28 02:38:36.380125 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'acme_client', 'value': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}})  2026-04-28 02:38:36.380137 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:38:36.380148 | orchestrator | 2026-04-28 02:38:36.380160 | orchestrator | TASK [proxysql-config : Copying over horizon ProxySQL users config] ************ 2026-04-28 02:38:36.380172 | orchestrator | Tuesday 28 April 2026 02:38:27 +0000 (0:00:01.161) 0:02:17.994 ********* 2026-04-28 02:38:36.380183 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:38:36.380194 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:38:36.380204 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:38:36.380215 | orchestrator | 2026-04-28 02:38:36.380226 | orchestrator | TASK [proxysql-config : Copying over horizon ProxySQL rules config] ************ 2026-04-28 02:38:36.380237 | orchestrator | Tuesday 28 April 2026 02:38:28 +0000 (0:00:01.731) 0:02:19.726 ********* 2026-04-28 02:38:36.380247 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:38:36.380258 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:38:36.380269 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:38:36.380327 | orchestrator | 2026-04-28 02:38:36.380339 | orchestrator | TASK [include_role : influxdb] ************************************************* 2026-04-28 02:38:36.380349 | orchestrator | Tuesday 28 April 2026 02:38:31 +0000 (0:00:02.210) 0:02:21.937 ********* 2026-04-28 02:38:36.380361 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:38:36.380374 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:38:36.380402 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:38:36.380415 | orchestrator | 2026-04-28 02:38:36.380428 | orchestrator | TASK [include_role : ironic] *************************************************** 2026-04-28 02:38:36.380449 | orchestrator | Tuesday 28 April 2026 02:38:31 +0000 (0:00:00.364) 0:02:22.301 ********* 2026-04-28 02:38:36.380477 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:38:36.380498 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:38:36.380517 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:38:36.380534 | orchestrator | 2026-04-28 02:38:36.380552 | orchestrator | TASK [include_role : keystone] ************************************************* 2026-04-28 02:38:36.380569 | orchestrator | Tuesday 28 April 2026 02:38:31 +0000 (0:00:00.329) 0:02:22.631 ********* 2026-04-28 02:38:36.380586 | orchestrator | included: keystone for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:38:36.380602 | orchestrator | 2026-04-28 02:38:36.380618 | orchestrator | TASK [haproxy-config : Copying over keystone haproxy config] ******************* 2026-04-28 02:38:36.380635 | orchestrator | Tuesday 28 April 2026 02:38:33 +0000 (0:00:01.293) 0:02:23.925 ********* 2026-04-28 02:38:36.380671 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-28 02:38:36.380697 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-28 02:38:36.380735 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 02:38:36.380755 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 02:38:36.380787 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 02:38:37.035112 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 02:38:37.035230 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-28 02:38:37.035271 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 02:38:37.035340 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 02:38:37.035351 | orchestrator | 2026-04-28 02:38:37.035363 | orchestrator | TASK [haproxy-config : Add configuration for keystone when using single external frontend] *** 2026-04-28 02:38:37.035375 | orchestrator | Tuesday 28 April 2026 02:38:36 +0000 (0:00:03.316) 0:02:27.241 ********* 2026-04-28 02:38:37.035425 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-28 02:38:37.035439 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 02:38:37.035456 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 02:38:37.035475 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:38:37.035488 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-28 02:38:37.035498 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 02:38:37.035509 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 02:38:37.035518 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:38:37.035536 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-28 02:38:46.871018 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 02:38:46.871110 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 02:38:46.871119 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:38:46.871126 | orchestrator | 2026-04-28 02:38:46.871133 | orchestrator | TASK [haproxy-config : Configuring firewall for keystone] ********************** 2026-04-28 02:38:46.871140 | orchestrator | Tuesday 28 April 2026 02:38:37 +0000 (0:00:00.652) 0:02:27.893 ********* 2026-04-28 02:38:46.871147 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone_internal', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}})  2026-04-28 02:38:46.871155 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}})  2026-04-28 02:38:46.871162 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:38:46.871168 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone_internal', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}})  2026-04-28 02:38:46.871173 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}})  2026-04-28 02:38:46.871179 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:38:46.871185 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone_internal', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}})  2026-04-28 02:38:46.871190 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}})  2026-04-28 02:38:46.871196 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:38:46.871202 | orchestrator | 2026-04-28 02:38:46.871207 | orchestrator | TASK [proxysql-config : Copying over keystone ProxySQL users config] *********** 2026-04-28 02:38:46.871212 | orchestrator | Tuesday 28 April 2026 02:38:38 +0000 (0:00:01.107) 0:02:29.001 ********* 2026-04-28 02:38:46.871218 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:38:46.871223 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:38:46.871230 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:38:46.871238 | orchestrator | 2026-04-28 02:38:46.871246 | orchestrator | TASK [proxysql-config : Copying over keystone ProxySQL rules config] *********** 2026-04-28 02:38:46.871255 | orchestrator | Tuesday 28 April 2026 02:38:39 +0000 (0:00:01.377) 0:02:30.379 ********* 2026-04-28 02:38:46.871263 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:38:46.871278 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:38:46.871354 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:38:46.871360 | orchestrator | 2026-04-28 02:38:46.871367 | orchestrator | TASK [include_role : letsencrypt] ********************************************** 2026-04-28 02:38:46.871376 | orchestrator | Tuesday 28 April 2026 02:38:41 +0000 (0:00:02.122) 0:02:32.501 ********* 2026-04-28 02:38:46.871384 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:38:46.871393 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:38:46.871401 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:38:46.871409 | orchestrator | 2026-04-28 02:38:46.871417 | orchestrator | TASK [include_role : magnum] *************************************************** 2026-04-28 02:38:46.871441 | orchestrator | Tuesday 28 April 2026 02:38:41 +0000 (0:00:00.322) 0:02:32.823 ********* 2026-04-28 02:38:46.871457 | orchestrator | included: magnum for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:38:46.871466 | orchestrator | 2026-04-28 02:38:46.871474 | orchestrator | TASK [haproxy-config : Copying over magnum haproxy config] ********************* 2026-04-28 02:38:46.871482 | orchestrator | Tuesday 28 April 2026 02:38:43 +0000 (0:00:01.286) 0:02:34.109 ********* 2026-04-28 02:38:46.871493 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-28 02:38:46.871506 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 02:38:46.871517 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-28 02:38:46.871526 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 02:38:46.871551 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-28 02:38:52.369692 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 02:38:52.369796 | orchestrator | 2026-04-28 02:38:52.369815 | orchestrator | TASK [haproxy-config : Add configuration for magnum when using single external frontend] *** 2026-04-28 02:38:52.369828 | orchestrator | Tuesday 28 April 2026 02:38:46 +0000 (0:00:03.621) 0:02:37.731 ********* 2026-04-28 02:38:52.369842 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-28 02:38:52.369856 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 02:38:52.369893 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:38:52.369907 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-28 02:38:52.369987 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 02:38:52.370004 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:38:52.370094 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-28 02:38:52.370109 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 02:38:52.370121 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:38:52.370132 | orchestrator | 2026-04-28 02:38:52.370144 | orchestrator | TASK [haproxy-config : Configuring firewall for magnum] ************************ 2026-04-28 02:38:52.370155 | orchestrator | Tuesday 28 April 2026 02:38:47 +0000 (0:00:00.711) 0:02:38.442 ********* 2026-04-28 02:38:52.370178 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}})  2026-04-28 02:38:52.370191 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}})  2026-04-28 02:38:52.370203 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:38:52.370217 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}})  2026-04-28 02:38:52.370229 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}})  2026-04-28 02:38:52.370241 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:38:52.370254 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}})  2026-04-28 02:38:52.370266 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}})  2026-04-28 02:38:52.370278 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:38:52.370352 | orchestrator | 2026-04-28 02:38:52.370367 | orchestrator | TASK [proxysql-config : Copying over magnum ProxySQL users config] ************* 2026-04-28 02:38:52.370379 | orchestrator | Tuesday 28 April 2026 02:38:48 +0000 (0:00:00.921) 0:02:39.364 ********* 2026-04-28 02:38:52.370392 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:38:52.370404 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:38:52.370417 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:38:52.370428 | orchestrator | 2026-04-28 02:38:52.370447 | orchestrator | TASK [proxysql-config : Copying over magnum ProxySQL rules config] ************* 2026-04-28 02:38:52.370459 | orchestrator | Tuesday 28 April 2026 02:38:50 +0000 (0:00:01.662) 0:02:41.027 ********* 2026-04-28 02:38:52.370472 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:38:52.370484 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:38:52.370497 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:38:52.370509 | orchestrator | 2026-04-28 02:38:52.370522 | orchestrator | TASK [include_role : manila] *************************************************** 2026-04-28 02:38:52.370544 | orchestrator | Tuesday 28 April 2026 02:38:52 +0000 (0:00:02.198) 0:02:43.226 ********* 2026-04-28 02:38:57.109853 | orchestrator | included: manila for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:38:57.109950 | orchestrator | 2026-04-28 02:38:57.109963 | orchestrator | TASK [haproxy-config : Copying over manila haproxy config] ********************* 2026-04-28 02:38:57.109969 | orchestrator | Tuesday 28 April 2026 02:38:53 +0000 (0:00:01.123) 0:02:44.349 ********* 2026-04-28 02:38:57.109979 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-28 02:38:57.109990 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 02:38:57.110079 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 02:38:57.110091 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 02:38:57.110112 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-28 02:38:57.110138 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 02:38:57.110149 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 02:38:57.110163 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 02:38:57.110170 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-28 02:38:57.110177 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 02:38:57.110188 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 02:38:57.110200 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 02:38:58.150919 | orchestrator | 2026-04-28 02:38:58.151022 | orchestrator | TASK [haproxy-config : Add configuration for manila when using single external frontend] *** 2026-04-28 02:38:58.151039 | orchestrator | Tuesday 28 April 2026 02:38:57 +0000 (0:00:03.712) 0:02:48.062 ********* 2026-04-28 02:38:58.151055 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-28 02:38:58.151097 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 02:38:58.151111 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 02:38:58.151124 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 02:38:58.151136 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:38:58.151165 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-28 02:38:58.151195 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 02:38:58.151217 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 02:38:58.151228 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 02:38:58.151239 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:38:58.151251 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-28 02:38:58.151262 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 02:38:58.151279 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 02:38:58.151338 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 02:39:09.816435 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:39:09.816535 | orchestrator | 2026-04-28 02:39:09.816550 | orchestrator | TASK [haproxy-config : Configuring firewall for manila] ************************ 2026-04-28 02:39:09.816562 | orchestrator | Tuesday 28 April 2026 02:38:58 +0000 (0:00:01.035) 0:02:49.097 ********* 2026-04-28 02:39:09.816570 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}})  2026-04-28 02:39:09.816579 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}})  2026-04-28 02:39:09.816587 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:39:09.816593 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}})  2026-04-28 02:39:09.816599 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}})  2026-04-28 02:39:09.816606 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:39:09.816612 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}})  2026-04-28 02:39:09.816618 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}})  2026-04-28 02:39:09.816624 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:39:09.816629 | orchestrator | 2026-04-28 02:39:09.816635 | orchestrator | TASK [proxysql-config : Copying over manila ProxySQL users config] ************* 2026-04-28 02:39:09.816641 | orchestrator | Tuesday 28 April 2026 02:38:59 +0000 (0:00:00.945) 0:02:50.042 ********* 2026-04-28 02:39:09.816647 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:39:09.816652 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:39:09.816658 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:39:09.816664 | orchestrator | 2026-04-28 02:39:09.816670 | orchestrator | TASK [proxysql-config : Copying over manila ProxySQL rules config] ************* 2026-04-28 02:39:09.816675 | orchestrator | Tuesday 28 April 2026 02:39:00 +0000 (0:00:01.326) 0:02:51.369 ********* 2026-04-28 02:39:09.816681 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:39:09.816687 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:39:09.816692 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:39:09.816698 | orchestrator | 2026-04-28 02:39:09.816704 | orchestrator | TASK [include_role : mariadb] ************************************************** 2026-04-28 02:39:09.816710 | orchestrator | Tuesday 28 April 2026 02:39:02 +0000 (0:00:02.053) 0:02:53.423 ********* 2026-04-28 02:39:09.816716 | orchestrator | included: mariadb for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:39:09.816721 | orchestrator | 2026-04-28 02:39:09.816727 | orchestrator | TASK [mariadb : Ensure mysql monitor user exist] ******************************* 2026-04-28 02:39:09.816733 | orchestrator | Tuesday 28 April 2026 02:39:04 +0000 (0:00:01.544) 0:02:54.967 ********* 2026-04-28 02:39:09.816739 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 02:39:09.816745 | orchestrator | 2026-04-28 02:39:09.816751 | orchestrator | TASK [haproxy-config : Copying over mariadb haproxy config] ******************** 2026-04-28 02:39:09.816756 | orchestrator | Tuesday 28 April 2026 02:39:07 +0000 (0:00:03.177) 0:02:58.144 ********* 2026-04-28 02:39:09.816789 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 02:39:09.816818 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/mariadb-clustercheck:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-28 02:39:09.816826 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:39:09.816833 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 02:39:09.816849 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/mariadb-clustercheck:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-28 02:39:09.816855 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:39:09.816867 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 02:39:12.290684 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/mariadb-clustercheck:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-28 02:39:12.290805 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:39:12.290830 | orchestrator | 2026-04-28 02:39:12.290848 | orchestrator | TASK [haproxy-config : Add configuration for mariadb when using single external frontend] *** 2026-04-28 02:39:12.290866 | orchestrator | Tuesday 28 April 2026 02:39:09 +0000 (0:00:02.527) 0:03:00.672 ********* 2026-04-28 02:39:12.290906 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 02:39:12.290977 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/mariadb-clustercheck:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-28 02:39:12.291008 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:39:12.291051 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 02:39:12.291102 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/mariadb-clustercheck:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-28 02:39:12.291119 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:39:12.291145 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 02:39:12.291174 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/mariadb-clustercheck:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-28 02:39:23.006871 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:39:23.006960 | orchestrator | 2026-04-28 02:39:23.006972 | orchestrator | TASK [haproxy-config : Configuring firewall for mariadb] *********************** 2026-04-28 02:39:23.006982 | orchestrator | Tuesday 28 April 2026 02:39:12 +0000 (0:00:02.477) 0:03:03.150 ********* 2026-04-28 02:39:23.006991 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-28 02:39:23.007034 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb_external_lb', 'value': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-28 02:39:23.007047 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:39:23.007067 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-28 02:39:23.007088 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb_external_lb', 'value': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-28 02:39:23.007101 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:39:23.007112 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-28 02:39:23.007125 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb_external_lb', 'value': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-28 02:39:23.007136 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:39:23.007148 | orchestrator | 2026-04-28 02:39:23.007158 | orchestrator | TASK [proxysql-config : Copying over mariadb ProxySQL users config] ************ 2026-04-28 02:39:23.007169 | orchestrator | Tuesday 28 April 2026 02:39:15 +0000 (0:00:03.394) 0:03:06.545 ********* 2026-04-28 02:39:23.007181 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:39:23.007209 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:39:23.007222 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:39:23.007236 | orchestrator | 2026-04-28 02:39:23.007251 | orchestrator | TASK [proxysql-config : Copying over mariadb ProxySQL rules config] ************ 2026-04-28 02:39:23.007264 | orchestrator | Tuesday 28 April 2026 02:39:17 +0000 (0:00:02.226) 0:03:08.771 ********* 2026-04-28 02:39:23.007292 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:39:23.007307 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:39:23.007348 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:39:23.007357 | orchestrator | 2026-04-28 02:39:23.007366 | orchestrator | TASK [include_role : masakari] ************************************************* 2026-04-28 02:39:23.007374 | orchestrator | Tuesday 28 April 2026 02:39:19 +0000 (0:00:01.506) 0:03:10.278 ********* 2026-04-28 02:39:23.007383 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:39:23.007392 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:39:23.007400 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:39:23.007409 | orchestrator | 2026-04-28 02:39:23.007418 | orchestrator | TASK [include_role : memcached] ************************************************ 2026-04-28 02:39:23.007428 | orchestrator | Tuesday 28 April 2026 02:39:19 +0000 (0:00:00.341) 0:03:10.620 ********* 2026-04-28 02:39:23.007438 | orchestrator | included: memcached for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:39:23.007448 | orchestrator | 2026-04-28 02:39:23.007458 | orchestrator | TASK [haproxy-config : Copying over memcached haproxy config] ****************** 2026-04-28 02:39:23.007469 | orchestrator | Tuesday 28 April 2026 02:39:21 +0000 (0:00:01.438) 0:03:12.059 ********* 2026-04-28 02:39:23.007487 | orchestrator | changed: [testbed-node-0] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/memcached:1.6.24.20251130', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-28 02:39:23.007501 | orchestrator | changed: [testbed-node-1] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/memcached:1.6.24.20251130', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-28 02:39:23.007512 | orchestrator | changed: [testbed-node-2] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/memcached:1.6.24.20251130', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-28 02:39:23.007523 | orchestrator | 2026-04-28 02:39:23.007533 | orchestrator | TASK [haproxy-config : Add configuration for memcached when using single external frontend] *** 2026-04-28 02:39:23.007543 | orchestrator | Tuesday 28 April 2026 02:39:22 +0000 (0:00:01.571) 0:03:13.630 ********* 2026-04-28 02:39:23.007562 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/memcached:1.6.24.20251130', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-28 02:39:32.463602 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/memcached:1.6.24.20251130', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-28 02:39:32.463725 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:39:32.463744 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:39:32.463756 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/memcached:1.6.24.20251130', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-28 02:39:32.463767 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:39:32.463777 | orchestrator | 2026-04-28 02:39:32.463788 | orchestrator | TASK [haproxy-config : Configuring firewall for memcached] ********************* 2026-04-28 02:39:32.463800 | orchestrator | Tuesday 28 April 2026 02:39:23 +0000 (0:00:00.440) 0:03:14.070 ********* 2026-04-28 02:39:32.463811 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'memcached', 'value': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}})  2026-04-28 02:39:32.463822 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:39:32.463833 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'memcached', 'value': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}})  2026-04-28 02:39:32.463842 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:39:32.463852 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'memcached', 'value': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}})  2026-04-28 02:39:32.463862 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:39:32.463872 | orchestrator | 2026-04-28 02:39:32.463882 | orchestrator | TASK [proxysql-config : Copying over memcached ProxySQL users config] ********** 2026-04-28 02:39:32.463892 | orchestrator | Tuesday 28 April 2026 02:39:24 +0000 (0:00:00.963) 0:03:15.033 ********* 2026-04-28 02:39:32.463924 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:39:32.463934 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:39:32.463944 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:39:32.463953 | orchestrator | 2026-04-28 02:39:32.463963 | orchestrator | TASK [proxysql-config : Copying over memcached ProxySQL rules config] ********** 2026-04-28 02:39:32.463973 | orchestrator | Tuesday 28 April 2026 02:39:24 +0000 (0:00:00.489) 0:03:15.522 ********* 2026-04-28 02:39:32.463983 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:39:32.463993 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:39:32.464002 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:39:32.464012 | orchestrator | 2026-04-28 02:39:32.464021 | orchestrator | TASK [include_role : mistral] ************************************************** 2026-04-28 02:39:32.464031 | orchestrator | Tuesday 28 April 2026 02:39:26 +0000 (0:00:01.454) 0:03:16.977 ********* 2026-04-28 02:39:32.464041 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:39:32.464050 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:39:32.464060 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:39:32.464069 | orchestrator | 2026-04-28 02:39:32.464079 | orchestrator | TASK [include_role : neutron] ************************************************** 2026-04-28 02:39:32.464089 | orchestrator | Tuesday 28 April 2026 02:39:26 +0000 (0:00:00.350) 0:03:17.328 ********* 2026-04-28 02:39:32.464098 | orchestrator | included: neutron for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:39:32.464108 | orchestrator | 2026-04-28 02:39:32.464117 | orchestrator | TASK [haproxy-config : Copying over neutron haproxy config] ******************** 2026-04-28 02:39:32.464127 | orchestrator | Tuesday 28 April 2026 02:39:28 +0000 (0:00:01.789) 0:03:19.117 ********* 2026-04-28 02:39:32.464196 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-28 02:39:32.464222 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/neutron-openvswitch-agent:25.2.2.20251130', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:32.464242 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-linuxbridge-agent', 'value': {'container_name': 'neutron_linuxbridge_agent', 'image': 'registry.osism.tech/kolla/release/neutron-linuxbridge-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-linuxbridge-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-linuxbridge-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:32.464345 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-dhcp-agent', 'value': {'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/neutron-dhcp-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:32.464363 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-l3-agent', 'value': {'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/neutron-l3-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}}})  2026-04-28 02:39:32.464430 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/neutron-sriov-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:32.855845 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/neutron-mlnx-agent:25.2.2.20251130', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-28 02:39:32.855970 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/neutron-eswitchd:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-28 02:39:32.856010 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-metadata-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:32.856056 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 02:39:32.856091 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/neutron-bgp-dragent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:32.856110 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/neutron-infoblox-ipam-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}}})  2026-04-28 02:39:32.856150 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metering-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-28 02:39:32.856169 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/ironic-neutron-agent:25.2.2.20251130', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:32.856198 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/neutron-tls-proxy:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-28 02:39:32.856234 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/neutron-ovn-agent:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-28 02:39:32.856288 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-28 02:39:32.856308 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/neutron-openvswitch-agent:25.2.2.20251130', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:32.856340 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-linuxbridge-agent', 'value': {'container_name': 'neutron_linuxbridge_agent', 'image': 'registry.osism.tech/kolla/release/neutron-linuxbridge-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-linuxbridge-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-linuxbridge-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:33.110648 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-dhcp-agent', 'value': {'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/neutron-dhcp-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:33.110754 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-l3-agent', 'value': {'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/neutron-l3-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}}})  2026-04-28 02:39:33.110770 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/neutron-sriov-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:33.110782 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/neutron-mlnx-agent:25.2.2.20251130', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-28 02:39:33.110793 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/neutron-eswitchd:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-28 02:39:33.110802 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-metadata-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:33.110834 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 02:39:33.110849 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/neutron-bgp-dragent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:33.110857 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/neutron-infoblox-ipam-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}}})  2026-04-28 02:39:33.110864 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metering-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-28 02:39:33.110873 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/ironic-neutron-agent:25.2.2.20251130', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:33.110881 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/neutron-tls-proxy:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-28 02:39:33.110901 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/neutron-ovn-agent:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-28 02:39:33.424586 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-28 02:39:33.424686 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/neutron-openvswitch-agent:25.2.2.20251130', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:33.424701 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-linuxbridge-agent', 'value': {'container_name': 'neutron_linuxbridge_agent', 'image': 'registry.osism.tech/kolla/release/neutron-linuxbridge-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-linuxbridge-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-linuxbridge-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:33.424710 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-dhcp-agent', 'value': {'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/neutron-dhcp-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:33.424733 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-l3-agent', 'value': {'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/neutron-l3-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}}})  2026-04-28 02:39:33.424828 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/neutron-sriov-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:33.424841 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/neutron-mlnx-agent:25.2.2.20251130', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-28 02:39:33.424850 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/neutron-eswitchd:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-28 02:39:33.424860 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-metadata-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:33.424868 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 02:39:33.424875 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/neutron-bgp-dragent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:33.424900 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/neutron-infoblox-ipam-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}}})  2026-04-28 02:39:34.705665 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metering-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-28 02:39:34.705754 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/ironic-neutron-agent:25.2.2.20251130', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:34.705771 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/neutron-tls-proxy:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-28 02:39:34.705786 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/neutron-ovn-agent:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-28 02:39:34.705798 | orchestrator | 2026-04-28 02:39:34.705811 | orchestrator | TASK [haproxy-config : Add configuration for neutron when using single external frontend] *** 2026-04-28 02:39:34.705823 | orchestrator | Tuesday 28 April 2026 02:39:33 +0000 (0:00:05.167) 0:03:24.284 ********* 2026-04-28 02:39:34.705854 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 02:39:34.705909 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/neutron-openvswitch-agent:25.2.2.20251130', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:34.705925 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-linuxbridge-agent', 'value': {'container_name': 'neutron_linuxbridge_agent', 'image': 'registry.osism.tech/kolla/release/neutron-linuxbridge-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-linuxbridge-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-linuxbridge-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:34.705938 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-dhcp-agent', 'value': {'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/neutron-dhcp-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:34.705948 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-l3-agent', 'value': {'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/neutron-l3-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}}})  2026-04-28 02:39:34.705965 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 02:39:34.705994 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/neutron-sriov-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:34.803578 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/neutron-openvswitch-agent:25.2.2.20251130', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:34.803667 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 02:39:34.803681 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-linuxbridge-agent', 'value': {'container_name': 'neutron_linuxbridge_agent', 'image': 'registry.osism.tech/kolla/release/neutron-linuxbridge-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-linuxbridge-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-linuxbridge-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:34.803693 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/neutron-mlnx-agent:25.2.2.20251130', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-28 02:39:34.803741 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-dhcp-agent', 'value': {'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/neutron-dhcp-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:34.803768 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/neutron-openvswitch-agent:25.2.2.20251130', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:34.803778 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/neutron-eswitchd:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-28 02:39:34.803788 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-l3-agent', 'value': {'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/neutron-l3-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}}})  2026-04-28 02:39:34.803799 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-metadata-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:34.803814 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-linuxbridge-agent', 'value': {'container_name': 'neutron_linuxbridge_agent', 'image': 'registry.osism.tech/kolla/release/neutron-linuxbridge-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-linuxbridge-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-linuxbridge-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:34.803828 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/neutron-sriov-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:34.803845 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/neutron-mlnx-agent:25.2.2.20251130', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-28 02:39:34.889747 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-dhcp-agent', 'value': {'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/neutron-dhcp-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:34.889846 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 02:39:34.889864 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/neutron-eswitchd:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-28 02:39:34.889903 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/neutron-bgp-dragent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:34.889930 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-l3-agent', 'value': {'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/neutron-l3-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}}})  2026-04-28 02:39:34.889967 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-metadata-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:34.889988 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/neutron-infoblox-ipam-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}}})  2026-04-28 02:39:34.890008 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/neutron-sriov-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:34.890116 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 02:39:34.890151 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metering-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-28 02:39:34.890172 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/neutron-bgp-dragent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:34.890204 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/neutron-mlnx-agent:25.2.2.20251130', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-28 02:39:34.890296 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/neutron-infoblox-ipam-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}}})  2026-04-28 02:39:35.115377 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/ironic-neutron-agent:25.2.2.20251130', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:35.115449 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/neutron-eswitchd:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-28 02:39:35.115456 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metering-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-28 02:39:35.115477 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/ironic-neutron-agent:25.2.2.20251130', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:35.115484 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/neutron-tls-proxy:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-28 02:39:35.115533 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-metadata-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:35.115556 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/neutron-tls-proxy:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-28 02:39:35.115578 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 02:39:35.115588 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/neutron-ovn-agent:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-28 02:39:35.115593 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/neutron-ovn-agent:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-28 02:39:35.115597 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:39:35.115606 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/neutron-bgp-dragent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:35.115610 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:39:35.115619 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/neutron-infoblox-ipam-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}}})  2026-04-28 02:39:45.977714 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metering-agent:25.2.2.20251130', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}}})  2026-04-28 02:39:45.977801 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/ironic-neutron-agent:25.2.2.20251130', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-28 02:39:45.977838 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/neutron-tls-proxy:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-28 02:39:45.977849 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/neutron-ovn-agent:25.2.2.20251130', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-28 02:39:45.977856 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:39:45.977864 | orchestrator | 2026-04-28 02:39:45.977871 | orchestrator | TASK [haproxy-config : Configuring firewall for neutron] *********************** 2026-04-28 02:39:45.977892 | orchestrator | Tuesday 28 April 2026 02:39:35 +0000 (0:00:01.693) 0:03:25.978 ********* 2026-04-28 02:39:45.977898 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}})  2026-04-28 02:39:45.977907 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}})  2026-04-28 02:39:45.977914 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:39:45.977919 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}})  2026-04-28 02:39:45.977924 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}})  2026-04-28 02:39:45.977930 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:39:45.977950 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}})  2026-04-28 02:39:45.977955 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}})  2026-04-28 02:39:45.977960 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:39:45.977966 | orchestrator | 2026-04-28 02:39:45.977971 | orchestrator | TASK [proxysql-config : Copying over neutron ProxySQL users config] ************ 2026-04-28 02:39:45.977977 | orchestrator | Tuesday 28 April 2026 02:39:37 +0000 (0:00:02.185) 0:03:28.164 ********* 2026-04-28 02:39:45.977990 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:39:45.977995 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:39:45.978000 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:39:45.978006 | orchestrator | 2026-04-28 02:39:45.978050 | orchestrator | TASK [proxysql-config : Copying over neutron ProxySQL rules config] ************ 2026-04-28 02:39:45.978059 | orchestrator | Tuesday 28 April 2026 02:39:38 +0000 (0:00:01.410) 0:03:29.574 ********* 2026-04-28 02:39:45.978065 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:39:45.978071 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:39:45.978077 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:39:45.978083 | orchestrator | 2026-04-28 02:39:45.978088 | orchestrator | TASK [include_role : placement] ************************************************ 2026-04-28 02:39:45.978094 | orchestrator | Tuesday 28 April 2026 02:39:40 +0000 (0:00:02.248) 0:03:31.822 ********* 2026-04-28 02:39:45.978100 | orchestrator | included: placement for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:39:45.978106 | orchestrator | 2026-04-28 02:39:45.978112 | orchestrator | TASK [haproxy-config : Copying over placement haproxy config] ****************** 2026-04-28 02:39:45.978119 | orchestrator | Tuesday 28 April 2026 02:39:42 +0000 (0:00:01.290) 0:03:33.113 ********* 2026-04-28 02:39:45.978126 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-28 02:39:45.978141 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-28 02:39:45.978148 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-28 02:39:45.978159 | orchestrator | 2026-04-28 02:39:45.978220 | orchestrator | TASK [haproxy-config : Add configuration for placement when using single external frontend] *** 2026-04-28 02:39:45.978237 | orchestrator | Tuesday 28 April 2026 02:39:45 +0000 (0:00:03.723) 0:03:36.836 ********* 2026-04-28 02:39:57.391233 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-28 02:39:57.391356 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:39:57.391378 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-28 02:39:57.391393 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:39:57.391407 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-28 02:39:57.391420 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:39:57.391443 | orchestrator | 2026-04-28 02:39:57.391468 | orchestrator | TASK [haproxy-config : Configuring firewall for placement] ********************* 2026-04-28 02:39:57.391486 | orchestrator | Tuesday 28 April 2026 02:39:46 +0000 (0:00:00.557) 0:03:37.394 ********* 2026-04-28 02:39:57.391494 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}})  2026-04-28 02:39:57.391504 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}})  2026-04-28 02:39:57.391534 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:39:57.391542 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}})  2026-04-28 02:39:57.391549 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}})  2026-04-28 02:39:57.391557 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:39:57.391578 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}})  2026-04-28 02:39:57.391586 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}})  2026-04-28 02:39:57.391593 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:39:57.391600 | orchestrator | 2026-04-28 02:39:57.391608 | orchestrator | TASK [proxysql-config : Copying over placement ProxySQL users config] ********** 2026-04-28 02:39:57.391615 | orchestrator | Tuesday 28 April 2026 02:39:47 +0000 (0:00:00.917) 0:03:38.312 ********* 2026-04-28 02:39:57.391623 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:39:57.391630 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:39:57.391637 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:39:57.391644 | orchestrator | 2026-04-28 02:39:57.391651 | orchestrator | TASK [proxysql-config : Copying over placement ProxySQL rules config] ********** 2026-04-28 02:39:57.391659 | orchestrator | Tuesday 28 April 2026 02:39:49 +0000 (0:00:01.970) 0:03:40.282 ********* 2026-04-28 02:39:57.391666 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:39:57.391673 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:39:57.391680 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:39:57.391687 | orchestrator | 2026-04-28 02:39:57.391695 | orchestrator | TASK [include_role : nova] ***************************************************** 2026-04-28 02:39:57.391702 | orchestrator | Tuesday 28 April 2026 02:39:51 +0000 (0:00:01.995) 0:03:42.277 ********* 2026-04-28 02:39:57.391709 | orchestrator | included: nova for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:39:57.391716 | orchestrator | 2026-04-28 02:39:57.391724 | orchestrator | TASK [haproxy-config : Copying over nova haproxy config] *********************** 2026-04-28 02:39:57.391731 | orchestrator | Tuesday 28 April 2026 02:39:53 +0000 (0:00:01.630) 0:03:43.907 ********* 2026-04-28 02:39:57.391741 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-28 02:39:57.391756 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 02:39:57.391773 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/nova-super-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 02:39:57.391790 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-28 02:39:58.679209 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 02:39:58.679311 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/nova-super-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 02:39:58.679348 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-28 02:39:58.679398 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 02:39:58.679424 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/nova-super-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 02:39:58.679437 | orchestrator | 2026-04-28 02:39:58.679451 | orchestrator | TASK [haproxy-config : Add configuration for nova when using single external frontend] *** 2026-04-28 02:39:58.679463 | orchestrator | Tuesday 28 April 2026 02:39:57 +0000 (0:00:04.343) 0:03:48.250 ********* 2026-04-28 02:39:58.679496 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-28 02:39:58.679510 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 02:39:58.679536 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/nova-super-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 02:39:58.679548 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:39:58.679562 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-28 02:39:58.679582 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 02:40:10.139865 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/nova-super-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 02:40:10.140013 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:40:10.140133 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-28 02:40:10.140172 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 02:40:10.140185 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/nova-super-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 02:40:10.140196 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:40:10.140208 | orchestrator | 2026-04-28 02:40:10.140220 | orchestrator | TASK [haproxy-config : Configuring firewall for nova] ************************** 2026-04-28 02:40:10.140232 | orchestrator | Tuesday 28 April 2026 02:39:58 +0000 (0:00:01.287) 0:03:49.538 ********* 2026-04-28 02:40:10.140249 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}})  2026-04-28 02:40:10.140271 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}})  2026-04-28 02:40:10.140293 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_metadata', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}})  2026-04-28 02:40:10.140337 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_metadata_external', 'value': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}})  2026-04-28 02:40:10.140361 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:40:10.140381 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}})  2026-04-28 02:40:10.140401 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}})  2026-04-28 02:40:10.140422 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_metadata', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}})  2026-04-28 02:40:10.140457 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_metadata_external', 'value': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}})  2026-04-28 02:40:10.140477 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:40:10.140497 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}})  2026-04-28 02:40:10.140510 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}})  2026-04-28 02:40:10.140523 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_metadata', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}})  2026-04-28 02:40:10.140544 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_metadata_external', 'value': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}})  2026-04-28 02:40:10.140557 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:40:10.140569 | orchestrator | 2026-04-28 02:40:10.140581 | orchestrator | TASK [proxysql-config : Copying over nova ProxySQL users config] *************** 2026-04-28 02:40:10.140593 | orchestrator | Tuesday 28 April 2026 02:39:59 +0000 (0:00:00.942) 0:03:50.480 ********* 2026-04-28 02:40:10.140606 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:40:10.140618 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:40:10.140630 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:40:10.140642 | orchestrator | 2026-04-28 02:40:10.140655 | orchestrator | TASK [proxysql-config : Copying over nova ProxySQL rules config] *************** 2026-04-28 02:40:10.140667 | orchestrator | Tuesday 28 April 2026 02:40:01 +0000 (0:00:01.470) 0:03:51.951 ********* 2026-04-28 02:40:10.140678 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:40:10.140689 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:40:10.140699 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:40:10.140710 | orchestrator | 2026-04-28 02:40:10.140721 | orchestrator | TASK [include_role : nova-cell] ************************************************ 2026-04-28 02:40:10.140731 | orchestrator | Tuesday 28 April 2026 02:40:03 +0000 (0:00:02.259) 0:03:54.210 ********* 2026-04-28 02:40:10.140742 | orchestrator | included: nova-cell for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:40:10.140753 | orchestrator | 2026-04-28 02:40:10.140763 | orchestrator | TASK [nova-cell : Configure loadbalancer for nova-novncproxy] ****************** 2026-04-28 02:40:10.140774 | orchestrator | Tuesday 28 April 2026 02:40:05 +0000 (0:00:01.720) 0:03:55.931 ********* 2026-04-28 02:40:10.140785 | orchestrator | included: /ansible/roles/nova-cell/tasks/cell_proxy_loadbalancer.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item=nova-novncproxy) 2026-04-28 02:40:10.140797 | orchestrator | 2026-04-28 02:40:10.140808 | orchestrator | TASK [haproxy-config : Copying over nova-cell:nova-novncproxy haproxy config] *** 2026-04-28 02:40:10.140819 | orchestrator | Tuesday 28 April 2026 02:40:05 +0000 (0:00:00.917) 0:03:56.848 ********* 2026-04-28 02:40:10.140831 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}}) 2026-04-28 02:40:10.140857 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}}) 2026-04-28 02:40:22.954231 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}}) 2026-04-28 02:40:22.954333 | orchestrator | 2026-04-28 02:40:22.954361 | orchestrator | TASK [haproxy-config : Add configuration for nova-cell:nova-novncproxy when using single external frontend] *** 2026-04-28 02:40:22.954375 | orchestrator | Tuesday 28 April 2026 02:40:10 +0000 (0:00:04.157) 0:04:01.006 ********* 2026-04-28 02:40:22.954389 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-28 02:40:22.954401 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:40:22.954432 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-28 02:40:22.954444 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:40:22.954455 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-28 02:40:22.954466 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:40:22.954477 | orchestrator | 2026-04-28 02:40:22.954488 | orchestrator | TASK [haproxy-config : Configuring firewall for nova-cell:nova-novncproxy] ***** 2026-04-28 02:40:22.954499 | orchestrator | Tuesday 28 April 2026 02:40:11 +0000 (0:00:01.603) 0:04:02.609 ********* 2026-04-28 02:40:22.954512 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_novncproxy', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-28 02:40:22.954526 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_novncproxy_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-28 02:40:22.954539 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:40:22.954550 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_novncproxy', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-28 02:40:22.954585 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_novncproxy_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-28 02:40:22.954597 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:40:22.954608 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_novncproxy', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-28 02:40:22.954620 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_novncproxy_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-28 02:40:22.954650 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:40:22.954662 | orchestrator | 2026-04-28 02:40:22.954673 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL users config] ********** 2026-04-28 02:40:22.954684 | orchestrator | Tuesday 28 April 2026 02:40:13 +0000 (0:00:01.719) 0:04:04.329 ********* 2026-04-28 02:40:22.954695 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:40:22.954706 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:40:22.954717 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:40:22.954728 | orchestrator | 2026-04-28 02:40:22.954739 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL rules config] ********** 2026-04-28 02:40:22.954751 | orchestrator | Tuesday 28 April 2026 02:40:16 +0000 (0:00:02.743) 0:04:07.072 ********* 2026-04-28 02:40:22.954763 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:40:22.954775 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:40:22.954787 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:40:22.954799 | orchestrator | 2026-04-28 02:40:22.954812 | orchestrator | TASK [nova-cell : Configure loadbalancer for nova-spicehtml5proxy] ************* 2026-04-28 02:40:22.954824 | orchestrator | Tuesday 28 April 2026 02:40:19 +0000 (0:00:03.037) 0:04:10.110 ********* 2026-04-28 02:40:22.954837 | orchestrator | included: /ansible/roles/nova-cell/tasks/cell_proxy_loadbalancer.yml for testbed-node-1, testbed-node-0, testbed-node-2 => (item=nova-spicehtml5proxy) 2026-04-28 02:40:22.954851 | orchestrator | 2026-04-28 02:40:22.954863 | orchestrator | TASK [haproxy-config : Copying over nova-cell:nova-spicehtml5proxy haproxy config] *** 2026-04-28 02:40:22.954876 | orchestrator | Tuesday 28 April 2026 02:40:20 +0000 (0:00:01.169) 0:04:11.279 ********* 2026-04-28 02:40:22.954890 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-28 02:40:22.954903 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:40:22.954920 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-28 02:40:22.954932 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:40:22.954970 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-28 02:40:22.954991 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:40:22.955002 | orchestrator | 2026-04-28 02:40:22.955014 | orchestrator | TASK [haproxy-config : Add configuration for nova-cell:nova-spicehtml5proxy when using single external frontend] *** 2026-04-28 02:40:22.955025 | orchestrator | Tuesday 28 April 2026 02:40:21 +0000 (0:00:01.102) 0:04:12.382 ********* 2026-04-28 02:40:22.955036 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-28 02:40:22.955048 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:40:22.955059 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-28 02:40:22.955077 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:40:48.110464 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-28 02:40:48.110643 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:40:48.111605 | orchestrator | 2026-04-28 02:40:48.111650 | orchestrator | TASK [haproxy-config : Configuring firewall for nova-cell:nova-spicehtml5proxy] *** 2026-04-28 02:40:48.111657 | orchestrator | Tuesday 28 April 2026 02:40:22 +0000 (0:00:01.432) 0:04:13.815 ********* 2026-04-28 02:40:48.111663 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:40:48.111668 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:40:48.111673 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:40:48.111678 | orchestrator | 2026-04-28 02:40:48.111682 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL users config] ********** 2026-04-28 02:40:48.111687 | orchestrator | Tuesday 28 April 2026 02:40:24 +0000 (0:00:01.624) 0:04:15.440 ********* 2026-04-28 02:40:48.111692 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:40:48.111697 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:40:48.111701 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:40:48.111706 | orchestrator | 2026-04-28 02:40:48.111710 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL rules config] ********** 2026-04-28 02:40:48.111714 | orchestrator | Tuesday 28 April 2026 02:40:27 +0000 (0:00:03.006) 0:04:18.446 ********* 2026-04-28 02:40:48.111718 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:40:48.111722 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:40:48.111726 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:40:48.111729 | orchestrator | 2026-04-28 02:40:48.111733 | orchestrator | TASK [nova-cell : Configure loadbalancer for nova-serialproxy] ***************** 2026-04-28 02:40:48.111737 | orchestrator | Tuesday 28 April 2026 02:40:30 +0000 (0:00:02.881) 0:04:21.328 ********* 2026-04-28 02:40:48.111759 | orchestrator | included: /ansible/roles/nova-cell/tasks/cell_proxy_loadbalancer.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item=nova-serialproxy) 2026-04-28 02:40:48.111765 | orchestrator | 2026-04-28 02:40:48.111781 | orchestrator | TASK [haproxy-config : Copying over nova-cell:nova-serialproxy haproxy config] *** 2026-04-28 02:40:48.111785 | orchestrator | Tuesday 28 April 2026 02:40:31 +0000 (0:00:01.249) 0:04:22.578 ********* 2026-04-28 02:40:48.111791 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-28 02:40:48.111827 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:40:48.111832 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-28 02:40:48.111836 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:40:48.111840 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-28 02:40:48.111844 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:40:48.111848 | orchestrator | 2026-04-28 02:40:48.111852 | orchestrator | TASK [haproxy-config : Add configuration for nova-cell:nova-serialproxy when using single external frontend] *** 2026-04-28 02:40:48.111857 | orchestrator | Tuesday 28 April 2026 02:40:33 +0000 (0:00:01.305) 0:04:23.883 ********* 2026-04-28 02:40:48.111876 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-28 02:40:48.111880 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:40:48.111884 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-28 02:40:48.111888 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:40:48.111892 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-28 02:40:48.111900 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:40:48.111904 | orchestrator | 2026-04-28 02:40:48.111908 | orchestrator | TASK [haproxy-config : Configuring firewall for nova-cell:nova-serialproxy] **** 2026-04-28 02:40:48.111913 | orchestrator | Tuesday 28 April 2026 02:40:34 +0000 (0:00:01.384) 0:04:25.268 ********* 2026-04-28 02:40:48.111916 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:40:48.111920 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:40:48.111924 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:40:48.111928 | orchestrator | 2026-04-28 02:40:48.111935 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL users config] ********** 2026-04-28 02:40:48.111939 | orchestrator | Tuesday 28 April 2026 02:40:36 +0000 (0:00:01.962) 0:04:27.230 ********* 2026-04-28 02:40:48.111943 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:40:48.111946 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:40:48.111950 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:40:48.111954 | orchestrator | 2026-04-28 02:40:48.111958 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL rules config] ********** 2026-04-28 02:40:48.111962 | orchestrator | Tuesday 28 April 2026 02:40:38 +0000 (0:00:02.513) 0:04:29.744 ********* 2026-04-28 02:40:48.111965 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:40:48.111969 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:40:48.111973 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:40:48.111977 | orchestrator | 2026-04-28 02:40:48.111980 | orchestrator | TASK [include_role : octavia] ************************************************** 2026-04-28 02:40:48.111984 | orchestrator | Tuesday 28 April 2026 02:40:42 +0000 (0:00:03.650) 0:04:33.394 ********* 2026-04-28 02:40:48.111988 | orchestrator | included: octavia for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:40:48.111992 | orchestrator | 2026-04-28 02:40:48.111996 | orchestrator | TASK [haproxy-config : Copying over octavia haproxy config] ******************** 2026-04-28 02:40:48.111999 | orchestrator | Tuesday 28 April 2026 02:40:44 +0000 (0:00:01.759) 0:04:35.154 ********* 2026-04-28 02:40:48.112004 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 02:40:48.112009 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 02:40:48.112018 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 02:40:48.925379 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 02:40:48.925508 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 02:40:48.925527 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 02:40:48.925540 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 02:40:48.925552 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 02:40:48.925565 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 02:40:48.925620 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 02:40:48.925639 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 02:40:48.925651 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 02:40:48.925663 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 02:40:48.925674 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 02:40:48.925685 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 02:40:48.925704 | orchestrator | 2026-04-28 02:40:48.925717 | orchestrator | TASK [haproxy-config : Add configuration for octavia when using single external frontend] *** 2026-04-28 02:40:48.925729 | orchestrator | Tuesday 28 April 2026 02:40:48 +0000 (0:00:03.958) 0:04:39.113 ********* 2026-04-28 02:40:48.925751 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 02:40:49.063915 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 02:40:49.064015 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 02:40:49.064068 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 02:40:49.064079 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 02:40:49.064103 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:40:49.064113 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 02:40:49.064120 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 02:40:49.064145 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 02:40:49.064152 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 02:40:49.064158 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 02:40:49.064164 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:40:49.064170 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 02:40:49.064181 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 02:40:49.064187 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 02:40:49.064203 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 02:41:01.584065 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 02:41:01.584183 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:41:01.584216 | orchestrator | 2026-04-28 02:41:01.584228 | orchestrator | TASK [haproxy-config : Configuring firewall for octavia] *********************** 2026-04-28 02:41:01.584240 | orchestrator | Tuesday 28 April 2026 02:40:49 +0000 (0:00:00.818) 0:04:39.931 ********* 2026-04-28 02:41:01.584251 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-28 02:41:01.584264 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-28 02:41:01.584276 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:41:01.584309 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-28 02:41:01.584320 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-28 02:41:01.584330 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:41:01.584340 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-28 02:41:01.584350 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-28 02:41:01.584359 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:41:01.584369 | orchestrator | 2026-04-28 02:41:01.584379 | orchestrator | TASK [proxysql-config : Copying over octavia ProxySQL users config] ************ 2026-04-28 02:41:01.584388 | orchestrator | Tuesday 28 April 2026 02:40:49 +0000 (0:00:00.928) 0:04:40.860 ********* 2026-04-28 02:41:01.584398 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:41:01.584408 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:41:01.584423 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:41:01.584439 | orchestrator | 2026-04-28 02:41:01.584468 | orchestrator | TASK [proxysql-config : Copying over octavia ProxySQL rules config] ************ 2026-04-28 02:41:01.584483 | orchestrator | Tuesday 28 April 2026 02:40:51 +0000 (0:00:01.894) 0:04:42.754 ********* 2026-04-28 02:41:01.584497 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:41:01.584513 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:41:01.584527 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:41:01.584543 | orchestrator | 2026-04-28 02:41:01.584558 | orchestrator | TASK [include_role : opensearch] *********************************************** 2026-04-28 02:41:01.584575 | orchestrator | Tuesday 28 April 2026 02:40:54 +0000 (0:00:02.380) 0:04:45.134 ********* 2026-04-28 02:41:01.584592 | orchestrator | included: opensearch for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:41:01.584610 | orchestrator | 2026-04-28 02:41:01.584626 | orchestrator | TASK [haproxy-config : Copying over opensearch haproxy config] ***************** 2026-04-28 02:41:01.584637 | orchestrator | Tuesday 28 April 2026 02:40:55 +0000 (0:00:01.526) 0:04:46.661 ********* 2026-04-28 02:41:01.584670 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-28 02:41:01.584706 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-28 02:41:01.584787 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-28 02:41:01.584803 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-28 02:41:01.584818 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-28 02:41:01.584847 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-28 02:41:03.640932 | orchestrator | 2026-04-28 02:41:03.641024 | orchestrator | TASK [haproxy-config : Add configuration for opensearch when using single external frontend] *** 2026-04-28 02:41:03.641038 | orchestrator | Tuesday 28 April 2026 02:41:01 +0000 (0:00:05.782) 0:04:52.444 ********* 2026-04-28 02:41:03.641051 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-28 02:41:03.641067 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-28 02:41:03.641079 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:41:03.641090 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-28 02:41:03.641121 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-28 02:41:03.641189 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-28 02:41:03.641207 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:41:03.641221 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-28 02:41:03.641237 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:41:03.641252 | orchestrator | 2026-04-28 02:41:03.641267 | orchestrator | TASK [haproxy-config : Configuring firewall for opensearch] ******************** 2026-04-28 02:41:03.641282 | orchestrator | Tuesday 28 April 2026 02:41:02 +0000 (0:00:01.095) 0:04:53.539 ********* 2026-04-28 02:41:03.641300 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}})  2026-04-28 02:41:03.641318 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}})  2026-04-28 02:41:03.641335 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}})  2026-04-28 02:41:03.641352 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch_dashboards_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}})  2026-04-28 02:41:03.641369 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:41:03.641396 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}})  2026-04-28 02:41:03.641428 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch_dashboards_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}})  2026-04-28 02:41:03.641446 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:41:03.641461 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}})  2026-04-28 02:41:03.641477 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}})  2026-04-28 02:41:03.641510 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch_dashboards_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}})  2026-04-28 02:41:10.004943 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:41:10.005051 | orchestrator | 2026-04-28 02:41:10.005070 | orchestrator | TASK [proxysql-config : Copying over opensearch ProxySQL users config] ********* 2026-04-28 02:41:10.005086 | orchestrator | Tuesday 28 April 2026 02:41:03 +0000 (0:00:00.962) 0:04:54.502 ********* 2026-04-28 02:41:10.005098 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:41:10.005111 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:41:10.005124 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:41:10.005137 | orchestrator | 2026-04-28 02:41:10.005150 | orchestrator | TASK [proxysql-config : Copying over opensearch ProxySQL rules config] ********* 2026-04-28 02:41:10.005163 | orchestrator | Tuesday 28 April 2026 02:41:04 +0000 (0:00:00.480) 0:04:54.983 ********* 2026-04-28 02:41:10.005175 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:41:10.005188 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:41:10.005202 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:41:10.005215 | orchestrator | 2026-04-28 02:41:10.005229 | orchestrator | TASK [include_role : prometheus] *********************************************** 2026-04-28 02:41:10.005242 | orchestrator | Tuesday 28 April 2026 02:41:05 +0000 (0:00:01.550) 0:04:56.533 ********* 2026-04-28 02:41:10.005255 | orchestrator | included: prometheus for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:41:10.005268 | orchestrator | 2026-04-28 02:41:10.005281 | orchestrator | TASK [haproxy-config : Copying over prometheus haproxy config] ***************** 2026-04-28 02:41:10.005294 | orchestrator | Tuesday 28 April 2026 02:41:07 +0000 (0:00:01.811) 0:04:58.345 ********* 2026-04-28 02:41:10.005328 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}}) 2026-04-28 02:41:10.005358 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 02:41:10.005397 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:10.005425 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:10.005438 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 02:41:10.005470 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}}) 2026-04-28 02:41:10.005484 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 02:41:10.005496 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:10.005508 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:10.005529 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 02:41:10.005549 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}}) 2026-04-28 02:41:10.005559 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 02:41:10.005574 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:11.671528 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:11.671644 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 02:41:11.671660 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}}) 2026-04-28 02:41:11.671768 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/prometheus-openstack-exporter:1.7.0.20251130', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}}}})  2026-04-28 02:41:11.671782 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:11.671792 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:11.671823 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 02:41:11.671834 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}}) 2026-04-28 02:41:11.671851 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/prometheus-openstack-exporter:1.7.0.20251130', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}}}})  2026-04-28 02:41:11.671865 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:11.671875 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:11.671884 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 02:41:11.671904 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}}) 2026-04-28 02:41:12.436445 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/prometheus-openstack-exporter:1.7.0.20251130', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}}}})  2026-04-28 02:41:12.436594 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:12.436639 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:12.436659 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 02:41:12.436790 | orchestrator | 2026-04-28 02:41:12.436812 | orchestrator | TASK [haproxy-config : Add configuration for prometheus when using single external frontend] *** 2026-04-28 02:41:12.436831 | orchestrator | Tuesday 28 April 2026 02:41:11 +0000 (0:00:04.368) 0:05:02.713 ********* 2026-04-28 02:41:12.436851 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}})  2026-04-28 02:41:12.436871 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 02:41:12.436919 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:12.436955 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:12.436977 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 02:41:12.437013 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}})  2026-04-28 02:41:12.437041 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/prometheus-openstack-exporter:1.7.0.20251130', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}}}})  2026-04-28 02:41:12.437077 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}})  2026-04-28 02:41:12.586164 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:12.586250 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 02:41:12.586262 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:12.586286 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:12.586297 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 02:41:12.586304 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:12.586313 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:41:12.586324 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 02:41:12.586367 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}})  2026-04-28 02:41:12.586378 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/prometheus-openstack-exporter:1.7.0.20251130', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}}}})  2026-04-28 02:41:12.586391 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}})  2026-04-28 02:41:12.586400 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:12.586407 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 02:41:12.586426 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:12.586447 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:14.289292 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 02:41:14.289375 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:41:14.289388 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:14.289412 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 02:41:14.289423 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}})  2026-04-28 02:41:14.289433 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/prometheus-openstack-exporter:1.7.0.20251130', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['timeout server 45s']}}}})  2026-04-28 02:41:14.289553 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:14.289579 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 02:41:14.289586 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 02:41:14.289592 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:41:14.289599 | orchestrator | 2026-04-28 02:41:14.289606 | orchestrator | TASK [haproxy-config : Configuring firewall for prometheus] ******************** 2026-04-28 02:41:14.289614 | orchestrator | Tuesday 28 April 2026 02:41:12 +0000 (0:00:00.883) 0:05:03.597 ********* 2026-04-28 02:41:14.289621 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}})  2026-04-28 02:41:14.289636 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_server_external', 'value': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}})  2026-04-28 02:41:14.289646 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_alertmanager', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}})  2026-04-28 02:41:14.289679 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_alertmanager_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}})  2026-04-28 02:41:14.289690 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:41:14.289699 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}})  2026-04-28 02:41:14.289708 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_server_external', 'value': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}})  2026-04-28 02:41:14.289726 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_alertmanager', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}})  2026-04-28 02:41:14.289736 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_alertmanager_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}})  2026-04-28 02:41:14.289747 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:41:14.289757 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}})  2026-04-28 02:41:14.289767 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_server_external', 'value': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}})  2026-04-28 02:41:14.289777 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_alertmanager', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}})  2026-04-28 02:41:14.289795 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_alertmanager_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}})  2026-04-28 02:41:22.692492 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:41:22.692601 | orchestrator | 2026-04-28 02:41:22.692664 | orchestrator | TASK [proxysql-config : Copying over prometheus ProxySQL users config] ********* 2026-04-28 02:41:22.692675 | orchestrator | Tuesday 28 April 2026 02:41:14 +0000 (0:00:01.544) 0:05:05.142 ********* 2026-04-28 02:41:22.692684 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:41:22.692692 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:41:22.692713 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:41:22.692730 | orchestrator | 2026-04-28 02:41:22.692739 | orchestrator | TASK [proxysql-config : Copying over prometheus ProxySQL rules config] ********* 2026-04-28 02:41:22.692747 | orchestrator | Tuesday 28 April 2026 02:41:14 +0000 (0:00:00.482) 0:05:05.624 ********* 2026-04-28 02:41:22.692756 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:41:22.692764 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:41:22.692772 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:41:22.692780 | orchestrator | 2026-04-28 02:41:22.692788 | orchestrator | TASK [include_role : rabbitmq] ************************************************* 2026-04-28 02:41:22.692797 | orchestrator | Tuesday 28 April 2026 02:41:16 +0000 (0:00:01.457) 0:05:07.082 ********* 2026-04-28 02:41:22.692805 | orchestrator | included: rabbitmq for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:41:22.692813 | orchestrator | 2026-04-28 02:41:22.692821 | orchestrator | TASK [haproxy-config : Copying over rabbitmq haproxy config] ******************* 2026-04-28 02:41:22.692829 | orchestrator | Tuesday 28 April 2026 02:41:18 +0000 (0:00:01.932) 0:05:09.015 ********* 2026-04-28 02:41:22.692857 | orchestrator | changed: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 02:41:22.692892 | orchestrator | changed: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 02:41:22.692902 | orchestrator | changed: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 02:41:22.692911 | orchestrator | 2026-04-28 02:41:22.692919 | orchestrator | TASK [haproxy-config : Add configuration for rabbitmq when using single external frontend] *** 2026-04-28 02:41:22.692944 | orchestrator | Tuesday 28 April 2026 02:41:20 +0000 (0:00:02.453) 0:05:11.468 ********* 2026-04-28 02:41:22.692953 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-28 02:41:22.692963 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-28 02:41:22.692978 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:41:22.692987 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:41:22.693024 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-28 02:41:22.693033 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:41:22.693041 | orchestrator | 2026-04-28 02:41:22.693049 | orchestrator | TASK [haproxy-config : Configuring firewall for rabbitmq] ********************** 2026-04-28 02:41:22.693057 | orchestrator | Tuesday 28 April 2026 02:41:21 +0000 (0:00:00.444) 0:05:11.913 ********* 2026-04-28 02:41:22.693066 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'rabbitmq_management', 'value': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}})  2026-04-28 02:41:22.693075 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:41:22.693083 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'rabbitmq_management', 'value': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}})  2026-04-28 02:41:22.693091 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:41:22.693099 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'rabbitmq_management', 'value': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}})  2026-04-28 02:41:22.693107 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:41:22.693115 | orchestrator | 2026-04-28 02:41:22.693123 | orchestrator | TASK [proxysql-config : Copying over rabbitmq ProxySQL users config] *********** 2026-04-28 02:41:22.693131 | orchestrator | Tuesday 28 April 2026 02:41:22 +0000 (0:00:01.121) 0:05:13.034 ********* 2026-04-28 02:41:22.693144 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:41:33.483324 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:41:33.484363 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:41:33.484412 | orchestrator | 2026-04-28 02:41:33.484422 | orchestrator | TASK [proxysql-config : Copying over rabbitmq ProxySQL rules config] *********** 2026-04-28 02:41:33.484429 | orchestrator | Tuesday 28 April 2026 02:41:22 +0000 (0:00:00.528) 0:05:13.562 ********* 2026-04-28 02:41:33.484436 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:41:33.484441 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:41:33.484447 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:41:33.484453 | orchestrator | 2026-04-28 02:41:33.484459 | orchestrator | TASK [include_role : skyline] ************************************************** 2026-04-28 02:41:33.484465 | orchestrator | Tuesday 28 April 2026 02:41:24 +0000 (0:00:01.465) 0:05:15.028 ********* 2026-04-28 02:41:33.484490 | orchestrator | included: skyline for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:41:33.484496 | orchestrator | 2026-04-28 02:41:33.484502 | orchestrator | TASK [haproxy-config : Copying over skyline haproxy config] ******************** 2026-04-28 02:41:33.484508 | orchestrator | Tuesday 28 April 2026 02:41:25 +0000 (0:00:01.697) 0:05:16.725 ********* 2026-04-28 02:41:33.484525 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-28 02:41:33.484537 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-28 02:41:33.484543 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-28 02:41:33.484585 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-28 02:41:33.484603 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-28 02:41:33.484609 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-28 02:41:33.484615 | orchestrator | 2026-04-28 02:41:33.484621 | orchestrator | TASK [haproxy-config : Add configuration for skyline when using single external frontend] *** 2026-04-28 02:41:33.484628 | orchestrator | Tuesday 28 April 2026 02:41:32 +0000 (0:00:06.900) 0:05:23.626 ********* 2026-04-28 02:41:33.484634 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-28 02:41:33.484645 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-28 02:41:39.725507 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:41:39.725720 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-28 02:41:39.725763 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-28 02:41:39.725777 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:41:39.725789 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-28 02:41:39.725802 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-28 02:41:39.725834 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:41:39.725846 | orchestrator | 2026-04-28 02:41:39.725858 | orchestrator | TASK [haproxy-config : Configuring firewall for skyline] *********************** 2026-04-28 02:41:39.725870 | orchestrator | Tuesday 28 April 2026 02:41:33 +0000 (0:00:00.719) 0:05:24.345 ********* 2026-04-28 02:41:39.725903 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_apiserver', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}})  2026-04-28 02:41:39.725917 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_apiserver_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}})  2026-04-28 02:41:39.725930 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_console', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}})  2026-04-28 02:41:39.725941 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_console_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}})  2026-04-28 02:41:39.725953 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:41:39.725970 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_apiserver', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}})  2026-04-28 02:41:39.725981 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_apiserver_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}})  2026-04-28 02:41:39.726009 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_console', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}})  2026-04-28 02:41:39.726090 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_console_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}})  2026-04-28 02:41:39.726105 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:41:39.726117 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_apiserver', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}})  2026-04-28 02:41:39.726130 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_apiserver_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}})  2026-04-28 02:41:39.726143 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_console', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}})  2026-04-28 02:41:39.726155 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_console_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}})  2026-04-28 02:41:39.726167 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:41:39.726180 | orchestrator | 2026-04-28 02:41:39.726194 | orchestrator | TASK [proxysql-config : Copying over skyline ProxySQL users config] ************ 2026-04-28 02:41:39.726206 | orchestrator | Tuesday 28 April 2026 02:41:34 +0000 (0:00:00.972) 0:05:25.318 ********* 2026-04-28 02:41:39.726219 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:41:39.726230 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:41:39.726250 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:41:39.726261 | orchestrator | 2026-04-28 02:41:39.726283 | orchestrator | TASK [proxysql-config : Copying over skyline ProxySQL rules config] ************ 2026-04-28 02:41:39.726294 | orchestrator | Tuesday 28 April 2026 02:41:35 +0000 (0:00:01.441) 0:05:26.760 ********* 2026-04-28 02:41:39.726304 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:41:39.726315 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:41:39.726326 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:41:39.726336 | orchestrator | 2026-04-28 02:41:39.726347 | orchestrator | TASK [include_role : swift] **************************************************** 2026-04-28 02:41:39.726358 | orchestrator | Tuesday 28 April 2026 02:41:38 +0000 (0:00:02.410) 0:05:29.170 ********* 2026-04-28 02:41:39.726369 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:41:39.726381 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:41:39.726392 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:41:39.726403 | orchestrator | 2026-04-28 02:41:39.726413 | orchestrator | TASK [include_role : tacker] *************************************************** 2026-04-28 02:41:39.726424 | orchestrator | Tuesday 28 April 2026 02:41:39 +0000 (0:00:00.740) 0:05:29.910 ********* 2026-04-28 02:41:39.726434 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:41:39.726445 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:41:39.726456 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:41:39.726467 | orchestrator | 2026-04-28 02:41:39.726477 | orchestrator | TASK [include_role : trove] **************************************************** 2026-04-28 02:41:39.726488 | orchestrator | Tuesday 28 April 2026 02:41:39 +0000 (0:00:00.355) 0:05:30.266 ********* 2026-04-28 02:41:39.726499 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:41:39.726518 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:42:30.702663 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:42:30.702772 | orchestrator | 2026-04-28 02:42:30.702787 | orchestrator | TASK [include_role : venus] **************************************************** 2026-04-28 02:42:30.702798 | orchestrator | Tuesday 28 April 2026 02:41:39 +0000 (0:00:00.329) 0:05:30.596 ********* 2026-04-28 02:42:30.702807 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:42:30.702816 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:42:30.702825 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:42:30.702833 | orchestrator | 2026-04-28 02:42:30.702842 | orchestrator | TASK [include_role : watcher] ************************************************** 2026-04-28 02:42:30.702850 | orchestrator | Tuesday 28 April 2026 02:41:40 +0000 (0:00:00.359) 0:05:30.955 ********* 2026-04-28 02:42:30.702859 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:42:30.702867 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:42:30.702876 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:42:30.702885 | orchestrator | 2026-04-28 02:42:30.702894 | orchestrator | TASK [include_role : zun] ****************************************************** 2026-04-28 02:42:30.702902 | orchestrator | Tuesday 28 April 2026 02:41:40 +0000 (0:00:00.679) 0:05:31.634 ********* 2026-04-28 02:42:30.702911 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:42:30.702919 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:42:30.702928 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:42:30.702936 | orchestrator | 2026-04-28 02:42:30.702944 | orchestrator | RUNNING HANDLER [loadbalancer : Check IP addresses on the API interface] ******* 2026-04-28 02:42:30.702970 | orchestrator | Tuesday 28 April 2026 02:41:41 +0000 (0:00:00.656) 0:05:32.291 ********* 2026-04-28 02:42:30.702979 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:42:30.702988 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:42:30.702997 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:42:30.703005 | orchestrator | 2026-04-28 02:42:30.703013 | orchestrator | RUNNING HANDLER [loadbalancer : Group HA nodes by status] ********************** 2026-04-28 02:42:30.703021 | orchestrator | Tuesday 28 April 2026 02:41:42 +0000 (0:00:00.673) 0:05:32.965 ********* 2026-04-28 02:42:30.703030 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:42:30.703038 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:42:30.703047 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:42:30.703079 | orchestrator | 2026-04-28 02:42:30.703087 | orchestrator | RUNNING HANDLER [loadbalancer : Stop backup keepalived container] ************** 2026-04-28 02:42:30.703096 | orchestrator | Tuesday 28 April 2026 02:41:42 +0000 (0:00:00.717) 0:05:33.682 ********* 2026-04-28 02:42:30.703105 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:42:30.703113 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:42:30.703122 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:42:30.703130 | orchestrator | 2026-04-28 02:42:30.703138 | orchestrator | RUNNING HANDLER [loadbalancer : Stop backup haproxy container] ***************** 2026-04-28 02:42:30.703146 | orchestrator | Tuesday 28 April 2026 02:41:43 +0000 (0:00:00.911) 0:05:34.594 ********* 2026-04-28 02:42:30.703155 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:42:30.703163 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:42:30.703170 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:42:30.703178 | orchestrator | 2026-04-28 02:42:30.703187 | orchestrator | RUNNING HANDLER [loadbalancer : Stop backup proxysql container] **************** 2026-04-28 02:42:30.703196 | orchestrator | Tuesday 28 April 2026 02:41:44 +0000 (0:00:00.915) 0:05:35.510 ********* 2026-04-28 02:42:30.703205 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:42:30.703214 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:42:30.703223 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:42:30.703232 | orchestrator | 2026-04-28 02:42:30.703241 | orchestrator | RUNNING HANDLER [loadbalancer : Start backup haproxy container] **************** 2026-04-28 02:42:30.703249 | orchestrator | Tuesday 28 April 2026 02:41:45 +0000 (0:00:00.902) 0:05:36.413 ********* 2026-04-28 02:42:30.703258 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:42:30.703267 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:42:30.703276 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:42:30.703336 | orchestrator | 2026-04-28 02:42:30.703346 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for backup haproxy to start] ************** 2026-04-28 02:42:30.703355 | orchestrator | Tuesday 28 April 2026 02:41:55 +0000 (0:00:10.320) 0:05:46.733 ********* 2026-04-28 02:42:30.703363 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:42:30.703371 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:42:30.703380 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:42:30.703388 | orchestrator | 2026-04-28 02:42:30.703397 | orchestrator | RUNNING HANDLER [loadbalancer : Start backup proxysql container] *************** 2026-04-28 02:42:30.703406 | orchestrator | Tuesday 28 April 2026 02:41:57 +0000 (0:00:01.263) 0:05:47.997 ********* 2026-04-28 02:42:30.703415 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:42:30.703424 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:42:30.703433 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:42:30.703441 | orchestrator | 2026-04-28 02:42:30.703449 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for backup proxysql to start] ************* 2026-04-28 02:42:30.703457 | orchestrator | Tuesday 28 April 2026 02:42:15 +0000 (0:00:18.203) 0:06:06.200 ********* 2026-04-28 02:42:30.703465 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:42:30.703473 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:42:30.703480 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:42:30.703488 | orchestrator | 2026-04-28 02:42:30.703496 | orchestrator | RUNNING HANDLER [loadbalancer : Start backup keepalived container] ************* 2026-04-28 02:42:30.703504 | orchestrator | Tuesday 28 April 2026 02:42:16 +0000 (0:00:00.878) 0:06:07.078 ********* 2026-04-28 02:42:30.703513 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:42:30.703521 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:42:30.703530 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:42:30.703538 | orchestrator | 2026-04-28 02:42:30.703546 | orchestrator | RUNNING HANDLER [loadbalancer : Stop master haproxy container] ***************** 2026-04-28 02:42:30.703555 | orchestrator | Tuesday 28 April 2026 02:42:20 +0000 (0:00:04.561) 0:06:11.640 ********* 2026-04-28 02:42:30.703563 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:42:30.703571 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:42:30.703580 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:42:30.703588 | orchestrator | 2026-04-28 02:42:30.703596 | orchestrator | RUNNING HANDLER [loadbalancer : Stop master proxysql container] **************** 2026-04-28 02:42:30.703619 | orchestrator | Tuesday 28 April 2026 02:42:21 +0000 (0:00:00.748) 0:06:12.389 ********* 2026-04-28 02:42:30.703627 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:42:30.703645 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:42:30.703653 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:42:30.703661 | orchestrator | 2026-04-28 02:42:30.703687 | orchestrator | RUNNING HANDLER [loadbalancer : Stop master keepalived container] ************** 2026-04-28 02:42:30.703696 | orchestrator | Tuesday 28 April 2026 02:42:21 +0000 (0:00:00.438) 0:06:12.828 ********* 2026-04-28 02:42:30.703704 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:42:30.703712 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:42:30.703719 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:42:30.703727 | orchestrator | 2026-04-28 02:42:30.703734 | orchestrator | RUNNING HANDLER [loadbalancer : Start master haproxy container] **************** 2026-04-28 02:42:30.703742 | orchestrator | Tuesday 28 April 2026 02:42:22 +0000 (0:00:00.391) 0:06:13.219 ********* 2026-04-28 02:42:30.703750 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:42:30.703759 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:42:30.703767 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:42:30.703774 | orchestrator | 2026-04-28 02:42:30.703781 | orchestrator | RUNNING HANDLER [loadbalancer : Start master proxysql container] *************** 2026-04-28 02:42:30.703789 | orchestrator | Tuesday 28 April 2026 02:42:22 +0000 (0:00:00.364) 0:06:13.584 ********* 2026-04-28 02:42:30.703797 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:42:30.703804 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:42:30.703812 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:42:30.703820 | orchestrator | 2026-04-28 02:42:30.703828 | orchestrator | RUNNING HANDLER [loadbalancer : Start master keepalived container] ************* 2026-04-28 02:42:30.703836 | orchestrator | Tuesday 28 April 2026 02:42:23 +0000 (0:00:00.974) 0:06:14.558 ********* 2026-04-28 02:42:30.703843 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:42:30.703859 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:42:30.703867 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:42:30.703875 | orchestrator | 2026-04-28 02:42:30.703883 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for haproxy to listen on VIP] ************* 2026-04-28 02:42:30.703890 | orchestrator | Tuesday 28 April 2026 02:42:24 +0000 (0:00:00.451) 0:06:15.009 ********* 2026-04-28 02:42:30.703898 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:42:30.703906 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:42:30.703913 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:42:30.703921 | orchestrator | 2026-04-28 02:42:30.703929 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for proxysql to listen on VIP] ************ 2026-04-28 02:42:30.703937 | orchestrator | Tuesday 28 April 2026 02:42:28 +0000 (0:00:04.783) 0:06:19.793 ********* 2026-04-28 02:42:30.703944 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:42:30.703952 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:42:30.703959 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:42:30.703967 | orchestrator | 2026-04-28 02:42:30.703975 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:42:30.703985 | orchestrator | testbed-node-0 : ok=123  changed=76  unreachable=0 failed=0 skipped=97  rescued=0 ignored=0 2026-04-28 02:42:30.703995 | orchestrator | testbed-node-1 : ok=122  changed=76  unreachable=0 failed=0 skipped=97  rescued=0 ignored=0 2026-04-28 02:42:30.704002 | orchestrator | testbed-node-2 : ok=122  changed=76  unreachable=0 failed=0 skipped=97  rescued=0 ignored=0 2026-04-28 02:42:30.704010 | orchestrator | 2026-04-28 02:42:30.704018 | orchestrator | 2026-04-28 02:42:30.704025 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:42:30.704033 | orchestrator | Tuesday 28 April 2026 02:42:29 +0000 (0:00:00.857) 0:06:20.650 ********* 2026-04-28 02:42:30.704040 | orchestrator | =============================================================================== 2026-04-28 02:42:30.704055 | orchestrator | loadbalancer : Start backup proxysql container ------------------------- 18.20s 2026-04-28 02:42:30.704063 | orchestrator | loadbalancer : Start backup haproxy container -------------------------- 10.32s 2026-04-28 02:42:30.704070 | orchestrator | haproxy-config : Copying over skyline haproxy config -------------------- 6.90s 2026-04-28 02:42:30.704079 | orchestrator | haproxy-config : Copying over opensearch haproxy config ----------------- 5.78s 2026-04-28 02:42:30.704087 | orchestrator | haproxy-config : Copying over neutron haproxy config -------------------- 5.17s 2026-04-28 02:42:30.704095 | orchestrator | loadbalancer : Wait for haproxy to listen on VIP ------------------------ 4.78s 2026-04-28 02:42:30.704104 | orchestrator | haproxy-config : Copying over glance haproxy config --------------------- 4.69s 2026-04-28 02:42:30.704112 | orchestrator | loadbalancer : Start backup keepalived container ------------------------ 4.56s 2026-04-28 02:42:30.704121 | orchestrator | haproxy-config : Copying over prometheus haproxy config ----------------- 4.37s 2026-04-28 02:42:30.704129 | orchestrator | haproxy-config : Copying over nova haproxy config ----------------------- 4.34s 2026-04-28 02:42:30.704137 | orchestrator | haproxy-config : Copying over nova-cell:nova-novncproxy haproxy config --- 4.16s 2026-04-28 02:42:30.704145 | orchestrator | haproxy-config : Copying over octavia haproxy config -------------------- 3.96s 2026-04-28 02:42:30.704154 | orchestrator | haproxy-config : Copying over designate haproxy config ------------------ 3.78s 2026-04-28 02:42:30.704161 | orchestrator | haproxy-config : Copying over cinder haproxy config --------------------- 3.75s 2026-04-28 02:42:30.704169 | orchestrator | haproxy-config : Copying over placement haproxy config ------------------ 3.72s 2026-04-28 02:42:30.704176 | orchestrator | haproxy-config : Configuring firewall for glance ------------------------ 3.72s 2026-04-28 02:42:30.704184 | orchestrator | haproxy-config : Copying over manila haproxy config --------------------- 3.71s 2026-04-28 02:42:30.704192 | orchestrator | haproxy-config : Copying over barbican haproxy config ------------------- 3.68s 2026-04-28 02:42:30.704200 | orchestrator | proxysql-config : Copying over nova-cell ProxySQL rules config ---------- 3.65s 2026-04-28 02:42:30.704208 | orchestrator | haproxy-config : Copying over magnum haproxy config --------------------- 3.62s 2026-04-28 02:42:33.356975 | orchestrator | 2026-04-28 02:42:33 | INFO  | Task c2da0968-cbd2-4ed7-9553-f23c05ede044 (opensearch) was prepared for execution. 2026-04-28 02:42:33.357897 | orchestrator | 2026-04-28 02:42:33 | INFO  | It takes a moment until task c2da0968-cbd2-4ed7-9553-f23c05ede044 (opensearch) has been started and output is visible here. 2026-04-28 02:42:44.798445 | orchestrator | 2026-04-28 02:42:44.798542 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 02:42:44.798556 | orchestrator | 2026-04-28 02:42:44.798565 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 02:42:44.798583 | orchestrator | Tuesday 28 April 2026 02:42:37 +0000 (0:00:00.265) 0:00:00.265 ********* 2026-04-28 02:42:44.798592 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:42:44.798601 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:42:44.798609 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:42:44.798617 | orchestrator | 2026-04-28 02:42:44.798625 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 02:42:44.798634 | orchestrator | Tuesday 28 April 2026 02:42:38 +0000 (0:00:00.341) 0:00:00.607 ********* 2026-04-28 02:42:44.798643 | orchestrator | ok: [testbed-node-0] => (item=enable_opensearch_True) 2026-04-28 02:42:44.798651 | orchestrator | ok: [testbed-node-1] => (item=enable_opensearch_True) 2026-04-28 02:42:44.798659 | orchestrator | ok: [testbed-node-2] => (item=enable_opensearch_True) 2026-04-28 02:42:44.798667 | orchestrator | 2026-04-28 02:42:44.798675 | orchestrator | PLAY [Apply role opensearch] *************************************************** 2026-04-28 02:42:44.798683 | orchestrator | 2026-04-28 02:42:44.798705 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-28 02:42:44.798714 | orchestrator | Tuesday 28 April 2026 02:42:38 +0000 (0:00:00.434) 0:00:01.041 ********* 2026-04-28 02:42:44.798723 | orchestrator | included: /ansible/roles/opensearch/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:42:44.798748 | orchestrator | 2026-04-28 02:42:44.798756 | orchestrator | TASK [opensearch : Setting sysctl values] ************************************** 2026-04-28 02:42:44.798764 | orchestrator | Tuesday 28 April 2026 02:42:39 +0000 (0:00:00.507) 0:00:01.549 ********* 2026-04-28 02:42:44.798772 | orchestrator | changed: [testbed-node-0] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-28 02:42:44.798780 | orchestrator | changed: [testbed-node-1] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-28 02:42:44.798788 | orchestrator | changed: [testbed-node-2] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-28 02:42:44.798796 | orchestrator | 2026-04-28 02:42:44.798804 | orchestrator | TASK [opensearch : Ensuring config directories exist] ************************** 2026-04-28 02:42:44.798813 | orchestrator | Tuesday 28 April 2026 02:42:39 +0000 (0:00:00.715) 0:00:02.264 ********* 2026-04-28 02:42:44.798824 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-28 02:42:44.798836 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-28 02:42:44.798862 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-28 02:42:44.798879 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-28 02:42:44.798896 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-28 02:42:44.798905 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-28 02:42:44.798914 | orchestrator | 2026-04-28 02:42:44.798922 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-28 02:42:44.798930 | orchestrator | Tuesday 28 April 2026 02:42:41 +0000 (0:00:01.777) 0:00:04.041 ********* 2026-04-28 02:42:44.798938 | orchestrator | included: /ansible/roles/opensearch/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:42:44.798946 | orchestrator | 2026-04-28 02:42:44.798954 | orchestrator | TASK [service-cert-copy : opensearch | Copying over extra CA certificates] ***** 2026-04-28 02:42:44.798962 | orchestrator | Tuesday 28 April 2026 02:42:42 +0000 (0:00:00.595) 0:00:04.637 ********* 2026-04-28 02:42:44.798978 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-28 02:42:45.673756 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-28 02:42:45.673852 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-28 02:42:45.673863 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-28 02:42:45.673870 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-28 02:42:45.673918 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-28 02:42:45.673926 | orchestrator | 2026-04-28 02:42:45.673933 | orchestrator | TASK [service-cert-copy : opensearch | Copying over backend internal TLS certificate] *** 2026-04-28 02:42:45.673940 | orchestrator | Tuesday 28 April 2026 02:42:44 +0000 (0:00:02.516) 0:00:07.154 ********* 2026-04-28 02:42:45.673947 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-28 02:42:45.673954 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-28 02:42:45.673961 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:42:45.673969 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-28 02:42:45.673989 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-28 02:42:46.784014 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:42:46.784115 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-28 02:42:46.784137 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-28 02:42:46.784151 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:42:46.784163 | orchestrator | 2026-04-28 02:42:46.784175 | orchestrator | TASK [service-cert-copy : opensearch | Copying over backend internal TLS key] *** 2026-04-28 02:42:46.784188 | orchestrator | Tuesday 28 April 2026 02:42:45 +0000 (0:00:00.883) 0:00:08.038 ********* 2026-04-28 02:42:46.784199 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-28 02:42:46.784362 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-28 02:42:46.784399 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:42:46.784412 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-28 02:42:46.784425 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-28 02:42:46.784437 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:42:46.784449 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}})  2026-04-28 02:42:46.784475 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}})  2026-04-28 02:42:46.784489 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:42:46.784502 | orchestrator | 2026-04-28 02:42:46.784514 | orchestrator | TASK [opensearch : Copying over config.json files for services] **************** 2026-04-28 02:42:46.784534 | orchestrator | Tuesday 28 April 2026 02:42:46 +0000 (0:00:01.098) 0:00:09.137 ********* 2026-04-28 02:42:55.547337 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-28 02:42:55.547496 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-28 02:42:55.547527 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-28 02:42:55.547604 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-28 02:42:55.547660 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-28 02:42:55.547684 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-28 02:42:55.547705 | orchestrator | 2026-04-28 02:42:55.547720 | orchestrator | TASK [opensearch : Copying over opensearch service config file] **************** 2026-04-28 02:42:55.547732 | orchestrator | Tuesday 28 April 2026 02:42:49 +0000 (0:00:02.472) 0:00:11.609 ********* 2026-04-28 02:42:55.547744 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:42:55.547767 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:42:55.547778 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:42:55.547789 | orchestrator | 2026-04-28 02:42:55.547800 | orchestrator | TASK [opensearch : Copying over opensearch-dashboards config file] ************* 2026-04-28 02:42:55.547810 | orchestrator | Tuesday 28 April 2026 02:42:51 +0000 (0:00:02.462) 0:00:14.072 ********* 2026-04-28 02:42:55.547821 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:42:55.547832 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:42:55.547842 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:42:55.547853 | orchestrator | 2026-04-28 02:42:55.547864 | orchestrator | TASK [opensearch : Check opensearch containers] ******************************** 2026-04-28 02:42:55.547874 | orchestrator | Tuesday 28 April 2026 02:42:53 +0000 (0:00:01.962) 0:00:16.034 ********* 2026-04-28 02:42:55.547886 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-28 02:42:55.547904 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-28 02:42:55.547925 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/opensearch:2.19.4.20251130', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal']}}}}) 2026-04-28 02:45:51.078892 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-28 02:45:51.079074 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-28 02:45:51.079123 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password'}}}}) 2026-04-28 02:45:51.079144 | orchestrator | 2026-04-28 02:45:51.079166 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-28 02:45:51.079187 | orchestrator | Tuesday 28 April 2026 02:42:55 +0000 (0:00:01.871) 0:00:17.906 ********* 2026-04-28 02:45:51.079204 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:45:51.079217 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:45:51.079228 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:45:51.079239 | orchestrator | 2026-04-28 02:45:51.079250 | orchestrator | TASK [opensearch : Flush handlers] ********************************************* 2026-04-28 02:45:51.079261 | orchestrator | Tuesday 28 April 2026 02:42:55 +0000 (0:00:00.331) 0:00:18.237 ********* 2026-04-28 02:45:51.079272 | orchestrator | 2026-04-28 02:45:51.079283 | orchestrator | TASK [opensearch : Flush handlers] ********************************************* 2026-04-28 02:45:51.079294 | orchestrator | Tuesday 28 April 2026 02:42:55 +0000 (0:00:00.065) 0:00:18.302 ********* 2026-04-28 02:45:51.079304 | orchestrator | 2026-04-28 02:45:51.079315 | orchestrator | TASK [opensearch : Flush handlers] ********************************************* 2026-04-28 02:45:51.079326 | orchestrator | Tuesday 28 April 2026 02:42:56 +0000 (0:00:00.081) 0:00:18.384 ********* 2026-04-28 02:45:51.079336 | orchestrator | 2026-04-28 02:45:51.079347 | orchestrator | RUNNING HANDLER [opensearch : Disable shard allocation] ************************ 2026-04-28 02:45:51.079376 | orchestrator | Tuesday 28 April 2026 02:42:56 +0000 (0:00:00.067) 0:00:18.452 ********* 2026-04-28 02:45:51.079402 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:45:51.079415 | orchestrator | 2026-04-28 02:45:51.079429 | orchestrator | RUNNING HANDLER [opensearch : Perform a flush] ********************************* 2026-04-28 02:45:51.079441 | orchestrator | Tuesday 28 April 2026 02:42:56 +0000 (0:00:00.272) 0:00:18.725 ********* 2026-04-28 02:45:51.079454 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:45:51.079466 | orchestrator | 2026-04-28 02:45:51.079479 | orchestrator | RUNNING HANDLER [opensearch : Restart opensearch container] ******************** 2026-04-28 02:45:51.079492 | orchestrator | Tuesday 28 April 2026 02:42:57 +0000 (0:00:00.673) 0:00:19.398 ********* 2026-04-28 02:45:51.079504 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:45:51.079544 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:45:51.079557 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:45:51.079569 | orchestrator | 2026-04-28 02:45:51.079582 | orchestrator | RUNNING HANDLER [opensearch : Restart opensearch-dashboards container] ********* 2026-04-28 02:45:51.079595 | orchestrator | Tuesday 28 April 2026 02:44:10 +0000 (0:01:13.834) 0:01:33.232 ********* 2026-04-28 02:45:51.079607 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:45:51.079618 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:45:51.079629 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:45:51.079640 | orchestrator | 2026-04-28 02:45:51.079650 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-28 02:45:51.079661 | orchestrator | Tuesday 28 April 2026 02:45:40 +0000 (0:01:29.423) 0:03:02.656 ********* 2026-04-28 02:45:51.079673 | orchestrator | included: /ansible/roles/opensearch/tasks/post-config.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:45:51.079684 | orchestrator | 2026-04-28 02:45:51.079695 | orchestrator | TASK [opensearch : Wait for OpenSearch to become ready] ************************ 2026-04-28 02:45:51.079706 | orchestrator | Tuesday 28 April 2026 02:45:40 +0000 (0:00:00.570) 0:03:03.226 ********* 2026-04-28 02:45:51.079717 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:45:51.079728 | orchestrator | 2026-04-28 02:45:51.079738 | orchestrator | TASK [opensearch : Check if a log retention policy exists] ********************* 2026-04-28 02:45:51.079837 | orchestrator | Tuesday 28 April 2026 02:45:43 +0000 (0:00:02.791) 0:03:06.018 ********* 2026-04-28 02:45:51.079851 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:45:51.079862 | orchestrator | 2026-04-28 02:45:51.079873 | orchestrator | TASK [opensearch : Create new log retention policy] **************************** 2026-04-28 02:45:51.079884 | orchestrator | Tuesday 28 April 2026 02:45:45 +0000 (0:00:02.212) 0:03:08.231 ********* 2026-04-28 02:45:51.079894 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:45:51.079905 | orchestrator | 2026-04-28 02:45:51.079916 | orchestrator | TASK [opensearch : Apply retention policy to existing indices] ***************** 2026-04-28 02:45:51.079927 | orchestrator | Tuesday 28 April 2026 02:45:48 +0000 (0:00:02.645) 0:03:10.876 ********* 2026-04-28 02:45:51.079938 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:45:51.079949 | orchestrator | 2026-04-28 02:45:51.079960 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:45:51.079972 | orchestrator | testbed-node-0 : ok=18  changed=11  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 02:45:51.079984 | orchestrator | testbed-node-1 : ok=14  changed=9  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-28 02:45:51.079995 | orchestrator | testbed-node-2 : ok=14  changed=9  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-28 02:45:51.080006 | orchestrator | 2026-04-28 02:45:51.080017 | orchestrator | 2026-04-28 02:45:51.080028 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:45:51.080039 | orchestrator | Tuesday 28 April 2026 02:45:51 +0000 (0:00:02.550) 0:03:13.427 ********* 2026-04-28 02:45:51.080049 | orchestrator | =============================================================================== 2026-04-28 02:45:51.080077 | orchestrator | opensearch : Restart opensearch-dashboards container ------------------- 89.42s 2026-04-28 02:45:51.080089 | orchestrator | opensearch : Restart opensearch container ------------------------------ 73.83s 2026-04-28 02:45:51.080099 | orchestrator | opensearch : Wait for OpenSearch to become ready ------------------------ 2.79s 2026-04-28 02:45:51.080110 | orchestrator | opensearch : Create new log retention policy ---------------------------- 2.65s 2026-04-28 02:45:51.080121 | orchestrator | opensearch : Apply retention policy to existing indices ----------------- 2.55s 2026-04-28 02:45:51.080131 | orchestrator | service-cert-copy : opensearch | Copying over extra CA certificates ----- 2.52s 2026-04-28 02:45:51.080142 | orchestrator | opensearch : Copying over config.json files for services ---------------- 2.47s 2026-04-28 02:45:51.080152 | orchestrator | opensearch : Copying over opensearch service config file ---------------- 2.46s 2026-04-28 02:45:51.080163 | orchestrator | opensearch : Check if a log retention policy exists --------------------- 2.21s 2026-04-28 02:45:51.080174 | orchestrator | opensearch : Copying over opensearch-dashboards config file ------------- 1.96s 2026-04-28 02:45:51.080184 | orchestrator | opensearch : Check opensearch containers -------------------------------- 1.87s 2026-04-28 02:45:51.080195 | orchestrator | opensearch : Ensuring config directories exist -------------------------- 1.78s 2026-04-28 02:45:51.080205 | orchestrator | service-cert-copy : opensearch | Copying over backend internal TLS key --- 1.10s 2026-04-28 02:45:51.080216 | orchestrator | service-cert-copy : opensearch | Copying over backend internal TLS certificate --- 0.88s 2026-04-28 02:45:51.080226 | orchestrator | opensearch : Setting sysctl values -------------------------------------- 0.72s 2026-04-28 02:45:51.080237 | orchestrator | opensearch : Perform a flush -------------------------------------------- 0.67s 2026-04-28 02:45:51.080262 | orchestrator | opensearch : include_tasks ---------------------------------------------- 0.60s 2026-04-28 02:45:51.529893 | orchestrator | opensearch : include_tasks ---------------------------------------------- 0.57s 2026-04-28 02:45:51.529979 | orchestrator | opensearch : include_tasks ---------------------------------------------- 0.51s 2026-04-28 02:45:51.529987 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.43s 2026-04-28 02:45:54.229498 | orchestrator | 2026-04-28 02:45:54 | INFO  | Task 1a57f682-4dcc-429b-8f24-86c76d2006b5 (memcached) was prepared for execution. 2026-04-28 02:45:54.229886 | orchestrator | 2026-04-28 02:45:54 | INFO  | It takes a moment until task 1a57f682-4dcc-429b-8f24-86c76d2006b5 (memcached) has been started and output is visible here. 2026-04-28 02:46:07.011574 | orchestrator | 2026-04-28 02:46:07.011685 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 02:46:07.011703 | orchestrator | 2026-04-28 02:46:07.011717 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 02:46:07.011730 | orchestrator | Tuesday 28 April 2026 02:45:58 +0000 (0:00:00.291) 0:00:00.291 ********* 2026-04-28 02:46:07.011743 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:46:07.011757 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:46:07.011770 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:46:07.011782 | orchestrator | 2026-04-28 02:46:07.011793 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 02:46:07.011805 | orchestrator | Tuesday 28 April 2026 02:45:59 +0000 (0:00:00.329) 0:00:00.621 ********* 2026-04-28 02:46:07.011817 | orchestrator | ok: [testbed-node-0] => (item=enable_memcached_True) 2026-04-28 02:46:07.011827 | orchestrator | ok: [testbed-node-1] => (item=enable_memcached_True) 2026-04-28 02:46:07.011837 | orchestrator | ok: [testbed-node-2] => (item=enable_memcached_True) 2026-04-28 02:46:07.011848 | orchestrator | 2026-04-28 02:46:07.011859 | orchestrator | PLAY [Apply role memcached] **************************************************** 2026-04-28 02:46:07.011869 | orchestrator | 2026-04-28 02:46:07.011880 | orchestrator | TASK [memcached : include_tasks] *********************************************** 2026-04-28 02:46:07.011890 | orchestrator | Tuesday 28 April 2026 02:45:59 +0000 (0:00:00.476) 0:00:01.098 ********* 2026-04-28 02:46:07.011902 | orchestrator | included: /ansible/roles/memcached/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:46:07.011944 | orchestrator | 2026-04-28 02:46:07.011958 | orchestrator | TASK [memcached : Ensuring config directories exist] *************************** 2026-04-28 02:46:07.011971 | orchestrator | Tuesday 28 April 2026 02:46:00 +0000 (0:00:00.512) 0:00:01.610 ********* 2026-04-28 02:46:07.011981 | orchestrator | changed: [testbed-node-1] => (item=memcached) 2026-04-28 02:46:07.011991 | orchestrator | changed: [testbed-node-0] => (item=memcached) 2026-04-28 02:46:07.012001 | orchestrator | changed: [testbed-node-2] => (item=memcached) 2026-04-28 02:46:07.012012 | orchestrator | 2026-04-28 02:46:07.012024 | orchestrator | TASK [memcached : Copying over config.json files for services] ***************** 2026-04-28 02:46:07.012035 | orchestrator | Tuesday 28 April 2026 02:46:00 +0000 (0:00:00.668) 0:00:02.279 ********* 2026-04-28 02:46:07.012046 | orchestrator | changed: [testbed-node-1] => (item=memcached) 2026-04-28 02:46:07.012057 | orchestrator | changed: [testbed-node-0] => (item=memcached) 2026-04-28 02:46:07.012069 | orchestrator | changed: [testbed-node-2] => (item=memcached) 2026-04-28 02:46:07.012081 | orchestrator | 2026-04-28 02:46:07.012093 | orchestrator | TASK [memcached : Check memcached container] *********************************** 2026-04-28 02:46:07.012103 | orchestrator | Tuesday 28 April 2026 02:46:02 +0000 (0:00:01.900) 0:00:04.179 ********* 2026-04-28 02:46:07.012115 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:46:07.012127 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:46:07.012139 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:46:07.012152 | orchestrator | 2026-04-28 02:46:07.012165 | orchestrator | RUNNING HANDLER [memcached : Restart memcached container] ********************** 2026-04-28 02:46:07.012179 | orchestrator | Tuesday 28 April 2026 02:46:04 +0000 (0:00:01.559) 0:00:05.739 ********* 2026-04-28 02:46:07.012209 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:46:07.012223 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:46:07.012237 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:46:07.012248 | orchestrator | 2026-04-28 02:46:07.012260 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:46:07.012272 | orchestrator | testbed-node-0 : ok=7  changed=4  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:46:07.012285 | orchestrator | testbed-node-1 : ok=7  changed=4  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:46:07.012297 | orchestrator | testbed-node-2 : ok=7  changed=4  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:46:07.012307 | orchestrator | 2026-04-28 02:46:07.012319 | orchestrator | 2026-04-28 02:46:07.012331 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:46:07.012342 | orchestrator | Tuesday 28 April 2026 02:46:06 +0000 (0:00:02.145) 0:00:07.885 ********* 2026-04-28 02:46:07.012354 | orchestrator | =============================================================================== 2026-04-28 02:46:07.012364 | orchestrator | memcached : Restart memcached container --------------------------------- 2.15s 2026-04-28 02:46:07.012374 | orchestrator | memcached : Copying over config.json files for services ----------------- 1.90s 2026-04-28 02:46:07.012383 | orchestrator | memcached : Check memcached container ----------------------------------- 1.56s 2026-04-28 02:46:07.012393 | orchestrator | memcached : Ensuring config directories exist --------------------------- 0.67s 2026-04-28 02:46:07.012403 | orchestrator | memcached : include_tasks ----------------------------------------------- 0.51s 2026-04-28 02:46:07.012413 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.48s 2026-04-28 02:46:07.012423 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.33s 2026-04-28 02:46:09.666433 | orchestrator | 2026-04-28 02:46:09 | INFO  | Task b38616f6-fab9-4f8f-9713-6995dd9b9c82 (redis) was prepared for execution. 2026-04-28 02:46:09.666573 | orchestrator | 2026-04-28 02:46:09 | INFO  | It takes a moment until task b38616f6-fab9-4f8f-9713-6995dd9b9c82 (redis) has been started and output is visible here. 2026-04-28 02:46:19.435571 | orchestrator | 2026-04-28 02:46:19.435666 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 02:46:19.435675 | orchestrator | 2026-04-28 02:46:19.435680 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 02:46:19.435685 | orchestrator | Tuesday 28 April 2026 02:46:14 +0000 (0:00:00.289) 0:00:00.289 ********* 2026-04-28 02:46:19.435689 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:46:19.435695 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:46:19.435699 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:46:19.435703 | orchestrator | 2026-04-28 02:46:19.435707 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 02:46:19.435711 | orchestrator | Tuesday 28 April 2026 02:46:14 +0000 (0:00:00.322) 0:00:00.611 ********* 2026-04-28 02:46:19.435715 | orchestrator | ok: [testbed-node-0] => (item=enable_redis_True) 2026-04-28 02:46:19.435719 | orchestrator | ok: [testbed-node-1] => (item=enable_redis_True) 2026-04-28 02:46:19.435722 | orchestrator | ok: [testbed-node-2] => (item=enable_redis_True) 2026-04-28 02:46:19.435726 | orchestrator | 2026-04-28 02:46:19.435730 | orchestrator | PLAY [Apply role redis] ******************************************************** 2026-04-28 02:46:19.435734 | orchestrator | 2026-04-28 02:46:19.435737 | orchestrator | TASK [redis : include_tasks] *************************************************** 2026-04-28 02:46:19.435741 | orchestrator | Tuesday 28 April 2026 02:46:15 +0000 (0:00:00.492) 0:00:01.103 ********* 2026-04-28 02:46:19.435745 | orchestrator | included: /ansible/roles/redis/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:46:19.435750 | orchestrator | 2026-04-28 02:46:19.435754 | orchestrator | TASK [redis : Ensuring config directories exist] ******************************* 2026-04-28 02:46:19.435757 | orchestrator | Tuesday 28 April 2026 02:46:15 +0000 (0:00:00.541) 0:00:01.645 ********* 2026-04-28 02:46:19.435765 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 02:46:19.435773 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 02:46:19.435790 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 02:46:19.435795 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 02:46:19.435831 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 02:46:19.435835 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 02:46:19.435839 | orchestrator | 2026-04-28 02:46:19.435843 | orchestrator | TASK [redis : Copying over default config.json files] ************************** 2026-04-28 02:46:19.435847 | orchestrator | Tuesday 28 April 2026 02:46:16 +0000 (0:00:01.092) 0:00:02.738 ********* 2026-04-28 02:46:19.435851 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 02:46:19.435855 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 02:46:19.435860 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 02:46:19.435864 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 02:46:19.435874 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 02:46:23.892555 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 02:46:23.892646 | orchestrator | 2026-04-28 02:46:23.892659 | orchestrator | TASK [redis : Copying over redis config files] ********************************* 2026-04-28 02:46:23.892668 | orchestrator | Tuesday 28 April 2026 02:46:19 +0000 (0:00:02.647) 0:00:05.386 ********* 2026-04-28 02:46:23.892753 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 02:46:23.892770 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 02:46:23.892782 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 02:46:23.892807 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 02:46:23.892815 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 02:46:23.892838 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 02:46:23.892846 | orchestrator | 2026-04-28 02:46:23.892854 | orchestrator | TASK [redis : Check redis containers] ****************************************** 2026-04-28 02:46:23.892861 | orchestrator | Tuesday 28 April 2026 02:46:22 +0000 (0:00:02.672) 0:00:08.058 ********* 2026-04-28 02:46:23.892869 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 02:46:23.892877 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 02:46:23.892888 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis:7.0.15.20251130', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 02:46:23.892903 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 02:46:23.892911 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 02:46:23.892925 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 02:46:35.603007 | orchestrator | 2026-04-28 02:46:35.603096 | orchestrator | TASK [redis : Flush handlers] ************************************************** 2026-04-28 02:46:35.603107 | orchestrator | Tuesday 28 April 2026 02:46:23 +0000 (0:00:01.565) 0:00:09.623 ********* 2026-04-28 02:46:35.603116 | orchestrator | 2026-04-28 02:46:35.603123 | orchestrator | TASK [redis : Flush handlers] ************************************************** 2026-04-28 02:46:35.603131 | orchestrator | Tuesday 28 April 2026 02:46:23 +0000 (0:00:00.067) 0:00:09.691 ********* 2026-04-28 02:46:35.603138 | orchestrator | 2026-04-28 02:46:35.603146 | orchestrator | TASK [redis : Flush handlers] ************************************************** 2026-04-28 02:46:35.603153 | orchestrator | Tuesday 28 April 2026 02:46:23 +0000 (0:00:00.076) 0:00:09.767 ********* 2026-04-28 02:46:35.603160 | orchestrator | 2026-04-28 02:46:35.603167 | orchestrator | RUNNING HANDLER [redis : Restart redis container] ****************************** 2026-04-28 02:46:35.603174 | orchestrator | Tuesday 28 April 2026 02:46:23 +0000 (0:00:00.076) 0:00:09.844 ********* 2026-04-28 02:46:35.603182 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:46:35.603190 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:46:35.603198 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:46:35.603205 | orchestrator | 2026-04-28 02:46:35.603212 | orchestrator | RUNNING HANDLER [redis : Restart redis-sentinel container] ********************* 2026-04-28 02:46:35.603219 | orchestrator | Tuesday 28 April 2026 02:46:31 +0000 (0:00:08.075) 0:00:17.919 ********* 2026-04-28 02:46:35.603226 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:46:35.603233 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:46:35.603240 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:46:35.603247 | orchestrator | 2026-04-28 02:46:35.603255 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:46:35.603285 | orchestrator | testbed-node-0 : ok=9  changed=6  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:46:35.603293 | orchestrator | testbed-node-1 : ok=9  changed=6  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:46:35.603301 | orchestrator | testbed-node-2 : ok=9  changed=6  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:46:35.603308 | orchestrator | 2026-04-28 02:46:35.603315 | orchestrator | 2026-04-28 02:46:35.603322 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:46:35.603329 | orchestrator | Tuesday 28 April 2026 02:46:35 +0000 (0:00:03.247) 0:00:21.167 ********* 2026-04-28 02:46:35.603348 | orchestrator | =============================================================================== 2026-04-28 02:46:35.603356 | orchestrator | redis : Restart redis container ----------------------------------------- 8.08s 2026-04-28 02:46:35.603363 | orchestrator | redis : Restart redis-sentinel container -------------------------------- 3.25s 2026-04-28 02:46:35.603370 | orchestrator | redis : Copying over redis config files --------------------------------- 2.67s 2026-04-28 02:46:35.603377 | orchestrator | redis : Copying over default config.json files -------------------------- 2.65s 2026-04-28 02:46:35.603439 | orchestrator | redis : Check redis containers ------------------------------------------ 1.57s 2026-04-28 02:46:35.603448 | orchestrator | redis : Ensuring config directories exist ------------------------------- 1.09s 2026-04-28 02:46:35.603456 | orchestrator | redis : include_tasks --------------------------------------------------- 0.54s 2026-04-28 02:46:35.603463 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.49s 2026-04-28 02:46:35.603470 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.32s 2026-04-28 02:46:35.603477 | orchestrator | redis : Flush handlers -------------------------------------------------- 0.22s 2026-04-28 02:46:38.340697 | orchestrator | 2026-04-28 02:46:38 | INFO  | Task 21c22b88-179b-4680-a6b0-f3ac612e87b1 (mariadb) was prepared for execution. 2026-04-28 02:46:38.340797 | orchestrator | 2026-04-28 02:46:38 | INFO  | It takes a moment until task 21c22b88-179b-4680-a6b0-f3ac612e87b1 (mariadb) has been started and output is visible here. 2026-04-28 02:46:52.641618 | orchestrator | 2026-04-28 02:46:52.641714 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 02:46:52.641724 | orchestrator | 2026-04-28 02:46:52.641731 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 02:46:52.641737 | orchestrator | Tuesday 28 April 2026 02:46:42 +0000 (0:00:00.169) 0:00:00.169 ********* 2026-04-28 02:46:52.641743 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:46:52.641774 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:46:52.641781 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:46:52.641787 | orchestrator | 2026-04-28 02:46:52.641792 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 02:46:52.641798 | orchestrator | Tuesday 28 April 2026 02:46:43 +0000 (0:00:00.329) 0:00:00.499 ********* 2026-04-28 02:46:52.641804 | orchestrator | ok: [testbed-node-0] => (item=enable_mariadb_True) 2026-04-28 02:46:52.641811 | orchestrator | ok: [testbed-node-1] => (item=enable_mariadb_True) 2026-04-28 02:46:52.641817 | orchestrator | ok: [testbed-node-2] => (item=enable_mariadb_True) 2026-04-28 02:46:52.641822 | orchestrator | 2026-04-28 02:46:52.641828 | orchestrator | PLAY [Apply role mariadb] ****************************************************** 2026-04-28 02:46:52.641833 | orchestrator | 2026-04-28 02:46:52.641839 | orchestrator | TASK [mariadb : Group MariaDB hosts based on shards] *************************** 2026-04-28 02:46:52.641844 | orchestrator | Tuesday 28 April 2026 02:46:43 +0000 (0:00:00.584) 0:00:01.084 ********* 2026-04-28 02:46:52.641850 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 02:46:52.641855 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-28 02:46:52.641879 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-28 02:46:52.641885 | orchestrator | 2026-04-28 02:46:52.641890 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-28 02:46:52.641896 | orchestrator | Tuesday 28 April 2026 02:46:44 +0000 (0:00:00.420) 0:00:01.504 ********* 2026-04-28 02:46:52.641902 | orchestrator | included: /ansible/roles/mariadb/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:46:52.641908 | orchestrator | 2026-04-28 02:46:52.641913 | orchestrator | TASK [mariadb : Ensuring config directories exist] ***************************** 2026-04-28 02:46:52.641918 | orchestrator | Tuesday 28 April 2026 02:46:44 +0000 (0:00:00.579) 0:00:02.084 ********* 2026-04-28 02:46:52.641940 | orchestrator | changed: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-28 02:46:52.641964 | orchestrator | changed: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-28 02:46:52.641981 | orchestrator | changed: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-28 02:46:52.641988 | orchestrator | 2026-04-28 02:46:52.641993 | orchestrator | TASK [mariadb : Ensuring database backup config directory exists] ************** 2026-04-28 02:46:52.641999 | orchestrator | Tuesday 28 April 2026 02:46:47 +0000 (0:00:02.657) 0:00:04.742 ********* 2026-04-28 02:46:52.642004 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:46:52.642011 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:46:52.642087 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:46:52.642093 | orchestrator | 2026-04-28 02:46:52.642099 | orchestrator | TASK [mariadb : Copying over my.cnf for mariabackup] *************************** 2026-04-28 02:46:52.642104 | orchestrator | Tuesday 28 April 2026 02:46:48 +0000 (0:00:00.678) 0:00:05.420 ********* 2026-04-28 02:46:52.642109 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:46:52.642115 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:46:52.642120 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:46:52.642126 | orchestrator | 2026-04-28 02:46:52.642131 | orchestrator | TASK [mariadb : Copying over config.json files for services] ******************* 2026-04-28 02:46:52.642136 | orchestrator | Tuesday 28 April 2026 02:46:49 +0000 (0:00:01.339) 0:00:06.759 ********* 2026-04-28 02:46:52.642150 | orchestrator | changed: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-28 02:47:00.741404 | orchestrator | changed: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-28 02:47:00.741501 | orchestrator | changed: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-28 02:47:00.741535 | orchestrator | 2026-04-28 02:47:00.741544 | orchestrator | TASK [mariadb : Copying over config.json files for mariabackup] **************** 2026-04-28 02:47:00.741553 | orchestrator | Tuesday 28 April 2026 02:46:52 +0000 (0:00:03.160) 0:00:09.920 ********* 2026-04-28 02:47:00.741560 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:47:00.741569 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:47:00.741575 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:47:00.741578 | orchestrator | 2026-04-28 02:47:00.741582 | orchestrator | TASK [mariadb : Copying over galera.cnf] *************************************** 2026-04-28 02:47:00.741598 | orchestrator | Tuesday 28 April 2026 02:46:53 +0000 (0:00:01.117) 0:00:11.037 ********* 2026-04-28 02:47:00.741602 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:47:00.741606 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:47:00.741610 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:47:00.741614 | orchestrator | 2026-04-28 02:47:00.741617 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-28 02:47:00.741621 | orchestrator | Tuesday 28 April 2026 02:46:57 +0000 (0:00:04.060) 0:00:15.098 ********* 2026-04-28 02:47:00.741626 | orchestrator | included: /ansible/roles/mariadb/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:47:00.741630 | orchestrator | 2026-04-28 02:47:00.741634 | orchestrator | TASK [service-cert-copy : mariadb | Copying over extra CA certificates] ******** 2026-04-28 02:47:00.741637 | orchestrator | Tuesday 28 April 2026 02:46:58 +0000 (0:00:00.550) 0:00:15.649 ********* 2026-04-28 02:47:00.741647 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 02:47:00.741656 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:47:00.741666 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 02:47:05.768190 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:47:05.768415 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 02:47:05.768454 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:47:05.768473 | orchestrator | 2026-04-28 02:47:05.768492 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS certificate] *** 2026-04-28 02:47:05.768538 | orchestrator | Tuesday 28 April 2026 02:47:00 +0000 (0:00:02.371) 0:00:18.020 ********* 2026-04-28 02:47:05.768558 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 02:47:05.768574 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:47:05.768627 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 02:47:05.768648 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:47:05.768666 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 02:47:05.768696 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:47:05.768715 | orchestrator | 2026-04-28 02:47:05.768731 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS key] ***** 2026-04-28 02:47:05.768749 | orchestrator | Tuesday 28 April 2026 02:47:03 +0000 (0:00:02.537) 0:00:20.558 ********* 2026-04-28 02:47:05.768792 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 02:47:08.798278 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:47:08.798403 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 02:47:08.798432 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:47:08.798439 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 02:47:08.798446 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:47:08.798452 | orchestrator | 2026-04-28 02:47:08.798459 | orchestrator | TASK [mariadb : Check mariadb containers] ************************************** 2026-04-28 02:47:08.798477 | orchestrator | Tuesday 28 April 2026 02:47:05 +0000 (0:00:02.492) 0:00:23.050 ********* 2026-04-28 02:47:08.798497 | orchestrator | changed: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-28 02:47:08.798512 | orchestrator | changed: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-28 02:47:08.798528 | orchestrator | changed: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-28 02:49:27.447818 | orchestrator | 2026-04-28 02:49:27.447919 | orchestrator | TASK [mariadb : Create MariaDB volume] ***************************************** 2026-04-28 02:49:27.447933 | orchestrator | Tuesday 28 April 2026 02:47:08 +0000 (0:00:03.029) 0:00:26.079 ********* 2026-04-28 02:49:27.447940 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:49:27.447948 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:49:27.447953 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:49:27.447959 | orchestrator | 2026-04-28 02:49:27.447965 | orchestrator | TASK [mariadb : Divide hosts by their MariaDB volume availability] ************* 2026-04-28 02:49:27.447971 | orchestrator | Tuesday 28 April 2026 02:47:09 +0000 (0:00:00.879) 0:00:26.959 ********* 2026-04-28 02:49:27.448024 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:49:27.448032 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:49:27.448038 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:49:27.448044 | orchestrator | 2026-04-28 02:49:27.448050 | orchestrator | TASK [mariadb : Establish whether the cluster has already existed] ************* 2026-04-28 02:49:27.448057 | orchestrator | Tuesday 28 April 2026 02:47:10 +0000 (0:00:00.593) 0:00:27.552 ********* 2026-04-28 02:49:27.448062 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:49:27.448069 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:49:27.448075 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:49:27.448081 | orchestrator | 2026-04-28 02:49:27.448087 | orchestrator | TASK [mariadb : Check MariaDB service port liveness] *************************** 2026-04-28 02:49:27.448093 | orchestrator | Tuesday 28 April 2026 02:47:10 +0000 (0:00:00.382) 0:00:27.934 ********* 2026-04-28 02:49:27.448101 | orchestrator | fatal: [testbed-node-1]: FAILED! => {"changed": false, "elapsed": 10, "msg": "Timeout when waiting for search string MariaDB in 192.168.16.11:3306"} 2026-04-28 02:49:27.448108 | orchestrator | ...ignoring 2026-04-28 02:49:27.448115 | orchestrator | fatal: [testbed-node-0]: FAILED! => {"changed": false, "elapsed": 10, "msg": "Timeout when waiting for search string MariaDB in 192.168.16.10:3306"} 2026-04-28 02:49:27.448122 | orchestrator | ...ignoring 2026-04-28 02:49:27.448128 | orchestrator | fatal: [testbed-node-2]: FAILED! => {"changed": false, "elapsed": 10, "msg": "Timeout when waiting for search string MariaDB in 192.168.16.12:3306"} 2026-04-28 02:49:27.448134 | orchestrator | ...ignoring 2026-04-28 02:49:27.448140 | orchestrator | 2026-04-28 02:49:27.448147 | orchestrator | TASK [mariadb : Divide hosts by their MariaDB service port liveness] *********** 2026-04-28 02:49:27.448153 | orchestrator | Tuesday 28 April 2026 02:47:21 +0000 (0:00:10.897) 0:00:38.832 ********* 2026-04-28 02:49:27.448159 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:49:27.448166 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:49:27.448192 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:49:27.448198 | orchestrator | 2026-04-28 02:49:27.448204 | orchestrator | TASK [mariadb : Fail on existing but stopped cluster] ************************** 2026-04-28 02:49:27.448211 | orchestrator | Tuesday 28 April 2026 02:47:22 +0000 (0:00:00.468) 0:00:39.300 ********* 2026-04-28 02:49:27.448217 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:49:27.448223 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:49:27.448229 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:49:27.448235 | orchestrator | 2026-04-28 02:49:27.448241 | orchestrator | TASK [mariadb : Check MariaDB service WSREP sync status] *********************** 2026-04-28 02:49:27.448247 | orchestrator | Tuesday 28 April 2026 02:47:22 +0000 (0:00:00.710) 0:00:40.011 ********* 2026-04-28 02:49:27.448253 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:49:27.448260 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:49:27.448266 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:49:27.448272 | orchestrator | 2026-04-28 02:49:27.448278 | orchestrator | TASK [mariadb : Extract MariaDB service WSREP sync status] ********************* 2026-04-28 02:49:27.448285 | orchestrator | Tuesday 28 April 2026 02:47:23 +0000 (0:00:00.511) 0:00:40.522 ********* 2026-04-28 02:49:27.448291 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:49:27.448298 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:49:27.448304 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:49:27.448310 | orchestrator | 2026-04-28 02:49:27.448326 | orchestrator | TASK [mariadb : Divide hosts by their MariaDB service WSREP sync status] ******* 2026-04-28 02:49:27.448332 | orchestrator | Tuesday 28 April 2026 02:47:23 +0000 (0:00:00.540) 0:00:41.063 ********* 2026-04-28 02:49:27.448338 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:49:27.448344 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:49:27.448350 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:49:27.448357 | orchestrator | 2026-04-28 02:49:27.448363 | orchestrator | TASK [mariadb : Fail when MariaDB services are not synced across the whole cluster] *** 2026-04-28 02:49:27.448370 | orchestrator | Tuesday 28 April 2026 02:47:24 +0000 (0:00:00.452) 0:00:41.515 ********* 2026-04-28 02:49:27.448377 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:49:27.448384 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:49:27.448390 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:49:27.448396 | orchestrator | 2026-04-28 02:49:27.448403 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-28 02:49:27.448409 | orchestrator | Tuesday 28 April 2026 02:47:25 +0000 (0:00:00.978) 0:00:42.494 ********* 2026-04-28 02:49:27.448417 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:49:27.448425 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:49:27.448432 | orchestrator | included: /ansible/roles/mariadb/tasks/bootstrap_cluster.yml for testbed-node-0 2026-04-28 02:49:27.448441 | orchestrator | 2026-04-28 02:49:27.448449 | orchestrator | TASK [mariadb : Running MariaDB bootstrap container] *************************** 2026-04-28 02:49:27.448457 | orchestrator | Tuesday 28 April 2026 02:47:25 +0000 (0:00:00.405) 0:00:42.900 ********* 2026-04-28 02:49:27.448465 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:49:27.448473 | orchestrator | 2026-04-28 02:49:27.448482 | orchestrator | TASK [mariadb : Store bootstrap host name into facts] ************************** 2026-04-28 02:49:27.448490 | orchestrator | Tuesday 28 April 2026 02:47:35 +0000 (0:00:10.088) 0:00:52.988 ********* 2026-04-28 02:49:27.448498 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:49:27.448506 | orchestrator | 2026-04-28 02:49:27.448514 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-28 02:49:27.448523 | orchestrator | Tuesday 28 April 2026 02:47:35 +0000 (0:00:00.153) 0:00:53.141 ********* 2026-04-28 02:49:27.448530 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:49:27.448558 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:49:27.448566 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:49:27.448571 | orchestrator | 2026-04-28 02:49:27.448577 | orchestrator | RUNNING HANDLER [mariadb : Starting first MariaDB container] ******************* 2026-04-28 02:49:27.448583 | orchestrator | Tuesday 28 April 2026 02:47:36 +0000 (0:00:01.040) 0:00:54.182 ********* 2026-04-28 02:49:27.448598 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:49:27.448604 | orchestrator | 2026-04-28 02:49:27.448610 | orchestrator | RUNNING HANDLER [mariadb : Wait for first MariaDB service port liveness] ******* 2026-04-28 02:49:27.448616 | orchestrator | Tuesday 28 April 2026 02:47:45 +0000 (0:00:08.424) 0:01:02.607 ********* 2026-04-28 02:49:27.448622 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:49:27.448628 | orchestrator | 2026-04-28 02:49:27.448633 | orchestrator | RUNNING HANDLER [mariadb : Wait for first MariaDB service to sync WSREP] ******* 2026-04-28 02:49:27.448639 | orchestrator | Tuesday 28 April 2026 02:47:46 +0000 (0:00:01.641) 0:01:04.248 ********* 2026-04-28 02:49:27.448645 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:49:27.448650 | orchestrator | 2026-04-28 02:49:27.448657 | orchestrator | RUNNING HANDLER [mariadb : Ensure MariaDB is running normally on bootstrap host] *** 2026-04-28 02:49:27.448662 | orchestrator | Tuesday 28 April 2026 02:47:49 +0000 (0:00:02.634) 0:01:06.882 ********* 2026-04-28 02:49:27.448668 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:49:27.448674 | orchestrator | 2026-04-28 02:49:27.448680 | orchestrator | RUNNING HANDLER [mariadb : Restart MariaDB on existing cluster members] ******** 2026-04-28 02:49:27.448686 | orchestrator | Tuesday 28 April 2026 02:47:49 +0000 (0:00:00.117) 0:01:07.000 ********* 2026-04-28 02:49:27.448692 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:49:27.448698 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:49:27.448703 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:49:27.448709 | orchestrator | 2026-04-28 02:49:27.448715 | orchestrator | RUNNING HANDLER [mariadb : Start MariaDB on new nodes] ************************* 2026-04-28 02:49:27.448721 | orchestrator | Tuesday 28 April 2026 02:47:50 +0000 (0:00:00.342) 0:01:07.342 ********* 2026-04-28 02:49:27.448726 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:49:27.448732 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: mariadb_restart 2026-04-28 02:49:27.448738 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:49:27.448744 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:49:27.448749 | orchestrator | 2026-04-28 02:49:27.448755 | orchestrator | PLAY [Restart mariadb services] ************************************************ 2026-04-28 02:49:27.448761 | orchestrator | skipping: no hosts matched 2026-04-28 02:49:27.448767 | orchestrator | 2026-04-28 02:49:27.448772 | orchestrator | PLAY [Start mariadb services] ************************************************** 2026-04-28 02:49:27.448778 | orchestrator | 2026-04-28 02:49:27.448784 | orchestrator | TASK [mariadb : Restart MariaDB container] ************************************* 2026-04-28 02:49:27.448789 | orchestrator | Tuesday 28 April 2026 02:47:50 +0000 (0:00:00.581) 0:01:07.923 ********* 2026-04-28 02:49:27.448795 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:49:27.448800 | orchestrator | 2026-04-28 02:49:27.448806 | orchestrator | TASK [mariadb : Wait for MariaDB service port liveness] ************************ 2026-04-28 02:49:27.448812 | orchestrator | Tuesday 28 April 2026 02:48:14 +0000 (0:00:23.682) 0:01:31.606 ********* 2026-04-28 02:49:27.448818 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:49:27.448824 | orchestrator | 2026-04-28 02:49:27.448831 | orchestrator | TASK [mariadb : Wait for MariaDB service to sync WSREP] ************************ 2026-04-28 02:49:27.448836 | orchestrator | Tuesday 28 April 2026 02:48:24 +0000 (0:00:10.557) 0:01:42.163 ********* 2026-04-28 02:49:27.448842 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:49:27.448848 | orchestrator | 2026-04-28 02:49:27.448853 | orchestrator | PLAY [Start mariadb services] ************************************************** 2026-04-28 02:49:27.448860 | orchestrator | 2026-04-28 02:49:27.448869 | orchestrator | TASK [mariadb : Restart MariaDB container] ************************************* 2026-04-28 02:49:27.448875 | orchestrator | Tuesday 28 April 2026 02:48:27 +0000 (0:00:02.576) 0:01:44.740 ********* 2026-04-28 02:49:27.448881 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:49:27.448887 | orchestrator | 2026-04-28 02:49:27.448892 | orchestrator | TASK [mariadb : Wait for MariaDB service port liveness] ************************ 2026-04-28 02:49:27.448905 | orchestrator | Tuesday 28 April 2026 02:48:51 +0000 (0:00:24.491) 0:02:09.231 ********* 2026-04-28 02:49:27.448918 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:49:27.448924 | orchestrator | 2026-04-28 02:49:27.448930 | orchestrator | TASK [mariadb : Wait for MariaDB service to sync WSREP] ************************ 2026-04-28 02:49:27.448936 | orchestrator | Tuesday 28 April 2026 02:49:03 +0000 (0:00:11.592) 0:02:20.823 ********* 2026-04-28 02:49:27.448942 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:49:27.448948 | orchestrator | 2026-04-28 02:49:27.448954 | orchestrator | PLAY [Restart bootstrap mariadb service] *************************************** 2026-04-28 02:49:27.448960 | orchestrator | 2026-04-28 02:49:27.448965 | orchestrator | TASK [mariadb : Restart MariaDB container] ************************************* 2026-04-28 02:49:27.448971 | orchestrator | Tuesday 28 April 2026 02:49:06 +0000 (0:00:02.683) 0:02:23.507 ********* 2026-04-28 02:49:27.449011 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:49:27.449017 | orchestrator | 2026-04-28 02:49:27.449022 | orchestrator | TASK [mariadb : Wait for MariaDB service port liveness] ************************ 2026-04-28 02:49:27.449028 | orchestrator | Tuesday 28 April 2026 02:49:19 +0000 (0:00:13.067) 0:02:36.574 ********* 2026-04-28 02:49:27.449034 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:49:27.449040 | orchestrator | 2026-04-28 02:49:27.449046 | orchestrator | TASK [mariadb : Wait for MariaDB service to sync WSREP] ************************ 2026-04-28 02:49:27.449051 | orchestrator | Tuesday 28 April 2026 02:49:23 +0000 (0:00:04.577) 0:02:41.151 ********* 2026-04-28 02:49:27.449057 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:49:27.449063 | orchestrator | 2026-04-28 02:49:27.449069 | orchestrator | PLAY [Apply mariadb post-configuration] **************************************** 2026-04-28 02:49:27.449075 | orchestrator | 2026-04-28 02:49:27.449082 | orchestrator | TASK [Include mariadb post-deploy.yml] ***************************************** 2026-04-28 02:49:27.449088 | orchestrator | Tuesday 28 April 2026 02:49:26 +0000 (0:00:02.964) 0:02:44.115 ********* 2026-04-28 02:49:27.449095 | orchestrator | included: mariadb for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:49:27.449101 | orchestrator | 2026-04-28 02:49:27.449106 | orchestrator | TASK [mariadb : Creating shard root mysql user] ******************************** 2026-04-28 02:49:27.449121 | orchestrator | Tuesday 28 April 2026 02:49:27 +0000 (0:00:00.609) 0:02:44.725 ********* 2026-04-28 02:49:39.693690 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:49:39.693809 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:49:39.693832 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:49:39.693851 | orchestrator | 2026-04-28 02:49:39.693873 | orchestrator | TASK [mariadb : Creating mysql monitor user] *********************************** 2026-04-28 02:49:39.693894 | orchestrator | Tuesday 28 April 2026 02:49:29 +0000 (0:00:02.268) 0:02:46.993 ********* 2026-04-28 02:49:39.693914 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:49:39.693925 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:49:39.693936 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:49:39.693946 | orchestrator | 2026-04-28 02:49:39.694135 | orchestrator | TASK [mariadb : Creating database backup user and setting permissions] ********* 2026-04-28 02:49:39.694149 | orchestrator | Tuesday 28 April 2026 02:49:31 +0000 (0:00:02.074) 0:02:49.068 ********* 2026-04-28 02:49:39.694160 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:49:39.694171 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:49:39.694187 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:49:39.694212 | orchestrator | 2026-04-28 02:49:39.694235 | orchestrator | TASK [mariadb : Granting permissions on Mariabackup database to backup user] *** 2026-04-28 02:49:39.694254 | orchestrator | Tuesday 28 April 2026 02:49:33 +0000 (0:00:02.151) 0:02:51.219 ********* 2026-04-28 02:49:39.694272 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:49:39.694291 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:49:39.694308 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:49:39.694326 | orchestrator | 2026-04-28 02:49:39.694345 | orchestrator | TASK [mariadb : Wait for MariaDB service to be ready through VIP] ************** 2026-04-28 02:49:39.694363 | orchestrator | Tuesday 28 April 2026 02:49:35 +0000 (0:00:01.909) 0:02:53.129 ********* 2026-04-28 02:49:39.694383 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:49:39.694403 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:49:39.694456 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:49:39.694468 | orchestrator | 2026-04-28 02:49:39.694480 | orchestrator | TASK [Include mariadb post-upgrade.yml] **************************************** 2026-04-28 02:49:39.694498 | orchestrator | Tuesday 28 April 2026 02:49:38 +0000 (0:00:03.014) 0:02:56.144 ********* 2026-04-28 02:49:39.694517 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:49:39.694535 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:49:39.694553 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:49:39.694571 | orchestrator | 2026-04-28 02:49:39.694589 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:49:39.694609 | orchestrator | testbed-node-0 : ok=34  changed=16  unreachable=0 failed=0 skipped=11  rescued=0 ignored=1  2026-04-28 02:49:39.694628 | orchestrator | testbed-node-1 : ok=20  changed=7  unreachable=0 failed=0 skipped=18  rescued=0 ignored=1  2026-04-28 02:49:39.694639 | orchestrator | testbed-node-2 : ok=20  changed=7  unreachable=0 failed=0 skipped=18  rescued=0 ignored=1  2026-04-28 02:49:39.694650 | orchestrator | 2026-04-28 02:49:39.694661 | orchestrator | 2026-04-28 02:49:39.694671 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:49:39.694682 | orchestrator | Tuesday 28 April 2026 02:49:39 +0000 (0:00:00.454) 0:02:56.598 ********* 2026-04-28 02:49:39.694693 | orchestrator | =============================================================================== 2026-04-28 02:49:39.694703 | orchestrator | mariadb : Restart MariaDB container ------------------------------------ 48.17s 2026-04-28 02:49:39.694714 | orchestrator | mariadb : Wait for MariaDB service port liveness ----------------------- 22.15s 2026-04-28 02:49:39.694725 | orchestrator | mariadb : Restart MariaDB container ------------------------------------ 13.07s 2026-04-28 02:49:39.694736 | orchestrator | mariadb : Check MariaDB service port liveness -------------------------- 10.90s 2026-04-28 02:49:39.694760 | orchestrator | mariadb : Running MariaDB bootstrap container -------------------------- 10.09s 2026-04-28 02:49:39.694772 | orchestrator | mariadb : Starting first MariaDB container ------------------------------ 8.42s 2026-04-28 02:49:39.694782 | orchestrator | mariadb : Wait for MariaDB service to sync WSREP ------------------------ 5.26s 2026-04-28 02:49:39.694793 | orchestrator | mariadb : Wait for MariaDB service port liveness ------------------------ 4.58s 2026-04-28 02:49:39.694804 | orchestrator | mariadb : Copying over galera.cnf --------------------------------------- 4.06s 2026-04-28 02:49:39.694815 | orchestrator | mariadb : Copying over config.json files for services ------------------- 3.16s 2026-04-28 02:49:39.694826 | orchestrator | mariadb : Check mariadb containers -------------------------------------- 3.03s 2026-04-28 02:49:39.694836 | orchestrator | mariadb : Wait for MariaDB service to be ready through VIP -------------- 3.01s 2026-04-28 02:49:39.694847 | orchestrator | mariadb : Wait for MariaDB service to sync WSREP ------------------------ 2.96s 2026-04-28 02:49:39.694858 | orchestrator | mariadb : Ensuring config directories exist ----------------------------- 2.66s 2026-04-28 02:49:39.694868 | orchestrator | mariadb : Wait for first MariaDB service to sync WSREP ------------------ 2.63s 2026-04-28 02:49:39.694879 | orchestrator | service-cert-copy : mariadb | Copying over backend internal TLS certificate --- 2.54s 2026-04-28 02:49:39.694890 | orchestrator | service-cert-copy : mariadb | Copying over backend internal TLS key ----- 2.49s 2026-04-28 02:49:39.694901 | orchestrator | service-cert-copy : mariadb | Copying over extra CA certificates -------- 2.37s 2026-04-28 02:49:39.694912 | orchestrator | mariadb : Creating shard root mysql user -------------------------------- 2.27s 2026-04-28 02:49:39.694922 | orchestrator | mariadb : Creating database backup user and setting permissions --------- 2.15s 2026-04-28 02:49:42.377101 | orchestrator | 2026-04-28 02:49:42 | INFO  | Task 0bad00f6-9f74-4291-9df3-6b9c7683d534 (rabbitmq) was prepared for execution. 2026-04-28 02:49:42.377228 | orchestrator | 2026-04-28 02:49:42 | INFO  | It takes a moment until task 0bad00f6-9f74-4291-9df3-6b9c7683d534 (rabbitmq) has been started and output is visible here. 2026-04-28 02:49:56.677701 | orchestrator | 2026-04-28 02:49:56.677817 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 02:49:56.677832 | orchestrator | 2026-04-28 02:49:56.677845 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 02:49:56.677859 | orchestrator | Tuesday 28 April 2026 02:49:47 +0000 (0:00:00.194) 0:00:00.194 ********* 2026-04-28 02:49:56.677873 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:49:56.677887 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:49:56.677901 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:49:56.677913 | orchestrator | 2026-04-28 02:49:56.678141 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 02:49:56.678166 | orchestrator | Tuesday 28 April 2026 02:49:47 +0000 (0:00:00.377) 0:00:00.572 ********* 2026-04-28 02:49:56.678176 | orchestrator | ok: [testbed-node-0] => (item=enable_rabbitmq_True) 2026-04-28 02:49:56.678187 | orchestrator | ok: [testbed-node-1] => (item=enable_rabbitmq_True) 2026-04-28 02:49:56.678200 | orchestrator | ok: [testbed-node-2] => (item=enable_rabbitmq_True) 2026-04-28 02:49:56.678213 | orchestrator | 2026-04-28 02:49:56.678232 | orchestrator | PLAY [Apply role rabbitmq] ***************************************************** 2026-04-28 02:49:56.678248 | orchestrator | 2026-04-28 02:49:56.678261 | orchestrator | TASK [rabbitmq : include_tasks] ************************************************ 2026-04-28 02:49:56.678276 | orchestrator | Tuesday 28 April 2026 02:49:48 +0000 (0:00:00.629) 0:00:01.202 ********* 2026-04-28 02:49:56.678290 | orchestrator | included: /ansible/roles/rabbitmq/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:49:56.678303 | orchestrator | 2026-04-28 02:49:56.678317 | orchestrator | TASK [rabbitmq : Get container facts] ****************************************** 2026-04-28 02:49:56.678330 | orchestrator | Tuesday 28 April 2026 02:49:48 +0000 (0:00:00.616) 0:00:01.818 ********* 2026-04-28 02:49:56.678342 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:49:56.678356 | orchestrator | 2026-04-28 02:49:56.678369 | orchestrator | TASK [rabbitmq : Get current RabbitMQ version] ********************************* 2026-04-28 02:49:56.678383 | orchestrator | Tuesday 28 April 2026 02:49:49 +0000 (0:00:00.919) 0:00:02.738 ********* 2026-04-28 02:49:56.678396 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:49:56.678411 | orchestrator | 2026-04-28 02:49:56.678425 | orchestrator | TASK [rabbitmq : Get new RabbitMQ version] ************************************* 2026-04-28 02:49:56.678439 | orchestrator | Tuesday 28 April 2026 02:49:49 +0000 (0:00:00.418) 0:00:03.156 ********* 2026-04-28 02:49:56.678452 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:49:56.678467 | orchestrator | 2026-04-28 02:49:56.678480 | orchestrator | TASK [rabbitmq : Check if running RabbitMQ is at most one version behind] ****** 2026-04-28 02:49:56.678494 | orchestrator | Tuesday 28 April 2026 02:49:50 +0000 (0:00:00.392) 0:00:03.549 ********* 2026-04-28 02:49:56.678508 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:49:56.678522 | orchestrator | 2026-04-28 02:49:56.678535 | orchestrator | TASK [rabbitmq : Catch when RabbitMQ is being downgraded] ********************** 2026-04-28 02:49:56.678548 | orchestrator | Tuesday 28 April 2026 02:49:50 +0000 (0:00:00.390) 0:00:03.939 ********* 2026-04-28 02:49:56.678563 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:49:56.678577 | orchestrator | 2026-04-28 02:49:56.678590 | orchestrator | TASK [rabbitmq : include_tasks] ************************************************ 2026-04-28 02:49:56.678605 | orchestrator | Tuesday 28 April 2026 02:49:51 +0000 (0:00:00.624) 0:00:04.563 ********* 2026-04-28 02:49:56.678618 | orchestrator | included: /ansible/roles/rabbitmq/tasks/remove-ha-all-policy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:49:56.678632 | orchestrator | 2026-04-28 02:49:56.678642 | orchestrator | TASK [rabbitmq : Get container facts] ****************************************** 2026-04-28 02:49:56.678650 | orchestrator | Tuesday 28 April 2026 02:49:52 +0000 (0:00:01.098) 0:00:05.662 ********* 2026-04-28 02:49:56.678676 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:49:56.678684 | orchestrator | 2026-04-28 02:49:56.678712 | orchestrator | TASK [rabbitmq : List RabbitMQ policies] *************************************** 2026-04-28 02:49:56.678720 | orchestrator | Tuesday 28 April 2026 02:49:53 +0000 (0:00:00.843) 0:00:06.505 ********* 2026-04-28 02:49:56.678728 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:49:56.678736 | orchestrator | 2026-04-28 02:49:56.678744 | orchestrator | TASK [rabbitmq : Remove ha-all policy from RabbitMQ] *************************** 2026-04-28 02:49:56.678752 | orchestrator | Tuesday 28 April 2026 02:49:53 +0000 (0:00:00.378) 0:00:06.884 ********* 2026-04-28 02:49:56.678760 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:49:56.678767 | orchestrator | 2026-04-28 02:49:56.678775 | orchestrator | TASK [rabbitmq : Ensuring config directories exist] **************************** 2026-04-28 02:49:56.678788 | orchestrator | Tuesday 28 April 2026 02:49:54 +0000 (0:00:00.425) 0:00:07.310 ********* 2026-04-28 02:49:56.678835 | orchestrator | changed: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 02:49:56.678857 | orchestrator | changed: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 02:49:56.678872 | orchestrator | changed: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 02:49:56.678895 | orchestrator | 2026-04-28 02:49:56.678905 | orchestrator | TASK [rabbitmq : Copying over config.json files for services] ****************** 2026-04-28 02:49:56.678912 | orchestrator | Tuesday 28 April 2026 02:49:54 +0000 (0:00:00.861) 0:00:08.171 ********* 2026-04-28 02:49:56.678957 | orchestrator | changed: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 02:49:56.678976 | orchestrator | changed: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 02:50:16.283804 | orchestrator | changed: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 02:50:16.283969 | orchestrator | 2026-04-28 02:50:16.283987 | orchestrator | TASK [rabbitmq : Copying over rabbitmq-env.conf] ******************************* 2026-04-28 02:50:16.284000 | orchestrator | Tuesday 28 April 2026 02:49:56 +0000 (0:00:01.681) 0:00:09.853 ********* 2026-04-28 02:50:16.284010 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/rabbitmq-env.conf.j2) 2026-04-28 02:50:16.284021 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/rabbitmq-env.conf.j2) 2026-04-28 02:50:16.284054 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/rabbitmq-env.conf.j2) 2026-04-28 02:50:16.284065 | orchestrator | 2026-04-28 02:50:16.284075 | orchestrator | TASK [rabbitmq : Copying over rabbitmq.conf] *********************************** 2026-04-28 02:50:16.284084 | orchestrator | Tuesday 28 April 2026 02:49:58 +0000 (0:00:01.526) 0:00:11.379 ********* 2026-04-28 02:50:16.284094 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/rabbitmq.conf.j2) 2026-04-28 02:50:16.284104 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/rabbitmq.conf.j2) 2026-04-28 02:50:16.284113 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/rabbitmq.conf.j2) 2026-04-28 02:50:16.284123 | orchestrator | 2026-04-28 02:50:16.284146 | orchestrator | TASK [rabbitmq : Copying over erl_inetrc] ************************************** 2026-04-28 02:50:16.284156 | orchestrator | Tuesday 28 April 2026 02:49:59 +0000 (0:00:01.750) 0:00:13.129 ********* 2026-04-28 02:50:16.284165 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/erl_inetrc.j2) 2026-04-28 02:50:16.284175 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/erl_inetrc.j2) 2026-04-28 02:50:16.284184 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/erl_inetrc.j2) 2026-04-28 02:50:16.284193 | orchestrator | 2026-04-28 02:50:16.284203 | orchestrator | TASK [rabbitmq : Copying over advanced.config] ********************************* 2026-04-28 02:50:16.284212 | orchestrator | Tuesday 28 April 2026 02:50:01 +0000 (0:00:01.473) 0:00:14.602 ********* 2026-04-28 02:50:16.284222 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/advanced.config.j2) 2026-04-28 02:50:16.284231 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/advanced.config.j2) 2026-04-28 02:50:16.284240 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/advanced.config.j2) 2026-04-28 02:50:16.284250 | orchestrator | 2026-04-28 02:50:16.284260 | orchestrator | TASK [rabbitmq : Copying over definitions.json] ******************************** 2026-04-28 02:50:16.284269 | orchestrator | Tuesday 28 April 2026 02:50:03 +0000 (0:00:01.877) 0:00:16.480 ********* 2026-04-28 02:50:16.284278 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/definitions.json.j2) 2026-04-28 02:50:16.284288 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/definitions.json.j2) 2026-04-28 02:50:16.284298 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/definitions.json.j2) 2026-04-28 02:50:16.284307 | orchestrator | 2026-04-28 02:50:16.284317 | orchestrator | TASK [rabbitmq : Copying over enabled_plugins] ********************************* 2026-04-28 02:50:16.284326 | orchestrator | Tuesday 28 April 2026 02:50:04 +0000 (0:00:01.432) 0:00:17.912 ********* 2026-04-28 02:50:16.284335 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/enabled_plugins.j2) 2026-04-28 02:50:16.284345 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/enabled_plugins.j2) 2026-04-28 02:50:16.284354 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/enabled_plugins.j2) 2026-04-28 02:50:16.284364 | orchestrator | 2026-04-28 02:50:16.284374 | orchestrator | TASK [rabbitmq : include_tasks] ************************************************ 2026-04-28 02:50:16.284383 | orchestrator | Tuesday 28 April 2026 02:50:06 +0000 (0:00:01.457) 0:00:19.370 ********* 2026-04-28 02:50:16.284393 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:50:16.284404 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:50:16.284430 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:50:16.284440 | orchestrator | 2026-04-28 02:50:16.284450 | orchestrator | TASK [rabbitmq : Check rabbitmq containers] ************************************ 2026-04-28 02:50:16.284460 | orchestrator | Tuesday 28 April 2026 02:50:06 +0000 (0:00:00.409) 0:00:19.779 ********* 2026-04-28 02:50:16.284471 | orchestrator | changed: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 02:50:16.284496 | orchestrator | changed: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 02:50:16.284508 | orchestrator | changed: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 02:50:16.284518 | orchestrator | 2026-04-28 02:50:16.284528 | orchestrator | TASK [rabbitmq : Creating rabbitmq volume] ************************************* 2026-04-28 02:50:16.284537 | orchestrator | Tuesday 28 April 2026 02:50:07 +0000 (0:00:01.305) 0:00:21.085 ********* 2026-04-28 02:50:16.284547 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:50:16.284556 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:50:16.284566 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:50:16.284575 | orchestrator | 2026-04-28 02:50:16.284585 | orchestrator | TASK [rabbitmq : Running RabbitMQ bootstrap container] ************************* 2026-04-28 02:50:16.284594 | orchestrator | Tuesday 28 April 2026 02:50:08 +0000 (0:00:00.866) 0:00:21.951 ********* 2026-04-28 02:50:16.284603 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:50:16.284613 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:50:16.284623 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:50:16.284638 | orchestrator | 2026-04-28 02:50:16.284648 | orchestrator | RUNNING HANDLER [rabbitmq : Restart rabbitmq container] ************************ 2026-04-28 02:50:16.284663 | orchestrator | Tuesday 28 April 2026 02:50:16 +0000 (0:00:07.502) 0:00:29.454 ********* 2026-04-28 02:51:47.439425 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:51:47.439539 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:51:47.439551 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:51:47.439559 | orchestrator | 2026-04-28 02:51:47.439568 | orchestrator | PLAY [Restart rabbitmq services] *********************************************** 2026-04-28 02:51:47.439576 | orchestrator | 2026-04-28 02:51:47.439584 | orchestrator | TASK [rabbitmq : Get info on RabbitMQ container] ******************************* 2026-04-28 02:51:47.439591 | orchestrator | Tuesday 28 April 2026 02:50:16 +0000 (0:00:00.517) 0:00:29.971 ********* 2026-04-28 02:51:47.439599 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:51:47.439607 | orchestrator | 2026-04-28 02:51:47.439614 | orchestrator | TASK [rabbitmq : Put RabbitMQ node into maintenance mode] ********************** 2026-04-28 02:51:47.439622 | orchestrator | Tuesday 28 April 2026 02:50:17 +0000 (0:00:00.629) 0:00:30.601 ********* 2026-04-28 02:51:47.439629 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:51:47.439636 | orchestrator | 2026-04-28 02:51:47.439644 | orchestrator | TASK [rabbitmq : Restart rabbitmq container] *********************************** 2026-04-28 02:51:47.439651 | orchestrator | Tuesday 28 April 2026 02:50:17 +0000 (0:00:00.263) 0:00:30.865 ********* 2026-04-28 02:51:47.439658 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:51:47.439665 | orchestrator | 2026-04-28 02:51:47.439673 | orchestrator | TASK [rabbitmq : Waiting for rabbitmq to start] ******************************** 2026-04-28 02:51:47.439680 | orchestrator | Tuesday 28 April 2026 02:50:24 +0000 (0:00:06.647) 0:00:37.512 ********* 2026-04-28 02:51:47.439687 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:51:47.439694 | orchestrator | 2026-04-28 02:51:47.439701 | orchestrator | PLAY [Restart rabbitmq services] *********************************************** 2026-04-28 02:51:47.439709 | orchestrator | 2026-04-28 02:51:47.439716 | orchestrator | TASK [rabbitmq : Get info on RabbitMQ container] ******************************* 2026-04-28 02:51:47.439723 | orchestrator | Tuesday 28 April 2026 02:51:12 +0000 (0:00:47.974) 0:01:25.486 ********* 2026-04-28 02:51:47.439810 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:51:47.439822 | orchestrator | 2026-04-28 02:51:47.439833 | orchestrator | TASK [rabbitmq : Put RabbitMQ node into maintenance mode] ********************** 2026-04-28 02:51:47.439844 | orchestrator | Tuesday 28 April 2026 02:51:12 +0000 (0:00:00.577) 0:01:26.064 ********* 2026-04-28 02:51:47.439856 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:51:47.439867 | orchestrator | 2026-04-28 02:51:47.439878 | orchestrator | TASK [rabbitmq : Restart rabbitmq container] *********************************** 2026-04-28 02:51:47.439890 | orchestrator | Tuesday 28 April 2026 02:51:13 +0000 (0:00:00.224) 0:01:26.288 ********* 2026-04-28 02:51:47.439902 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:51:47.439914 | orchestrator | 2026-04-28 02:51:47.439926 | orchestrator | TASK [rabbitmq : Waiting for rabbitmq to start] ******************************** 2026-04-28 02:51:47.439938 | orchestrator | Tuesday 28 April 2026 02:51:19 +0000 (0:00:06.600) 0:01:32.888 ********* 2026-04-28 02:51:47.439950 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:51:47.439964 | orchestrator | 2026-04-28 02:51:47.439976 | orchestrator | PLAY [Restart rabbitmq services] *********************************************** 2026-04-28 02:51:47.439990 | orchestrator | 2026-04-28 02:51:47.440002 | orchestrator | TASK [rabbitmq : Get info on RabbitMQ container] ******************************* 2026-04-28 02:51:47.440035 | orchestrator | Tuesday 28 April 2026 02:51:26 +0000 (0:00:07.129) 0:01:40.018 ********* 2026-04-28 02:51:47.440049 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:51:47.440058 | orchestrator | 2026-04-28 02:51:47.440066 | orchestrator | TASK [rabbitmq : Put RabbitMQ node into maintenance mode] ********************** 2026-04-28 02:51:47.440074 | orchestrator | Tuesday 28 April 2026 02:51:27 +0000 (0:00:00.826) 0:01:40.845 ********* 2026-04-28 02:51:47.440082 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:51:47.440090 | orchestrator | 2026-04-28 02:51:47.440098 | orchestrator | TASK [rabbitmq : Restart rabbitmq container] *********************************** 2026-04-28 02:51:47.440123 | orchestrator | Tuesday 28 April 2026 02:51:27 +0000 (0:00:00.237) 0:01:41.083 ********* 2026-04-28 02:51:47.440132 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:51:47.440139 | orchestrator | 2026-04-28 02:51:47.440148 | orchestrator | TASK [rabbitmq : Waiting for rabbitmq to start] ******************************** 2026-04-28 02:51:47.440158 | orchestrator | Tuesday 28 April 2026 02:51:29 +0000 (0:00:01.701) 0:01:42.784 ********* 2026-04-28 02:51:47.440170 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:51:47.440183 | orchestrator | 2026-04-28 02:51:47.440195 | orchestrator | PLAY [Apply rabbitmq post-configuration] *************************************** 2026-04-28 02:51:47.440208 | orchestrator | 2026-04-28 02:51:47.440221 | orchestrator | TASK [Include rabbitmq post-deploy.yml] **************************************** 2026-04-28 02:51:47.440233 | orchestrator | Tuesday 28 April 2026 02:51:44 +0000 (0:00:14.892) 0:01:57.676 ********* 2026-04-28 02:51:47.440244 | orchestrator | included: rabbitmq for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:51:47.440251 | orchestrator | 2026-04-28 02:51:47.440258 | orchestrator | TASK [rabbitmq : Enable all stable feature flags] ****************************** 2026-04-28 02:51:47.440265 | orchestrator | Tuesday 28 April 2026 02:51:45 +0000 (0:00:00.561) 0:01:58.238 ********* 2026-04-28 02:51:47.440273 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: 2026-04-28 02:51:47.440280 | orchestrator | enable_outward_rabbitmq_True 2026-04-28 02:51:47.440287 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: 2026-04-28 02:51:47.440294 | orchestrator | outward_rabbitmq_restart 2026-04-28 02:51:47.440301 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:51:47.440309 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:51:47.440316 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:51:47.440323 | orchestrator | 2026-04-28 02:51:47.440332 | orchestrator | PLAY [Apply role rabbitmq (outward)] ******************************************* 2026-04-28 02:51:47.440344 | orchestrator | skipping: no hosts matched 2026-04-28 02:51:47.440356 | orchestrator | 2026-04-28 02:51:47.440368 | orchestrator | PLAY [Restart rabbitmq (outward) services] ************************************* 2026-04-28 02:51:47.440381 | orchestrator | skipping: no hosts matched 2026-04-28 02:51:47.440394 | orchestrator | 2026-04-28 02:51:47.440405 | orchestrator | PLAY [Apply rabbitmq (outward) post-configuration] ***************************** 2026-04-28 02:51:47.440416 | orchestrator | skipping: no hosts matched 2026-04-28 02:51:47.440424 | orchestrator | 2026-04-28 02:51:47.440431 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:51:47.440457 | orchestrator | testbed-node-0 : ok=23  changed=14  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2026-04-28 02:51:47.440467 | orchestrator | testbed-node-1 : ok=21  changed=14  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:51:47.440474 | orchestrator | testbed-node-2 : ok=21  changed=14  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:51:47.440481 | orchestrator | 2026-04-28 02:51:47.440488 | orchestrator | 2026-04-28 02:51:47.440495 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:51:47.440503 | orchestrator | Tuesday 28 April 2026 02:51:47 +0000 (0:00:01.969) 0:02:00.208 ********* 2026-04-28 02:51:47.440510 | orchestrator | =============================================================================== 2026-04-28 02:51:47.440517 | orchestrator | rabbitmq : Waiting for rabbitmq to start ------------------------------- 70.00s 2026-04-28 02:51:47.440524 | orchestrator | rabbitmq : Restart rabbitmq container ---------------------------------- 14.95s 2026-04-28 02:51:47.440532 | orchestrator | rabbitmq : Running RabbitMQ bootstrap container ------------------------- 7.50s 2026-04-28 02:51:47.440544 | orchestrator | rabbitmq : Get info on RabbitMQ container ------------------------------- 2.03s 2026-04-28 02:51:47.440556 | orchestrator | rabbitmq : Enable all stable feature flags ------------------------------ 1.97s 2026-04-28 02:51:47.440579 | orchestrator | rabbitmq : Copying over advanced.config --------------------------------- 1.88s 2026-04-28 02:51:47.440592 | orchestrator | rabbitmq : Copying over rabbitmq.conf ----------------------------------- 1.75s 2026-04-28 02:51:47.440600 | orchestrator | rabbitmq : Copying over config.json files for services ------------------ 1.68s 2026-04-28 02:51:47.440607 | orchestrator | rabbitmq : Copying over rabbitmq-env.conf ------------------------------- 1.53s 2026-04-28 02:51:47.440614 | orchestrator | rabbitmq : Copying over erl_inetrc -------------------------------------- 1.47s 2026-04-28 02:51:47.440621 | orchestrator | rabbitmq : Copying over enabled_plugins --------------------------------- 1.46s 2026-04-28 02:51:47.440628 | orchestrator | rabbitmq : Copying over definitions.json -------------------------------- 1.43s 2026-04-28 02:51:47.440635 | orchestrator | rabbitmq : Check rabbitmq containers ------------------------------------ 1.31s 2026-04-28 02:51:47.440642 | orchestrator | rabbitmq : include_tasks ------------------------------------------------ 1.10s 2026-04-28 02:51:47.440650 | orchestrator | rabbitmq : Get container facts ------------------------------------------ 0.92s 2026-04-28 02:51:47.440657 | orchestrator | rabbitmq : Creating rabbitmq volume ------------------------------------- 0.87s 2026-04-28 02:51:47.440667 | orchestrator | rabbitmq : Ensuring config directories exist ---------------------------- 0.86s 2026-04-28 02:51:47.440684 | orchestrator | rabbitmq : Get container facts ------------------------------------------ 0.84s 2026-04-28 02:51:47.440705 | orchestrator | rabbitmq : Put RabbitMQ node into maintenance mode ---------------------- 0.73s 2026-04-28 02:51:47.440717 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.63s 2026-04-28 02:51:50.061827 | orchestrator | 2026-04-28 02:51:50 | INFO  | Task 488cf9cf-ba28-41e7-9833-42da3ad4af3d (openvswitch) was prepared for execution. 2026-04-28 02:51:50.061923 | orchestrator | 2026-04-28 02:51:50 | INFO  | It takes a moment until task 488cf9cf-ba28-41e7-9833-42da3ad4af3d (openvswitch) has been started and output is visible here. 2026-04-28 02:52:03.768210 | orchestrator | 2026-04-28 02:52:03.768299 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 02:52:03.768308 | orchestrator | 2026-04-28 02:52:03.768314 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 02:52:03.768320 | orchestrator | Tuesday 28 April 2026 02:51:54 +0000 (0:00:00.311) 0:00:00.311 ********* 2026-04-28 02:52:03.768326 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:52:03.768332 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:52:03.768337 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:52:03.768343 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:52:03.768348 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:52:03.768353 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:52:03.768358 | orchestrator | 2026-04-28 02:52:03.768363 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 02:52:03.768368 | orchestrator | Tuesday 28 April 2026 02:51:55 +0000 (0:00:00.783) 0:00:01.095 ********* 2026-04-28 02:52:03.768374 | orchestrator | ok: [testbed-node-0] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-28 02:52:03.768380 | orchestrator | ok: [testbed-node-1] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-28 02:52:03.768385 | orchestrator | ok: [testbed-node-2] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-28 02:52:03.768390 | orchestrator | ok: [testbed-node-3] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-28 02:52:03.768395 | orchestrator | ok: [testbed-node-4] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-28 02:52:03.768400 | orchestrator | ok: [testbed-node-5] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-28 02:52:03.768405 | orchestrator | 2026-04-28 02:52:03.768411 | orchestrator | PLAY [Apply role openvswitch] ************************************************** 2026-04-28 02:52:03.768416 | orchestrator | 2026-04-28 02:52:03.768421 | orchestrator | TASK [openvswitch : include_tasks] ********************************************* 2026-04-28 02:52:03.768426 | orchestrator | Tuesday 28 April 2026 02:51:56 +0000 (0:00:00.643) 0:00:01.738 ********* 2026-04-28 02:52:03.768447 | orchestrator | included: /ansible/roles/openvswitch/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 02:52:03.768454 | orchestrator | 2026-04-28 02:52:03.768459 | orchestrator | TASK [module-load : Load modules] ********************************************** 2026-04-28 02:52:03.768464 | orchestrator | Tuesday 28 April 2026 02:51:57 +0000 (0:00:01.293) 0:00:03.032 ********* 2026-04-28 02:52:03.768469 | orchestrator | changed: [testbed-node-0] => (item=openvswitch) 2026-04-28 02:52:03.768475 | orchestrator | changed: [testbed-node-1] => (item=openvswitch) 2026-04-28 02:52:03.768480 | orchestrator | changed: [testbed-node-2] => (item=openvswitch) 2026-04-28 02:52:03.768485 | orchestrator | changed: [testbed-node-3] => (item=openvswitch) 2026-04-28 02:52:03.768490 | orchestrator | changed: [testbed-node-4] => (item=openvswitch) 2026-04-28 02:52:03.768495 | orchestrator | changed: [testbed-node-5] => (item=openvswitch) 2026-04-28 02:52:03.768500 | orchestrator | 2026-04-28 02:52:03.768505 | orchestrator | TASK [module-load : Persist modules via modules-load.d] ************************ 2026-04-28 02:52:03.768511 | orchestrator | Tuesday 28 April 2026 02:51:58 +0000 (0:00:01.234) 0:00:04.266 ********* 2026-04-28 02:52:03.768516 | orchestrator | changed: [testbed-node-1] => (item=openvswitch) 2026-04-28 02:52:03.768521 | orchestrator | changed: [testbed-node-0] => (item=openvswitch) 2026-04-28 02:52:03.768526 | orchestrator | changed: [testbed-node-3] => (item=openvswitch) 2026-04-28 02:52:03.768531 | orchestrator | changed: [testbed-node-2] => (item=openvswitch) 2026-04-28 02:52:03.768536 | orchestrator | changed: [testbed-node-4] => (item=openvswitch) 2026-04-28 02:52:03.768541 | orchestrator | changed: [testbed-node-5] => (item=openvswitch) 2026-04-28 02:52:03.768546 | orchestrator | 2026-04-28 02:52:03.768551 | orchestrator | TASK [module-load : Drop module persistence] *********************************** 2026-04-28 02:52:03.768556 | orchestrator | Tuesday 28 April 2026 02:52:00 +0000 (0:00:01.530) 0:00:05.797 ********* 2026-04-28 02:52:03.768561 | orchestrator | skipping: [testbed-node-0] => (item=openvswitch)  2026-04-28 02:52:03.768566 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:52:03.768572 | orchestrator | skipping: [testbed-node-1] => (item=openvswitch)  2026-04-28 02:52:03.768577 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:52:03.768582 | orchestrator | skipping: [testbed-node-2] => (item=openvswitch)  2026-04-28 02:52:03.768588 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:52:03.768593 | orchestrator | skipping: [testbed-node-3] => (item=openvswitch)  2026-04-28 02:52:03.768598 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:52:03.768603 | orchestrator | skipping: [testbed-node-4] => (item=openvswitch)  2026-04-28 02:52:03.768608 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:52:03.768613 | orchestrator | skipping: [testbed-node-5] => (item=openvswitch)  2026-04-28 02:52:03.768618 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:52:03.768623 | orchestrator | 2026-04-28 02:52:03.768628 | orchestrator | TASK [openvswitch : Create /run/openvswitch directory on host] ***************** 2026-04-28 02:52:03.768633 | orchestrator | Tuesday 28 April 2026 02:52:01 +0000 (0:00:01.305) 0:00:07.102 ********* 2026-04-28 02:52:03.768638 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:52:03.768643 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:52:03.768648 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:52:03.768664 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:52:03.768669 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:52:03.768674 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:52:03.768680 | orchestrator | 2026-04-28 02:52:03.768685 | orchestrator | TASK [openvswitch : Ensuring config directories exist] ************************* 2026-04-28 02:52:03.768690 | orchestrator | Tuesday 28 April 2026 02:52:02 +0000 (0:00:00.824) 0:00:07.927 ********* 2026-04-28 02:52:03.768731 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 02:52:03.768754 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 02:52:03.768764 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 02:52:03.768774 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 02:52:03.768785 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 02:52:03.768799 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 02:52:06.361893 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 02:52:06.362078 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 02:52:06.362158 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 02:52:06.362268 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 02:52:06.362298 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 02:52:06.362355 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 02:52:06.362412 | orchestrator | 2026-04-28 02:52:06.362436 | orchestrator | TASK [openvswitch : Copying over config.json files for services] *************** 2026-04-28 02:52:06.362457 | orchestrator | Tuesday 28 April 2026 02:52:03 +0000 (0:00:01.439) 0:00:09.366 ********* 2026-04-28 02:52:06.362476 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 02:52:06.362498 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 02:52:06.362521 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 02:52:06.362545 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 02:52:06.362574 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 02:52:06.362611 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 02:52:09.373276 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 02:52:09.373387 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 02:52:09.373407 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 02:52:09.373421 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 02:52:09.373476 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 02:52:09.373511 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 02:52:09.373525 | orchestrator | 2026-04-28 02:52:09.373536 | orchestrator | TASK [openvswitch : Copying over ovs-vsctl wrapper] **************************** 2026-04-28 02:52:09.373545 | orchestrator | Tuesday 28 April 2026 02:52:06 +0000 (0:00:02.615) 0:00:11.981 ********* 2026-04-28 02:52:09.373553 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:52:09.373561 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:52:09.373568 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:52:09.373575 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:52:09.373582 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:52:09.373589 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:52:09.373597 | orchestrator | 2026-04-28 02:52:09.373604 | orchestrator | TASK [openvswitch : Check openvswitch containers] ****************************** 2026-04-28 02:52:09.373612 | orchestrator | Tuesday 28 April 2026 02:52:07 +0000 (0:00:01.166) 0:00:13.148 ********* 2026-04-28 02:52:09.373620 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 02:52:09.373630 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 02:52:09.373637 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 02:52:09.373665 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 02:52:09.373688 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 02:52:34.462496 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 02:52:34.462599 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 02:52:34.462609 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 02:52:34.462648 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 02:52:34.462655 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 02:52:34.462739 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 02:52:34.462747 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 02:52:34.462754 | orchestrator | 2026-04-28 02:52:34.462761 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-28 02:52:34.462770 | orchestrator | Tuesday 28 April 2026 02:52:09 +0000 (0:00:01.826) 0:00:14.974 ********* 2026-04-28 02:52:34.462776 | orchestrator | 2026-04-28 02:52:34.462782 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-28 02:52:34.462789 | orchestrator | Tuesday 28 April 2026 02:52:09 +0000 (0:00:00.323) 0:00:15.298 ********* 2026-04-28 02:52:34.462795 | orchestrator | 2026-04-28 02:52:34.462801 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-28 02:52:34.462808 | orchestrator | Tuesday 28 April 2026 02:52:09 +0000 (0:00:00.162) 0:00:15.461 ********* 2026-04-28 02:52:34.462814 | orchestrator | 2026-04-28 02:52:34.462822 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-28 02:52:34.462836 | orchestrator | Tuesday 28 April 2026 02:52:10 +0000 (0:00:00.167) 0:00:15.629 ********* 2026-04-28 02:52:34.462842 | orchestrator | 2026-04-28 02:52:34.462848 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-28 02:52:34.462854 | orchestrator | Tuesday 28 April 2026 02:52:10 +0000 (0:00:00.154) 0:00:15.783 ********* 2026-04-28 02:52:34.462860 | orchestrator | 2026-04-28 02:52:34.462866 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-28 02:52:34.462872 | orchestrator | Tuesday 28 April 2026 02:52:10 +0000 (0:00:00.147) 0:00:15.931 ********* 2026-04-28 02:52:34.462878 | orchestrator | 2026-04-28 02:52:34.462884 | orchestrator | RUNNING HANDLER [openvswitch : Restart openvswitch-db-server container] ******** 2026-04-28 02:52:34.462891 | orchestrator | Tuesday 28 April 2026 02:52:10 +0000 (0:00:00.142) 0:00:16.073 ********* 2026-04-28 02:52:34.462906 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:52:34.462914 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:52:34.462921 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:52:34.462927 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:52:34.462934 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:52:34.462941 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:52:34.462947 | orchestrator | 2026-04-28 02:52:34.462954 | orchestrator | RUNNING HANDLER [openvswitch : Waiting for openvswitch_db service to be ready] *** 2026-04-28 02:52:34.462962 | orchestrator | Tuesday 28 April 2026 02:52:19 +0000 (0:00:08.879) 0:00:24.952 ********* 2026-04-28 02:52:34.462969 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:52:34.462978 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:52:34.462985 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:52:34.462992 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:52:34.462999 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:52:34.463005 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:52:34.463012 | orchestrator | 2026-04-28 02:52:34.463018 | orchestrator | RUNNING HANDLER [openvswitch : Restart openvswitch-vswitchd container] ********* 2026-04-28 02:52:34.463030 | orchestrator | Tuesday 28 April 2026 02:52:20 +0000 (0:00:01.085) 0:00:26.038 ********* 2026-04-28 02:52:34.463038 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:52:34.463045 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:52:34.463052 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:52:34.463058 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:52:34.463063 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:52:34.463069 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:52:34.463076 | orchestrator | 2026-04-28 02:52:34.463082 | orchestrator | TASK [openvswitch : Set system-id, hostname and hw-offload] ******************** 2026-04-28 02:52:34.463088 | orchestrator | Tuesday 28 April 2026 02:52:28 +0000 (0:00:08.246) 0:00:34.285 ********* 2026-04-28 02:52:34.463094 | orchestrator | changed: [testbed-node-1] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-1'}) 2026-04-28 02:52:34.463101 | orchestrator | changed: [testbed-node-0] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-0'}) 2026-04-28 02:52:34.463108 | orchestrator | changed: [testbed-node-2] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-2'}) 2026-04-28 02:52:34.463116 | orchestrator | changed: [testbed-node-3] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-3'}) 2026-04-28 02:52:34.463123 | orchestrator | changed: [testbed-node-5] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-5'}) 2026-04-28 02:52:34.463131 | orchestrator | changed: [testbed-node-4] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-4'}) 2026-04-28 02:52:34.463139 | orchestrator | changed: [testbed-node-1] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-1'}) 2026-04-28 02:52:34.463154 | orchestrator | changed: [testbed-node-0] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-0'}) 2026-04-28 02:52:47.774462 | orchestrator | changed: [testbed-node-2] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-2'}) 2026-04-28 02:52:47.774564 | orchestrator | changed: [testbed-node-5] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-5'}) 2026-04-28 02:52:47.774571 | orchestrator | changed: [testbed-node-3] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-3'}) 2026-04-28 02:52:47.774576 | orchestrator | changed: [testbed-node-4] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-4'}) 2026-04-28 02:52:47.774581 | orchestrator | ok: [testbed-node-1] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-28 02:52:47.774585 | orchestrator | ok: [testbed-node-0] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-28 02:52:47.774589 | orchestrator | ok: [testbed-node-5] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-28 02:52:47.774593 | orchestrator | ok: [testbed-node-3] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-28 02:52:47.774597 | orchestrator | ok: [testbed-node-2] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-28 02:52:47.774602 | orchestrator | ok: [testbed-node-4] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-28 02:52:47.774606 | orchestrator | 2026-04-28 02:52:47.774611 | orchestrator | TASK [openvswitch : Ensuring OVS bridge is properly setup] ********************* 2026-04-28 02:52:47.774616 | orchestrator | Tuesday 28 April 2026 02:52:34 +0000 (0:00:05.680) 0:00:39.966 ********* 2026-04-28 02:52:47.774621 | orchestrator | skipping: [testbed-node-3] => (item=br-ex)  2026-04-28 02:52:47.774626 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:52:47.774632 | orchestrator | skipping: [testbed-node-4] => (item=br-ex)  2026-04-28 02:52:47.774636 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:52:47.774677 | orchestrator | skipping: [testbed-node-5] => (item=br-ex)  2026-04-28 02:52:47.774689 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:52:47.774693 | orchestrator | changed: [testbed-node-0] => (item=br-ex) 2026-04-28 02:52:47.774697 | orchestrator | changed: [testbed-node-1] => (item=br-ex) 2026-04-28 02:52:47.774701 | orchestrator | changed: [testbed-node-2] => (item=br-ex) 2026-04-28 02:52:47.774705 | orchestrator | 2026-04-28 02:52:47.774710 | orchestrator | TASK [openvswitch : Ensuring OVS ports are properly setup] ********************* 2026-04-28 02:52:47.774714 | orchestrator | Tuesday 28 April 2026 02:52:36 +0000 (0:00:02.498) 0:00:42.464 ********* 2026-04-28 02:52:47.774718 | orchestrator | skipping: [testbed-node-3] => (item=['br-ex', 'vxlan0'])  2026-04-28 02:52:47.774722 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:52:47.774727 | orchestrator | skipping: [testbed-node-4] => (item=['br-ex', 'vxlan0'])  2026-04-28 02:52:47.774731 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:52:47.774735 | orchestrator | skipping: [testbed-node-5] => (item=['br-ex', 'vxlan0'])  2026-04-28 02:52:47.774739 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:52:47.774743 | orchestrator | changed: [testbed-node-0] => (item=['br-ex', 'vxlan0']) 2026-04-28 02:52:47.774747 | orchestrator | changed: [testbed-node-1] => (item=['br-ex', 'vxlan0']) 2026-04-28 02:52:47.774751 | orchestrator | changed: [testbed-node-2] => (item=['br-ex', 'vxlan0']) 2026-04-28 02:52:47.774755 | orchestrator | 2026-04-28 02:52:47.774760 | orchestrator | RUNNING HANDLER [openvswitch : Restart openvswitch-vswitchd container] ********* 2026-04-28 02:52:47.774764 | orchestrator | Tuesday 28 April 2026 02:52:39 +0000 (0:00:03.015) 0:00:45.479 ********* 2026-04-28 02:52:47.774768 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:52:47.774784 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:52:47.774789 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:52:47.774793 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:52:47.774797 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:52:47.774801 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:52:47.774806 | orchestrator | 2026-04-28 02:52:47.774810 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:52:47.774840 | orchestrator | testbed-node-0 : ok=15  changed=11  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-28 02:52:47.774846 | orchestrator | testbed-node-1 : ok=15  changed=11  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-28 02:52:47.774851 | orchestrator | testbed-node-2 : ok=15  changed=11  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-28 02:52:47.774855 | orchestrator | testbed-node-3 : ok=13  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 02:52:47.774859 | orchestrator | testbed-node-4 : ok=13  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 02:52:47.774863 | orchestrator | testbed-node-5 : ok=13  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 02:52:47.774867 | orchestrator | 2026-04-28 02:52:47.774871 | orchestrator | 2026-04-28 02:52:47.774875 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:52:47.774879 | orchestrator | Tuesday 28 April 2026 02:52:47 +0000 (0:00:07.259) 0:00:52.739 ********* 2026-04-28 02:52:47.774895 | orchestrator | =============================================================================== 2026-04-28 02:52:47.774899 | orchestrator | openvswitch : Restart openvswitch-vswitchd container ------------------- 15.51s 2026-04-28 02:52:47.774903 | orchestrator | openvswitch : Restart openvswitch-db-server container ------------------- 8.88s 2026-04-28 02:52:47.774908 | orchestrator | openvswitch : Set system-id, hostname and hw-offload -------------------- 5.68s 2026-04-28 02:52:47.774912 | orchestrator | openvswitch : Ensuring OVS ports are properly setup --------------------- 3.02s 2026-04-28 02:52:47.774916 | orchestrator | openvswitch : Copying over config.json files for services --------------- 2.62s 2026-04-28 02:52:47.774920 | orchestrator | openvswitch : Ensuring OVS bridge is properly setup --------------------- 2.50s 2026-04-28 02:52:47.774924 | orchestrator | openvswitch : Check openvswitch containers ------------------------------ 1.83s 2026-04-28 02:52:47.774928 | orchestrator | module-load : Persist modules via modules-load.d ------------------------ 1.53s 2026-04-28 02:52:47.774932 | orchestrator | openvswitch : Ensuring config directories exist ------------------------- 1.44s 2026-04-28 02:52:47.774936 | orchestrator | module-load : Drop module persistence ----------------------------------- 1.31s 2026-04-28 02:52:47.774940 | orchestrator | openvswitch : include_tasks --------------------------------------------- 1.29s 2026-04-28 02:52:47.774944 | orchestrator | module-load : Load modules ---------------------------------------------- 1.23s 2026-04-28 02:52:47.774948 | orchestrator | openvswitch : Copying over ovs-vsctl wrapper ---------------------------- 1.17s 2026-04-28 02:52:47.774953 | orchestrator | openvswitch : Flush Handlers -------------------------------------------- 1.10s 2026-04-28 02:52:47.774957 | orchestrator | openvswitch : Waiting for openvswitch_db service to be ready ------------ 1.09s 2026-04-28 02:52:47.774961 | orchestrator | openvswitch : Create /run/openvswitch directory on host ----------------- 0.82s 2026-04-28 02:52:47.774965 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.78s 2026-04-28 02:52:47.774969 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.64s 2026-04-28 02:52:50.298949 | orchestrator | 2026-04-28 02:52:50 | INFO  | Task 9f0d2a68-5f23-438d-8c6e-f5a6cec55e13 (ovn) was prepared for execution. 2026-04-28 02:52:50.299058 | orchestrator | 2026-04-28 02:52:50 | INFO  | It takes a moment until task 9f0d2a68-5f23-438d-8c6e-f5a6cec55e13 (ovn) has been started and output is visible here. 2026-04-28 02:53:01.761069 | orchestrator | 2026-04-28 02:53:01.761153 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 02:53:01.761160 | orchestrator | 2026-04-28 02:53:01.761181 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 02:53:01.761185 | orchestrator | Tuesday 28 April 2026 02:52:54 +0000 (0:00:00.178) 0:00:00.178 ********* 2026-04-28 02:53:01.761189 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:53:01.761194 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:53:01.761198 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:53:01.761202 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:53:01.761206 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:53:01.761210 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:53:01.761214 | orchestrator | 2026-04-28 02:53:01.761218 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 02:53:01.761222 | orchestrator | Tuesday 28 April 2026 02:52:55 +0000 (0:00:00.766) 0:00:00.945 ********* 2026-04-28 02:53:01.761226 | orchestrator | ok: [testbed-node-3] => (item=enable_ovn_True) 2026-04-28 02:53:01.761230 | orchestrator | ok: [testbed-node-4] => (item=enable_ovn_True) 2026-04-28 02:53:01.761234 | orchestrator | ok: [testbed-node-5] => (item=enable_ovn_True) 2026-04-28 02:53:01.761239 | orchestrator | ok: [testbed-node-0] => (item=enable_ovn_True) 2026-04-28 02:53:01.761242 | orchestrator | ok: [testbed-node-1] => (item=enable_ovn_True) 2026-04-28 02:53:01.761257 | orchestrator | ok: [testbed-node-2] => (item=enable_ovn_True) 2026-04-28 02:53:01.761261 | orchestrator | 2026-04-28 02:53:01.761264 | orchestrator | PLAY [Apply role ovn-controller] *********************************************** 2026-04-28 02:53:01.761268 | orchestrator | 2026-04-28 02:53:01.761273 | orchestrator | TASK [ovn-controller : include_tasks] ****************************************** 2026-04-28 02:53:01.761277 | orchestrator | Tuesday 28 April 2026 02:52:56 +0000 (0:00:00.888) 0:00:01.834 ********* 2026-04-28 02:53:01.761281 | orchestrator | included: /ansible/roles/ovn-controller/tasks/deploy.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:53:01.761286 | orchestrator | 2026-04-28 02:53:01.761290 | orchestrator | TASK [ovn-controller : Ensuring config directories exist] ********************** 2026-04-28 02:53:01.761294 | orchestrator | Tuesday 28 April 2026 02:52:57 +0000 (0:00:01.223) 0:00:03.057 ********* 2026-04-28 02:53:01.761299 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:01.761305 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:01.761309 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:01.761313 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:01.761323 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:01.761337 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:01.761342 | orchestrator | 2026-04-28 02:53:01.761346 | orchestrator | TASK [ovn-controller : Copying over config.json files for services] ************ 2026-04-28 02:53:01.761349 | orchestrator | Tuesday 28 April 2026 02:52:59 +0000 (0:00:01.314) 0:00:04.372 ********* 2026-04-28 02:53:01.761353 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:01.761361 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:01.761365 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:01.761368 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:01.761372 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:01.761376 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:01.761380 | orchestrator | 2026-04-28 02:53:01.761384 | orchestrator | TASK [ovn-controller : Ensuring systemd override directory exists] ************* 2026-04-28 02:53:01.761391 | orchestrator | Tuesday 28 April 2026 02:53:00 +0000 (0:00:01.533) 0:00:05.905 ********* 2026-04-28 02:53:01.761395 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:01.761399 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:01.761406 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:26.789412 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:26.789571 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:26.789735 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:26.789760 | orchestrator | 2026-04-28 02:53:26.789774 | orchestrator | TASK [ovn-controller : Copying over systemd override] ************************** 2026-04-28 02:53:26.789787 | orchestrator | Tuesday 28 April 2026 02:53:01 +0000 (0:00:01.175) 0:00:07.081 ********* 2026-04-28 02:53:26.789798 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:26.789810 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:26.789850 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:26.789862 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:26.789873 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:26.789906 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:26.789921 | orchestrator | 2026-04-28 02:53:26.789933 | orchestrator | TASK [ovn-controller : Check ovn-controller containers] ************************ 2026-04-28 02:53:26.789946 | orchestrator | Tuesday 28 April 2026 02:53:03 +0000 (0:00:01.646) 0:00:08.728 ********* 2026-04-28 02:53:26.789967 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:26.789980 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:26.789993 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:26.790005 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:26.790093 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:26.790106 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:53:26.790117 | orchestrator | 2026-04-28 02:53:26.790128 | orchestrator | TASK [ovn-controller : Create br-int bridge on OpenvSwitch] ******************** 2026-04-28 02:53:26.790139 | orchestrator | Tuesday 28 April 2026 02:53:04 +0000 (0:00:01.440) 0:00:10.169 ********* 2026-04-28 02:53:26.790150 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:53:26.790164 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:53:26.790175 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:53:26.790186 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:53:26.790196 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:53:26.790207 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:53:26.790217 | orchestrator | 2026-04-28 02:53:26.790229 | orchestrator | TASK [ovn-controller : Configure OVN in OVSDB] ********************************* 2026-04-28 02:53:26.790239 | orchestrator | Tuesday 28 April 2026 02:53:07 +0000 (0:00:02.560) 0:00:12.730 ********* 2026-04-28 02:53:26.790250 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.13'}) 2026-04-28 02:53:26.790262 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.14'}) 2026-04-28 02:53:26.790272 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.15'}) 2026-04-28 02:53:26.790283 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.10'}) 2026-04-28 02:53:26.790293 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.11'}) 2026-04-28 02:53:26.790304 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.12'}) 2026-04-28 02:53:26.790329 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-28 02:54:09.073527 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-28 02:54:09.073634 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-28 02:54:09.073643 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-28 02:54:09.073649 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-28 02:54:09.073655 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-28 02:54:09.073673 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}) 2026-04-28 02:54:09.073680 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}) 2026-04-28 02:54:09.073686 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}) 2026-04-28 02:54:09.073694 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}) 2026-04-28 02:54:09.073726 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}) 2026-04-28 02:54:09.073736 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}) 2026-04-28 02:54:09.073746 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-28 02:54:09.073756 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-28 02:54:09.073765 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-28 02:54:09.073773 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-28 02:54:09.073782 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-28 02:54:09.073792 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-28 02:54:09.073802 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-28 02:54:09.073811 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-28 02:54:09.073819 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-28 02:54:09.073827 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-28 02:54:09.073836 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-28 02:54:09.073844 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-28 02:54:09.073853 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-28 02:54:09.073861 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-28 02:54:09.073870 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-28 02:54:09.073879 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-28 02:54:09.073887 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-28 02:54:09.073896 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-28 02:54:09.073905 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'absent'}) 2026-04-28 02:54:09.073914 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'absent'}) 2026-04-28 02:54:09.073923 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'present'}) 2026-04-28 02:54:09.073932 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'absent'}) 2026-04-28 02:54:09.073940 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'present'}) 2026-04-28 02:54:09.073949 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'present'}) 2026-04-28 02:54:09.073958 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:71:3a:c3', 'state': 'present'}) 2026-04-28 02:54:09.073984 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:89:18:56', 'state': 'present'}) 2026-04-28 02:54:09.073994 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:52:c1:40', 'state': 'absent'}) 2026-04-28 02:54:09.074013 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:2f:fa:44', 'state': 'present'}) 2026-04-28 02:54:09.074057 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:33:12:50', 'state': 'absent'}) 2026-04-28 02:54:09.074072 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:29:4a:9b', 'state': 'absent'}) 2026-04-28 02:54:09.074080 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-cms-options', 'value': '', 'state': 'absent'}) 2026-04-28 02:54:09.074089 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-cms-options', 'value': '', 'state': 'absent'}) 2026-04-28 02:54:09.074098 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-cms-options', 'value': 'enable-chassis-as-gw,availability-zones=nova', 'state': 'present'}) 2026-04-28 02:54:09.074106 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-cms-options', 'value': '', 'state': 'absent'}) 2026-04-28 02:54:09.074114 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-cms-options', 'value': 'enable-chassis-as-gw,availability-zones=nova', 'state': 'present'}) 2026-04-28 02:54:09.074122 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-cms-options', 'value': 'enable-chassis-as-gw,availability-zones=nova', 'state': 'present'}) 2026-04-28 02:54:09.074131 | orchestrator | 2026-04-28 02:54:09.074141 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-28 02:54:09.074149 | orchestrator | Tuesday 28 April 2026 02:53:26 +0000 (0:00:18.739) 0:00:31.469 ********* 2026-04-28 02:54:09.074158 | orchestrator | 2026-04-28 02:54:09.074166 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-28 02:54:09.074175 | orchestrator | Tuesday 28 April 2026 02:53:26 +0000 (0:00:00.281) 0:00:31.751 ********* 2026-04-28 02:54:09.074183 | orchestrator | 2026-04-28 02:54:09.074191 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-28 02:54:09.074200 | orchestrator | Tuesday 28 April 2026 02:53:26 +0000 (0:00:00.066) 0:00:31.818 ********* 2026-04-28 02:54:09.074208 | orchestrator | 2026-04-28 02:54:09.074216 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-28 02:54:09.074230 | orchestrator | Tuesday 28 April 2026 02:53:26 +0000 (0:00:00.065) 0:00:31.883 ********* 2026-04-28 02:54:09.074240 | orchestrator | 2026-04-28 02:54:09.074249 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-28 02:54:09.074258 | orchestrator | Tuesday 28 April 2026 02:53:26 +0000 (0:00:00.068) 0:00:31.951 ********* 2026-04-28 02:54:09.074266 | orchestrator | 2026-04-28 02:54:09.074275 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-28 02:54:09.074283 | orchestrator | Tuesday 28 April 2026 02:53:26 +0000 (0:00:00.084) 0:00:32.036 ********* 2026-04-28 02:54:09.074291 | orchestrator | 2026-04-28 02:54:09.074299 | orchestrator | RUNNING HANDLER [ovn-controller : Reload systemd config] *********************** 2026-04-28 02:54:09.074308 | orchestrator | Tuesday 28 April 2026 02:53:26 +0000 (0:00:00.066) 0:00:32.102 ********* 2026-04-28 02:54:09.074317 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:54:09.074327 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:54:09.074336 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:54:09.074344 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:54:09.074352 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:54:09.074360 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:54:09.074369 | orchestrator | 2026-04-28 02:54:09.074378 | orchestrator | RUNNING HANDLER [ovn-controller : Restart ovn-controller container] ************ 2026-04-28 02:54:09.074387 | orchestrator | Tuesday 28 April 2026 02:53:28 +0000 (0:00:01.593) 0:00:33.696 ********* 2026-04-28 02:54:09.074395 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:54:09.074404 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:54:09.074413 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:54:09.074422 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:54:09.074431 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:54:09.074449 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:54:09.074458 | orchestrator | 2026-04-28 02:54:09.074466 | orchestrator | PLAY [Apply role ovn-db] ******************************************************* 2026-04-28 02:54:09.074475 | orchestrator | 2026-04-28 02:54:09.074484 | orchestrator | TASK [ovn-db : include_tasks] ************************************************** 2026-04-28 02:54:09.074492 | orchestrator | Tuesday 28 April 2026 02:54:06 +0000 (0:00:38.329) 0:01:12.026 ********* 2026-04-28 02:54:09.074501 | orchestrator | included: /ansible/roles/ovn-db/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:54:09.074511 | orchestrator | 2026-04-28 02:54:09.074519 | orchestrator | TASK [ovn-db : include_tasks] ************************************************** 2026-04-28 02:54:09.074528 | orchestrator | Tuesday 28 April 2026 02:54:07 +0000 (0:00:00.740) 0:01:12.767 ********* 2026-04-28 02:54:09.074654 | orchestrator | included: /ansible/roles/ovn-db/tasks/lookup_cluster.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:54:09.074678 | orchestrator | 2026-04-28 02:54:09.074688 | orchestrator | TASK [ovn-db : Checking for any existing OVN DB container volumes] ************* 2026-04-28 02:54:09.074697 | orchestrator | Tuesday 28 April 2026 02:54:08 +0000 (0:00:00.617) 0:01:13.385 ********* 2026-04-28 02:54:09.074706 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:54:09.074714 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:54:09.074723 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:54:09.074731 | orchestrator | 2026-04-28 02:54:09.074740 | orchestrator | TASK [ovn-db : Divide hosts by their OVN NB volume availability] *************** 2026-04-28 02:54:09.074764 | orchestrator | Tuesday 28 April 2026 02:54:09 +0000 (0:00:01.006) 0:01:14.391 ********* 2026-04-28 02:54:20.912788 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:54:20.912870 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:54:20.912877 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:54:20.912881 | orchestrator | 2026-04-28 02:54:20.912887 | orchestrator | TASK [ovn-db : Divide hosts by their OVN SB volume availability] *************** 2026-04-28 02:54:20.912892 | orchestrator | Tuesday 28 April 2026 02:54:09 +0000 (0:00:00.364) 0:01:14.756 ********* 2026-04-28 02:54:20.912896 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:54:20.912900 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:54:20.912904 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:54:20.912908 | orchestrator | 2026-04-28 02:54:20.912912 | orchestrator | TASK [ovn-db : Establish whether the OVN NB cluster has already existed] ******* 2026-04-28 02:54:20.912928 | orchestrator | Tuesday 28 April 2026 02:54:09 +0000 (0:00:00.362) 0:01:15.118 ********* 2026-04-28 02:54:20.912932 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:54:20.912936 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:54:20.912940 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:54:20.912943 | orchestrator | 2026-04-28 02:54:20.912947 | orchestrator | TASK [ovn-db : Establish whether the OVN SB cluster has already existed] ******* 2026-04-28 02:54:20.912951 | orchestrator | Tuesday 28 April 2026 02:54:10 +0000 (0:00:00.343) 0:01:15.462 ********* 2026-04-28 02:54:20.912955 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:54:20.912959 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:54:20.912962 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:54:20.912966 | orchestrator | 2026-04-28 02:54:20.912970 | orchestrator | TASK [ovn-db : Check if running on all OVN NB DB hosts] ************************ 2026-04-28 02:54:20.912974 | orchestrator | Tuesday 28 April 2026 02:54:10 +0000 (0:00:00.560) 0:01:16.022 ********* 2026-04-28 02:54:20.912978 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:54:20.912983 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:54:20.912987 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:54:20.912991 | orchestrator | 2026-04-28 02:54:20.912995 | orchestrator | TASK [ovn-db : Check OVN NB service port liveness] ***************************** 2026-04-28 02:54:20.912999 | orchestrator | Tuesday 28 April 2026 02:54:11 +0000 (0:00:00.354) 0:01:16.377 ********* 2026-04-28 02:54:20.913003 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:54:20.913006 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:54:20.913010 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:54:20.913030 | orchestrator | 2026-04-28 02:54:20.913034 | orchestrator | TASK [ovn-db : Divide hosts by their OVN NB service port liveness] ************* 2026-04-28 02:54:20.913038 | orchestrator | Tuesday 28 April 2026 02:54:11 +0000 (0:00:00.321) 0:01:16.699 ********* 2026-04-28 02:54:20.913041 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:54:20.913045 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:54:20.913049 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:54:20.913053 | orchestrator | 2026-04-28 02:54:20.913057 | orchestrator | TASK [ovn-db : Get OVN NB database information] ******************************** 2026-04-28 02:54:20.913060 | orchestrator | Tuesday 28 April 2026 02:54:11 +0000 (0:00:00.309) 0:01:17.008 ********* 2026-04-28 02:54:20.913064 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:54:20.913068 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:54:20.913072 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:54:20.913075 | orchestrator | 2026-04-28 02:54:20.913079 | orchestrator | TASK [ovn-db : Divide hosts by their OVN NB leader/follower role] ************** 2026-04-28 02:54:20.913083 | orchestrator | Tuesday 28 April 2026 02:54:11 +0000 (0:00:00.307) 0:01:17.316 ********* 2026-04-28 02:54:20.913087 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:54:20.913091 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:54:20.913094 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:54:20.913099 | orchestrator | 2026-04-28 02:54:20.913103 | orchestrator | TASK [ovn-db : Fail on existing OVN NB cluster with no leader] ***************** 2026-04-28 02:54:20.913106 | orchestrator | Tuesday 28 April 2026 02:54:12 +0000 (0:00:00.569) 0:01:17.885 ********* 2026-04-28 02:54:20.913110 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:54:20.913114 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:54:20.913118 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:54:20.913121 | orchestrator | 2026-04-28 02:54:20.913125 | orchestrator | TASK [ovn-db : Check if running on all OVN SB DB hosts] ************************ 2026-04-28 02:54:20.913129 | orchestrator | Tuesday 28 April 2026 02:54:12 +0000 (0:00:00.305) 0:01:18.191 ********* 2026-04-28 02:54:20.913133 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:54:20.913137 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:54:20.913140 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:54:20.913144 | orchestrator | 2026-04-28 02:54:20.913148 | orchestrator | TASK [ovn-db : Check OVN SB service port liveness] ***************************** 2026-04-28 02:54:20.913152 | orchestrator | Tuesday 28 April 2026 02:54:13 +0000 (0:00:00.335) 0:01:18.526 ********* 2026-04-28 02:54:20.913156 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:54:20.913159 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:54:20.913163 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:54:20.913167 | orchestrator | 2026-04-28 02:54:20.913171 | orchestrator | TASK [ovn-db : Divide hosts by their OVN SB service port liveness] ************* 2026-04-28 02:54:20.913174 | orchestrator | Tuesday 28 April 2026 02:54:13 +0000 (0:00:00.334) 0:01:18.861 ********* 2026-04-28 02:54:20.913178 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:54:20.913182 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:54:20.913186 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:54:20.913190 | orchestrator | 2026-04-28 02:54:20.913193 | orchestrator | TASK [ovn-db : Get OVN SB database information] ******************************** 2026-04-28 02:54:20.913197 | orchestrator | Tuesday 28 April 2026 02:54:14 +0000 (0:00:00.546) 0:01:19.407 ********* 2026-04-28 02:54:20.913201 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:54:20.913205 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:54:20.913208 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:54:20.913212 | orchestrator | 2026-04-28 02:54:20.913216 | orchestrator | TASK [ovn-db : Divide hosts by their OVN SB leader/follower role] ************** 2026-04-28 02:54:20.913220 | orchestrator | Tuesday 28 April 2026 02:54:14 +0000 (0:00:00.346) 0:01:19.754 ********* 2026-04-28 02:54:20.913224 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:54:20.913228 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:54:20.913232 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:54:20.913236 | orchestrator | 2026-04-28 02:54:20.913243 | orchestrator | TASK [ovn-db : Fail on existing OVN SB cluster with no leader] ***************** 2026-04-28 02:54:20.913247 | orchestrator | Tuesday 28 April 2026 02:54:14 +0000 (0:00:00.368) 0:01:20.122 ********* 2026-04-28 02:54:20.913260 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:54:20.913264 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:54:20.913268 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:54:20.913272 | orchestrator | 2026-04-28 02:54:20.913276 | orchestrator | TASK [ovn-db : include_tasks] ************************************************** 2026-04-28 02:54:20.913279 | orchestrator | Tuesday 28 April 2026 02:54:15 +0000 (0:00:00.316) 0:01:20.439 ********* 2026-04-28 02:54:20.913284 | orchestrator | included: /ansible/roles/ovn-db/tasks/bootstrap-initial.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 02:54:20.913288 | orchestrator | 2026-04-28 02:54:20.913292 | orchestrator | TASK [ovn-db : Set bootstrap args fact for NB (new cluster)] ******************* 2026-04-28 02:54:20.913299 | orchestrator | Tuesday 28 April 2026 02:54:15 +0000 (0:00:00.807) 0:01:21.246 ********* 2026-04-28 02:54:20.913303 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:54:20.913307 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:54:20.913310 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:54:20.913314 | orchestrator | 2026-04-28 02:54:20.913318 | orchestrator | TASK [ovn-db : Set bootstrap args fact for SB (new cluster)] ******************* 2026-04-28 02:54:20.913322 | orchestrator | Tuesday 28 April 2026 02:54:16 +0000 (0:00:00.457) 0:01:21.704 ********* 2026-04-28 02:54:20.913326 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:54:20.913329 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:54:20.913333 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:54:20.913337 | orchestrator | 2026-04-28 02:54:20.913341 | orchestrator | TASK [ovn-db : Check NB cluster status] **************************************** 2026-04-28 02:54:20.913345 | orchestrator | Tuesday 28 April 2026 02:54:16 +0000 (0:00:00.442) 0:01:22.147 ********* 2026-04-28 02:54:20.913349 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:54:20.913354 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:54:20.913358 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:54:20.913362 | orchestrator | 2026-04-28 02:54:20.913367 | orchestrator | TASK [ovn-db : Check SB cluster status] **************************************** 2026-04-28 02:54:20.913371 | orchestrator | Tuesday 28 April 2026 02:54:17 +0000 (0:00:00.546) 0:01:22.693 ********* 2026-04-28 02:54:20.913376 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:54:20.913380 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:54:20.913384 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:54:20.913389 | orchestrator | 2026-04-28 02:54:20.913393 | orchestrator | TASK [ovn-db : Remove an old node with the same ip address as the new node in NB DB] *** 2026-04-28 02:54:20.913397 | orchestrator | Tuesday 28 April 2026 02:54:17 +0000 (0:00:00.357) 0:01:23.051 ********* 2026-04-28 02:54:20.913402 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:54:20.913406 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:54:20.913410 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:54:20.913414 | orchestrator | 2026-04-28 02:54:20.913419 | orchestrator | TASK [ovn-db : Remove an old node with the same ip address as the new node in SB DB] *** 2026-04-28 02:54:20.913423 | orchestrator | Tuesday 28 April 2026 02:54:18 +0000 (0:00:00.375) 0:01:23.427 ********* 2026-04-28 02:54:20.913427 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:54:20.913432 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:54:20.913436 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:54:20.913440 | orchestrator | 2026-04-28 02:54:20.913445 | orchestrator | TASK [ovn-db : Set bootstrap args fact for NB (new member)] ******************** 2026-04-28 02:54:20.913449 | orchestrator | Tuesday 28 April 2026 02:54:18 +0000 (0:00:00.359) 0:01:23.787 ********* 2026-04-28 02:54:20.913453 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:54:20.913457 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:54:20.913461 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:54:20.913466 | orchestrator | 2026-04-28 02:54:20.913470 | orchestrator | TASK [ovn-db : Set bootstrap args fact for SB (new member)] ******************** 2026-04-28 02:54:20.913481 | orchestrator | Tuesday 28 April 2026 02:54:18 +0000 (0:00:00.354) 0:01:24.141 ********* 2026-04-28 02:54:20.913485 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:54:20.913490 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:54:20.913494 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:54:20.913498 | orchestrator | 2026-04-28 02:54:20.913503 | orchestrator | TASK [ovn-db : Ensuring config directories exist] ****************************** 2026-04-28 02:54:20.913510 | orchestrator | Tuesday 28 April 2026 02:54:19 +0000 (0:00:00.558) 0:01:24.700 ********* 2026-04-28 02:54:20.913536 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:20.913548 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:20.913554 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:20.913566 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:27.411849 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:27.411941 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:27.411952 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:27.411961 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:27.411968 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:27.411996 | orchestrator | 2026-04-28 02:54:27.412005 | orchestrator | TASK [ovn-db : Copying over config.json files for services] ******************** 2026-04-28 02:54:27.412014 | orchestrator | Tuesday 28 April 2026 02:54:20 +0000 (0:00:01.529) 0:01:26.230 ********* 2026-04-28 02:54:27.412023 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:27.412032 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:27.412039 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:27.412047 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:27.412069 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:27.412082 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:27.412090 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:27.412098 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:27.412111 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:27.412118 | orchestrator | 2026-04-28 02:54:27.412126 | orchestrator | TASK [ovn-db : Check ovn containers] ******************************************* 2026-04-28 02:54:27.412133 | orchestrator | Tuesday 28 April 2026 02:54:24 +0000 (0:00:03.943) 0:01:30.173 ********* 2026-04-28 02:54:27.412141 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:27.412148 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:27.412156 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:27.412163 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:27.412171 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:27.412189 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:52.314287 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:52.314377 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:52.314404 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:52.314412 | orchestrator | 2026-04-28 02:54:52.314421 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-28 02:54:52.314429 | orchestrator | Tuesday 28 April 2026 02:54:26 +0000 (0:00:02.106) 0:01:32.279 ********* 2026-04-28 02:54:52.314436 | orchestrator | 2026-04-28 02:54:52.314443 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-28 02:54:52.314450 | orchestrator | Tuesday 28 April 2026 02:54:27 +0000 (0:00:00.072) 0:01:32.351 ********* 2026-04-28 02:54:52.314457 | orchestrator | 2026-04-28 02:54:52.314464 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-28 02:54:52.314471 | orchestrator | Tuesday 28 April 2026 02:54:27 +0000 (0:00:00.307) 0:01:32.659 ********* 2026-04-28 02:54:52.314478 | orchestrator | 2026-04-28 02:54:52.314572 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-nb-db container] ************************* 2026-04-28 02:54:52.314577 | orchestrator | Tuesday 28 April 2026 02:54:27 +0000 (0:00:00.072) 0:01:32.732 ********* 2026-04-28 02:54:52.314582 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:54:52.314587 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:54:52.314592 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:54:52.314596 | orchestrator | 2026-04-28 02:54:52.314600 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-sb-db container] ************************* 2026-04-28 02:54:52.314604 | orchestrator | Tuesday 28 April 2026 02:54:30 +0000 (0:00:02.641) 0:01:35.373 ********* 2026-04-28 02:54:52.314608 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:54:52.314612 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:54:52.314616 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:54:52.314621 | orchestrator | 2026-04-28 02:54:52.314625 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-northd container] ************************ 2026-04-28 02:54:52.314629 | orchestrator | Tuesday 28 April 2026 02:54:37 +0000 (0:00:07.421) 0:01:42.795 ********* 2026-04-28 02:54:52.314633 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:54:52.314637 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:54:52.314641 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:54:52.314645 | orchestrator | 2026-04-28 02:54:52.314650 | orchestrator | TASK [ovn-db : Wait for leader election] *************************************** 2026-04-28 02:54:52.314654 | orchestrator | Tuesday 28 April 2026 02:54:44 +0000 (0:00:07.452) 0:01:50.247 ********* 2026-04-28 02:54:52.314658 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:54:52.314662 | orchestrator | 2026-04-28 02:54:52.314666 | orchestrator | TASK [ovn-db : Get OVN_Northbound cluster leader] ****************************** 2026-04-28 02:54:52.314670 | orchestrator | Tuesday 28 April 2026 02:54:45 +0000 (0:00:00.183) 0:01:50.430 ********* 2026-04-28 02:54:52.314674 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:54:52.314679 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:54:52.314683 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:54:52.314687 | orchestrator | 2026-04-28 02:54:52.314694 | orchestrator | TASK [ovn-db : Configure OVN NB connection settings] *************************** 2026-04-28 02:54:52.314701 | orchestrator | Tuesday 28 April 2026 02:54:46 +0000 (0:00:01.095) 0:01:51.526 ********* 2026-04-28 02:54:52.314707 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:54:52.314713 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:54:52.314721 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:54:52.314731 | orchestrator | 2026-04-28 02:54:52.314738 | orchestrator | TASK [ovn-db : Get OVN_Southbound cluster leader] ****************************** 2026-04-28 02:54:52.314745 | orchestrator | Tuesday 28 April 2026 02:54:46 +0000 (0:00:00.647) 0:01:52.174 ********* 2026-04-28 02:54:52.314760 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:54:52.314766 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:54:52.314773 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:54:52.314780 | orchestrator | 2026-04-28 02:54:52.314787 | orchestrator | TASK [ovn-db : Configure OVN SB connection settings] *************************** 2026-04-28 02:54:52.314794 | orchestrator | Tuesday 28 April 2026 02:54:47 +0000 (0:00:00.806) 0:01:52.980 ********* 2026-04-28 02:54:52.314801 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:54:52.314809 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:54:52.314816 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:54:52.314823 | orchestrator | 2026-04-28 02:54:52.314831 | orchestrator | TASK [ovn-db : Wait for ovn-nb-db] ********************************************* 2026-04-28 02:54:52.314852 | orchestrator | Tuesday 28 April 2026 02:54:48 +0000 (0:00:00.647) 0:01:53.628 ********* 2026-04-28 02:54:52.314860 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:54:52.314867 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:54:52.314890 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:54:52.314898 | orchestrator | 2026-04-28 02:54:52.314906 | orchestrator | TASK [ovn-db : Wait for ovn-sb-db] ********************************************* 2026-04-28 02:54:52.314913 | orchestrator | Tuesday 28 April 2026 02:54:49 +0000 (0:00:01.393) 0:01:55.022 ********* 2026-04-28 02:54:52.314921 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:54:52.314928 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:54:52.314935 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:54:52.314942 | orchestrator | 2026-04-28 02:54:52.314949 | orchestrator | TASK [ovn-db : Unset bootstrap args fact] ************************************** 2026-04-28 02:54:52.314956 | orchestrator | Tuesday 28 April 2026 02:54:50 +0000 (0:00:00.851) 0:01:55.874 ********* 2026-04-28 02:54:52.314963 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:54:52.314971 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:54:52.314978 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:54:52.314985 | orchestrator | 2026-04-28 02:54:52.314992 | orchestrator | TASK [ovn-db : Ensuring config directories exist] ****************************** 2026-04-28 02:54:52.314999 | orchestrator | Tuesday 28 April 2026 02:54:50 +0000 (0:00:00.320) 0:01:56.194 ********* 2026-04-28 02:54:52.315008 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:52.315017 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:52.315025 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:52.315033 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:52.315041 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:52.315055 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:52.315063 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:52.315070 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:52.315090 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:59.748326 | orchestrator | 2026-04-28 02:54:59.748427 | orchestrator | TASK [ovn-db : Copying over config.json files for services] ******************** 2026-04-28 02:54:59.748441 | orchestrator | Tuesday 28 April 2026 02:54:52 +0000 (0:00:01.435) 0:01:57.630 ********* 2026-04-28 02:54:59.748454 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:59.748464 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:59.748532 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:59.748546 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:59.748558 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:59.748591 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:59.748601 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:59.748611 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:59.748635 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:59.748646 | orchestrator | 2026-04-28 02:54:59.748654 | orchestrator | TASK [ovn-db : Check ovn containers] ******************************************* 2026-04-28 02:54:59.748663 | orchestrator | Tuesday 28 April 2026 02:54:56 +0000 (0:00:03.993) 0:02:01.624 ********* 2026-04-28 02:54:59.748691 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:59.748701 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:59.748710 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:59.748719 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:59.748729 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:59.748745 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:59.748755 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:59.748764 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:59.748774 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 02:54:59.748783 | orchestrator | 2026-04-28 02:54:59.748792 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-28 02:54:59.748801 | orchestrator | Tuesday 28 April 2026 02:54:59 +0000 (0:00:03.221) 0:02:04.845 ********* 2026-04-28 02:54:59.748809 | orchestrator | 2026-04-28 02:54:59.748823 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-28 02:54:59.748832 | orchestrator | Tuesday 28 April 2026 02:54:59 +0000 (0:00:00.075) 0:02:04.920 ********* 2026-04-28 02:54:59.748840 | orchestrator | 2026-04-28 02:54:59.748849 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-28 02:54:59.748859 | orchestrator | Tuesday 28 April 2026 02:54:59 +0000 (0:00:00.069) 0:02:04.989 ********* 2026-04-28 02:54:59.748869 | orchestrator | 2026-04-28 02:54:59.748884 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-nb-db container] ************************* 2026-04-28 02:55:24.444693 | orchestrator | Tuesday 28 April 2026 02:54:59 +0000 (0:00:00.067) 0:02:05.056 ********* 2026-04-28 02:55:24.444777 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:55:24.444786 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:55:24.444792 | orchestrator | 2026-04-28 02:55:24.444797 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-sb-db container] ************************* 2026-04-28 02:55:24.444802 | orchestrator | Tuesday 28 April 2026 02:55:06 +0000 (0:00:06.287) 0:02:11.344 ********* 2026-04-28 02:55:24.444807 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:55:24.444812 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:55:24.444817 | orchestrator | 2026-04-28 02:55:24.444822 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-northd container] ************************ 2026-04-28 02:55:24.444827 | orchestrator | Tuesday 28 April 2026 02:55:12 +0000 (0:00:06.219) 0:02:17.564 ********* 2026-04-28 02:55:24.444832 | orchestrator | changed: [testbed-node-1] 2026-04-28 02:55:24.444837 | orchestrator | changed: [testbed-node-2] 2026-04-28 02:55:24.444858 | orchestrator | 2026-04-28 02:55:24.444863 | orchestrator | TASK [ovn-db : Wait for leader election] *************************************** 2026-04-28 02:55:24.444868 | orchestrator | Tuesday 28 April 2026 02:55:18 +0000 (0:00:06.278) 0:02:23.842 ********* 2026-04-28 02:55:24.444873 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:55:24.444878 | orchestrator | 2026-04-28 02:55:24.444883 | orchestrator | TASK [ovn-db : Get OVN_Northbound cluster leader] ****************************** 2026-04-28 02:55:24.444887 | orchestrator | Tuesday 28 April 2026 02:55:18 +0000 (0:00:00.157) 0:02:23.999 ********* 2026-04-28 02:55:24.444892 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:55:24.444898 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:55:24.444902 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:55:24.444907 | orchestrator | 2026-04-28 02:55:24.444912 | orchestrator | TASK [ovn-db : Configure OVN NB connection settings] *************************** 2026-04-28 02:55:24.444917 | orchestrator | Tuesday 28 April 2026 02:55:19 +0000 (0:00:01.091) 0:02:25.091 ********* 2026-04-28 02:55:24.444921 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:55:24.444926 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:55:24.444931 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:55:24.444935 | orchestrator | 2026-04-28 02:55:24.444940 | orchestrator | TASK [ovn-db : Get OVN_Southbound cluster leader] ****************************** 2026-04-28 02:55:24.444945 | orchestrator | Tuesday 28 April 2026 02:55:20 +0000 (0:00:00.639) 0:02:25.730 ********* 2026-04-28 02:55:24.444949 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:55:24.444954 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:55:24.444959 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:55:24.444964 | orchestrator | 2026-04-28 02:55:24.444969 | orchestrator | TASK [ovn-db : Configure OVN SB connection settings] *************************** 2026-04-28 02:55:24.444973 | orchestrator | Tuesday 28 April 2026 02:55:21 +0000 (0:00:00.835) 0:02:26.565 ********* 2026-04-28 02:55:24.444978 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:55:24.444982 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:55:24.444987 | orchestrator | changed: [testbed-node-0] 2026-04-28 02:55:24.444991 | orchestrator | 2026-04-28 02:55:24.445004 | orchestrator | TASK [ovn-db : Wait for ovn-nb-db] ********************************************* 2026-04-28 02:55:24.445009 | orchestrator | Tuesday 28 April 2026 02:55:21 +0000 (0:00:00.638) 0:02:27.203 ********* 2026-04-28 02:55:24.445013 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:55:24.445018 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:55:24.445023 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:55:24.445028 | orchestrator | 2026-04-28 02:55:24.445032 | orchestrator | TASK [ovn-db : Wait for ovn-sb-db] ********************************************* 2026-04-28 02:55:24.445037 | orchestrator | Tuesday 28 April 2026 02:55:22 +0000 (0:00:01.094) 0:02:28.298 ********* 2026-04-28 02:55:24.445041 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:55:24.445046 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:55:24.445051 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:55:24.445056 | orchestrator | 2026-04-28 02:55:24.445064 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:55:24.445072 | orchestrator | testbed-node-0 : ok=44  changed=18  unreachable=0 failed=0 skipped=20  rescued=0 ignored=0 2026-04-28 02:55:24.445080 | orchestrator | testbed-node-1 : ok=43  changed=19  unreachable=0 failed=0 skipped=22  rescued=0 ignored=0 2026-04-28 02:55:24.445087 | orchestrator | testbed-node-2 : ok=43  changed=19  unreachable=0 failed=0 skipped=22  rescued=0 ignored=0 2026-04-28 02:55:24.445094 | orchestrator | testbed-node-3 : ok=12  changed=8  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:55:24.445101 | orchestrator | testbed-node-4 : ok=12  changed=8  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:55:24.445108 | orchestrator | testbed-node-5 : ok=12  changed=8  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 02:55:24.445123 | orchestrator | 2026-04-28 02:55:24.445129 | orchestrator | 2026-04-28 02:55:24.445136 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:55:24.445142 | orchestrator | Tuesday 28 April 2026 02:55:23 +0000 (0:00:00.957) 0:02:29.256 ********* 2026-04-28 02:55:24.445149 | orchestrator | =============================================================================== 2026-04-28 02:55:24.445170 | orchestrator | ovn-controller : Restart ovn-controller container ---------------------- 38.33s 2026-04-28 02:55:24.445188 | orchestrator | ovn-controller : Configure OVN in OVSDB -------------------------------- 18.74s 2026-04-28 02:55:24.445195 | orchestrator | ovn-db : Restart ovn-northd container ---------------------------------- 13.73s 2026-04-28 02:55:24.445203 | orchestrator | ovn-db : Restart ovn-sb-db container ----------------------------------- 13.64s 2026-04-28 02:55:24.445210 | orchestrator | ovn-db : Restart ovn-nb-db container ------------------------------------ 8.93s 2026-04-28 02:55:24.445242 | orchestrator | ovn-db : Copying over config.json files for services -------------------- 3.99s 2026-04-28 02:55:24.445251 | orchestrator | ovn-db : Copying over config.json files for services -------------------- 3.94s 2026-04-28 02:55:24.445260 | orchestrator | ovn-db : Check ovn containers ------------------------------------------- 3.22s 2026-04-28 02:55:24.445266 | orchestrator | ovn-controller : Create br-int bridge on OpenvSwitch -------------------- 2.56s 2026-04-28 02:55:24.445271 | orchestrator | ovn-db : Check ovn containers ------------------------------------------- 2.11s 2026-04-28 02:55:24.445279 | orchestrator | ovn-controller : Copying over systemd override -------------------------- 1.65s 2026-04-28 02:55:24.445286 | orchestrator | ovn-controller : Reload systemd config ---------------------------------- 1.59s 2026-04-28 02:55:24.445293 | orchestrator | ovn-controller : Copying over config.json files for services ------------ 1.53s 2026-04-28 02:55:24.445300 | orchestrator | ovn-db : Ensuring config directories exist ------------------------------ 1.53s 2026-04-28 02:55:24.445307 | orchestrator | ovn-controller : Check ovn-controller containers ------------------------ 1.44s 2026-04-28 02:55:24.445314 | orchestrator | ovn-db : Ensuring config directories exist ------------------------------ 1.44s 2026-04-28 02:55:24.445322 | orchestrator | ovn-db : Wait for ovn-nb-db --------------------------------------------- 1.39s 2026-04-28 02:55:24.445329 | orchestrator | ovn-controller : Ensuring config directories exist ---------------------- 1.31s 2026-04-28 02:55:24.445336 | orchestrator | ovn-controller : include_tasks ------------------------------------------ 1.22s 2026-04-28 02:55:24.445344 | orchestrator | ovn-controller : Ensuring systemd override directory exists ------------- 1.18s 2026-04-28 02:55:24.851958 | orchestrator | + [[ ceph-ansible == \c\e\p\h\-\a\n\s\i\b\l\e ]] 2026-04-28 02:55:24.852064 | orchestrator | + sh -c /opt/configuration/scripts/deploy/100-ceph-with-ansible.sh 2026-04-28 02:55:27.218703 | orchestrator | 2026-04-28 02:55:27 | INFO  | Trying to run play wipe-partitions in environment custom 2026-04-28 02:55:37.350567 | orchestrator | 2026-04-28 02:55:37 | INFO  | Task 2fd1a4cf-0e84-4725-ac50-e794c494d5a0 (wipe-partitions) was prepared for execution. 2026-04-28 02:55:37.350645 | orchestrator | 2026-04-28 02:55:37 | INFO  | It takes a moment until task 2fd1a4cf-0e84-4725-ac50-e794c494d5a0 (wipe-partitions) has been started and output is visible here. 2026-04-28 02:55:50.878350 | orchestrator | 2026-04-28 02:55:50.878471 | orchestrator | PLAY [Wipe partitions] ********************************************************* 2026-04-28 02:55:50.878482 | orchestrator | 2026-04-28 02:55:50.878490 | orchestrator | TASK [Find all logical devices owned by UID 167] ******************************* 2026-04-28 02:55:50.878499 | orchestrator | Tuesday 28 April 2026 02:55:42 +0000 (0:00:00.145) 0:00:00.145 ********* 2026-04-28 02:55:50.878508 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:55:50.878519 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:55:50.878527 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:55:50.878536 | orchestrator | 2026-04-28 02:55:50.878544 | orchestrator | TASK [Remove all rook related logical devices] ********************************* 2026-04-28 02:55:50.878576 | orchestrator | Tuesday 28 April 2026 02:55:42 +0000 (0:00:00.628) 0:00:00.773 ********* 2026-04-28 02:55:50.878585 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:55:50.878594 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:55:50.878602 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:55:50.878611 | orchestrator | 2026-04-28 02:55:50.878620 | orchestrator | TASK [Find all logical devices with prefix ceph] ******************************* 2026-04-28 02:55:50.878626 | orchestrator | Tuesday 28 April 2026 02:55:43 +0000 (0:00:00.422) 0:00:01.196 ********* 2026-04-28 02:55:50.878631 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:55:50.878637 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:55:50.878642 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:55:50.878647 | orchestrator | 2026-04-28 02:55:50.878652 | orchestrator | TASK [Remove all ceph related logical devices] ********************************* 2026-04-28 02:55:50.878658 | orchestrator | Tuesday 28 April 2026 02:55:43 +0000 (0:00:00.618) 0:00:01.815 ********* 2026-04-28 02:55:50.878663 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:55:50.878668 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:55:50.878673 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:55:50.878678 | orchestrator | 2026-04-28 02:55:50.878684 | orchestrator | TASK [Check device availability] *********************************************** 2026-04-28 02:55:50.878690 | orchestrator | Tuesday 28 April 2026 02:55:43 +0000 (0:00:00.300) 0:00:02.115 ********* 2026-04-28 02:55:50.878695 | orchestrator | changed: [testbed-node-3] => (item=/dev/sdb) 2026-04-28 02:55:50.878701 | orchestrator | changed: [testbed-node-4] => (item=/dev/sdb) 2026-04-28 02:55:50.878706 | orchestrator | changed: [testbed-node-5] => (item=/dev/sdb) 2026-04-28 02:55:50.878711 | orchestrator | changed: [testbed-node-3] => (item=/dev/sdc) 2026-04-28 02:55:50.878716 | orchestrator | changed: [testbed-node-4] => (item=/dev/sdc) 2026-04-28 02:55:50.878721 | orchestrator | changed: [testbed-node-5] => (item=/dev/sdc) 2026-04-28 02:55:50.878726 | orchestrator | changed: [testbed-node-3] => (item=/dev/sdd) 2026-04-28 02:55:50.878731 | orchestrator | changed: [testbed-node-4] => (item=/dev/sdd) 2026-04-28 02:55:50.878736 | orchestrator | changed: [testbed-node-5] => (item=/dev/sdd) 2026-04-28 02:55:50.878741 | orchestrator | 2026-04-28 02:55:50.878746 | orchestrator | TASK [Wipe partitions with wipefs] ********************************************* 2026-04-28 02:55:50.878764 | orchestrator | Tuesday 28 April 2026 02:55:45 +0000 (0:00:01.290) 0:00:03.406 ********* 2026-04-28 02:55:50.878769 | orchestrator | ok: [testbed-node-3] => (item=/dev/sdb) 2026-04-28 02:55:50.878774 | orchestrator | ok: [testbed-node-4] => (item=/dev/sdb) 2026-04-28 02:55:50.878780 | orchestrator | ok: [testbed-node-5] => (item=/dev/sdb) 2026-04-28 02:55:50.878785 | orchestrator | ok: [testbed-node-3] => (item=/dev/sdc) 2026-04-28 02:55:50.878790 | orchestrator | ok: [testbed-node-4] => (item=/dev/sdc) 2026-04-28 02:55:50.878795 | orchestrator | ok: [testbed-node-5] => (item=/dev/sdc) 2026-04-28 02:55:50.878800 | orchestrator | ok: [testbed-node-3] => (item=/dev/sdd) 2026-04-28 02:55:50.878805 | orchestrator | ok: [testbed-node-4] => (item=/dev/sdd) 2026-04-28 02:55:50.878810 | orchestrator | ok: [testbed-node-5] => (item=/dev/sdd) 2026-04-28 02:55:50.878818 | orchestrator | 2026-04-28 02:55:50.878827 | orchestrator | TASK [Overwrite first 32M with zeros] ****************************************** 2026-04-28 02:55:50.878835 | orchestrator | Tuesday 28 April 2026 02:55:46 +0000 (0:00:01.659) 0:00:05.065 ********* 2026-04-28 02:55:50.878843 | orchestrator | changed: [testbed-node-3] => (item=/dev/sdb) 2026-04-28 02:55:50.878851 | orchestrator | changed: [testbed-node-4] => (item=/dev/sdb) 2026-04-28 02:55:50.878859 | orchestrator | changed: [testbed-node-5] => (item=/dev/sdb) 2026-04-28 02:55:50.878868 | orchestrator | changed: [testbed-node-3] => (item=/dev/sdc) 2026-04-28 02:55:50.878877 | orchestrator | changed: [testbed-node-4] => (item=/dev/sdc) 2026-04-28 02:55:50.878886 | orchestrator | changed: [testbed-node-5] => (item=/dev/sdc) 2026-04-28 02:55:50.878893 | orchestrator | changed: [testbed-node-3] => (item=/dev/sdd) 2026-04-28 02:55:50.878899 | orchestrator | changed: [testbed-node-4] => (item=/dev/sdd) 2026-04-28 02:55:50.878911 | orchestrator | changed: [testbed-node-5] => (item=/dev/sdd) 2026-04-28 02:55:50.878917 | orchestrator | 2026-04-28 02:55:50.878923 | orchestrator | TASK [Reload udev rules] ******************************************************* 2026-04-28 02:55:50.878929 | orchestrator | Tuesday 28 April 2026 02:55:49 +0000 (0:00:02.186) 0:00:07.252 ********* 2026-04-28 02:55:50.878934 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:55:50.878949 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:55:50.878955 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:55:50.878961 | orchestrator | 2026-04-28 02:55:50.878972 | orchestrator | TASK [Request device events from the kernel] *********************************** 2026-04-28 02:55:50.878978 | orchestrator | Tuesday 28 April 2026 02:55:49 +0000 (0:00:00.636) 0:00:07.888 ********* 2026-04-28 02:55:50.878984 | orchestrator | changed: [testbed-node-3] 2026-04-28 02:55:50.878989 | orchestrator | changed: [testbed-node-4] 2026-04-28 02:55:50.878996 | orchestrator | changed: [testbed-node-5] 2026-04-28 02:55:50.879001 | orchestrator | 2026-04-28 02:55:50.879008 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:55:50.879015 | orchestrator | testbed-node-3 : ok=7  changed=5  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:55:50.879022 | orchestrator | testbed-node-4 : ok=7  changed=5  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:55:50.879041 | orchestrator | testbed-node-5 : ok=7  changed=5  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:55:50.879047 | orchestrator | 2026-04-28 02:55:50.879052 | orchestrator | 2026-04-28 02:55:50.879057 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:55:50.879063 | orchestrator | Tuesday 28 April 2026 02:55:50 +0000 (0:00:00.693) 0:00:08.582 ********* 2026-04-28 02:55:50.879068 | orchestrator | =============================================================================== 2026-04-28 02:55:50.879073 | orchestrator | Overwrite first 32M with zeros ------------------------------------------ 2.19s 2026-04-28 02:55:50.879078 | orchestrator | Wipe partitions with wipefs --------------------------------------------- 1.66s 2026-04-28 02:55:50.879083 | orchestrator | Check device availability ----------------------------------------------- 1.29s 2026-04-28 02:55:50.879088 | orchestrator | Request device events from the kernel ----------------------------------- 0.69s 2026-04-28 02:55:50.879093 | orchestrator | Reload udev rules ------------------------------------------------------- 0.64s 2026-04-28 02:55:50.879098 | orchestrator | Find all logical devices owned by UID 167 ------------------------------- 0.63s 2026-04-28 02:55:50.879103 | orchestrator | Find all logical devices with prefix ceph ------------------------------- 0.62s 2026-04-28 02:55:50.879108 | orchestrator | Remove all rook related logical devices --------------------------------- 0.42s 2026-04-28 02:55:50.879113 | orchestrator | Remove all ceph related logical devices --------------------------------- 0.30s 2026-04-28 02:56:03.571375 | orchestrator | 2026-04-28 02:56:03 | INFO  | Task f5937157-8834-4925-a3cd-87bfb4ed70c8 (facts) was prepared for execution. 2026-04-28 02:56:03.571470 | orchestrator | 2026-04-28 02:56:03 | INFO  | It takes a moment until task f5937157-8834-4925-a3cd-87bfb4ed70c8 (facts) has been started and output is visible here. 2026-04-28 02:56:17.732152 | orchestrator | 2026-04-28 02:56:17.732273 | orchestrator | PLAY [Apply role facts] ******************************************************** 2026-04-28 02:56:17.732292 | orchestrator | 2026-04-28 02:56:17.732303 | orchestrator | TASK [osism.commons.facts : Create custom facts directory] ********************* 2026-04-28 02:56:17.732316 | orchestrator | Tuesday 28 April 2026 02:56:08 +0000 (0:00:00.325) 0:00:00.325 ********* 2026-04-28 02:56:17.732326 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:56:17.732338 | orchestrator | ok: [testbed-manager] 2026-04-28 02:56:17.732344 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:56:17.732351 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:56:17.732430 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:56:17.732439 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:56:17.732445 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:56:17.732451 | orchestrator | 2026-04-28 02:56:17.732458 | orchestrator | TASK [osism.commons.facts : Copy fact files] *********************************** 2026-04-28 02:56:17.732477 | orchestrator | Tuesday 28 April 2026 02:56:09 +0000 (0:00:01.265) 0:00:01.591 ********* 2026-04-28 02:56:17.732484 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:56:17.732492 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:56:17.732499 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:56:17.732505 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:56:17.732511 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:17.732517 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:17.732524 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:56:17.732530 | orchestrator | 2026-04-28 02:56:17.732536 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-28 02:56:17.732542 | orchestrator | 2026-04-28 02:56:17.732549 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-28 02:56:17.732555 | orchestrator | Tuesday 28 April 2026 02:56:11 +0000 (0:00:01.419) 0:00:03.011 ********* 2026-04-28 02:56:17.732561 | orchestrator | ok: [testbed-node-0] 2026-04-28 02:56:17.732567 | orchestrator | ok: [testbed-node-1] 2026-04-28 02:56:17.732573 | orchestrator | ok: [testbed-node-2] 2026-04-28 02:56:17.732580 | orchestrator | ok: [testbed-manager] 2026-04-28 02:56:17.732586 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:56:17.732592 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:56:17.732598 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:56:17.732604 | orchestrator | 2026-04-28 02:56:17.732611 | orchestrator | PLAY [Gather facts for all hosts if using --limit] ***************************** 2026-04-28 02:56:17.732617 | orchestrator | 2026-04-28 02:56:17.732623 | orchestrator | TASK [Gather facts for all hosts] ********************************************** 2026-04-28 02:56:17.732629 | orchestrator | Tuesday 28 April 2026 02:56:16 +0000 (0:00:05.315) 0:00:08.326 ********* 2026-04-28 02:56:17.732635 | orchestrator | skipping: [testbed-manager] 2026-04-28 02:56:17.732642 | orchestrator | skipping: [testbed-node-0] 2026-04-28 02:56:17.732648 | orchestrator | skipping: [testbed-node-1] 2026-04-28 02:56:17.732654 | orchestrator | skipping: [testbed-node-2] 2026-04-28 02:56:17.732660 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:17.732666 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:17.732675 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:56:17.732686 | orchestrator | 2026-04-28 02:56:17.732695 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:56:17.732706 | orchestrator | testbed-manager : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:56:17.732719 | orchestrator | testbed-node-0 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:56:17.732729 | orchestrator | testbed-node-1 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:56:17.732738 | orchestrator | testbed-node-2 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:56:17.732749 | orchestrator | testbed-node-3 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:56:17.732759 | orchestrator | testbed-node-4 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:56:17.732770 | orchestrator | testbed-node-5 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 02:56:17.732780 | orchestrator | 2026-04-28 02:56:17.732792 | orchestrator | 2026-04-28 02:56:17.732803 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:56:17.732826 | orchestrator | Tuesday 28 April 2026 02:56:17 +0000 (0:00:00.605) 0:00:08.932 ********* 2026-04-28 02:56:17.732834 | orchestrator | =============================================================================== 2026-04-28 02:56:17.732841 | orchestrator | Gathers facts about hosts ----------------------------------------------- 5.32s 2026-04-28 02:56:17.732849 | orchestrator | osism.commons.facts : Copy fact files ----------------------------------- 1.42s 2026-04-28 02:56:17.732855 | orchestrator | osism.commons.facts : Create custom facts directory --------------------- 1.27s 2026-04-28 02:56:17.732862 | orchestrator | Gather facts for all hosts ---------------------------------------------- 0.61s 2026-04-28 02:56:20.620598 | orchestrator | 2026-04-28 02:56:20 | INFO  | Task 3c90b767-2f6c-460a-825f-a34299f909c5 (ceph-configure-lvm-volumes) was prepared for execution. 2026-04-28 02:56:20.620679 | orchestrator | 2026-04-28 02:56:20 | INFO  | It takes a moment until task 3c90b767-2f6c-460a-825f-a34299f909c5 (ceph-configure-lvm-volumes) has been started and output is visible here. 2026-04-28 02:56:34.545404 | orchestrator | [WARNING]: Collection community.general does not support Ansible version 2026-04-28 02:56:34.545486 | orchestrator | 2.16.14 2026-04-28 02:56:34.545497 | orchestrator | 2026-04-28 02:56:34.545505 | orchestrator | PLAY [Ceph configure LVM] ****************************************************** 2026-04-28 02:56:34.545513 | orchestrator | 2026-04-28 02:56:34.545521 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-28 02:56:34.545528 | orchestrator | Tuesday 28 April 2026 02:56:26 +0000 (0:00:00.402) 0:00:00.402 ********* 2026-04-28 02:56:34.545536 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-28 02:56:34.545541 | orchestrator | 2026-04-28 02:56:34.545545 | orchestrator | TASK [Get initial list of available block devices] ***************************** 2026-04-28 02:56:34.545549 | orchestrator | Tuesday 28 April 2026 02:56:26 +0000 (0:00:00.272) 0:00:00.674 ********* 2026-04-28 02:56:34.545553 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:56:34.545558 | orchestrator | 2026-04-28 02:56:34.545562 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:34.545566 | orchestrator | Tuesday 28 April 2026 02:56:26 +0000 (0:00:00.242) 0:00:00.917 ********* 2026-04-28 02:56:34.545570 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop0) 2026-04-28 02:56:34.545574 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop1) 2026-04-28 02:56:34.545579 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop2) 2026-04-28 02:56:34.545582 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop3) 2026-04-28 02:56:34.545586 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop4) 2026-04-28 02:56:34.545590 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop5) 2026-04-28 02:56:34.545594 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop6) 2026-04-28 02:56:34.545598 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop7) 2026-04-28 02:56:34.545602 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sda) 2026-04-28 02:56:34.545606 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sdb) 2026-04-28 02:56:34.545609 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sdc) 2026-04-28 02:56:34.545613 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sdd) 2026-04-28 02:56:34.545619 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sr0) 2026-04-28 02:56:34.545624 | orchestrator | 2026-04-28 02:56:34.545630 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:34.545636 | orchestrator | Tuesday 28 April 2026 02:56:27 +0000 (0:00:00.595) 0:00:01.512 ********* 2026-04-28 02:56:34.545665 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:34.545672 | orchestrator | 2026-04-28 02:56:34.545679 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:34.545684 | orchestrator | Tuesday 28 April 2026 02:56:27 +0000 (0:00:00.231) 0:00:01.744 ********* 2026-04-28 02:56:34.545687 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:34.545691 | orchestrator | 2026-04-28 02:56:34.545695 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:34.545698 | orchestrator | Tuesday 28 April 2026 02:56:27 +0000 (0:00:00.234) 0:00:01.979 ********* 2026-04-28 02:56:34.545702 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:34.545706 | orchestrator | 2026-04-28 02:56:34.545710 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:34.545714 | orchestrator | Tuesday 28 April 2026 02:56:27 +0000 (0:00:00.225) 0:00:02.204 ********* 2026-04-28 02:56:34.545717 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:34.545721 | orchestrator | 2026-04-28 02:56:34.545725 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:34.545728 | orchestrator | Tuesday 28 April 2026 02:56:28 +0000 (0:00:00.215) 0:00:02.419 ********* 2026-04-28 02:56:34.545732 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:34.545736 | orchestrator | 2026-04-28 02:56:34.545775 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:34.545780 | orchestrator | Tuesday 28 April 2026 02:56:28 +0000 (0:00:00.223) 0:00:02.643 ********* 2026-04-28 02:56:34.545784 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:34.545787 | orchestrator | 2026-04-28 02:56:34.545791 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:34.545795 | orchestrator | Tuesday 28 April 2026 02:56:28 +0000 (0:00:00.273) 0:00:02.916 ********* 2026-04-28 02:56:34.545799 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:34.545802 | orchestrator | 2026-04-28 02:56:34.545806 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:34.545810 | orchestrator | Tuesday 28 April 2026 02:56:28 +0000 (0:00:00.243) 0:00:03.160 ********* 2026-04-28 02:56:34.545814 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:34.545817 | orchestrator | 2026-04-28 02:56:34.545823 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:34.545829 | orchestrator | Tuesday 28 April 2026 02:56:29 +0000 (0:00:00.220) 0:00:03.381 ********* 2026-04-28 02:56:34.545835 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e) 2026-04-28 02:56:34.545842 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e) 2026-04-28 02:56:34.545848 | orchestrator | 2026-04-28 02:56:34.545855 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:34.545874 | orchestrator | Tuesday 28 April 2026 02:56:29 +0000 (0:00:00.498) 0:00:03.879 ********* 2026-04-28 02:56:34.545882 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202) 2026-04-28 02:56:34.545886 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202) 2026-04-28 02:56:34.545890 | orchestrator | 2026-04-28 02:56:34.545894 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:34.545897 | orchestrator | Tuesday 28 April 2026 02:56:30 +0000 (0:00:00.723) 0:00:04.603 ********* 2026-04-28 02:56:34.545901 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675) 2026-04-28 02:56:34.545905 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675) 2026-04-28 02:56:34.545909 | orchestrator | 2026-04-28 02:56:34.545913 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:34.545920 | orchestrator | Tuesday 28 April 2026 02:56:31 +0000 (0:00:00.772) 0:00:05.375 ********* 2026-04-28 02:56:34.545930 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c) 2026-04-28 02:56:34.545934 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c) 2026-04-28 02:56:34.545937 | orchestrator | 2026-04-28 02:56:34.545941 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:34.545945 | orchestrator | Tuesday 28 April 2026 02:56:32 +0000 (0:00:01.071) 0:00:06.447 ********* 2026-04-28 02:56:34.545949 | orchestrator | ok: [testbed-node-3] => (item=ata-QEMU_DVD-ROM_QM00001) 2026-04-28 02:56:34.545952 | orchestrator | 2026-04-28 02:56:34.545956 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:34.545960 | orchestrator | Tuesday 28 April 2026 02:56:32 +0000 (0:00:00.383) 0:00:06.831 ********* 2026-04-28 02:56:34.545964 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop0) 2026-04-28 02:56:34.545968 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop1) 2026-04-28 02:56:34.545972 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop2) 2026-04-28 02:56:34.545975 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop3) 2026-04-28 02:56:34.545979 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop4) 2026-04-28 02:56:34.545983 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop5) 2026-04-28 02:56:34.545987 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop6) 2026-04-28 02:56:34.545990 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop7) 2026-04-28 02:56:34.545994 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sda) 2026-04-28 02:56:34.546009 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sdb) 2026-04-28 02:56:34.546013 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sdc) 2026-04-28 02:56:34.546064 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sdd) 2026-04-28 02:56:34.546068 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sr0) 2026-04-28 02:56:34.546072 | orchestrator | 2026-04-28 02:56:34.546075 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:34.546079 | orchestrator | Tuesday 28 April 2026 02:56:32 +0000 (0:00:00.449) 0:00:07.281 ********* 2026-04-28 02:56:34.546083 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:34.546087 | orchestrator | 2026-04-28 02:56:34.546090 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:34.546094 | orchestrator | Tuesday 28 April 2026 02:56:33 +0000 (0:00:00.220) 0:00:07.501 ********* 2026-04-28 02:56:34.546098 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:34.546102 | orchestrator | 2026-04-28 02:56:34.546107 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:34.546113 | orchestrator | Tuesday 28 April 2026 02:56:33 +0000 (0:00:00.257) 0:00:07.759 ********* 2026-04-28 02:56:34.546119 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:34.546125 | orchestrator | 2026-04-28 02:56:34.546131 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:34.546137 | orchestrator | Tuesday 28 April 2026 02:56:33 +0000 (0:00:00.229) 0:00:07.989 ********* 2026-04-28 02:56:34.546143 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:34.546149 | orchestrator | 2026-04-28 02:56:34.546156 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:34.546162 | orchestrator | Tuesday 28 April 2026 02:56:33 +0000 (0:00:00.217) 0:00:08.206 ********* 2026-04-28 02:56:34.546168 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:34.546181 | orchestrator | 2026-04-28 02:56:34.546185 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:34.546189 | orchestrator | Tuesday 28 April 2026 02:56:34 +0000 (0:00:00.236) 0:00:08.442 ********* 2026-04-28 02:56:34.546193 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:34.546197 | orchestrator | 2026-04-28 02:56:34.546200 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:34.546204 | orchestrator | Tuesday 28 April 2026 02:56:34 +0000 (0:00:00.218) 0:00:08.661 ********* 2026-04-28 02:56:34.546208 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:34.546212 | orchestrator | 2026-04-28 02:56:34.546220 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:43.032235 | orchestrator | Tuesday 28 April 2026 02:56:34 +0000 (0:00:00.236) 0:00:08.897 ********* 2026-04-28 02:56:43.032419 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:43.032441 | orchestrator | 2026-04-28 02:56:43.032454 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:43.032468 | orchestrator | Tuesday 28 April 2026 02:56:34 +0000 (0:00:00.213) 0:00:09.110 ********* 2026-04-28 02:56:43.032480 | orchestrator | ok: [testbed-node-3] => (item=sda1) 2026-04-28 02:56:43.032493 | orchestrator | ok: [testbed-node-3] => (item=sda14) 2026-04-28 02:56:43.032505 | orchestrator | ok: [testbed-node-3] => (item=sda15) 2026-04-28 02:56:43.032517 | orchestrator | ok: [testbed-node-3] => (item=sda16) 2026-04-28 02:56:43.032528 | orchestrator | 2026-04-28 02:56:43.032540 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:43.032552 | orchestrator | Tuesday 28 April 2026 02:56:35 +0000 (0:00:01.242) 0:00:10.353 ********* 2026-04-28 02:56:43.032563 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:43.032575 | orchestrator | 2026-04-28 02:56:43.032604 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:43.032616 | orchestrator | Tuesday 28 April 2026 02:56:36 +0000 (0:00:00.297) 0:00:10.651 ********* 2026-04-28 02:56:43.032627 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:43.032639 | orchestrator | 2026-04-28 02:56:43.032650 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:43.032661 | orchestrator | Tuesday 28 April 2026 02:56:36 +0000 (0:00:00.242) 0:00:10.893 ********* 2026-04-28 02:56:43.032672 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:43.032685 | orchestrator | 2026-04-28 02:56:43.032696 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:43.032708 | orchestrator | Tuesday 28 April 2026 02:56:36 +0000 (0:00:00.249) 0:00:11.143 ********* 2026-04-28 02:56:43.032719 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:43.032731 | orchestrator | 2026-04-28 02:56:43.032742 | orchestrator | TASK [Set UUIDs for OSD VGs/LVs] *********************************************** 2026-04-28 02:56:43.032753 | orchestrator | Tuesday 28 April 2026 02:56:37 +0000 (0:00:00.244) 0:00:11.387 ********* 2026-04-28 02:56:43.032765 | orchestrator | ok: [testbed-node-3] => (item={'key': 'sdb', 'value': None}) 2026-04-28 02:56:43.032778 | orchestrator | ok: [testbed-node-3] => (item={'key': 'sdc', 'value': None}) 2026-04-28 02:56:43.032790 | orchestrator | 2026-04-28 02:56:43.032802 | orchestrator | TASK [Generate WAL VG names] *************************************************** 2026-04-28 02:56:43.032814 | orchestrator | Tuesday 28 April 2026 02:56:37 +0000 (0:00:00.228) 0:00:11.616 ********* 2026-04-28 02:56:43.032826 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:43.032838 | orchestrator | 2026-04-28 02:56:43.032849 | orchestrator | TASK [Generate DB VG names] **************************************************** 2026-04-28 02:56:43.032860 | orchestrator | Tuesday 28 April 2026 02:56:37 +0000 (0:00:00.152) 0:00:11.769 ********* 2026-04-28 02:56:43.032872 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:43.032885 | orchestrator | 2026-04-28 02:56:43.032897 | orchestrator | TASK [Generate shared DB/WAL VG names] ***************************************** 2026-04-28 02:56:43.032910 | orchestrator | Tuesday 28 April 2026 02:56:37 +0000 (0:00:00.151) 0:00:11.921 ********* 2026-04-28 02:56:43.032943 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:43.032955 | orchestrator | 2026-04-28 02:56:43.032966 | orchestrator | TASK [Define lvm_volumes structures] ******************************************* 2026-04-28 02:56:43.032978 | orchestrator | Tuesday 28 April 2026 02:56:37 +0000 (0:00:00.146) 0:00:12.067 ********* 2026-04-28 02:56:43.032989 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:56:43.033001 | orchestrator | 2026-04-28 02:56:43.033012 | orchestrator | TASK [Generate lvm_volumes structure (block only)] ***************************** 2026-04-28 02:56:43.033024 | orchestrator | Tuesday 28 April 2026 02:56:37 +0000 (0:00:00.158) 0:00:12.225 ********* 2026-04-28 02:56:43.033036 | orchestrator | ok: [testbed-node-3] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': 'b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'}}) 2026-04-28 02:56:43.033047 | orchestrator | ok: [testbed-node-3] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'be99929f-8eb5-5413-bbfd-d844b44bc4d1'}}) 2026-04-28 02:56:43.033058 | orchestrator | 2026-04-28 02:56:43.033070 | orchestrator | TASK [Generate lvm_volumes structure (block + db)] ***************************** 2026-04-28 02:56:43.033081 | orchestrator | Tuesday 28 April 2026 02:56:38 +0000 (0:00:00.212) 0:00:12.438 ********* 2026-04-28 02:56:43.033094 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': 'b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'}})  2026-04-28 02:56:43.033108 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'be99929f-8eb5-5413-bbfd-d844b44bc4d1'}})  2026-04-28 02:56:43.033121 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:43.033133 | orchestrator | 2026-04-28 02:56:43.033144 | orchestrator | TASK [Generate lvm_volumes structure (block + wal)] **************************** 2026-04-28 02:56:43.033156 | orchestrator | Tuesday 28 April 2026 02:56:38 +0000 (0:00:00.421) 0:00:12.859 ********* 2026-04-28 02:56:43.033167 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': 'b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'}})  2026-04-28 02:56:43.033178 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'be99929f-8eb5-5413-bbfd-d844b44bc4d1'}})  2026-04-28 02:56:43.033190 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:43.033201 | orchestrator | 2026-04-28 02:56:43.033212 | orchestrator | TASK [Generate lvm_volumes structure (block + db + wal)] *********************** 2026-04-28 02:56:43.033225 | orchestrator | Tuesday 28 April 2026 02:56:38 +0000 (0:00:00.162) 0:00:13.022 ********* 2026-04-28 02:56:43.033236 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': 'b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'}})  2026-04-28 02:56:43.033265 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'be99929f-8eb5-5413-bbfd-d844b44bc4d1'}})  2026-04-28 02:56:43.033273 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:43.033280 | orchestrator | 2026-04-28 02:56:43.033286 | orchestrator | TASK [Compile lvm_volumes] ***************************************************** 2026-04-28 02:56:43.033293 | orchestrator | Tuesday 28 April 2026 02:56:38 +0000 (0:00:00.150) 0:00:13.173 ********* 2026-04-28 02:56:43.033301 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:56:43.033307 | orchestrator | 2026-04-28 02:56:43.033314 | orchestrator | TASK [Set OSD devices config data] ********************************************* 2026-04-28 02:56:43.033321 | orchestrator | Tuesday 28 April 2026 02:56:38 +0000 (0:00:00.173) 0:00:13.346 ********* 2026-04-28 02:56:43.033327 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:56:43.033334 | orchestrator | 2026-04-28 02:56:43.033341 | orchestrator | TASK [Set DB devices config data] ********************************************** 2026-04-28 02:56:43.033371 | orchestrator | Tuesday 28 April 2026 02:56:39 +0000 (0:00:00.161) 0:00:13.507 ********* 2026-04-28 02:56:43.033383 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:43.033394 | orchestrator | 2026-04-28 02:56:43.033414 | orchestrator | TASK [Set WAL devices config data] ********************************************* 2026-04-28 02:56:43.033426 | orchestrator | Tuesday 28 April 2026 02:56:39 +0000 (0:00:00.143) 0:00:13.651 ********* 2026-04-28 02:56:43.033442 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:43.033449 | orchestrator | 2026-04-28 02:56:43.033456 | orchestrator | TASK [Set DB+WAL devices config data] ****************************************** 2026-04-28 02:56:43.033462 | orchestrator | Tuesday 28 April 2026 02:56:39 +0000 (0:00:00.153) 0:00:13.805 ********* 2026-04-28 02:56:43.033469 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:43.033476 | orchestrator | 2026-04-28 02:56:43.033482 | orchestrator | TASK [Print ceph_osd_devices] ************************************************** 2026-04-28 02:56:43.033489 | orchestrator | Tuesday 28 April 2026 02:56:39 +0000 (0:00:00.146) 0:00:13.952 ********* 2026-04-28 02:56:43.033496 | orchestrator | ok: [testbed-node-3] => { 2026-04-28 02:56:43.033502 | orchestrator |  "ceph_osd_devices": { 2026-04-28 02:56:43.033509 | orchestrator |  "sdb": { 2026-04-28 02:56:43.033517 | orchestrator |  "osd_lvm_uuid": "b91f22db-c1ee-55b4-b9b8-1bae9cdca76f" 2026-04-28 02:56:43.033524 | orchestrator |  }, 2026-04-28 02:56:43.033531 | orchestrator |  "sdc": { 2026-04-28 02:56:43.033537 | orchestrator |  "osd_lvm_uuid": "be99929f-8eb5-5413-bbfd-d844b44bc4d1" 2026-04-28 02:56:43.033544 | orchestrator |  } 2026-04-28 02:56:43.033551 | orchestrator |  } 2026-04-28 02:56:43.033558 | orchestrator | } 2026-04-28 02:56:43.033565 | orchestrator | 2026-04-28 02:56:43.033572 | orchestrator | TASK [Print WAL devices] ******************************************************* 2026-04-28 02:56:43.033578 | orchestrator | Tuesday 28 April 2026 02:56:39 +0000 (0:00:00.144) 0:00:14.096 ********* 2026-04-28 02:56:43.033585 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:43.033592 | orchestrator | 2026-04-28 02:56:43.033598 | orchestrator | TASK [Print DB devices] ******************************************************** 2026-04-28 02:56:43.033605 | orchestrator | Tuesday 28 April 2026 02:56:39 +0000 (0:00:00.140) 0:00:14.237 ********* 2026-04-28 02:56:43.033612 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:43.033618 | orchestrator | 2026-04-28 02:56:43.033625 | orchestrator | TASK [Print shared DB/WAL devices] ********************************************* 2026-04-28 02:56:43.033632 | orchestrator | Tuesday 28 April 2026 02:56:40 +0000 (0:00:00.147) 0:00:14.385 ********* 2026-04-28 02:56:43.033638 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:56:43.033645 | orchestrator | 2026-04-28 02:56:43.033652 | orchestrator | TASK [Print configuration data] ************************************************ 2026-04-28 02:56:43.033658 | orchestrator | Tuesday 28 April 2026 02:56:40 +0000 (0:00:00.138) 0:00:14.523 ********* 2026-04-28 02:56:43.033665 | orchestrator | changed: [testbed-node-3] => { 2026-04-28 02:56:43.033672 | orchestrator |  "_ceph_configure_lvm_config_data": { 2026-04-28 02:56:43.033678 | orchestrator |  "ceph_osd_devices": { 2026-04-28 02:56:43.033685 | orchestrator |  "sdb": { 2026-04-28 02:56:43.033692 | orchestrator |  "osd_lvm_uuid": "b91f22db-c1ee-55b4-b9b8-1bae9cdca76f" 2026-04-28 02:56:43.033698 | orchestrator |  }, 2026-04-28 02:56:43.033705 | orchestrator |  "sdc": { 2026-04-28 02:56:43.033712 | orchestrator |  "osd_lvm_uuid": "be99929f-8eb5-5413-bbfd-d844b44bc4d1" 2026-04-28 02:56:43.033718 | orchestrator |  } 2026-04-28 02:56:43.033725 | orchestrator |  }, 2026-04-28 02:56:43.033732 | orchestrator |  "lvm_volumes": [ 2026-04-28 02:56:43.033739 | orchestrator |  { 2026-04-28 02:56:43.033745 | orchestrator |  "data": "osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f", 2026-04-28 02:56:43.033752 | orchestrator |  "data_vg": "ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f" 2026-04-28 02:56:43.033759 | orchestrator |  }, 2026-04-28 02:56:43.033765 | orchestrator |  { 2026-04-28 02:56:43.033772 | orchestrator |  "data": "osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1", 2026-04-28 02:56:43.033779 | orchestrator |  "data_vg": "ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1" 2026-04-28 02:56:43.033786 | orchestrator |  } 2026-04-28 02:56:43.033792 | orchestrator |  ] 2026-04-28 02:56:43.033799 | orchestrator |  } 2026-04-28 02:56:43.033806 | orchestrator | } 2026-04-28 02:56:43.033813 | orchestrator | 2026-04-28 02:56:43.033825 | orchestrator | RUNNING HANDLER [Write configuration file] ************************************* 2026-04-28 02:56:43.033831 | orchestrator | Tuesday 28 April 2026 02:56:40 +0000 (0:00:00.472) 0:00:14.995 ********* 2026-04-28 02:56:43.033838 | orchestrator | changed: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-28 02:56:43.033844 | orchestrator | 2026-04-28 02:56:43.033851 | orchestrator | PLAY [Ceph configure LVM] ****************************************************** 2026-04-28 02:56:43.033858 | orchestrator | 2026-04-28 02:56:43.033864 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-28 02:56:43.033871 | orchestrator | Tuesday 28 April 2026 02:56:42 +0000 (0:00:01.857) 0:00:16.853 ********* 2026-04-28 02:56:43.033878 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] 2026-04-28 02:56:43.033884 | orchestrator | 2026-04-28 02:56:43.033891 | orchestrator | TASK [Get initial list of available block devices] ***************************** 2026-04-28 02:56:43.033898 | orchestrator | Tuesday 28 April 2026 02:56:42 +0000 (0:00:00.268) 0:00:17.122 ********* 2026-04-28 02:56:43.033904 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:56:43.033911 | orchestrator | 2026-04-28 02:56:43.033923 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:52.050837 | orchestrator | Tuesday 28 April 2026 02:56:43 +0000 (0:00:00.267) 0:00:17.389 ********* 2026-04-28 02:56:52.050987 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop0) 2026-04-28 02:56:52.051018 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop1) 2026-04-28 02:56:52.051038 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop2) 2026-04-28 02:56:52.051056 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop3) 2026-04-28 02:56:52.051076 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop4) 2026-04-28 02:56:52.051096 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop5) 2026-04-28 02:56:52.051139 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop6) 2026-04-28 02:56:52.051159 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop7) 2026-04-28 02:56:52.051180 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sda) 2026-04-28 02:56:52.051229 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sdb) 2026-04-28 02:56:52.051243 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sdc) 2026-04-28 02:56:52.051254 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sdd) 2026-04-28 02:56:52.051266 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sr0) 2026-04-28 02:56:52.051276 | orchestrator | 2026-04-28 02:56:52.051289 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:52.051300 | orchestrator | Tuesday 28 April 2026 02:56:43 +0000 (0:00:00.411) 0:00:17.800 ********* 2026-04-28 02:56:52.051310 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:52.051322 | orchestrator | 2026-04-28 02:56:52.051333 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:52.051378 | orchestrator | Tuesday 28 April 2026 02:56:43 +0000 (0:00:00.212) 0:00:18.013 ********* 2026-04-28 02:56:52.051392 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:52.051405 | orchestrator | 2026-04-28 02:56:52.051418 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:52.051430 | orchestrator | Tuesday 28 April 2026 02:56:43 +0000 (0:00:00.236) 0:00:18.249 ********* 2026-04-28 02:56:52.051442 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:52.051455 | orchestrator | 2026-04-28 02:56:52.051467 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:52.051480 | orchestrator | Tuesday 28 April 2026 02:56:44 +0000 (0:00:00.225) 0:00:18.474 ********* 2026-04-28 02:56:52.051518 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:52.051531 | orchestrator | 2026-04-28 02:56:52.051544 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:52.051556 | orchestrator | Tuesday 28 April 2026 02:56:44 +0000 (0:00:00.697) 0:00:19.172 ********* 2026-04-28 02:56:52.051568 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:52.051580 | orchestrator | 2026-04-28 02:56:52.051592 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:52.051606 | orchestrator | Tuesday 28 April 2026 02:56:45 +0000 (0:00:00.233) 0:00:19.405 ********* 2026-04-28 02:56:52.051618 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:52.051631 | orchestrator | 2026-04-28 02:56:52.051644 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:52.051656 | orchestrator | Tuesday 28 April 2026 02:56:45 +0000 (0:00:00.226) 0:00:19.631 ********* 2026-04-28 02:56:52.051669 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:52.051680 | orchestrator | 2026-04-28 02:56:52.051693 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:52.051705 | orchestrator | Tuesday 28 April 2026 02:56:45 +0000 (0:00:00.237) 0:00:19.869 ********* 2026-04-28 02:56:52.051718 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:52.051730 | orchestrator | 2026-04-28 02:56:52.051743 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:52.051754 | orchestrator | Tuesday 28 April 2026 02:56:45 +0000 (0:00:00.215) 0:00:20.084 ********* 2026-04-28 02:56:52.051765 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb) 2026-04-28 02:56:52.051777 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb) 2026-04-28 02:56:52.051788 | orchestrator | 2026-04-28 02:56:52.051799 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:52.051810 | orchestrator | Tuesday 28 April 2026 02:56:46 +0000 (0:00:00.468) 0:00:20.552 ********* 2026-04-28 02:56:52.051821 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b) 2026-04-28 02:56:52.051832 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b) 2026-04-28 02:56:52.051843 | orchestrator | 2026-04-28 02:56:52.051854 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:52.051865 | orchestrator | Tuesday 28 April 2026 02:56:46 +0000 (0:00:00.475) 0:00:21.028 ********* 2026-04-28 02:56:52.051875 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba) 2026-04-28 02:56:52.051886 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba) 2026-04-28 02:56:52.051897 | orchestrator | 2026-04-28 02:56:52.051908 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:52.051939 | orchestrator | Tuesday 28 April 2026 02:56:47 +0000 (0:00:00.474) 0:00:21.502 ********* 2026-04-28 02:56:52.051951 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80) 2026-04-28 02:56:52.051962 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80) 2026-04-28 02:56:52.051972 | orchestrator | 2026-04-28 02:56:52.051983 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:52.051994 | orchestrator | Tuesday 28 April 2026 02:56:47 +0000 (0:00:00.524) 0:00:22.027 ********* 2026-04-28 02:56:52.052005 | orchestrator | ok: [testbed-node-4] => (item=ata-QEMU_DVD-ROM_QM00001) 2026-04-28 02:56:52.052016 | orchestrator | 2026-04-28 02:56:52.052027 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:52.052044 | orchestrator | Tuesday 28 April 2026 02:56:48 +0000 (0:00:00.366) 0:00:22.394 ********* 2026-04-28 02:56:52.052055 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop0) 2026-04-28 02:56:52.052076 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop1) 2026-04-28 02:56:52.052087 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop2) 2026-04-28 02:56:52.052098 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop3) 2026-04-28 02:56:52.052109 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop4) 2026-04-28 02:56:52.052119 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop5) 2026-04-28 02:56:52.052130 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop6) 2026-04-28 02:56:52.052141 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop7) 2026-04-28 02:56:52.052151 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sda) 2026-04-28 02:56:52.052162 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sdb) 2026-04-28 02:56:52.052172 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sdc) 2026-04-28 02:56:52.052183 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sdd) 2026-04-28 02:56:52.052194 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sr0) 2026-04-28 02:56:52.052205 | orchestrator | 2026-04-28 02:56:52.052216 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:52.052226 | orchestrator | Tuesday 28 April 2026 02:56:48 +0000 (0:00:00.439) 0:00:22.833 ********* 2026-04-28 02:56:52.052237 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:52.052248 | orchestrator | 2026-04-28 02:56:52.052258 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:52.052269 | orchestrator | Tuesday 28 April 2026 02:56:49 +0000 (0:00:00.722) 0:00:23.556 ********* 2026-04-28 02:56:52.052280 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:52.052291 | orchestrator | 2026-04-28 02:56:52.052302 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:52.052313 | orchestrator | Tuesday 28 April 2026 02:56:49 +0000 (0:00:00.227) 0:00:23.783 ********* 2026-04-28 02:56:52.052323 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:52.052404 | orchestrator | 2026-04-28 02:56:52.052437 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:52.052453 | orchestrator | Tuesday 28 April 2026 02:56:49 +0000 (0:00:00.230) 0:00:24.014 ********* 2026-04-28 02:56:52.052470 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:52.052486 | orchestrator | 2026-04-28 02:56:52.052503 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:52.052518 | orchestrator | Tuesday 28 April 2026 02:56:49 +0000 (0:00:00.227) 0:00:24.241 ********* 2026-04-28 02:56:52.052532 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:52.052547 | orchestrator | 2026-04-28 02:56:52.052562 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:52.052578 | orchestrator | Tuesday 28 April 2026 02:56:50 +0000 (0:00:00.236) 0:00:24.478 ********* 2026-04-28 02:56:52.052593 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:52.052629 | orchestrator | 2026-04-28 02:56:52.052660 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:52.052678 | orchestrator | Tuesday 28 April 2026 02:56:50 +0000 (0:00:00.234) 0:00:24.712 ********* 2026-04-28 02:56:52.052694 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:52.052711 | orchestrator | 2026-04-28 02:56:52.052728 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:52.052747 | orchestrator | Tuesday 28 April 2026 02:56:50 +0000 (0:00:00.219) 0:00:24.932 ********* 2026-04-28 02:56:52.052766 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:52.052800 | orchestrator | 2026-04-28 02:56:52.052815 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:52.052826 | orchestrator | Tuesday 28 April 2026 02:56:50 +0000 (0:00:00.219) 0:00:25.152 ********* 2026-04-28 02:56:52.052836 | orchestrator | ok: [testbed-node-4] => (item=sda1) 2026-04-28 02:56:52.052848 | orchestrator | ok: [testbed-node-4] => (item=sda14) 2026-04-28 02:56:52.052859 | orchestrator | ok: [testbed-node-4] => (item=sda15) 2026-04-28 02:56:52.052870 | orchestrator | ok: [testbed-node-4] => (item=sda16) 2026-04-28 02:56:52.052880 | orchestrator | 2026-04-28 02:56:52.052891 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:52.052902 | orchestrator | Tuesday 28 April 2026 02:56:51 +0000 (0:00:01.039) 0:00:26.191 ********* 2026-04-28 02:56:52.052913 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:59.177036 | orchestrator | 2026-04-28 02:56:59.177143 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:59.177161 | orchestrator | Tuesday 28 April 2026 02:56:52 +0000 (0:00:00.218) 0:00:26.410 ********* 2026-04-28 02:56:59.177173 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:59.177185 | orchestrator | 2026-04-28 02:56:59.177196 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:59.177207 | orchestrator | Tuesday 28 April 2026 02:56:52 +0000 (0:00:00.226) 0:00:26.636 ********* 2026-04-28 02:56:59.177219 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:59.177230 | orchestrator | 2026-04-28 02:56:59.177241 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:56:59.177252 | orchestrator | Tuesday 28 April 2026 02:56:53 +0000 (0:00:00.777) 0:00:27.413 ********* 2026-04-28 02:56:59.177263 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:59.177273 | orchestrator | 2026-04-28 02:56:59.177301 | orchestrator | TASK [Set UUIDs for OSD VGs/LVs] *********************************************** 2026-04-28 02:56:59.177312 | orchestrator | Tuesday 28 April 2026 02:56:53 +0000 (0:00:00.241) 0:00:27.654 ********* 2026-04-28 02:56:59.177323 | orchestrator | ok: [testbed-node-4] => (item={'key': 'sdb', 'value': None}) 2026-04-28 02:56:59.177406 | orchestrator | ok: [testbed-node-4] => (item={'key': 'sdc', 'value': None}) 2026-04-28 02:56:59.177418 | orchestrator | 2026-04-28 02:56:59.177429 | orchestrator | TASK [Generate WAL VG names] *************************************************** 2026-04-28 02:56:59.177440 | orchestrator | Tuesday 28 April 2026 02:56:53 +0000 (0:00:00.180) 0:00:27.835 ********* 2026-04-28 02:56:59.177451 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:59.177462 | orchestrator | 2026-04-28 02:56:59.177473 | orchestrator | TASK [Generate DB VG names] **************************************************** 2026-04-28 02:56:59.177484 | orchestrator | Tuesday 28 April 2026 02:56:53 +0000 (0:00:00.160) 0:00:27.996 ********* 2026-04-28 02:56:59.177495 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:59.177506 | orchestrator | 2026-04-28 02:56:59.177516 | orchestrator | TASK [Generate shared DB/WAL VG names] ***************************************** 2026-04-28 02:56:59.177527 | orchestrator | Tuesday 28 April 2026 02:56:53 +0000 (0:00:00.145) 0:00:28.142 ********* 2026-04-28 02:56:59.177538 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:59.177549 | orchestrator | 2026-04-28 02:56:59.177560 | orchestrator | TASK [Define lvm_volumes structures] ******************************************* 2026-04-28 02:56:59.177573 | orchestrator | Tuesday 28 April 2026 02:56:53 +0000 (0:00:00.140) 0:00:28.283 ********* 2026-04-28 02:56:59.177586 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:56:59.177598 | orchestrator | 2026-04-28 02:56:59.177611 | orchestrator | TASK [Generate lvm_volumes structure (block only)] ***************************** 2026-04-28 02:56:59.177623 | orchestrator | Tuesday 28 April 2026 02:56:54 +0000 (0:00:00.164) 0:00:28.448 ********* 2026-04-28 02:56:59.177636 | orchestrator | ok: [testbed-node-4] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '1455ab40-e845-5ac6-aa29-4f0468cc06bf'}}) 2026-04-28 02:56:59.177649 | orchestrator | ok: [testbed-node-4] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'b3b62482-c8be-5063-9ecc-120425980b0a'}}) 2026-04-28 02:56:59.177688 | orchestrator | 2026-04-28 02:56:59.177701 | orchestrator | TASK [Generate lvm_volumes structure (block + db)] ***************************** 2026-04-28 02:56:59.177714 | orchestrator | Tuesday 28 April 2026 02:56:54 +0000 (0:00:00.186) 0:00:28.634 ********* 2026-04-28 02:56:59.177726 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '1455ab40-e845-5ac6-aa29-4f0468cc06bf'}})  2026-04-28 02:56:59.177740 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'b3b62482-c8be-5063-9ecc-120425980b0a'}})  2026-04-28 02:56:59.177753 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:59.177765 | orchestrator | 2026-04-28 02:56:59.177778 | orchestrator | TASK [Generate lvm_volumes structure (block + wal)] **************************** 2026-04-28 02:56:59.177795 | orchestrator | Tuesday 28 April 2026 02:56:54 +0000 (0:00:00.166) 0:00:28.801 ********* 2026-04-28 02:56:59.177815 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '1455ab40-e845-5ac6-aa29-4f0468cc06bf'}})  2026-04-28 02:56:59.177835 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'b3b62482-c8be-5063-9ecc-120425980b0a'}})  2026-04-28 02:56:59.177855 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:59.177872 | orchestrator | 2026-04-28 02:56:59.177890 | orchestrator | TASK [Generate lvm_volumes structure (block + db + wal)] *********************** 2026-04-28 02:56:59.177908 | orchestrator | Tuesday 28 April 2026 02:56:54 +0000 (0:00:00.203) 0:00:29.004 ********* 2026-04-28 02:56:59.177925 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '1455ab40-e845-5ac6-aa29-4f0468cc06bf'}})  2026-04-28 02:56:59.177942 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'b3b62482-c8be-5063-9ecc-120425980b0a'}})  2026-04-28 02:56:59.177960 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:59.177978 | orchestrator | 2026-04-28 02:56:59.177998 | orchestrator | TASK [Compile lvm_volumes] ***************************************************** 2026-04-28 02:56:59.178119 | orchestrator | Tuesday 28 April 2026 02:56:54 +0000 (0:00:00.160) 0:00:29.165 ********* 2026-04-28 02:56:59.178138 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:56:59.178148 | orchestrator | 2026-04-28 02:56:59.178160 | orchestrator | TASK [Set OSD devices config data] ********************************************* 2026-04-28 02:56:59.178170 | orchestrator | Tuesday 28 April 2026 02:56:54 +0000 (0:00:00.158) 0:00:29.324 ********* 2026-04-28 02:56:59.178181 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:56:59.178192 | orchestrator | 2026-04-28 02:56:59.178203 | orchestrator | TASK [Set DB devices config data] ********************************************** 2026-04-28 02:56:59.178214 | orchestrator | Tuesday 28 April 2026 02:56:55 +0000 (0:00:00.420) 0:00:29.744 ********* 2026-04-28 02:56:59.178245 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:59.178257 | orchestrator | 2026-04-28 02:56:59.178268 | orchestrator | TASK [Set WAL devices config data] ********************************************* 2026-04-28 02:56:59.178278 | orchestrator | Tuesday 28 April 2026 02:56:55 +0000 (0:00:00.172) 0:00:29.917 ********* 2026-04-28 02:56:59.178289 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:59.178300 | orchestrator | 2026-04-28 02:56:59.178311 | orchestrator | TASK [Set DB+WAL devices config data] ****************************************** 2026-04-28 02:56:59.178321 | orchestrator | Tuesday 28 April 2026 02:56:55 +0000 (0:00:00.153) 0:00:30.070 ********* 2026-04-28 02:56:59.178354 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:59.178366 | orchestrator | 2026-04-28 02:56:59.178376 | orchestrator | TASK [Print ceph_osd_devices] ************************************************** 2026-04-28 02:56:59.178387 | orchestrator | Tuesday 28 April 2026 02:56:55 +0000 (0:00:00.139) 0:00:30.210 ********* 2026-04-28 02:56:59.178398 | orchestrator | ok: [testbed-node-4] => { 2026-04-28 02:56:59.178409 | orchestrator |  "ceph_osd_devices": { 2026-04-28 02:56:59.178429 | orchestrator |  "sdb": { 2026-04-28 02:56:59.178442 | orchestrator |  "osd_lvm_uuid": "1455ab40-e845-5ac6-aa29-4f0468cc06bf" 2026-04-28 02:56:59.178453 | orchestrator |  }, 2026-04-28 02:56:59.178476 | orchestrator |  "sdc": { 2026-04-28 02:56:59.178488 | orchestrator |  "osd_lvm_uuid": "b3b62482-c8be-5063-9ecc-120425980b0a" 2026-04-28 02:56:59.178499 | orchestrator |  } 2026-04-28 02:56:59.178509 | orchestrator |  } 2026-04-28 02:56:59.178520 | orchestrator | } 2026-04-28 02:56:59.178532 | orchestrator | 2026-04-28 02:56:59.178543 | orchestrator | TASK [Print WAL devices] ******************************************************* 2026-04-28 02:56:59.178553 | orchestrator | Tuesday 28 April 2026 02:56:56 +0000 (0:00:00.173) 0:00:30.384 ********* 2026-04-28 02:56:59.178564 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:59.178575 | orchestrator | 2026-04-28 02:56:59.178586 | orchestrator | TASK [Print DB devices] ******************************************************** 2026-04-28 02:56:59.178597 | orchestrator | Tuesday 28 April 2026 02:56:56 +0000 (0:00:00.152) 0:00:30.536 ********* 2026-04-28 02:56:59.178608 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:59.178619 | orchestrator | 2026-04-28 02:56:59.178630 | orchestrator | TASK [Print shared DB/WAL devices] ********************************************* 2026-04-28 02:56:59.178641 | orchestrator | Tuesday 28 April 2026 02:56:56 +0000 (0:00:00.139) 0:00:30.676 ********* 2026-04-28 02:56:59.178652 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:56:59.178662 | orchestrator | 2026-04-28 02:56:59.178673 | orchestrator | TASK [Print configuration data] ************************************************ 2026-04-28 02:56:59.178684 | orchestrator | Tuesday 28 April 2026 02:56:56 +0000 (0:00:00.151) 0:00:30.827 ********* 2026-04-28 02:56:59.178695 | orchestrator | changed: [testbed-node-4] => { 2026-04-28 02:56:59.178706 | orchestrator |  "_ceph_configure_lvm_config_data": { 2026-04-28 02:56:59.178716 | orchestrator |  "ceph_osd_devices": { 2026-04-28 02:56:59.178727 | orchestrator |  "sdb": { 2026-04-28 02:56:59.178738 | orchestrator |  "osd_lvm_uuid": "1455ab40-e845-5ac6-aa29-4f0468cc06bf" 2026-04-28 02:56:59.178750 | orchestrator |  }, 2026-04-28 02:56:59.178761 | orchestrator |  "sdc": { 2026-04-28 02:56:59.178771 | orchestrator |  "osd_lvm_uuid": "b3b62482-c8be-5063-9ecc-120425980b0a" 2026-04-28 02:56:59.178782 | orchestrator |  } 2026-04-28 02:56:59.178793 | orchestrator |  }, 2026-04-28 02:56:59.178804 | orchestrator |  "lvm_volumes": [ 2026-04-28 02:56:59.178815 | orchestrator |  { 2026-04-28 02:56:59.178826 | orchestrator |  "data": "osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf", 2026-04-28 02:56:59.178837 | orchestrator |  "data_vg": "ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf" 2026-04-28 02:56:59.178848 | orchestrator |  }, 2026-04-28 02:56:59.178859 | orchestrator |  { 2026-04-28 02:56:59.178869 | orchestrator |  "data": "osd-block-b3b62482-c8be-5063-9ecc-120425980b0a", 2026-04-28 02:56:59.178880 | orchestrator |  "data_vg": "ceph-b3b62482-c8be-5063-9ecc-120425980b0a" 2026-04-28 02:56:59.178891 | orchestrator |  } 2026-04-28 02:56:59.178902 | orchestrator |  ] 2026-04-28 02:56:59.178913 | orchestrator |  } 2026-04-28 02:56:59.178924 | orchestrator | } 2026-04-28 02:56:59.178935 | orchestrator | 2026-04-28 02:56:59.178946 | orchestrator | RUNNING HANDLER [Write configuration file] ************************************* 2026-04-28 02:56:59.178957 | orchestrator | Tuesday 28 April 2026 02:56:56 +0000 (0:00:00.250) 0:00:31.078 ********* 2026-04-28 02:56:59.178967 | orchestrator | changed: [testbed-node-4 -> testbed-manager(192.168.16.5)] 2026-04-28 02:56:59.178978 | orchestrator | 2026-04-28 02:56:59.178989 | orchestrator | PLAY [Ceph configure LVM] ****************************************************** 2026-04-28 02:56:59.179000 | orchestrator | 2026-04-28 02:56:59.179011 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-28 02:56:59.179021 | orchestrator | Tuesday 28 April 2026 02:56:58 +0000 (0:00:01.445) 0:00:32.523 ********* 2026-04-28 02:56:59.179032 | orchestrator | ok: [testbed-node-5 -> testbed-manager(192.168.16.5)] 2026-04-28 02:56:59.179043 | orchestrator | 2026-04-28 02:56:59.179054 | orchestrator | TASK [Get initial list of available block devices] ***************************** 2026-04-28 02:56:59.179072 | orchestrator | Tuesday 28 April 2026 02:56:58 +0000 (0:00:00.290) 0:00:32.813 ********* 2026-04-28 02:56:59.179083 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:56:59.179094 | orchestrator | 2026-04-28 02:56:59.179105 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:56:59.179115 | orchestrator | Tuesday 28 April 2026 02:56:58 +0000 (0:00:00.253) 0:00:33.066 ********* 2026-04-28 02:56:59.179126 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop0) 2026-04-28 02:56:59.179137 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop1) 2026-04-28 02:56:59.179148 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop2) 2026-04-28 02:56:59.179159 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop3) 2026-04-28 02:56:59.179169 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop4) 2026-04-28 02:56:59.179188 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop5) 2026-04-28 02:57:08.450180 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop6) 2026-04-28 02:57:08.450308 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop7) 2026-04-28 02:57:08.450390 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sda) 2026-04-28 02:57:08.450410 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sdb) 2026-04-28 02:57:08.450428 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sdc) 2026-04-28 02:57:08.450447 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sdd) 2026-04-28 02:57:08.450466 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sr0) 2026-04-28 02:57:08.450482 | orchestrator | 2026-04-28 02:57:08.450520 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:57:08.450541 | orchestrator | Tuesday 28 April 2026 02:56:59 +0000 (0:00:00.462) 0:00:33.528 ********* 2026-04-28 02:57:08.450560 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:08.450578 | orchestrator | 2026-04-28 02:57:08.450589 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:57:08.450600 | orchestrator | Tuesday 28 April 2026 02:56:59 +0000 (0:00:00.242) 0:00:33.771 ********* 2026-04-28 02:57:08.450611 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:08.450622 | orchestrator | 2026-04-28 02:57:08.450633 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:57:08.450646 | orchestrator | Tuesday 28 April 2026 02:56:59 +0000 (0:00:00.236) 0:00:34.008 ********* 2026-04-28 02:57:08.450658 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:08.450671 | orchestrator | 2026-04-28 02:57:08.450683 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:57:08.450696 | orchestrator | Tuesday 28 April 2026 02:56:59 +0000 (0:00:00.212) 0:00:34.221 ********* 2026-04-28 02:57:08.450709 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:08.450722 | orchestrator | 2026-04-28 02:57:08.450734 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:57:08.450747 | orchestrator | Tuesday 28 April 2026 02:57:00 +0000 (0:00:00.239) 0:00:34.460 ********* 2026-04-28 02:57:08.450760 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:08.450772 | orchestrator | 2026-04-28 02:57:08.450785 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:57:08.450798 | orchestrator | Tuesday 28 April 2026 02:57:00 +0000 (0:00:00.233) 0:00:34.694 ********* 2026-04-28 02:57:08.450811 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:08.450822 | orchestrator | 2026-04-28 02:57:08.450833 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:57:08.450844 | orchestrator | Tuesday 28 April 2026 02:57:00 +0000 (0:00:00.249) 0:00:34.943 ********* 2026-04-28 02:57:08.450875 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:08.450886 | orchestrator | 2026-04-28 02:57:08.450897 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:57:08.450908 | orchestrator | Tuesday 28 April 2026 02:57:01 +0000 (0:00:00.742) 0:00:35.685 ********* 2026-04-28 02:57:08.450919 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:08.450930 | orchestrator | 2026-04-28 02:57:08.450941 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:57:08.450951 | orchestrator | Tuesday 28 April 2026 02:57:01 +0000 (0:00:00.222) 0:00:35.907 ********* 2026-04-28 02:57:08.450962 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50) 2026-04-28 02:57:08.450974 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50) 2026-04-28 02:57:08.450984 | orchestrator | 2026-04-28 02:57:08.450995 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:57:08.451006 | orchestrator | Tuesday 28 April 2026 02:57:02 +0000 (0:00:00.494) 0:00:36.402 ********* 2026-04-28 02:57:08.451017 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79) 2026-04-28 02:57:08.451028 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79) 2026-04-28 02:57:08.451038 | orchestrator | 2026-04-28 02:57:08.451049 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:57:08.451060 | orchestrator | Tuesday 28 April 2026 02:57:02 +0000 (0:00:00.474) 0:00:36.876 ********* 2026-04-28 02:57:08.451070 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89) 2026-04-28 02:57:08.451081 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89) 2026-04-28 02:57:08.451092 | orchestrator | 2026-04-28 02:57:08.451103 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:57:08.451113 | orchestrator | Tuesday 28 April 2026 02:57:03 +0000 (0:00:00.520) 0:00:37.396 ********* 2026-04-28 02:57:08.451124 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de) 2026-04-28 02:57:08.451135 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de) 2026-04-28 02:57:08.451146 | orchestrator | 2026-04-28 02:57:08.451157 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:57:08.451168 | orchestrator | Tuesday 28 April 2026 02:57:03 +0000 (0:00:00.482) 0:00:37.879 ********* 2026-04-28 02:57:08.451178 | orchestrator | ok: [testbed-node-5] => (item=ata-QEMU_DVD-ROM_QM00001) 2026-04-28 02:57:08.451189 | orchestrator | 2026-04-28 02:57:08.451200 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:57:08.451232 | orchestrator | Tuesday 28 April 2026 02:57:03 +0000 (0:00:00.405) 0:00:38.285 ********* 2026-04-28 02:57:08.451243 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop0) 2026-04-28 02:57:08.451255 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop1) 2026-04-28 02:57:08.451265 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop2) 2026-04-28 02:57:08.451276 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop3) 2026-04-28 02:57:08.451287 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop4) 2026-04-28 02:57:08.451297 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop5) 2026-04-28 02:57:08.451313 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop6) 2026-04-28 02:57:08.451406 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop7) 2026-04-28 02:57:08.451429 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sda) 2026-04-28 02:57:08.451440 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sdb) 2026-04-28 02:57:08.451451 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sdc) 2026-04-28 02:57:08.451462 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sdd) 2026-04-28 02:57:08.451472 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sr0) 2026-04-28 02:57:08.451483 | orchestrator | 2026-04-28 02:57:08.451494 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:57:08.451504 | orchestrator | Tuesday 28 April 2026 02:57:04 +0000 (0:00:00.452) 0:00:38.738 ********* 2026-04-28 02:57:08.451515 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:08.451526 | orchestrator | 2026-04-28 02:57:08.451537 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:57:08.451547 | orchestrator | Tuesday 28 April 2026 02:57:04 +0000 (0:00:00.233) 0:00:38.971 ********* 2026-04-28 02:57:08.451558 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:08.451569 | orchestrator | 2026-04-28 02:57:08.451580 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:57:08.451591 | orchestrator | Tuesday 28 April 2026 02:57:04 +0000 (0:00:00.227) 0:00:39.198 ********* 2026-04-28 02:57:08.451602 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:08.451613 | orchestrator | 2026-04-28 02:57:08.451624 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:57:08.451634 | orchestrator | Tuesday 28 April 2026 02:57:05 +0000 (0:00:00.732) 0:00:39.930 ********* 2026-04-28 02:57:08.451645 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:08.451656 | orchestrator | 2026-04-28 02:57:08.451667 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:57:08.451677 | orchestrator | Tuesday 28 April 2026 02:57:05 +0000 (0:00:00.239) 0:00:40.170 ********* 2026-04-28 02:57:08.451688 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:08.451699 | orchestrator | 2026-04-28 02:57:08.451710 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:57:08.451721 | orchestrator | Tuesday 28 April 2026 02:57:06 +0000 (0:00:00.236) 0:00:40.406 ********* 2026-04-28 02:57:08.451732 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:08.451743 | orchestrator | 2026-04-28 02:57:08.451754 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:57:08.451765 | orchestrator | Tuesday 28 April 2026 02:57:06 +0000 (0:00:00.249) 0:00:40.656 ********* 2026-04-28 02:57:08.451776 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:08.451786 | orchestrator | 2026-04-28 02:57:08.451797 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:57:08.451808 | orchestrator | Tuesday 28 April 2026 02:57:06 +0000 (0:00:00.220) 0:00:40.877 ********* 2026-04-28 02:57:08.451819 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:08.451830 | orchestrator | 2026-04-28 02:57:08.451841 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:57:08.451851 | orchestrator | Tuesday 28 April 2026 02:57:06 +0000 (0:00:00.244) 0:00:41.122 ********* 2026-04-28 02:57:08.451862 | orchestrator | ok: [testbed-node-5] => (item=sda1) 2026-04-28 02:57:08.451873 | orchestrator | ok: [testbed-node-5] => (item=sda14) 2026-04-28 02:57:08.451884 | orchestrator | ok: [testbed-node-5] => (item=sda15) 2026-04-28 02:57:08.451895 | orchestrator | ok: [testbed-node-5] => (item=sda16) 2026-04-28 02:57:08.451906 | orchestrator | 2026-04-28 02:57:08.451917 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:57:08.451927 | orchestrator | Tuesday 28 April 2026 02:57:07 +0000 (0:00:00.780) 0:00:41.902 ********* 2026-04-28 02:57:08.451937 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:08.451946 | orchestrator | 2026-04-28 02:57:08.451956 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:57:08.451973 | orchestrator | Tuesday 28 April 2026 02:57:07 +0000 (0:00:00.217) 0:00:42.120 ********* 2026-04-28 02:57:08.451982 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:08.451992 | orchestrator | 2026-04-28 02:57:08.452001 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:57:08.452011 | orchestrator | Tuesday 28 April 2026 02:57:07 +0000 (0:00:00.234) 0:00:42.355 ********* 2026-04-28 02:57:08.452021 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:08.452030 | orchestrator | 2026-04-28 02:57:08.452040 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:57:08.452050 | orchestrator | Tuesday 28 April 2026 02:57:08 +0000 (0:00:00.228) 0:00:42.584 ********* 2026-04-28 02:57:08.452059 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:08.452069 | orchestrator | 2026-04-28 02:57:08.452086 | orchestrator | TASK [Set UUIDs for OSD VGs/LVs] *********************************************** 2026-04-28 02:57:13.162816 | orchestrator | Tuesday 28 April 2026 02:57:08 +0000 (0:00:00.224) 0:00:42.808 ********* 2026-04-28 02:57:13.162903 | orchestrator | ok: [testbed-node-5] => (item={'key': 'sdb', 'value': None}) 2026-04-28 02:57:13.162909 | orchestrator | ok: [testbed-node-5] => (item={'key': 'sdc', 'value': None}) 2026-04-28 02:57:13.162913 | orchestrator | 2026-04-28 02:57:13.162918 | orchestrator | TASK [Generate WAL VG names] *************************************************** 2026-04-28 02:57:13.162922 | orchestrator | Tuesday 28 April 2026 02:57:08 +0000 (0:00:00.448) 0:00:43.257 ********* 2026-04-28 02:57:13.162927 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:13.162931 | orchestrator | 2026-04-28 02:57:13.162935 | orchestrator | TASK [Generate DB VG names] **************************************************** 2026-04-28 02:57:13.162939 | orchestrator | Tuesday 28 April 2026 02:57:09 +0000 (0:00:00.152) 0:00:43.410 ********* 2026-04-28 02:57:13.162955 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:13.162959 | orchestrator | 2026-04-28 02:57:13.162963 | orchestrator | TASK [Generate shared DB/WAL VG names] ***************************************** 2026-04-28 02:57:13.162966 | orchestrator | Tuesday 28 April 2026 02:57:09 +0000 (0:00:00.154) 0:00:43.564 ********* 2026-04-28 02:57:13.162970 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:13.162974 | orchestrator | 2026-04-28 02:57:13.162978 | orchestrator | TASK [Define lvm_volumes structures] ******************************************* 2026-04-28 02:57:13.162981 | orchestrator | Tuesday 28 April 2026 02:57:09 +0000 (0:00:00.132) 0:00:43.697 ********* 2026-04-28 02:57:13.162985 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:57:13.162990 | orchestrator | 2026-04-28 02:57:13.162994 | orchestrator | TASK [Generate lvm_volumes structure (block only)] ***************************** 2026-04-28 02:57:13.162998 | orchestrator | Tuesday 28 April 2026 02:57:09 +0000 (0:00:00.162) 0:00:43.860 ********* 2026-04-28 02:57:13.163002 | orchestrator | ok: [testbed-node-5] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': 'd7e38cf3-e59d-5932-97d5-5021af3eecab'}}) 2026-04-28 02:57:13.163006 | orchestrator | ok: [testbed-node-5] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'}}) 2026-04-28 02:57:13.163010 | orchestrator | 2026-04-28 02:57:13.163014 | orchestrator | TASK [Generate lvm_volumes structure (block + db)] ***************************** 2026-04-28 02:57:13.163017 | orchestrator | Tuesday 28 April 2026 02:57:09 +0000 (0:00:00.201) 0:00:44.061 ********* 2026-04-28 02:57:13.163022 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': 'd7e38cf3-e59d-5932-97d5-5021af3eecab'}})  2026-04-28 02:57:13.163027 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'}})  2026-04-28 02:57:13.163031 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:13.163035 | orchestrator | 2026-04-28 02:57:13.163039 | orchestrator | TASK [Generate lvm_volumes structure (block + wal)] **************************** 2026-04-28 02:57:13.163042 | orchestrator | Tuesday 28 April 2026 02:57:09 +0000 (0:00:00.170) 0:00:44.231 ********* 2026-04-28 02:57:13.163046 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': 'd7e38cf3-e59d-5932-97d5-5021af3eecab'}})  2026-04-28 02:57:13.163064 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'}})  2026-04-28 02:57:13.163068 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:13.163072 | orchestrator | 2026-04-28 02:57:13.163076 | orchestrator | TASK [Generate lvm_volumes structure (block + db + wal)] *********************** 2026-04-28 02:57:13.163080 | orchestrator | Tuesday 28 April 2026 02:57:10 +0000 (0:00:00.176) 0:00:44.408 ********* 2026-04-28 02:57:13.163084 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': 'd7e38cf3-e59d-5932-97d5-5021af3eecab'}})  2026-04-28 02:57:13.163088 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'}})  2026-04-28 02:57:13.163091 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:13.163095 | orchestrator | 2026-04-28 02:57:13.163099 | orchestrator | TASK [Compile lvm_volumes] ***************************************************** 2026-04-28 02:57:13.163103 | orchestrator | Tuesday 28 April 2026 02:57:10 +0000 (0:00:00.150) 0:00:44.558 ********* 2026-04-28 02:57:13.163106 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:57:13.163110 | orchestrator | 2026-04-28 02:57:13.163114 | orchestrator | TASK [Set OSD devices config data] ********************************************* 2026-04-28 02:57:13.163117 | orchestrator | Tuesday 28 April 2026 02:57:10 +0000 (0:00:00.167) 0:00:44.726 ********* 2026-04-28 02:57:13.163121 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:57:13.163125 | orchestrator | 2026-04-28 02:57:13.163129 | orchestrator | TASK [Set DB devices config data] ********************************************** 2026-04-28 02:57:13.163132 | orchestrator | Tuesday 28 April 2026 02:57:10 +0000 (0:00:00.157) 0:00:44.883 ********* 2026-04-28 02:57:13.163136 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:13.163140 | orchestrator | 2026-04-28 02:57:13.163143 | orchestrator | TASK [Set WAL devices config data] ********************************************* 2026-04-28 02:57:13.163147 | orchestrator | Tuesday 28 April 2026 02:57:10 +0000 (0:00:00.132) 0:00:45.016 ********* 2026-04-28 02:57:13.163151 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:13.163155 | orchestrator | 2026-04-28 02:57:13.163159 | orchestrator | TASK [Set DB+WAL devices config data] ****************************************** 2026-04-28 02:57:13.163163 | orchestrator | Tuesday 28 April 2026 02:57:11 +0000 (0:00:00.382) 0:00:45.399 ********* 2026-04-28 02:57:13.163166 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:13.163170 | orchestrator | 2026-04-28 02:57:13.163174 | orchestrator | TASK [Print ceph_osd_devices] ************************************************** 2026-04-28 02:57:13.163177 | orchestrator | Tuesday 28 April 2026 02:57:11 +0000 (0:00:00.155) 0:00:45.554 ********* 2026-04-28 02:57:13.163181 | orchestrator | ok: [testbed-node-5] => { 2026-04-28 02:57:13.163185 | orchestrator |  "ceph_osd_devices": { 2026-04-28 02:57:13.163189 | orchestrator |  "sdb": { 2026-04-28 02:57:13.163204 | orchestrator |  "osd_lvm_uuid": "d7e38cf3-e59d-5932-97d5-5021af3eecab" 2026-04-28 02:57:13.163209 | orchestrator |  }, 2026-04-28 02:57:13.163213 | orchestrator |  "sdc": { 2026-04-28 02:57:13.163217 | orchestrator |  "osd_lvm_uuid": "bdda1e24-8b47-5b08-be8f-b7cb87fd92e1" 2026-04-28 02:57:13.163220 | orchestrator |  } 2026-04-28 02:57:13.163224 | orchestrator |  } 2026-04-28 02:57:13.163228 | orchestrator | } 2026-04-28 02:57:13.163232 | orchestrator | 2026-04-28 02:57:13.163236 | orchestrator | TASK [Print WAL devices] ******************************************************* 2026-04-28 02:57:13.163240 | orchestrator | Tuesday 28 April 2026 02:57:11 +0000 (0:00:00.162) 0:00:45.716 ********* 2026-04-28 02:57:13.163244 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:13.163247 | orchestrator | 2026-04-28 02:57:13.163251 | orchestrator | TASK [Print DB devices] ******************************************************** 2026-04-28 02:57:13.163257 | orchestrator | Tuesday 28 April 2026 02:57:11 +0000 (0:00:00.151) 0:00:45.868 ********* 2026-04-28 02:57:13.163261 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:13.163269 | orchestrator | 2026-04-28 02:57:13.163272 | orchestrator | TASK [Print shared DB/WAL devices] ********************************************* 2026-04-28 02:57:13.163276 | orchestrator | Tuesday 28 April 2026 02:57:11 +0000 (0:00:00.162) 0:00:46.031 ********* 2026-04-28 02:57:13.163280 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:57:13.163283 | orchestrator | 2026-04-28 02:57:13.163287 | orchestrator | TASK [Print configuration data] ************************************************ 2026-04-28 02:57:13.163291 | orchestrator | Tuesday 28 April 2026 02:57:11 +0000 (0:00:00.152) 0:00:46.184 ********* 2026-04-28 02:57:13.163295 | orchestrator | changed: [testbed-node-5] => { 2026-04-28 02:57:13.163299 | orchestrator |  "_ceph_configure_lvm_config_data": { 2026-04-28 02:57:13.163302 | orchestrator |  "ceph_osd_devices": { 2026-04-28 02:57:13.163306 | orchestrator |  "sdb": { 2026-04-28 02:57:13.163354 | orchestrator |  "osd_lvm_uuid": "d7e38cf3-e59d-5932-97d5-5021af3eecab" 2026-04-28 02:57:13.163360 | orchestrator |  }, 2026-04-28 02:57:13.163365 | orchestrator |  "sdc": { 2026-04-28 02:57:13.163369 | orchestrator |  "osd_lvm_uuid": "bdda1e24-8b47-5b08-be8f-b7cb87fd92e1" 2026-04-28 02:57:13.163373 | orchestrator |  } 2026-04-28 02:57:13.163377 | orchestrator |  }, 2026-04-28 02:57:13.163382 | orchestrator |  "lvm_volumes": [ 2026-04-28 02:57:13.163386 | orchestrator |  { 2026-04-28 02:57:13.163391 | orchestrator |  "data": "osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab", 2026-04-28 02:57:13.163395 | orchestrator |  "data_vg": "ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab" 2026-04-28 02:57:13.163399 | orchestrator |  }, 2026-04-28 02:57:13.163403 | orchestrator |  { 2026-04-28 02:57:13.163408 | orchestrator |  "data": "osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1", 2026-04-28 02:57:13.163412 | orchestrator |  "data_vg": "ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1" 2026-04-28 02:57:13.163416 | orchestrator |  } 2026-04-28 02:57:13.163420 | orchestrator |  ] 2026-04-28 02:57:13.163424 | orchestrator |  } 2026-04-28 02:57:13.163429 | orchestrator | } 2026-04-28 02:57:13.163433 | orchestrator | 2026-04-28 02:57:13.163437 | orchestrator | RUNNING HANDLER [Write configuration file] ************************************* 2026-04-28 02:57:13.163441 | orchestrator | Tuesday 28 April 2026 02:57:12 +0000 (0:00:00.243) 0:00:46.427 ********* 2026-04-28 02:57:13.163445 | orchestrator | changed: [testbed-node-5 -> testbed-manager(192.168.16.5)] 2026-04-28 02:57:13.163449 | orchestrator | 2026-04-28 02:57:13.163454 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:57:13.163458 | orchestrator | testbed-node-3 : ok=42  changed=2  unreachable=0 failed=0 skipped=32  rescued=0 ignored=0 2026-04-28 02:57:13.163463 | orchestrator | testbed-node-4 : ok=42  changed=2  unreachable=0 failed=0 skipped=32  rescued=0 ignored=0 2026-04-28 02:57:13.163468 | orchestrator | testbed-node-5 : ok=42  changed=2  unreachable=0 failed=0 skipped=32  rescued=0 ignored=0 2026-04-28 02:57:13.163472 | orchestrator | 2026-04-28 02:57:13.163476 | orchestrator | 2026-04-28 02:57:13.163480 | orchestrator | 2026-04-28 02:57:13.163485 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:57:13.163489 | orchestrator | Tuesday 28 April 2026 02:57:13 +0000 (0:00:01.072) 0:00:47.500 ********* 2026-04-28 02:57:13.163493 | orchestrator | =============================================================================== 2026-04-28 02:57:13.163497 | orchestrator | Write configuration file ------------------------------------------------ 4.38s 2026-04-28 02:57:13.163501 | orchestrator | Add known links to the list of available block devices ------------------ 1.47s 2026-04-28 02:57:13.163505 | orchestrator | Add known partitions to the list of available block devices ------------- 1.34s 2026-04-28 02:57:13.163510 | orchestrator | Add known partitions to the list of available block devices ------------- 1.24s 2026-04-28 02:57:13.163514 | orchestrator | Add known links to the list of available block devices ------------------ 1.07s 2026-04-28 02:57:13.163522 | orchestrator | Add known partitions to the list of available block devices ------------- 1.04s 2026-04-28 02:57:13.163526 | orchestrator | Print configuration data ------------------------------------------------ 0.97s 2026-04-28 02:57:13.163530 | orchestrator | Set UUIDs for OSD VGs/LVs ----------------------------------------------- 0.86s 2026-04-28 02:57:13.163534 | orchestrator | Get extra vars for Ceph configuration ----------------------------------- 0.83s 2026-04-28 02:57:13.163538 | orchestrator | Add known partitions to the list of available block devices ------------- 0.78s 2026-04-28 02:57:13.163543 | orchestrator | Add known partitions to the list of available block devices ------------- 0.78s 2026-04-28 02:57:13.163547 | orchestrator | Add known links to the list of available block devices ------------------ 0.77s 2026-04-28 02:57:13.163551 | orchestrator | Get initial list of available block devices ----------------------------- 0.76s 2026-04-28 02:57:13.163558 | orchestrator | Generate lvm_volumes structure (block + db) ----------------------------- 0.76s 2026-04-28 02:57:13.643935 | orchestrator | Add known links to the list of available block devices ------------------ 0.74s 2026-04-28 02:57:13.644069 | orchestrator | Set OSD devices config data --------------------------------------------- 0.74s 2026-04-28 02:57:13.644092 | orchestrator | Add known partitions to the list of available block devices ------------- 0.73s 2026-04-28 02:57:13.644108 | orchestrator | Add known links to the list of available block devices ------------------ 0.72s 2026-04-28 02:57:13.644122 | orchestrator | Add known partitions to the list of available block devices ------------- 0.72s 2026-04-28 02:57:13.644138 | orchestrator | Add known links to the list of available block devices ------------------ 0.70s 2026-04-28 02:57:36.399034 | orchestrator | 2026-04-28 02:57:36 | INFO  | Task 2d654331-a6b4-43ce-b02b-b6c1fe959e2d (sync inventory) is running in background. Output coming soon. 2026-04-28 02:58:09.071880 | orchestrator | 2026-04-28 02:57:38 | INFO  | Starting group_vars file reorganization 2026-04-28 02:58:09.072020 | orchestrator | 2026-04-28 02:57:38 | INFO  | Moved 0 file(s) to their respective directories 2026-04-28 02:58:09.072049 | orchestrator | 2026-04-28 02:57:38 | INFO  | Group_vars file reorganization completed 2026-04-28 02:58:09.072070 | orchestrator | 2026-04-28 02:57:41 | INFO  | Starting variable preparation from inventory 2026-04-28 02:58:09.072090 | orchestrator | 2026-04-28 02:57:44 | INFO  | Writing 050-kolla-ceph-rgw-hosts.yml with ceph_rgw_hosts 2026-04-28 02:58:09.072109 | orchestrator | 2026-04-28 02:57:44 | INFO  | Writing 050-infrastructure-cephclient-mons.yml with cephclient_mons 2026-04-28 02:58:09.072123 | orchestrator | 2026-04-28 02:57:44 | INFO  | Writing 050-ceph-cluster-fsid.yml with ceph_cluster_fsid 2026-04-28 02:58:09.072136 | orchestrator | 2026-04-28 02:57:44 | INFO  | 3 file(s) written, 6 host(s) processed 2026-04-28 02:58:09.072156 | orchestrator | 2026-04-28 02:57:44 | INFO  | Variable preparation completed 2026-04-28 02:58:09.072174 | orchestrator | 2026-04-28 02:57:46 | INFO  | Starting inventory overwrite handling 2026-04-28 02:58:09.072229 | orchestrator | 2026-04-28 02:57:46 | INFO  | Handling group overwrites in 99-overwrite 2026-04-28 02:58:09.072275 | orchestrator | 2026-04-28 02:57:46 | INFO  | Removing group frr:children from 60-generic 2026-04-28 02:58:09.072293 | orchestrator | 2026-04-28 02:57:46 | INFO  | Removing group netbird:children from 50-infrastructure 2026-04-28 02:58:09.072312 | orchestrator | 2026-04-28 02:57:46 | INFO  | Removing group ceph-rgw from 50-ceph 2026-04-28 02:58:09.072328 | orchestrator | 2026-04-28 02:57:46 | INFO  | Removing group ceph-mds from 50-ceph 2026-04-28 02:58:09.072344 | orchestrator | 2026-04-28 02:57:46 | INFO  | Handling group overwrites in 20-roles 2026-04-28 02:58:09.072361 | orchestrator | 2026-04-28 02:57:46 | INFO  | Removing group k3s_node from 50-infrastructure 2026-04-28 02:58:09.072418 | orchestrator | 2026-04-28 02:57:46 | INFO  | Removed 5 group(s) in total 2026-04-28 02:58:09.072441 | orchestrator | 2026-04-28 02:57:46 | INFO  | Inventory overwrite handling completed 2026-04-28 02:58:09.072460 | orchestrator | 2026-04-28 02:57:48 | INFO  | Starting merge of inventory files 2026-04-28 02:58:09.072480 | orchestrator | 2026-04-28 02:57:48 | INFO  | Inventory files merged successfully 2026-04-28 02:58:09.072495 | orchestrator | 2026-04-28 02:57:54 | INFO  | Generating ClusterShell configuration from Ansible inventory 2026-04-28 02:58:09.072508 | orchestrator | 2026-04-28 02:58:07 | INFO  | Successfully wrote ClusterShell configuration 2026-04-28 02:58:09.072523 | orchestrator | [master cabcc91] 2026-04-28-02-58 2026-04-28 02:58:09.072537 | orchestrator | 1 file changed, 30 insertions(+), 9 deletions(-) 2026-04-28 02:58:11.631879 | orchestrator | 2026-04-28 02:58:11 | INFO  | Task 4cc2f5d3-1fb7-4116-8259-956ac6fbc11e (ceph-create-lvm-devices) was prepared for execution. 2026-04-28 02:58:11.631984 | orchestrator | 2026-04-28 02:58:11 | INFO  | It takes a moment until task 4cc2f5d3-1fb7-4116-8259-956ac6fbc11e (ceph-create-lvm-devices) has been started and output is visible here. 2026-04-28 02:58:25.192015 | orchestrator | [WARNING]: Collection community.general does not support Ansible version 2026-04-28 02:58:25.192114 | orchestrator | 2.16.14 2026-04-28 02:58:25.192125 | orchestrator | 2026-04-28 02:58:25.192133 | orchestrator | PLAY [Ceph create LVM devices] ************************************************* 2026-04-28 02:58:25.192140 | orchestrator | 2026-04-28 02:58:25.192145 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-28 02:58:25.192149 | orchestrator | Tuesday 28 April 2026 02:58:16 +0000 (0:00:00.355) 0:00:00.355 ********* 2026-04-28 02:58:25.192154 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-28 02:58:25.192159 | orchestrator | 2026-04-28 02:58:25.192166 | orchestrator | TASK [Get initial list of available block devices] ***************************** 2026-04-28 02:58:25.192172 | orchestrator | Tuesday 28 April 2026 02:58:16 +0000 (0:00:00.315) 0:00:00.670 ********* 2026-04-28 02:58:25.192179 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:58:25.192185 | orchestrator | 2026-04-28 02:58:25.192191 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:58:25.192197 | orchestrator | Tuesday 28 April 2026 02:58:17 +0000 (0:00:00.265) 0:00:00.935 ********* 2026-04-28 02:58:25.192204 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop0) 2026-04-28 02:58:25.192209 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop1) 2026-04-28 02:58:25.192215 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop2) 2026-04-28 02:58:25.192221 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop3) 2026-04-28 02:58:25.192277 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop4) 2026-04-28 02:58:25.192299 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop5) 2026-04-28 02:58:25.192306 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop6) 2026-04-28 02:58:25.192314 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=loop7) 2026-04-28 02:58:25.192321 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sda) 2026-04-28 02:58:25.192327 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sdb) 2026-04-28 02:58:25.192333 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sdc) 2026-04-28 02:58:25.192339 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sdd) 2026-04-28 02:58:25.192344 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-3 => (item=sr0) 2026-04-28 02:58:25.192368 | orchestrator | 2026-04-28 02:58:25.192374 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:58:25.192380 | orchestrator | Tuesday 28 April 2026 02:58:17 +0000 (0:00:00.588) 0:00:01.524 ********* 2026-04-28 02:58:25.192386 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:25.192392 | orchestrator | 2026-04-28 02:58:25.192399 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:58:25.192404 | orchestrator | Tuesday 28 April 2026 02:58:18 +0000 (0:00:00.270) 0:00:01.794 ********* 2026-04-28 02:58:25.192410 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:25.192416 | orchestrator | 2026-04-28 02:58:25.192421 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:58:25.192427 | orchestrator | Tuesday 28 April 2026 02:58:18 +0000 (0:00:00.219) 0:00:02.014 ********* 2026-04-28 02:58:25.192433 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:25.192439 | orchestrator | 2026-04-28 02:58:25.192445 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:58:25.192450 | orchestrator | Tuesday 28 April 2026 02:58:18 +0000 (0:00:00.251) 0:00:02.265 ********* 2026-04-28 02:58:25.192456 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:25.192462 | orchestrator | 2026-04-28 02:58:25.192468 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:58:25.192473 | orchestrator | Tuesday 28 April 2026 02:58:18 +0000 (0:00:00.222) 0:00:02.488 ********* 2026-04-28 02:58:25.192479 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:25.192485 | orchestrator | 2026-04-28 02:58:25.192490 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:58:25.192496 | orchestrator | Tuesday 28 April 2026 02:58:18 +0000 (0:00:00.218) 0:00:02.706 ********* 2026-04-28 02:58:25.192502 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:25.192508 | orchestrator | 2026-04-28 02:58:25.192514 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:58:25.192519 | orchestrator | Tuesday 28 April 2026 02:58:19 +0000 (0:00:00.214) 0:00:02.920 ********* 2026-04-28 02:58:25.192525 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:25.192531 | orchestrator | 2026-04-28 02:58:25.192537 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:58:25.192543 | orchestrator | Tuesday 28 April 2026 02:58:19 +0000 (0:00:00.227) 0:00:03.148 ********* 2026-04-28 02:58:25.192548 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:25.192554 | orchestrator | 2026-04-28 02:58:25.192560 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:58:25.192566 | orchestrator | Tuesday 28 April 2026 02:58:19 +0000 (0:00:00.234) 0:00:03.383 ********* 2026-04-28 02:58:25.192572 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e) 2026-04-28 02:58:25.192579 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e) 2026-04-28 02:58:25.192585 | orchestrator | 2026-04-28 02:58:25.192590 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:58:25.192613 | orchestrator | Tuesday 28 April 2026 02:58:20 +0000 (0:00:00.452) 0:00:03.836 ********* 2026-04-28 02:58:25.192619 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202) 2026-04-28 02:58:25.192624 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202) 2026-04-28 02:58:25.192630 | orchestrator | 2026-04-28 02:58:25.192636 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:58:25.192642 | orchestrator | Tuesday 28 April 2026 02:58:20 +0000 (0:00:00.744) 0:00:04.580 ********* 2026-04-28 02:58:25.192648 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675) 2026-04-28 02:58:25.192654 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675) 2026-04-28 02:58:25.192665 | orchestrator | 2026-04-28 02:58:25.192671 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:58:25.192677 | orchestrator | Tuesday 28 April 2026 02:58:21 +0000 (0:00:00.797) 0:00:05.378 ********* 2026-04-28 02:58:25.192682 | orchestrator | ok: [testbed-node-3] => (item=scsi-0QEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c) 2026-04-28 02:58:25.192688 | orchestrator | ok: [testbed-node-3] => (item=scsi-SQEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c) 2026-04-28 02:58:25.192694 | orchestrator | 2026-04-28 02:58:25.192700 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:58:25.192705 | orchestrator | Tuesday 28 April 2026 02:58:22 +0000 (0:00:01.073) 0:00:06.452 ********* 2026-04-28 02:58:25.192711 | orchestrator | ok: [testbed-node-3] => (item=ata-QEMU_DVD-ROM_QM00001) 2026-04-28 02:58:25.192717 | orchestrator | 2026-04-28 02:58:25.192728 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:58:25.192735 | orchestrator | Tuesday 28 April 2026 02:58:23 +0000 (0:00:00.395) 0:00:06.847 ********* 2026-04-28 02:58:25.192741 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop0) 2026-04-28 02:58:25.192746 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop1) 2026-04-28 02:58:25.192752 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop2) 2026-04-28 02:58:25.192758 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop3) 2026-04-28 02:58:25.192764 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop4) 2026-04-28 02:58:25.192770 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop5) 2026-04-28 02:58:25.192775 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop6) 2026-04-28 02:58:25.192781 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=loop7) 2026-04-28 02:58:25.192786 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sda) 2026-04-28 02:58:25.192792 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sdb) 2026-04-28 02:58:25.192798 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sdc) 2026-04-28 02:58:25.192804 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sdd) 2026-04-28 02:58:25.192810 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-3 => (item=sr0) 2026-04-28 02:58:25.192815 | orchestrator | 2026-04-28 02:58:25.192821 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:58:25.192827 | orchestrator | Tuesday 28 April 2026 02:58:23 +0000 (0:00:00.441) 0:00:07.288 ********* 2026-04-28 02:58:25.192833 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:25.192838 | orchestrator | 2026-04-28 02:58:25.192844 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:58:25.192850 | orchestrator | Tuesday 28 April 2026 02:58:23 +0000 (0:00:00.211) 0:00:07.499 ********* 2026-04-28 02:58:25.192856 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:25.192861 | orchestrator | 2026-04-28 02:58:25.192867 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:58:25.192873 | orchestrator | Tuesday 28 April 2026 02:58:23 +0000 (0:00:00.270) 0:00:07.770 ********* 2026-04-28 02:58:25.192880 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:25.192886 | orchestrator | 2026-04-28 02:58:25.192893 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:58:25.192899 | orchestrator | Tuesday 28 April 2026 02:58:24 +0000 (0:00:00.236) 0:00:08.006 ********* 2026-04-28 02:58:25.192905 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:25.192912 | orchestrator | 2026-04-28 02:58:25.192923 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:58:25.192929 | orchestrator | Tuesday 28 April 2026 02:58:24 +0000 (0:00:00.243) 0:00:08.250 ********* 2026-04-28 02:58:25.192936 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:25.192942 | orchestrator | 2026-04-28 02:58:25.192949 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:58:25.192955 | orchestrator | Tuesday 28 April 2026 02:58:24 +0000 (0:00:00.221) 0:00:08.471 ********* 2026-04-28 02:58:25.192962 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:25.192968 | orchestrator | 2026-04-28 02:58:25.192974 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:58:25.192980 | orchestrator | Tuesday 28 April 2026 02:58:24 +0000 (0:00:00.236) 0:00:08.708 ********* 2026-04-28 02:58:25.192987 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:25.192993 | orchestrator | 2026-04-28 02:58:25.193002 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:58:34.160455 | orchestrator | Tuesday 28 April 2026 02:58:25 +0000 (0:00:00.251) 0:00:08.959 ********* 2026-04-28 02:58:34.160580 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:34.160602 | orchestrator | 2026-04-28 02:58:34.160619 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:58:34.160633 | orchestrator | Tuesday 28 April 2026 02:58:25 +0000 (0:00:00.766) 0:00:09.726 ********* 2026-04-28 02:58:34.160647 | orchestrator | ok: [testbed-node-3] => (item=sda1) 2026-04-28 02:58:34.160662 | orchestrator | ok: [testbed-node-3] => (item=sda14) 2026-04-28 02:58:34.160676 | orchestrator | ok: [testbed-node-3] => (item=sda15) 2026-04-28 02:58:34.160689 | orchestrator | ok: [testbed-node-3] => (item=sda16) 2026-04-28 02:58:34.160703 | orchestrator | 2026-04-28 02:58:34.160717 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:58:34.160731 | orchestrator | Tuesday 28 April 2026 02:58:26 +0000 (0:00:00.757) 0:00:10.484 ********* 2026-04-28 02:58:34.160743 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:34.160756 | orchestrator | 2026-04-28 02:58:34.160769 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:58:34.160784 | orchestrator | Tuesday 28 April 2026 02:58:26 +0000 (0:00:00.232) 0:00:10.716 ********* 2026-04-28 02:58:34.160798 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:34.160813 | orchestrator | 2026-04-28 02:58:34.160828 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:58:34.160842 | orchestrator | Tuesday 28 April 2026 02:58:27 +0000 (0:00:00.289) 0:00:11.006 ********* 2026-04-28 02:58:34.160857 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:34.160872 | orchestrator | 2026-04-28 02:58:34.160886 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:58:34.160923 | orchestrator | Tuesday 28 April 2026 02:58:27 +0000 (0:00:00.238) 0:00:11.244 ********* 2026-04-28 02:58:34.160938 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:34.160952 | orchestrator | 2026-04-28 02:58:34.160967 | orchestrator | TASK [Check whether ceph_db_wal_devices is used exclusively] ******************* 2026-04-28 02:58:34.160982 | orchestrator | Tuesday 28 April 2026 02:58:27 +0000 (0:00:00.204) 0:00:11.449 ********* 2026-04-28 02:58:34.160999 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:34.161014 | orchestrator | 2026-04-28 02:58:34.161030 | orchestrator | TASK [Create dict of block VGs -> PVs from ceph_osd_devices] ******************* 2026-04-28 02:58:34.161042 | orchestrator | Tuesday 28 April 2026 02:58:27 +0000 (0:00:00.161) 0:00:11.610 ********* 2026-04-28 02:58:34.161053 | orchestrator | ok: [testbed-node-3] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': 'b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'}}) 2026-04-28 02:58:34.161065 | orchestrator | ok: [testbed-node-3] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'be99929f-8eb5-5413-bbfd-d844b44bc4d1'}}) 2026-04-28 02:58:34.161075 | orchestrator | 2026-04-28 02:58:34.161085 | orchestrator | TASK [Create block VGs] ******************************************************** 2026-04-28 02:58:34.161095 | orchestrator | Tuesday 28 April 2026 02:58:28 +0000 (0:00:00.221) 0:00:11.832 ********* 2026-04-28 02:58:34.161126 | orchestrator | changed: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'}) 2026-04-28 02:58:34.161138 | orchestrator | changed: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'}) 2026-04-28 02:58:34.161149 | orchestrator | 2026-04-28 02:58:34.161159 | orchestrator | TASK [Print 'Create block VGs'] ************************************************ 2026-04-28 02:58:34.161169 | orchestrator | Tuesday 28 April 2026 02:58:30 +0000 (0:00:02.100) 0:00:13.932 ********* 2026-04-28 02:58:34.161179 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 02:58:34.161191 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 02:58:34.161201 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:34.161211 | orchestrator | 2026-04-28 02:58:34.161252 | orchestrator | TASK [Create block LVs] ******************************************************** 2026-04-28 02:58:34.161268 | orchestrator | Tuesday 28 April 2026 02:58:30 +0000 (0:00:00.186) 0:00:14.118 ********* 2026-04-28 02:58:34.161276 | orchestrator | changed: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'}) 2026-04-28 02:58:34.161285 | orchestrator | changed: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'}) 2026-04-28 02:58:34.161294 | orchestrator | 2026-04-28 02:58:34.161302 | orchestrator | TASK [Print 'Create block LVs'] ************************************************ 2026-04-28 02:58:34.161311 | orchestrator | Tuesday 28 April 2026 02:58:31 +0000 (0:00:01.543) 0:00:15.661 ********* 2026-04-28 02:58:34.161319 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 02:58:34.161328 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 02:58:34.161337 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:34.161346 | orchestrator | 2026-04-28 02:58:34.161354 | orchestrator | TASK [Create DB VGs] *********************************************************** 2026-04-28 02:58:34.161363 | orchestrator | Tuesday 28 April 2026 02:58:32 +0000 (0:00:00.182) 0:00:15.844 ********* 2026-04-28 02:58:34.161392 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:34.161402 | orchestrator | 2026-04-28 02:58:34.161411 | orchestrator | TASK [Print 'Create DB VGs'] *************************************************** 2026-04-28 02:58:34.161419 | orchestrator | Tuesday 28 April 2026 02:58:32 +0000 (0:00:00.406) 0:00:16.250 ********* 2026-04-28 02:58:34.161428 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 02:58:34.161437 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 02:58:34.161445 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:34.161454 | orchestrator | 2026-04-28 02:58:34.161463 | orchestrator | TASK [Create WAL VGs] ********************************************************** 2026-04-28 02:58:34.161471 | orchestrator | Tuesday 28 April 2026 02:58:32 +0000 (0:00:00.179) 0:00:16.430 ********* 2026-04-28 02:58:34.161480 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:34.161488 | orchestrator | 2026-04-28 02:58:34.161496 | orchestrator | TASK [Print 'Create WAL VGs'] ************************************************** 2026-04-28 02:58:34.161504 | orchestrator | Tuesday 28 April 2026 02:58:32 +0000 (0:00:00.175) 0:00:16.605 ********* 2026-04-28 02:58:34.161522 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 02:58:34.161537 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 02:58:34.161545 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:34.161553 | orchestrator | 2026-04-28 02:58:34.161561 | orchestrator | TASK [Create DB+WAL VGs] ******************************************************* 2026-04-28 02:58:34.161569 | orchestrator | Tuesday 28 April 2026 02:58:32 +0000 (0:00:00.166) 0:00:16.772 ********* 2026-04-28 02:58:34.161576 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:34.161584 | orchestrator | 2026-04-28 02:58:34.161592 | orchestrator | TASK [Print 'Create DB+WAL VGs'] *********************************************** 2026-04-28 02:58:34.161600 | orchestrator | Tuesday 28 April 2026 02:58:33 +0000 (0:00:00.137) 0:00:16.910 ********* 2026-04-28 02:58:34.161608 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 02:58:34.161616 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 02:58:34.161624 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:34.161632 | orchestrator | 2026-04-28 02:58:34.161640 | orchestrator | TASK [Prepare variables for OSD count check] *********************************** 2026-04-28 02:58:34.161648 | orchestrator | Tuesday 28 April 2026 02:58:33 +0000 (0:00:00.169) 0:00:17.079 ********* 2026-04-28 02:58:34.161656 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:58:34.161664 | orchestrator | 2026-04-28 02:58:34.161672 | orchestrator | TASK [Count OSDs put on ceph_db_devices defined in lvm_volumes] **************** 2026-04-28 02:58:34.161680 | orchestrator | Tuesday 28 April 2026 02:58:33 +0000 (0:00:00.175) 0:00:17.255 ********* 2026-04-28 02:58:34.161688 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 02:58:34.161696 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 02:58:34.161704 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:34.161712 | orchestrator | 2026-04-28 02:58:34.161719 | orchestrator | TASK [Count OSDs put on ceph_wal_devices defined in lvm_volumes] *************** 2026-04-28 02:58:34.161727 | orchestrator | Tuesday 28 April 2026 02:58:33 +0000 (0:00:00.179) 0:00:17.434 ********* 2026-04-28 02:58:34.161735 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 02:58:34.161743 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 02:58:34.161751 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:34.161759 | orchestrator | 2026-04-28 02:58:34.161767 | orchestrator | TASK [Count OSDs put on ceph_db_wal_devices defined in lvm_volumes] ************ 2026-04-28 02:58:34.161774 | orchestrator | Tuesday 28 April 2026 02:58:33 +0000 (0:00:00.171) 0:00:17.605 ********* 2026-04-28 02:58:34.161782 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 02:58:34.161790 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 02:58:34.161798 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:34.161806 | orchestrator | 2026-04-28 02:58:34.161814 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a DB VG] ********************* 2026-04-28 02:58:34.161821 | orchestrator | Tuesday 28 April 2026 02:58:33 +0000 (0:00:00.172) 0:00:17.778 ********* 2026-04-28 02:58:34.161836 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:34.161844 | orchestrator | 2026-04-28 02:58:34.161851 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a WAL VG] ******************** 2026-04-28 02:58:34.161865 | orchestrator | Tuesday 28 April 2026 02:58:34 +0000 (0:00:00.156) 0:00:17.935 ********* 2026-04-28 02:58:41.369603 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.369758 | orchestrator | 2026-04-28 02:58:41.369776 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a DB+WAL VG] ***************** 2026-04-28 02:58:41.369789 | orchestrator | Tuesday 28 April 2026 02:58:34 +0000 (0:00:00.148) 0:00:18.084 ********* 2026-04-28 02:58:41.369799 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.369810 | orchestrator | 2026-04-28 02:58:41.369820 | orchestrator | TASK [Print number of OSDs wanted per DB VG] *********************************** 2026-04-28 02:58:41.369843 | orchestrator | Tuesday 28 April 2026 02:58:34 +0000 (0:00:00.403) 0:00:18.487 ********* 2026-04-28 02:58:41.369893 | orchestrator | ok: [testbed-node-3] => { 2026-04-28 02:58:41.369902 | orchestrator |  "_num_osds_wanted_per_db_vg": {} 2026-04-28 02:58:41.369909 | orchestrator | } 2026-04-28 02:58:41.369915 | orchestrator | 2026-04-28 02:58:41.369922 | orchestrator | TASK [Print number of OSDs wanted per WAL VG] ********************************** 2026-04-28 02:58:41.369928 | orchestrator | Tuesday 28 April 2026 02:58:34 +0000 (0:00:00.156) 0:00:18.644 ********* 2026-04-28 02:58:41.369934 | orchestrator | ok: [testbed-node-3] => { 2026-04-28 02:58:41.369940 | orchestrator |  "_num_osds_wanted_per_wal_vg": {} 2026-04-28 02:58:41.369947 | orchestrator | } 2026-04-28 02:58:41.369957 | orchestrator | 2026-04-28 02:58:41.369966 | orchestrator | TASK [Print number of OSDs wanted per DB+WAL VG] ******************************* 2026-04-28 02:58:41.369975 | orchestrator | Tuesday 28 April 2026 02:58:35 +0000 (0:00:00.170) 0:00:18.814 ********* 2026-04-28 02:58:41.369984 | orchestrator | ok: [testbed-node-3] => { 2026-04-28 02:58:41.369994 | orchestrator |  "_num_osds_wanted_per_db_wal_vg": {} 2026-04-28 02:58:41.370004 | orchestrator | } 2026-04-28 02:58:41.370070 | orchestrator | 2026-04-28 02:58:41.370088 | orchestrator | TASK [Gather DB VGs with total and available size in bytes] ******************** 2026-04-28 02:58:41.370114 | orchestrator | Tuesday 28 April 2026 02:58:35 +0000 (0:00:00.162) 0:00:18.977 ********* 2026-04-28 02:58:41.370124 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:58:41.370136 | orchestrator | 2026-04-28 02:58:41.370149 | orchestrator | TASK [Gather WAL VGs with total and available size in bytes] ******************* 2026-04-28 02:58:41.370159 | orchestrator | Tuesday 28 April 2026 02:58:35 +0000 (0:00:00.689) 0:00:19.666 ********* 2026-04-28 02:58:41.370168 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:58:41.370178 | orchestrator | 2026-04-28 02:58:41.370187 | orchestrator | TASK [Gather DB+WAL VGs with total and available size in bytes] **************** 2026-04-28 02:58:41.370196 | orchestrator | Tuesday 28 April 2026 02:58:36 +0000 (0:00:00.570) 0:00:20.237 ********* 2026-04-28 02:58:41.370205 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:58:41.370235 | orchestrator | 2026-04-28 02:58:41.370245 | orchestrator | TASK [Combine JSON from _db/wal/db_wal_vgs_cmd_output] ************************* 2026-04-28 02:58:41.370255 | orchestrator | Tuesday 28 April 2026 02:58:36 +0000 (0:00:00.545) 0:00:20.782 ********* 2026-04-28 02:58:41.370265 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:58:41.370274 | orchestrator | 2026-04-28 02:58:41.370283 | orchestrator | TASK [Calculate VG sizes (without buffer)] ************************************* 2026-04-28 02:58:41.370292 | orchestrator | Tuesday 28 April 2026 02:58:37 +0000 (0:00:00.161) 0:00:20.944 ********* 2026-04-28 02:58:41.370302 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.370311 | orchestrator | 2026-04-28 02:58:41.370321 | orchestrator | TASK [Calculate VG sizes (with buffer)] **************************************** 2026-04-28 02:58:41.370331 | orchestrator | Tuesday 28 April 2026 02:58:37 +0000 (0:00:00.135) 0:00:21.080 ********* 2026-04-28 02:58:41.370340 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.370350 | orchestrator | 2026-04-28 02:58:41.370359 | orchestrator | TASK [Print LVM VGs report data] *********************************************** 2026-04-28 02:58:41.370368 | orchestrator | Tuesday 28 April 2026 02:58:37 +0000 (0:00:00.140) 0:00:21.220 ********* 2026-04-28 02:58:41.370396 | orchestrator | ok: [testbed-node-3] => { 2026-04-28 02:58:41.370403 | orchestrator |  "vgs_report": { 2026-04-28 02:58:41.370410 | orchestrator |  "vg": [] 2026-04-28 02:58:41.370416 | orchestrator |  } 2026-04-28 02:58:41.370422 | orchestrator | } 2026-04-28 02:58:41.370428 | orchestrator | 2026-04-28 02:58:41.370433 | orchestrator | TASK [Print LVM VG sizes] ****************************************************** 2026-04-28 02:58:41.370439 | orchestrator | Tuesday 28 April 2026 02:58:37 +0000 (0:00:00.151) 0:00:21.371 ********* 2026-04-28 02:58:41.370445 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.370451 | orchestrator | 2026-04-28 02:58:41.370457 | orchestrator | TASK [Calculate size needed for LVs on ceph_db_devices] ************************ 2026-04-28 02:58:41.370463 | orchestrator | Tuesday 28 April 2026 02:58:37 +0000 (0:00:00.150) 0:00:21.521 ********* 2026-04-28 02:58:41.370469 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.370475 | orchestrator | 2026-04-28 02:58:41.370480 | orchestrator | TASK [Print size needed for LVs on ceph_db_devices] **************************** 2026-04-28 02:58:41.370486 | orchestrator | Tuesday 28 April 2026 02:58:38 +0000 (0:00:00.386) 0:00:21.908 ********* 2026-04-28 02:58:41.370492 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.370498 | orchestrator | 2026-04-28 02:58:41.370503 | orchestrator | TASK [Fail if size of DB LVs on ceph_db_devices > available] ******************* 2026-04-28 02:58:41.370509 | orchestrator | Tuesday 28 April 2026 02:58:38 +0000 (0:00:00.147) 0:00:22.056 ********* 2026-04-28 02:58:41.370515 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.370521 | orchestrator | 2026-04-28 02:58:41.370527 | orchestrator | TASK [Calculate size needed for LVs on ceph_wal_devices] *********************** 2026-04-28 02:58:41.370532 | orchestrator | Tuesday 28 April 2026 02:58:38 +0000 (0:00:00.156) 0:00:22.212 ********* 2026-04-28 02:58:41.370538 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.370543 | orchestrator | 2026-04-28 02:58:41.370549 | orchestrator | TASK [Print size needed for LVs on ceph_wal_devices] *************************** 2026-04-28 02:58:41.370555 | orchestrator | Tuesday 28 April 2026 02:58:38 +0000 (0:00:00.143) 0:00:22.356 ********* 2026-04-28 02:58:41.370561 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.370566 | orchestrator | 2026-04-28 02:58:41.370572 | orchestrator | TASK [Fail if size of WAL LVs on ceph_wal_devices > available] ***************** 2026-04-28 02:58:41.370578 | orchestrator | Tuesday 28 April 2026 02:58:38 +0000 (0:00:00.149) 0:00:22.506 ********* 2026-04-28 02:58:41.370584 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.370590 | orchestrator | 2026-04-28 02:58:41.370596 | orchestrator | TASK [Calculate size needed for WAL LVs on ceph_db_wal_devices] **************** 2026-04-28 02:58:41.370602 | orchestrator | Tuesday 28 April 2026 02:58:38 +0000 (0:00:00.165) 0:00:22.672 ********* 2026-04-28 02:58:41.370627 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.370633 | orchestrator | 2026-04-28 02:58:41.370639 | orchestrator | TASK [Print size needed for WAL LVs on ceph_db_wal_devices] ******************** 2026-04-28 02:58:41.370644 | orchestrator | Tuesday 28 April 2026 02:58:39 +0000 (0:00:00.160) 0:00:22.832 ********* 2026-04-28 02:58:41.370650 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.370656 | orchestrator | 2026-04-28 02:58:41.370662 | orchestrator | TASK [Calculate size needed for DB LVs on ceph_db_wal_devices] ***************** 2026-04-28 02:58:41.370668 | orchestrator | Tuesday 28 April 2026 02:58:39 +0000 (0:00:00.146) 0:00:22.979 ********* 2026-04-28 02:58:41.370674 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.370680 | orchestrator | 2026-04-28 02:58:41.370686 | orchestrator | TASK [Print size needed for DB LVs on ceph_db_wal_devices] ********************* 2026-04-28 02:58:41.370691 | orchestrator | Tuesday 28 April 2026 02:58:39 +0000 (0:00:00.157) 0:00:23.137 ********* 2026-04-28 02:58:41.370697 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.370703 | orchestrator | 2026-04-28 02:58:41.370709 | orchestrator | TASK [Fail if size of DB+WAL LVs on ceph_db_wal_devices > available] *********** 2026-04-28 02:58:41.370715 | orchestrator | Tuesday 28 April 2026 02:58:39 +0000 (0:00:00.145) 0:00:23.283 ********* 2026-04-28 02:58:41.370726 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.370732 | orchestrator | 2026-04-28 02:58:41.370738 | orchestrator | TASK [Fail if DB LV size < 30 GiB for ceph_db_devices] ************************* 2026-04-28 02:58:41.370744 | orchestrator | Tuesday 28 April 2026 02:58:39 +0000 (0:00:00.157) 0:00:23.440 ********* 2026-04-28 02:58:41.370750 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.370755 | orchestrator | 2026-04-28 02:58:41.370761 | orchestrator | TASK [Fail if DB LV size < 30 GiB for ceph_db_wal_devices] ********************* 2026-04-28 02:58:41.370773 | orchestrator | Tuesday 28 April 2026 02:58:39 +0000 (0:00:00.154) 0:00:23.595 ********* 2026-04-28 02:58:41.370779 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.370785 | orchestrator | 2026-04-28 02:58:41.370791 | orchestrator | TASK [Create DB LVs for ceph_db_devices] *************************************** 2026-04-28 02:58:41.370796 | orchestrator | Tuesday 28 April 2026 02:58:40 +0000 (0:00:00.477) 0:00:24.073 ********* 2026-04-28 02:58:41.370803 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 02:58:41.370811 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 02:58:41.370817 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.370823 | orchestrator | 2026-04-28 02:58:41.370828 | orchestrator | TASK [Print 'Create DB LVs for ceph_db_devices'] ******************************* 2026-04-28 02:58:41.370834 | orchestrator | Tuesday 28 April 2026 02:58:40 +0000 (0:00:00.175) 0:00:24.249 ********* 2026-04-28 02:58:41.370840 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 02:58:41.370846 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 02:58:41.370852 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.370857 | orchestrator | 2026-04-28 02:58:41.370863 | orchestrator | TASK [Create WAL LVs for ceph_wal_devices] ************************************* 2026-04-28 02:58:41.370869 | orchestrator | Tuesday 28 April 2026 02:58:40 +0000 (0:00:00.182) 0:00:24.431 ********* 2026-04-28 02:58:41.370875 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 02:58:41.370881 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 02:58:41.370887 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.370893 | orchestrator | 2026-04-28 02:58:41.370898 | orchestrator | TASK [Print 'Create WAL LVs for ceph_wal_devices'] ***************************** 2026-04-28 02:58:41.370904 | orchestrator | Tuesday 28 April 2026 02:58:40 +0000 (0:00:00.174) 0:00:24.606 ********* 2026-04-28 02:58:41.370910 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 02:58:41.370916 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 02:58:41.370922 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.370927 | orchestrator | 2026-04-28 02:58:41.370933 | orchestrator | TASK [Create WAL LVs for ceph_db_wal_devices] ********************************** 2026-04-28 02:58:41.370939 | orchestrator | Tuesday 28 April 2026 02:58:41 +0000 (0:00:00.183) 0:00:24.790 ********* 2026-04-28 02:58:41.370945 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 02:58:41.370950 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 02:58:41.370960 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:41.370966 | orchestrator | 2026-04-28 02:58:41.370972 | orchestrator | TASK [Print 'Create WAL LVs for ceph_db_wal_devices'] ************************** 2026-04-28 02:58:41.370978 | orchestrator | Tuesday 28 April 2026 02:58:41 +0000 (0:00:00.180) 0:00:24.971 ********* 2026-04-28 02:58:41.370988 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 02:58:47.337649 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 02:58:47.337758 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:47.337774 | orchestrator | 2026-04-28 02:58:47.337787 | orchestrator | TASK [Create DB LVs for ceph_db_wal_devices] *********************************** 2026-04-28 02:58:47.337800 | orchestrator | Tuesday 28 April 2026 02:58:41 +0000 (0:00:00.173) 0:00:25.144 ********* 2026-04-28 02:58:47.337811 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 02:58:47.337824 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 02:58:47.337843 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:47.337860 | orchestrator | 2026-04-28 02:58:47.337886 | orchestrator | TASK [Print 'Create DB LVs for ceph_db_wal_devices'] *************************** 2026-04-28 02:58:47.337907 | orchestrator | Tuesday 28 April 2026 02:58:41 +0000 (0:00:00.174) 0:00:25.318 ********* 2026-04-28 02:58:47.337925 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 02:58:47.337966 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 02:58:47.337983 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:47.338001 | orchestrator | 2026-04-28 02:58:47.338096 | orchestrator | TASK [Get list of Ceph LVs with associated VGs] ******************************** 2026-04-28 02:58:47.338121 | orchestrator | Tuesday 28 April 2026 02:58:41 +0000 (0:00:00.195) 0:00:25.514 ********* 2026-04-28 02:58:47.338140 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:58:47.338159 | orchestrator | 2026-04-28 02:58:47.338178 | orchestrator | TASK [Get list of Ceph PVs with associated VGs] ******************************** 2026-04-28 02:58:47.338199 | orchestrator | Tuesday 28 April 2026 02:58:42 +0000 (0:00:00.567) 0:00:26.081 ********* 2026-04-28 02:58:47.338247 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:58:47.338260 | orchestrator | 2026-04-28 02:58:47.338272 | orchestrator | TASK [Combine JSON from _lvs_cmd_output/_pvs_cmd_output] *********************** 2026-04-28 02:58:47.338284 | orchestrator | Tuesday 28 April 2026 02:58:42 +0000 (0:00:00.562) 0:00:26.643 ********* 2026-04-28 02:58:47.338297 | orchestrator | ok: [testbed-node-3] 2026-04-28 02:58:47.338310 | orchestrator | 2026-04-28 02:58:47.338323 | orchestrator | TASK [Create list of VG/LV names] ********************************************** 2026-04-28 02:58:47.338335 | orchestrator | Tuesday 28 April 2026 02:58:43 +0000 (0:00:00.147) 0:00:26.791 ********* 2026-04-28 02:58:47.338347 | orchestrator | ok: [testbed-node-3] => (item={'lv_name': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'vg_name': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'}) 2026-04-28 02:58:47.338362 | orchestrator | ok: [testbed-node-3] => (item={'lv_name': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'vg_name': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'}) 2026-04-28 02:58:47.338375 | orchestrator | 2026-04-28 02:58:47.338387 | orchestrator | TASK [Fail if block LV defined in lvm_volumes is missing] ********************** 2026-04-28 02:58:47.338399 | orchestrator | Tuesday 28 April 2026 02:58:43 +0000 (0:00:00.185) 0:00:26.977 ********* 2026-04-28 02:58:47.338411 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 02:58:47.338452 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 02:58:47.338465 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:47.338602 | orchestrator | 2026-04-28 02:58:47.338615 | orchestrator | TASK [Fail if DB LV defined in lvm_volumes is missing] ************************* 2026-04-28 02:58:47.338627 | orchestrator | Tuesday 28 April 2026 02:58:43 +0000 (0:00:00.428) 0:00:27.405 ********* 2026-04-28 02:58:47.338638 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 02:58:47.338649 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 02:58:47.338660 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:47.338670 | orchestrator | 2026-04-28 02:58:47.338681 | orchestrator | TASK [Fail if WAL LV defined in lvm_volumes is missing] ************************ 2026-04-28 02:58:47.338692 | orchestrator | Tuesday 28 April 2026 02:58:43 +0000 (0:00:00.176) 0:00:27.582 ********* 2026-04-28 02:58:47.338703 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 02:58:47.338714 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 02:58:47.338725 | orchestrator | skipping: [testbed-node-3] 2026-04-28 02:58:47.338736 | orchestrator | 2026-04-28 02:58:47.338746 | orchestrator | TASK [Print LVM report data] *************************************************** 2026-04-28 02:58:47.338757 | orchestrator | Tuesday 28 April 2026 02:58:43 +0000 (0:00:00.166) 0:00:27.748 ********* 2026-04-28 02:58:47.338792 | orchestrator | ok: [testbed-node-3] => { 2026-04-28 02:58:47.338803 | orchestrator |  "lvm_report": { 2026-04-28 02:58:47.338815 | orchestrator |  "lv": [ 2026-04-28 02:58:47.338826 | orchestrator |  { 2026-04-28 02:58:47.338837 | orchestrator |  "lv_name": "osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f", 2026-04-28 02:58:47.338849 | orchestrator |  "vg_name": "ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f" 2026-04-28 02:58:47.338860 | orchestrator |  }, 2026-04-28 02:58:47.338871 | orchestrator |  { 2026-04-28 02:58:47.338882 | orchestrator |  "lv_name": "osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1", 2026-04-28 02:58:47.338893 | orchestrator |  "vg_name": "ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1" 2026-04-28 02:58:47.338903 | orchestrator |  } 2026-04-28 02:58:47.338914 | orchestrator |  ], 2026-04-28 02:58:47.338925 | orchestrator |  "pv": [ 2026-04-28 02:58:47.338936 | orchestrator |  { 2026-04-28 02:58:47.338947 | orchestrator |  "pv_name": "/dev/sdb", 2026-04-28 02:58:47.338957 | orchestrator |  "vg_name": "ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f" 2026-04-28 02:58:47.338968 | orchestrator |  }, 2026-04-28 02:58:47.338979 | orchestrator |  { 2026-04-28 02:58:47.338989 | orchestrator |  "pv_name": "/dev/sdc", 2026-04-28 02:58:47.339000 | orchestrator |  "vg_name": "ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1" 2026-04-28 02:58:47.339011 | orchestrator |  } 2026-04-28 02:58:47.339022 | orchestrator |  ] 2026-04-28 02:58:47.339033 | orchestrator |  } 2026-04-28 02:58:47.339044 | orchestrator | } 2026-04-28 02:58:47.339055 | orchestrator | 2026-04-28 02:58:47.339066 | orchestrator | PLAY [Ceph create LVM devices] ************************************************* 2026-04-28 02:58:47.339077 | orchestrator | 2026-04-28 02:58:47.339134 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-28 02:58:47.339149 | orchestrator | Tuesday 28 April 2026 02:58:44 +0000 (0:00:00.317) 0:00:28.065 ********* 2026-04-28 02:58:47.339171 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] 2026-04-28 02:58:47.339183 | orchestrator | 2026-04-28 02:58:47.339193 | orchestrator | TASK [Get initial list of available block devices] ***************************** 2026-04-28 02:58:47.339222 | orchestrator | Tuesday 28 April 2026 02:58:44 +0000 (0:00:00.287) 0:00:28.353 ********* 2026-04-28 02:58:47.339234 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:58:47.339245 | orchestrator | 2026-04-28 02:58:47.339255 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:58:47.339266 | orchestrator | Tuesday 28 April 2026 02:58:44 +0000 (0:00:00.271) 0:00:28.625 ********* 2026-04-28 02:58:47.339277 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop0) 2026-04-28 02:58:47.339287 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop1) 2026-04-28 02:58:47.339298 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop2) 2026-04-28 02:58:47.339309 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop3) 2026-04-28 02:58:47.339319 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop4) 2026-04-28 02:58:47.339331 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop5) 2026-04-28 02:58:47.339349 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop6) 2026-04-28 02:58:47.339367 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=loop7) 2026-04-28 02:58:47.339385 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sda) 2026-04-28 02:58:47.339403 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sdb) 2026-04-28 02:58:47.339422 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sdc) 2026-04-28 02:58:47.339440 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sdd) 2026-04-28 02:58:47.339459 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-4 => (item=sr0) 2026-04-28 02:58:47.339472 | orchestrator | 2026-04-28 02:58:47.339483 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:58:47.339493 | orchestrator | Tuesday 28 April 2026 02:58:45 +0000 (0:00:00.481) 0:00:29.106 ********* 2026-04-28 02:58:47.339504 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:58:47.339515 | orchestrator | 2026-04-28 02:58:47.339525 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:58:47.339536 | orchestrator | Tuesday 28 April 2026 02:58:45 +0000 (0:00:00.246) 0:00:29.353 ********* 2026-04-28 02:58:47.339547 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:58:47.339558 | orchestrator | 2026-04-28 02:58:47.339568 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:58:47.339579 | orchestrator | Tuesday 28 April 2026 02:58:46 +0000 (0:00:00.762) 0:00:30.115 ********* 2026-04-28 02:58:47.339590 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:58:47.339601 | orchestrator | 2026-04-28 02:58:47.339612 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:58:47.339622 | orchestrator | Tuesday 28 April 2026 02:58:46 +0000 (0:00:00.269) 0:00:30.384 ********* 2026-04-28 02:58:47.339633 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:58:47.339644 | orchestrator | 2026-04-28 02:58:47.339654 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:58:47.339702 | orchestrator | Tuesday 28 April 2026 02:58:46 +0000 (0:00:00.250) 0:00:30.635 ********* 2026-04-28 02:58:47.339716 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:58:47.339727 | orchestrator | 2026-04-28 02:58:47.339738 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:58:47.339748 | orchestrator | Tuesday 28 April 2026 02:58:47 +0000 (0:00:00.240) 0:00:30.876 ********* 2026-04-28 02:58:47.339773 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:58:47.339784 | orchestrator | 2026-04-28 02:58:47.339804 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:59:00.012805 | orchestrator | Tuesday 28 April 2026 02:58:47 +0000 (0:00:00.235) 0:00:31.111 ********* 2026-04-28 02:59:00.012966 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:00.012991 | orchestrator | 2026-04-28 02:59:00.013003 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:59:00.013014 | orchestrator | Tuesday 28 April 2026 02:58:47 +0000 (0:00:00.212) 0:00:31.324 ********* 2026-04-28 02:59:00.013024 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:00.013035 | orchestrator | 2026-04-28 02:59:00.013045 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:59:00.013055 | orchestrator | Tuesday 28 April 2026 02:58:47 +0000 (0:00:00.235) 0:00:31.560 ********* 2026-04-28 02:59:00.013065 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb) 2026-04-28 02:59:00.013077 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb) 2026-04-28 02:59:00.013086 | orchestrator | 2026-04-28 02:59:00.013096 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:59:00.013106 | orchestrator | Tuesday 28 April 2026 02:58:48 +0000 (0:00:00.469) 0:00:32.029 ********* 2026-04-28 02:59:00.013115 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b) 2026-04-28 02:59:00.013142 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b) 2026-04-28 02:59:00.013152 | orchestrator | 2026-04-28 02:59:00.013162 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:59:00.013172 | orchestrator | Tuesday 28 April 2026 02:58:48 +0000 (0:00:00.491) 0:00:32.521 ********* 2026-04-28 02:59:00.013181 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba) 2026-04-28 02:59:00.013217 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba) 2026-04-28 02:59:00.013236 | orchestrator | 2026-04-28 02:59:00.013246 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:59:00.013256 | orchestrator | Tuesday 28 April 2026 02:58:49 +0000 (0:00:00.493) 0:00:33.015 ********* 2026-04-28 02:59:00.013265 | orchestrator | ok: [testbed-node-4] => (item=scsi-0QEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80) 2026-04-28 02:59:00.013275 | orchestrator | ok: [testbed-node-4] => (item=scsi-SQEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80) 2026-04-28 02:59:00.013285 | orchestrator | 2026-04-28 02:59:00.013297 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:59:00.013309 | orchestrator | Tuesday 28 April 2026 02:58:49 +0000 (0:00:00.738) 0:00:33.754 ********* 2026-04-28 02:59:00.013321 | orchestrator | ok: [testbed-node-4] => (item=ata-QEMU_DVD-ROM_QM00001) 2026-04-28 02:59:00.013332 | orchestrator | 2026-04-28 02:59:00.013344 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:00.013355 | orchestrator | Tuesday 28 April 2026 02:58:50 +0000 (0:00:00.691) 0:00:34.445 ********* 2026-04-28 02:59:00.013366 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop0) 2026-04-28 02:59:00.013379 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop1) 2026-04-28 02:59:00.013390 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop2) 2026-04-28 02:59:00.013401 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop3) 2026-04-28 02:59:00.013412 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop4) 2026-04-28 02:59:00.013423 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop5) 2026-04-28 02:59:00.013460 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop6) 2026-04-28 02:59:00.013473 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=loop7) 2026-04-28 02:59:00.013484 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sda) 2026-04-28 02:59:00.013495 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sdb) 2026-04-28 02:59:00.013508 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sdc) 2026-04-28 02:59:00.013525 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sdd) 2026-04-28 02:59:00.013539 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-4 => (item=sr0) 2026-04-28 02:59:00.013551 | orchestrator | 2026-04-28 02:59:00.013563 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:00.013574 | orchestrator | Tuesday 28 April 2026 02:58:51 +0000 (0:00:00.988) 0:00:35.434 ********* 2026-04-28 02:59:00.013585 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:00.013596 | orchestrator | 2026-04-28 02:59:00.013608 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:00.013619 | orchestrator | Tuesday 28 April 2026 02:58:51 +0000 (0:00:00.226) 0:00:35.661 ********* 2026-04-28 02:59:00.013630 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:00.013642 | orchestrator | 2026-04-28 02:59:00.013653 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:00.013663 | orchestrator | Tuesday 28 April 2026 02:58:52 +0000 (0:00:00.215) 0:00:35.876 ********* 2026-04-28 02:59:00.013672 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:00.013682 | orchestrator | 2026-04-28 02:59:00.013711 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:00.013721 | orchestrator | Tuesday 28 April 2026 02:58:52 +0000 (0:00:00.218) 0:00:36.094 ********* 2026-04-28 02:59:00.013731 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:00.013741 | orchestrator | 2026-04-28 02:59:00.013750 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:00.013760 | orchestrator | Tuesday 28 April 2026 02:58:52 +0000 (0:00:00.216) 0:00:36.311 ********* 2026-04-28 02:59:00.013769 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:00.013778 | orchestrator | 2026-04-28 02:59:00.013788 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:00.013798 | orchestrator | Tuesday 28 April 2026 02:58:52 +0000 (0:00:00.229) 0:00:36.540 ********* 2026-04-28 02:59:00.013807 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:00.013818 | orchestrator | 2026-04-28 02:59:00.013828 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:00.013837 | orchestrator | Tuesday 28 April 2026 02:58:52 +0000 (0:00:00.232) 0:00:36.773 ********* 2026-04-28 02:59:00.013847 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:00.013856 | orchestrator | 2026-04-28 02:59:00.013866 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:00.013875 | orchestrator | Tuesday 28 April 2026 02:58:53 +0000 (0:00:00.220) 0:00:36.993 ********* 2026-04-28 02:59:00.013885 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:00.013894 | orchestrator | 2026-04-28 02:59:00.013912 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:00.013921 | orchestrator | Tuesday 28 April 2026 02:58:53 +0000 (0:00:00.224) 0:00:37.218 ********* 2026-04-28 02:59:00.013931 | orchestrator | ok: [testbed-node-4] => (item=sda1) 2026-04-28 02:59:00.013941 | orchestrator | ok: [testbed-node-4] => (item=sda14) 2026-04-28 02:59:00.013950 | orchestrator | ok: [testbed-node-4] => (item=sda15) 2026-04-28 02:59:00.013960 | orchestrator | ok: [testbed-node-4] => (item=sda16) 2026-04-28 02:59:00.013969 | orchestrator | 2026-04-28 02:59:00.013979 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:00.013996 | orchestrator | Tuesday 28 April 2026 02:58:54 +0000 (0:00:01.030) 0:00:38.248 ********* 2026-04-28 02:59:00.014006 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:00.014093 | orchestrator | 2026-04-28 02:59:00.014116 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:00.014131 | orchestrator | Tuesday 28 April 2026 02:58:55 +0000 (0:00:00.805) 0:00:39.054 ********* 2026-04-28 02:59:00.014144 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:00.014157 | orchestrator | 2026-04-28 02:59:00.014170 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:00.014185 | orchestrator | Tuesday 28 April 2026 02:58:55 +0000 (0:00:00.225) 0:00:39.280 ********* 2026-04-28 02:59:00.014271 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:00.014287 | orchestrator | 2026-04-28 02:59:00.014301 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:00.014316 | orchestrator | Tuesday 28 April 2026 02:58:55 +0000 (0:00:00.217) 0:00:39.497 ********* 2026-04-28 02:59:00.014330 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:00.014346 | orchestrator | 2026-04-28 02:59:00.014361 | orchestrator | TASK [Check whether ceph_db_wal_devices is used exclusively] ******************* 2026-04-28 02:59:00.014377 | orchestrator | Tuesday 28 April 2026 02:58:55 +0000 (0:00:00.252) 0:00:39.750 ********* 2026-04-28 02:59:00.014393 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:00.014408 | orchestrator | 2026-04-28 02:59:00.014423 | orchestrator | TASK [Create dict of block VGs -> PVs from ceph_osd_devices] ******************* 2026-04-28 02:59:00.014438 | orchestrator | Tuesday 28 April 2026 02:58:56 +0000 (0:00:00.154) 0:00:39.905 ********* 2026-04-28 02:59:00.014453 | orchestrator | ok: [testbed-node-4] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': '1455ab40-e845-5ac6-aa29-4f0468cc06bf'}}) 2026-04-28 02:59:00.014470 | orchestrator | ok: [testbed-node-4] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'b3b62482-c8be-5063-9ecc-120425980b0a'}}) 2026-04-28 02:59:00.014486 | orchestrator | 2026-04-28 02:59:00.014501 | orchestrator | TASK [Create block VGs] ******************************************************** 2026-04-28 02:59:00.014516 | orchestrator | Tuesday 28 April 2026 02:58:56 +0000 (0:00:00.205) 0:00:40.110 ********* 2026-04-28 02:59:00.014534 | orchestrator | changed: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'}) 2026-04-28 02:59:00.014551 | orchestrator | changed: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'}) 2026-04-28 02:59:00.014568 | orchestrator | 2026-04-28 02:59:00.014584 | orchestrator | TASK [Print 'Create block VGs'] ************************************************ 2026-04-28 02:59:00.014599 | orchestrator | Tuesday 28 April 2026 02:58:58 +0000 (0:00:02.099) 0:00:42.209 ********* 2026-04-28 02:59:00.014616 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 02:59:00.014633 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 02:59:00.014649 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:00.014664 | orchestrator | 2026-04-28 02:59:00.014680 | orchestrator | TASK [Create block LVs] ******************************************************** 2026-04-28 02:59:00.014697 | orchestrator | Tuesday 28 April 2026 02:58:58 +0000 (0:00:00.165) 0:00:42.375 ********* 2026-04-28 02:59:00.014714 | orchestrator | changed: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'}) 2026-04-28 02:59:00.014768 | orchestrator | changed: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'}) 2026-04-28 02:59:06.197453 | orchestrator | 2026-04-28 02:59:06.197555 | orchestrator | TASK [Print 'Create block LVs'] ************************************************ 2026-04-28 02:59:06.197596 | orchestrator | Tuesday 28 April 2026 02:58:59 +0000 (0:00:01.404) 0:00:43.779 ********* 2026-04-28 02:59:06.197608 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 02:59:06.197620 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 02:59:06.197630 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:06.197641 | orchestrator | 2026-04-28 02:59:06.197651 | orchestrator | TASK [Create DB VGs] *********************************************************** 2026-04-28 02:59:06.197661 | orchestrator | Tuesday 28 April 2026 02:59:00 +0000 (0:00:00.176) 0:00:43.956 ********* 2026-04-28 02:59:06.197671 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:06.197681 | orchestrator | 2026-04-28 02:59:06.197691 | orchestrator | TASK [Print 'Create DB VGs'] *************************************************** 2026-04-28 02:59:06.197717 | orchestrator | Tuesday 28 April 2026 02:59:00 +0000 (0:00:00.155) 0:00:44.111 ********* 2026-04-28 02:59:06.197729 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 02:59:06.197739 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 02:59:06.197749 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:06.197760 | orchestrator | 2026-04-28 02:59:06.197771 | orchestrator | TASK [Create WAL VGs] ********************************************************** 2026-04-28 02:59:06.197781 | orchestrator | Tuesday 28 April 2026 02:59:00 +0000 (0:00:00.160) 0:00:44.271 ********* 2026-04-28 02:59:06.197792 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:06.197802 | orchestrator | 2026-04-28 02:59:06.197813 | orchestrator | TASK [Print 'Create WAL VGs'] ************************************************** 2026-04-28 02:59:06.197824 | orchestrator | Tuesday 28 April 2026 02:59:00 +0000 (0:00:00.414) 0:00:44.686 ********* 2026-04-28 02:59:06.197835 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 02:59:06.197845 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 02:59:06.197856 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:06.197866 | orchestrator | 2026-04-28 02:59:06.197876 | orchestrator | TASK [Create DB+WAL VGs] ******************************************************* 2026-04-28 02:59:06.197888 | orchestrator | Tuesday 28 April 2026 02:59:01 +0000 (0:00:00.175) 0:00:44.862 ********* 2026-04-28 02:59:06.197899 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:06.197909 | orchestrator | 2026-04-28 02:59:06.197919 | orchestrator | TASK [Print 'Create DB+WAL VGs'] *********************************************** 2026-04-28 02:59:06.197930 | orchestrator | Tuesday 28 April 2026 02:59:01 +0000 (0:00:00.151) 0:00:45.014 ********* 2026-04-28 02:59:06.197940 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 02:59:06.197950 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 02:59:06.197961 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:06.197971 | orchestrator | 2026-04-28 02:59:06.197981 | orchestrator | TASK [Prepare variables for OSD count check] *********************************** 2026-04-28 02:59:06.197992 | orchestrator | Tuesday 28 April 2026 02:59:01 +0000 (0:00:00.163) 0:00:45.178 ********* 2026-04-28 02:59:06.198003 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:59:06.198078 | orchestrator | 2026-04-28 02:59:06.198093 | orchestrator | TASK [Count OSDs put on ceph_db_devices defined in lvm_volumes] **************** 2026-04-28 02:59:06.198116 | orchestrator | Tuesday 28 April 2026 02:59:01 +0000 (0:00:00.143) 0:00:45.321 ********* 2026-04-28 02:59:06.198127 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 02:59:06.198138 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 02:59:06.198149 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:06.198160 | orchestrator | 2026-04-28 02:59:06.198170 | orchestrator | TASK [Count OSDs put on ceph_wal_devices defined in lvm_volumes] *************** 2026-04-28 02:59:06.198181 | orchestrator | Tuesday 28 April 2026 02:59:01 +0000 (0:00:00.196) 0:00:45.517 ********* 2026-04-28 02:59:06.198210 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 02:59:06.198221 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 02:59:06.198232 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:06.198242 | orchestrator | 2026-04-28 02:59:06.198252 | orchestrator | TASK [Count OSDs put on ceph_db_wal_devices defined in lvm_volumes] ************ 2026-04-28 02:59:06.198282 | orchestrator | Tuesday 28 April 2026 02:59:01 +0000 (0:00:00.183) 0:00:45.701 ********* 2026-04-28 02:59:06.198293 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 02:59:06.198304 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 02:59:06.198314 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:06.198325 | orchestrator | 2026-04-28 02:59:06.198336 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a DB VG] ********************* 2026-04-28 02:59:06.198346 | orchestrator | Tuesday 28 April 2026 02:59:02 +0000 (0:00:00.172) 0:00:45.874 ********* 2026-04-28 02:59:06.198357 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:06.198367 | orchestrator | 2026-04-28 02:59:06.198377 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a WAL VG] ******************** 2026-04-28 02:59:06.198387 | orchestrator | Tuesday 28 April 2026 02:59:02 +0000 (0:00:00.154) 0:00:46.029 ********* 2026-04-28 02:59:06.198398 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:06.198408 | orchestrator | 2026-04-28 02:59:06.198426 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a DB+WAL VG] ***************** 2026-04-28 02:59:06.198437 | orchestrator | Tuesday 28 April 2026 02:59:02 +0000 (0:00:00.156) 0:00:46.186 ********* 2026-04-28 02:59:06.198447 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:06.198457 | orchestrator | 2026-04-28 02:59:06.198467 | orchestrator | TASK [Print number of OSDs wanted per DB VG] *********************************** 2026-04-28 02:59:06.198478 | orchestrator | Tuesday 28 April 2026 02:59:02 +0000 (0:00:00.154) 0:00:46.340 ********* 2026-04-28 02:59:06.198488 | orchestrator | ok: [testbed-node-4] => { 2026-04-28 02:59:06.198499 | orchestrator |  "_num_osds_wanted_per_db_vg": {} 2026-04-28 02:59:06.198509 | orchestrator | } 2026-04-28 02:59:06.198521 | orchestrator | 2026-04-28 02:59:06.198531 | orchestrator | TASK [Print number of OSDs wanted per WAL VG] ********************************** 2026-04-28 02:59:06.198541 | orchestrator | Tuesday 28 April 2026 02:59:02 +0000 (0:00:00.147) 0:00:46.488 ********* 2026-04-28 02:59:06.198552 | orchestrator | ok: [testbed-node-4] => { 2026-04-28 02:59:06.198562 | orchestrator |  "_num_osds_wanted_per_wal_vg": {} 2026-04-28 02:59:06.198572 | orchestrator | } 2026-04-28 02:59:06.198583 | orchestrator | 2026-04-28 02:59:06.198593 | orchestrator | TASK [Print number of OSDs wanted per DB+WAL VG] ******************************* 2026-04-28 02:59:06.198604 | orchestrator | Tuesday 28 April 2026 02:59:03 +0000 (0:00:00.416) 0:00:46.904 ********* 2026-04-28 02:59:06.198623 | orchestrator | ok: [testbed-node-4] => { 2026-04-28 02:59:06.198634 | orchestrator |  "_num_osds_wanted_per_db_wal_vg": {} 2026-04-28 02:59:06.198644 | orchestrator | } 2026-04-28 02:59:06.198655 | orchestrator | 2026-04-28 02:59:06.198666 | orchestrator | TASK [Gather DB VGs with total and available size in bytes] ******************** 2026-04-28 02:59:06.198676 | orchestrator | Tuesday 28 April 2026 02:59:03 +0000 (0:00:00.146) 0:00:47.051 ********* 2026-04-28 02:59:06.198686 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:59:06.198697 | orchestrator | 2026-04-28 02:59:06.198707 | orchestrator | TASK [Gather WAL VGs with total and available size in bytes] ******************* 2026-04-28 02:59:06.198717 | orchestrator | Tuesday 28 April 2026 02:59:03 +0000 (0:00:00.612) 0:00:47.663 ********* 2026-04-28 02:59:06.198728 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:59:06.198738 | orchestrator | 2026-04-28 02:59:06.198748 | orchestrator | TASK [Gather DB+WAL VGs with total and available size in bytes] **************** 2026-04-28 02:59:06.198758 | orchestrator | Tuesday 28 April 2026 02:59:04 +0000 (0:00:00.562) 0:00:48.226 ********* 2026-04-28 02:59:06.198768 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:59:06.198779 | orchestrator | 2026-04-28 02:59:06.198789 | orchestrator | TASK [Combine JSON from _db/wal/db_wal_vgs_cmd_output] ************************* 2026-04-28 02:59:06.198800 | orchestrator | Tuesday 28 April 2026 02:59:05 +0000 (0:00:00.584) 0:00:48.811 ********* 2026-04-28 02:59:06.198811 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:59:06.198821 | orchestrator | 2026-04-28 02:59:06.198831 | orchestrator | TASK [Calculate VG sizes (without buffer)] ************************************* 2026-04-28 02:59:06.198837 | orchestrator | Tuesday 28 April 2026 02:59:05 +0000 (0:00:00.150) 0:00:48.961 ********* 2026-04-28 02:59:06.198843 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:06.198849 | orchestrator | 2026-04-28 02:59:06.198855 | orchestrator | TASK [Calculate VG sizes (with buffer)] **************************************** 2026-04-28 02:59:06.198861 | orchestrator | Tuesday 28 April 2026 02:59:05 +0000 (0:00:00.128) 0:00:49.090 ********* 2026-04-28 02:59:06.198867 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:06.198874 | orchestrator | 2026-04-28 02:59:06.198880 | orchestrator | TASK [Print LVM VGs report data] *********************************************** 2026-04-28 02:59:06.198886 | orchestrator | Tuesday 28 April 2026 02:59:05 +0000 (0:00:00.123) 0:00:49.214 ********* 2026-04-28 02:59:06.198892 | orchestrator | ok: [testbed-node-4] => { 2026-04-28 02:59:06.198898 | orchestrator |  "vgs_report": { 2026-04-28 02:59:06.198905 | orchestrator |  "vg": [] 2026-04-28 02:59:06.198912 | orchestrator |  } 2026-04-28 02:59:06.198918 | orchestrator | } 2026-04-28 02:59:06.198924 | orchestrator | 2026-04-28 02:59:06.198930 | orchestrator | TASK [Print LVM VG sizes] ****************************************************** 2026-04-28 02:59:06.198936 | orchestrator | Tuesday 28 April 2026 02:59:05 +0000 (0:00:00.146) 0:00:49.360 ********* 2026-04-28 02:59:06.198942 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:06.198949 | orchestrator | 2026-04-28 02:59:06.198955 | orchestrator | TASK [Calculate size needed for LVs on ceph_db_devices] ************************ 2026-04-28 02:59:06.198961 | orchestrator | Tuesday 28 April 2026 02:59:05 +0000 (0:00:00.146) 0:00:49.506 ********* 2026-04-28 02:59:06.198967 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:06.198973 | orchestrator | 2026-04-28 02:59:06.198980 | orchestrator | TASK [Print size needed for LVs on ceph_db_devices] **************************** 2026-04-28 02:59:06.198986 | orchestrator | Tuesday 28 April 2026 02:59:05 +0000 (0:00:00.168) 0:00:49.675 ********* 2026-04-28 02:59:06.198992 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:06.198998 | orchestrator | 2026-04-28 02:59:06.199004 | orchestrator | TASK [Fail if size of DB LVs on ceph_db_devices > available] ******************* 2026-04-28 02:59:06.199011 | orchestrator | Tuesday 28 April 2026 02:59:06 +0000 (0:00:00.155) 0:00:49.831 ********* 2026-04-28 02:59:06.199017 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:06.199023 | orchestrator | 2026-04-28 02:59:06.199035 | orchestrator | TASK [Calculate size needed for LVs on ceph_wal_devices] *********************** 2026-04-28 02:59:11.468882 | orchestrator | Tuesday 28 April 2026 02:59:06 +0000 (0:00:00.142) 0:00:49.973 ********* 2026-04-28 02:59:11.469055 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:11.469088 | orchestrator | 2026-04-28 02:59:11.469108 | orchestrator | TASK [Print size needed for LVs on ceph_wal_devices] *************************** 2026-04-28 02:59:11.469128 | orchestrator | Tuesday 28 April 2026 02:59:06 +0000 (0:00:00.403) 0:00:50.377 ********* 2026-04-28 02:59:11.469148 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:11.469167 | orchestrator | 2026-04-28 02:59:11.469217 | orchestrator | TASK [Fail if size of WAL LVs on ceph_wal_devices > available] ***************** 2026-04-28 02:59:11.469236 | orchestrator | Tuesday 28 April 2026 02:59:06 +0000 (0:00:00.158) 0:00:50.535 ********* 2026-04-28 02:59:11.469252 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:11.469268 | orchestrator | 2026-04-28 02:59:11.469284 | orchestrator | TASK [Calculate size needed for WAL LVs on ceph_db_wal_devices] **************** 2026-04-28 02:59:11.469302 | orchestrator | Tuesday 28 April 2026 02:59:06 +0000 (0:00:00.160) 0:00:50.696 ********* 2026-04-28 02:59:11.469319 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:11.469337 | orchestrator | 2026-04-28 02:59:11.469355 | orchestrator | TASK [Print size needed for WAL LVs on ceph_db_wal_devices] ******************** 2026-04-28 02:59:11.469391 | orchestrator | Tuesday 28 April 2026 02:59:07 +0000 (0:00:00.158) 0:00:50.855 ********* 2026-04-28 02:59:11.469412 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:11.469431 | orchestrator | 2026-04-28 02:59:11.469449 | orchestrator | TASK [Calculate size needed for DB LVs on ceph_db_wal_devices] ***************** 2026-04-28 02:59:11.469467 | orchestrator | Tuesday 28 April 2026 02:59:07 +0000 (0:00:00.158) 0:00:51.013 ********* 2026-04-28 02:59:11.469485 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:11.469502 | orchestrator | 2026-04-28 02:59:11.469520 | orchestrator | TASK [Print size needed for DB LVs on ceph_db_wal_devices] ********************* 2026-04-28 02:59:11.469538 | orchestrator | Tuesday 28 April 2026 02:59:07 +0000 (0:00:00.168) 0:00:51.182 ********* 2026-04-28 02:59:11.469556 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:11.469574 | orchestrator | 2026-04-28 02:59:11.469593 | orchestrator | TASK [Fail if size of DB+WAL LVs on ceph_db_wal_devices > available] *********** 2026-04-28 02:59:11.469611 | orchestrator | Tuesday 28 April 2026 02:59:07 +0000 (0:00:00.138) 0:00:51.320 ********* 2026-04-28 02:59:11.469629 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:11.469646 | orchestrator | 2026-04-28 02:59:11.469664 | orchestrator | TASK [Fail if DB LV size < 30 GiB for ceph_db_devices] ************************* 2026-04-28 02:59:11.469682 | orchestrator | Tuesday 28 April 2026 02:59:07 +0000 (0:00:00.153) 0:00:51.474 ********* 2026-04-28 02:59:11.469700 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:11.469718 | orchestrator | 2026-04-28 02:59:11.469738 | orchestrator | TASK [Fail if DB LV size < 30 GiB for ceph_db_wal_devices] ********************* 2026-04-28 02:59:11.469757 | orchestrator | Tuesday 28 April 2026 02:59:07 +0000 (0:00:00.148) 0:00:51.622 ********* 2026-04-28 02:59:11.469776 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:11.469796 | orchestrator | 2026-04-28 02:59:11.469815 | orchestrator | TASK [Create DB LVs for ceph_db_devices] *************************************** 2026-04-28 02:59:11.469835 | orchestrator | Tuesday 28 April 2026 02:59:07 +0000 (0:00:00.151) 0:00:51.773 ********* 2026-04-28 02:59:11.469856 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 02:59:11.469878 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 02:59:11.469897 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:11.469917 | orchestrator | 2026-04-28 02:59:11.469936 | orchestrator | TASK [Print 'Create DB LVs for ceph_db_devices'] ******************************* 2026-04-28 02:59:11.469953 | orchestrator | Tuesday 28 April 2026 02:59:08 +0000 (0:00:00.169) 0:00:51.943 ********* 2026-04-28 02:59:11.469972 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 02:59:11.469990 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 02:59:11.470109 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:11.470136 | orchestrator | 2026-04-28 02:59:11.470157 | orchestrator | TASK [Create WAL LVs for ceph_wal_devices] ************************************* 2026-04-28 02:59:11.470176 | orchestrator | Tuesday 28 April 2026 02:59:08 +0000 (0:00:00.166) 0:00:52.109 ********* 2026-04-28 02:59:11.470281 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 02:59:11.470301 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 02:59:11.470321 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:11.470338 | orchestrator | 2026-04-28 02:59:11.470355 | orchestrator | TASK [Print 'Create WAL LVs for ceph_wal_devices'] ***************************** 2026-04-28 02:59:11.470375 | orchestrator | Tuesday 28 April 2026 02:59:08 +0000 (0:00:00.410) 0:00:52.520 ********* 2026-04-28 02:59:11.470393 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 02:59:11.470411 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 02:59:11.470428 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:11.470446 | orchestrator | 2026-04-28 02:59:11.470493 | orchestrator | TASK [Create WAL LVs for ceph_db_wal_devices] ********************************** 2026-04-28 02:59:11.470514 | orchestrator | Tuesday 28 April 2026 02:59:08 +0000 (0:00:00.172) 0:00:52.692 ********* 2026-04-28 02:59:11.470532 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 02:59:11.470550 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 02:59:11.470568 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:11.470585 | orchestrator | 2026-04-28 02:59:11.470603 | orchestrator | TASK [Print 'Create WAL LVs for ceph_db_wal_devices'] ************************** 2026-04-28 02:59:11.470620 | orchestrator | Tuesday 28 April 2026 02:59:09 +0000 (0:00:00.178) 0:00:52.871 ********* 2026-04-28 02:59:11.470639 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 02:59:11.470670 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 02:59:11.470688 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:11.470708 | orchestrator | 2026-04-28 02:59:11.470726 | orchestrator | TASK [Create DB LVs for ceph_db_wal_devices] *********************************** 2026-04-28 02:59:11.470746 | orchestrator | Tuesday 28 April 2026 02:59:09 +0000 (0:00:00.156) 0:00:53.028 ********* 2026-04-28 02:59:11.470758 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 02:59:11.470769 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 02:59:11.470786 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:11.470804 | orchestrator | 2026-04-28 02:59:11.470821 | orchestrator | TASK [Print 'Create DB LVs for ceph_db_wal_devices'] *************************** 2026-04-28 02:59:11.470838 | orchestrator | Tuesday 28 April 2026 02:59:09 +0000 (0:00:00.161) 0:00:53.189 ********* 2026-04-28 02:59:11.470855 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 02:59:11.470889 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 02:59:11.470908 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:11.470925 | orchestrator | 2026-04-28 02:59:11.470942 | orchestrator | TASK [Get list of Ceph LVs with associated VGs] ******************************** 2026-04-28 02:59:11.470960 | orchestrator | Tuesday 28 April 2026 02:59:09 +0000 (0:00:00.228) 0:00:53.418 ********* 2026-04-28 02:59:11.470979 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:59:11.470997 | orchestrator | 2026-04-28 02:59:11.471016 | orchestrator | TASK [Get list of Ceph PVs with associated VGs] ******************************** 2026-04-28 02:59:11.471035 | orchestrator | Tuesday 28 April 2026 02:59:10 +0000 (0:00:00.545) 0:00:53.963 ********* 2026-04-28 02:59:11.471052 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:59:11.471071 | orchestrator | 2026-04-28 02:59:11.471089 | orchestrator | TASK [Combine JSON from _lvs_cmd_output/_pvs_cmd_output] *********************** 2026-04-28 02:59:11.471106 | orchestrator | Tuesday 28 April 2026 02:59:10 +0000 (0:00:00.580) 0:00:54.544 ********* 2026-04-28 02:59:11.471123 | orchestrator | ok: [testbed-node-4] 2026-04-28 02:59:11.471141 | orchestrator | 2026-04-28 02:59:11.471158 | orchestrator | TASK [Create list of VG/LV names] ********************************************** 2026-04-28 02:59:11.471176 | orchestrator | Tuesday 28 April 2026 02:59:10 +0000 (0:00:00.170) 0:00:54.714 ********* 2026-04-28 02:59:11.471258 | orchestrator | ok: [testbed-node-4] => (item={'lv_name': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'vg_name': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'}) 2026-04-28 02:59:11.471277 | orchestrator | ok: [testbed-node-4] => (item={'lv_name': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'vg_name': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'}) 2026-04-28 02:59:11.471293 | orchestrator | 2026-04-28 02:59:11.471310 | orchestrator | TASK [Fail if block LV defined in lvm_volumes is missing] ********************** 2026-04-28 02:59:11.471326 | orchestrator | Tuesday 28 April 2026 02:59:11 +0000 (0:00:00.184) 0:00:54.899 ********* 2026-04-28 02:59:11.471336 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 02:59:11.471348 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 02:59:11.471365 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:11.471381 | orchestrator | 2026-04-28 02:59:11.471397 | orchestrator | TASK [Fail if DB LV defined in lvm_volumes is missing] ************************* 2026-04-28 02:59:11.471413 | orchestrator | Tuesday 28 April 2026 02:59:11 +0000 (0:00:00.167) 0:00:55.066 ********* 2026-04-28 02:59:11.471428 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 02:59:11.471460 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 02:59:18.928993 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:18.929073 | orchestrator | 2026-04-28 02:59:18.929082 | orchestrator | TASK [Fail if WAL LV defined in lvm_volumes is missing] ************************ 2026-04-28 02:59:18.929089 | orchestrator | Tuesday 28 April 2026 02:59:11 +0000 (0:00:00.175) 0:00:55.242 ********* 2026-04-28 02:59:18.929096 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 02:59:18.929104 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 02:59:18.929109 | orchestrator | skipping: [testbed-node-4] 2026-04-28 02:59:18.929115 | orchestrator | 2026-04-28 02:59:18.929121 | orchestrator | TASK [Print LVM report data] *************************************************** 2026-04-28 02:59:18.929142 | orchestrator | Tuesday 28 April 2026 02:59:11 +0000 (0:00:00.416) 0:00:55.658 ********* 2026-04-28 02:59:18.929159 | orchestrator | ok: [testbed-node-4] => { 2026-04-28 02:59:18.929165 | orchestrator |  "lvm_report": { 2026-04-28 02:59:18.929231 | orchestrator |  "lv": [ 2026-04-28 02:59:18.929240 | orchestrator |  { 2026-04-28 02:59:18.929246 | orchestrator |  "lv_name": "osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf", 2026-04-28 02:59:18.929253 | orchestrator |  "vg_name": "ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf" 2026-04-28 02:59:18.929258 | orchestrator |  }, 2026-04-28 02:59:18.929263 | orchestrator |  { 2026-04-28 02:59:18.929269 | orchestrator |  "lv_name": "osd-block-b3b62482-c8be-5063-9ecc-120425980b0a", 2026-04-28 02:59:18.929274 | orchestrator |  "vg_name": "ceph-b3b62482-c8be-5063-9ecc-120425980b0a" 2026-04-28 02:59:18.929280 | orchestrator |  } 2026-04-28 02:59:18.929285 | orchestrator |  ], 2026-04-28 02:59:18.929291 | orchestrator |  "pv": [ 2026-04-28 02:59:18.929296 | orchestrator |  { 2026-04-28 02:59:18.929302 | orchestrator |  "pv_name": "/dev/sdb", 2026-04-28 02:59:18.929307 | orchestrator |  "vg_name": "ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf" 2026-04-28 02:59:18.929312 | orchestrator |  }, 2026-04-28 02:59:18.929318 | orchestrator |  { 2026-04-28 02:59:18.929324 | orchestrator |  "pv_name": "/dev/sdc", 2026-04-28 02:59:18.929329 | orchestrator |  "vg_name": "ceph-b3b62482-c8be-5063-9ecc-120425980b0a" 2026-04-28 02:59:18.929335 | orchestrator |  } 2026-04-28 02:59:18.929340 | orchestrator |  ] 2026-04-28 02:59:18.929346 | orchestrator |  } 2026-04-28 02:59:18.929351 | orchestrator | } 2026-04-28 02:59:18.929357 | orchestrator | 2026-04-28 02:59:18.929362 | orchestrator | PLAY [Ceph create LVM devices] ************************************************* 2026-04-28 02:59:18.929368 | orchestrator | 2026-04-28 02:59:18.929373 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-28 02:59:18.929379 | orchestrator | Tuesday 28 April 2026 02:59:12 +0000 (0:00:00.345) 0:00:56.003 ********* 2026-04-28 02:59:18.929384 | orchestrator | ok: [testbed-node-5 -> testbed-manager(192.168.16.5)] 2026-04-28 02:59:18.929389 | orchestrator | 2026-04-28 02:59:18.929395 | orchestrator | TASK [Get initial list of available block devices] ***************************** 2026-04-28 02:59:18.929400 | orchestrator | Tuesday 28 April 2026 02:59:12 +0000 (0:00:00.283) 0:00:56.287 ********* 2026-04-28 02:59:18.929406 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:59:18.929411 | orchestrator | 2026-04-28 02:59:18.929416 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:59:18.929422 | orchestrator | Tuesday 28 April 2026 02:59:12 +0000 (0:00:00.295) 0:00:56.583 ********* 2026-04-28 02:59:18.929427 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop0) 2026-04-28 02:59:18.929433 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop1) 2026-04-28 02:59:18.929438 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop2) 2026-04-28 02:59:18.929443 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop3) 2026-04-28 02:59:18.929449 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop4) 2026-04-28 02:59:18.929454 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop5) 2026-04-28 02:59:18.929459 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop6) 2026-04-28 02:59:18.929465 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=loop7) 2026-04-28 02:59:18.929470 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sda) 2026-04-28 02:59:18.929475 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sdb) 2026-04-28 02:59:18.929487 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sdc) 2026-04-28 02:59:18.929493 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sdd) 2026-04-28 02:59:18.929498 | orchestrator | included: /ansible/tasks/_add-device-links.yml for testbed-node-5 => (item=sr0) 2026-04-28 02:59:18.929503 | orchestrator | 2026-04-28 02:59:18.929509 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:59:18.929514 | orchestrator | Tuesday 28 April 2026 02:59:13 +0000 (0:00:00.451) 0:00:57.034 ********* 2026-04-28 02:59:18.929520 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:18.929525 | orchestrator | 2026-04-28 02:59:18.929530 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:59:18.929536 | orchestrator | Tuesday 28 April 2026 02:59:13 +0000 (0:00:00.295) 0:00:57.330 ********* 2026-04-28 02:59:18.929541 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:18.929546 | orchestrator | 2026-04-28 02:59:18.929553 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:59:18.929577 | orchestrator | Tuesday 28 April 2026 02:59:13 +0000 (0:00:00.238) 0:00:57.568 ********* 2026-04-28 02:59:18.929584 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:18.929597 | orchestrator | 2026-04-28 02:59:18.929603 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:59:18.929609 | orchestrator | Tuesday 28 April 2026 02:59:14 +0000 (0:00:00.242) 0:00:57.811 ********* 2026-04-28 02:59:18.929615 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:18.929621 | orchestrator | 2026-04-28 02:59:18.929628 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:59:18.929634 | orchestrator | Tuesday 28 April 2026 02:59:14 +0000 (0:00:00.751) 0:00:58.563 ********* 2026-04-28 02:59:18.929640 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:18.929647 | orchestrator | 2026-04-28 02:59:18.929653 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:59:18.929659 | orchestrator | Tuesday 28 April 2026 02:59:15 +0000 (0:00:00.265) 0:00:58.829 ********* 2026-04-28 02:59:18.929665 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:18.929671 | orchestrator | 2026-04-28 02:59:18.929681 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:59:18.929687 | orchestrator | Tuesday 28 April 2026 02:59:15 +0000 (0:00:00.265) 0:00:59.095 ********* 2026-04-28 02:59:18.929693 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:18.929700 | orchestrator | 2026-04-28 02:59:18.929706 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:59:18.929712 | orchestrator | Tuesday 28 April 2026 02:59:15 +0000 (0:00:00.231) 0:00:59.326 ********* 2026-04-28 02:59:18.929718 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:18.929724 | orchestrator | 2026-04-28 02:59:18.929730 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:59:18.929736 | orchestrator | Tuesday 28 April 2026 02:59:15 +0000 (0:00:00.229) 0:00:59.556 ********* 2026-04-28 02:59:18.929742 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50) 2026-04-28 02:59:18.929750 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50) 2026-04-28 02:59:18.929756 | orchestrator | 2026-04-28 02:59:18.929762 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:59:18.929768 | orchestrator | Tuesday 28 April 2026 02:59:16 +0000 (0:00:00.494) 0:01:00.050 ********* 2026-04-28 02:59:18.929774 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79) 2026-04-28 02:59:18.929780 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79) 2026-04-28 02:59:18.929786 | orchestrator | 2026-04-28 02:59:18.929793 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:59:18.929803 | orchestrator | Tuesday 28 April 2026 02:59:16 +0000 (0:00:00.476) 0:01:00.527 ********* 2026-04-28 02:59:18.929809 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89) 2026-04-28 02:59:18.929815 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89) 2026-04-28 02:59:18.929821 | orchestrator | 2026-04-28 02:59:18.929827 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:59:18.929833 | orchestrator | Tuesday 28 April 2026 02:59:17 +0000 (0:00:00.535) 0:01:01.063 ********* 2026-04-28 02:59:18.929839 | orchestrator | ok: [testbed-node-5] => (item=scsi-0QEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de) 2026-04-28 02:59:18.929845 | orchestrator | ok: [testbed-node-5] => (item=scsi-SQEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de) 2026-04-28 02:59:18.929851 | orchestrator | 2026-04-28 02:59:18.929858 | orchestrator | TASK [Add known links to the list of available block devices] ****************** 2026-04-28 02:59:18.929864 | orchestrator | Tuesday 28 April 2026 02:59:17 +0000 (0:00:00.480) 0:01:01.543 ********* 2026-04-28 02:59:18.929870 | orchestrator | ok: [testbed-node-5] => (item=ata-QEMU_DVD-ROM_QM00001) 2026-04-28 02:59:18.929876 | orchestrator | 2026-04-28 02:59:18.929882 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:18.929889 | orchestrator | Tuesday 28 April 2026 02:59:18 +0000 (0:00:00.384) 0:01:01.928 ********* 2026-04-28 02:59:18.929895 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop0) 2026-04-28 02:59:18.929901 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop1) 2026-04-28 02:59:18.929907 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop2) 2026-04-28 02:59:18.929913 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop3) 2026-04-28 02:59:18.929919 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop4) 2026-04-28 02:59:18.929925 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop5) 2026-04-28 02:59:18.929931 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop6) 2026-04-28 02:59:18.929937 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=loop7) 2026-04-28 02:59:18.929943 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sda) 2026-04-28 02:59:18.929948 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sdb) 2026-04-28 02:59:18.929954 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sdc) 2026-04-28 02:59:18.929963 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sdd) 2026-04-28 02:59:28.841846 | orchestrator | included: /ansible/tasks/_add-device-partitions.yml for testbed-node-5 => (item=sr0) 2026-04-28 02:59:28.841957 | orchestrator | 2026-04-28 02:59:28.841976 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:28.841989 | orchestrator | Tuesday 28 April 2026 02:59:18 +0000 (0:00:00.766) 0:01:02.694 ********* 2026-04-28 02:59:28.842001 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:28.842106 | orchestrator | 2026-04-28 02:59:28.842126 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:28.842138 | orchestrator | Tuesday 28 April 2026 02:59:19 +0000 (0:00:00.255) 0:01:02.950 ********* 2026-04-28 02:59:28.842150 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:28.842161 | orchestrator | 2026-04-28 02:59:28.842230 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:28.842242 | orchestrator | Tuesday 28 April 2026 02:59:19 +0000 (0:00:00.224) 0:01:03.174 ********* 2026-04-28 02:59:28.842253 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:28.842289 | orchestrator | 2026-04-28 02:59:28.842301 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:28.842313 | orchestrator | Tuesday 28 April 2026 02:59:19 +0000 (0:00:00.255) 0:01:03.430 ********* 2026-04-28 02:59:28.842324 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:28.842335 | orchestrator | 2026-04-28 02:59:28.842347 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:28.842358 | orchestrator | Tuesday 28 April 2026 02:59:19 +0000 (0:00:00.261) 0:01:03.692 ********* 2026-04-28 02:59:28.842370 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:28.842382 | orchestrator | 2026-04-28 02:59:28.842394 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:28.842405 | orchestrator | Tuesday 28 April 2026 02:59:20 +0000 (0:00:00.227) 0:01:03.920 ********* 2026-04-28 02:59:28.842417 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:28.842429 | orchestrator | 2026-04-28 02:59:28.842441 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:28.842452 | orchestrator | Tuesday 28 April 2026 02:59:20 +0000 (0:00:00.243) 0:01:04.163 ********* 2026-04-28 02:59:28.842466 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:28.842478 | orchestrator | 2026-04-28 02:59:28.842490 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:28.842502 | orchestrator | Tuesday 28 April 2026 02:59:20 +0000 (0:00:00.245) 0:01:04.409 ********* 2026-04-28 02:59:28.842513 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:28.842525 | orchestrator | 2026-04-28 02:59:28.842536 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:28.842548 | orchestrator | Tuesday 28 April 2026 02:59:20 +0000 (0:00:00.249) 0:01:04.658 ********* 2026-04-28 02:59:28.842560 | orchestrator | ok: [testbed-node-5] => (item=sda1) 2026-04-28 02:59:28.842573 | orchestrator | ok: [testbed-node-5] => (item=sda14) 2026-04-28 02:59:28.842585 | orchestrator | ok: [testbed-node-5] => (item=sda15) 2026-04-28 02:59:28.842597 | orchestrator | ok: [testbed-node-5] => (item=sda16) 2026-04-28 02:59:28.842608 | orchestrator | 2026-04-28 02:59:28.842620 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:28.842631 | orchestrator | Tuesday 28 April 2026 02:59:21 +0000 (0:00:01.029) 0:01:05.688 ********* 2026-04-28 02:59:28.842643 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:28.842655 | orchestrator | 2026-04-28 02:59:28.842668 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:28.842679 | orchestrator | Tuesday 28 April 2026 02:59:22 +0000 (0:00:00.225) 0:01:05.914 ********* 2026-04-28 02:59:28.842692 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:28.842704 | orchestrator | 2026-04-28 02:59:28.842716 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:28.842728 | orchestrator | Tuesday 28 April 2026 02:59:22 +0000 (0:00:00.749) 0:01:06.664 ********* 2026-04-28 02:59:28.842740 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:28.842752 | orchestrator | 2026-04-28 02:59:28.842764 | orchestrator | TASK [Add known partitions to the list of available block devices] ************* 2026-04-28 02:59:28.842830 | orchestrator | Tuesday 28 April 2026 02:59:23 +0000 (0:00:00.236) 0:01:06.900 ********* 2026-04-28 02:59:28.842843 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:28.842855 | orchestrator | 2026-04-28 02:59:28.842867 | orchestrator | TASK [Check whether ceph_db_wal_devices is used exclusively] ******************* 2026-04-28 02:59:28.842879 | orchestrator | Tuesday 28 April 2026 02:59:23 +0000 (0:00:00.216) 0:01:07.117 ********* 2026-04-28 02:59:28.842891 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:28.842902 | orchestrator | 2026-04-28 02:59:28.842914 | orchestrator | TASK [Create dict of block VGs -> PVs from ceph_osd_devices] ******************* 2026-04-28 02:59:28.842926 | orchestrator | Tuesday 28 April 2026 02:59:23 +0000 (0:00:00.167) 0:01:07.285 ********* 2026-04-28 02:59:28.842939 | orchestrator | ok: [testbed-node-5] => (item={'key': 'sdb', 'value': {'osd_lvm_uuid': 'd7e38cf3-e59d-5932-97d5-5021af3eecab'}}) 2026-04-28 02:59:28.842960 | orchestrator | ok: [testbed-node-5] => (item={'key': 'sdc', 'value': {'osd_lvm_uuid': 'bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'}}) 2026-04-28 02:59:28.842973 | orchestrator | 2026-04-28 02:59:28.842986 | orchestrator | TASK [Create block VGs] ******************************************************** 2026-04-28 02:59:28.842997 | orchestrator | Tuesday 28 April 2026 02:59:23 +0000 (0:00:00.210) 0:01:07.496 ********* 2026-04-28 02:59:28.843011 | orchestrator | changed: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'}) 2026-04-28 02:59:28.843024 | orchestrator | changed: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'}) 2026-04-28 02:59:28.843036 | orchestrator | 2026-04-28 02:59:28.843047 | orchestrator | TASK [Print 'Create block VGs'] ************************************************ 2026-04-28 02:59:28.843080 | orchestrator | Tuesday 28 April 2026 02:59:25 +0000 (0:00:01.838) 0:01:09.334 ********* 2026-04-28 02:59:28.843093 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 02:59:28.843106 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 02:59:28.843118 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:28.843130 | orchestrator | 2026-04-28 02:59:28.843143 | orchestrator | TASK [Create block LVs] ******************************************************** 2026-04-28 02:59:28.843155 | orchestrator | Tuesday 28 April 2026 02:59:25 +0000 (0:00:00.179) 0:01:09.514 ********* 2026-04-28 02:59:28.843189 | orchestrator | changed: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'}) 2026-04-28 02:59:28.843202 | orchestrator | changed: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'}) 2026-04-28 02:59:28.843212 | orchestrator | 2026-04-28 02:59:28.843223 | orchestrator | TASK [Print 'Create block LVs'] ************************************************ 2026-04-28 02:59:28.843235 | orchestrator | Tuesday 28 April 2026 02:59:27 +0000 (0:00:01.364) 0:01:10.879 ********* 2026-04-28 02:59:28.843246 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 02:59:28.843259 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 02:59:28.843271 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:28.843283 | orchestrator | 2026-04-28 02:59:28.843295 | orchestrator | TASK [Create DB VGs] *********************************************************** 2026-04-28 02:59:28.843307 | orchestrator | Tuesday 28 April 2026 02:59:27 +0000 (0:00:00.176) 0:01:11.056 ********* 2026-04-28 02:59:28.843319 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:28.843331 | orchestrator | 2026-04-28 02:59:28.843341 | orchestrator | TASK [Print 'Create DB VGs'] *************************************************** 2026-04-28 02:59:28.843352 | orchestrator | Tuesday 28 April 2026 02:59:27 +0000 (0:00:00.151) 0:01:11.207 ********* 2026-04-28 02:59:28.843363 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 02:59:28.843374 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 02:59:28.843386 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:28.843397 | orchestrator | 2026-04-28 02:59:28.843407 | orchestrator | TASK [Create WAL VGs] ********************************************************** 2026-04-28 02:59:28.843417 | orchestrator | Tuesday 28 April 2026 02:59:27 +0000 (0:00:00.181) 0:01:11.389 ********* 2026-04-28 02:59:28.843437 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:28.843449 | orchestrator | 2026-04-28 02:59:28.843460 | orchestrator | TASK [Print 'Create WAL VGs'] ************************************************** 2026-04-28 02:59:28.843471 | orchestrator | Tuesday 28 April 2026 02:59:28 +0000 (0:00:00.395) 0:01:11.784 ********* 2026-04-28 02:59:28.843481 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 02:59:28.843492 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 02:59:28.843504 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:28.843514 | orchestrator | 2026-04-28 02:59:28.843525 | orchestrator | TASK [Create DB+WAL VGs] ******************************************************* 2026-04-28 02:59:28.843536 | orchestrator | Tuesday 28 April 2026 02:59:28 +0000 (0:00:00.172) 0:01:11.957 ********* 2026-04-28 02:59:28.843546 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:28.843556 | orchestrator | 2026-04-28 02:59:28.843568 | orchestrator | TASK [Print 'Create DB+WAL VGs'] *********************************************** 2026-04-28 02:59:28.843578 | orchestrator | Tuesday 28 April 2026 02:59:28 +0000 (0:00:00.144) 0:01:12.101 ********* 2026-04-28 02:59:28.843589 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 02:59:28.843602 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 02:59:28.843609 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:28.843616 | orchestrator | 2026-04-28 02:59:28.843623 | orchestrator | TASK [Prepare variables for OSD count check] *********************************** 2026-04-28 02:59:28.843629 | orchestrator | Tuesday 28 April 2026 02:59:28 +0000 (0:00:00.181) 0:01:12.283 ********* 2026-04-28 02:59:28.843636 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:59:28.843643 | orchestrator | 2026-04-28 02:59:28.843649 | orchestrator | TASK [Count OSDs put on ceph_db_devices defined in lvm_volumes] **************** 2026-04-28 02:59:28.843656 | orchestrator | Tuesday 28 April 2026 02:59:28 +0000 (0:00:00.158) 0:01:12.441 ********* 2026-04-28 02:59:28.843673 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 02:59:35.889593 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 02:59:35.889674 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.889682 | orchestrator | 2026-04-28 02:59:35.889688 | orchestrator | TASK [Count OSDs put on ceph_wal_devices defined in lvm_volumes] *************** 2026-04-28 02:59:35.889694 | orchestrator | Tuesday 28 April 2026 02:59:28 +0000 (0:00:00.176) 0:01:12.618 ********* 2026-04-28 02:59:35.889698 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 02:59:35.889714 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 02:59:35.889718 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.889722 | orchestrator | 2026-04-28 02:59:35.889726 | orchestrator | TASK [Count OSDs put on ceph_db_wal_devices defined in lvm_volumes] ************ 2026-04-28 02:59:35.889730 | orchestrator | Tuesday 28 April 2026 02:59:29 +0000 (0:00:00.166) 0:01:12.784 ********* 2026-04-28 02:59:35.889736 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 02:59:35.889742 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 02:59:35.889770 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.889781 | orchestrator | 2026-04-28 02:59:35.889787 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a DB VG] ********************* 2026-04-28 02:59:35.889792 | orchestrator | Tuesday 28 April 2026 02:59:29 +0000 (0:00:00.174) 0:01:12.959 ********* 2026-04-28 02:59:35.889797 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.889803 | orchestrator | 2026-04-28 02:59:35.889809 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a WAL VG] ******************** 2026-04-28 02:59:35.889814 | orchestrator | Tuesday 28 April 2026 02:59:29 +0000 (0:00:00.168) 0:01:13.128 ********* 2026-04-28 02:59:35.889819 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.889825 | orchestrator | 2026-04-28 02:59:35.889830 | orchestrator | TASK [Fail if number of OSDs exceeds num_osds for a DB+WAL VG] ***************** 2026-04-28 02:59:35.889837 | orchestrator | Tuesday 28 April 2026 02:59:29 +0000 (0:00:00.160) 0:01:13.288 ********* 2026-04-28 02:59:35.889842 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.889848 | orchestrator | 2026-04-28 02:59:35.889853 | orchestrator | TASK [Print number of OSDs wanted per DB VG] *********************************** 2026-04-28 02:59:35.889859 | orchestrator | Tuesday 28 April 2026 02:59:29 +0000 (0:00:00.177) 0:01:13.466 ********* 2026-04-28 02:59:35.889865 | orchestrator | ok: [testbed-node-5] => { 2026-04-28 02:59:35.889871 | orchestrator |  "_num_osds_wanted_per_db_vg": {} 2026-04-28 02:59:35.889877 | orchestrator | } 2026-04-28 02:59:35.889884 | orchestrator | 2026-04-28 02:59:35.889890 | orchestrator | TASK [Print number of OSDs wanted per WAL VG] ********************************** 2026-04-28 02:59:35.889896 | orchestrator | Tuesday 28 April 2026 02:59:29 +0000 (0:00:00.173) 0:01:13.640 ********* 2026-04-28 02:59:35.889902 | orchestrator | ok: [testbed-node-5] => { 2026-04-28 02:59:35.889909 | orchestrator |  "_num_osds_wanted_per_wal_vg": {} 2026-04-28 02:59:35.889915 | orchestrator | } 2026-04-28 02:59:35.889922 | orchestrator | 2026-04-28 02:59:35.889928 | orchestrator | TASK [Print number of OSDs wanted per DB+WAL VG] ******************************* 2026-04-28 02:59:35.889934 | orchestrator | Tuesday 28 April 2026 02:59:30 +0000 (0:00:00.398) 0:01:14.039 ********* 2026-04-28 02:59:35.889938 | orchestrator | ok: [testbed-node-5] => { 2026-04-28 02:59:35.889942 | orchestrator |  "_num_osds_wanted_per_db_wal_vg": {} 2026-04-28 02:59:35.889946 | orchestrator | } 2026-04-28 02:59:35.889950 | orchestrator | 2026-04-28 02:59:35.889954 | orchestrator | TASK [Gather DB VGs with total and available size in bytes] ******************** 2026-04-28 02:59:35.889958 | orchestrator | Tuesday 28 April 2026 02:59:30 +0000 (0:00:00.156) 0:01:14.195 ********* 2026-04-28 02:59:35.889962 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:59:35.889966 | orchestrator | 2026-04-28 02:59:35.889970 | orchestrator | TASK [Gather WAL VGs with total and available size in bytes] ******************* 2026-04-28 02:59:35.889974 | orchestrator | Tuesday 28 April 2026 02:59:30 +0000 (0:00:00.555) 0:01:14.750 ********* 2026-04-28 02:59:35.889978 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:59:35.889981 | orchestrator | 2026-04-28 02:59:35.889985 | orchestrator | TASK [Gather DB+WAL VGs with total and available size in bytes] **************** 2026-04-28 02:59:35.889989 | orchestrator | Tuesday 28 April 2026 02:59:31 +0000 (0:00:00.539) 0:01:15.290 ********* 2026-04-28 02:59:35.889993 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:59:35.889997 | orchestrator | 2026-04-28 02:59:35.890001 | orchestrator | TASK [Combine JSON from _db/wal/db_wal_vgs_cmd_output] ************************* 2026-04-28 02:59:35.890005 | orchestrator | Tuesday 28 April 2026 02:59:32 +0000 (0:00:00.562) 0:01:15.852 ********* 2026-04-28 02:59:35.890008 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:59:35.890056 | orchestrator | 2026-04-28 02:59:35.890070 | orchestrator | TASK [Calculate VG sizes (without buffer)] ************************************* 2026-04-28 02:59:35.890074 | orchestrator | Tuesday 28 April 2026 02:59:32 +0000 (0:00:00.157) 0:01:16.010 ********* 2026-04-28 02:59:35.890084 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.890088 | orchestrator | 2026-04-28 02:59:35.890092 | orchestrator | TASK [Calculate VG sizes (with buffer)] **************************************** 2026-04-28 02:59:35.890103 | orchestrator | Tuesday 28 April 2026 02:59:32 +0000 (0:00:00.137) 0:01:16.147 ********* 2026-04-28 02:59:35.890107 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.890111 | orchestrator | 2026-04-28 02:59:35.890115 | orchestrator | TASK [Print LVM VGs report data] *********************************************** 2026-04-28 02:59:35.890119 | orchestrator | Tuesday 28 April 2026 02:59:32 +0000 (0:00:00.137) 0:01:16.284 ********* 2026-04-28 02:59:35.890123 | orchestrator | ok: [testbed-node-5] => { 2026-04-28 02:59:35.890127 | orchestrator |  "vgs_report": { 2026-04-28 02:59:35.890131 | orchestrator |  "vg": [] 2026-04-28 02:59:35.890148 | orchestrator |  } 2026-04-28 02:59:35.890153 | orchestrator | } 2026-04-28 02:59:35.890178 | orchestrator | 2026-04-28 02:59:35.890183 | orchestrator | TASK [Print LVM VG sizes] ****************************************************** 2026-04-28 02:59:35.890188 | orchestrator | Tuesday 28 April 2026 02:59:32 +0000 (0:00:00.183) 0:01:16.467 ********* 2026-04-28 02:59:35.890193 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.890197 | orchestrator | 2026-04-28 02:59:35.890201 | orchestrator | TASK [Calculate size needed for LVs on ceph_db_devices] ************************ 2026-04-28 02:59:35.890206 | orchestrator | Tuesday 28 April 2026 02:59:32 +0000 (0:00:00.175) 0:01:16.643 ********* 2026-04-28 02:59:35.890210 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.890214 | orchestrator | 2026-04-28 02:59:35.890219 | orchestrator | TASK [Print size needed for LVs on ceph_db_devices] **************************** 2026-04-28 02:59:35.890224 | orchestrator | Tuesday 28 April 2026 02:59:33 +0000 (0:00:00.145) 0:01:16.789 ********* 2026-04-28 02:59:35.890228 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.890233 | orchestrator | 2026-04-28 02:59:35.890242 | orchestrator | TASK [Fail if size of DB LVs on ceph_db_devices > available] ******************* 2026-04-28 02:59:35.890247 | orchestrator | Tuesday 28 April 2026 02:59:33 +0000 (0:00:00.404) 0:01:17.193 ********* 2026-04-28 02:59:35.890251 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.890256 | orchestrator | 2026-04-28 02:59:35.890260 | orchestrator | TASK [Calculate size needed for LVs on ceph_wal_devices] *********************** 2026-04-28 02:59:35.890264 | orchestrator | Tuesday 28 April 2026 02:59:33 +0000 (0:00:00.156) 0:01:17.350 ********* 2026-04-28 02:59:35.890269 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.890273 | orchestrator | 2026-04-28 02:59:35.890278 | orchestrator | TASK [Print size needed for LVs on ceph_wal_devices] *************************** 2026-04-28 02:59:35.890282 | orchestrator | Tuesday 28 April 2026 02:59:33 +0000 (0:00:00.161) 0:01:17.512 ********* 2026-04-28 02:59:35.890286 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.890291 | orchestrator | 2026-04-28 02:59:35.890295 | orchestrator | TASK [Fail if size of WAL LVs on ceph_wal_devices > available] ***************** 2026-04-28 02:59:35.890300 | orchestrator | Tuesday 28 April 2026 02:59:33 +0000 (0:00:00.166) 0:01:17.678 ********* 2026-04-28 02:59:35.890304 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.890309 | orchestrator | 2026-04-28 02:59:35.890313 | orchestrator | TASK [Calculate size needed for WAL LVs on ceph_db_wal_devices] **************** 2026-04-28 02:59:35.890317 | orchestrator | Tuesday 28 April 2026 02:59:34 +0000 (0:00:00.162) 0:01:17.841 ********* 2026-04-28 02:59:35.890322 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.890326 | orchestrator | 2026-04-28 02:59:35.890331 | orchestrator | TASK [Print size needed for WAL LVs on ceph_db_wal_devices] ******************** 2026-04-28 02:59:35.890335 | orchestrator | Tuesday 28 April 2026 02:59:34 +0000 (0:00:00.156) 0:01:17.998 ********* 2026-04-28 02:59:35.890340 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.890344 | orchestrator | 2026-04-28 02:59:35.890348 | orchestrator | TASK [Calculate size needed for DB LVs on ceph_db_wal_devices] ***************** 2026-04-28 02:59:35.890353 | orchestrator | Tuesday 28 April 2026 02:59:34 +0000 (0:00:00.159) 0:01:18.158 ********* 2026-04-28 02:59:35.890357 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.890362 | orchestrator | 2026-04-28 02:59:35.890366 | orchestrator | TASK [Print size needed for DB LVs on ceph_db_wal_devices] ********************* 2026-04-28 02:59:35.890371 | orchestrator | Tuesday 28 April 2026 02:59:34 +0000 (0:00:00.153) 0:01:18.311 ********* 2026-04-28 02:59:35.890380 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.890384 | orchestrator | 2026-04-28 02:59:35.890389 | orchestrator | TASK [Fail if size of DB+WAL LVs on ceph_db_wal_devices > available] *********** 2026-04-28 02:59:35.890393 | orchestrator | Tuesday 28 April 2026 02:59:34 +0000 (0:00:00.160) 0:01:18.472 ********* 2026-04-28 02:59:35.890397 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.890402 | orchestrator | 2026-04-28 02:59:35.890406 | orchestrator | TASK [Fail if DB LV size < 30 GiB for ceph_db_devices] ************************* 2026-04-28 02:59:35.890411 | orchestrator | Tuesday 28 April 2026 02:59:34 +0000 (0:00:00.159) 0:01:18.631 ********* 2026-04-28 02:59:35.890415 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.890419 | orchestrator | 2026-04-28 02:59:35.890424 | orchestrator | TASK [Fail if DB LV size < 30 GiB for ceph_db_wal_devices] ********************* 2026-04-28 02:59:35.890428 | orchestrator | Tuesday 28 April 2026 02:59:34 +0000 (0:00:00.137) 0:01:18.768 ********* 2026-04-28 02:59:35.890433 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.890437 | orchestrator | 2026-04-28 02:59:35.890441 | orchestrator | TASK [Create DB LVs for ceph_db_devices] *************************************** 2026-04-28 02:59:35.890446 | orchestrator | Tuesday 28 April 2026 02:59:35 +0000 (0:00:00.387) 0:01:19.155 ********* 2026-04-28 02:59:35.890450 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 02:59:35.890455 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 02:59:35.890460 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.890464 | orchestrator | 2026-04-28 02:59:35.890468 | orchestrator | TASK [Print 'Create DB LVs for ceph_db_devices'] ******************************* 2026-04-28 02:59:35.890473 | orchestrator | Tuesday 28 April 2026 02:59:35 +0000 (0:00:00.175) 0:01:19.331 ********* 2026-04-28 02:59:35.890477 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 02:59:35.890482 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 02:59:35.890486 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:35.890491 | orchestrator | 2026-04-28 02:59:35.890495 | orchestrator | TASK [Create WAL LVs for ceph_wal_devices] ************************************* 2026-04-28 02:59:35.890500 | orchestrator | Tuesday 28 April 2026 02:59:35 +0000 (0:00:00.164) 0:01:19.495 ********* 2026-04-28 02:59:35.890508 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 02:59:39.239589 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 02:59:39.239714 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:39.239729 | orchestrator | 2026-04-28 02:59:39.239741 | orchestrator | TASK [Print 'Create WAL LVs for ceph_wal_devices'] ***************************** 2026-04-28 02:59:39.239754 | orchestrator | Tuesday 28 April 2026 02:59:35 +0000 (0:00:00.168) 0:01:19.663 ********* 2026-04-28 02:59:39.239765 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 02:59:39.239794 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 02:59:39.239804 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:39.239814 | orchestrator | 2026-04-28 02:59:39.239824 | orchestrator | TASK [Create WAL LVs for ceph_db_wal_devices] ********************************** 2026-04-28 02:59:39.239833 | orchestrator | Tuesday 28 April 2026 02:59:36 +0000 (0:00:00.183) 0:01:19.847 ********* 2026-04-28 02:59:39.239867 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 02:59:39.239878 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 02:59:39.239888 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:39.239898 | orchestrator | 2026-04-28 02:59:39.239907 | orchestrator | TASK [Print 'Create WAL LVs for ceph_db_wal_devices'] ************************** 2026-04-28 02:59:39.239917 | orchestrator | Tuesday 28 April 2026 02:59:36 +0000 (0:00:00.186) 0:01:20.033 ********* 2026-04-28 02:59:39.239927 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 02:59:39.239936 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 02:59:39.239946 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:39.239956 | orchestrator | 2026-04-28 02:59:39.239965 | orchestrator | TASK [Create DB LVs for ceph_db_wal_devices] *********************************** 2026-04-28 02:59:39.239975 | orchestrator | Tuesday 28 April 2026 02:59:36 +0000 (0:00:00.178) 0:01:20.212 ********* 2026-04-28 02:59:39.239985 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 02:59:39.239994 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 02:59:39.240004 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:39.240015 | orchestrator | 2026-04-28 02:59:39.240031 | orchestrator | TASK [Print 'Create DB LVs for ceph_db_wal_devices'] *************************** 2026-04-28 02:59:39.240047 | orchestrator | Tuesday 28 April 2026 02:59:36 +0000 (0:00:00.180) 0:01:20.392 ********* 2026-04-28 02:59:39.240062 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 02:59:39.240078 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 02:59:39.240100 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:39.240123 | orchestrator | 2026-04-28 02:59:39.240138 | orchestrator | TASK [Get list of Ceph LVs with associated VGs] ******************************** 2026-04-28 02:59:39.240184 | orchestrator | Tuesday 28 April 2026 02:59:36 +0000 (0:00:00.169) 0:01:20.562 ********* 2026-04-28 02:59:39.240204 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:59:39.240222 | orchestrator | 2026-04-28 02:59:39.240239 | orchestrator | TASK [Get list of Ceph PVs with associated VGs] ******************************** 2026-04-28 02:59:39.240253 | orchestrator | Tuesday 28 April 2026 02:59:37 +0000 (0:00:00.548) 0:01:21.110 ********* 2026-04-28 02:59:39.240264 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:59:39.240275 | orchestrator | 2026-04-28 02:59:39.240286 | orchestrator | TASK [Combine JSON from _lvs_cmd_output/_pvs_cmd_output] *********************** 2026-04-28 02:59:39.240297 | orchestrator | Tuesday 28 April 2026 02:59:37 +0000 (0:00:00.538) 0:01:21.648 ********* 2026-04-28 02:59:39.240308 | orchestrator | ok: [testbed-node-5] 2026-04-28 02:59:39.240321 | orchestrator | 2026-04-28 02:59:39.240337 | orchestrator | TASK [Create list of VG/LV names] ********************************************** 2026-04-28 02:59:39.240352 | orchestrator | Tuesday 28 April 2026 02:59:38 +0000 (0:00:00.176) 0:01:21.825 ********* 2026-04-28 02:59:39.240376 | orchestrator | ok: [testbed-node-5] => (item={'lv_name': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'vg_name': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'}) 2026-04-28 02:59:39.240396 | orchestrator | ok: [testbed-node-5] => (item={'lv_name': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'vg_name': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'}) 2026-04-28 02:59:39.240423 | orchestrator | 2026-04-28 02:59:39.240439 | orchestrator | TASK [Fail if block LV defined in lvm_volumes is missing] ********************** 2026-04-28 02:59:39.240454 | orchestrator | Tuesday 28 April 2026 02:59:38 +0000 (0:00:00.445) 0:01:22.271 ********* 2026-04-28 02:59:39.240497 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 02:59:39.240517 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 02:59:39.240534 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:39.240557 | orchestrator | 2026-04-28 02:59:39.240577 | orchestrator | TASK [Fail if DB LV defined in lvm_volumes is missing] ************************* 2026-04-28 02:59:39.240594 | orchestrator | Tuesday 28 April 2026 02:59:38 +0000 (0:00:00.204) 0:01:22.476 ********* 2026-04-28 02:59:39.240619 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 02:59:39.240635 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 02:59:39.240651 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:39.240666 | orchestrator | 2026-04-28 02:59:39.240683 | orchestrator | TASK [Fail if WAL LV defined in lvm_volumes is missing] ************************ 2026-04-28 02:59:39.240709 | orchestrator | Tuesday 28 April 2026 02:59:38 +0000 (0:00:00.164) 0:01:22.640 ********* 2026-04-28 02:59:39.240725 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 02:59:39.240741 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 02:59:39.240757 | orchestrator | skipping: [testbed-node-5] 2026-04-28 02:59:39.240773 | orchestrator | 2026-04-28 02:59:39.240788 | orchestrator | TASK [Print LVM report data] *************************************************** 2026-04-28 02:59:39.240805 | orchestrator | Tuesday 28 April 2026 02:59:39 +0000 (0:00:00.184) 0:01:22.824 ********* 2026-04-28 02:59:39.240818 | orchestrator | ok: [testbed-node-5] => { 2026-04-28 02:59:39.240831 | orchestrator |  "lvm_report": { 2026-04-28 02:59:39.240846 | orchestrator |  "lv": [ 2026-04-28 02:59:39.240861 | orchestrator |  { 2026-04-28 02:59:39.240880 | orchestrator |  "lv_name": "osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1", 2026-04-28 02:59:39.240896 | orchestrator |  "vg_name": "ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1" 2026-04-28 02:59:39.240911 | orchestrator |  }, 2026-04-28 02:59:39.240928 | orchestrator |  { 2026-04-28 02:59:39.240945 | orchestrator |  "lv_name": "osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab", 2026-04-28 02:59:39.240959 | orchestrator |  "vg_name": "ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab" 2026-04-28 02:59:39.240975 | orchestrator |  } 2026-04-28 02:59:39.240990 | orchestrator |  ], 2026-04-28 02:59:39.241004 | orchestrator |  "pv": [ 2026-04-28 02:59:39.241019 | orchestrator |  { 2026-04-28 02:59:39.241034 | orchestrator |  "pv_name": "/dev/sdb", 2026-04-28 02:59:39.241050 | orchestrator |  "vg_name": "ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab" 2026-04-28 02:59:39.241066 | orchestrator |  }, 2026-04-28 02:59:39.241081 | orchestrator |  { 2026-04-28 02:59:39.241096 | orchestrator |  "pv_name": "/dev/sdc", 2026-04-28 02:59:39.241111 | orchestrator |  "vg_name": "ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1" 2026-04-28 02:59:39.241127 | orchestrator |  } 2026-04-28 02:59:39.241142 | orchestrator |  ] 2026-04-28 02:59:39.241202 | orchestrator |  } 2026-04-28 02:59:39.241220 | orchestrator | } 2026-04-28 02:59:39.241263 | orchestrator | 2026-04-28 02:59:39.241280 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 02:59:39.241297 | orchestrator | testbed-node-3 : ok=51  changed=2  unreachable=0 failed=0 skipped=62  rescued=0 ignored=0 2026-04-28 02:59:39.241314 | orchestrator | testbed-node-4 : ok=51  changed=2  unreachable=0 failed=0 skipped=62  rescued=0 ignored=0 2026-04-28 02:59:39.241330 | orchestrator | testbed-node-5 : ok=51  changed=2  unreachable=0 failed=0 skipped=62  rescued=0 ignored=0 2026-04-28 02:59:39.241340 | orchestrator | 2026-04-28 02:59:39.241350 | orchestrator | 2026-04-28 02:59:39.241359 | orchestrator | 2026-04-28 02:59:39.241369 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 02:59:39.241378 | orchestrator | Tuesday 28 April 2026 02:59:39 +0000 (0:00:00.164) 0:01:22.989 ********* 2026-04-28 02:59:39.241388 | orchestrator | =============================================================================== 2026-04-28 02:59:39.241398 | orchestrator | Create block VGs -------------------------------------------------------- 6.04s 2026-04-28 02:59:39.241408 | orchestrator | Create block LVs -------------------------------------------------------- 4.31s 2026-04-28 02:59:39.241417 | orchestrator | Add known partitions to the list of available block devices ------------- 2.20s 2026-04-28 02:59:39.241427 | orchestrator | Gather DB VGs with total and available size in bytes -------------------- 1.86s 2026-04-28 02:59:39.241436 | orchestrator | Gather DB+WAL VGs with total and available size in bytes ---------------- 1.69s 2026-04-28 02:59:39.241446 | orchestrator | Get list of Ceph PVs with associated VGs -------------------------------- 1.68s 2026-04-28 02:59:39.241455 | orchestrator | Gather WAL VGs with total and available size in bytes ------------------- 1.67s 2026-04-28 02:59:39.241465 | orchestrator | Get list of Ceph LVs with associated VGs -------------------------------- 1.66s 2026-04-28 02:59:39.241491 | orchestrator | Add known links to the list of available block devices ------------------ 1.52s 2026-04-28 02:59:39.642841 | orchestrator | Add known links to the list of available block devices ------------------ 1.07s 2026-04-28 02:59:39.642997 | orchestrator | Add known partitions to the list of available block devices ------------- 1.03s 2026-04-28 02:59:39.643021 | orchestrator | Add known partitions to the list of available block devices ------------- 1.03s 2026-04-28 02:59:39.643042 | orchestrator | Fail if DB LV size < 30 GiB for ceph_db_wal_devices --------------------- 1.02s 2026-04-28 02:59:39.643062 | orchestrator | Print number of OSDs wanted per WAL VG ---------------------------------- 0.99s 2026-04-28 02:59:39.643081 | orchestrator | Create WAL VGs ---------------------------------------------------------- 0.99s 2026-04-28 02:59:39.643132 | orchestrator | Get extra vars for Ceph configuration ----------------------------------- 0.89s 2026-04-28 02:59:39.643145 | orchestrator | Get initial list of available block devices ----------------------------- 0.83s 2026-04-28 02:59:39.643189 | orchestrator | Print LVM report data --------------------------------------------------- 0.83s 2026-04-28 02:59:39.643200 | orchestrator | Create list of VG/LV names ---------------------------------------------- 0.82s 2026-04-28 02:59:39.643212 | orchestrator | Add known partitions to the list of available block devices ------------- 0.81s 2026-04-28 02:59:52.222923 | orchestrator | 2026-04-28 02:59:52 | INFO  | Task fe96fb07-565b-4777-9cfd-224bda7048f0 (facts) was prepared for execution. 2026-04-28 02:59:52.223040 | orchestrator | 2026-04-28 02:59:52 | INFO  | It takes a moment until task fe96fb07-565b-4777-9cfd-224bda7048f0 (facts) has been started and output is visible here. 2026-04-28 03:00:06.788984 | orchestrator | 2026-04-28 03:00:06.789092 | orchestrator | PLAY [Apply role facts] ******************************************************** 2026-04-28 03:00:06.789106 | orchestrator | 2026-04-28 03:00:06.789116 | orchestrator | TASK [osism.commons.facts : Create custom facts directory] ********************* 2026-04-28 03:00:06.789126 | orchestrator | Tuesday 28 April 2026 02:59:57 +0000 (0:00:00.307) 0:00:00.307 ********* 2026-04-28 03:00:06.789191 | orchestrator | ok: [testbed-manager] 2026-04-28 03:00:06.789232 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:00:06.789243 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:00:06.789252 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:00:06.789261 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:00:06.789271 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:00:06.789280 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:00:06.789289 | orchestrator | 2026-04-28 03:00:06.789299 | orchestrator | TASK [osism.commons.facts : Copy fact files] *********************************** 2026-04-28 03:00:06.789309 | orchestrator | Tuesday 28 April 2026 02:59:58 +0000 (0:00:01.239) 0:00:01.547 ********* 2026-04-28 03:00:06.789318 | orchestrator | skipping: [testbed-manager] 2026-04-28 03:00:06.789329 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:00:06.789338 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:00:06.789347 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:00:06.789356 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:06.789365 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:06.789374 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:06.789383 | orchestrator | 2026-04-28 03:00:06.789392 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-28 03:00:06.789401 | orchestrator | 2026-04-28 03:00:06.789411 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-28 03:00:06.789420 | orchestrator | Tuesday 28 April 2026 03:00:00 +0000 (0:00:01.456) 0:00:03.003 ********* 2026-04-28 03:00:06.789429 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:00:06.789438 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:00:06.789448 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:00:06.789456 | orchestrator | ok: [testbed-manager] 2026-04-28 03:00:06.789465 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:00:06.789474 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:00:06.789482 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:00:06.789491 | orchestrator | 2026-04-28 03:00:06.789501 | orchestrator | PLAY [Gather facts for all hosts if using --limit] ***************************** 2026-04-28 03:00:06.789511 | orchestrator | 2026-04-28 03:00:06.789520 | orchestrator | TASK [Gather facts for all hosts] ********************************************** 2026-04-28 03:00:06.789529 | orchestrator | Tuesday 28 April 2026 03:00:05 +0000 (0:00:05.540) 0:00:08.544 ********* 2026-04-28 03:00:06.789538 | orchestrator | skipping: [testbed-manager] 2026-04-28 03:00:06.789547 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:00:06.789556 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:00:06.789566 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:00:06.789575 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:06.789584 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:06.789592 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:06.789601 | orchestrator | 2026-04-28 03:00:06.789609 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 03:00:06.789617 | orchestrator | testbed-manager : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 03:00:06.789628 | orchestrator | testbed-node-0 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 03:00:06.789637 | orchestrator | testbed-node-1 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 03:00:06.789646 | orchestrator | testbed-node-2 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 03:00:06.789655 | orchestrator | testbed-node-3 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 03:00:06.789665 | orchestrator | testbed-node-4 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 03:00:06.789674 | orchestrator | testbed-node-5 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 03:00:06.789696 | orchestrator | 2026-04-28 03:00:06.789705 | orchestrator | 2026-04-28 03:00:06.789715 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 03:00:06.789724 | orchestrator | Tuesday 28 April 2026 03:00:06 +0000 (0:00:00.631) 0:00:09.175 ********* 2026-04-28 03:00:06.789734 | orchestrator | =============================================================================== 2026-04-28 03:00:06.789744 | orchestrator | Gathers facts about hosts ----------------------------------------------- 5.54s 2026-04-28 03:00:06.789753 | orchestrator | osism.commons.facts : Copy fact files ----------------------------------- 1.46s 2026-04-28 03:00:06.789780 | orchestrator | osism.commons.facts : Create custom facts directory --------------------- 1.24s 2026-04-28 03:00:06.789790 | orchestrator | Gather facts for all hosts ---------------------------------------------- 0.63s 2026-04-28 03:00:09.560516 | orchestrator | 2026-04-28 03:00:09 | INFO  | Task 96306efe-f68e-4c59-a94f-d1e12d105bcc (ceph) was prepared for execution. 2026-04-28 03:00:09.560619 | orchestrator | 2026-04-28 03:00:09 | INFO  | It takes a moment until task 96306efe-f68e-4c59-a94f-d1e12d105bcc (ceph) has been started and output is visible here. 2026-04-28 03:00:30.094378 | orchestrator | [WARNING]: Collection community.general does not support Ansible version 2026-04-28 03:00:30.095343 | orchestrator | 2.16.14 2026-04-28 03:00:30.095389 | orchestrator | 2026-04-28 03:00:30.095395 | orchestrator | PLAY [Prepare deployment of Ceph services] ************************************* 2026-04-28 03:00:30.095400 | orchestrator | 2026-04-28 03:00:30.095404 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 03:00:30.095408 | orchestrator | Tuesday 28 April 2026 03:00:15 +0000 (0:00:01.072) 0:00:01.072 ********* 2026-04-28 03:00:30.095414 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:00:30.095419 | orchestrator | 2026-04-28 03:00:30.095423 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-28 03:00:30.095427 | orchestrator | Tuesday 28 April 2026 03:00:17 +0000 (0:00:01.409) 0:00:02.481 ********* 2026-04-28 03:00:30.095431 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:00:30.095435 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:00:30.095438 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:00:30.095442 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:00:30.095446 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:00:30.095450 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:00:30.095453 | orchestrator | 2026-04-28 03:00:30.095457 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-28 03:00:30.095462 | orchestrator | Tuesday 28 April 2026 03:00:18 +0000 (0:00:01.477) 0:00:03.959 ********* 2026-04-28 03:00:30.095465 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:00:30.095469 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:00:30.095473 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:00:30.095477 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:00:30.095480 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:00:30.095484 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:00:30.095488 | orchestrator | 2026-04-28 03:00:30.095492 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 03:00:30.095496 | orchestrator | Tuesday 28 April 2026 03:00:19 +0000 (0:00:00.878) 0:00:04.838 ********* 2026-04-28 03:00:30.095499 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:00:30.095503 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:00:30.095507 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:00:30.095511 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:00:30.095514 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:00:30.095518 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:00:30.095522 | orchestrator | 2026-04-28 03:00:30.095526 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 03:00:30.095536 | orchestrator | Tuesday 28 April 2026 03:00:20 +0000 (0:00:01.019) 0:00:05.858 ********* 2026-04-28 03:00:30.095564 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:00:30.095568 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:00:30.095572 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:00:30.095575 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:00:30.095579 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:00:30.095583 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:00:30.095587 | orchestrator | 2026-04-28 03:00:30.095591 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-28 03:00:30.095595 | orchestrator | Tuesday 28 April 2026 03:00:21 +0000 (0:00:00.935) 0:00:06.793 ********* 2026-04-28 03:00:30.095599 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:00:30.095602 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:00:30.095606 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:00:30.095610 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:00:30.095614 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:00:30.095618 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:00:30.095622 | orchestrator | 2026-04-28 03:00:30.095626 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-28 03:00:30.095629 | orchestrator | Tuesday 28 April 2026 03:00:21 +0000 (0:00:00.622) 0:00:07.416 ********* 2026-04-28 03:00:30.095633 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:00:30.095637 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:00:30.095641 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:00:30.095645 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:00:30.095648 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:00:30.095652 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:00:30.095656 | orchestrator | 2026-04-28 03:00:30.095660 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-28 03:00:30.095664 | orchestrator | Tuesday 28 April 2026 03:00:22 +0000 (0:00:00.912) 0:00:08.328 ********* 2026-04-28 03:00:30.095668 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:30.095672 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:30.095676 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:30.095680 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:00:30.095684 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:00:30.095687 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:00:30.095692 | orchestrator | 2026-04-28 03:00:30.095696 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-28 03:00:30.095699 | orchestrator | Tuesday 28 April 2026 03:00:23 +0000 (0:00:00.671) 0:00:09.000 ********* 2026-04-28 03:00:30.095703 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:00:30.095707 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:00:30.095711 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:00:30.095715 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:00:30.095718 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:00:30.095722 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:00:30.095726 | orchestrator | 2026-04-28 03:00:30.095730 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-28 03:00:30.095734 | orchestrator | Tuesday 28 April 2026 03:00:24 +0000 (0:00:00.907) 0:00:09.907 ********* 2026-04-28 03:00:30.095738 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 03:00:30.095751 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 03:00:30.095755 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 03:00:30.095759 | orchestrator | 2026-04-28 03:00:30.095762 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-28 03:00:30.095766 | orchestrator | Tuesday 28 April 2026 03:00:25 +0000 (0:00:00.737) 0:00:10.645 ********* 2026-04-28 03:00:30.095770 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:00:30.095774 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:00:30.095777 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:00:30.095796 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:00:30.095800 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:00:30.095808 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:00:30.095812 | orchestrator | 2026-04-28 03:00:30.095816 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-28 03:00:30.095820 | orchestrator | Tuesday 28 April 2026 03:00:26 +0000 (0:00:01.307) 0:00:11.952 ********* 2026-04-28 03:00:30.095823 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 03:00:30.095827 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 03:00:30.095831 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 03:00:30.095835 | orchestrator | 2026-04-28 03:00:30.095839 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-28 03:00:30.095842 | orchestrator | Tuesday 28 April 2026 03:00:28 +0000 (0:00:02.094) 0:00:14.047 ********* 2026-04-28 03:00:30.095847 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-28 03:00:30.095851 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-28 03:00:30.095855 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-28 03:00:30.095859 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:30.095862 | orchestrator | 2026-04-28 03:00:30.095866 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-28 03:00:30.095870 | orchestrator | Tuesday 28 April 2026 03:00:29 +0000 (0:00:00.444) 0:00:14.491 ********* 2026-04-28 03:00:30.095875 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-28 03:00:30.095882 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-28 03:00:30.095885 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-28 03:00:30.095889 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:30.095893 | orchestrator | 2026-04-28 03:00:30.095897 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-28 03:00:30.095900 | orchestrator | Tuesday 28 April 2026 03:00:29 +0000 (0:00:00.674) 0:00:15.166 ********* 2026-04-28 03:00:30.095906 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:30.095912 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:30.095916 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:30.095920 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:30.095923 | orchestrator | 2026-04-28 03:00:30.095931 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-28 03:00:30.095934 | orchestrator | Tuesday 28 April 2026 03:00:29 +0000 (0:00:00.175) 0:00:15.341 ********* 2026-04-28 03:00:30.095948 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'stdout': '', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-28 03:00:27.162788', 'end': '2026-04-28 03:00:27.211926', 'delta': '0:00:00.049138', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': [], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-28 03:00:40.846473 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'stdout': '', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-28 03:00:27.742154', 'end': '2026-04-28 03:00:27.785601', 'delta': '0:00:00.043447', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': [], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-28 03:00:40.846587 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'stdout': '', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-28 03:00:28.326502', 'end': '2026-04-28 03:00:28.376419', 'delta': '0:00:00.049917', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': [], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-28 03:00:40.846606 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:40.846621 | orchestrator | 2026-04-28 03:00:40.846634 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-28 03:00:40.846646 | orchestrator | Tuesday 28 April 2026 03:00:30 +0000 (0:00:00.212) 0:00:15.553 ********* 2026-04-28 03:00:40.846657 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:00:40.846669 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:00:40.846679 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:00:40.846690 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:00:40.846700 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:00:40.846711 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:00:40.846722 | orchestrator | 2026-04-28 03:00:40.846733 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-28 03:00:40.846744 | orchestrator | Tuesday 28 April 2026 03:00:30 +0000 (0:00:00.905) 0:00:16.459 ********* 2026-04-28 03:00:40.846755 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-28 03:00:40.846766 | orchestrator | 2026-04-28 03:00:40.846777 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-28 03:00:40.846788 | orchestrator | Tuesday 28 April 2026 03:00:32 +0000 (0:00:01.110) 0:00:17.569 ********* 2026-04-28 03:00:40.846799 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:40.846809 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:40.846820 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:40.846831 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:00:40.846842 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:00:40.846880 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:00:40.846891 | orchestrator | 2026-04-28 03:00:40.846902 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-28 03:00:40.846913 | orchestrator | Tuesday 28 April 2026 03:00:32 +0000 (0:00:00.667) 0:00:18.237 ********* 2026-04-28 03:00:40.846924 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:40.846935 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:40.846946 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:40.846957 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:00:40.846967 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:00:40.846978 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:00:40.846989 | orchestrator | 2026-04-28 03:00:40.847002 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 03:00:40.847014 | orchestrator | Tuesday 28 April 2026 03:00:34 +0000 (0:00:01.238) 0:00:19.476 ********* 2026-04-28 03:00:40.847026 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:40.847039 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:40.847051 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:40.847063 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:00:40.847075 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:00:40.847088 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:00:40.847100 | orchestrator | 2026-04-28 03:00:40.847143 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-28 03:00:40.847157 | orchestrator | Tuesday 28 April 2026 03:00:34 +0000 (0:00:00.659) 0:00:20.135 ********* 2026-04-28 03:00:40.847170 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:40.847181 | orchestrator | 2026-04-28 03:00:40.847206 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-28 03:00:40.847217 | orchestrator | Tuesday 28 April 2026 03:00:34 +0000 (0:00:00.116) 0:00:20.252 ********* 2026-04-28 03:00:40.847228 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:40.847238 | orchestrator | 2026-04-28 03:00:40.847249 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 03:00:40.847260 | orchestrator | Tuesday 28 April 2026 03:00:35 +0000 (0:00:00.220) 0:00:20.473 ********* 2026-04-28 03:00:40.847270 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:40.847281 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:40.847292 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:40.847302 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:00:40.847313 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:00:40.847324 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:00:40.847335 | orchestrator | 2026-04-28 03:00:40.847363 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-28 03:00:40.847375 | orchestrator | Tuesday 28 April 2026 03:00:35 +0000 (0:00:00.890) 0:00:21.363 ********* 2026-04-28 03:00:40.847386 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:40.847397 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:40.847407 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:40.847418 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:00:40.847429 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:00:40.847439 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:00:40.847450 | orchestrator | 2026-04-28 03:00:40.847461 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-28 03:00:40.847472 | orchestrator | Tuesday 28 April 2026 03:00:36 +0000 (0:00:00.703) 0:00:22.067 ********* 2026-04-28 03:00:40.847483 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:40.847494 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:40.847504 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:40.847515 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:00:40.847526 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:00:40.847536 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:00:40.847547 | orchestrator | 2026-04-28 03:00:40.847558 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-28 03:00:40.847579 | orchestrator | Tuesday 28 April 2026 03:00:37 +0000 (0:00:00.909) 0:00:22.976 ********* 2026-04-28 03:00:40.847590 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:40.847600 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:40.847611 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:40.847622 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:00:40.847633 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:00:40.847643 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:00:40.847654 | orchestrator | 2026-04-28 03:00:40.847665 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-28 03:00:40.847676 | orchestrator | Tuesday 28 April 2026 03:00:38 +0000 (0:00:00.641) 0:00:23.617 ********* 2026-04-28 03:00:40.847687 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:40.847697 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:40.847708 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:40.847719 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:00:40.847729 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:00:40.847740 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:00:40.847751 | orchestrator | 2026-04-28 03:00:40.847761 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-28 03:00:40.847772 | orchestrator | Tuesday 28 April 2026 03:00:39 +0000 (0:00:00.915) 0:00:24.533 ********* 2026-04-28 03:00:40.847783 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:40.847793 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:40.847804 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:40.847815 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:00:40.847825 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:00:40.847836 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:00:40.847847 | orchestrator | 2026-04-28 03:00:40.847858 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-28 03:00:40.847869 | orchestrator | Tuesday 28 April 2026 03:00:39 +0000 (0:00:00.656) 0:00:25.190 ********* 2026-04-28 03:00:40.847880 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:40.847890 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:40.847901 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:40.847912 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:00:40.847923 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:00:40.847933 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:00:40.847944 | orchestrator | 2026-04-28 03:00:40.847955 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-28 03:00:40.847966 | orchestrator | Tuesday 28 April 2026 03:00:40 +0000 (0:00:00.883) 0:00:26.073 ********* 2026-04-28 03:00:40.847978 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f', 'dm-uuid-LVM-8dHS1FAptgldbJuN9Gw1hr0pl5XswJ3894zCAdztzvSylGKJfL2Zwu5Qsrm0jqWu'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:40.847997 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1', 'dm-uuid-LVM-SMcSbjI9wnD6SeY7SKKJ6dCSoT074g1SuE3hmfWZ3V1NoBQYcdXeMp0c5DwXf9Jz'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:40.848017 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:40.851473 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:40.851532 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:40.851544 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:40.851556 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:40.851566 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:40.851576 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:40.851586 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:40.851608 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf', 'dm-uuid-LVM-jDSXafY010UkbP8ZmxeIQet2dAZt2ducp03EHOrl6D51efYCaF9MHllF0WrfMNUg'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:40.851667 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:00:40.851681 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a', 'dm-uuid-LVM-Ef9S4L9mnk6YjVYwTU4OmJ1Dk0yNJkcNEeYiJgmdqy5Dk4JMIq1jh9ZhEgnxusYs'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:40.851693 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'holders': ['ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-CCJsyU-Xs4y-bAwu-Sr1U-RU9B-U5cX-8dk8mo', 'scsi-0QEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202', 'scsi-SQEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:00:40.851705 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:40.851750 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'holders': ['ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-rTHLNA-XX65-cEa6-oPdR-i0kN-CrZ9-dGTohN', 'scsi-0QEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675', 'scsi-SQEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:00:40.976481 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:40.976552 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c', 'scsi-SQEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:00:40.976561 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:40.976568 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-28-01-45-18-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:00:40.976574 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:40.976580 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:40.976585 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:40.976629 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:40.976654 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:40.976662 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:00:40.976670 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'holders': ['ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-l9OtEf-0x8l-OZFM-QMSY-xI5K-ifcY-q0IHfV', 'scsi-0QEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b', 'scsi-SQEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:00:40.976685 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'holders': ['ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-NfMdHp-i6Wd-iXE4-bdeT-UQcT-dakb-CDL8cZ', 'scsi-0QEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba', 'scsi-SQEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:00:40.976696 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80', 'scsi-SQEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:00:41.304662 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:41.304738 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-28-01-45-13-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:00:41.304747 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab', 'dm-uuid-LVM-wa3l676dWvdqPItJjhbbIPxjjJMNXrWDxgNEYRSdoBZ0EZLJPUa6Po9zcB3PjLSE'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.304753 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1', 'dm-uuid-LVM-L5YjMhWvYgnpoIfTj51PZeO1wrabnQEX7l2ME9eZWg9LEHQ0f9eDaf27dOm77xe0'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.304758 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.304765 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.304785 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.304804 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.304808 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.304824 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.304828 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.304832 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.304836 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:41.304846 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:00:41.304856 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'holders': ['ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-L2AQ1c-y7H3-F3Y3-6Qkf-SkKZ-Rdhw-Yd8PGb', 'scsi-0QEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79', 'scsi-SQEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:00:41.304865 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'holders': ['ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-vGsvHj-S1i8-Sw7N-17Sv-GX9v-DQYR-rG2tdh', 'scsi-0QEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89', 'scsi-SQEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:00:41.510736 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de', 'scsi-SQEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:00:41.510864 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-28-01-45-15-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:00:41.510888 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.510929 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.510955 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.510966 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.510976 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.510986 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.511015 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.511026 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.511045 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part1', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part14', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part15', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part16', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:00:41.511067 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-28-01-45-19-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:00:41.511078 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:41.511090 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.511100 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.511235 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.661752 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.661881 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.661954 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.661970 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.661997 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.662153 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part1', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part14', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part15', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part16', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:00:41.662177 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:00:41.662192 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-28-01-45-12-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:00:41.662215 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:00:41.662229 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.662242 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.662256 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.662281 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.662313 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.662334 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.662354 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:41.662385 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:00:42.266491 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part1', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part14', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part15', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part16', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:00:42.266624 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-28-01-45-16-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:00:42.266644 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:00:42.266659 | orchestrator | 2026-04-28 03:00:42.266671 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-28 03:00:42.266683 | orchestrator | Tuesday 28 April 2026 03:00:41 +0000 (0:00:01.157) 0:00:27.230 ********* 2026-04-28 03:00:42.266696 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f', 'dm-uuid-LVM-8dHS1FAptgldbJuN9Gw1hr0pl5XswJ3894zCAdztzvSylGKJfL2Zwu5Qsrm0jqWu'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.266728 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1', 'dm-uuid-LVM-SMcSbjI9wnD6SeY7SKKJ6dCSoT074g1SuE3hmfWZ3V1NoBQYcdXeMp0c5DwXf9Jz'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.266750 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.266763 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.266781 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.266792 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.266804 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.266815 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.266849 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.364729 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.364882 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.364919 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf', 'dm-uuid-LVM-jDSXafY010UkbP8ZmxeIQet2dAZt2ducp03EHOrl6D51efYCaF9MHllF0WrfMNUg'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.364994 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'holders': ['ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-CCJsyU-Xs4y-bAwu-Sr1U-RU9B-U5cX-8dk8mo', 'scsi-0QEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202', 'scsi-SQEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.365021 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a', 'dm-uuid-LVM-Ef9S4L9mnk6YjVYwTU4OmJ1Dk0yNJkcNEeYiJgmdqy5Dk4JMIq1jh9ZhEgnxusYs'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.365051 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'holders': ['ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-rTHLNA-XX65-cEa6-oPdR-i0kN-CrZ9-dGTohN', 'scsi-0QEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675', 'scsi-SQEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.365072 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.365091 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c', 'scsi-SQEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.365188 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.611008 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-28-01-45-18-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.611162 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.611178 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:42.611191 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab', 'dm-uuid-LVM-wa3l676dWvdqPItJjhbbIPxjjJMNXrWDxgNEYRSdoBZ0EZLJPUa6Po9zcB3PjLSE'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.611203 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1', 'dm-uuid-LVM-L5YjMhWvYgnpoIfTj51PZeO1wrabnQEX7l2ME9eZWg9LEHQ0f9eDaf27dOm77xe0'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.611232 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.611273 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.611298 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.611320 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.611348 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.611363 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.611390 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.611405 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.611433 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.658479 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.658617 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.658638 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.658653 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.658691 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.658745 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.658758 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.658773 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.658783 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'holders': ['ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-l9OtEf-0x8l-OZFM-QMSY-xI5K-ifcY-q0IHfV', 'scsi-0QEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b', 'scsi-SQEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.658792 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.658814 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.698756 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'holders': ['ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-NfMdHp-i6Wd-iXE4-bdeT-UQcT-dakb-CDL8cZ', 'scsi-0QEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba', 'scsi-SQEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.698874 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.698892 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.698930 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'holders': ['ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-L2AQ1c-y7H3-F3Y3-6Qkf-SkKZ-Rdhw-Yd8PGb', 'scsi-0QEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79', 'scsi-SQEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.698945 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80', 'scsi-SQEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.699002 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.699017 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'holders': ['ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-vGsvHj-S1i8-Sw7N-17Sv-GX9v-DQYR-rG2tdh', 'scsi-0QEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89', 'scsi-SQEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.699031 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-28-01-45-13-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.699049 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.699058 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de', 'scsi-SQEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.699083 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part1', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part14', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part15', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part16', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.901672 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-28-01-45-15-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.901880 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-28-01-45-19-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.901948 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:42.901975 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.902004 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.902150 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.902171 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.902220 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.902253 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.902290 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.902311 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:42.902349 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part1', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part14', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part15', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part16', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:43.153694 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-28-01-45-12-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:43.153817 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:43.153831 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:00:43.153841 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:00:43.153851 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:43.153863 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:43.153873 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:43.153882 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:43.153892 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:43.153923 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:43.153939 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:43.153948 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:43.153961 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part1', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part14', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part15', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part16', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:43.153982 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-28-01-45-16-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:00:56.163408 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:00:56.163491 | orchestrator | 2026-04-28 03:00:56.163498 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-28 03:00:56.163504 | orchestrator | Tuesday 28 April 2026 03:00:43 +0000 (0:00:01.374) 0:00:28.605 ********* 2026-04-28 03:00:56.163508 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:00:56.163513 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:00:56.163517 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:00:56.163521 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:00:56.163525 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:00:56.163529 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:00:56.163533 | orchestrator | 2026-04-28 03:00:56.163537 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-28 03:00:56.163541 | orchestrator | Tuesday 28 April 2026 03:00:44 +0000 (0:00:01.116) 0:00:29.722 ********* 2026-04-28 03:00:56.163545 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:00:56.163548 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:00:56.163552 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:00:56.163556 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:00:56.163560 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:00:56.163564 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:00:56.163567 | orchestrator | 2026-04-28 03:00:56.163571 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 03:00:56.163575 | orchestrator | Tuesday 28 April 2026 03:00:45 +0000 (0:00:00.887) 0:00:30.610 ********* 2026-04-28 03:00:56.163579 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:56.163583 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:56.163587 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:56.163590 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:00:56.163594 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:00:56.163598 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:00:56.163602 | orchestrator | 2026-04-28 03:00:56.163606 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 03:00:56.163610 | orchestrator | Tuesday 28 April 2026 03:00:45 +0000 (0:00:00.651) 0:00:31.262 ********* 2026-04-28 03:00:56.163613 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:56.163618 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:56.163622 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:56.163625 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:00:56.163629 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:00:56.163633 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:00:56.163637 | orchestrator | 2026-04-28 03:00:56.163641 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 03:00:56.163644 | orchestrator | Tuesday 28 April 2026 03:00:46 +0000 (0:00:00.923) 0:00:32.185 ********* 2026-04-28 03:00:56.163648 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:56.163652 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:56.163656 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:56.163660 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:00:56.163663 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:00:56.163667 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:00:56.163671 | orchestrator | 2026-04-28 03:00:56.163675 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 03:00:56.163694 | orchestrator | Tuesday 28 April 2026 03:00:47 +0000 (0:00:00.962) 0:00:33.147 ********* 2026-04-28 03:00:56.163698 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:56.163702 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:56.163706 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:56.163709 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:00:56.163713 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:00:56.163717 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:00:56.163721 | orchestrator | 2026-04-28 03:00:56.163725 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-28 03:00:56.163728 | orchestrator | Tuesday 28 April 2026 03:00:48 +0000 (0:00:00.687) 0:00:33.835 ********* 2026-04-28 03:00:56.163732 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-0) 2026-04-28 03:00:56.163737 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-0) 2026-04-28 03:00:56.163740 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-1) 2026-04-28 03:00:56.163744 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-0) 2026-04-28 03:00:56.163748 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-1) 2026-04-28 03:00:56.163752 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 03:00:56.163755 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-2) 2026-04-28 03:00:56.163759 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-1) 2026-04-28 03:00:56.163763 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-0) 2026-04-28 03:00:56.163767 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-2) 2026-04-28 03:00:56.163770 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-2) 2026-04-28 03:00:56.163774 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-0) 2026-04-28 03:00:56.163778 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-28 03:00:56.163781 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-28 03:00:56.163785 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-2) 2026-04-28 03:00:56.163789 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-1) 2026-04-28 03:00:56.163793 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-28 03:00:56.163796 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-28 03:00:56.163800 | orchestrator | 2026-04-28 03:00:56.163804 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-28 03:00:56.163808 | orchestrator | Tuesday 28 April 2026 03:00:50 +0000 (0:00:02.097) 0:00:35.933 ********* 2026-04-28 03:00:56.163812 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-28 03:00:56.163826 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-28 03:00:56.163830 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-28 03:00:56.163834 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:56.163838 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-28 03:00:56.163841 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-28 03:00:56.163845 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-28 03:00:56.163859 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:56.163863 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-28 03:00:56.163867 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-28 03:00:56.163870 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-28 03:00:56.163874 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:56.163878 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-28 03:00:56.163881 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-28 03:00:56.163885 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-28 03:00:56.163889 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:00:56.163893 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-28 03:00:56.163896 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-28 03:00:56.163905 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-28 03:00:56.163909 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:00:56.163912 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-28 03:00:56.163916 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-28 03:00:56.163920 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-28 03:00:56.163924 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:00:56.163927 | orchestrator | 2026-04-28 03:00:56.163931 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-28 03:00:56.163935 | orchestrator | Tuesday 28 April 2026 03:00:51 +0000 (0:00:00.830) 0:00:36.763 ********* 2026-04-28 03:00:56.163939 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:00:56.163943 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:00:56.163947 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:00:56.163951 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:00:56.163955 | orchestrator | 2026-04-28 03:00:56.163959 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 03:00:56.163964 | orchestrator | Tuesday 28 April 2026 03:00:52 +0000 (0:00:01.241) 0:00:38.005 ********* 2026-04-28 03:00:56.163968 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:56.163973 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:56.163977 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:56.163982 | orchestrator | 2026-04-28 03:00:56.163987 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 03:00:56.163991 | orchestrator | Tuesday 28 April 2026 03:00:52 +0000 (0:00:00.372) 0:00:38.377 ********* 2026-04-28 03:00:56.163995 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:56.164000 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:56.164004 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:56.164008 | orchestrator | 2026-04-28 03:00:56.164012 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 03:00:56.164017 | orchestrator | Tuesday 28 April 2026 03:00:53 +0000 (0:00:00.424) 0:00:38.802 ********* 2026-04-28 03:00:56.164021 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:56.164025 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:00:56.164030 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:00:56.164034 | orchestrator | 2026-04-28 03:00:56.164038 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 03:00:56.164043 | orchestrator | Tuesday 28 April 2026 03:00:53 +0000 (0:00:00.600) 0:00:39.402 ********* 2026-04-28 03:00:56.164048 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:00:56.164052 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:00:56.164057 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:00:56.164061 | orchestrator | 2026-04-28 03:00:56.164065 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 03:00:56.164069 | orchestrator | Tuesday 28 April 2026 03:00:54 +0000 (0:00:00.496) 0:00:39.899 ********* 2026-04-28 03:00:56.164074 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 03:00:56.164078 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 03:00:56.164083 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 03:00:56.164087 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:56.164109 | orchestrator | 2026-04-28 03:00:56.164116 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 03:00:56.164122 | orchestrator | Tuesday 28 April 2026 03:00:54 +0000 (0:00:00.477) 0:00:40.376 ********* 2026-04-28 03:00:56.164129 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 03:00:56.164135 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 03:00:56.164142 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 03:00:56.164155 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:56.164162 | orchestrator | 2026-04-28 03:00:56.164166 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 03:00:56.164171 | orchestrator | Tuesday 28 April 2026 03:00:55 +0000 (0:00:00.464) 0:00:40.841 ********* 2026-04-28 03:00:56.164175 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 03:00:56.164180 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 03:00:56.164184 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 03:00:56.164188 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:00:56.164192 | orchestrator | 2026-04-28 03:00:56.164200 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 03:00:56.164205 | orchestrator | Tuesday 28 April 2026 03:00:55 +0000 (0:00:00.411) 0:00:41.253 ********* 2026-04-28 03:00:56.164209 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:00:56.164213 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:00:56.164218 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:00:56.164222 | orchestrator | 2026-04-28 03:00:56.164226 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 03:00:56.164234 | orchestrator | Tuesday 28 April 2026 03:00:56 +0000 (0:00:00.363) 0:00:41.617 ********* 2026-04-28 03:01:17.192067 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-28 03:01:17.192159 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-28 03:01:17.192168 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-28 03:01:17.192174 | orchestrator | 2026-04-28 03:01:17.192182 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-28 03:01:17.192189 | orchestrator | Tuesday 28 April 2026 03:00:57 +0000 (0:00:00.887) 0:00:42.504 ********* 2026-04-28 03:01:17.192195 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 03:01:17.192201 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 03:01:17.192207 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 03:01:17.192213 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-28 03:01:17.192219 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 03:01:17.192225 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 03:01:17.192230 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 03:01:17.192235 | orchestrator | 2026-04-28 03:01:17.192241 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-28 03:01:17.192246 | orchestrator | Tuesday 28 April 2026 03:00:57 +0000 (0:00:00.884) 0:00:43.388 ********* 2026-04-28 03:01:17.192251 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 03:01:17.192257 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 03:01:17.192262 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 03:01:17.192267 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-28 03:01:17.192273 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 03:01:17.192278 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 03:01:17.192283 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 03:01:17.192289 | orchestrator | 2026-04-28 03:01:17.192294 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 03:01:17.192299 | orchestrator | Tuesday 28 April 2026 03:01:00 +0000 (0:00:02.103) 0:00:45.492 ********* 2026-04-28 03:01:17.192305 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:01:17.192333 | orchestrator | 2026-04-28 03:01:17.192339 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 03:01:17.192344 | orchestrator | Tuesday 28 April 2026 03:01:01 +0000 (0:00:01.365) 0:00:46.858 ********* 2026-04-28 03:01:17.192350 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:01:17.192356 | orchestrator | 2026-04-28 03:01:17.192361 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 03:01:17.192366 | orchestrator | Tuesday 28 April 2026 03:01:02 +0000 (0:00:01.365) 0:00:48.223 ********* 2026-04-28 03:01:17.192372 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:01:17.192377 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:01:17.192383 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:01:17.192388 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:01:17.192394 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:01:17.192399 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:01:17.192405 | orchestrator | 2026-04-28 03:01:17.192410 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 03:01:17.192416 | orchestrator | Tuesday 28 April 2026 03:01:04 +0000 (0:00:01.353) 0:00:49.577 ********* 2026-04-28 03:01:17.192421 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:01:17.192426 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:01:17.192432 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:01:17.192437 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:01:17.192442 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:01:17.192447 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:01:17.192453 | orchestrator | 2026-04-28 03:01:17.192458 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 03:01:17.192463 | orchestrator | Tuesday 28 April 2026 03:01:04 +0000 (0:00:00.723) 0:00:50.300 ********* 2026-04-28 03:01:17.192469 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:01:17.192474 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:01:17.192479 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:01:17.192485 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:01:17.192492 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:01:17.192500 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:01:17.192509 | orchestrator | 2026-04-28 03:01:17.192517 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 03:01:17.192527 | orchestrator | Tuesday 28 April 2026 03:01:05 +0000 (0:00:01.056) 0:00:51.357 ********* 2026-04-28 03:01:17.192535 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:01:17.192544 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:01:17.192552 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:01:17.192573 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:01:17.192583 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:01:17.192592 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:01:17.192601 | orchestrator | 2026-04-28 03:01:17.192610 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 03:01:17.192619 | orchestrator | Tuesday 28 April 2026 03:01:06 +0000 (0:00:00.786) 0:00:52.144 ********* 2026-04-28 03:01:17.192629 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:01:17.192638 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:01:17.192663 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:01:17.192672 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:01:17.192681 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:01:17.192689 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:01:17.192696 | orchestrator | 2026-04-28 03:01:17.192702 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 03:01:17.192709 | orchestrator | Tuesday 28 April 2026 03:01:08 +0000 (0:00:01.361) 0:00:53.505 ********* 2026-04-28 03:01:17.192715 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:01:17.192721 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:01:17.192735 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:01:17.192741 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:01:17.192747 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:01:17.192753 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:01:17.192759 | orchestrator | 2026-04-28 03:01:17.192765 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 03:01:17.192772 | orchestrator | Tuesday 28 April 2026 03:01:08 +0000 (0:00:00.639) 0:00:54.145 ********* 2026-04-28 03:01:17.192778 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:01:17.192784 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:01:17.192791 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:01:17.192797 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:01:17.192803 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:01:17.192809 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:01:17.192816 | orchestrator | 2026-04-28 03:01:17.192822 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 03:01:17.192828 | orchestrator | Tuesday 28 April 2026 03:01:09 +0000 (0:00:00.934) 0:00:55.080 ********* 2026-04-28 03:01:17.192834 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:01:17.192841 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:01:17.192847 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:01:17.192853 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:01:17.192859 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:01:17.192866 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:01:17.192872 | orchestrator | 2026-04-28 03:01:17.192878 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 03:01:17.192885 | orchestrator | Tuesday 28 April 2026 03:01:10 +0000 (0:00:01.386) 0:00:56.466 ********* 2026-04-28 03:01:17.192891 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:01:17.192898 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:01:17.192903 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:01:17.192910 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:01:17.192916 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:01:17.192923 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:01:17.192929 | orchestrator | 2026-04-28 03:01:17.192935 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 03:01:17.192941 | orchestrator | Tuesday 28 April 2026 03:01:12 +0000 (0:00:01.133) 0:00:57.600 ********* 2026-04-28 03:01:17.192948 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:01:17.192955 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:01:17.192961 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:01:17.192967 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:01:17.192972 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:01:17.192978 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:01:17.192983 | orchestrator | 2026-04-28 03:01:17.192989 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 03:01:17.192994 | orchestrator | Tuesday 28 April 2026 03:01:13 +0000 (0:00:00.919) 0:00:58.519 ********* 2026-04-28 03:01:17.192999 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:01:17.193005 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:01:17.193010 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:01:17.193015 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:01:17.193021 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:01:17.193026 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:01:17.193031 | orchestrator | 2026-04-28 03:01:17.193037 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 03:01:17.193042 | orchestrator | Tuesday 28 April 2026 03:01:13 +0000 (0:00:00.686) 0:00:59.205 ********* 2026-04-28 03:01:17.193047 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:01:17.193053 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:01:17.193058 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:01:17.193063 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:01:17.193069 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:01:17.193074 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:01:17.193096 | orchestrator | 2026-04-28 03:01:17.193110 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 03:01:17.193116 | orchestrator | Tuesday 28 April 2026 03:01:14 +0000 (0:00:00.884) 0:01:00.090 ********* 2026-04-28 03:01:17.193122 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:01:17.193127 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:01:17.193132 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:01:17.193138 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:01:17.193143 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:01:17.193149 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:01:17.193154 | orchestrator | 2026-04-28 03:01:17.193159 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 03:01:17.193165 | orchestrator | Tuesday 28 April 2026 03:01:15 +0000 (0:00:00.710) 0:01:00.800 ********* 2026-04-28 03:01:17.193170 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:01:17.193176 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:01:17.193181 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:01:17.193186 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:01:17.193192 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:01:17.193197 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:01:17.193206 | orchestrator | 2026-04-28 03:01:17.193214 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 03:01:17.193229 | orchestrator | Tuesday 28 April 2026 03:01:16 +0000 (0:00:00.879) 0:01:01.680 ********* 2026-04-28 03:01:17.193237 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:01:17.193246 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:01:17.193260 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:01:17.193269 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:01:17.193277 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:01:17.193284 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:01:17.193292 | orchestrator | 2026-04-28 03:01:17.193301 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 03:01:17.193310 | orchestrator | Tuesday 28 April 2026 03:01:16 +0000 (0:00:00.640) 0:01:02.321 ********* 2026-04-28 03:01:17.193318 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:01:17.193334 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:02:36.071746 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:02:36.071865 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:02:36.071881 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:02:36.071893 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:02:36.071905 | orchestrator | 2026-04-28 03:02:36.071918 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 03:02:36.071931 | orchestrator | Tuesday 28 April 2026 03:01:17 +0000 (0:00:00.922) 0:01:03.243 ********* 2026-04-28 03:02:36.071942 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:02:36.071953 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:02:36.071964 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:02:36.071975 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:02:36.071986 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:02:36.071997 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:02:36.072008 | orchestrator | 2026-04-28 03:02:36.072020 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 03:02:36.072093 | orchestrator | Tuesday 28 April 2026 03:01:18 +0000 (0:00:00.688) 0:01:03.931 ********* 2026-04-28 03:02:36.072106 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:02:36.072117 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:02:36.072128 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:02:36.072139 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:02:36.072150 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:02:36.072161 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:02:36.072172 | orchestrator | 2026-04-28 03:02:36.072183 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 03:02:36.072195 | orchestrator | Tuesday 28 April 2026 03:01:19 +0000 (0:00:00.885) 0:01:04.817 ********* 2026-04-28 03:02:36.072206 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:02:36.072244 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:02:36.072255 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:02:36.072266 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:02:36.072277 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:02:36.072288 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:02:36.072299 | orchestrator | 2026-04-28 03:02:36.072310 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-28 03:02:36.072322 | orchestrator | Tuesday 28 April 2026 03:01:20 +0000 (0:00:01.410) 0:01:06.228 ********* 2026-04-28 03:02:36.072333 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:02:36.072344 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:02:36.072355 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:02:36.072366 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:02:36.072377 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:02:36.072387 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:02:36.072398 | orchestrator | 2026-04-28 03:02:36.072409 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-28 03:02:36.072420 | orchestrator | Tuesday 28 April 2026 03:01:22 +0000 (0:00:01.571) 0:01:07.800 ********* 2026-04-28 03:02:36.072431 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:02:36.072442 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:02:36.072453 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:02:36.072464 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:02:36.072475 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:02:36.072486 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:02:36.072497 | orchestrator | 2026-04-28 03:02:36.072508 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-28 03:02:36.072519 | orchestrator | Tuesday 28 April 2026 03:01:24 +0000 (0:00:02.496) 0:01:10.296 ********* 2026-04-28 03:02:36.072531 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:02:36.072544 | orchestrator | 2026-04-28 03:02:36.072555 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-28 03:02:36.072566 | orchestrator | Tuesday 28 April 2026 03:01:26 +0000 (0:00:01.358) 0:01:11.655 ********* 2026-04-28 03:02:36.072577 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:02:36.072587 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:02:36.072598 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:02:36.072609 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:02:36.072620 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:02:36.072631 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:02:36.072642 | orchestrator | 2026-04-28 03:02:36.072653 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-28 03:02:36.072664 | orchestrator | Tuesday 28 April 2026 03:01:26 +0000 (0:00:00.729) 0:01:12.385 ********* 2026-04-28 03:02:36.072675 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:02:36.072686 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:02:36.072696 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:02:36.072707 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:02:36.072718 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:02:36.072729 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:02:36.072740 | orchestrator | 2026-04-28 03:02:36.072751 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-28 03:02:36.072762 | orchestrator | Tuesday 28 April 2026 03:01:27 +0000 (0:00:00.919) 0:01:13.305 ********* 2026-04-28 03:02:36.072773 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-28 03:02:36.072784 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-28 03:02:36.072795 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-28 03:02:36.072805 | orchestrator | ok: [testbed-node-0] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-28 03:02:36.072816 | orchestrator | ok: [testbed-node-1] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-28 03:02:36.072854 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-28 03:02:36.072867 | orchestrator | ok: [testbed-node-2] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-28 03:02:36.072878 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-28 03:02:36.072889 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-28 03:02:36.072917 | orchestrator | ok: [testbed-node-0] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-28 03:02:36.072929 | orchestrator | ok: [testbed-node-1] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-28 03:02:36.072940 | orchestrator | ok: [testbed-node-2] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-28 03:02:36.072951 | orchestrator | 2026-04-28 03:02:36.072962 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-28 03:02:36.072973 | orchestrator | Tuesday 28 April 2026 03:01:29 +0000 (0:00:01.331) 0:01:14.636 ********* 2026-04-28 03:02:36.072984 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:02:36.072994 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:02:36.073005 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:02:36.073016 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:02:36.073027 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:02:36.073059 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:02:36.073070 | orchestrator | 2026-04-28 03:02:36.073081 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-28 03:02:36.073093 | orchestrator | Tuesday 28 April 2026 03:01:30 +0000 (0:00:01.316) 0:01:15.953 ********* 2026-04-28 03:02:36.073103 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:02:36.073114 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:02:36.073125 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:02:36.073136 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:02:36.073147 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:02:36.073158 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:02:36.073168 | orchestrator | 2026-04-28 03:02:36.073179 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-28 03:02:36.073190 | orchestrator | Tuesday 28 April 2026 03:01:31 +0000 (0:00:00.686) 0:01:16.640 ********* 2026-04-28 03:02:36.073201 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:02:36.073212 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:02:36.073223 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:02:36.073234 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:02:36.073245 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:02:36.073256 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:02:36.073266 | orchestrator | 2026-04-28 03:02:36.073277 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-28 03:02:36.073288 | orchestrator | Tuesday 28 April 2026 03:01:32 +0000 (0:00:00.931) 0:01:17.572 ********* 2026-04-28 03:02:36.073299 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:02:36.073310 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:02:36.073321 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:02:36.073332 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:02:36.073343 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:02:36.073354 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:02:36.073365 | orchestrator | 2026-04-28 03:02:36.073376 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-28 03:02:36.073387 | orchestrator | Tuesday 28 April 2026 03:01:32 +0000 (0:00:00.653) 0:01:18.225 ********* 2026-04-28 03:02:36.073399 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:02:36.073410 | orchestrator | 2026-04-28 03:02:36.073421 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-28 03:02:36.073440 | orchestrator | Tuesday 28 April 2026 03:01:34 +0000 (0:00:01.422) 0:01:19.648 ********* 2026-04-28 03:02:36.073452 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:02:36.073463 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:02:36.073474 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:02:36.073485 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:02:36.073496 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:02:36.073507 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:02:36.073518 | orchestrator | 2026-04-28 03:02:36.073529 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-28 03:02:36.073540 | orchestrator | Tuesday 28 April 2026 03:02:35 +0000 (0:01:01.132) 0:02:20.780 ********* 2026-04-28 03:02:36.073551 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-28 03:02:36.073562 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-28 03:02:36.073573 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-28 03:02:36.073584 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:02:36.073596 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-28 03:02:36.073607 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-28 03:02:36.073618 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-28 03:02:36.073629 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:02:36.073640 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-28 03:02:36.073651 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-28 03:02:36.073662 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-28 03:02:36.073673 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:02:36.073684 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-28 03:02:36.073695 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-28 03:02:36.073711 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-28 03:02:36.073722 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:02:36.073733 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-28 03:02:36.073744 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-28 03:02:36.073755 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-28 03:02:36.073772 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:01.250990 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-28 03:03:01.251103 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-28 03:03:01.251111 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-28 03:03:01.251116 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:01.251121 | orchestrator | 2026-04-28 03:03:01.251126 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-28 03:03:01.251130 | orchestrator | Tuesday 28 April 2026 03:02:36 +0000 (0:00:00.746) 0:02:21.527 ********* 2026-04-28 03:03:01.251133 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:01.251137 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:01.251141 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:01.251145 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:01.251149 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:01.251153 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:01.251157 | orchestrator | 2026-04-28 03:03:01.251161 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-28 03:03:01.251171 | orchestrator | Tuesday 28 April 2026 03:02:36 +0000 (0:00:00.890) 0:02:22.418 ********* 2026-04-28 03:03:01.251175 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:01.251196 | orchestrator | 2026-04-28 03:03:01.251200 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-28 03:03:01.251204 | orchestrator | Tuesday 28 April 2026 03:02:37 +0000 (0:00:00.169) 0:02:22.588 ********* 2026-04-28 03:03:01.251208 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:01.251212 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:01.251215 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:01.251219 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:01.251223 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:01.251227 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:01.251230 | orchestrator | 2026-04-28 03:03:01.251234 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-28 03:03:01.251238 | orchestrator | Tuesday 28 April 2026 03:02:38 +0000 (0:00:00.928) 0:02:23.516 ********* 2026-04-28 03:03:01.251242 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:01.251246 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:01.251251 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:01.251257 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:01.251263 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:01.251269 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:01.251275 | orchestrator | 2026-04-28 03:03:01.251281 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-28 03:03:01.251286 | orchestrator | Tuesday 28 April 2026 03:02:38 +0000 (0:00:00.682) 0:02:24.199 ********* 2026-04-28 03:03:01.251292 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:01.251298 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:01.251303 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:01.251309 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:01.251314 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:01.251321 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:01.251327 | orchestrator | 2026-04-28 03:03:01.251333 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-28 03:03:01.251338 | orchestrator | Tuesday 28 April 2026 03:02:39 +0000 (0:00:00.928) 0:02:25.128 ********* 2026-04-28 03:03:01.251344 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:03:01.251351 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:03:01.251357 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:03:01.251363 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:03:01.251369 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:03:01.251375 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:03:01.251381 | orchestrator | 2026-04-28 03:03:01.251387 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-28 03:03:01.251394 | orchestrator | Tuesday 28 April 2026 03:02:42 +0000 (0:00:03.324) 0:02:28.452 ********* 2026-04-28 03:03:01.251399 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:03:01.251406 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:03:01.251412 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:03:01.251418 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:03:01.251424 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:03:01.251429 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:03:01.251436 | orchestrator | 2026-04-28 03:03:01.251442 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-28 03:03:01.251449 | orchestrator | Tuesday 28 April 2026 03:02:43 +0000 (0:00:00.920) 0:02:29.373 ********* 2026-04-28 03:03:01.251457 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:03:01.251462 | orchestrator | 2026-04-28 03:03:01.251466 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-28 03:03:01.251470 | orchestrator | Tuesday 28 April 2026 03:02:45 +0000 (0:00:01.400) 0:02:30.773 ********* 2026-04-28 03:03:01.251474 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:01.251478 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:01.251481 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:01.251492 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:01.251496 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:01.251499 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:01.251503 | orchestrator | 2026-04-28 03:03:01.251507 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-28 03:03:01.251511 | orchestrator | Tuesday 28 April 2026 03:02:46 +0000 (0:00:00.758) 0:02:31.532 ********* 2026-04-28 03:03:01.251515 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:01.251529 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:01.251533 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:01.251536 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:01.251540 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:01.251544 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:01.251550 | orchestrator | 2026-04-28 03:03:01.251556 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-28 03:03:01.251567 | orchestrator | Tuesday 28 April 2026 03:02:46 +0000 (0:00:00.904) 0:02:32.437 ********* 2026-04-28 03:03:01.251573 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:01.251593 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:01.251599 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:01.251605 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:01.251611 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:01.251617 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:01.251623 | orchestrator | 2026-04-28 03:03:01.251629 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-28 03:03:01.251635 | orchestrator | Tuesday 28 April 2026 03:02:47 +0000 (0:00:00.762) 0:02:33.200 ********* 2026-04-28 03:03:01.251642 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:01.251648 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:01.251656 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:01.251661 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:01.251665 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:01.251670 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:01.251674 | orchestrator | 2026-04-28 03:03:01.251679 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-28 03:03:01.251683 | orchestrator | Tuesday 28 April 2026 03:02:48 +0000 (0:00:00.939) 0:02:34.139 ********* 2026-04-28 03:03:01.251688 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:01.251692 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:01.251696 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:01.251700 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:01.251705 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:01.251710 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:01.251714 | orchestrator | 2026-04-28 03:03:01.251718 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-28 03:03:01.251723 | orchestrator | Tuesday 28 April 2026 03:02:49 +0000 (0:00:00.680) 0:02:34.819 ********* 2026-04-28 03:03:01.251727 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:01.251732 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:01.251736 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:01.251741 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:01.251745 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:01.251749 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:01.251754 | orchestrator | 2026-04-28 03:03:01.251758 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-28 03:03:01.251762 | orchestrator | Tuesday 28 April 2026 03:02:50 +0000 (0:00:00.963) 0:02:35.783 ********* 2026-04-28 03:03:01.251767 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:01.251771 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:01.251776 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:01.251781 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:01.251787 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:01.251800 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:01.251806 | orchestrator | 2026-04-28 03:03:01.251812 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-28 03:03:01.251819 | orchestrator | Tuesday 28 April 2026 03:02:51 +0000 (0:00:00.733) 0:02:36.516 ********* 2026-04-28 03:03:01.251828 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:01.251836 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:01.251842 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:01.251848 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:01.251854 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:01.251860 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:01.251866 | orchestrator | 2026-04-28 03:03:01.251872 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-28 03:03:01.251878 | orchestrator | Tuesday 28 April 2026 03:02:51 +0000 (0:00:00.923) 0:02:37.440 ********* 2026-04-28 03:03:01.251883 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:03:01.251890 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:03:01.251895 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:03:01.251901 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:03:01.251907 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:03:01.251912 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:03:01.251918 | orchestrator | 2026-04-28 03:03:01.251924 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-28 03:03:01.251930 | orchestrator | Tuesday 28 April 2026 03:02:53 +0000 (0:00:01.452) 0:02:38.892 ********* 2026-04-28 03:03:01.251937 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:03:01.251944 | orchestrator | 2026-04-28 03:03:01.251951 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-28 03:03:01.251957 | orchestrator | Tuesday 28 April 2026 03:02:54 +0000 (0:00:01.391) 0:02:40.284 ********* 2026-04-28 03:03:01.251964 | orchestrator | changed: [testbed-node-3] => (item=/etc/ceph) 2026-04-28 03:03:01.251971 | orchestrator | changed: [testbed-node-4] => (item=/etc/ceph) 2026-04-28 03:03:01.251977 | orchestrator | changed: [testbed-node-5] => (item=/etc/ceph) 2026-04-28 03:03:01.251983 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/) 2026-04-28 03:03:01.251987 | orchestrator | changed: [testbed-node-0] => (item=/etc/ceph) 2026-04-28 03:03:01.251991 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/) 2026-04-28 03:03:01.251994 | orchestrator | changed: [testbed-node-1] => (item=/etc/ceph) 2026-04-28 03:03:01.251998 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/) 2026-04-28 03:03:01.252002 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/mon) 2026-04-28 03:03:01.252006 | orchestrator | changed: [testbed-node-2] => (item=/etc/ceph) 2026-04-28 03:03:01.252009 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/) 2026-04-28 03:03:01.252037 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/mon) 2026-04-28 03:03:01.252042 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/) 2026-04-28 03:03:01.252045 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/mon) 2026-04-28 03:03:01.252050 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/osd) 2026-04-28 03:03:01.252054 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/mon) 2026-04-28 03:03:01.252057 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/) 2026-04-28 03:03:01.252068 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/osd) 2026-04-28 03:03:07.141631 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/mon) 2026-04-28 03:03:07.141764 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/osd) 2026-04-28 03:03:07.141788 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/mds) 2026-04-28 03:03:07.141806 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/osd) 2026-04-28 03:03:07.141824 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/mon) 2026-04-28 03:03:07.141872 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/osd) 2026-04-28 03:03:07.141884 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/mds) 2026-04-28 03:03:07.141894 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/mds) 2026-04-28 03:03:07.141904 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/tmp) 2026-04-28 03:03:07.141914 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/mds) 2026-04-28 03:03:07.141923 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/osd) 2026-04-28 03:03:07.141933 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/mds) 2026-04-28 03:03:07.141942 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/tmp) 2026-04-28 03:03:07.141952 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/tmp) 2026-04-28 03:03:07.141962 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/crash) 2026-04-28 03:03:07.141972 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/tmp) 2026-04-28 03:03:07.141981 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/mds) 2026-04-28 03:03:07.141991 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/tmp) 2026-04-28 03:03:07.142000 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/crash) 2026-04-28 03:03:07.142010 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/crash) 2026-04-28 03:03:07.142119 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/radosgw) 2026-04-28 03:03:07.142133 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/crash) 2026-04-28 03:03:07.142144 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/tmp) 2026-04-28 03:03:07.142156 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/crash) 2026-04-28 03:03:07.142167 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/radosgw) 2026-04-28 03:03:07.142179 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/radosgw) 2026-04-28 03:03:07.142192 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-28 03:03:07.142209 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/radosgw) 2026-04-28 03:03:07.142225 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/crash) 2026-04-28 03:03:07.142242 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/radosgw) 2026-04-28 03:03:07.142258 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-28 03:03:07.142274 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-28 03:03:07.142289 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-28 03:03:07.142306 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-28 03:03:07.142323 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/radosgw) 2026-04-28 03:03:07.142341 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-28 03:03:07.142358 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-28 03:03:07.142371 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-28 03:03:07.142382 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-28 03:03:07.142395 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-28 03:03:07.142406 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-28 03:03:07.142418 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-28 03:03:07.142430 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-28 03:03:07.142441 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-28 03:03:07.142452 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-28 03:03:07.142463 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-28 03:03:07.142487 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-28 03:03:07.142497 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-28 03:03:07.142506 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-28 03:03:07.142516 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-28 03:03:07.142525 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-28 03:03:07.142535 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-28 03:03:07.142559 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-28 03:03:07.142569 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-28 03:03:07.142579 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-28 03:03:07.142588 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-28 03:03:07.142598 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-28 03:03:07.142608 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-28 03:03:07.142637 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-28 03:03:07.142647 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-28 03:03:07.142658 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-28 03:03:07.142675 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-28 03:03:07.142692 | orchestrator | changed: [testbed-node-3] => (item=/var/run/ceph) 2026-04-28 03:03:07.142710 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-28 03:03:07.142725 | orchestrator | changed: [testbed-node-5] => (item=/var/run/ceph) 2026-04-28 03:03:07.142741 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-28 03:03:07.142757 | orchestrator | changed: [testbed-node-4] => (item=/var/run/ceph) 2026-04-28 03:03:07.142775 | orchestrator | changed: [testbed-node-3] => (item=/var/log/ceph) 2026-04-28 03:03:07.142792 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-28 03:03:07.142808 | orchestrator | changed: [testbed-node-0] => (item=/var/run/ceph) 2026-04-28 03:03:07.142826 | orchestrator | changed: [testbed-node-5] => (item=/var/log/ceph) 2026-04-28 03:03:07.142837 | orchestrator | changed: [testbed-node-1] => (item=/var/run/ceph) 2026-04-28 03:03:07.142847 | orchestrator | changed: [testbed-node-4] => (item=/var/log/ceph) 2026-04-28 03:03:07.142856 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-28 03:03:07.142866 | orchestrator | changed: [testbed-node-0] => (item=/var/log/ceph) 2026-04-28 03:03:07.142876 | orchestrator | changed: [testbed-node-1] => (item=/var/log/ceph) 2026-04-28 03:03:07.142885 | orchestrator | changed: [testbed-node-2] => (item=/var/run/ceph) 2026-04-28 03:03:07.142895 | orchestrator | changed: [testbed-node-2] => (item=/var/log/ceph) 2026-04-28 03:03:07.142921 | orchestrator | 2026-04-28 03:03:07.142932 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-28 03:03:07.142952 | orchestrator | Tuesday 28 April 2026 03:03:01 +0000 (0:00:06.397) 0:02:46.681 ********* 2026-04-28 03:03:07.142963 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:07.142972 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:07.142982 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:07.142992 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:03:07.143004 | orchestrator | 2026-04-28 03:03:07.143035 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-28 03:03:07.143046 | orchestrator | Tuesday 28 April 2026 03:03:02 +0000 (0:00:01.180) 0:02:47.862 ********* 2026-04-28 03:03:07.143056 | orchestrator | changed: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-28 03:03:07.143076 | orchestrator | changed: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-28 03:03:07.143086 | orchestrator | changed: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-28 03:03:07.143096 | orchestrator | 2026-04-28 03:03:07.143106 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-28 03:03:07.143115 | orchestrator | Tuesday 28 April 2026 03:03:03 +0000 (0:00:00.761) 0:02:48.623 ********* 2026-04-28 03:03:07.143125 | orchestrator | changed: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-28 03:03:07.143135 | orchestrator | changed: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-28 03:03:07.143145 | orchestrator | changed: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-28 03:03:07.143154 | orchestrator | 2026-04-28 03:03:07.143164 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-28 03:03:07.143174 | orchestrator | Tuesday 28 April 2026 03:03:04 +0000 (0:00:01.669) 0:02:50.293 ********* 2026-04-28 03:03:07.143183 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:03:07.143193 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:03:07.143202 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:03:07.143212 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:07.143221 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:07.143231 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:07.143241 | orchestrator | 2026-04-28 03:03:07.143250 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-28 03:03:07.143260 | orchestrator | Tuesday 28 April 2026 03:03:05 +0000 (0:00:00.707) 0:02:51.000 ********* 2026-04-28 03:03:07.143269 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:03:07.143279 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:03:07.143288 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:03:07.143298 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:07.143307 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:07.143317 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:07.143326 | orchestrator | 2026-04-28 03:03:07.143344 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-28 03:03:07.143354 | orchestrator | Tuesday 28 April 2026 03:03:06 +0000 (0:00:00.938) 0:02:51.939 ********* 2026-04-28 03:03:07.143364 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:07.143374 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:07.143383 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:07.143393 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:07.143403 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:07.143412 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:07.143422 | orchestrator | 2026-04-28 03:03:07.143442 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-28 03:03:21.988987 | orchestrator | Tuesday 28 April 2026 03:03:07 +0000 (0:00:00.661) 0:02:52.600 ********* 2026-04-28 03:03:21.989224 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:21.989255 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:21.989273 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:21.989291 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:21.989303 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:21.989312 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:21.989322 | orchestrator | 2026-04-28 03:03:21.989333 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-28 03:03:21.989343 | orchestrator | Tuesday 28 April 2026 03:03:08 +0000 (0:00:00.970) 0:02:53.571 ********* 2026-04-28 03:03:21.989353 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:21.989392 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:21.989403 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:21.989412 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:21.989422 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:21.989434 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:21.989454 | orchestrator | 2026-04-28 03:03:21.989478 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-28 03:03:21.989495 | orchestrator | Tuesday 28 April 2026 03:03:08 +0000 (0:00:00.721) 0:02:54.293 ********* 2026-04-28 03:03:21.989511 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:21.989527 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:21.989544 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:21.989558 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:21.989572 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:21.989587 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:21.989602 | orchestrator | 2026-04-28 03:03:21.989619 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-28 03:03:21.989637 | orchestrator | Tuesday 28 April 2026 03:03:09 +0000 (0:00:00.946) 0:02:55.239 ********* 2026-04-28 03:03:21.989655 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:21.989670 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:21.989688 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:21.989706 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:21.989723 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:21.989740 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:21.989758 | orchestrator | 2026-04-28 03:03:21.989775 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-28 03:03:21.989792 | orchestrator | Tuesday 28 April 2026 03:03:10 +0000 (0:00:00.718) 0:02:55.958 ********* 2026-04-28 03:03:21.989808 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:21.989825 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:21.989841 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:21.989858 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:21.989874 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:21.989891 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:21.989907 | orchestrator | 2026-04-28 03:03:21.989957 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-28 03:03:21.989974 | orchestrator | Tuesday 28 April 2026 03:03:11 +0000 (0:00:00.913) 0:02:56.871 ********* 2026-04-28 03:03:21.989991 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:21.990116 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:21.990134 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:21.990145 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:03:21.990156 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:03:21.990166 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:03:21.990175 | orchestrator | 2026-04-28 03:03:21.990185 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-28 03:03:21.990195 | orchestrator | Tuesday 28 April 2026 03:03:14 +0000 (0:00:02.794) 0:02:59.666 ********* 2026-04-28 03:03:21.990205 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:03:21.990214 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:03:21.990224 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:03:21.990234 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:21.990243 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:21.990253 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:21.990262 | orchestrator | 2026-04-28 03:03:21.990272 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-28 03:03:21.990281 | orchestrator | Tuesday 28 April 2026 03:03:15 +0000 (0:00:01.062) 0:03:00.728 ********* 2026-04-28 03:03:21.990291 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:03:21.990300 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:03:21.990310 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:03:21.990335 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:21.990345 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:21.990354 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:21.990364 | orchestrator | 2026-04-28 03:03:21.990373 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-28 03:03:21.990383 | orchestrator | Tuesday 28 April 2026 03:03:15 +0000 (0:00:00.673) 0:03:01.402 ********* 2026-04-28 03:03:21.990393 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:21.990402 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:21.990411 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:21.990421 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:21.990430 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:21.990440 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:21.990449 | orchestrator | 2026-04-28 03:03:21.990459 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-28 03:03:21.990492 | orchestrator | Tuesday 28 April 2026 03:03:16 +0000 (0:00:00.966) 0:03:02.368 ********* 2026-04-28 03:03:21.990517 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-28 03:03:21.990535 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-28 03:03:21.990550 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-28 03:03:21.990567 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:21.990612 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:21.990630 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:21.990648 | orchestrator | 2026-04-28 03:03:21.990666 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-28 03:03:21.990683 | orchestrator | Tuesday 28 April 2026 03:03:17 +0000 (0:00:00.715) 0:03:03.084 ********* 2026-04-28 03:03:21.990699 | orchestrator | skipping: [testbed-node-3] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log'}])  2026-04-28 03:03:21.990712 | orchestrator | skipping: [testbed-node-3] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.13:8081'}])  2026-04-28 03:03:21.990724 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:21.990734 | orchestrator | skipping: [testbed-node-4] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log'}])  2026-04-28 03:03:21.990744 | orchestrator | skipping: [testbed-node-4] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.14:8081'}])  2026-04-28 03:03:21.990754 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:21.990763 | orchestrator | skipping: [testbed-node-5] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log'}])  2026-04-28 03:03:21.990774 | orchestrator | skipping: [testbed-node-5] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.15:8081'}])  2026-04-28 03:03:21.990795 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:21.990805 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:21.990814 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:21.990824 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:21.990833 | orchestrator | 2026-04-28 03:03:21.990843 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-28 03:03:21.990853 | orchestrator | Tuesday 28 April 2026 03:03:18 +0000 (0:00:00.998) 0:03:04.083 ********* 2026-04-28 03:03:21.990862 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:21.990872 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:21.990881 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:21.990891 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:21.990900 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:21.990910 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:21.990919 | orchestrator | 2026-04-28 03:03:21.990929 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-28 03:03:21.990938 | orchestrator | Tuesday 28 April 2026 03:03:19 +0000 (0:00:00.702) 0:03:04.785 ********* 2026-04-28 03:03:21.990948 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:21.990957 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:21.990966 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:21.990976 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:21.990985 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:21.990995 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:21.991004 | orchestrator | 2026-04-28 03:03:21.991043 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 03:03:21.991053 | orchestrator | Tuesday 28 April 2026 03:03:20 +0000 (0:00:00.929) 0:03:05.715 ********* 2026-04-28 03:03:21.991063 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:21.991073 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:21.991082 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:21.991091 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:21.991101 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:21.991110 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:21.991120 | orchestrator | 2026-04-28 03:03:21.991136 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 03:03:21.991146 | orchestrator | Tuesday 28 April 2026 03:03:20 +0000 (0:00:00.703) 0:03:06.419 ********* 2026-04-28 03:03:21.991156 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:21.991165 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:21.991175 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:21.991184 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:21.991194 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:21.991203 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:21.991213 | orchestrator | 2026-04-28 03:03:21.991222 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 03:03:21.991240 | orchestrator | Tuesday 28 April 2026 03:03:21 +0000 (0:00:01.014) 0:03:07.434 ********* 2026-04-28 03:03:41.550237 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:41.550351 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:41.550367 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:41.550377 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:41.550387 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:41.550398 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:41.550409 | orchestrator | 2026-04-28 03:03:41.550420 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 03:03:41.550432 | orchestrator | Tuesday 28 April 2026 03:03:22 +0000 (0:00:00.718) 0:03:08.153 ********* 2026-04-28 03:03:41.550442 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:03:41.550453 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:03:41.550487 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:41.550495 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:03:41.550501 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:41.550507 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:41.550514 | orchestrator | 2026-04-28 03:03:41.550520 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 03:03:41.550526 | orchestrator | Tuesday 28 April 2026 03:03:23 +0000 (0:00:01.003) 0:03:09.156 ********* 2026-04-28 03:03:41.550533 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 03:03:41.550539 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 03:03:41.550545 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 03:03:41.550551 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:41.550557 | orchestrator | 2026-04-28 03:03:41.550565 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 03:03:41.550571 | orchestrator | Tuesday 28 April 2026 03:03:24 +0000 (0:00:00.451) 0:03:09.607 ********* 2026-04-28 03:03:41.550577 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 03:03:41.550583 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 03:03:41.550589 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 03:03:41.550595 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:41.550601 | orchestrator | 2026-04-28 03:03:41.550607 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 03:03:41.550614 | orchestrator | Tuesday 28 April 2026 03:03:24 +0000 (0:00:00.451) 0:03:10.059 ********* 2026-04-28 03:03:41.550620 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 03:03:41.550626 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 03:03:41.550632 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 03:03:41.550638 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:41.550644 | orchestrator | 2026-04-28 03:03:41.550650 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 03:03:41.550656 | orchestrator | Tuesday 28 April 2026 03:03:25 +0000 (0:00:00.493) 0:03:10.552 ********* 2026-04-28 03:03:41.550662 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:03:41.550669 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:03:41.550675 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:03:41.550681 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:41.550687 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:41.550693 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:41.550699 | orchestrator | 2026-04-28 03:03:41.550705 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 03:03:41.550711 | orchestrator | Tuesday 28 April 2026 03:03:26 +0000 (0:00:00.919) 0:03:11.472 ********* 2026-04-28 03:03:41.550717 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-28 03:03:41.550724 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-28 03:03:41.550730 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-28 03:03:41.550736 | orchestrator | skipping: [testbed-node-0] => (item=0)  2026-04-28 03:03:41.550742 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:41.550748 | orchestrator | skipping: [testbed-node-1] => (item=0)  2026-04-28 03:03:41.550754 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:41.550760 | orchestrator | skipping: [testbed-node-2] => (item=0)  2026-04-28 03:03:41.550766 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:41.550772 | orchestrator | 2026-04-28 03:03:41.550778 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-28 03:03:41.550784 | orchestrator | Tuesday 28 April 2026 03:03:27 +0000 (0:00:01.890) 0:03:13.362 ********* 2026-04-28 03:03:41.550790 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:03:41.550796 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:03:41.550802 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:03:41.550809 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:03:41.550820 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:03:41.550826 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:03:41.550832 | orchestrator | 2026-04-28 03:03:41.550838 | orchestrator | RUNNING HANDLER [ceph-handler : Make tempdir for scripts] ********************** 2026-04-28 03:03:41.550844 | orchestrator | Tuesday 28 April 2026 03:03:30 +0000 (0:00:02.566) 0:03:15.929 ********* 2026-04-28 03:03:41.550850 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:03:41.550856 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:03:41.550862 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:03:41.550868 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:03:41.550874 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:03:41.550880 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:03:41.550887 | orchestrator | 2026-04-28 03:03:41.550893 | orchestrator | RUNNING HANDLER [ceph-handler : Mons handler] ********************************** 2026-04-28 03:03:41.550913 | orchestrator | Tuesday 28 April 2026 03:03:31 +0000 (0:00:01.423) 0:03:17.352 ********* 2026-04-28 03:03:41.550919 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:41.550925 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:41.550931 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:41.550938 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_mons.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:03:41.550944 | orchestrator | 2026-04-28 03:03:41.550950 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mon_handler_called before restart] ******** 2026-04-28 03:03:41.550956 | orchestrator | Tuesday 28 April 2026 03:03:33 +0000 (0:00:01.229) 0:03:18.581 ********* 2026-04-28 03:03:41.550963 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:03:41.550984 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:03:41.550991 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:03:41.550997 | orchestrator | 2026-04-28 03:03:41.551045 | orchestrator | RUNNING HANDLER [ceph-handler : Copy mon restart script] *********************** 2026-04-28 03:03:41.551051 | orchestrator | Tuesday 28 April 2026 03:03:33 +0000 (0:00:00.378) 0:03:18.960 ********* 2026-04-28 03:03:41.551058 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:03:41.551064 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:03:41.551070 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:03:41.551076 | orchestrator | 2026-04-28 03:03:41.551082 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph mon daemon(s)] ******************** 2026-04-28 03:03:41.551089 | orchestrator | Tuesday 28 April 2026 03:03:34 +0000 (0:00:01.323) 0:03:20.283 ********* 2026-04-28 03:03:41.551095 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-28 03:03:41.551101 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-28 03:03:41.551107 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-28 03:03:41.551113 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:41.551119 | orchestrator | 2026-04-28 03:03:41.551125 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mon_handler_called after restart] ********* 2026-04-28 03:03:41.551131 | orchestrator | Tuesday 28 April 2026 03:03:35 +0000 (0:00:00.967) 0:03:21.251 ********* 2026-04-28 03:03:41.551137 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:03:41.551144 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:03:41.551150 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:03:41.551156 | orchestrator | 2026-04-28 03:03:41.551162 | orchestrator | RUNNING HANDLER [ceph-handler : Osds handler] ********************************** 2026-04-28 03:03:41.551168 | orchestrator | Tuesday 28 April 2026 03:03:36 +0000 (0:00:00.400) 0:03:21.652 ********* 2026-04-28 03:03:41.551175 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:03:41.551181 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:03:41.551187 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:03:41.551193 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_osds.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:03:41.551199 | orchestrator | 2026-04-28 03:03:41.551205 | orchestrator | RUNNING HANDLER [ceph-handler : Set_fact trigger_restart] ********************** 2026-04-28 03:03:41.551212 | orchestrator | Tuesday 28 April 2026 03:03:37 +0000 (0:00:01.229) 0:03:22.882 ********* 2026-04-28 03:03:41.551224 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 03:03:41.551231 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 03:03:41.551237 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 03:03:41.551243 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:41.551249 | orchestrator | 2026-04-28 03:03:41.551255 | orchestrator | RUNNING HANDLER [ceph-handler : Set _osd_handler_called before restart] ******** 2026-04-28 03:03:41.551261 | orchestrator | Tuesday 28 April 2026 03:03:37 +0000 (0:00:00.420) 0:03:23.302 ********* 2026-04-28 03:03:41.551267 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:41.551273 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:41.551280 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:41.551286 | orchestrator | 2026-04-28 03:03:41.551292 | orchestrator | RUNNING HANDLER [ceph-handler : Unset noup flag] ******************************* 2026-04-28 03:03:41.551298 | orchestrator | Tuesday 28 April 2026 03:03:38 +0000 (0:00:00.597) 0:03:23.900 ********* 2026-04-28 03:03:41.551304 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:41.551310 | orchestrator | 2026-04-28 03:03:41.551316 | orchestrator | RUNNING HANDLER [ceph-handler : Copy osd restart script] *********************** 2026-04-28 03:03:41.551323 | orchestrator | Tuesday 28 April 2026 03:03:38 +0000 (0:00:00.270) 0:03:24.171 ********* 2026-04-28 03:03:41.551329 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:41.551335 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:03:41.551341 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:03:41.551347 | orchestrator | 2026-04-28 03:03:41.551353 | orchestrator | RUNNING HANDLER [ceph-handler : Get pool list] ********************************* 2026-04-28 03:03:41.551359 | orchestrator | Tuesday 28 April 2026 03:03:39 +0000 (0:00:00.377) 0:03:24.548 ********* 2026-04-28 03:03:41.551366 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:41.551372 | orchestrator | 2026-04-28 03:03:41.551378 | orchestrator | RUNNING HANDLER [ceph-handler : Get balancer module status] ******************** 2026-04-28 03:03:41.551384 | orchestrator | Tuesday 28 April 2026 03:03:39 +0000 (0:00:00.260) 0:03:24.809 ********* 2026-04-28 03:03:41.551390 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:41.551396 | orchestrator | 2026-04-28 03:03:41.551403 | orchestrator | RUNNING HANDLER [ceph-handler : Set_fact pools_pgautoscaler_mode] ************** 2026-04-28 03:03:41.551409 | orchestrator | Tuesday 28 April 2026 03:03:39 +0000 (0:00:00.298) 0:03:25.108 ********* 2026-04-28 03:03:41.551415 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:41.551421 | orchestrator | 2026-04-28 03:03:41.551427 | orchestrator | RUNNING HANDLER [ceph-handler : Disable balancer] ****************************** 2026-04-28 03:03:41.551433 | orchestrator | Tuesday 28 April 2026 03:03:39 +0000 (0:00:00.131) 0:03:25.239 ********* 2026-04-28 03:03:41.551440 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:41.551446 | orchestrator | 2026-04-28 03:03:41.551452 | orchestrator | RUNNING HANDLER [ceph-handler : Disable pg autoscale on pools] ***************** 2026-04-28 03:03:41.551458 | orchestrator | Tuesday 28 April 2026 03:03:40 +0000 (0:00:00.276) 0:03:25.516 ********* 2026-04-28 03:03:41.551464 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:41.551471 | orchestrator | 2026-04-28 03:03:41.551481 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph osds daemon(s)] ******************* 2026-04-28 03:03:41.551488 | orchestrator | Tuesday 28 April 2026 03:03:40 +0000 (0:00:00.283) 0:03:25.799 ********* 2026-04-28 03:03:41.551494 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 03:03:41.551500 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 03:03:41.551507 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 03:03:41.551513 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:03:41.551519 | orchestrator | 2026-04-28 03:03:41.551525 | orchestrator | RUNNING HANDLER [ceph-handler : Set _osd_handler_called after restart] ********* 2026-04-28 03:03:41.551531 | orchestrator | Tuesday 28 April 2026 03:03:41 +0000 (0:00:00.715) 0:03:26.515 ********* 2026-04-28 03:03:41.551547 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:04:01.460723 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:04:01.460850 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:04:01.460872 | orchestrator | 2026-04-28 03:04:01.460891 | orchestrator | RUNNING HANDLER [ceph-handler : Re-enable pg autoscale on pools] *************** 2026-04-28 03:04:01.460909 | orchestrator | Tuesday 28 April 2026 03:03:41 +0000 (0:00:00.632) 0:03:27.147 ********* 2026-04-28 03:04:01.460926 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:04:01.460942 | orchestrator | 2026-04-28 03:04:01.460958 | orchestrator | RUNNING HANDLER [ceph-handler : Re-enable balancer] **************************** 2026-04-28 03:04:01.460974 | orchestrator | Tuesday 28 April 2026 03:03:41 +0000 (0:00:00.245) 0:03:27.393 ********* 2026-04-28 03:04:01.461035 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:04:01.461054 | orchestrator | 2026-04-28 03:04:01.461071 | orchestrator | RUNNING HANDLER [ceph-handler : Mdss handler] ********************************** 2026-04-28 03:04:01.461087 | orchestrator | Tuesday 28 April 2026 03:03:42 +0000 (0:00:00.256) 0:03:27.649 ********* 2026-04-28 03:04:01.461104 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:04:01.461119 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:04:01.461135 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:04:01.461153 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_mdss.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:04:01.461169 | orchestrator | 2026-04-28 03:04:01.461185 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mds_handler_called before restart] ******** 2026-04-28 03:04:01.461202 | orchestrator | Tuesday 28 April 2026 03:03:43 +0000 (0:00:01.188) 0:03:28.838 ********* 2026-04-28 03:04:01.461219 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:04:01.461239 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:04:01.461259 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:04:01.461277 | orchestrator | 2026-04-28 03:04:01.461295 | orchestrator | RUNNING HANDLER [ceph-handler : Copy mds restart script] *********************** 2026-04-28 03:04:01.461335 | orchestrator | Tuesday 28 April 2026 03:03:43 +0000 (0:00:00.360) 0:03:29.198 ********* 2026-04-28 03:04:01.461351 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:04:01.461367 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:04:01.461383 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:04:01.461399 | orchestrator | 2026-04-28 03:04:01.461415 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph mds daemon(s)] ******************** 2026-04-28 03:04:01.461432 | orchestrator | Tuesday 28 April 2026 03:03:44 +0000 (0:00:01.253) 0:03:30.451 ********* 2026-04-28 03:04:01.461448 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 03:04:01.461465 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 03:04:01.461480 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 03:04:01.461496 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:04:01.461511 | orchestrator | 2026-04-28 03:04:01.461529 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mds_handler_called after restart] ********* 2026-04-28 03:04:01.461546 | orchestrator | Tuesday 28 April 2026 03:03:45 +0000 (0:00:00.932) 0:03:31.383 ********* 2026-04-28 03:04:01.461562 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:04:01.461577 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:04:01.461593 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:04:01.461609 | orchestrator | 2026-04-28 03:04:01.461625 | orchestrator | RUNNING HANDLER [ceph-handler : Rgws handler] ********************************** 2026-04-28 03:04:01.461640 | orchestrator | Tuesday 28 April 2026 03:03:46 +0000 (0:00:00.382) 0:03:31.766 ********* 2026-04-28 03:04:01.461655 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:04:01.461671 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:04:01.461688 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:04:01.461703 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_rgws.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:04:01.461720 | orchestrator | 2026-04-28 03:04:01.461736 | orchestrator | RUNNING HANDLER [ceph-handler : Set _rgw_handler_called before restart] ******** 2026-04-28 03:04:01.461791 | orchestrator | Tuesday 28 April 2026 03:03:47 +0000 (0:00:01.354) 0:03:33.120 ********* 2026-04-28 03:04:01.461808 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:04:01.461824 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:04:01.461840 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:04:01.461857 | orchestrator | 2026-04-28 03:04:01.461875 | orchestrator | RUNNING HANDLER [ceph-handler : Copy rgw restart script] *********************** 2026-04-28 03:04:01.461893 | orchestrator | Tuesday 28 April 2026 03:03:48 +0000 (0:00:00.601) 0:03:33.722 ********* 2026-04-28 03:04:01.461910 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:04:01.461927 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:04:01.461944 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:04:01.461960 | orchestrator | 2026-04-28 03:04:01.461978 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph rgw daemon(s)] ******************** 2026-04-28 03:04:01.462147 | orchestrator | Tuesday 28 April 2026 03:03:49 +0000 (0:00:01.330) 0:03:35.052 ********* 2026-04-28 03:04:01.462173 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 03:04:01.462193 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 03:04:01.462210 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 03:04:01.462228 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:04:01.462242 | orchestrator | 2026-04-28 03:04:01.462255 | orchestrator | RUNNING HANDLER [ceph-handler : Set _rgw_handler_called after restart] ********* 2026-04-28 03:04:01.462269 | orchestrator | Tuesday 28 April 2026 03:03:50 +0000 (0:00:00.778) 0:03:35.831 ********* 2026-04-28 03:04:01.462302 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:04:01.462316 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:04:01.462330 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:04:01.462343 | orchestrator | 2026-04-28 03:04:01.462357 | orchestrator | RUNNING HANDLER [ceph-handler : Rbdmirrors handler] **************************** 2026-04-28 03:04:01.462371 | orchestrator | Tuesday 28 April 2026 03:03:50 +0000 (0:00:00.429) 0:03:36.260 ********* 2026-04-28 03:04:01.462385 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:04:01.462398 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:04:01.462412 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:04:01.462426 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:04:01.462441 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:04:01.462454 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:04:01.462469 | orchestrator | 2026-04-28 03:04:01.462509 | orchestrator | RUNNING HANDLER [ceph-handler : Mgrs handler] ********************************** 2026-04-28 03:04:01.462525 | orchestrator | Tuesday 28 April 2026 03:03:51 +0000 (0:00:00.923) 0:03:37.184 ********* 2026-04-28 03:04:01.462540 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:04:01.462554 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:04:01.462567 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:04:01.462581 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_mgrs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:04:01.462596 | orchestrator | 2026-04-28 03:04:01.462610 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mgr_handler_called before restart] ******** 2026-04-28 03:04:01.462623 | orchestrator | Tuesday 28 April 2026 03:03:52 +0000 (0:00:00.945) 0:03:38.130 ********* 2026-04-28 03:04:01.462636 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:04:01.462649 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:04:01.462662 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:04:01.462674 | orchestrator | 2026-04-28 03:04:01.462686 | orchestrator | RUNNING HANDLER [ceph-handler : Copy mgr restart script] *********************** 2026-04-28 03:04:01.462700 | orchestrator | Tuesday 28 April 2026 03:03:53 +0000 (0:00:00.641) 0:03:38.771 ********* 2026-04-28 03:04:01.462713 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:04:01.462747 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:04:01.462759 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:04:01.462771 | orchestrator | 2026-04-28 03:04:01.462782 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph mgr daemon(s)] ******************** 2026-04-28 03:04:01.462794 | orchestrator | Tuesday 28 April 2026 03:03:54 +0000 (0:00:01.273) 0:03:40.045 ********* 2026-04-28 03:04:01.462822 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-28 03:04:01.462835 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-28 03:04:01.462848 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-28 03:04:01.462860 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:04:01.462873 | orchestrator | 2026-04-28 03:04:01.462886 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mgr_handler_called after restart] ********* 2026-04-28 03:04:01.462899 | orchestrator | Tuesday 28 April 2026 03:03:55 +0000 (0:00:00.722) 0:03:40.768 ********* 2026-04-28 03:04:01.462912 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:04:01.462924 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:04:01.462936 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:04:01.462948 | orchestrator | 2026-04-28 03:04:01.462961 | orchestrator | PLAY [Apply role ceph-mon] ***************************************************** 2026-04-28 03:04:01.462973 | orchestrator | 2026-04-28 03:04:01.463020 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 03:04:01.463037 | orchestrator | Tuesday 28 April 2026 03:03:56 +0000 (0:00:00.952) 0:03:41.720 ********* 2026-04-28 03:04:01.463051 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:04:01.463065 | orchestrator | 2026-04-28 03:04:01.463078 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 03:04:01.463091 | orchestrator | Tuesday 28 April 2026 03:03:56 +0000 (0:00:00.610) 0:03:42.331 ********* 2026-04-28 03:04:01.463103 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:04:01.463116 | orchestrator | 2026-04-28 03:04:01.463129 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 03:04:01.463143 | orchestrator | Tuesday 28 April 2026 03:03:57 +0000 (0:00:00.860) 0:03:43.191 ********* 2026-04-28 03:04:01.463157 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:04:01.463170 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:04:01.463183 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:04:01.463197 | orchestrator | 2026-04-28 03:04:01.463210 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 03:04:01.463224 | orchestrator | Tuesday 28 April 2026 03:03:58 +0000 (0:00:00.801) 0:03:43.993 ********* 2026-04-28 03:04:01.463238 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:04:01.463252 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:04:01.463266 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:04:01.463279 | orchestrator | 2026-04-28 03:04:01.463292 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 03:04:01.463306 | orchestrator | Tuesday 28 April 2026 03:03:58 +0000 (0:00:00.374) 0:03:44.367 ********* 2026-04-28 03:04:01.463320 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:04:01.463335 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:04:01.463349 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:04:01.463362 | orchestrator | 2026-04-28 03:04:01.463376 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 03:04:01.463388 | orchestrator | Tuesday 28 April 2026 03:03:59 +0000 (0:00:00.345) 0:03:44.713 ********* 2026-04-28 03:04:01.463401 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:04:01.463415 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:04:01.463429 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:04:01.463442 | orchestrator | 2026-04-28 03:04:01.463457 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 03:04:01.463470 | orchestrator | Tuesday 28 April 2026 03:03:59 +0000 (0:00:00.644) 0:03:45.358 ********* 2026-04-28 03:04:01.463484 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:04:01.463497 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:04:01.463510 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:04:01.463524 | orchestrator | 2026-04-28 03:04:01.463551 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 03:04:01.463578 | orchestrator | Tuesday 28 April 2026 03:04:00 +0000 (0:00:00.834) 0:03:46.192 ********* 2026-04-28 03:04:01.463590 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:04:01.463602 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:04:01.463615 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:04:01.463627 | orchestrator | 2026-04-28 03:04:01.463640 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 03:04:01.463652 | orchestrator | Tuesday 28 April 2026 03:04:01 +0000 (0:00:00.367) 0:03:46.560 ********* 2026-04-28 03:04:01.463664 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:04:01.463675 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:04:01.463708 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:04:25.703277 | orchestrator | 2026-04-28 03:04:25.703390 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 03:04:25.703414 | orchestrator | Tuesday 28 April 2026 03:04:01 +0000 (0:00:00.355) 0:03:46.915 ********* 2026-04-28 03:04:25.703431 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:04:25.703449 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:04:25.703468 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:04:25.703486 | orchestrator | 2026-04-28 03:04:25.703504 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 03:04:25.703521 | orchestrator | Tuesday 28 April 2026 03:04:02 +0000 (0:00:01.402) 0:03:48.318 ********* 2026-04-28 03:04:25.703539 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:04:25.703555 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:04:25.703571 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:04:25.703581 | orchestrator | 2026-04-28 03:04:25.703591 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 03:04:25.703601 | orchestrator | Tuesday 28 April 2026 03:04:03 +0000 (0:00:00.800) 0:03:49.118 ********* 2026-04-28 03:04:25.703611 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:04:25.703622 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:04:25.703632 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:04:25.703641 | orchestrator | 2026-04-28 03:04:25.703651 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 03:04:25.703661 | orchestrator | Tuesday 28 April 2026 03:04:04 +0000 (0:00:00.361) 0:03:49.480 ********* 2026-04-28 03:04:25.703671 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:04:25.703680 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:04:25.703690 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:04:25.703700 | orchestrator | 2026-04-28 03:04:25.703711 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 03:04:25.703721 | orchestrator | Tuesday 28 April 2026 03:04:04 +0000 (0:00:00.366) 0:03:49.846 ********* 2026-04-28 03:04:25.703731 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:04:25.703740 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:04:25.703750 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:04:25.703759 | orchestrator | 2026-04-28 03:04:25.703769 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 03:04:25.703779 | orchestrator | Tuesday 28 April 2026 03:04:05 +0000 (0:00:00.656) 0:03:50.503 ********* 2026-04-28 03:04:25.703789 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:04:25.703799 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:04:25.703809 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:04:25.703820 | orchestrator | 2026-04-28 03:04:25.703832 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 03:04:25.703843 | orchestrator | Tuesday 28 April 2026 03:04:05 +0000 (0:00:00.374) 0:03:50.878 ********* 2026-04-28 03:04:25.703855 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:04:25.703866 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:04:25.703877 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:04:25.703888 | orchestrator | 2026-04-28 03:04:25.703900 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 03:04:25.703911 | orchestrator | Tuesday 28 April 2026 03:04:05 +0000 (0:00:00.368) 0:03:51.246 ********* 2026-04-28 03:04:25.703949 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:04:25.703961 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:04:25.703972 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:04:25.704010 | orchestrator | 2026-04-28 03:04:25.704023 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 03:04:25.704035 | orchestrator | Tuesday 28 April 2026 03:04:06 +0000 (0:00:00.385) 0:03:51.632 ********* 2026-04-28 03:04:25.704046 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:04:25.704058 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:04:25.704069 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:04:25.704080 | orchestrator | 2026-04-28 03:04:25.704091 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 03:04:25.704102 | orchestrator | Tuesday 28 April 2026 03:04:06 +0000 (0:00:00.632) 0:03:52.264 ********* 2026-04-28 03:04:25.704113 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:04:25.704124 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:04:25.704135 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:04:25.704146 | orchestrator | 2026-04-28 03:04:25.704158 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 03:04:25.704170 | orchestrator | Tuesday 28 April 2026 03:04:07 +0000 (0:00:00.364) 0:03:52.629 ********* 2026-04-28 03:04:25.704179 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:04:25.704189 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:04:25.704198 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:04:25.704208 | orchestrator | 2026-04-28 03:04:25.704217 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 03:04:25.704227 | orchestrator | Tuesday 28 April 2026 03:04:07 +0000 (0:00:00.391) 0:03:53.020 ********* 2026-04-28 03:04:25.704237 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:04:25.704246 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:04:25.704255 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:04:25.704265 | orchestrator | 2026-04-28 03:04:25.704275 | orchestrator | TASK [ceph-mon : Set_fact container_exec_cmd] ********************************** 2026-04-28 03:04:25.704284 | orchestrator | Tuesday 28 April 2026 03:04:08 +0000 (0:00:00.887) 0:03:53.907 ********* 2026-04-28 03:04:25.704294 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:04:25.704304 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:04:25.704313 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:04:25.704323 | orchestrator | 2026-04-28 03:04:25.704333 | orchestrator | TASK [ceph-mon : Include deploy_monitors.yml] ********************************** 2026-04-28 03:04:25.704356 | orchestrator | Tuesday 28 April 2026 03:04:08 +0000 (0:00:00.410) 0:03:54.317 ********* 2026-04-28 03:04:25.704367 | orchestrator | included: /ansible/roles/ceph-mon/tasks/deploy_monitors.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:04:25.704382 | orchestrator | 2026-04-28 03:04:25.704398 | orchestrator | TASK [ceph-mon : Check if monitor initial keyring already exists] ************** 2026-04-28 03:04:25.704426 | orchestrator | Tuesday 28 April 2026 03:04:09 +0000 (0:00:00.648) 0:03:54.966 ********* 2026-04-28 03:04:25.704442 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:04:25.704458 | orchestrator | 2026-04-28 03:04:25.704475 | orchestrator | TASK [ceph-mon : Generate monitor initial keyring] ***************************** 2026-04-28 03:04:25.704517 | orchestrator | Tuesday 28 April 2026 03:04:09 +0000 (0:00:00.440) 0:03:55.406 ********* 2026-04-28 03:04:25.704534 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-28 03:04:25.704544 | orchestrator | 2026-04-28 03:04:25.704554 | orchestrator | TASK [ceph-mon : Set_fact _initial_mon_key_success] **************************** 2026-04-28 03:04:25.704563 | orchestrator | Tuesday 28 April 2026 03:04:11 +0000 (0:00:01.094) 0:03:56.501 ********* 2026-04-28 03:04:25.704573 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:04:25.704582 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:04:25.704592 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:04:25.704601 | orchestrator | 2026-04-28 03:04:25.704611 | orchestrator | TASK [ceph-mon : Get initial keyring when it already exists] ******************* 2026-04-28 03:04:25.704620 | orchestrator | Tuesday 28 April 2026 03:04:11 +0000 (0:00:00.425) 0:03:56.927 ********* 2026-04-28 03:04:25.704642 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:04:25.704652 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:04:25.704661 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:04:25.704671 | orchestrator | 2026-04-28 03:04:25.704680 | orchestrator | TASK [ceph-mon : Create monitor initial keyring] ******************************* 2026-04-28 03:04:25.704690 | orchestrator | Tuesday 28 April 2026 03:04:11 +0000 (0:00:00.411) 0:03:57.338 ********* 2026-04-28 03:04:25.704700 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:04:25.704709 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:04:25.704719 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:04:25.704728 | orchestrator | 2026-04-28 03:04:25.704738 | orchestrator | TASK [ceph-mon : Copy the initial key in /etc/ceph (for containers)] *********** 2026-04-28 03:04:25.704748 | orchestrator | Tuesday 28 April 2026 03:04:13 +0000 (0:00:01.313) 0:03:58.652 ********* 2026-04-28 03:04:25.704757 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:04:25.704767 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:04:25.704776 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:04:25.704786 | orchestrator | 2026-04-28 03:04:25.704795 | orchestrator | TASK [ceph-mon : Create monitor directory] ************************************* 2026-04-28 03:04:25.704805 | orchestrator | Tuesday 28 April 2026 03:04:14 +0000 (0:00:01.159) 0:03:59.811 ********* 2026-04-28 03:04:25.704815 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:04:25.704824 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:04:25.704834 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:04:25.704843 | orchestrator | 2026-04-28 03:04:25.704853 | orchestrator | TASK [ceph-mon : Recursively fix ownership of monitor directory] *************** 2026-04-28 03:04:25.704863 | orchestrator | Tuesday 28 April 2026 03:04:15 +0000 (0:00:00.748) 0:04:00.559 ********* 2026-04-28 03:04:25.704873 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:04:25.704882 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:04:25.704891 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:04:25.704901 | orchestrator | 2026-04-28 03:04:25.704910 | orchestrator | TASK [ceph-mon : Create admin keyring] ***************************************** 2026-04-28 03:04:25.704920 | orchestrator | Tuesday 28 April 2026 03:04:15 +0000 (0:00:00.773) 0:04:01.333 ********* 2026-04-28 03:04:25.704929 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:04:25.704939 | orchestrator | 2026-04-28 03:04:25.704948 | orchestrator | TASK [ceph-mon : Slurp admin keyring] ****************************************** 2026-04-28 03:04:25.704958 | orchestrator | Tuesday 28 April 2026 03:04:17 +0000 (0:00:01.259) 0:04:02.593 ********* 2026-04-28 03:04:25.704967 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:04:25.704977 | orchestrator | 2026-04-28 03:04:25.705078 | orchestrator | TASK [ceph-mon : Copy admin keyring over to mons] ****************************** 2026-04-28 03:04:25.705097 | orchestrator | Tuesday 28 April 2026 03:04:17 +0000 (0:00:00.710) 0:04:03.303 ********* 2026-04-28 03:04:25.705113 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-28 03:04:25.705130 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:04:25.705145 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:04:25.705160 | orchestrator | changed: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-28 03:04:25.705176 | orchestrator | ok: [testbed-node-1] => (item=None) 2026-04-28 03:04:25.705193 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-28 03:04:25.705209 | orchestrator | changed: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-28 03:04:25.705227 | orchestrator | changed: [testbed-node-0 -> {{ item }}] 2026-04-28 03:04:25.705243 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-28 03:04:25.705259 | orchestrator | ok: [testbed-node-1 -> {{ item }}] 2026-04-28 03:04:25.705269 | orchestrator | ok: [testbed-node-2] => (item=None) 2026-04-28 03:04:25.705279 | orchestrator | ok: [testbed-node-2 -> {{ item }}] 2026-04-28 03:04:25.705289 | orchestrator | 2026-04-28 03:04:25.705308 | orchestrator | TASK [ceph-mon : Import admin keyring into mon keyring] ************************ 2026-04-28 03:04:25.705318 | orchestrator | Tuesday 28 April 2026 03:04:21 +0000 (0:00:03.696) 0:04:06.999 ********* 2026-04-28 03:04:25.705327 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:04:25.705337 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:04:25.705347 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:04:25.705356 | orchestrator | 2026-04-28 03:04:25.705368 | orchestrator | TASK [ceph-mon : Set_fact ceph-mon container command] ************************** 2026-04-28 03:04:25.705384 | orchestrator | Tuesday 28 April 2026 03:04:22 +0000 (0:00:01.293) 0:04:08.293 ********* 2026-04-28 03:04:25.705400 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:04:25.705416 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:04:25.705432 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:04:25.705448 | orchestrator | 2026-04-28 03:04:25.705475 | orchestrator | TASK [ceph-mon : Set_fact monmaptool container command] ************************ 2026-04-28 03:04:25.705493 | orchestrator | Tuesday 28 April 2026 03:04:23 +0000 (0:00:00.419) 0:04:08.712 ********* 2026-04-28 03:04:25.705508 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:04:25.705525 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:04:25.705536 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:04:25.705545 | orchestrator | 2026-04-28 03:04:25.705555 | orchestrator | TASK [ceph-mon : Generate initial monmap] ************************************** 2026-04-28 03:04:25.705564 | orchestrator | Tuesday 28 April 2026 03:04:23 +0000 (0:00:00.394) 0:04:09.106 ********* 2026-04-28 03:04:25.705574 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:04:25.705583 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:04:25.705593 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:04:25.705602 | orchestrator | 2026-04-28 03:04:25.705622 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs with keyring] ******************************* 2026-04-28 03:05:30.811736 | orchestrator | Tuesday 28 April 2026 03:04:25 +0000 (0:00:02.038) 0:04:11.145 ********* 2026-04-28 03:05:30.811811 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:05:30.811818 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:05:30.811823 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:05:30.811827 | orchestrator | 2026-04-28 03:05:30.811832 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs without keyring] **************************** 2026-04-28 03:05:30.811836 | orchestrator | Tuesday 28 April 2026 03:04:27 +0000 (0:00:01.554) 0:04:12.700 ********* 2026-04-28 03:05:30.811841 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:05:30.811845 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:05:30.811849 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:05:30.811852 | orchestrator | 2026-04-28 03:05:30.811857 | orchestrator | TASK [ceph-mon : Include start_monitor.yml] ************************************ 2026-04-28 03:05:30.811861 | orchestrator | Tuesday 28 April 2026 03:04:27 +0000 (0:00:00.338) 0:04:13.038 ********* 2026-04-28 03:05:30.811865 | orchestrator | included: /ansible/roles/ceph-mon/tasks/start_monitor.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:05:30.811869 | orchestrator | 2026-04-28 03:05:30.811873 | orchestrator | TASK [ceph-mon : Ensure systemd service override directory exists] ************* 2026-04-28 03:05:30.811877 | orchestrator | Tuesday 28 April 2026 03:04:28 +0000 (0:00:00.845) 0:04:13.884 ********* 2026-04-28 03:05:30.811881 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:05:30.811885 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:05:30.811889 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:05:30.811893 | orchestrator | 2026-04-28 03:05:30.811897 | orchestrator | TASK [ceph-mon : Add ceph-mon systemd service overrides] *********************** 2026-04-28 03:05:30.811901 | orchestrator | Tuesday 28 April 2026 03:04:28 +0000 (0:00:00.349) 0:04:14.233 ********* 2026-04-28 03:05:30.811904 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:05:30.811908 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:05:30.811912 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:05:30.811916 | orchestrator | 2026-04-28 03:05:30.811919 | orchestrator | TASK [ceph-mon : Include_tasks systemd.yml] ************************************ 2026-04-28 03:05:30.811923 | orchestrator | Tuesday 28 April 2026 03:04:29 +0000 (0:00:00.345) 0:04:14.579 ********* 2026-04-28 03:05:30.811946 | orchestrator | included: /ansible/roles/ceph-mon/tasks/systemd.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:05:30.811951 | orchestrator | 2026-04-28 03:05:30.811955 | orchestrator | TASK [ceph-mon : Generate systemd unit file for mon container] ***************** 2026-04-28 03:05:30.812010 | orchestrator | Tuesday 28 April 2026 03:04:29 +0000 (0:00:00.879) 0:04:15.458 ********* 2026-04-28 03:05:30.812014 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:05:30.812018 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:05:30.812022 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:05:30.812025 | orchestrator | 2026-04-28 03:05:30.812029 | orchestrator | TASK [ceph-mon : Generate systemd ceph-mon target file] ************************ 2026-04-28 03:05:30.812033 | orchestrator | Tuesday 28 April 2026 03:04:31 +0000 (0:00:01.567) 0:04:17.025 ********* 2026-04-28 03:05:30.812037 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:05:30.812040 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:05:30.812044 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:05:30.812048 | orchestrator | 2026-04-28 03:05:30.812052 | orchestrator | TASK [ceph-mon : Enable ceph-mon.target] *************************************** 2026-04-28 03:05:30.812055 | orchestrator | Tuesday 28 April 2026 03:04:32 +0000 (0:00:01.205) 0:04:18.231 ********* 2026-04-28 03:05:30.812059 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:05:30.812063 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:05:30.812067 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:05:30.812070 | orchestrator | 2026-04-28 03:05:30.812074 | orchestrator | TASK [ceph-mon : Start the monitor service] ************************************ 2026-04-28 03:05:30.812078 | orchestrator | Tuesday 28 April 2026 03:04:34 +0000 (0:00:02.075) 0:04:20.306 ********* 2026-04-28 03:05:30.812082 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:05:30.812085 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:05:30.812089 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:05:30.812093 | orchestrator | 2026-04-28 03:05:30.812097 | orchestrator | TASK [ceph-mon : Include_tasks ceph_keys.yml] ********************************** 2026-04-28 03:05:30.812100 | orchestrator | Tuesday 28 April 2026 03:04:38 +0000 (0:00:03.540) 0:04:23.847 ********* 2026-04-28 03:05:30.812104 | orchestrator | included: /ansible/roles/ceph-mon/tasks/ceph_keys.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:05:30.812108 | orchestrator | 2026-04-28 03:05:30.812112 | orchestrator | TASK [ceph-mon : Waiting for the monitor(s) to form the quorum...] ************* 2026-04-28 03:05:30.812116 | orchestrator | Tuesday 28 April 2026 03:04:39 +0000 (0:00:00.625) 0:04:24.472 ********* 2026-04-28 03:05:30.812119 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Waiting for the monitor(s) to form the quorum... (10 retries left). 2026-04-28 03:05:30.812123 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:05:30.812128 | orchestrator | 2026-04-28 03:05:30.812132 | orchestrator | TASK [ceph-mon : Fetch ceph initial keys] ************************************** 2026-04-28 03:05:30.812136 | orchestrator | Tuesday 28 April 2026 03:05:00 +0000 (0:00:21.853) 0:04:46.325 ********* 2026-04-28 03:05:30.812140 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:05:30.812153 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:05:30.812157 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:05:30.812161 | orchestrator | 2026-04-28 03:05:30.812165 | orchestrator | TASK [ceph-mon : Include secure_cluster.yml] *********************************** 2026-04-28 03:05:30.812169 | orchestrator | Tuesday 28 April 2026 03:05:11 +0000 (0:00:10.346) 0:04:56.672 ********* 2026-04-28 03:05:30.812173 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:05:30.812177 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:05:30.812181 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:05:30.812184 | orchestrator | 2026-04-28 03:05:30.812188 | orchestrator | TASK [ceph-mon : Set cluster configs] ****************************************** 2026-04-28 03:05:30.812192 | orchestrator | Tuesday 28 April 2026 03:05:11 +0000 (0:00:00.364) 0:04:57.036 ********* 2026-04-28 03:05:30.812207 | orchestrator | changed: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__4b7799c1ab638b312d54680ee678a64df0e1135c'}}, {'key': 'public_network', 'value': '192.168.16.0/20'}]) 2026-04-28 03:05:30.812217 | orchestrator | changed: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__4b7799c1ab638b312d54680ee678a64df0e1135c'}}, {'key': 'cluster_network', 'value': '192.168.16.0/20'}]) 2026-04-28 03:05:30.812222 | orchestrator | changed: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__4b7799c1ab638b312d54680ee678a64df0e1135c'}}, {'key': 'osd_pool_default_crush_rule', 'value': -1}]) 2026-04-28 03:05:30.812227 | orchestrator | changed: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__4b7799c1ab638b312d54680ee678a64df0e1135c'}}, {'key': 'ms_bind_ipv6', 'value': 'False'}]) 2026-04-28 03:05:30.812231 | orchestrator | changed: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__4b7799c1ab638b312d54680ee678a64df0e1135c'}}, {'key': 'ms_bind_ipv4', 'value': 'True'}]) 2026-04-28 03:05:30.812236 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__4b7799c1ab638b312d54680ee678a64df0e1135c'}}, {'key': 'osd_crush_chooseleaf_type', 'value': '__omit_place_holder__4b7799c1ab638b312d54680ee678a64df0e1135c'}])  2026-04-28 03:05:30.812241 | orchestrator | 2026-04-28 03:05:30.812245 | orchestrator | RUNNING HANDLER [ceph-handler : Make tempdir for scripts] ********************** 2026-04-28 03:05:30.812249 | orchestrator | Tuesday 28 April 2026 03:05:26 +0000 (0:00:15.231) 0:05:12.267 ********* 2026-04-28 03:05:30.812252 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:05:30.812256 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:05:30.812260 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:05:30.812264 | orchestrator | 2026-04-28 03:05:30.812267 | orchestrator | RUNNING HANDLER [ceph-handler : Mons handler] ********************************** 2026-04-28 03:05:30.812271 | orchestrator | Tuesday 28 April 2026 03:05:27 +0000 (0:00:00.704) 0:05:12.972 ********* 2026-04-28 03:05:30.812275 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_mons.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:05:30.812279 | orchestrator | 2026-04-28 03:05:30.812282 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mon_handler_called before restart] ******** 2026-04-28 03:05:30.812286 | orchestrator | Tuesday 28 April 2026 03:05:28 +0000 (0:00:00.602) 0:05:13.574 ********* 2026-04-28 03:05:30.812290 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:05:30.812294 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:05:30.812297 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:05:30.812301 | orchestrator | 2026-04-28 03:05:30.812305 | orchestrator | RUNNING HANDLER [ceph-handler : Copy mon restart script] *********************** 2026-04-28 03:05:30.812309 | orchestrator | Tuesday 28 April 2026 03:05:28 +0000 (0:00:00.381) 0:05:13.956 ********* 2026-04-28 03:05:30.812313 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:05:30.812316 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:05:30.812323 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:05:30.812327 | orchestrator | 2026-04-28 03:05:30.812331 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph mon daemon(s)] ******************** 2026-04-28 03:05:30.812335 | orchestrator | Tuesday 28 April 2026 03:05:29 +0000 (0:00:00.702) 0:05:14.659 ********* 2026-04-28 03:05:30.812342 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-28 03:05:30.812347 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-28 03:05:30.812351 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-28 03:05:30.812354 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:05:30.812365 | orchestrator | 2026-04-28 03:05:30.812369 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mon_handler_called after restart] ********* 2026-04-28 03:05:30.812373 | orchestrator | Tuesday 28 April 2026 03:05:29 +0000 (0:00:00.714) 0:05:15.374 ********* 2026-04-28 03:05:30.812377 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:05:30.812380 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:05:30.812384 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:05:30.812388 | orchestrator | 2026-04-28 03:05:30.812392 | orchestrator | PLAY [Apply role ceph-mgr] ***************************************************** 2026-04-28 03:05:30.812396 | orchestrator | 2026-04-28 03:05:30.812402 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 03:06:00.086598 | orchestrator | Tuesday 28 April 2026 03:05:30 +0000 (0:00:00.884) 0:05:16.258 ********* 2026-04-28 03:06:00.086738 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:06:00.086780 | orchestrator | 2026-04-28 03:06:00.086803 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 03:06:00.086816 | orchestrator | Tuesday 28 April 2026 03:05:31 +0000 (0:00:01.015) 0:05:17.274 ********* 2026-04-28 03:06:00.086828 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:06:00.086839 | orchestrator | 2026-04-28 03:06:00.086851 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 03:06:00.086862 | orchestrator | Tuesday 28 April 2026 03:05:32 +0000 (0:00:00.597) 0:05:17.872 ********* 2026-04-28 03:06:00.086873 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:06:00.086886 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:06:00.086897 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:06:00.086908 | orchestrator | 2026-04-28 03:06:00.086920 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 03:06:00.086931 | orchestrator | Tuesday 28 April 2026 03:05:33 +0000 (0:00:01.033) 0:05:18.905 ********* 2026-04-28 03:06:00.086942 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:06:00.087004 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:06:00.087016 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:06:00.087027 | orchestrator | 2026-04-28 03:06:00.087038 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 03:06:00.087049 | orchestrator | Tuesday 28 April 2026 03:05:33 +0000 (0:00:00.370) 0:05:19.275 ********* 2026-04-28 03:06:00.087060 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:06:00.087071 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:06:00.087082 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:06:00.087095 | orchestrator | 2026-04-28 03:06:00.087109 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 03:06:00.087124 | orchestrator | Tuesday 28 April 2026 03:05:34 +0000 (0:00:00.350) 0:05:19.626 ********* 2026-04-28 03:06:00.087137 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:06:00.087150 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:06:00.087163 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:06:00.087176 | orchestrator | 2026-04-28 03:06:00.087191 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 03:06:00.087211 | orchestrator | Tuesday 28 April 2026 03:05:34 +0000 (0:00:00.333) 0:05:19.960 ********* 2026-04-28 03:06:00.087276 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:06:00.087297 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:06:00.087314 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:06:00.087331 | orchestrator | 2026-04-28 03:06:00.087347 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 03:06:00.087363 | orchestrator | Tuesday 28 April 2026 03:05:35 +0000 (0:00:01.021) 0:05:20.981 ********* 2026-04-28 03:06:00.087378 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:06:00.087394 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:06:00.087410 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:06:00.087427 | orchestrator | 2026-04-28 03:06:00.087444 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 03:06:00.087462 | orchestrator | Tuesday 28 April 2026 03:05:35 +0000 (0:00:00.363) 0:05:21.344 ********* 2026-04-28 03:06:00.087481 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:06:00.087499 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:06:00.087518 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:06:00.087536 | orchestrator | 2026-04-28 03:06:00.087552 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 03:06:00.087563 | orchestrator | Tuesday 28 April 2026 03:05:36 +0000 (0:00:00.416) 0:05:21.761 ********* 2026-04-28 03:06:00.087574 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:06:00.087585 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:06:00.087596 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:06:00.087607 | orchestrator | 2026-04-28 03:06:00.087618 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 03:06:00.087629 | orchestrator | Tuesday 28 April 2026 03:05:37 +0000 (0:00:00.825) 0:05:22.586 ********* 2026-04-28 03:06:00.087640 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:06:00.087651 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:06:00.087661 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:06:00.087672 | orchestrator | 2026-04-28 03:06:00.087683 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 03:06:00.087695 | orchestrator | Tuesday 28 April 2026 03:05:38 +0000 (0:00:01.400) 0:05:23.986 ********* 2026-04-28 03:06:00.087706 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:06:00.087717 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:06:00.087728 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:06:00.087738 | orchestrator | 2026-04-28 03:06:00.087749 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 03:06:00.087760 | orchestrator | Tuesday 28 April 2026 03:05:38 +0000 (0:00:00.340) 0:05:24.327 ********* 2026-04-28 03:06:00.087771 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:06:00.087782 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:06:00.087812 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:06:00.087823 | orchestrator | 2026-04-28 03:06:00.087834 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 03:06:00.087845 | orchestrator | Tuesday 28 April 2026 03:05:39 +0000 (0:00:00.380) 0:05:24.707 ********* 2026-04-28 03:06:00.087856 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:06:00.087866 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:06:00.087877 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:06:00.087888 | orchestrator | 2026-04-28 03:06:00.087899 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 03:06:00.087910 | orchestrator | Tuesday 28 April 2026 03:05:39 +0000 (0:00:00.350) 0:05:25.057 ********* 2026-04-28 03:06:00.087920 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:06:00.087931 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:06:00.087942 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:06:00.087983 | orchestrator | 2026-04-28 03:06:00.088017 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 03:06:00.088028 | orchestrator | Tuesday 28 April 2026 03:05:40 +0000 (0:00:00.630) 0:05:25.688 ********* 2026-04-28 03:06:00.088040 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:06:00.088051 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:06:00.088073 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:06:00.088084 | orchestrator | 2026-04-28 03:06:00.088095 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 03:06:00.088106 | orchestrator | Tuesday 28 April 2026 03:05:40 +0000 (0:00:00.364) 0:05:26.053 ********* 2026-04-28 03:06:00.088117 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:06:00.088128 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:06:00.088139 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:06:00.088150 | orchestrator | 2026-04-28 03:06:00.088161 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 03:06:00.088171 | orchestrator | Tuesday 28 April 2026 03:05:40 +0000 (0:00:00.339) 0:05:26.392 ********* 2026-04-28 03:06:00.088182 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:06:00.088193 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:06:00.088204 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:06:00.088215 | orchestrator | 2026-04-28 03:06:00.088226 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 03:06:00.088237 | orchestrator | Tuesday 28 April 2026 03:05:41 +0000 (0:00:00.358) 0:05:26.751 ********* 2026-04-28 03:06:00.088248 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:06:00.088259 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:06:00.088269 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:06:00.088280 | orchestrator | 2026-04-28 03:06:00.088291 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 03:06:00.088302 | orchestrator | Tuesday 28 April 2026 03:05:41 +0000 (0:00:00.680) 0:05:27.431 ********* 2026-04-28 03:06:00.088313 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:06:00.088324 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:06:00.088335 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:06:00.088346 | orchestrator | 2026-04-28 03:06:00.088357 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 03:06:00.088368 | orchestrator | Tuesday 28 April 2026 03:05:42 +0000 (0:00:00.388) 0:05:27.820 ********* 2026-04-28 03:06:00.088379 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:06:00.088390 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:06:00.088400 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:06:00.088411 | orchestrator | 2026-04-28 03:06:00.088422 | orchestrator | TASK [ceph-mgr : Set_fact container_exec_cmd] ********************************** 2026-04-28 03:06:00.088433 | orchestrator | Tuesday 28 April 2026 03:05:43 +0000 (0:00:00.647) 0:05:28.468 ********* 2026-04-28 03:06:00.088444 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 03:06:00.088455 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 03:06:00.088467 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 03:06:00.088478 | orchestrator | 2026-04-28 03:06:00.088489 | orchestrator | TASK [ceph-mgr : Include common.yml] ******************************************* 2026-04-28 03:06:00.088500 | orchestrator | Tuesday 28 April 2026 03:05:43 +0000 (0:00:00.981) 0:05:29.449 ********* 2026-04-28 03:06:00.088511 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/common.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:06:00.088522 | orchestrator | 2026-04-28 03:06:00.088533 | orchestrator | TASK [ceph-mgr : Create mgr directory] ***************************************** 2026-04-28 03:06:00.088544 | orchestrator | Tuesday 28 April 2026 03:05:44 +0000 (0:00:00.889) 0:05:30.339 ********* 2026-04-28 03:06:00.088555 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:06:00.088565 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:06:00.088576 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:06:00.088587 | orchestrator | 2026-04-28 03:06:00.088598 | orchestrator | TASK [ceph-mgr : Fetch ceph mgr keyring] *************************************** 2026-04-28 03:06:00.088609 | orchestrator | Tuesday 28 April 2026 03:05:45 +0000 (0:00:00.809) 0:05:31.149 ********* 2026-04-28 03:06:00.088620 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:06:00.088632 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:06:00.088661 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:06:00.088678 | orchestrator | 2026-04-28 03:06:00.088696 | orchestrator | TASK [ceph-mgr : Create ceph mgr keyring(s) on a mon node] ********************* 2026-04-28 03:06:00.088715 | orchestrator | Tuesday 28 April 2026 03:05:46 +0000 (0:00:00.637) 0:05:31.786 ********* 2026-04-28 03:06:00.088735 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-28 03:06:00.088754 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-28 03:06:00.088772 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-28 03:06:00.088789 | orchestrator | changed: [testbed-node-0 -> {{ groups[mon_group_name][0] }}] 2026-04-28 03:06:00.088801 | orchestrator | 2026-04-28 03:06:00.088812 | orchestrator | TASK [ceph-mgr : Set_fact _mgr_keys] ******************************************* 2026-04-28 03:06:00.088823 | orchestrator | Tuesday 28 April 2026 03:05:57 +0000 (0:00:10.957) 0:05:42.744 ********* 2026-04-28 03:06:00.088833 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:06:00.088844 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:06:00.088855 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:06:00.088866 | orchestrator | 2026-04-28 03:06:00.088884 | orchestrator | TASK [ceph-mgr : Get keys from monitors] *************************************** 2026-04-28 03:06:00.088895 | orchestrator | Tuesday 28 April 2026 03:05:57 +0000 (0:00:00.432) 0:05:43.176 ********* 2026-04-28 03:06:00.088906 | orchestrator | skipping: [testbed-node-0] => (item=None)  2026-04-28 03:06:00.088917 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-28 03:06:00.088928 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-28 03:06:00.088939 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-28 03:06:00.089019 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:06:00.089032 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:06:00.089043 | orchestrator | 2026-04-28 03:06:00.089054 | orchestrator | TASK [ceph-mgr : Copy ceph key(s) if needed] *********************************** 2026-04-28 03:06:00.089074 | orchestrator | Tuesday 28 April 2026 03:06:00 +0000 (0:00:02.355) 0:05:45.532 ********* 2026-04-28 03:06:59.488459 | orchestrator | skipping: [testbed-node-0] => (item=None)  2026-04-28 03:06:59.488571 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-28 03:06:59.488587 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-28 03:06:59.488598 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-28 03:06:59.488608 | orchestrator | changed: [testbed-node-1] => (item=None) 2026-04-28 03:06:59.488617 | orchestrator | changed: [testbed-node-2] => (item=None) 2026-04-28 03:06:59.488628 | orchestrator | 2026-04-28 03:06:59.488639 | orchestrator | TASK [ceph-mgr : Set mgr key permissions] ************************************** 2026-04-28 03:06:59.488650 | orchestrator | Tuesday 28 April 2026 03:06:01 +0000 (0:00:01.305) 0:05:46.837 ********* 2026-04-28 03:06:59.488660 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:06:59.488670 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:06:59.488679 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:06:59.488689 | orchestrator | 2026-04-28 03:06:59.488699 | orchestrator | TASK [ceph-mgr : Append dashboard modules to ceph_mgr_modules] ***************** 2026-04-28 03:06:59.488708 | orchestrator | Tuesday 28 April 2026 03:06:02 +0000 (0:00:01.094) 0:05:47.932 ********* 2026-04-28 03:06:59.488718 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:06:59.488749 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:06:59.488770 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:06:59.488780 | orchestrator | 2026-04-28 03:06:59.488789 | orchestrator | TASK [ceph-mgr : Include pre_requisite.yml] ************************************ 2026-04-28 03:06:59.488799 | orchestrator | Tuesday 28 April 2026 03:06:02 +0000 (0:00:00.362) 0:05:48.295 ********* 2026-04-28 03:06:59.488809 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:06:59.488819 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:06:59.488828 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:06:59.488838 | orchestrator | 2026-04-28 03:06:59.488848 | orchestrator | TASK [ceph-mgr : Include start_mgr.yml] **************************************** 2026-04-28 03:06:59.488882 | orchestrator | Tuesday 28 April 2026 03:06:03 +0000 (0:00:00.353) 0:05:48.648 ********* 2026-04-28 03:06:59.488893 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/start_mgr.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:06:59.488903 | orchestrator | 2026-04-28 03:06:59.488912 | orchestrator | TASK [ceph-mgr : Ensure systemd service override directory exists] ************* 2026-04-28 03:06:59.488922 | orchestrator | Tuesday 28 April 2026 03:06:04 +0000 (0:00:00.862) 0:05:49.510 ********* 2026-04-28 03:06:59.488966 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:06:59.488979 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:06:59.488990 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:06:59.489001 | orchestrator | 2026-04-28 03:06:59.489013 | orchestrator | TASK [ceph-mgr : Add ceph-mgr systemd service overrides] *********************** 2026-04-28 03:06:59.489024 | orchestrator | Tuesday 28 April 2026 03:06:04 +0000 (0:00:00.381) 0:05:49.892 ********* 2026-04-28 03:06:59.489035 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:06:59.489045 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:06:59.489056 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:06:59.489067 | orchestrator | 2026-04-28 03:06:59.489078 | orchestrator | TASK [ceph-mgr : Include_tasks systemd.yml] ************************************ 2026-04-28 03:06:59.489089 | orchestrator | Tuesday 28 April 2026 03:06:04 +0000 (0:00:00.369) 0:05:50.262 ********* 2026-04-28 03:06:59.489101 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/systemd.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:06:59.489113 | orchestrator | 2026-04-28 03:06:59.489124 | orchestrator | TASK [ceph-mgr : Generate systemd unit file] *********************************** 2026-04-28 03:06:59.489135 | orchestrator | Tuesday 28 April 2026 03:06:05 +0000 (0:00:00.891) 0:05:51.153 ********* 2026-04-28 03:06:59.489146 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:06:59.489158 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:06:59.489169 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:06:59.489180 | orchestrator | 2026-04-28 03:06:59.489191 | orchestrator | TASK [ceph-mgr : Generate systemd ceph-mgr target file] ************************ 2026-04-28 03:06:59.489201 | orchestrator | Tuesday 28 April 2026 03:06:06 +0000 (0:00:01.278) 0:05:52.431 ********* 2026-04-28 03:06:59.489211 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:06:59.489220 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:06:59.489229 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:06:59.489239 | orchestrator | 2026-04-28 03:06:59.489248 | orchestrator | TASK [ceph-mgr : Enable ceph-mgr.target] *************************************** 2026-04-28 03:06:59.489258 | orchestrator | Tuesday 28 April 2026 03:06:08 +0000 (0:00:01.114) 0:05:53.546 ********* 2026-04-28 03:06:59.489267 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:06:59.489277 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:06:59.489286 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:06:59.489296 | orchestrator | 2026-04-28 03:06:59.489306 | orchestrator | TASK [ceph-mgr : Systemd start mgr] ******************************************** 2026-04-28 03:06:59.489316 | orchestrator | Tuesday 28 April 2026 03:06:09 +0000 (0:00:01.904) 0:05:55.451 ********* 2026-04-28 03:06:59.489325 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:06:59.489335 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:06:59.489344 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:06:59.489354 | orchestrator | 2026-04-28 03:06:59.489363 | orchestrator | TASK [ceph-mgr : Include mgr_modules.yml] ************************************** 2026-04-28 03:06:59.489387 | orchestrator | Tuesday 28 April 2026 03:06:13 +0000 (0:00:03.657) 0:05:59.109 ********* 2026-04-28 03:06:59.489397 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:06:59.489407 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:06:59.489416 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/mgr_modules.yml for testbed-node-2 2026-04-28 03:06:59.489426 | orchestrator | 2026-04-28 03:06:59.489436 | orchestrator | TASK [ceph-mgr : Wait for all mgr to be up] ************************************ 2026-04-28 03:06:59.489454 | orchestrator | Tuesday 28 April 2026 03:06:14 +0000 (0:00:00.458) 0:05:59.567 ********* 2026-04-28 03:06:59.489482 | orchestrator | FAILED - RETRYING: [testbed-node-2 -> testbed-node-0]: Wait for all mgr to be up (30 retries left). 2026-04-28 03:06:59.489501 | orchestrator | FAILED - RETRYING: [testbed-node-2 -> testbed-node-0]: Wait for all mgr to be up (29 retries left). 2026-04-28 03:06:59.489540 | orchestrator | FAILED - RETRYING: [testbed-node-2 -> testbed-node-0]: Wait for all mgr to be up (28 retries left). 2026-04-28 03:06:59.489557 | orchestrator | FAILED - RETRYING: [testbed-node-2 -> testbed-node-0]: Wait for all mgr to be up (27 retries left). 2026-04-28 03:06:59.489573 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-28 03:06:59.489590 | orchestrator | 2026-04-28 03:06:59.489604 | orchestrator | TASK [ceph-mgr : Get enabled modules from ceph-mgr] **************************** 2026-04-28 03:06:59.489620 | orchestrator | Tuesday 28 April 2026 03:06:38 +0000 (0:00:24.317) 0:06:23.884 ********* 2026-04-28 03:06:59.489637 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-28 03:06:59.489654 | orchestrator | 2026-04-28 03:06:59.489672 | orchestrator | TASK [ceph-mgr : Set _ceph_mgr_modules fact (convert _ceph_mgr_modules.stdout to a dict)] *** 2026-04-28 03:06:59.489690 | orchestrator | Tuesday 28 April 2026 03:06:39 +0000 (0:00:01.310) 0:06:25.195 ********* 2026-04-28 03:06:59.489707 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:06:59.489721 | orchestrator | 2026-04-28 03:06:59.489730 | orchestrator | TASK [ceph-mgr : Set _disabled_ceph_mgr_modules fact] ************************** 2026-04-28 03:06:59.489740 | orchestrator | Tuesday 28 April 2026 03:06:40 +0000 (0:00:00.378) 0:06:25.573 ********* 2026-04-28 03:06:59.489750 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:06:59.489767 | orchestrator | 2026-04-28 03:06:59.489783 | orchestrator | TASK [ceph-mgr : Disable ceph mgr enabled modules] ***************************** 2026-04-28 03:06:59.489799 | orchestrator | Tuesday 28 April 2026 03:06:40 +0000 (0:00:00.153) 0:06:25.726 ********* 2026-04-28 03:06:59.489814 | orchestrator | changed: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=iostat) 2026-04-28 03:06:59.489831 | orchestrator | changed: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=nfs) 2026-04-28 03:06:59.489848 | orchestrator | changed: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=restful) 2026-04-28 03:06:59.489864 | orchestrator | 2026-04-28 03:06:59.489881 | orchestrator | TASK [ceph-mgr : Add modules to ceph-mgr] ************************************** 2026-04-28 03:06:59.489898 | orchestrator | Tuesday 28 April 2026 03:06:47 +0000 (0:00:07.513) 0:06:33.240 ********* 2026-04-28 03:06:59.489911 | orchestrator | skipping: [testbed-node-2] => (item=balancer)  2026-04-28 03:06:59.489921 | orchestrator | changed: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=dashboard) 2026-04-28 03:06:59.490004 | orchestrator | changed: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=prometheus) 2026-04-28 03:06:59.490089 | orchestrator | skipping: [testbed-node-2] => (item=status)  2026-04-28 03:06:59.490109 | orchestrator | 2026-04-28 03:06:59.490125 | orchestrator | RUNNING HANDLER [ceph-handler : Make tempdir for scripts] ********************** 2026-04-28 03:06:59.490140 | orchestrator | Tuesday 28 April 2026 03:06:52 +0000 (0:00:05.028) 0:06:38.268 ********* 2026-04-28 03:06:59.490150 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:06:59.490159 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:06:59.490169 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:06:59.490178 | orchestrator | 2026-04-28 03:06:59.490188 | orchestrator | RUNNING HANDLER [ceph-handler : Mgrs handler] ********************************** 2026-04-28 03:06:59.490198 | orchestrator | Tuesday 28 April 2026 03:06:53 +0000 (0:00:00.662) 0:06:38.931 ********* 2026-04-28 03:06:59.490208 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_mgrs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:06:59.490218 | orchestrator | 2026-04-28 03:06:59.490227 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mgr_handler_called before restart] ******** 2026-04-28 03:06:59.490237 | orchestrator | Tuesday 28 April 2026 03:06:54 +0000 (0:00:00.885) 0:06:39.816 ********* 2026-04-28 03:06:59.490246 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:06:59.490256 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:06:59.490275 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:06:59.490285 | orchestrator | 2026-04-28 03:06:59.490295 | orchestrator | RUNNING HANDLER [ceph-handler : Copy mgr restart script] *********************** 2026-04-28 03:06:59.490304 | orchestrator | Tuesday 28 April 2026 03:06:54 +0000 (0:00:00.376) 0:06:40.192 ********* 2026-04-28 03:06:59.490314 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:06:59.490323 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:06:59.490333 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:06:59.490342 | orchestrator | 2026-04-28 03:06:59.490352 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph mgr daemon(s)] ******************** 2026-04-28 03:06:59.490361 | orchestrator | Tuesday 28 April 2026 03:06:55 +0000 (0:00:01.219) 0:06:41.411 ********* 2026-04-28 03:06:59.490371 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-28 03:06:59.490381 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-28 03:06:59.490390 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-28 03:06:59.490400 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:06:59.490409 | orchestrator | 2026-04-28 03:06:59.490419 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mgr_handler_called after restart] ********* 2026-04-28 03:06:59.490428 | orchestrator | Tuesday 28 April 2026 03:06:56 +0000 (0:00:01.011) 0:06:42.423 ********* 2026-04-28 03:06:59.490438 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:06:59.490455 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:06:59.490465 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:06:59.490474 | orchestrator | 2026-04-28 03:06:59.490484 | orchestrator | PLAY [Apply role ceph-osd] ***************************************************** 2026-04-28 03:06:59.490493 | orchestrator | 2026-04-28 03:06:59.490503 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 03:06:59.490512 | orchestrator | Tuesday 28 April 2026 03:06:58 +0000 (0:00:01.045) 0:06:43.468 ********* 2026-04-28 03:06:59.490520 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:06:59.490530 | orchestrator | 2026-04-28 03:06:59.490538 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 03:06:59.490546 | orchestrator | Tuesday 28 April 2026 03:06:58 +0000 (0:00:00.831) 0:06:44.300 ********* 2026-04-28 03:06:59.490563 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:07:16.632062 | orchestrator | 2026-04-28 03:07:16.632208 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 03:07:16.632228 | orchestrator | Tuesday 28 April 2026 03:06:59 +0000 (0:00:00.641) 0:06:44.942 ********* 2026-04-28 03:07:16.632241 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:07:16.632253 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:07:16.632265 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:07:16.632276 | orchestrator | 2026-04-28 03:07:16.632287 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 03:07:16.632298 | orchestrator | Tuesday 28 April 2026 03:06:59 +0000 (0:00:00.402) 0:06:45.344 ********* 2026-04-28 03:07:16.632309 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:07:16.632321 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:07:16.632332 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:07:16.632342 | orchestrator | 2026-04-28 03:07:16.632353 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 03:07:16.632364 | orchestrator | Tuesday 28 April 2026 03:07:00 +0000 (0:00:01.041) 0:06:46.386 ********* 2026-04-28 03:07:16.632375 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:07:16.632386 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:07:16.632397 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:07:16.632407 | orchestrator | 2026-04-28 03:07:16.632418 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 03:07:16.632429 | orchestrator | Tuesday 28 April 2026 03:07:01 +0000 (0:00:00.719) 0:06:47.105 ********* 2026-04-28 03:07:16.632440 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:07:16.632474 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:07:16.632486 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:07:16.632497 | orchestrator | 2026-04-28 03:07:16.632510 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 03:07:16.632523 | orchestrator | Tuesday 28 April 2026 03:07:02 +0000 (0:00:00.731) 0:06:47.836 ********* 2026-04-28 03:07:16.632536 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:07:16.632548 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:07:16.632560 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:07:16.632573 | orchestrator | 2026-04-28 03:07:16.632586 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 03:07:16.632599 | orchestrator | Tuesday 28 April 2026 03:07:02 +0000 (0:00:00.355) 0:06:48.192 ********* 2026-04-28 03:07:16.632612 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:07:16.632624 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:07:16.632637 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:07:16.632649 | orchestrator | 2026-04-28 03:07:16.632662 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 03:07:16.632675 | orchestrator | Tuesday 28 April 2026 03:07:03 +0000 (0:00:00.634) 0:06:48.826 ********* 2026-04-28 03:07:16.632687 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:07:16.632699 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:07:16.632711 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:07:16.632724 | orchestrator | 2026-04-28 03:07:16.632737 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 03:07:16.632749 | orchestrator | Tuesday 28 April 2026 03:07:03 +0000 (0:00:00.397) 0:06:49.224 ********* 2026-04-28 03:07:16.632762 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:07:16.632774 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:07:16.632787 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:07:16.632800 | orchestrator | 2026-04-28 03:07:16.632813 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 03:07:16.632825 | orchestrator | Tuesday 28 April 2026 03:07:04 +0000 (0:00:00.751) 0:06:49.975 ********* 2026-04-28 03:07:16.632838 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:07:16.632851 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:07:16.632862 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:07:16.632873 | orchestrator | 2026-04-28 03:07:16.632884 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 03:07:16.632894 | orchestrator | Tuesday 28 April 2026 03:07:05 +0000 (0:00:00.769) 0:06:50.744 ********* 2026-04-28 03:07:16.632905 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:07:16.632916 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:07:16.632949 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:07:16.632960 | orchestrator | 2026-04-28 03:07:16.632971 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 03:07:16.632982 | orchestrator | Tuesday 28 April 2026 03:07:05 +0000 (0:00:00.627) 0:06:51.372 ********* 2026-04-28 03:07:16.632993 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:07:16.633004 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:07:16.633015 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:07:16.633025 | orchestrator | 2026-04-28 03:07:16.633036 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 03:07:16.633047 | orchestrator | Tuesday 28 April 2026 03:07:06 +0000 (0:00:00.428) 0:06:51.800 ********* 2026-04-28 03:07:16.633058 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:07:16.633069 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:07:16.633079 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:07:16.633090 | orchestrator | 2026-04-28 03:07:16.633101 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 03:07:16.633127 | orchestrator | Tuesday 28 April 2026 03:07:06 +0000 (0:00:00.361) 0:06:52.162 ********* 2026-04-28 03:07:16.633138 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:07:16.633149 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:07:16.633168 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:07:16.633179 | orchestrator | 2026-04-28 03:07:16.633191 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 03:07:16.633202 | orchestrator | Tuesday 28 April 2026 03:07:07 +0000 (0:00:00.371) 0:06:52.534 ********* 2026-04-28 03:07:16.633212 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:07:16.633223 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:07:16.633234 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:07:16.633245 | orchestrator | 2026-04-28 03:07:16.633255 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 03:07:16.633266 | orchestrator | Tuesday 28 April 2026 03:07:07 +0000 (0:00:00.696) 0:06:53.230 ********* 2026-04-28 03:07:16.633277 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:07:16.633288 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:07:16.633299 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:07:16.633310 | orchestrator | 2026-04-28 03:07:16.633321 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 03:07:16.633350 | orchestrator | Tuesday 28 April 2026 03:07:08 +0000 (0:00:00.367) 0:06:53.598 ********* 2026-04-28 03:07:16.633362 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:07:16.633373 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:07:16.633384 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:07:16.633395 | orchestrator | 2026-04-28 03:07:16.633406 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 03:07:16.633417 | orchestrator | Tuesday 28 April 2026 03:07:08 +0000 (0:00:00.338) 0:06:53.937 ********* 2026-04-28 03:07:16.633428 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:07:16.633438 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:07:16.633449 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:07:16.633460 | orchestrator | 2026-04-28 03:07:16.633471 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 03:07:16.633482 | orchestrator | Tuesday 28 April 2026 03:07:08 +0000 (0:00:00.355) 0:06:54.292 ********* 2026-04-28 03:07:16.633492 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:07:16.633503 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:07:16.633514 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:07:16.633525 | orchestrator | 2026-04-28 03:07:16.633536 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 03:07:16.633547 | orchestrator | Tuesday 28 April 2026 03:07:09 +0000 (0:00:00.702) 0:06:54.995 ********* 2026-04-28 03:07:16.633557 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:07:16.633568 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:07:16.633579 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:07:16.633590 | orchestrator | 2026-04-28 03:07:16.633600 | orchestrator | TASK [ceph-osd : Set_fact add_osd] ********************************************* 2026-04-28 03:07:16.633611 | orchestrator | Tuesday 28 April 2026 03:07:10 +0000 (0:00:00.672) 0:06:55.668 ********* 2026-04-28 03:07:16.633622 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:07:16.633632 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:07:16.633643 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:07:16.633654 | orchestrator | 2026-04-28 03:07:16.633664 | orchestrator | TASK [ceph-osd : Set_fact container_exec_cmd] ********************************** 2026-04-28 03:07:16.633675 | orchestrator | Tuesday 28 April 2026 03:07:10 +0000 (0:00:00.337) 0:06:56.005 ********* 2026-04-28 03:07:16.633686 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 03:07:16.633698 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 03:07:16.633709 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 03:07:16.633720 | orchestrator | 2026-04-28 03:07:16.633730 | orchestrator | TASK [ceph-osd : Include_tasks system_tuning.yml] ****************************** 2026-04-28 03:07:16.633741 | orchestrator | Tuesday 28 April 2026 03:07:11 +0000 (0:00:01.314) 0:06:57.319 ********* 2026-04-28 03:07:16.633752 | orchestrator | included: /ansible/roles/ceph-osd/tasks/system_tuning.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:07:16.633771 | orchestrator | 2026-04-28 03:07:16.633782 | orchestrator | TASK [ceph-osd : Create tmpfiles.d directory] ********************************** 2026-04-28 03:07:16.633793 | orchestrator | Tuesday 28 April 2026 03:07:12 +0000 (0:00:00.595) 0:06:57.914 ********* 2026-04-28 03:07:16.633803 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:07:16.633814 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:07:16.633825 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:07:16.633836 | orchestrator | 2026-04-28 03:07:16.633847 | orchestrator | TASK [ceph-osd : Disable transparent hugepage] ********************************* 2026-04-28 03:07:16.633858 | orchestrator | Tuesday 28 April 2026 03:07:12 +0000 (0:00:00.352) 0:06:58.266 ********* 2026-04-28 03:07:16.633868 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:07:16.633879 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:07:16.633890 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:07:16.633901 | orchestrator | 2026-04-28 03:07:16.633911 | orchestrator | TASK [ceph-osd : Get default vm.min_free_kbytes] ******************************* 2026-04-28 03:07:16.633949 | orchestrator | Tuesday 28 April 2026 03:07:13 +0000 (0:00:00.645) 0:06:58.912 ********* 2026-04-28 03:07:16.633960 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:07:16.633971 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:07:16.633982 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:07:16.633993 | orchestrator | 2026-04-28 03:07:16.634003 | orchestrator | TASK [ceph-osd : Set_fact vm_min_free_kbytes] ********************************** 2026-04-28 03:07:16.634127 | orchestrator | Tuesday 28 April 2026 03:07:14 +0000 (0:00:00.682) 0:06:59.594 ********* 2026-04-28 03:07:16.634143 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:07:16.634154 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:07:16.634165 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:07:16.634176 | orchestrator | 2026-04-28 03:07:16.634187 | orchestrator | TASK [ceph-osd : Apply operating system tuning] ******************************** 2026-04-28 03:07:16.634198 | orchestrator | Tuesday 28 April 2026 03:07:14 +0000 (0:00:00.400) 0:06:59.995 ********* 2026-04-28 03:07:16.634209 | orchestrator | changed: [testbed-node-4] => (item={'name': 'fs.aio-max-nr', 'value': '1048576', 'enable': True}) 2026-04-28 03:07:16.634228 | orchestrator | changed: [testbed-node-3] => (item={'name': 'fs.aio-max-nr', 'value': '1048576', 'enable': True}) 2026-04-28 03:07:16.634240 | orchestrator | changed: [testbed-node-5] => (item={'name': 'fs.aio-max-nr', 'value': '1048576', 'enable': True}) 2026-04-28 03:07:16.634251 | orchestrator | changed: [testbed-node-4] => (item={'name': 'fs.file-max', 'value': 26234859}) 2026-04-28 03:07:16.634262 | orchestrator | changed: [testbed-node-3] => (item={'name': 'fs.file-max', 'value': 26234859}) 2026-04-28 03:07:16.634272 | orchestrator | changed: [testbed-node-5] => (item={'name': 'fs.file-max', 'value': 26234859}) 2026-04-28 03:07:16.634284 | orchestrator | changed: [testbed-node-3] => (item={'name': 'vm.zone_reclaim_mode', 'value': 0}) 2026-04-28 03:07:16.634295 | orchestrator | changed: [testbed-node-4] => (item={'name': 'vm.zone_reclaim_mode', 'value': 0}) 2026-04-28 03:07:16.634306 | orchestrator | changed: [testbed-node-5] => (item={'name': 'vm.zone_reclaim_mode', 'value': 0}) 2026-04-28 03:07:16.634326 | orchestrator | changed: [testbed-node-3] => (item={'name': 'vm.swappiness', 'value': 10}) 2026-04-28 03:08:24.369147 | orchestrator | changed: [testbed-node-4] => (item={'name': 'vm.swappiness', 'value': 10}) 2026-04-28 03:08:24.369253 | orchestrator | changed: [testbed-node-5] => (item={'name': 'vm.swappiness', 'value': 10}) 2026-04-28 03:08:24.369267 | orchestrator | changed: [testbed-node-3] => (item={'name': 'vm.min_free_kbytes', 'value': '67584'}) 2026-04-28 03:08:24.369278 | orchestrator | changed: [testbed-node-4] => (item={'name': 'vm.min_free_kbytes', 'value': '67584'}) 2026-04-28 03:08:24.369288 | orchestrator | changed: [testbed-node-5] => (item={'name': 'vm.min_free_kbytes', 'value': '67584'}) 2026-04-28 03:08:24.369298 | orchestrator | 2026-04-28 03:08:24.369324 | orchestrator | TASK [ceph-osd : Install dependencies] ***************************************** 2026-04-28 03:08:24.369344 | orchestrator | Tuesday 28 April 2026 03:07:16 +0000 (0:00:02.089) 0:07:02.084 ********* 2026-04-28 03:08:24.369383 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:24.369394 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:08:24.369405 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:08:24.369415 | orchestrator | 2026-04-28 03:08:24.369425 | orchestrator | TASK [ceph-osd : Include_tasks common.yml] ************************************* 2026-04-28 03:08:24.369435 | orchestrator | Tuesday 28 April 2026 03:07:17 +0000 (0:00:00.650) 0:07:02.735 ********* 2026-04-28 03:08:24.369445 | orchestrator | included: /ansible/roles/ceph-osd/tasks/common.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:08:24.369456 | orchestrator | 2026-04-28 03:08:24.369466 | orchestrator | TASK [ceph-osd : Create bootstrap-osd and osd directories] ********************* 2026-04-28 03:08:24.369476 | orchestrator | Tuesday 28 April 2026 03:07:17 +0000 (0:00:00.608) 0:07:03.344 ********* 2026-04-28 03:08:24.369486 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-osd/) 2026-04-28 03:08:24.369496 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-osd/) 2026-04-28 03:08:24.369505 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-osd/) 2026-04-28 03:08:24.369515 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/osd/) 2026-04-28 03:08:24.369526 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/osd/) 2026-04-28 03:08:24.369535 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/osd/) 2026-04-28 03:08:24.369545 | orchestrator | 2026-04-28 03:08:24.369555 | orchestrator | TASK [ceph-osd : Get keys from monitors] *************************************** 2026-04-28 03:08:24.369565 | orchestrator | Tuesday 28 April 2026 03:07:18 +0000 (0:00:00.951) 0:07:04.296 ********* 2026-04-28 03:08:24.369575 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:08:24.369584 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-28 03:08:24.369594 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-28 03:08:24.369604 | orchestrator | 2026-04-28 03:08:24.369614 | orchestrator | TASK [ceph-osd : Copy ceph key(s) if needed] *********************************** 2026-04-28 03:08:24.369623 | orchestrator | Tuesday 28 April 2026 03:07:21 +0000 (0:00:02.790) 0:07:07.086 ********* 2026-04-28 03:08:24.369633 | orchestrator | changed: [testbed-node-3] => (item=None) 2026-04-28 03:08:24.369643 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-28 03:08:24.369653 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:08:24.369662 | orchestrator | changed: [testbed-node-4] => (item=None) 2026-04-28 03:08:24.369672 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-28 03:08:24.369682 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:08:24.369691 | orchestrator | changed: [testbed-node-5] => (item=None) 2026-04-28 03:08:24.369701 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-28 03:08:24.369711 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:08:24.369721 | orchestrator | 2026-04-28 03:08:24.369730 | orchestrator | TASK [ceph-osd : Set noup flag] ************************************************ 2026-04-28 03:08:24.369740 | orchestrator | Tuesday 28 April 2026 03:07:22 +0000 (0:00:01.155) 0:07:08.241 ********* 2026-04-28 03:08:24.369750 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-28 03:08:24.369759 | orchestrator | 2026-04-28 03:08:24.369769 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm.yml] ****************************** 2026-04-28 03:08:24.369779 | orchestrator | Tuesday 28 April 2026 03:07:24 +0000 (0:00:02.136) 0:07:10.378 ********* 2026-04-28 03:08:24.369789 | orchestrator | included: /ansible/roles/ceph-osd/tasks/scenarios/lvm.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:08:24.369799 | orchestrator | 2026-04-28 03:08:24.369809 | orchestrator | TASK [ceph-osd : Use ceph-volume to create osds] ******************************* 2026-04-28 03:08:24.369819 | orchestrator | Tuesday 28 April 2026 03:07:25 +0000 (0:00:00.634) 0:07:11.013 ********* 2026-04-28 03:08:24.369845 | orchestrator | changed: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'}) 2026-04-28 03:08:24.369864 | orchestrator | changed: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'}) 2026-04-28 03:08:24.369874 | orchestrator | changed: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'}) 2026-04-28 03:08:24.369884 | orchestrator | changed: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'}) 2026-04-28 03:08:24.369928 | orchestrator | changed: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'}) 2026-04-28 03:08:24.369957 | orchestrator | changed: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'}) 2026-04-28 03:08:24.369967 | orchestrator | 2026-04-28 03:08:24.369977 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm-batch.yml] ************************ 2026-04-28 03:08:24.369986 | orchestrator | Tuesday 28 April 2026 03:08:06 +0000 (0:00:40.632) 0:07:51.645 ********* 2026-04-28 03:08:24.369996 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:24.370006 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:08:24.370079 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:08:24.370098 | orchestrator | 2026-04-28 03:08:24.370124 | orchestrator | TASK [ceph-osd : Include_tasks start_osds.yml] ********************************* 2026-04-28 03:08:24.370142 | orchestrator | Tuesday 28 April 2026 03:08:06 +0000 (0:00:00.358) 0:07:52.003 ********* 2026-04-28 03:08:24.370157 | orchestrator | included: /ansible/roles/ceph-osd/tasks/start_osds.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:08:24.370173 | orchestrator | 2026-04-28 03:08:24.370190 | orchestrator | TASK [ceph-osd : Get osd ids] ************************************************** 2026-04-28 03:08:24.370206 | orchestrator | Tuesday 28 April 2026 03:08:07 +0000 (0:00:00.607) 0:07:52.610 ********* 2026-04-28 03:08:24.370223 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:08:24.370239 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:08:24.370257 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:08:24.370274 | orchestrator | 2026-04-28 03:08:24.370291 | orchestrator | TASK [ceph-osd : Collect osd ids] ********************************************** 2026-04-28 03:08:24.370302 | orchestrator | Tuesday 28 April 2026 03:08:08 +0000 (0:00:01.039) 0:07:53.650 ********* 2026-04-28 03:08:24.370311 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:08:24.370321 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:08:24.370331 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:08:24.370340 | orchestrator | 2026-04-28 03:08:24.370350 | orchestrator | TASK [ceph-osd : Include_tasks systemd.yml] ************************************ 2026-04-28 03:08:24.370379 | orchestrator | Tuesday 28 April 2026 03:08:10 +0000 (0:00:02.756) 0:07:56.406 ********* 2026-04-28 03:08:24.370400 | orchestrator | included: /ansible/roles/ceph-osd/tasks/systemd.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:08:24.370410 | orchestrator | 2026-04-28 03:08:24.370419 | orchestrator | TASK [ceph-osd : Generate systemd unit file] *********************************** 2026-04-28 03:08:24.370429 | orchestrator | Tuesday 28 April 2026 03:08:11 +0000 (0:00:00.583) 0:07:56.989 ********* 2026-04-28 03:08:24.370438 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:08:24.370448 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:08:24.370457 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:08:24.370467 | orchestrator | 2026-04-28 03:08:24.370476 | orchestrator | TASK [ceph-osd : Generate systemd ceph-osd target file] ************************ 2026-04-28 03:08:24.370486 | orchestrator | Tuesday 28 April 2026 03:08:13 +0000 (0:00:01.584) 0:07:58.574 ********* 2026-04-28 03:08:24.370496 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:08:24.370505 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:08:24.370515 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:08:24.370524 | orchestrator | 2026-04-28 03:08:24.370534 | orchestrator | TASK [ceph-osd : Enable ceph-osd.target] *************************************** 2026-04-28 03:08:24.370555 | orchestrator | Tuesday 28 April 2026 03:08:14 +0000 (0:00:01.201) 0:07:59.775 ********* 2026-04-28 03:08:24.370565 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:08:24.370574 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:08:24.370584 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:08:24.370594 | orchestrator | 2026-04-28 03:08:24.370605 | orchestrator | TASK [ceph-osd : Ensure systemd service override directory exists] ************* 2026-04-28 03:08:24.370616 | orchestrator | Tuesday 28 April 2026 03:08:16 +0000 (0:00:01.781) 0:08:01.556 ********* 2026-04-28 03:08:24.370626 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:24.370637 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:08:24.370648 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:08:24.370658 | orchestrator | 2026-04-28 03:08:24.370669 | orchestrator | TASK [ceph-osd : Add ceph-osd systemd service overrides] *********************** 2026-04-28 03:08:24.370680 | orchestrator | Tuesday 28 April 2026 03:08:16 +0000 (0:00:00.673) 0:08:02.230 ********* 2026-04-28 03:08:24.370690 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:24.370701 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:08:24.370712 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:08:24.370722 | orchestrator | 2026-04-28 03:08:24.370733 | orchestrator | TASK [ceph-osd : Ensure /var/lib/ceph/osd/- is present] ********* 2026-04-28 03:08:24.370744 | orchestrator | Tuesday 28 April 2026 03:08:17 +0000 (0:00:00.374) 0:08:02.604 ********* 2026-04-28 03:08:24.370754 | orchestrator | ok: [testbed-node-3] => (item=3) 2026-04-28 03:08:24.370765 | orchestrator | ok: [testbed-node-4] => (item=1) 2026-04-28 03:08:24.370776 | orchestrator | ok: [testbed-node-5] => (item=5) 2026-04-28 03:08:24.370786 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-28 03:08:24.370797 | orchestrator | ok: [testbed-node-4] => (item=4) 2026-04-28 03:08:24.370808 | orchestrator | ok: [testbed-node-5] => (item=2) 2026-04-28 03:08:24.370818 | orchestrator | 2026-04-28 03:08:24.370838 | orchestrator | TASK [ceph-osd : Write run file in /var/lib/ceph/osd/xxxx/run] ***************** 2026-04-28 03:08:24.370849 | orchestrator | Tuesday 28 April 2026 03:08:18 +0000 (0:00:01.091) 0:08:03.696 ********* 2026-04-28 03:08:24.370859 | orchestrator | changed: [testbed-node-3] => (item=3) 2026-04-28 03:08:24.370870 | orchestrator | changed: [testbed-node-4] => (item=1) 2026-04-28 03:08:24.370881 | orchestrator | changed: [testbed-node-5] => (item=5) 2026-04-28 03:08:24.370892 | orchestrator | changed: [testbed-node-3] => (item=0) 2026-04-28 03:08:24.370922 | orchestrator | changed: [testbed-node-5] => (item=2) 2026-04-28 03:08:24.370933 | orchestrator | changed: [testbed-node-4] => (item=4) 2026-04-28 03:08:24.370944 | orchestrator | 2026-04-28 03:08:24.370955 | orchestrator | TASK [ceph-osd : Systemd start osd] ******************************************** 2026-04-28 03:08:24.370965 | orchestrator | Tuesday 28 April 2026 03:08:20 +0000 (0:00:02.158) 0:08:05.854 ********* 2026-04-28 03:08:24.370976 | orchestrator | changed: [testbed-node-3] => (item=3) 2026-04-28 03:08:24.370987 | orchestrator | changed: [testbed-node-4] => (item=1) 2026-04-28 03:08:24.370997 | orchestrator | changed: [testbed-node-5] => (item=5) 2026-04-28 03:08:24.371008 | orchestrator | changed: [testbed-node-3] => (item=0) 2026-04-28 03:08:24.371029 | orchestrator | changed: [testbed-node-4] => (item=4) 2026-04-28 03:08:57.537275 | orchestrator | changed: [testbed-node-5] => (item=2) 2026-04-28 03:08:57.537354 | orchestrator | 2026-04-28 03:08:57.537361 | orchestrator | TASK [ceph-osd : Unset noup flag] ********************************************** 2026-04-28 03:08:57.537367 | orchestrator | Tuesday 28 April 2026 03:08:24 +0000 (0:00:03.957) 0:08:09.812 ********* 2026-04-28 03:08:57.537372 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:57.537376 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:08:57.537381 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-28 03:08:57.537385 | orchestrator | 2026-04-28 03:08:57.537389 | orchestrator | TASK [ceph-osd : Wait for all osd to be up] ************************************ 2026-04-28 03:08:57.537393 | orchestrator | Tuesday 28 April 2026 03:08:27 +0000 (0:00:03.180) 0:08:12.992 ********* 2026-04-28 03:08:57.537415 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:57.537419 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:08:57.537423 | orchestrator | FAILED - RETRYING: [testbed-node-5 -> testbed-node-0]: Wait for all osd to be up (60 retries left). 2026-04-28 03:08:57.537428 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-28 03:08:57.537432 | orchestrator | 2026-04-28 03:08:57.537436 | orchestrator | TASK [ceph-osd : Include crush_rules.yml] ************************************** 2026-04-28 03:08:57.537440 | orchestrator | Tuesday 28 April 2026 03:08:39 +0000 (0:00:12.397) 0:08:25.390 ********* 2026-04-28 03:08:57.537444 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:57.537448 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:08:57.537451 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:08:57.537455 | orchestrator | 2026-04-28 03:08:57.537459 | orchestrator | RUNNING HANDLER [ceph-handler : Make tempdir for scripts] ********************** 2026-04-28 03:08:57.537463 | orchestrator | Tuesday 28 April 2026 03:08:41 +0000 (0:00:01.209) 0:08:26.599 ********* 2026-04-28 03:08:57.537467 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:57.537471 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:08:57.537475 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:08:57.537478 | orchestrator | 2026-04-28 03:08:57.537482 | orchestrator | RUNNING HANDLER [ceph-handler : Osds handler] ********************************** 2026-04-28 03:08:57.537486 | orchestrator | Tuesday 28 April 2026 03:08:41 +0000 (0:00:00.386) 0:08:26.986 ********* 2026-04-28 03:08:57.537490 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_osds.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:08:57.537494 | orchestrator | 2026-04-28 03:08:57.537498 | orchestrator | RUNNING HANDLER [ceph-handler : Set_fact trigger_restart] ********************** 2026-04-28 03:08:57.537502 | orchestrator | Tuesday 28 April 2026 03:08:42 +0000 (0:00:00.853) 0:08:27.840 ********* 2026-04-28 03:08:57.537505 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 03:08:57.537509 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 03:08:57.537513 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 03:08:57.537517 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:57.537521 | orchestrator | 2026-04-28 03:08:57.537524 | orchestrator | RUNNING HANDLER [ceph-handler : Set _osd_handler_called before restart] ******** 2026-04-28 03:08:57.537528 | orchestrator | Tuesday 28 April 2026 03:08:42 +0000 (0:00:00.468) 0:08:28.308 ********* 2026-04-28 03:08:57.537532 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:57.537535 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:08:57.537539 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:08:57.537543 | orchestrator | 2026-04-28 03:08:57.537547 | orchestrator | RUNNING HANDLER [ceph-handler : Unset noup flag] ******************************* 2026-04-28 03:08:57.537550 | orchestrator | Tuesday 28 April 2026 03:08:43 +0000 (0:00:00.379) 0:08:28.688 ********* 2026-04-28 03:08:57.537554 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:57.537558 | orchestrator | 2026-04-28 03:08:57.537562 | orchestrator | RUNNING HANDLER [ceph-handler : Copy osd restart script] *********************** 2026-04-28 03:08:57.537565 | orchestrator | Tuesday 28 April 2026 03:08:43 +0000 (0:00:00.253) 0:08:28.942 ********* 2026-04-28 03:08:57.537569 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:57.537573 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:08:57.537576 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:08:57.537580 | orchestrator | 2026-04-28 03:08:57.537584 | orchestrator | RUNNING HANDLER [ceph-handler : Get pool list] ********************************* 2026-04-28 03:08:57.537588 | orchestrator | Tuesday 28 April 2026 03:08:43 +0000 (0:00:00.349) 0:08:29.291 ********* 2026-04-28 03:08:57.537591 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:57.537595 | orchestrator | 2026-04-28 03:08:57.537599 | orchestrator | RUNNING HANDLER [ceph-handler : Get balancer module status] ******************** 2026-04-28 03:08:57.537602 | orchestrator | Tuesday 28 April 2026 03:08:44 +0000 (0:00:00.280) 0:08:29.571 ********* 2026-04-28 03:08:57.537611 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:57.537615 | orchestrator | 2026-04-28 03:08:57.537619 | orchestrator | RUNNING HANDLER [ceph-handler : Set_fact pools_pgautoscaler_mode] ************** 2026-04-28 03:08:57.537633 | orchestrator | Tuesday 28 April 2026 03:08:45 +0000 (0:00:00.900) 0:08:30.472 ********* 2026-04-28 03:08:57.537637 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:57.537641 | orchestrator | 2026-04-28 03:08:57.537644 | orchestrator | RUNNING HANDLER [ceph-handler : Disable balancer] ****************************** 2026-04-28 03:08:57.537648 | orchestrator | Tuesday 28 April 2026 03:08:45 +0000 (0:00:00.149) 0:08:30.621 ********* 2026-04-28 03:08:57.537652 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:57.537656 | orchestrator | 2026-04-28 03:08:57.537659 | orchestrator | RUNNING HANDLER [ceph-handler : Disable pg autoscale on pools] ***************** 2026-04-28 03:08:57.537663 | orchestrator | Tuesday 28 April 2026 03:08:45 +0000 (0:00:00.274) 0:08:30.896 ********* 2026-04-28 03:08:57.537667 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:57.537671 | orchestrator | 2026-04-28 03:08:57.537674 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph osds daemon(s)] ******************* 2026-04-28 03:08:57.537678 | orchestrator | Tuesday 28 April 2026 03:08:45 +0000 (0:00:00.241) 0:08:31.138 ********* 2026-04-28 03:08:57.537682 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 03:08:57.537686 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 03:08:57.537700 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 03:08:57.537704 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:57.537708 | orchestrator | 2026-04-28 03:08:57.537712 | orchestrator | RUNNING HANDLER [ceph-handler : Set _osd_handler_called after restart] ********* 2026-04-28 03:08:57.537716 | orchestrator | Tuesday 28 April 2026 03:08:46 +0000 (0:00:00.452) 0:08:31.590 ********* 2026-04-28 03:08:57.537720 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:57.537723 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:08:57.537727 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:08:57.537731 | orchestrator | 2026-04-28 03:08:57.537735 | orchestrator | RUNNING HANDLER [ceph-handler : Re-enable pg autoscale on pools] *************** 2026-04-28 03:08:57.537739 | orchestrator | Tuesday 28 April 2026 03:08:46 +0000 (0:00:00.355) 0:08:31.946 ********* 2026-04-28 03:08:57.537742 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:57.537746 | orchestrator | 2026-04-28 03:08:57.537750 | orchestrator | RUNNING HANDLER [ceph-handler : Re-enable balancer] **************************** 2026-04-28 03:08:57.537754 | orchestrator | Tuesday 28 April 2026 03:08:46 +0000 (0:00:00.247) 0:08:32.194 ********* 2026-04-28 03:08:57.537758 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:57.537761 | orchestrator | 2026-04-28 03:08:57.537765 | orchestrator | PLAY [Apply role ceph-crash] *************************************************** 2026-04-28 03:08:57.537769 | orchestrator | 2026-04-28 03:08:57.537773 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 03:08:57.537776 | orchestrator | Tuesday 28 April 2026 03:08:47 +0000 (0:00:01.074) 0:08:33.268 ********* 2026-04-28 03:08:57.537781 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:08:57.537786 | orchestrator | 2026-04-28 03:08:57.537790 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 03:08:57.537793 | orchestrator | Tuesday 28 April 2026 03:08:49 +0000 (0:00:01.430) 0:08:34.698 ********* 2026-04-28 03:08:57.537797 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:08:57.537801 | orchestrator | 2026-04-28 03:08:57.537805 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 03:08:57.537809 | orchestrator | Tuesday 28 April 2026 03:08:50 +0000 (0:00:01.404) 0:08:36.103 ********* 2026-04-28 03:08:57.537813 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:57.537816 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:08:57.537824 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:08:57.537828 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:08:57.537833 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:08:57.537838 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:08:57.537842 | orchestrator | 2026-04-28 03:08:57.537847 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 03:08:57.537851 | orchestrator | Tuesday 28 April 2026 03:08:51 +0000 (0:00:01.114) 0:08:37.218 ********* 2026-04-28 03:08:57.537856 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:08:57.537860 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:08:57.537864 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:08:57.537869 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:08:57.537913 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:08:57.537918 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:08:57.537922 | orchestrator | 2026-04-28 03:08:57.537927 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 03:08:57.537931 | orchestrator | Tuesday 28 April 2026 03:08:52 +0000 (0:00:01.069) 0:08:38.287 ********* 2026-04-28 03:08:57.537935 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:08:57.537940 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:08:57.537944 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:08:57.537948 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:08:57.537952 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:08:57.537957 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:08:57.537961 | orchestrator | 2026-04-28 03:08:57.537965 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 03:08:57.537970 | orchestrator | Tuesday 28 April 2026 03:08:53 +0000 (0:00:00.729) 0:08:39.017 ********* 2026-04-28 03:08:57.537974 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:08:57.537979 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:08:57.537983 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:08:57.537987 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:08:57.537992 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:08:57.537996 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:08:57.538000 | orchestrator | 2026-04-28 03:08:57.538005 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 03:08:57.538009 | orchestrator | Tuesday 28 April 2026 03:08:54 +0000 (0:00:01.080) 0:08:40.097 ********* 2026-04-28 03:08:57.538052 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:57.538057 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:08:57.538061 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:08:57.538069 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:08:57.538074 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:08:57.538078 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:08:57.538082 | orchestrator | 2026-04-28 03:08:57.538087 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 03:08:57.538091 | orchestrator | Tuesday 28 April 2026 03:08:55 +0000 (0:00:01.113) 0:08:41.211 ********* 2026-04-28 03:08:57.538096 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:57.538100 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:08:57.538104 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:08:57.538109 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:08:57.538113 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:08:57.538117 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:08:57.538122 | orchestrator | 2026-04-28 03:08:57.538126 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 03:08:57.538131 | orchestrator | Tuesday 28 April 2026 03:08:56 +0000 (0:00:01.098) 0:08:42.309 ********* 2026-04-28 03:08:57.538135 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:08:57.538140 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:08:57.538144 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:08:57.538148 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:08:57.538155 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:09:32.069778 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:09:32.069961 | orchestrator | 2026-04-28 03:09:32.069971 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 03:09:32.069978 | orchestrator | Tuesday 28 April 2026 03:08:57 +0000 (0:00:00.686) 0:08:42.995 ********* 2026-04-28 03:09:32.069982 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:09:32.069987 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:09:32.069991 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:09:32.069994 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:09:32.069998 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:09:32.070002 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:09:32.070006 | orchestrator | 2026-04-28 03:09:32.070010 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 03:09:32.070060 | orchestrator | Tuesday 28 April 2026 03:08:58 +0000 (0:00:01.432) 0:08:44.427 ********* 2026-04-28 03:09:32.070064 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:09:32.070068 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:09:32.070072 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:09:32.070075 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:09:32.070079 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:09:32.070083 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:09:32.070087 | orchestrator | 2026-04-28 03:09:32.070091 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 03:09:32.070095 | orchestrator | Tuesday 28 April 2026 03:09:00 +0000 (0:00:01.253) 0:08:45.681 ********* 2026-04-28 03:09:32.070099 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:09:32.070103 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:09:32.070107 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:09:32.070112 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:09:32.070116 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:09:32.070119 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:09:32.070123 | orchestrator | 2026-04-28 03:09:32.070127 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 03:09:32.070131 | orchestrator | Tuesday 28 April 2026 03:09:01 +0000 (0:00:00.948) 0:08:46.629 ********* 2026-04-28 03:09:32.070135 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:09:32.070138 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:09:32.070142 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:09:32.070146 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:09:32.070150 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:09:32.070153 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:09:32.070157 | orchestrator | 2026-04-28 03:09:32.070161 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 03:09:32.070165 | orchestrator | Tuesday 28 April 2026 03:09:01 +0000 (0:00:00.666) 0:08:47.296 ********* 2026-04-28 03:09:32.070169 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:09:32.070173 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:09:32.070176 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:09:32.070180 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:09:32.070184 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:09:32.070187 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:09:32.070191 | orchestrator | 2026-04-28 03:09:32.070195 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 03:09:32.070199 | orchestrator | Tuesday 28 April 2026 03:09:02 +0000 (0:00:01.015) 0:08:48.312 ********* 2026-04-28 03:09:32.070202 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:09:32.070206 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:09:32.070210 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:09:32.070214 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:09:32.070217 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:09:32.070221 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:09:32.070225 | orchestrator | 2026-04-28 03:09:32.070229 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 03:09:32.070233 | orchestrator | Tuesday 28 April 2026 03:09:03 +0000 (0:00:00.949) 0:08:49.261 ********* 2026-04-28 03:09:32.070236 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:09:32.070246 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:09:32.070250 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:09:32.070254 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:09:32.070257 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:09:32.070261 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:09:32.070265 | orchestrator | 2026-04-28 03:09:32.070269 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 03:09:32.070272 | orchestrator | Tuesday 28 April 2026 03:09:04 +0000 (0:00:00.765) 0:08:50.026 ********* 2026-04-28 03:09:32.070276 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:09:32.070280 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:09:32.070284 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:09:32.070287 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:09:32.070291 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:09:32.070295 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:09:32.070298 | orchestrator | 2026-04-28 03:09:32.070302 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 03:09:32.070306 | orchestrator | Tuesday 28 April 2026 03:09:05 +0000 (0:00:00.950) 0:08:50.977 ********* 2026-04-28 03:09:32.070310 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:09:32.070314 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:09:32.070332 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:09:32.070336 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:09:32.070340 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:09:32.070344 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:09:32.070348 | orchestrator | 2026-04-28 03:09:32.070351 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 03:09:32.070355 | orchestrator | Tuesday 28 April 2026 03:09:06 +0000 (0:00:00.753) 0:08:51.730 ********* 2026-04-28 03:09:32.070359 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:09:32.070363 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:09:32.070366 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:09:32.070370 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:09:32.070374 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:09:32.070378 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:09:32.070382 | orchestrator | 2026-04-28 03:09:32.070385 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 03:09:32.070389 | orchestrator | Tuesday 28 April 2026 03:09:07 +0000 (0:00:00.988) 0:08:52.718 ********* 2026-04-28 03:09:32.070393 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:09:32.070397 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:09:32.070400 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:09:32.070404 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:09:32.070423 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:09:32.070427 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:09:32.070431 | orchestrator | 2026-04-28 03:09:32.070434 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 03:09:32.070438 | orchestrator | Tuesday 28 April 2026 03:09:07 +0000 (0:00:00.717) 0:08:53.436 ********* 2026-04-28 03:09:32.070442 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:09:32.070446 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:09:32.070449 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:09:32.070453 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:09:32.070457 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:09:32.070461 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:09:32.070464 | orchestrator | 2026-04-28 03:09:32.070468 | orchestrator | TASK [ceph-crash : Create client.crash keyring] ******************************** 2026-04-28 03:09:32.070472 | orchestrator | Tuesday 28 April 2026 03:09:09 +0000 (0:00:01.441) 0:08:54.878 ********* 2026-04-28 03:09:32.070476 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-28 03:09:32.070480 | orchestrator | 2026-04-28 03:09:32.070484 | orchestrator | TASK [ceph-crash : Get keys from monitors] ************************************* 2026-04-28 03:09:32.070488 | orchestrator | Tuesday 28 April 2026 03:09:13 +0000 (0:00:04.194) 0:08:59.073 ********* 2026-04-28 03:09:32.070501 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-28 03:09:32.070508 | orchestrator | 2026-04-28 03:09:32.070514 | orchestrator | TASK [ceph-crash : Copy ceph key(s) if needed] ********************************* 2026-04-28 03:09:32.070519 | orchestrator | Tuesday 28 April 2026 03:09:15 +0000 (0:00:02.034) 0:09:01.107 ********* 2026-04-28 03:09:32.070525 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:09:32.070531 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:09:32.070536 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:09:32.070542 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:09:32.070549 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:09:32.070555 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:09:32.070561 | orchestrator | 2026-04-28 03:09:32.070568 | orchestrator | TASK [ceph-crash : Create /var/lib/ceph/crash/posted] ************************** 2026-04-28 03:09:32.070574 | orchestrator | Tuesday 28 April 2026 03:09:17 +0000 (0:00:01.976) 0:09:03.084 ********* 2026-04-28 03:09:32.070578 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:09:32.070582 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:09:32.070585 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:09:32.070589 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:09:32.070593 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:09:32.070597 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:09:32.070600 | orchestrator | 2026-04-28 03:09:32.070604 | orchestrator | TASK [ceph-crash : Include_tasks systemd.yml] ********************************** 2026-04-28 03:09:32.070608 | orchestrator | Tuesday 28 April 2026 03:09:18 +0000 (0:00:01.088) 0:09:04.172 ********* 2026-04-28 03:09:32.070613 | orchestrator | included: /ansible/roles/ceph-crash/tasks/systemd.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:09:32.070619 | orchestrator | 2026-04-28 03:09:32.070623 | orchestrator | TASK [ceph-crash : Generate systemd unit file for ceph-crash container] ******** 2026-04-28 03:09:32.070627 | orchestrator | Tuesday 28 April 2026 03:09:20 +0000 (0:00:01.449) 0:09:05.622 ********* 2026-04-28 03:09:32.070631 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:09:32.070634 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:09:32.070638 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:09:32.070642 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:09:32.070646 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:09:32.070649 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:09:32.070653 | orchestrator | 2026-04-28 03:09:32.070657 | orchestrator | TASK [ceph-crash : Start the ceph-crash service] ******************************* 2026-04-28 03:09:32.070661 | orchestrator | Tuesday 28 April 2026 03:09:22 +0000 (0:00:02.023) 0:09:07.645 ********* 2026-04-28 03:09:32.070665 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:09:32.070668 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:09:32.070672 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:09:32.070676 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:09:32.070680 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:09:32.070683 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:09:32.070687 | orchestrator | 2026-04-28 03:09:32.070691 | orchestrator | RUNNING HANDLER [ceph-handler : Ceph crash handler] **************************** 2026-04-28 03:09:32.070695 | orchestrator | Tuesday 28 April 2026 03:09:25 +0000 (0:00:03.672) 0:09:11.318 ********* 2026-04-28 03:09:32.070699 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_crash.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:09:32.070703 | orchestrator | 2026-04-28 03:09:32.070706 | orchestrator | RUNNING HANDLER [ceph-handler : Set _crash_handler_called before restart] ****** 2026-04-28 03:09:32.070710 | orchestrator | Tuesday 28 April 2026 03:09:27 +0000 (0:00:01.607) 0:09:12.925 ********* 2026-04-28 03:09:32.070714 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:09:32.070718 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:09:32.070722 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:09:32.070726 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:09:32.070735 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:09:32.070739 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:09:32.070743 | orchestrator | 2026-04-28 03:09:32.070747 | orchestrator | RUNNING HANDLER [ceph-handler : Restart the ceph-crash service] **************** 2026-04-28 03:09:32.070750 | orchestrator | Tuesday 28 April 2026 03:09:28 +0000 (0:00:01.013) 0:09:13.939 ********* 2026-04-28 03:09:32.070754 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:09:32.070758 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:09:32.070762 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:09:32.070766 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:09:32.070770 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:09:32.070773 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:09:32.070777 | orchestrator | 2026-04-28 03:09:32.070781 | orchestrator | RUNNING HANDLER [ceph-handler : Set _crash_handler_called after restart] ******* 2026-04-28 03:09:32.070785 | orchestrator | Tuesday 28 April 2026 03:09:31 +0000 (0:00:02.589) 0:09:16.528 ********* 2026-04-28 03:09:32.070788 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:09:32.070792 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:09:32.070796 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:09:32.070800 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:09:32.070807 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:10:01.437045 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:10:01.437241 | orchestrator | 2026-04-28 03:10:01.437284 | orchestrator | PLAY [Apply role ceph-mds] ***************************************************** 2026-04-28 03:10:01.437348 | orchestrator | 2026-04-28 03:10:01.437361 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 03:10:01.437372 | orchestrator | Tuesday 28 April 2026 03:09:32 +0000 (0:00:00.996) 0:09:17.524 ********* 2026-04-28 03:10:01.437384 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:10:01.437397 | orchestrator | 2026-04-28 03:10:01.437407 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 03:10:01.437417 | orchestrator | Tuesday 28 April 2026 03:09:32 +0000 (0:00:00.845) 0:09:18.370 ********* 2026-04-28 03:10:01.437428 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:10:01.437437 | orchestrator | 2026-04-28 03:10:01.437451 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 03:10:01.437469 | orchestrator | Tuesday 28 April 2026 03:09:33 +0000 (0:00:00.595) 0:09:18.965 ********* 2026-04-28 03:10:01.437487 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:01.437505 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:10:01.437522 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:10:01.437540 | orchestrator | 2026-04-28 03:10:01.437556 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 03:10:01.437574 | orchestrator | Tuesday 28 April 2026 03:09:34 +0000 (0:00:00.633) 0:09:19.599 ********* 2026-04-28 03:10:01.437587 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:01.437600 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:01.437610 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:01.437622 | orchestrator | 2026-04-28 03:10:01.437633 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 03:10:01.437644 | orchestrator | Tuesday 28 April 2026 03:09:34 +0000 (0:00:00.760) 0:09:20.359 ********* 2026-04-28 03:10:01.437655 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:01.437667 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:01.437678 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:01.437689 | orchestrator | 2026-04-28 03:10:01.437701 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 03:10:01.437712 | orchestrator | Tuesday 28 April 2026 03:09:35 +0000 (0:00:00.846) 0:09:21.206 ********* 2026-04-28 03:10:01.437723 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:01.437734 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:01.437756 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:01.437800 | orchestrator | 2026-04-28 03:10:01.437811 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 03:10:01.437823 | orchestrator | Tuesday 28 April 2026 03:09:36 +0000 (0:00:00.745) 0:09:21.951 ********* 2026-04-28 03:10:01.437834 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:01.437877 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:10:01.437887 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:10:01.437898 | orchestrator | 2026-04-28 03:10:01.437915 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 03:10:01.437932 | orchestrator | Tuesday 28 April 2026 03:09:37 +0000 (0:00:00.707) 0:09:22.658 ********* 2026-04-28 03:10:01.437949 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:01.437967 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:10:01.437984 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:10:01.438000 | orchestrator | 2026-04-28 03:10:01.438157 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 03:10:01.438184 | orchestrator | Tuesday 28 April 2026 03:09:37 +0000 (0:00:00.365) 0:09:23.024 ********* 2026-04-28 03:10:01.438201 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:01.438217 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:10:01.438233 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:10:01.438249 | orchestrator | 2026-04-28 03:10:01.438265 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 03:10:01.438281 | orchestrator | Tuesday 28 April 2026 03:09:37 +0000 (0:00:00.344) 0:09:23.368 ********* 2026-04-28 03:10:01.438298 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:01.438315 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:01.438331 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:01.438348 | orchestrator | 2026-04-28 03:10:01.438364 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 03:10:01.438380 | orchestrator | Tuesday 28 April 2026 03:09:38 +0000 (0:00:00.799) 0:09:24.168 ********* 2026-04-28 03:10:01.438390 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:01.438400 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:01.438410 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:01.438419 | orchestrator | 2026-04-28 03:10:01.438429 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 03:10:01.438449 | orchestrator | Tuesday 28 April 2026 03:09:39 +0000 (0:00:01.170) 0:09:25.339 ********* 2026-04-28 03:10:01.438459 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:01.438469 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:10:01.438478 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:10:01.438488 | orchestrator | 2026-04-28 03:10:01.438498 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 03:10:01.438507 | orchestrator | Tuesday 28 April 2026 03:09:40 +0000 (0:00:00.392) 0:09:25.731 ********* 2026-04-28 03:10:01.438518 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:01.438535 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:10:01.438551 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:10:01.438568 | orchestrator | 2026-04-28 03:10:01.438583 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 03:10:01.438600 | orchestrator | Tuesday 28 April 2026 03:09:40 +0000 (0:00:00.361) 0:09:26.092 ********* 2026-04-28 03:10:01.438610 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:01.438620 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:01.438630 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:01.438646 | orchestrator | 2026-04-28 03:10:01.438660 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 03:10:01.438677 | orchestrator | Tuesday 28 April 2026 03:09:41 +0000 (0:00:00.391) 0:09:26.483 ********* 2026-04-28 03:10:01.438731 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:01.438749 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:01.438764 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:01.438781 | orchestrator | 2026-04-28 03:10:01.438796 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 03:10:01.438830 | orchestrator | Tuesday 28 April 2026 03:09:41 +0000 (0:00:00.677) 0:09:27.161 ********* 2026-04-28 03:10:01.438905 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:01.438916 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:01.438926 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:01.438935 | orchestrator | 2026-04-28 03:10:01.438945 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 03:10:01.438955 | orchestrator | Tuesday 28 April 2026 03:09:42 +0000 (0:00:00.393) 0:09:27.555 ********* 2026-04-28 03:10:01.438964 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:01.438974 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:10:01.438984 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:10:01.438993 | orchestrator | 2026-04-28 03:10:01.439003 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 03:10:01.439012 | orchestrator | Tuesday 28 April 2026 03:09:42 +0000 (0:00:00.332) 0:09:27.888 ********* 2026-04-28 03:10:01.439022 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:01.439031 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:10:01.439041 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:10:01.439050 | orchestrator | 2026-04-28 03:10:01.439060 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 03:10:01.439070 | orchestrator | Tuesday 28 April 2026 03:09:42 +0000 (0:00:00.337) 0:09:28.225 ********* 2026-04-28 03:10:01.439079 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:01.439089 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:10:01.439098 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:10:01.439108 | orchestrator | 2026-04-28 03:10:01.439118 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 03:10:01.439127 | orchestrator | Tuesday 28 April 2026 03:09:43 +0000 (0:00:00.679) 0:09:28.905 ********* 2026-04-28 03:10:01.439137 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:01.439147 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:01.439156 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:01.439165 | orchestrator | 2026-04-28 03:10:01.439175 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 03:10:01.439185 | orchestrator | Tuesday 28 April 2026 03:09:43 +0000 (0:00:00.383) 0:09:29.288 ********* 2026-04-28 03:10:01.439194 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:01.439204 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:01.439214 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:01.439223 | orchestrator | 2026-04-28 03:10:01.439233 | orchestrator | TASK [ceph-mds : Include create_mds_filesystems.yml] *************************** 2026-04-28 03:10:01.439243 | orchestrator | Tuesday 28 April 2026 03:09:44 +0000 (0:00:00.900) 0:09:30.189 ********* 2026-04-28 03:10:01.439253 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:10:01.439262 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:10:01.439272 | orchestrator | included: /ansible/roles/ceph-mds/tasks/create_mds_filesystems.yml for testbed-node-3 2026-04-28 03:10:01.439283 | orchestrator | 2026-04-28 03:10:01.439293 | orchestrator | TASK [ceph-facts : Get current default crush rule details] ********************* 2026-04-28 03:10:01.439303 | orchestrator | Tuesday 28 April 2026 03:09:45 +0000 (0:00:00.478) 0:09:30.667 ********* 2026-04-28 03:10:01.439312 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-28 03:10:01.439322 | orchestrator | 2026-04-28 03:10:01.439332 | orchestrator | TASK [ceph-facts : Get current default crush rule name] ************************ 2026-04-28 03:10:01.439341 | orchestrator | Tuesday 28 April 2026 03:09:47 +0000 (0:00:02.142) 0:09:32.809 ********* 2026-04-28 03:10:01.439354 | orchestrator | skipping: [testbed-node-3] => (item={'rule_id': 0, 'rule_name': 'replicated_rule', 'type': 1, 'steps': [{'op': 'take', 'item': -1, 'item_name': 'default'}, {'op': 'chooseleaf_firstn', 'num': 0, 'type': 'host'}, {'op': 'emit'}]})  2026-04-28 03:10:01.439367 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:01.439377 | orchestrator | 2026-04-28 03:10:01.439387 | orchestrator | TASK [ceph-mds : Create filesystem pools] ************************************** 2026-04-28 03:10:01.439406 | orchestrator | Tuesday 28 April 2026 03:09:47 +0000 (0:00:00.240) 0:09:33.050 ********* 2026-04-28 03:10:01.439419 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'application': 'cephfs', 'erasure_profile': '', 'expected_num_objects': '', 'min_size': 0, 'name': 'cephfs_data', 'pg_num': 16, 'pgp_num': 16, 'rule_name': 'replicated_rule', 'size': 3, 'type': 1}) 2026-04-28 03:10:01.439446 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'application': 'cephfs', 'erasure_profile': '', 'expected_num_objects': '', 'min_size': 0, 'name': 'cephfs_metadata', 'pg_num': 16, 'pgp_num': 16, 'rule_name': 'replicated_rule', 'size': 3, 'type': 1}) 2026-04-28 03:10:01.439456 | orchestrator | 2026-04-28 03:10:01.439466 | orchestrator | TASK [ceph-mds : Create ceph filesystem] *************************************** 2026-04-28 03:10:01.439476 | orchestrator | Tuesday 28 April 2026 03:09:55 +0000 (0:00:08.175) 0:09:41.226 ********* 2026-04-28 03:10:01.439486 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-28 03:10:01.439495 | orchestrator | 2026-04-28 03:10:01.439505 | orchestrator | TASK [ceph-mds : Include common.yml] ******************************************* 2026-04-28 03:10:01.439515 | orchestrator | Tuesday 28 April 2026 03:09:59 +0000 (0:00:03.575) 0:09:44.801 ********* 2026-04-28 03:10:01.439524 | orchestrator | included: /ansible/roles/ceph-mds/tasks/common.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:10:01.439534 | orchestrator | 2026-04-28 03:10:01.439544 | orchestrator | TASK [ceph-mds : Create bootstrap-mds and mds directories] ********************* 2026-04-28 03:10:01.439553 | orchestrator | Tuesday 28 April 2026 03:10:00 +0000 (0:00:00.957) 0:09:45.759 ********* 2026-04-28 03:10:01.439573 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mds/) 2026-04-28 03:10:29.650008 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mds/) 2026-04-28 03:10:29.650201 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mds/) 2026-04-28 03:10:29.650212 | orchestrator | changed: [testbed-node-3] => (item=/var/lib/ceph/mds/ceph-testbed-node-3) 2026-04-28 03:10:29.650221 | orchestrator | changed: [testbed-node-4] => (item=/var/lib/ceph/mds/ceph-testbed-node-4) 2026-04-28 03:10:29.650229 | orchestrator | changed: [testbed-node-5] => (item=/var/lib/ceph/mds/ceph-testbed-node-5) 2026-04-28 03:10:29.650236 | orchestrator | 2026-04-28 03:10:29.650244 | orchestrator | TASK [ceph-mds : Get keys from monitors] *************************************** 2026-04-28 03:10:29.650251 | orchestrator | Tuesday 28 April 2026 03:10:01 +0000 (0:00:01.132) 0:09:46.892 ********* 2026-04-28 03:10:29.650258 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:10:29.650265 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-28 03:10:29.650272 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-28 03:10:29.650278 | orchestrator | 2026-04-28 03:10:29.650285 | orchestrator | TASK [ceph-mds : Copy ceph key(s) if needed] *********************************** 2026-04-28 03:10:29.650291 | orchestrator | Tuesday 28 April 2026 03:10:03 +0000 (0:00:02.209) 0:09:49.102 ********* 2026-04-28 03:10:29.650298 | orchestrator | changed: [testbed-node-3] => (item=None) 2026-04-28 03:10:29.650305 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-28 03:10:29.650312 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:10:29.650319 | orchestrator | changed: [testbed-node-4] => (item=None) 2026-04-28 03:10:29.650326 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-28 03:10:29.650332 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:10:29.650339 | orchestrator | changed: [testbed-node-5] => (item=None) 2026-04-28 03:10:29.650346 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-28 03:10:29.650352 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:10:29.650359 | orchestrator | 2026-04-28 03:10:29.650365 | orchestrator | TASK [ceph-mds : Create mds keyring] ******************************************* 2026-04-28 03:10:29.650372 | orchestrator | Tuesday 28 April 2026 03:10:04 +0000 (0:00:01.187) 0:09:50.290 ********* 2026-04-28 03:10:29.650398 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:10:29.650405 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:10:29.650412 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:10:29.650418 | orchestrator | 2026-04-28 03:10:29.650425 | orchestrator | TASK [ceph-mds : Non_containerized.yml] **************************************** 2026-04-28 03:10:29.650432 | orchestrator | Tuesday 28 April 2026 03:10:08 +0000 (0:00:03.210) 0:09:53.500 ********* 2026-04-28 03:10:29.650438 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:29.650444 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:10:29.650451 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:10:29.650457 | orchestrator | 2026-04-28 03:10:29.650464 | orchestrator | TASK [ceph-mds : Containerized.yml] ******************************************** 2026-04-28 03:10:29.650470 | orchestrator | Tuesday 28 April 2026 03:10:08 +0000 (0:00:00.394) 0:09:53.895 ********* 2026-04-28 03:10:29.650477 | orchestrator | included: /ansible/roles/ceph-mds/tasks/containerized.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:10:29.650483 | orchestrator | 2026-04-28 03:10:29.650490 | orchestrator | TASK [ceph-mds : Include_tasks systemd.yml] ************************************ 2026-04-28 03:10:29.650496 | orchestrator | Tuesday 28 April 2026 03:10:09 +0000 (0:00:00.661) 0:09:54.556 ********* 2026-04-28 03:10:29.650503 | orchestrator | included: /ansible/roles/ceph-mds/tasks/systemd.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:10:29.650511 | orchestrator | 2026-04-28 03:10:29.650517 | orchestrator | TASK [ceph-mds : Generate systemd unit file] *********************************** 2026-04-28 03:10:29.650524 | orchestrator | Tuesday 28 April 2026 03:10:09 +0000 (0:00:00.899) 0:09:55.456 ********* 2026-04-28 03:10:29.650530 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:10:29.650537 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:10:29.650543 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:10:29.650550 | orchestrator | 2026-04-28 03:10:29.650557 | orchestrator | TASK [ceph-mds : Generate systemd ceph-mds target file] ************************ 2026-04-28 03:10:29.650564 | orchestrator | Tuesday 28 April 2026 03:10:11 +0000 (0:00:01.307) 0:09:56.763 ********* 2026-04-28 03:10:29.650570 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:10:29.650577 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:10:29.650584 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:10:29.650591 | orchestrator | 2026-04-28 03:10:29.650597 | orchestrator | TASK [ceph-mds : Enable ceph-mds.target] *************************************** 2026-04-28 03:10:29.650604 | orchestrator | Tuesday 28 April 2026 03:10:12 +0000 (0:00:01.492) 0:09:58.255 ********* 2026-04-28 03:10:29.650623 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:10:29.650630 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:10:29.650637 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:10:29.650644 | orchestrator | 2026-04-28 03:10:29.650650 | orchestrator | TASK [ceph-mds : Systemd start mds container] ********************************** 2026-04-28 03:10:29.650657 | orchestrator | Tuesday 28 April 2026 03:10:14 +0000 (0:00:01.898) 0:10:00.154 ********* 2026-04-28 03:10:29.650664 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:10:29.650671 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:10:29.650678 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:10:29.650685 | orchestrator | 2026-04-28 03:10:29.650691 | orchestrator | TASK [ceph-mds : Wait for mds socket to exist] ********************************* 2026-04-28 03:10:29.650698 | orchestrator | Tuesday 28 April 2026 03:10:16 +0000 (0:00:02.018) 0:10:02.172 ********* 2026-04-28 03:10:29.650705 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:29.650712 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:29.650718 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:29.650725 | orchestrator | 2026-04-28 03:10:29.650732 | orchestrator | RUNNING HANDLER [ceph-handler : Make tempdir for scripts] ********************** 2026-04-28 03:10:29.650739 | orchestrator | Tuesday 28 April 2026 03:10:18 +0000 (0:00:01.653) 0:10:03.826 ********* 2026-04-28 03:10:29.650745 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:10:29.650752 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:10:29.650775 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:10:29.650789 | orchestrator | 2026-04-28 03:10:29.650796 | orchestrator | RUNNING HANDLER [ceph-handler : Mdss handler] ********************************** 2026-04-28 03:10:29.650803 | orchestrator | Tuesday 28 April 2026 03:10:19 +0000 (0:00:00.770) 0:10:04.597 ********* 2026-04-28 03:10:29.650810 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_mdss.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:10:29.650817 | orchestrator | 2026-04-28 03:10:29.650844 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mds_handler_called before restart] ******** 2026-04-28 03:10:29.650852 | orchestrator | Tuesday 28 April 2026 03:10:20 +0000 (0:00:00.883) 0:10:05.480 ********* 2026-04-28 03:10:29.650859 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:29.650866 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:29.650873 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:29.650880 | orchestrator | 2026-04-28 03:10:29.650888 | orchestrator | RUNNING HANDLER [ceph-handler : Copy mds restart script] *********************** 2026-04-28 03:10:29.650894 | orchestrator | Tuesday 28 April 2026 03:10:20 +0000 (0:00:00.464) 0:10:05.945 ********* 2026-04-28 03:10:29.650901 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:10:29.650908 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:10:29.650915 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:10:29.650921 | orchestrator | 2026-04-28 03:10:29.650929 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph mds daemon(s)] ******************** 2026-04-28 03:10:29.650935 | orchestrator | Tuesday 28 April 2026 03:10:21 +0000 (0:00:01.264) 0:10:07.209 ********* 2026-04-28 03:10:29.650942 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 03:10:29.650948 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 03:10:29.650956 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 03:10:29.650962 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:29.650969 | orchestrator | 2026-04-28 03:10:29.650976 | orchestrator | RUNNING HANDLER [ceph-handler : Set _mds_handler_called after restart] ********* 2026-04-28 03:10:29.650983 | orchestrator | Tuesday 28 April 2026 03:10:22 +0000 (0:00:01.029) 0:10:08.239 ********* 2026-04-28 03:10:29.650989 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:29.650996 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:29.651003 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:29.651009 | orchestrator | 2026-04-28 03:10:29.651016 | orchestrator | PLAY [Apply role ceph-rgw] ***************************************************** 2026-04-28 03:10:29.651023 | orchestrator | 2026-04-28 03:10:29.651029 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 03:10:29.651036 | orchestrator | Tuesday 28 April 2026 03:10:23 +0000 (0:00:00.986) 0:10:09.226 ********* 2026-04-28 03:10:29.651044 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:10:29.651052 | orchestrator | 2026-04-28 03:10:29.651059 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 03:10:29.651066 | orchestrator | Tuesday 28 April 2026 03:10:24 +0000 (0:00:00.617) 0:10:09.843 ********* 2026-04-28 03:10:29.651072 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:10:29.651079 | orchestrator | 2026-04-28 03:10:29.651086 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 03:10:29.651093 | orchestrator | Tuesday 28 April 2026 03:10:25 +0000 (0:00:00.912) 0:10:10.756 ********* 2026-04-28 03:10:29.651100 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:29.651107 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:10:29.651113 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:10:29.651121 | orchestrator | 2026-04-28 03:10:29.651127 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 03:10:29.651134 | orchestrator | Tuesday 28 April 2026 03:10:25 +0000 (0:00:00.346) 0:10:11.103 ********* 2026-04-28 03:10:29.651140 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:29.651153 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:29.651160 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:29.651166 | orchestrator | 2026-04-28 03:10:29.651173 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 03:10:29.651180 | orchestrator | Tuesday 28 April 2026 03:10:26 +0000 (0:00:00.755) 0:10:11.858 ********* 2026-04-28 03:10:29.651186 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:29.651193 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:29.651199 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:29.651207 | orchestrator | 2026-04-28 03:10:29.651213 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 03:10:29.651220 | orchestrator | Tuesday 28 April 2026 03:10:27 +0000 (0:00:01.044) 0:10:12.903 ********* 2026-04-28 03:10:29.651227 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:29.651234 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:29.651244 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:29.651251 | orchestrator | 2026-04-28 03:10:29.651258 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 03:10:29.651265 | orchestrator | Tuesday 28 April 2026 03:10:28 +0000 (0:00:00.792) 0:10:13.696 ********* 2026-04-28 03:10:29.651271 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:29.651278 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:10:29.651285 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:10:29.651293 | orchestrator | 2026-04-28 03:10:29.651299 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 03:10:29.651306 | orchestrator | Tuesday 28 April 2026 03:10:28 +0000 (0:00:00.359) 0:10:14.055 ********* 2026-04-28 03:10:29.651331 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:29.651338 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:10:29.651344 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:10:29.651351 | orchestrator | 2026-04-28 03:10:29.651357 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 03:10:29.651364 | orchestrator | Tuesday 28 April 2026 03:10:28 +0000 (0:00:00.389) 0:10:14.445 ********* 2026-04-28 03:10:29.651371 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:29.651377 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:10:29.651384 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:10:29.651390 | orchestrator | 2026-04-28 03:10:29.651401 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 03:10:52.114974 | orchestrator | Tuesday 28 April 2026 03:10:29 +0000 (0:00:00.657) 0:10:15.103 ********* 2026-04-28 03:10:52.115082 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:52.115103 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:52.115117 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:52.115131 | orchestrator | 2026-04-28 03:10:52.115145 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 03:10:52.115160 | orchestrator | Tuesday 28 April 2026 03:10:30 +0000 (0:00:00.753) 0:10:15.856 ********* 2026-04-28 03:10:52.115173 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:52.115187 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:52.115200 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:52.115212 | orchestrator | 2026-04-28 03:10:52.115220 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 03:10:52.115227 | orchestrator | Tuesday 28 April 2026 03:10:31 +0000 (0:00:00.788) 0:10:16.645 ********* 2026-04-28 03:10:52.115235 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:52.115243 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:10:52.115251 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:10:52.115258 | orchestrator | 2026-04-28 03:10:52.115265 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 03:10:52.115273 | orchestrator | Tuesday 28 April 2026 03:10:31 +0000 (0:00:00.360) 0:10:17.005 ********* 2026-04-28 03:10:52.115280 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:52.115287 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:10:52.115294 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:10:52.115327 | orchestrator | 2026-04-28 03:10:52.115336 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 03:10:52.115344 | orchestrator | Tuesday 28 April 2026 03:10:32 +0000 (0:00:00.720) 0:10:17.726 ********* 2026-04-28 03:10:52.115351 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:52.115358 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:52.115365 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:52.115372 | orchestrator | 2026-04-28 03:10:52.115380 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 03:10:52.115387 | orchestrator | Tuesday 28 April 2026 03:10:32 +0000 (0:00:00.400) 0:10:18.126 ********* 2026-04-28 03:10:52.115395 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:52.115402 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:52.115409 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:52.115416 | orchestrator | 2026-04-28 03:10:52.115423 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 03:10:52.115430 | orchestrator | Tuesday 28 April 2026 03:10:33 +0000 (0:00:00.395) 0:10:18.522 ********* 2026-04-28 03:10:52.115438 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:52.115445 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:52.115452 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:52.115459 | orchestrator | 2026-04-28 03:10:52.115466 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 03:10:52.115473 | orchestrator | Tuesday 28 April 2026 03:10:33 +0000 (0:00:00.374) 0:10:18.896 ********* 2026-04-28 03:10:52.115480 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:52.115487 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:10:52.115494 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:10:52.115502 | orchestrator | 2026-04-28 03:10:52.115509 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 03:10:52.115518 | orchestrator | Tuesday 28 April 2026 03:10:34 +0000 (0:00:00.676) 0:10:19.572 ********* 2026-04-28 03:10:52.115526 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:52.115534 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:10:52.115542 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:10:52.115550 | orchestrator | 2026-04-28 03:10:52.115558 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 03:10:52.115566 | orchestrator | Tuesday 28 April 2026 03:10:34 +0000 (0:00:00.355) 0:10:19.927 ********* 2026-04-28 03:10:52.115577 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:52.115589 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:10:52.115601 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:10:52.115613 | orchestrator | 2026-04-28 03:10:52.115624 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 03:10:52.115635 | orchestrator | Tuesday 28 April 2026 03:10:34 +0000 (0:00:00.358) 0:10:20.286 ********* 2026-04-28 03:10:52.115647 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:52.115659 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:52.115670 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:52.115681 | orchestrator | 2026-04-28 03:10:52.115692 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 03:10:52.115705 | orchestrator | Tuesday 28 April 2026 03:10:35 +0000 (0:00:00.361) 0:10:20.648 ********* 2026-04-28 03:10:52.115716 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:10:52.115727 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:10:52.115738 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:10:52.115750 | orchestrator | 2026-04-28 03:10:52.115779 | orchestrator | TASK [ceph-rgw : Include common.yml] ******************************************* 2026-04-28 03:10:52.115793 | orchestrator | Tuesday 28 April 2026 03:10:36 +0000 (0:00:00.981) 0:10:21.629 ********* 2026-04-28 03:10:52.115805 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/common.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:10:52.115889 | orchestrator | 2026-04-28 03:10:52.115898 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-28 03:10:52.115905 | orchestrator | Tuesday 28 April 2026 03:10:37 +0000 (0:00:00.888) 0:10:22.518 ********* 2026-04-28 03:10:52.115938 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:10:52.115946 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-28 03:10:52.115954 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-28 03:10:52.115969 | orchestrator | 2026-04-28 03:10:52.115977 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-28 03:10:52.115984 | orchestrator | Tuesday 28 April 2026 03:10:39 +0000 (0:00:02.238) 0:10:24.757 ********* 2026-04-28 03:10:52.115991 | orchestrator | changed: [testbed-node-3] => (item=None) 2026-04-28 03:10:52.115999 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-28 03:10:52.116007 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:10:52.116032 | orchestrator | changed: [testbed-node-4] => (item=None) 2026-04-28 03:10:52.116040 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-28 03:10:52.116047 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:10:52.116054 | orchestrator | changed: [testbed-node-5] => (item=None) 2026-04-28 03:10:52.116061 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-28 03:10:52.116069 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:10:52.116076 | orchestrator | 2026-04-28 03:10:52.116083 | orchestrator | TASK [ceph-rgw : Copy SSL certificate & key data to certificate path] ********** 2026-04-28 03:10:52.116091 | orchestrator | Tuesday 28 April 2026 03:10:40 +0000 (0:00:01.262) 0:10:26.019 ********* 2026-04-28 03:10:52.116098 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:10:52.116107 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:10:52.116119 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:10:52.116131 | orchestrator | 2026-04-28 03:10:52.116143 | orchestrator | TASK [ceph-rgw : Include_tasks pre_requisite.yml] ****************************** 2026-04-28 03:10:52.116154 | orchestrator | Tuesday 28 April 2026 03:10:40 +0000 (0:00:00.399) 0:10:26.419 ********* 2026-04-28 03:10:52.116166 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/pre_requisite.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:10:52.116178 | orchestrator | 2026-04-28 03:10:52.116189 | orchestrator | TASK [ceph-rgw : Create rados gateway directories] ***************************** 2026-04-28 03:10:52.116201 | orchestrator | Tuesday 28 April 2026 03:10:41 +0000 (0:00:00.887) 0:10:27.306 ********* 2026-04-28 03:10:52.116215 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-28 03:10:52.116229 | orchestrator | changed: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-28 03:10:52.116241 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-28 03:10:52.116253 | orchestrator | 2026-04-28 03:10:52.116266 | orchestrator | TASK [ceph-rgw : Create rgw keyrings] ****************************************** 2026-04-28 03:10:52.116278 | orchestrator | Tuesday 28 April 2026 03:10:42 +0000 (0:00:00.924) 0:10:28.231 ********* 2026-04-28 03:10:52.116290 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:10:52.116302 | orchestrator | changed: [testbed-node-3 -> {{ groups[mon_group_name][0] if groups.get(mon_group_name, []) | length > 0 else 'localhost' }}] 2026-04-28 03:10:52.116310 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:10:52.116317 | orchestrator | changed: [testbed-node-5 -> {{ groups[mon_group_name][0] if groups.get(mon_group_name, []) | length > 0 else 'localhost' }}] 2026-04-28 03:10:52.116324 | orchestrator | changed: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:10:52.116331 | orchestrator | changed: [testbed-node-4 -> {{ groups[mon_group_name][0] if groups.get(mon_group_name, []) | length > 0 else 'localhost' }}] 2026-04-28 03:10:52.116348 | orchestrator | 2026-04-28 03:10:52.116360 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-28 03:10:52.116370 | orchestrator | Tuesday 28 April 2026 03:10:47 +0000 (0:00:04.528) 0:10:32.760 ********* 2026-04-28 03:10:52.116387 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:10:52.116402 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-28 03:10:52.116413 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:10:52.116424 | orchestrator | ok: [testbed-node-4 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-28 03:10:52.116435 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:10:52.116447 | orchestrator | ok: [testbed-node-5 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-28 03:10:52.116457 | orchestrator | 2026-04-28 03:10:52.116468 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-28 03:10:52.116479 | orchestrator | Tuesday 28 April 2026 03:10:49 +0000 (0:00:02.281) 0:10:35.042 ********* 2026-04-28 03:10:52.116490 | orchestrator | changed: [testbed-node-3] => (item=None) 2026-04-28 03:10:52.116512 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:10:52.116525 | orchestrator | changed: [testbed-node-4] => (item=None) 2026-04-28 03:10:52.116536 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:10:52.116548 | orchestrator | changed: [testbed-node-5] => (item=None) 2026-04-28 03:10:52.116560 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:10:52.116572 | orchestrator | 2026-04-28 03:10:52.116583 | orchestrator | TASK [ceph-rgw : Rgw pool creation tasks] ************************************** 2026-04-28 03:10:52.116595 | orchestrator | Tuesday 28 April 2026 03:10:51 +0000 (0:00:01.627) 0:10:36.669 ********* 2026-04-28 03:10:52.116607 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/rgw_create_pools.yml for testbed-node-3 2026-04-28 03:10:52.116618 | orchestrator | 2026-04-28 03:10:52.116630 | orchestrator | TASK [ceph-rgw : Create ec profile] ******************************************** 2026-04-28 03:10:52.116642 | orchestrator | Tuesday 28 April 2026 03:10:51 +0000 (0:00:00.251) 0:10:36.920 ********* 2026-04-28 03:10:52.116654 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 03:10:52.116667 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 03:10:52.116689 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 03:11:38.552202 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 03:11:38.552303 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 03:11:38.552314 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:11:38.552322 | orchestrator | 2026-04-28 03:11:38.552332 | orchestrator | TASK [ceph-rgw : Set crush rule] *********************************************** 2026-04-28 03:11:38.552347 | orchestrator | Tuesday 28 April 2026 03:10:52 +0000 (0:00:00.647) 0:10:37.567 ********* 2026-04-28 03:11:38.552355 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 03:11:38.552362 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 03:11:38.552369 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 03:11:38.552375 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 03:11:38.552384 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 03:11:38.552420 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:11:38.552431 | orchestrator | 2026-04-28 03:11:38.552442 | orchestrator | TASK [ceph-rgw : Create rgw pools] ********************************************* 2026-04-28 03:11:38.552454 | orchestrator | Tuesday 28 April 2026 03:10:52 +0000 (0:00:00.728) 0:10:38.296 ********* 2026-04-28 03:11:38.552461 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-28 03:11:38.552469 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-28 03:11:38.552475 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-28 03:11:38.552482 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-28 03:11:38.552488 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-28 03:11:38.552494 | orchestrator | 2026-04-28 03:11:38.552500 | orchestrator | TASK [ceph-rgw : Include_tasks openstack-keystone.yml] ************************* 2026-04-28 03:11:38.552509 | orchestrator | Tuesday 28 April 2026 03:11:24 +0000 (0:00:31.250) 0:11:09.546 ********* 2026-04-28 03:11:38.552519 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:11:38.552528 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:11:38.552539 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:11:38.552549 | orchestrator | 2026-04-28 03:11:38.552560 | orchestrator | TASK [ceph-rgw : Include_tasks start_radosgw.yml] ****************************** 2026-04-28 03:11:38.552570 | orchestrator | Tuesday 28 April 2026 03:11:24 +0000 (0:00:00.362) 0:11:09.909 ********* 2026-04-28 03:11:38.552580 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:11:38.552591 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:11:38.552599 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:11:38.552606 | orchestrator | 2026-04-28 03:11:38.552612 | orchestrator | TASK [ceph-rgw : Include start_docker_rgw.yml] ********************************* 2026-04-28 03:11:38.552618 | orchestrator | Tuesday 28 April 2026 03:11:25 +0000 (0:00:00.691) 0:11:10.600 ********* 2026-04-28 03:11:38.552625 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/start_docker_rgw.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:11:38.552631 | orchestrator | 2026-04-28 03:11:38.552650 | orchestrator | TASK [ceph-rgw : Include_task systemd.yml] ************************************* 2026-04-28 03:11:38.552656 | orchestrator | Tuesday 28 April 2026 03:11:25 +0000 (0:00:00.655) 0:11:11.256 ********* 2026-04-28 03:11:38.552662 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/systemd.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:11:38.552668 | orchestrator | 2026-04-28 03:11:38.552674 | orchestrator | TASK [ceph-rgw : Generate systemd unit file] *********************************** 2026-04-28 03:11:38.552681 | orchestrator | Tuesday 28 April 2026 03:11:26 +0000 (0:00:00.944) 0:11:12.201 ********* 2026-04-28 03:11:38.552687 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:11:38.552698 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:11:38.552707 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:11:38.552722 | orchestrator | 2026-04-28 03:11:38.552736 | orchestrator | TASK [ceph-rgw : Generate systemd ceph-radosgw target file] ******************** 2026-04-28 03:11:38.552746 | orchestrator | Tuesday 28 April 2026 03:11:28 +0000 (0:00:01.392) 0:11:13.594 ********* 2026-04-28 03:11:38.552756 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:11:38.552766 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:11:38.552776 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:11:38.552786 | orchestrator | 2026-04-28 03:11:38.552963 | orchestrator | TASK [ceph-rgw : Enable ceph-radosgw.target] *********************************** 2026-04-28 03:11:38.552988 | orchestrator | Tuesday 28 April 2026 03:11:29 +0000 (0:00:01.252) 0:11:14.846 ********* 2026-04-28 03:11:38.552994 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:11:38.553019 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:11:38.553027 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:11:38.553033 | orchestrator | 2026-04-28 03:11:38.553040 | orchestrator | TASK [ceph-rgw : Systemd start rgw container] ********************************** 2026-04-28 03:11:38.553046 | orchestrator | Tuesday 28 April 2026 03:11:31 +0000 (0:00:02.490) 0:11:17.337 ********* 2026-04-28 03:11:38.553052 | orchestrator | changed: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-28 03:11:38.553059 | orchestrator | changed: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-28 03:11:38.553065 | orchestrator | changed: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-28 03:11:38.553071 | orchestrator | 2026-04-28 03:11:38.553078 | orchestrator | RUNNING HANDLER [ceph-handler : Make tempdir for scripts] ********************** 2026-04-28 03:11:38.553084 | orchestrator | Tuesday 28 April 2026 03:11:34 +0000 (0:00:02.959) 0:11:20.296 ********* 2026-04-28 03:11:38.553090 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:11:38.553096 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:11:38.553102 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:11:38.553109 | orchestrator | 2026-04-28 03:11:38.553128 | orchestrator | RUNNING HANDLER [ceph-handler : Rgws handler] ********************************** 2026-04-28 03:11:38.553135 | orchestrator | Tuesday 28 April 2026 03:11:35 +0000 (0:00:00.376) 0:11:20.673 ********* 2026-04-28 03:11:38.553148 | orchestrator | included: /ansible/roles/ceph-handler/tasks/handler_rgws.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:11:38.553155 | orchestrator | 2026-04-28 03:11:38.553161 | orchestrator | RUNNING HANDLER [ceph-handler : Set _rgw_handler_called before restart] ******** 2026-04-28 03:11:38.553167 | orchestrator | Tuesday 28 April 2026 03:11:36 +0000 (0:00:00.997) 0:11:21.670 ********* 2026-04-28 03:11:38.553173 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:11:38.553180 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:11:38.553186 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:11:38.553193 | orchestrator | 2026-04-28 03:11:38.553199 | orchestrator | RUNNING HANDLER [ceph-handler : Copy rgw restart script] *********************** 2026-04-28 03:11:38.553210 | orchestrator | Tuesday 28 April 2026 03:11:36 +0000 (0:00:00.375) 0:11:22.046 ********* 2026-04-28 03:11:38.553220 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:11:38.553236 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:11:38.553248 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:11:38.553257 | orchestrator | 2026-04-28 03:11:38.553268 | orchestrator | RUNNING HANDLER [ceph-handler : Restart ceph rgw daemon(s)] ******************** 2026-04-28 03:11:38.553280 | orchestrator | Tuesday 28 April 2026 03:11:37 +0000 (0:00:00.682) 0:11:22.728 ********* 2026-04-28 03:11:38.553290 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 03:11:38.553301 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 03:11:38.553312 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 03:11:38.553322 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:11:38.553332 | orchestrator | 2026-04-28 03:11:38.553342 | orchestrator | RUNNING HANDLER [ceph-handler : Set _rgw_handler_called after restart] ********* 2026-04-28 03:11:38.553351 | orchestrator | Tuesday 28 April 2026 03:11:38 +0000 (0:00:00.873) 0:11:23.602 ********* 2026-04-28 03:11:38.553361 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:11:38.553372 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:11:38.553383 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:11:38.553394 | orchestrator | 2026-04-28 03:11:38.553405 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 03:11:38.553416 | orchestrator | testbed-node-0 : ok=134  changed=35  unreachable=0 failed=0 skipped=125  rescued=0 ignored=0 2026-04-28 03:11:38.553439 | orchestrator | testbed-node-1 : ok=127  changed=31  unreachable=0 failed=0 skipped=120  rescued=0 ignored=0 2026-04-28 03:11:38.553450 | orchestrator | testbed-node-2 : ok=134  changed=33  unreachable=0 failed=0 skipped=119  rescued=0 ignored=0 2026-04-28 03:11:38.553470 | orchestrator | testbed-node-3 : ok=193  changed=45  unreachable=0 failed=0 skipped=162  rescued=0 ignored=0 2026-04-28 03:11:38.553481 | orchestrator | testbed-node-4 : ok=175  changed=40  unreachable=0 failed=0 skipped=123  rescued=0 ignored=0 2026-04-28 03:11:38.553492 | orchestrator | testbed-node-5 : ok=177  changed=41  unreachable=0 failed=0 skipped=121  rescued=0 ignored=0 2026-04-28 03:11:38.553503 | orchestrator | 2026-04-28 03:11:38.553513 | orchestrator | 2026-04-28 03:11:38.553524 | orchestrator | 2026-04-28 03:11:38.553531 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 03:11:38.553537 | orchestrator | Tuesday 28 April 2026 03:11:38 +0000 (0:00:00.391) 0:11:23.994 ********* 2026-04-28 03:11:38.553543 | orchestrator | =============================================================================== 2026-04-28 03:11:38.553550 | orchestrator | ceph-container-common : Pulling Ceph container image ------------------- 61.13s 2026-04-28 03:11:38.553556 | orchestrator | ceph-osd : Use ceph-volume to create osds ------------------------------ 40.63s 2026-04-28 03:11:38.553562 | orchestrator | ceph-rgw : Create rgw pools -------------------------------------------- 31.25s 2026-04-28 03:11:38.553568 | orchestrator | ceph-mgr : Wait for all mgr to be up ----------------------------------- 24.32s 2026-04-28 03:11:38.553574 | orchestrator | ceph-mon : Waiting for the monitor(s) to form the quorum... ------------ 21.85s 2026-04-28 03:11:38.553588 | orchestrator | ceph-mon : Set cluster configs ----------------------------------------- 15.23s 2026-04-28 03:11:39.139147 | orchestrator | ceph-osd : Wait for all osd to be up ----------------------------------- 12.40s 2026-04-28 03:11:39.139236 | orchestrator | ceph-mgr : Create ceph mgr keyring(s) on a mon node -------------------- 10.96s 2026-04-28 03:11:39.139248 | orchestrator | ceph-mon : Fetch ceph initial keys ------------------------------------- 10.35s 2026-04-28 03:11:39.139256 | orchestrator | ceph-mds : Create filesystem pools -------------------------------------- 8.18s 2026-04-28 03:11:39.139264 | orchestrator | ceph-mgr : Disable ceph mgr enabled modules ----------------------------- 7.51s 2026-04-28 03:11:39.139272 | orchestrator | ceph-config : Create ceph initial directories --------------------------- 6.40s 2026-04-28 03:11:39.139280 | orchestrator | ceph-mgr : Add modules to ceph-mgr -------------------------------------- 5.03s 2026-04-28 03:11:39.139288 | orchestrator | ceph-rgw : Create rgw keyrings ------------------------------------------ 4.53s 2026-04-28 03:11:39.139296 | orchestrator | ceph-crash : Create client.crash keyring -------------------------------- 4.19s 2026-04-28 03:11:39.139304 | orchestrator | ceph-osd : Systemd start osd -------------------------------------------- 3.96s 2026-04-28 03:11:39.139311 | orchestrator | ceph-mon : Copy admin keyring over to mons ------------------------------ 3.70s 2026-04-28 03:11:39.139319 | orchestrator | ceph-crash : Start the ceph-crash service ------------------------------- 3.67s 2026-04-28 03:11:39.139328 | orchestrator | ceph-mgr : Systemd start mgr -------------------------------------------- 3.66s 2026-04-28 03:11:39.139336 | orchestrator | ceph-mds : Create ceph filesystem --------------------------------------- 3.58s 2026-04-28 03:11:41.814750 | orchestrator | 2026-04-28 03:11:41 | INFO  | Task 1b0354dd-cf43-417b-b9c1-4c30872d243b (ceph-pools) was prepared for execution. 2026-04-28 03:11:41.814900 | orchestrator | 2026-04-28 03:11:41 | INFO  | It takes a moment until task 1b0354dd-cf43-417b-b9c1-4c30872d243b (ceph-pools) has been started and output is visible here. 2026-04-28 03:11:57.768276 | orchestrator | [WARNING]: Collection community.general does not support Ansible version 2026-04-28 03:11:57.768404 | orchestrator | 2.16.14 2026-04-28 03:11:57.768417 | orchestrator | 2026-04-28 03:11:57.768425 | orchestrator | PLAY [Create ceph pools] ******************************************************* 2026-04-28 03:11:57.768433 | orchestrator | 2026-04-28 03:11:57.768441 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 03:11:57.768448 | orchestrator | Tuesday 28 April 2026 03:11:46 +0000 (0:00:00.658) 0:00:00.658 ********* 2026-04-28 03:11:57.768456 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:11:57.768464 | orchestrator | 2026-04-28 03:11:57.768472 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-28 03:11:57.768479 | orchestrator | Tuesday 28 April 2026 03:11:47 +0000 (0:00:00.772) 0:00:01.430 ********* 2026-04-28 03:11:57.768487 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:11:57.768495 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:11:57.768502 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:11:57.768510 | orchestrator | 2026-04-28 03:11:57.768517 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-28 03:11:57.768524 | orchestrator | Tuesday 28 April 2026 03:11:48 +0000 (0:00:00.662) 0:00:02.092 ********* 2026-04-28 03:11:57.768531 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:11:57.768538 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:11:57.768545 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:11:57.768552 | orchestrator | 2026-04-28 03:11:57.768559 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 03:11:57.768568 | orchestrator | Tuesday 28 April 2026 03:11:48 +0000 (0:00:00.342) 0:00:02.434 ********* 2026-04-28 03:11:57.768576 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:11:57.768584 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:11:57.768592 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:11:57.768600 | orchestrator | 2026-04-28 03:11:57.768608 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 03:11:57.768616 | orchestrator | Tuesday 28 April 2026 03:11:49 +0000 (0:00:00.898) 0:00:03.333 ********* 2026-04-28 03:11:57.768625 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:11:57.768633 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:11:57.768641 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:11:57.768650 | orchestrator | 2026-04-28 03:11:57.768671 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-28 03:11:57.768681 | orchestrator | Tuesday 28 April 2026 03:11:50 +0000 (0:00:00.362) 0:00:03.696 ********* 2026-04-28 03:11:57.768690 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:11:57.768698 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:11:57.768706 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:11:57.768715 | orchestrator | 2026-04-28 03:11:57.768723 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-28 03:11:57.768731 | orchestrator | Tuesday 28 April 2026 03:11:50 +0000 (0:00:00.363) 0:00:04.059 ********* 2026-04-28 03:11:57.768740 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:11:57.768748 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:11:57.768755 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:11:57.768762 | orchestrator | 2026-04-28 03:11:57.768770 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-28 03:11:57.768777 | orchestrator | Tuesday 28 April 2026 03:11:50 +0000 (0:00:00.356) 0:00:04.415 ********* 2026-04-28 03:11:57.768814 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:11:57.768823 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:11:57.768830 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:11:57.768838 | orchestrator | 2026-04-28 03:11:57.768846 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-28 03:11:57.768853 | orchestrator | Tuesday 28 April 2026 03:11:51 +0000 (0:00:00.620) 0:00:05.035 ********* 2026-04-28 03:11:57.768861 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:11:57.768868 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:11:57.768875 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:11:57.768894 | orchestrator | 2026-04-28 03:11:57.768902 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-28 03:11:57.768911 | orchestrator | Tuesday 28 April 2026 03:11:51 +0000 (0:00:00.343) 0:00:05.379 ********* 2026-04-28 03:11:57.768919 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 03:11:57.768928 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 03:11:57.768936 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 03:11:57.768944 | orchestrator | 2026-04-28 03:11:57.768951 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-28 03:11:57.768958 | orchestrator | Tuesday 28 April 2026 03:11:52 +0000 (0:00:00.954) 0:00:06.333 ********* 2026-04-28 03:11:57.768965 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:11:57.768972 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:11:57.768979 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:11:57.768987 | orchestrator | 2026-04-28 03:11:57.768994 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-28 03:11:57.769002 | orchestrator | Tuesday 28 April 2026 03:11:53 +0000 (0:00:00.504) 0:00:06.837 ********* 2026-04-28 03:11:57.769010 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 03:11:57.769018 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 03:11:57.769026 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 03:11:57.769032 | orchestrator | 2026-04-28 03:11:57.769039 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-28 03:11:57.769045 | orchestrator | Tuesday 28 April 2026 03:11:55 +0000 (0:00:02.390) 0:00:09.227 ********* 2026-04-28 03:11:57.769052 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-28 03:11:57.769059 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-28 03:11:57.769067 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-28 03:11:57.769074 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:11:57.769082 | orchestrator | 2026-04-28 03:11:57.769110 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-28 03:11:57.769119 | orchestrator | Tuesday 28 April 2026 03:11:56 +0000 (0:00:01.002) 0:00:10.230 ********* 2026-04-28 03:11:57.769129 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-28 03:11:57.769138 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-28 03:11:57.769143 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-28 03:11:57.769147 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:11:57.769152 | orchestrator | 2026-04-28 03:11:57.769157 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-28 03:11:57.769161 | orchestrator | Tuesday 28 April 2026 03:11:57 +0000 (0:00:00.814) 0:00:11.045 ********* 2026-04-28 03:11:57.769167 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 03:11:57.769188 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 03:11:57.769194 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 03:11:57.769199 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:11:57.769203 | orchestrator | 2026-04-28 03:11:57.769208 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-28 03:11:57.769212 | orchestrator | Tuesday 28 April 2026 03:11:57 +0000 (0:00:00.181) 0:00:11.227 ********* 2026-04-28 03:11:57.769219 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': '87fa47a77fbc', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-28 03:11:54.161646', 'end': '2026-04-28 03:11:54.211790', 'delta': '0:00:00.050144', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['87fa47a77fbc'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-28 03:11:57.769227 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': '90eb2d51595d', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-28 03:11:54.807545', 'end': '2026-04-28 03:11:54.845586', 'delta': '0:00:00.038041', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['90eb2d51595d'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-28 03:11:57.769238 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': 'ba47649d1789', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-28 03:11:55.377198', 'end': '2026-04-28 03:11:55.425261', 'delta': '0:00:00.048063', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['ba47649d1789'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-28 03:12:05.268695 | orchestrator | 2026-04-28 03:12:05.268861 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-28 03:12:05.268887 | orchestrator | Tuesday 28 April 2026 03:11:57 +0000 (0:00:00.200) 0:00:11.427 ********* 2026-04-28 03:12:05.268901 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:12:05.268915 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:12:05.268928 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:12:05.268941 | orchestrator | 2026-04-28 03:12:05.268954 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-28 03:12:05.269000 | orchestrator | Tuesday 28 April 2026 03:11:58 +0000 (0:00:00.514) 0:00:11.941 ********* 2026-04-28 03:12:05.269015 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] 2026-04-28 03:12:05.269029 | orchestrator | 2026-04-28 03:12:05.269042 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-28 03:12:05.269055 | orchestrator | Tuesday 28 April 2026 03:12:00 +0000 (0:00:01.810) 0:00:13.751 ********* 2026-04-28 03:12:05.269067 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:05.269078 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:12:05.269090 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:12:05.269115 | orchestrator | 2026-04-28 03:12:05.269145 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-28 03:12:05.269159 | orchestrator | Tuesday 28 April 2026 03:12:00 +0000 (0:00:00.335) 0:00:14.086 ********* 2026-04-28 03:12:05.269174 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:05.269187 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:12:05.269200 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:12:05.269214 | orchestrator | 2026-04-28 03:12:05.269229 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 03:12:05.269243 | orchestrator | Tuesday 28 April 2026 03:12:01 +0000 (0:00:00.725) 0:00:14.812 ********* 2026-04-28 03:12:05.269256 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:05.269271 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:12:05.269285 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:12:05.269299 | orchestrator | 2026-04-28 03:12:05.269314 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-28 03:12:05.269329 | orchestrator | Tuesday 28 April 2026 03:12:01 +0000 (0:00:00.341) 0:00:15.154 ********* 2026-04-28 03:12:05.269344 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:12:05.269358 | orchestrator | 2026-04-28 03:12:05.269374 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-28 03:12:05.269388 | orchestrator | Tuesday 28 April 2026 03:12:01 +0000 (0:00:00.149) 0:00:15.303 ********* 2026-04-28 03:12:05.269401 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:05.269413 | orchestrator | 2026-04-28 03:12:05.269422 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 03:12:05.269430 | orchestrator | Tuesday 28 April 2026 03:12:01 +0000 (0:00:00.251) 0:00:15.555 ********* 2026-04-28 03:12:05.269438 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:05.269446 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:12:05.269454 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:12:05.269462 | orchestrator | 2026-04-28 03:12:05.269469 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-28 03:12:05.269478 | orchestrator | Tuesday 28 April 2026 03:12:02 +0000 (0:00:00.343) 0:00:15.899 ********* 2026-04-28 03:12:05.269485 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:05.269493 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:12:05.269501 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:12:05.269508 | orchestrator | 2026-04-28 03:12:05.269516 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-28 03:12:05.269524 | orchestrator | Tuesday 28 April 2026 03:12:02 +0000 (0:00:00.580) 0:00:16.479 ********* 2026-04-28 03:12:05.269532 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:05.269539 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:12:05.269547 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:12:05.269555 | orchestrator | 2026-04-28 03:12:05.269562 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-28 03:12:05.269570 | orchestrator | Tuesday 28 April 2026 03:12:03 +0000 (0:00:00.375) 0:00:16.854 ********* 2026-04-28 03:12:05.269578 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:05.269586 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:12:05.269593 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:12:05.269601 | orchestrator | 2026-04-28 03:12:05.269609 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-28 03:12:05.269629 | orchestrator | Tuesday 28 April 2026 03:12:03 +0000 (0:00:00.389) 0:00:17.244 ********* 2026-04-28 03:12:05.269637 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:05.269645 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:12:05.269652 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:12:05.269660 | orchestrator | 2026-04-28 03:12:05.269668 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-28 03:12:05.269676 | orchestrator | Tuesday 28 April 2026 03:12:04 +0000 (0:00:00.492) 0:00:17.737 ********* 2026-04-28 03:12:05.269684 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:05.269691 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:12:05.269699 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:12:05.269707 | orchestrator | 2026-04-28 03:12:05.269716 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-28 03:12:05.269730 | orchestrator | Tuesday 28 April 2026 03:12:04 +0000 (0:00:00.605) 0:00:18.342 ********* 2026-04-28 03:12:05.269742 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:05.269755 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:12:05.269768 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:12:05.269848 | orchestrator | 2026-04-28 03:12:05.269865 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-28 03:12:05.269877 | orchestrator | Tuesday 28 April 2026 03:12:05 +0000 (0:00:00.395) 0:00:18.738 ********* 2026-04-28 03:12:05.269922 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f', 'dm-uuid-LVM-8dHS1FAptgldbJuN9Gw1hr0pl5XswJ3894zCAdztzvSylGKJfL2Zwu5Qsrm0jqWu'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.269953 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1', 'dm-uuid-LVM-SMcSbjI9wnD6SeY7SKKJ6dCSoT074g1SuE3hmfWZ3V1NoBQYcdXeMp0c5DwXf9Jz'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.269970 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.269986 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.270001 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.270097 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.270113 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.270125 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.270138 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.270163 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.444401 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:12:05.444508 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'holders': ['ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-CCJsyU-Xs4y-bAwu-Sr1U-RU9B-U5cX-8dk8mo', 'scsi-0QEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202', 'scsi-SQEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:12:05.444521 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'holders': ['ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-rTHLNA-XX65-cEa6-oPdR-i0kN-CrZ9-dGTohN', 'scsi-0QEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675', 'scsi-SQEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:12:05.444545 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c', 'scsi-SQEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:12:05.444561 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-28-01-45-18-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:12:05.444586 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf', 'dm-uuid-LVM-jDSXafY010UkbP8ZmxeIQet2dAZt2ducp03EHOrl6D51efYCaF9MHllF0WrfMNUg'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.444596 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a', 'dm-uuid-LVM-Ef9S4L9mnk6YjVYwTU4OmJ1Dk0yNJkcNEeYiJgmdqy5Dk4JMIq1jh9ZhEgnxusYs'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.444611 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.444622 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.444631 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.444640 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.444652 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.564449 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.564577 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.564598 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:05.564615 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.564658 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:12:05.564700 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'holders': ['ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-l9OtEf-0x8l-OZFM-QMSY-xI5K-ifcY-q0IHfV', 'scsi-0QEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b', 'scsi-SQEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:12:05.564725 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'holders': ['ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-NfMdHp-i6Wd-iXE4-bdeT-UQcT-dakb-CDL8cZ', 'scsi-0QEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba', 'scsi-SQEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:12:05.564740 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80', 'scsi-SQEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:12:05.564764 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab', 'dm-uuid-LVM-wa3l676dWvdqPItJjhbbIPxjjJMNXrWDxgNEYRSdoBZ0EZLJPUa6Po9zcB3PjLSE'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.564872 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-28-01-45-13-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:12:05.564886 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:12:05.564895 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1', 'dm-uuid-LVM-L5YjMhWvYgnpoIfTj51PZeO1wrabnQEX7l2ME9eZWg9LEHQ0f9eDaf27dOm77xe0'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.564903 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.564921 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.869943 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.870116 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.870162 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.870173 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.870183 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.870193 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}})  2026-04-28 03:12:05.870257 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:12:05.870275 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'holders': ['ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-L2AQ1c-y7H3-F3Y3-6Qkf-SkKZ-Rdhw-Yd8PGb', 'scsi-0QEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79', 'scsi-SQEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:12:05.870295 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'holders': ['ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-vGsvHj-S1i8-Sw7N-17Sv-GX9v-DQYR-rG2tdh', 'scsi-0QEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89', 'scsi-SQEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:12:05.870306 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de', 'scsi-SQEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:12:05.870317 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-28-01-45-15-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}})  2026-04-28 03:12:05.870329 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:12:05.870341 | orchestrator | 2026-04-28 03:12:05.870352 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-28 03:12:05.870362 | orchestrator | Tuesday 28 April 2026 03:12:05 +0000 (0:00:00.683) 0:00:19.421 ********* 2026-04-28 03:12:05.870381 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f', 'dm-uuid-LVM-8dHS1FAptgldbJuN9Gw1hr0pl5XswJ3894zCAdztzvSylGKJfL2Zwu5Qsrm0jqWu'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.008291 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1', 'dm-uuid-LVM-SMcSbjI9wnD6SeY7SKKJ6dCSoT074g1SuE3hmfWZ3V1NoBQYcdXeMp0c5DwXf9Jz'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.008421 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.008437 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.008446 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.008455 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.008519 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.008561 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.008583 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.008591 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.008603 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.008626 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'holders': ['ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-CCJsyU-Xs4y-bAwu-Sr1U-RU9B-U5cX-8dk8mo', 'scsi-0QEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202', 'scsi-SQEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.177999 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf', 'dm-uuid-LVM-jDSXafY010UkbP8ZmxeIQet2dAZt2ducp03EHOrl6D51efYCaF9MHllF0WrfMNUg'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.178126 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'holders': ['ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-rTHLNA-XX65-cEa6-oPdR-i0kN-CrZ9-dGTohN', 'scsi-0QEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675', 'scsi-SQEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.178135 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a', 'dm-uuid-LVM-Ef9S4L9mnk6YjVYwTU4OmJ1Dk0yNJkcNEeYiJgmdqy5Dk4JMIq1jh9ZhEgnxusYs'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.178140 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c', 'scsi-SQEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.178181 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.178198 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-28-01-45-18-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.178203 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.178208 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.178212 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.178216 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.178224 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:06.178233 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.178241 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.312938 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.313018 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.313055 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'holders': ['ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-l9OtEf-0x8l-OZFM-QMSY-xI5K-ifcY-q0IHfV', 'scsi-0QEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b', 'scsi-SQEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.313074 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'holders': ['ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-NfMdHp-i6Wd-iXE4-bdeT-UQcT-dakb-CDL8cZ', 'scsi-0QEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba', 'scsi-SQEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.313080 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80', 'scsi-SQEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.313086 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab', 'dm-uuid-LVM-wa3l676dWvdqPItJjhbbIPxjjJMNXrWDxgNEYRSdoBZ0EZLJPUa6Po9zcB3PjLSE'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.313091 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-28-01-45-13-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.313109 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1', 'dm-uuid-LVM-L5YjMhWvYgnpoIfTj51PZeO1wrabnQEX7l2ME9eZWg9LEHQ0f9eDaf27dOm77xe0'], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': 41934848, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.313114 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:12:06.313125 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.477930 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.478093 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.478117 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.478132 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.478186 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.478212 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.478249 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'holders': [], 'host': '', 'links': {'ids': [], 'labels': [], 'masters': [], 'uuids': []}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 0, 'sectorsize': '512', 'size': '0.00 Bytes', 'support_discard': '0', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.478263 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1'], 'labels': ['cloudimg-rootfs'], 'masters': [], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf']}, 'sectors': 165672927, 'sectorsize': 512, 'size': '79.00 GB', 'start': '2099200', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf'}, 'sda14': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14'], 'labels': [], 'masters': [], 'uuids': []}, 'sectors': 8192, 'sectorsize': 512, 'size': '4.00 MB', 'start': '2048', 'uuid': None}, 'sda15': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15'], 'labels': ['UEFI'], 'masters': [], 'uuids': ['5C78-612A']}, 'sectors': 217088, 'sectorsize': 512, 'size': '106.00 MB', 'start': '10240', 'uuid': '5C78-612A'}, 'sda16': {'holders': [], 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16'], 'labels': ['BOOT'], 'masters': [], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec']}, 'sectors': 1869825, 'sectorsize': 512, 'size': '913.00 MB', 'start': '227328', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 167772160, 'sectorsize': '512', 'size': '80.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.478285 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'holders': ['ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-L2AQ1c-y7H3-F3Y3-6Qkf-SkKZ-Rdhw-Yd8PGb', 'scsi-0QEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79', 'scsi-SQEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79'], 'labels': [], 'masters': ['dm-0'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:06.478301 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'holders': ['ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1'], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['lvm-pv-uuid-vGsvHj-S1i8-Sw7N-17Sv-GX9v-DQYR-rG2tdh', 'scsi-0QEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89', 'scsi-SQEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89'], 'labels': [], 'masters': ['dm-1'], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:18.654875 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'holders': [], 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de', 'scsi-SQEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'QEMU HARDDISK', 'partitions': {}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': 41943040, 'sectorsize': '512', 'size': '20.00 GB', 'support_discard': '4096', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:18.654992 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'holders': [], 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'labels': ['config-2'], 'masters': [], 'uuids': ['2026-04-28-01-45-15-00']}, 'model': 'QEMU DVD-ROM', 'partitions': {}, 'removable': '1', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': 253, 'sectorsize': '2048', 'size': '506.00 KB', 'support_discard': '0', 'vendor': 'QEMU', 'virtual': 1}}, 'ansible_loop_var': 'item'})  2026-04-28 03:12:18.655039 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:12:18.655054 | orchestrator | 2026-04-28 03:12:18.655067 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-28 03:12:18.655079 | orchestrator | Tuesday 28 April 2026 03:12:06 +0000 (0:00:00.721) 0:00:20.143 ********* 2026-04-28 03:12:18.655090 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:12:18.655102 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:12:18.655113 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:12:18.655123 | orchestrator | 2026-04-28 03:12:18.655134 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-28 03:12:18.655146 | orchestrator | Tuesday 28 April 2026 03:12:07 +0000 (0:00:00.999) 0:00:21.142 ********* 2026-04-28 03:12:18.655156 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:12:18.655168 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:12:18.655178 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:12:18.655189 | orchestrator | 2026-04-28 03:12:18.655200 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 03:12:18.655211 | orchestrator | Tuesday 28 April 2026 03:12:07 +0000 (0:00:00.355) 0:00:21.497 ********* 2026-04-28 03:12:18.655221 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:12:18.655232 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:12:18.655243 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:12:18.655254 | orchestrator | 2026-04-28 03:12:18.655265 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 03:12:18.655276 | orchestrator | Tuesday 28 April 2026 03:12:08 +0000 (0:00:00.717) 0:00:22.215 ********* 2026-04-28 03:12:18.655289 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:18.655301 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:12:18.655314 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:12:18.655326 | orchestrator | 2026-04-28 03:12:18.655355 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 03:12:18.655369 | orchestrator | Tuesday 28 April 2026 03:12:08 +0000 (0:00:00.359) 0:00:22.574 ********* 2026-04-28 03:12:18.655381 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:18.655392 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:12:18.655405 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:12:18.655416 | orchestrator | 2026-04-28 03:12:18.655429 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 03:12:18.655442 | orchestrator | Tuesday 28 April 2026 03:12:09 +0000 (0:00:00.787) 0:00:23.362 ********* 2026-04-28 03:12:18.655454 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:18.655466 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:12:18.655478 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:12:18.655490 | orchestrator | 2026-04-28 03:12:18.655503 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-28 03:12:18.655516 | orchestrator | Tuesday 28 April 2026 03:12:10 +0000 (0:00:00.393) 0:00:23.755 ********* 2026-04-28 03:12:18.655528 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-0) 2026-04-28 03:12:18.655541 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-0) 2026-04-28 03:12:18.655554 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-1) 2026-04-28 03:12:18.655566 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-0) 2026-04-28 03:12:18.655578 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-1) 2026-04-28 03:12:18.655591 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-2) 2026-04-28 03:12:18.655604 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-1) 2026-04-28 03:12:18.655616 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-2) 2026-04-28 03:12:18.655628 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-2) 2026-04-28 03:12:18.655640 | orchestrator | 2026-04-28 03:12:18.655653 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-28 03:12:18.655677 | orchestrator | Tuesday 28 April 2026 03:12:11 +0000 (0:00:01.241) 0:00:24.997 ********* 2026-04-28 03:12:18.655707 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-28 03:12:18.655719 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-28 03:12:18.655730 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-28 03:12:18.655740 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:18.655751 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-28 03:12:18.655762 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-28 03:12:18.655805 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-28 03:12:18.655830 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:12:18.655854 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-28 03:12:18.655874 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-28 03:12:18.655890 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-28 03:12:18.655907 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:12:18.655923 | orchestrator | 2026-04-28 03:12:18.655940 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-28 03:12:18.655957 | orchestrator | Tuesday 28 April 2026 03:12:11 +0000 (0:00:00.626) 0:00:25.623 ********* 2026-04-28 03:12:18.655974 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:12:18.655991 | orchestrator | 2026-04-28 03:12:18.656009 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 03:12:18.656027 | orchestrator | Tuesday 28 April 2026 03:12:12 +0000 (0:00:00.626) 0:00:26.250 ********* 2026-04-28 03:12:18.656045 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:18.656064 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:12:18.656082 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:12:18.656101 | orchestrator | 2026-04-28 03:12:18.656120 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 03:12:18.656137 | orchestrator | Tuesday 28 April 2026 03:12:12 +0000 (0:00:00.341) 0:00:26.592 ********* 2026-04-28 03:12:18.656156 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:18.656167 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:12:18.656178 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:12:18.656188 | orchestrator | 2026-04-28 03:12:18.656199 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 03:12:18.656210 | orchestrator | Tuesday 28 April 2026 03:12:13 +0000 (0:00:00.598) 0:00:27.190 ********* 2026-04-28 03:12:18.656220 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:18.656231 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:12:18.656242 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:12:18.656252 | orchestrator | 2026-04-28 03:12:18.656263 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 03:12:18.656274 | orchestrator | Tuesday 28 April 2026 03:12:13 +0000 (0:00:00.370) 0:00:27.561 ********* 2026-04-28 03:12:18.656284 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:12:18.656295 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:12:18.656306 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:12:18.656317 | orchestrator | 2026-04-28 03:12:18.656330 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 03:12:18.656348 | orchestrator | Tuesday 28 April 2026 03:12:14 +0000 (0:00:00.470) 0:00:28.031 ********* 2026-04-28 03:12:18.656365 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 03:12:18.656381 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 03:12:18.656398 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 03:12:18.656416 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:18.656450 | orchestrator | 2026-04-28 03:12:18.656470 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 03:12:18.656503 | orchestrator | Tuesday 28 April 2026 03:12:14 +0000 (0:00:00.482) 0:00:28.514 ********* 2026-04-28 03:12:18.656523 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 03:12:18.656543 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 03:12:18.656571 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 03:12:18.656594 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:18.656605 | orchestrator | 2026-04-28 03:12:18.656616 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 03:12:18.656627 | orchestrator | Tuesday 28 April 2026 03:12:15 +0000 (0:00:00.575) 0:00:29.089 ********* 2026-04-28 03:12:18.656637 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 03:12:18.656654 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 03:12:18.656672 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 03:12:18.656693 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:12:18.656712 | orchestrator | 2026-04-28 03:12:18.656731 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 03:12:18.656746 | orchestrator | Tuesday 28 April 2026 03:12:16 +0000 (0:00:00.694) 0:00:29.784 ********* 2026-04-28 03:12:18.656757 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:12:18.656767 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:12:18.656808 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:12:18.656820 | orchestrator | 2026-04-28 03:12:18.656831 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 03:12:18.656841 | orchestrator | Tuesday 28 April 2026 03:12:16 +0000 (0:00:00.633) 0:00:30.417 ********* 2026-04-28 03:12:18.656852 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-28 03:12:18.656863 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-28 03:12:18.656873 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-28 03:12:18.656884 | orchestrator | 2026-04-28 03:12:18.656895 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-28 03:12:18.656906 | orchestrator | Tuesday 28 April 2026 03:12:17 +0000 (0:00:00.632) 0:00:31.049 ********* 2026-04-28 03:12:18.656916 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 03:12:18.656940 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 03:13:59.893671 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 03:13:59.893887 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-28 03:13:59.893915 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 03:13:59.893931 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 03:13:59.893946 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 03:13:59.893963 | orchestrator | 2026-04-28 03:13:59.893979 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-28 03:13:59.893996 | orchestrator | Tuesday 28 April 2026 03:12:18 +0000 (0:00:01.267) 0:00:32.317 ********* 2026-04-28 03:13:59.894010 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 03:13:59.894165 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 03:13:59.894181 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 03:13:59.894191 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-28 03:13:59.894202 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 03:13:59.894212 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 03:13:59.894222 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 03:13:59.894261 | orchestrator | 2026-04-28 03:13:59.894271 | orchestrator | TASK [Include tasks from the ceph-osd role] ************************************ 2026-04-28 03:13:59.894281 | orchestrator | Tuesday 28 April 2026 03:12:20 +0000 (0:00:01.877) 0:00:34.194 ********* 2026-04-28 03:13:59.894291 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:13:59.894302 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:13:59.894312 | orchestrator | included: /ansible/tasks/openstack_config.yml for testbed-node-5 2026-04-28 03:13:59.894322 | orchestrator | 2026-04-28 03:13:59.894332 | orchestrator | TASK [create openstack pool(s)] ************************************************ 2026-04-28 03:13:59.894342 | orchestrator | Tuesday 28 April 2026 03:12:21 +0000 (0:00:00.674) 0:00:34.869 ********* 2026-04-28 03:13:59.894354 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'application': 'rbd', 'erasure_profile': '', 'expected_num_objects': '', 'min_size': 0, 'name': 'backups', 'pg_autoscale_mode': False, 'pg_num': 32, 'pgp_num': 32, 'rule_name': 'replicated_rule', 'size': 3, 'type': 1}) 2026-04-28 03:13:59.894368 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'application': 'rbd', 'erasure_profile': '', 'expected_num_objects': '', 'min_size': 0, 'name': 'volumes', 'pg_autoscale_mode': False, 'pg_num': 32, 'pgp_num': 32, 'rule_name': 'replicated_rule', 'size': 3, 'type': 1}) 2026-04-28 03:13:59.894379 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'application': 'rbd', 'erasure_profile': '', 'expected_num_objects': '', 'min_size': 0, 'name': 'images', 'pg_autoscale_mode': False, 'pg_num': 32, 'pgp_num': 32, 'rule_name': 'replicated_rule', 'size': 3, 'type': 1}) 2026-04-28 03:13:59.894403 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'application': 'rbd', 'erasure_profile': '', 'expected_num_objects': '', 'min_size': 0, 'name': 'metrics', 'pg_autoscale_mode': False, 'pg_num': 32, 'pgp_num': 32, 'rule_name': 'replicated_rule', 'size': 3, 'type': 1}) 2026-04-28 03:13:59.894412 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'application': 'rbd', 'erasure_profile': '', 'expected_num_objects': '', 'min_size': 0, 'name': 'vms', 'pg_autoscale_mode': False, 'pg_num': 32, 'pgp_num': 32, 'rule_name': 'replicated_rule', 'size': 3, 'type': 1}) 2026-04-28 03:13:59.894421 | orchestrator | 2026-04-28 03:13:59.894430 | orchestrator | TASK [generate keys] *********************************************************** 2026-04-28 03:13:59.894439 | orchestrator | Tuesday 28 April 2026 03:13:06 +0000 (0:00:45.274) 0:01:20.144 ********* 2026-04-28 03:13:59.894447 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:13:59.894456 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:13:59.894465 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:13:59.894476 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:13:59.894489 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:13:59.894503 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:13:59.894517 | orchestrator | changed: [testbed-node-5 -> {{ groups[mon_group_name][0] }}] 2026-04-28 03:13:59.894530 | orchestrator | 2026-04-28 03:13:59.894543 | orchestrator | TASK [get keys from monitors] ************************************************** 2026-04-28 03:13:59.894557 | orchestrator | Tuesday 28 April 2026 03:13:30 +0000 (0:00:23.996) 0:01:44.140 ********* 2026-04-28 03:13:59.894597 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:13:59.894613 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:13:59.894626 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:13:59.894639 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:13:59.894665 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:13:59.894680 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:13:59.894694 | orchestrator | ok: [testbed-node-5 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-28 03:13:59.894708 | orchestrator | 2026-04-28 03:13:59.894722 | orchestrator | TASK [copy ceph key(s) if needed] ********************************************** 2026-04-28 03:13:59.894736 | orchestrator | Tuesday 28 April 2026 03:13:42 +0000 (0:00:11.742) 0:01:55.882 ********* 2026-04-28 03:13:59.894781 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:13:59.894796 | orchestrator | changed: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-28 03:13:59.894811 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-28 03:13:59.894824 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:13:59.894839 | orchestrator | changed: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-28 03:13:59.894852 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-28 03:13:59.894865 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:13:59.894879 | orchestrator | changed: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-28 03:13:59.894892 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-28 03:13:59.894907 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:13:59.894922 | orchestrator | changed: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-28 03:13:59.894936 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-28 03:13:59.894949 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:13:59.894963 | orchestrator | changed: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-28 03:13:59.894978 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-28 03:13:59.894992 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 03:13:59.895007 | orchestrator | changed: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-28 03:13:59.895023 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-28 03:13:59.895037 | orchestrator | changed: [testbed-node-5 -> {{ item.1 }}] 2026-04-28 03:13:59.895052 | orchestrator | 2026-04-28 03:13:59.895066 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 03:13:59.895080 | orchestrator | testbed-node-3 : ok=25  changed=0 unreachable=0 failed=0 skipped=28  rescued=0 ignored=0 2026-04-28 03:13:59.895096 | orchestrator | testbed-node-4 : ok=18  changed=0 unreachable=0 failed=0 skipped=21  rescued=0 ignored=0 2026-04-28 03:13:59.895123 | orchestrator | testbed-node-5 : ok=23  changed=3  unreachable=0 failed=0 skipped=20  rescued=0 ignored=0 2026-04-28 03:13:59.895138 | orchestrator | 2026-04-28 03:13:59.895152 | orchestrator | 2026-04-28 03:13:59.895166 | orchestrator | 2026-04-28 03:13:59.895180 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 03:13:59.895194 | orchestrator | Tuesday 28 April 2026 03:13:59 +0000 (0:00:17.643) 0:02:13.526 ********* 2026-04-28 03:13:59.895208 | orchestrator | =============================================================================== 2026-04-28 03:13:59.895221 | orchestrator | create openstack pool(s) ----------------------------------------------- 45.27s 2026-04-28 03:13:59.895235 | orchestrator | generate keys ---------------------------------------------------------- 24.00s 2026-04-28 03:13:59.895249 | orchestrator | copy ceph key(s) if needed --------------------------------------------- 17.64s 2026-04-28 03:13:59.895277 | orchestrator | get keys from monitors ------------------------------------------------- 11.74s 2026-04-28 03:13:59.895291 | orchestrator | ceph-facts : Find a running mon container ------------------------------- 2.39s 2026-04-28 03:13:59.895305 | orchestrator | ceph-facts : Set_fact ceph_admin_command -------------------------------- 1.88s 2026-04-28 03:13:59.895319 | orchestrator | ceph-facts : Get current fsid if cluster is already running ------------- 1.81s 2026-04-28 03:13:59.895333 | orchestrator | ceph-facts : Set_fact ceph_run_cmd -------------------------------------- 1.27s 2026-04-28 03:13:59.895347 | orchestrator | ceph-facts : Set_fact _monitor_addresses - ipv4 ------------------------- 1.24s 2026-04-28 03:13:59.895361 | orchestrator | ceph-facts : Check for a ceph mon socket -------------------------------- 1.00s 2026-04-28 03:13:59.895375 | orchestrator | ceph-facts : Check if the ceph conf exists ------------------------------ 1.00s 2026-04-28 03:13:59.895389 | orchestrator | ceph-facts : Set_fact monitor_name ansible_facts['hostname'] ------------ 0.95s 2026-04-28 03:13:59.895402 | orchestrator | ceph-facts : Check if podman binary is present -------------------------- 0.90s 2026-04-28 03:13:59.895432 | orchestrator | ceph-facts : Check if the ceph mon socket is in-use --------------------- 0.81s 2026-04-28 03:14:00.312841 | orchestrator | ceph-facts : Read osd pool default crush rule --------------------------- 0.79s 2026-04-28 03:14:00.312937 | orchestrator | ceph-facts : Include facts.yml ------------------------------------------ 0.77s 2026-04-28 03:14:00.312949 | orchestrator | ceph-facts : Get current fsid ------------------------------------------- 0.73s 2026-04-28 03:14:00.312957 | orchestrator | ceph-facts : Set_fact devices generate device list when osd_auto_discovery --- 0.72s 2026-04-28 03:14:00.312966 | orchestrator | ceph-facts : Read osd pool default crush rule --------------------------- 0.72s 2026-04-28 03:14:00.312974 | orchestrator | ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6 ------ 0.69s 2026-04-28 03:14:02.875899 | orchestrator | 2026-04-28 03:14:02 | INFO  | Task fc250c4e-5fe9-4fa2-8d16-eea41922b5b3 (copy-ceph-keys) was prepared for execution. 2026-04-28 03:14:02.876029 | orchestrator | 2026-04-28 03:14:02 | INFO  | It takes a moment until task fc250c4e-5fe9-4fa2-8d16-eea41922b5b3 (copy-ceph-keys) has been started and output is visible here. 2026-04-28 03:14:43.895473 | orchestrator | 2026-04-28 03:14:43.895565 | orchestrator | PLAY [Copy ceph keys to the configuration repository] ************************** 2026-04-28 03:14:43.895575 | orchestrator | 2026-04-28 03:14:43.895581 | orchestrator | TASK [Check if ceph keys exist] ************************************************ 2026-04-28 03:14:43.895588 | orchestrator | Tuesday 28 April 2026 03:14:07 +0000 (0:00:00.176) 0:00:00.176 ********* 2026-04-28 03:14:43.895595 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.admin.keyring) 2026-04-28 03:14:43.895602 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder.keyring) 2026-04-28 03:14:43.895608 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder.keyring) 2026-04-28 03:14:43.895613 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder-backup.keyring) 2026-04-28 03:14:43.895619 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder.keyring) 2026-04-28 03:14:43.895625 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.nova.keyring) 2026-04-28 03:14:43.895631 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.glance.keyring) 2026-04-28 03:14:43.895636 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.gnocchi.keyring) 2026-04-28 03:14:43.895642 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.manila.keyring) 2026-04-28 03:14:43.895648 | orchestrator | 2026-04-28 03:14:43.895654 | orchestrator | TASK [Fetch all ceph keys] ***************************************************** 2026-04-28 03:14:43.895660 | orchestrator | Tuesday 28 April 2026 03:14:12 +0000 (0:00:04.648) 0:00:04.824 ********* 2026-04-28 03:14:43.895684 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.admin.keyring) 2026-04-28 03:14:43.895690 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder.keyring) 2026-04-28 03:14:43.895696 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder.keyring) 2026-04-28 03:14:43.895701 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder-backup.keyring) 2026-04-28 03:14:43.895718 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.cinder.keyring) 2026-04-28 03:14:43.895724 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.nova.keyring) 2026-04-28 03:14:43.895730 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.glance.keyring) 2026-04-28 03:14:43.895736 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.gnocchi.keyring) 2026-04-28 03:14:43.895780 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] => (item=ceph.client.manila.keyring) 2026-04-28 03:14:43.895786 | orchestrator | 2026-04-28 03:14:43.895792 | orchestrator | TASK [Create share directory] ************************************************** 2026-04-28 03:14:43.895798 | orchestrator | Tuesday 28 April 2026 03:14:16 +0000 (0:00:04.382) 0:00:09.207 ********* 2026-04-28 03:14:43.895804 | orchestrator | changed: [testbed-manager -> localhost] 2026-04-28 03:14:43.895811 | orchestrator | 2026-04-28 03:14:43.895816 | orchestrator | TASK [Write ceph keys to the share directory] ********************************** 2026-04-28 03:14:43.895822 | orchestrator | Tuesday 28 April 2026 03:14:17 +0000 (0:00:01.097) 0:00:10.304 ********* 2026-04-28 03:14:43.895828 | orchestrator | changed: [testbed-manager -> localhost] => (item=ceph.client.admin.keyring) 2026-04-28 03:14:43.895834 | orchestrator | changed: [testbed-manager -> localhost] => (item=ceph.client.cinder.keyring) 2026-04-28 03:14:43.895840 | orchestrator | ok: [testbed-manager -> localhost] => (item=ceph.client.cinder.keyring) 2026-04-28 03:14:43.895846 | orchestrator | changed: [testbed-manager -> localhost] => (item=ceph.client.cinder-backup.keyring) 2026-04-28 03:14:43.895852 | orchestrator | ok: [testbed-manager -> localhost] => (item=ceph.client.cinder.keyring) 2026-04-28 03:14:43.895858 | orchestrator | changed: [testbed-manager -> localhost] => (item=ceph.client.nova.keyring) 2026-04-28 03:14:43.895864 | orchestrator | changed: [testbed-manager -> localhost] => (item=ceph.client.glance.keyring) 2026-04-28 03:14:43.895869 | orchestrator | changed: [testbed-manager -> localhost] => (item=ceph.client.gnocchi.keyring) 2026-04-28 03:14:43.895875 | orchestrator | changed: [testbed-manager -> localhost] => (item=ceph.client.manila.keyring) 2026-04-28 03:14:43.895881 | orchestrator | 2026-04-28 03:14:43.895886 | orchestrator | TASK [Check if target directories exist] *************************************** 2026-04-28 03:14:43.895895 | orchestrator | Tuesday 28 April 2026 03:14:32 +0000 (0:00:14.936) 0:00:25.241 ********* 2026-04-28 03:14:43.895905 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/infrastructure/files/ceph) 2026-04-28 03:14:43.895914 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/cinder/cinder-volume) 2026-04-28 03:14:43.895925 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/cinder/cinder-backup) 2026-04-28 03:14:43.895934 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/cinder/cinder-backup) 2026-04-28 03:14:43.895960 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/nova) 2026-04-28 03:14:43.895969 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/nova) 2026-04-28 03:14:43.895978 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/glance) 2026-04-28 03:14:43.895997 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/gnocchi) 2026-04-28 03:14:43.896006 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/manila) 2026-04-28 03:14:43.896015 | orchestrator | 2026-04-28 03:14:43.896024 | orchestrator | TASK [Write ceph keys to the configuration directory] ************************** 2026-04-28 03:14:43.896034 | orchestrator | Tuesday 28 April 2026 03:14:36 +0000 (0:00:03.295) 0:00:28.536 ********* 2026-04-28 03:14:43.896044 | orchestrator | changed: [testbed-manager] => (item=ceph.client.admin.keyring) 2026-04-28 03:14:43.896055 | orchestrator | changed: [testbed-manager] => (item=ceph.client.cinder.keyring) 2026-04-28 03:14:43.896065 | orchestrator | changed: [testbed-manager] => (item=ceph.client.cinder.keyring) 2026-04-28 03:14:43.896076 | orchestrator | changed: [testbed-manager] => (item=ceph.client.cinder-backup.keyring) 2026-04-28 03:14:43.896086 | orchestrator | changed: [testbed-manager] => (item=ceph.client.cinder.keyring) 2026-04-28 03:14:43.896096 | orchestrator | changed: [testbed-manager] => (item=ceph.client.nova.keyring) 2026-04-28 03:14:43.896105 | orchestrator | changed: [testbed-manager] => (item=ceph.client.glance.keyring) 2026-04-28 03:14:43.896112 | orchestrator | changed: [testbed-manager] => (item=ceph.client.gnocchi.keyring) 2026-04-28 03:14:43.896118 | orchestrator | changed: [testbed-manager] => (item=ceph.client.manila.keyring) 2026-04-28 03:14:43.896124 | orchestrator | 2026-04-28 03:14:43.896131 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 03:14:43.896137 | orchestrator | testbed-manager : ok=6  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 03:14:43.896145 | orchestrator | 2026-04-28 03:14:43.896152 | orchestrator | 2026-04-28 03:14:43.896158 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 03:14:43.896164 | orchestrator | Tuesday 28 April 2026 03:14:43 +0000 (0:00:07.430) 0:00:35.967 ********* 2026-04-28 03:14:43.896177 | orchestrator | =============================================================================== 2026-04-28 03:14:43.896183 | orchestrator | Write ceph keys to the share directory --------------------------------- 14.94s 2026-04-28 03:14:43.896190 | orchestrator | Write ceph keys to the configuration directory -------------------------- 7.43s 2026-04-28 03:14:43.896196 | orchestrator | Check if ceph keys exist ------------------------------------------------ 4.65s 2026-04-28 03:14:43.896203 | orchestrator | Fetch all ceph keys ----------------------------------------------------- 4.38s 2026-04-28 03:14:43.896209 | orchestrator | Check if target directories exist --------------------------------------- 3.30s 2026-04-28 03:14:43.896216 | orchestrator | Create share directory -------------------------------------------------- 1.10s 2026-04-28 03:14:56.480510 | orchestrator | 2026-04-28 03:14:56 | INFO  | Task 0e43276a-14c4-42e9-964f-b90151916bf0 (cephclient) was prepared for execution. 2026-04-28 03:14:56.480635 | orchestrator | 2026-04-28 03:14:56 | INFO  | It takes a moment until task 0e43276a-14c4-42e9-964f-b90151916bf0 (cephclient) has been started and output is visible here. 2026-04-28 03:15:59.232093 | orchestrator | 2026-04-28 03:15:59.232209 | orchestrator | PLAY [Apply role cephclient] *************************************************** 2026-04-28 03:15:59.232222 | orchestrator | 2026-04-28 03:15:59.232230 | orchestrator | TASK [osism.services.cephclient : Include container tasks] ********************* 2026-04-28 03:15:59.232238 | orchestrator | Tuesday 28 April 2026 03:15:01 +0000 (0:00:00.263) 0:00:00.264 ********* 2026-04-28 03:15:59.232246 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/cephclient/tasks/container.yml for testbed-manager 2026-04-28 03:15:59.232255 | orchestrator | 2026-04-28 03:15:59.232262 | orchestrator | TASK [osism.services.cephclient : Create required directories] ***************** 2026-04-28 03:15:59.232270 | orchestrator | Tuesday 28 April 2026 03:15:01 +0000 (0:00:00.287) 0:00:00.551 ********* 2026-04-28 03:15:59.232278 | orchestrator | changed: [testbed-manager] => (item=/opt/cephclient/configuration) 2026-04-28 03:15:59.232306 | orchestrator | changed: [testbed-manager] => (item=/opt/cephclient/data) 2026-04-28 03:15:59.232315 | orchestrator | ok: [testbed-manager] => (item=/opt/cephclient) 2026-04-28 03:15:59.232322 | orchestrator | 2026-04-28 03:15:59.232330 | orchestrator | TASK [osism.services.cephclient : Copy configuration files] ******************** 2026-04-28 03:15:59.232337 | orchestrator | Tuesday 28 April 2026 03:15:03 +0000 (0:00:01.410) 0:00:01.961 ********* 2026-04-28 03:15:59.232345 | orchestrator | changed: [testbed-manager] => (item={'src': 'ceph.conf.j2', 'dest': '/opt/cephclient/configuration/ceph.conf'}) 2026-04-28 03:15:59.232352 | orchestrator | 2026-04-28 03:15:59.232360 | orchestrator | TASK [osism.services.cephclient : Copy keyring file] *************************** 2026-04-28 03:15:59.232367 | orchestrator | Tuesday 28 April 2026 03:15:04 +0000 (0:00:01.541) 0:00:03.503 ********* 2026-04-28 03:15:59.232374 | orchestrator | changed: [testbed-manager] 2026-04-28 03:15:59.232382 | orchestrator | 2026-04-28 03:15:59.232389 | orchestrator | TASK [osism.services.cephclient : Copy docker-compose.yml file] **************** 2026-04-28 03:15:59.232397 | orchestrator | Tuesday 28 April 2026 03:15:05 +0000 (0:00:00.943) 0:00:04.447 ********* 2026-04-28 03:15:59.232404 | orchestrator | changed: [testbed-manager] 2026-04-28 03:15:59.232411 | orchestrator | 2026-04-28 03:15:59.232418 | orchestrator | TASK [osism.services.cephclient : Manage cephclient service] ******************* 2026-04-28 03:15:59.232442 | orchestrator | Tuesday 28 April 2026 03:15:06 +0000 (0:00:00.979) 0:00:05.426 ********* 2026-04-28 03:15:59.232450 | orchestrator | FAILED - RETRYING: [testbed-manager]: Manage cephclient service (10 retries left). 2026-04-28 03:15:59.232457 | orchestrator | ok: [testbed-manager] 2026-04-28 03:15:59.232464 | orchestrator | 2026-04-28 03:15:59.232471 | orchestrator | TASK [osism.services.cephclient : Copy wrapper scripts] ************************ 2026-04-28 03:15:59.232478 | orchestrator | Tuesday 28 April 2026 03:15:48 +0000 (0:00:42.038) 0:00:47.464 ********* 2026-04-28 03:15:59.232486 | orchestrator | changed: [testbed-manager] => (item=ceph) 2026-04-28 03:15:59.232494 | orchestrator | changed: [testbed-manager] => (item=ceph-authtool) 2026-04-28 03:15:59.232501 | orchestrator | changed: [testbed-manager] => (item=rados) 2026-04-28 03:15:59.232508 | orchestrator | changed: [testbed-manager] => (item=radosgw-admin) 2026-04-28 03:15:59.232515 | orchestrator | changed: [testbed-manager] => (item=rbd) 2026-04-28 03:15:59.232522 | orchestrator | 2026-04-28 03:15:59.232530 | orchestrator | TASK [osism.services.cephclient : Remove old wrapper scripts] ****************** 2026-04-28 03:15:59.232537 | orchestrator | Tuesday 28 April 2026 03:15:52 +0000 (0:00:04.365) 0:00:51.830 ********* 2026-04-28 03:15:59.232544 | orchestrator | ok: [testbed-manager] => (item=crushtool) 2026-04-28 03:15:59.232554 | orchestrator | 2026-04-28 03:15:59.232568 | orchestrator | TASK [osism.services.cephclient : Include package tasks] *********************** 2026-04-28 03:15:59.232590 | orchestrator | Tuesday 28 April 2026 03:15:53 +0000 (0:00:00.524) 0:00:52.354 ********* 2026-04-28 03:15:59.232607 | orchestrator | skipping: [testbed-manager] 2026-04-28 03:15:59.232620 | orchestrator | 2026-04-28 03:15:59.232635 | orchestrator | TASK [osism.services.cephclient : Include rook task] *************************** 2026-04-28 03:15:59.232649 | orchestrator | Tuesday 28 April 2026 03:15:53 +0000 (0:00:00.152) 0:00:52.507 ********* 2026-04-28 03:15:59.232661 | orchestrator | skipping: [testbed-manager] 2026-04-28 03:15:59.232676 | orchestrator | 2026-04-28 03:15:59.232691 | orchestrator | RUNNING HANDLER [osism.services.cephclient : Restart cephclient service] ******* 2026-04-28 03:15:59.232706 | orchestrator | Tuesday 28 April 2026 03:15:54 +0000 (0:00:00.568) 0:00:53.075 ********* 2026-04-28 03:15:59.232722 | orchestrator | changed: [testbed-manager] 2026-04-28 03:15:59.232762 | orchestrator | 2026-04-28 03:15:59.232779 | orchestrator | RUNNING HANDLER [osism.services.cephclient : Ensure that all containers are up] *** 2026-04-28 03:15:59.232795 | orchestrator | Tuesday 28 April 2026 03:15:55 +0000 (0:00:01.494) 0:00:54.570 ********* 2026-04-28 03:15:59.232805 | orchestrator | changed: [testbed-manager] 2026-04-28 03:15:59.232815 | orchestrator | 2026-04-28 03:15:59.232840 | orchestrator | RUNNING HANDLER [osism.services.cephclient : Wait for an healthy service] ****** 2026-04-28 03:15:59.232867 | orchestrator | Tuesday 28 April 2026 03:15:56 +0000 (0:00:00.856) 0:00:55.427 ********* 2026-04-28 03:15:59.232877 | orchestrator | changed: [testbed-manager] 2026-04-28 03:15:59.232886 | orchestrator | 2026-04-28 03:15:59.232896 | orchestrator | RUNNING HANDLER [osism.services.cephclient : Copy bash completion scripts] ***** 2026-04-28 03:15:59.232906 | orchestrator | Tuesday 28 April 2026 03:15:57 +0000 (0:00:00.637) 0:00:56.065 ********* 2026-04-28 03:15:59.232916 | orchestrator | ok: [testbed-manager] => (item=ceph) 2026-04-28 03:15:59.232926 | orchestrator | ok: [testbed-manager] => (item=rados) 2026-04-28 03:15:59.232936 | orchestrator | ok: [testbed-manager] => (item=radosgw-admin) 2026-04-28 03:15:59.232945 | orchestrator | ok: [testbed-manager] => (item=rbd) 2026-04-28 03:15:59.232955 | orchestrator | 2026-04-28 03:15:59.232965 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 03:15:59.232975 | orchestrator | testbed-manager : ok=12  changed=8  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 03:15:59.232986 | orchestrator | 2026-04-28 03:15:59.232995 | orchestrator | 2026-04-28 03:15:59.233021 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 03:15:59.233030 | orchestrator | Tuesday 28 April 2026 03:15:58 +0000 (0:00:01.602) 0:00:57.668 ********* 2026-04-28 03:15:59.233039 | orchestrator | =============================================================================== 2026-04-28 03:15:59.233047 | orchestrator | osism.services.cephclient : Manage cephclient service ------------------ 42.04s 2026-04-28 03:15:59.233056 | orchestrator | osism.services.cephclient : Copy wrapper scripts ------------------------ 4.37s 2026-04-28 03:15:59.233065 | orchestrator | osism.services.cephclient : Copy bash completion scripts ---------------- 1.60s 2026-04-28 03:15:59.233073 | orchestrator | osism.services.cephclient : Copy configuration files -------------------- 1.54s 2026-04-28 03:15:59.233082 | orchestrator | osism.services.cephclient : Restart cephclient service ------------------ 1.49s 2026-04-28 03:15:59.233090 | orchestrator | osism.services.cephclient : Create required directories ----------------- 1.41s 2026-04-28 03:15:59.233099 | orchestrator | osism.services.cephclient : Copy docker-compose.yml file ---------------- 0.98s 2026-04-28 03:15:59.233107 | orchestrator | osism.services.cephclient : Copy keyring file --------------------------- 0.94s 2026-04-28 03:15:59.233116 | orchestrator | osism.services.cephclient : Ensure that all containers are up ----------- 0.86s 2026-04-28 03:15:59.233124 | orchestrator | osism.services.cephclient : Wait for an healthy service ----------------- 0.64s 2026-04-28 03:15:59.233133 | orchestrator | osism.services.cephclient : Include rook task --------------------------- 0.57s 2026-04-28 03:15:59.233147 | orchestrator | osism.services.cephclient : Remove old wrapper scripts ------------------ 0.52s 2026-04-28 03:15:59.233166 | orchestrator | osism.services.cephclient : Include container tasks --------------------- 0.29s 2026-04-28 03:15:59.233186 | orchestrator | osism.services.cephclient : Include package tasks ----------------------- 0.15s 2026-04-28 03:16:01.896443 | orchestrator | 2026-04-28 03:16:01 | INFO  | Task ce85ee73-53c0-4700-8811-0470a0b99b89 (ceph-bootstrap-dashboard) was prepared for execution. 2026-04-28 03:16:01.896568 | orchestrator | 2026-04-28 03:16:01 | INFO  | It takes a moment until task ce85ee73-53c0-4700-8811-0470a0b99b89 (ceph-bootstrap-dashboard) has been started and output is visible here. 2026-04-28 03:17:21.248559 | orchestrator | [WARNING]: Collection community.general does not support Ansible version 2026-04-28 03:17:21.248696 | orchestrator | 2.16.14 2026-04-28 03:17:21.248716 | orchestrator | 2026-04-28 03:17:21.248730 | orchestrator | PLAY [Bootstraph ceph dashboard] *********************************************** 2026-04-28 03:17:21.248802 | orchestrator | 2026-04-28 03:17:21.248814 | orchestrator | TASK [Disable the ceph dashboard] ********************************************** 2026-04-28 03:17:21.248826 | orchestrator | Tuesday 28 April 2026 03:16:06 +0000 (0:00:00.300) 0:00:00.300 ********* 2026-04-28 03:17:21.248837 | orchestrator | changed: [testbed-manager] 2026-04-28 03:17:21.248849 | orchestrator | 2026-04-28 03:17:21.248860 | orchestrator | TASK [Set mgr/dashboard/ssl to false] ****************************************** 2026-04-28 03:17:21.248901 | orchestrator | Tuesday 28 April 2026 03:16:08 +0000 (0:00:02.128) 0:00:02.428 ********* 2026-04-28 03:17:21.248913 | orchestrator | changed: [testbed-manager] 2026-04-28 03:17:21.248923 | orchestrator | 2026-04-28 03:17:21.248934 | orchestrator | TASK [Set mgr/dashboard/server_port to 7000] *********************************** 2026-04-28 03:17:21.248945 | orchestrator | Tuesday 28 April 2026 03:16:09 +0000 (0:00:01.136) 0:00:03.565 ********* 2026-04-28 03:17:21.248956 | orchestrator | changed: [testbed-manager] 2026-04-28 03:17:21.248967 | orchestrator | 2026-04-28 03:17:21.248978 | orchestrator | TASK [Set mgr/dashboard/server_addr to 0.0.0.0] ******************************** 2026-04-28 03:17:21.248989 | orchestrator | Tuesday 28 April 2026 03:16:11 +0000 (0:00:01.118) 0:00:04.683 ********* 2026-04-28 03:17:21.249000 | orchestrator | changed: [testbed-manager] 2026-04-28 03:17:21.249010 | orchestrator | 2026-04-28 03:17:21.249021 | orchestrator | TASK [Set mgr/dashboard/standby_behaviour to error] **************************** 2026-04-28 03:17:21.249032 | orchestrator | Tuesday 28 April 2026 03:16:12 +0000 (0:00:01.321) 0:00:06.005 ********* 2026-04-28 03:17:21.249043 | orchestrator | changed: [testbed-manager] 2026-04-28 03:17:21.249053 | orchestrator | 2026-04-28 03:17:21.249067 | orchestrator | TASK [Set mgr/dashboard/standby_error_status_code to 404] ********************** 2026-04-28 03:17:21.249080 | orchestrator | Tuesday 28 April 2026 03:16:13 +0000 (0:00:01.106) 0:00:07.112 ********* 2026-04-28 03:17:21.249092 | orchestrator | changed: [testbed-manager] 2026-04-28 03:17:21.249104 | orchestrator | 2026-04-28 03:17:21.249116 | orchestrator | TASK [Enable the ceph dashboard] *********************************************** 2026-04-28 03:17:21.249129 | orchestrator | Tuesday 28 April 2026 03:16:14 +0000 (0:00:01.129) 0:00:08.241 ********* 2026-04-28 03:17:21.249142 | orchestrator | changed: [testbed-manager] 2026-04-28 03:17:21.249155 | orchestrator | 2026-04-28 03:17:21.249183 | orchestrator | TASK [Write ceph_dashboard_password to temporary file] ************************* 2026-04-28 03:17:21.249196 | orchestrator | Tuesday 28 April 2026 03:16:16 +0000 (0:00:02.051) 0:00:10.293 ********* 2026-04-28 03:17:21.249209 | orchestrator | changed: [testbed-manager] 2026-04-28 03:17:21.249221 | orchestrator | 2026-04-28 03:17:21.249234 | orchestrator | TASK [Create admin user] ******************************************************* 2026-04-28 03:17:21.249246 | orchestrator | Tuesday 28 April 2026 03:16:18 +0000 (0:00:01.393) 0:00:11.686 ********* 2026-04-28 03:17:21.249258 | orchestrator | changed: [testbed-manager] 2026-04-28 03:17:21.249271 | orchestrator | 2026-04-28 03:17:21.249283 | orchestrator | TASK [Remove temporary file for ceph_dashboard_password] *********************** 2026-04-28 03:17:21.249295 | orchestrator | Tuesday 28 April 2026 03:16:55 +0000 (0:00:37.775) 0:00:49.462 ********* 2026-04-28 03:17:21.249307 | orchestrator | skipping: [testbed-manager] 2026-04-28 03:17:21.249319 | orchestrator | 2026-04-28 03:17:21.249331 | orchestrator | PLAY [Restart ceph manager services] ******************************************* 2026-04-28 03:17:21.249343 | orchestrator | 2026-04-28 03:17:21.249355 | orchestrator | TASK [Restart ceph manager service] ******************************************** 2026-04-28 03:17:21.249367 | orchestrator | Tuesday 28 April 2026 03:16:55 +0000 (0:00:00.173) 0:00:49.636 ********* 2026-04-28 03:17:21.249383 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:17:21.249403 | orchestrator | 2026-04-28 03:17:21.249422 | orchestrator | PLAY [Restart ceph manager services] ******************************************* 2026-04-28 03:17:21.249441 | orchestrator | 2026-04-28 03:17:21.249458 | orchestrator | TASK [Restart ceph manager service] ******************************************** 2026-04-28 03:17:21.249477 | orchestrator | Tuesday 28 April 2026 03:17:08 +0000 (0:00:12.146) 0:01:01.783 ********* 2026-04-28 03:17:21.249495 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:17:21.249514 | orchestrator | 2026-04-28 03:17:21.249535 | orchestrator | PLAY [Restart ceph manager services] ******************************************* 2026-04-28 03:17:21.249554 | orchestrator | 2026-04-28 03:17:21.249574 | orchestrator | TASK [Restart ceph manager service] ******************************************** 2026-04-28 03:17:21.249594 | orchestrator | Tuesday 28 April 2026 03:17:09 +0000 (0:00:01.280) 0:01:03.063 ********* 2026-04-28 03:17:21.249607 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:17:21.249630 | orchestrator | 2026-04-28 03:17:21.249642 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 03:17:21.249654 | orchestrator | testbed-manager : ok=9  changed=9  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 03:17:21.249667 | orchestrator | testbed-node-0 : ok=1  changed=1  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 03:17:21.249678 | orchestrator | testbed-node-1 : ok=1  changed=1  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 03:17:21.249689 | orchestrator | testbed-node-2 : ok=1  changed=1  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 03:17:21.249700 | orchestrator | 2026-04-28 03:17:21.249711 | orchestrator | 2026-04-28 03:17:21.249721 | orchestrator | 2026-04-28 03:17:21.249790 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 03:17:21.249812 | orchestrator | Tuesday 28 April 2026 03:17:20 +0000 (0:00:11.375) 0:01:14.439 ********* 2026-04-28 03:17:21.249830 | orchestrator | =============================================================================== 2026-04-28 03:17:21.249848 | orchestrator | Create admin user ------------------------------------------------------ 37.78s 2026-04-28 03:17:21.249886 | orchestrator | Restart ceph manager service ------------------------------------------- 24.80s 2026-04-28 03:17:21.249897 | orchestrator | Disable the ceph dashboard ---------------------------------------------- 2.13s 2026-04-28 03:17:21.249908 | orchestrator | Enable the ceph dashboard ----------------------------------------------- 2.05s 2026-04-28 03:17:21.249919 | orchestrator | Write ceph_dashboard_password to temporary file ------------------------- 1.39s 2026-04-28 03:17:21.249930 | orchestrator | Set mgr/dashboard/server_addr to 0.0.0.0 -------------------------------- 1.32s 2026-04-28 03:17:21.249940 | orchestrator | Set mgr/dashboard/ssl to false ------------------------------------------ 1.14s 2026-04-28 03:17:21.249951 | orchestrator | Set mgr/dashboard/standby_error_status_code to 404 ---------------------- 1.13s 2026-04-28 03:17:21.249962 | orchestrator | Set mgr/dashboard/server_port to 7000 ----------------------------------- 1.12s 2026-04-28 03:17:21.249973 | orchestrator | Set mgr/dashboard/standby_behaviour to error ---------------------------- 1.11s 2026-04-28 03:17:21.249983 | orchestrator | Remove temporary file for ceph_dashboard_password ----------------------- 0.17s 2026-04-28 03:17:21.729652 | orchestrator | + sh -c /opt/configuration/scripts/deploy/300-openstack.sh 2026-04-28 03:17:24.037084 | orchestrator | 2026-04-28 03:17:24 | INFO  | Task bcbef16d-dab2-4815-89af-bfc5cadb2839 (keystone) was prepared for execution. 2026-04-28 03:17:24.037178 | orchestrator | 2026-04-28 03:17:24 | INFO  | It takes a moment until task bcbef16d-dab2-4815-89af-bfc5cadb2839 (keystone) has been started and output is visible here. 2026-04-28 03:17:31.885887 | orchestrator | 2026-04-28 03:17:31.885983 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 03:17:31.885995 | orchestrator | 2026-04-28 03:17:31.886004 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 03:17:31.886090 | orchestrator | Tuesday 28 April 2026 03:17:28 +0000 (0:00:00.315) 0:00:00.315 ********* 2026-04-28 03:17:31.886103 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:17:31.886113 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:17:31.886121 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:17:31.886129 | orchestrator | 2026-04-28 03:17:31.886136 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 03:17:31.886158 | orchestrator | Tuesday 28 April 2026 03:17:29 +0000 (0:00:00.347) 0:00:00.662 ********* 2026-04-28 03:17:31.886166 | orchestrator | ok: [testbed-node-0] => (item=enable_keystone_True) 2026-04-28 03:17:31.886174 | orchestrator | ok: [testbed-node-1] => (item=enable_keystone_True) 2026-04-28 03:17:31.886182 | orchestrator | ok: [testbed-node-2] => (item=enable_keystone_True) 2026-04-28 03:17:31.886210 | orchestrator | 2026-04-28 03:17:31.886218 | orchestrator | PLAY [Apply role keystone] ***************************************************** 2026-04-28 03:17:31.886225 | orchestrator | 2026-04-28 03:17:31.886245 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-28 03:17:31.886262 | orchestrator | Tuesday 28 April 2026 03:17:29 +0000 (0:00:00.474) 0:00:01.137 ********* 2026-04-28 03:17:31.886270 | orchestrator | included: /ansible/roles/keystone/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:17:31.886278 | orchestrator | 2026-04-28 03:17:31.886286 | orchestrator | TASK [keystone : Ensuring config directories exist] **************************** 2026-04-28 03:17:31.886293 | orchestrator | Tuesday 28 April 2026 03:17:30 +0000 (0:00:00.630) 0:00:01.768 ********* 2026-04-28 03:17:31.886305 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-28 03:17:31.886317 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-28 03:17:31.886341 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-28 03:17:31.886356 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 03:17:31.886376 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 03:17:31.886385 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 03:17:31.886393 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 03:17:31.886402 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 03:17:31.886411 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 03:17:31.886419 | orchestrator | 2026-04-28 03:17:31.886428 | orchestrator | TASK [keystone : Check if policies shall be overwritten] *********************** 2026-04-28 03:17:31.886441 | orchestrator | Tuesday 28 April 2026 03:17:31 +0000 (0:00:01.754) 0:00:03.522 ********* 2026-04-28 03:17:37.904555 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:17:37.904713 | orchestrator | 2026-04-28 03:17:37.904848 | orchestrator | TASK [keystone : Set keystone policy file] ************************************* 2026-04-28 03:17:37.904868 | orchestrator | Tuesday 28 April 2026 03:17:32 +0000 (0:00:00.356) 0:00:03.878 ********* 2026-04-28 03:17:37.904882 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:17:37.904898 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:17:37.904911 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:17:37.904925 | orchestrator | 2026-04-28 03:17:37.904939 | orchestrator | TASK [keystone : Check if Keystone domain-specific config is supplied] ********* 2026-04-28 03:17:37.904970 | orchestrator | Tuesday 28 April 2026 03:17:32 +0000 (0:00:00.351) 0:00:04.229 ********* 2026-04-28 03:17:37.904984 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 03:17:37.904998 | orchestrator | 2026-04-28 03:17:37.905012 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-28 03:17:37.905026 | orchestrator | Tuesday 28 April 2026 03:17:33 +0000 (0:00:00.885) 0:00:05.115 ********* 2026-04-28 03:17:37.905040 | orchestrator | included: /ansible/roles/keystone/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:17:37.905054 | orchestrator | 2026-04-28 03:17:37.905068 | orchestrator | TASK [service-cert-copy : keystone | Copying over extra CA certificates] ******* 2026-04-28 03:17:37.905084 | orchestrator | Tuesday 28 April 2026 03:17:34 +0000 (0:00:00.646) 0:00:05.761 ********* 2026-04-28 03:17:37.905106 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-28 03:17:37.905126 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-28 03:17:37.905143 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-28 03:17:37.905200 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 03:17:37.905217 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 03:17:37.905233 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 03:17:37.905249 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 03:17:37.905265 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 03:17:37.905280 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 03:17:37.905303 | orchestrator | 2026-04-28 03:17:37.905318 | orchestrator | TASK [service-cert-copy : keystone | Copying over backend internal TLS certificate] *** 2026-04-28 03:17:37.905333 | orchestrator | Tuesday 28 April 2026 03:17:37 +0000 (0:00:03.163) 0:00:08.925 ********* 2026-04-28 03:17:37.905364 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-28 03:17:38.761985 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 03:17:38.762194 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 03:17:38.762214 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:17:38.762231 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-28 03:17:38.762271 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 03:17:38.762284 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 03:17:38.762295 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:17:38.762343 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-28 03:17:38.762357 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 03:17:38.762369 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 03:17:38.762380 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:17:38.762391 | orchestrator | 2026-04-28 03:17:38.762403 | orchestrator | TASK [service-cert-copy : keystone | Copying over backend internal TLS key] **** 2026-04-28 03:17:38.762415 | orchestrator | Tuesday 28 April 2026 03:17:37 +0000 (0:00:00.620) 0:00:09.545 ********* 2026-04-28 03:17:38.762436 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-28 03:17:38.762448 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 03:17:38.762604 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 03:17:42.257347 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:17:42.257450 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-28 03:17:42.257468 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 03:17:42.257507 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 03:17:42.257534 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:17:42.257551 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-28 03:17:42.257583 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 03:17:42.257618 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 03:17:42.257633 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:17:42.257646 | orchestrator | 2026-04-28 03:17:42.257660 | orchestrator | TASK [keystone : Copying over config.json files for services] ****************** 2026-04-28 03:17:42.257676 | orchestrator | Tuesday 28 April 2026 03:17:38 +0000 (0:00:00.855) 0:00:10.401 ********* 2026-04-28 03:17:42.257690 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-28 03:17:42.257720 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-28 03:17:42.257772 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-28 03:17:42.257803 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 03:17:47.262516 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 03:17:47.263432 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 03:17:47.263498 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 03:17:47.263508 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 03:17:47.263528 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 03:17:47.263535 | orchestrator | 2026-04-28 03:17:47.263543 | orchestrator | TASK [keystone : Copying over keystone.conf] *********************************** 2026-04-28 03:17:47.263552 | orchestrator | Tuesday 28 April 2026 03:17:42 +0000 (0:00:03.498) 0:00:13.900 ********* 2026-04-28 03:17:47.263580 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-28 03:17:47.263589 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-28 03:17:47.263602 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 03:17:47.263609 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 03:17:47.263620 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-28 03:17:47.263632 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 03:17:51.128763 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 03:17:51.128880 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 03:17:51.128891 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 03:17:51.128900 | orchestrator | 2026-04-28 03:17:51.128910 | orchestrator | TASK [keystone : Copying keystone-startup script for keystone] ***************** 2026-04-28 03:17:51.128927 | orchestrator | Tuesday 28 April 2026 03:17:47 +0000 (0:00:05.005) 0:00:18.905 ********* 2026-04-28 03:17:51.128935 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:17:51.128944 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:17:51.128951 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:17:51.128959 | orchestrator | 2026-04-28 03:17:51.128966 | orchestrator | TASK [keystone : Create Keystone domain-specific config directory] ************* 2026-04-28 03:17:51.128974 | orchestrator | Tuesday 28 April 2026 03:17:48 +0000 (0:00:01.452) 0:00:20.358 ********* 2026-04-28 03:17:51.128981 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:17:51.128989 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:17:51.128996 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:17:51.129004 | orchestrator | 2026-04-28 03:17:51.129011 | orchestrator | TASK [keystone : Get file list in custom domains folder] *********************** 2026-04-28 03:17:51.129019 | orchestrator | Tuesday 28 April 2026 03:17:49 +0000 (0:00:00.837) 0:00:21.196 ********* 2026-04-28 03:17:51.129026 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:17:51.129033 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:17:51.129041 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:17:51.129048 | orchestrator | 2026-04-28 03:17:51.129056 | orchestrator | TASK [keystone : Copying Keystone Domain specific settings] ******************** 2026-04-28 03:17:51.129063 | orchestrator | Tuesday 28 April 2026 03:17:50 +0000 (0:00:00.577) 0:00:21.773 ********* 2026-04-28 03:17:51.129071 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:17:51.129078 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:17:51.129085 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:17:51.129092 | orchestrator | 2026-04-28 03:17:51.129112 | orchestrator | TASK [keystone : Copying over existing policy file] **************************** 2026-04-28 03:17:51.129120 | orchestrator | Tuesday 28 April 2026 03:17:50 +0000 (0:00:00.334) 0:00:22.108 ********* 2026-04-28 03:17:51.129146 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-28 03:17:51.129163 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 03:17:51.129172 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 03:17:51.129180 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:17:51.129188 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-28 03:17:51.129196 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 03:17:51.129209 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 03:17:51.129222 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:17:51.129238 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}})  2026-04-28 03:18:10.533635 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 03:18:10.533716 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 03:18:10.533723 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:18:10.533780 | orchestrator | 2026-04-28 03:18:10.533788 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-28 03:18:10.533793 | orchestrator | Tuesday 28 April 2026 03:17:51 +0000 (0:00:00.652) 0:00:22.760 ********* 2026-04-28 03:18:10.533797 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:18:10.533802 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:18:10.533806 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:18:10.533810 | orchestrator | 2026-04-28 03:18:10.533814 | orchestrator | TASK [keystone : Copying over wsgi-keystone.conf] ****************************** 2026-04-28 03:18:10.533818 | orchestrator | Tuesday 28 April 2026 03:17:51 +0000 (0:00:00.366) 0:00:23.126 ********* 2026-04-28 03:18:10.533822 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/keystone/templates/wsgi-keystone.conf.j2) 2026-04-28 03:18:10.533827 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/keystone/templates/wsgi-keystone.conf.j2) 2026-04-28 03:18:10.533831 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/keystone/templates/wsgi-keystone.conf.j2) 2026-04-28 03:18:10.533835 | orchestrator | 2026-04-28 03:18:10.533838 | orchestrator | TASK [keystone : Checking whether keystone-paste.ini file exists] ************** 2026-04-28 03:18:10.533842 | orchestrator | Tuesday 28 April 2026 03:17:53 +0000 (0:00:01.858) 0:00:24.985 ********* 2026-04-28 03:18:10.533873 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 03:18:10.533877 | orchestrator | 2026-04-28 03:18:10.533881 | orchestrator | TASK [keystone : Copying over keystone-paste.ini] ****************************** 2026-04-28 03:18:10.533899 | orchestrator | Tuesday 28 April 2026 03:17:54 +0000 (0:00:00.988) 0:00:25.973 ********* 2026-04-28 03:18:10.533906 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:18:10.533911 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:18:10.533918 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:18:10.533923 | orchestrator | 2026-04-28 03:18:10.533929 | orchestrator | TASK [keystone : Generate the required cron jobs for the node] ***************** 2026-04-28 03:18:10.533935 | orchestrator | Tuesday 28 April 2026 03:17:54 +0000 (0:00:00.606) 0:00:26.579 ********* 2026-04-28 03:18:10.533940 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-28 03:18:10.533946 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 03:18:10.533952 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-28 03:18:10.533958 | orchestrator | 2026-04-28 03:18:10.533964 | orchestrator | TASK [keystone : Set fact with the generated cron jobs for building the crontab later] *** 2026-04-28 03:18:10.533972 | orchestrator | Tuesday 28 April 2026 03:17:56 +0000 (0:00:01.197) 0:00:27.777 ********* 2026-04-28 03:18:10.533978 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:18:10.533986 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:18:10.533992 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:18:10.533999 | orchestrator | 2026-04-28 03:18:10.534005 | orchestrator | TASK [keystone : Copying files for keystone-fernet] **************************** 2026-04-28 03:18:10.534009 | orchestrator | Tuesday 28 April 2026 03:17:56 +0000 (0:00:00.550) 0:00:28.328 ********* 2026-04-28 03:18:10.534013 | orchestrator | changed: [testbed-node-0] => (item={'src': 'crontab.j2', 'dest': 'crontab'}) 2026-04-28 03:18:10.534060 | orchestrator | changed: [testbed-node-1] => (item={'src': 'crontab.j2', 'dest': 'crontab'}) 2026-04-28 03:18:10.534064 | orchestrator | changed: [testbed-node-2] => (item={'src': 'crontab.j2', 'dest': 'crontab'}) 2026-04-28 03:18:10.534068 | orchestrator | changed: [testbed-node-0] => (item={'src': 'fernet-rotate.sh.j2', 'dest': 'fernet-rotate.sh'}) 2026-04-28 03:18:10.534072 | orchestrator | changed: [testbed-node-1] => (item={'src': 'fernet-rotate.sh.j2', 'dest': 'fernet-rotate.sh'}) 2026-04-28 03:18:10.534076 | orchestrator | changed: [testbed-node-2] => (item={'src': 'fernet-rotate.sh.j2', 'dest': 'fernet-rotate.sh'}) 2026-04-28 03:18:10.534080 | orchestrator | changed: [testbed-node-1] => (item={'src': 'fernet-node-sync.sh.j2', 'dest': 'fernet-node-sync.sh'}) 2026-04-28 03:18:10.534084 | orchestrator | changed: [testbed-node-0] => (item={'src': 'fernet-node-sync.sh.j2', 'dest': 'fernet-node-sync.sh'}) 2026-04-28 03:18:10.534100 | orchestrator | changed: [testbed-node-2] => (item={'src': 'fernet-node-sync.sh.j2', 'dest': 'fernet-node-sync.sh'}) 2026-04-28 03:18:10.534104 | orchestrator | changed: [testbed-node-1] => (item={'src': 'fernet-push.sh.j2', 'dest': 'fernet-push.sh'}) 2026-04-28 03:18:10.534108 | orchestrator | changed: [testbed-node-0] => (item={'src': 'fernet-push.sh.j2', 'dest': 'fernet-push.sh'}) 2026-04-28 03:18:10.534111 | orchestrator | changed: [testbed-node-2] => (item={'src': 'fernet-push.sh.j2', 'dest': 'fernet-push.sh'}) 2026-04-28 03:18:10.534115 | orchestrator | changed: [testbed-node-1] => (item={'src': 'fernet-healthcheck.sh.j2', 'dest': 'fernet-healthcheck.sh'}) 2026-04-28 03:18:10.534119 | orchestrator | changed: [testbed-node-0] => (item={'src': 'fernet-healthcheck.sh.j2', 'dest': 'fernet-healthcheck.sh'}) 2026-04-28 03:18:10.534123 | orchestrator | changed: [testbed-node-2] => (item={'src': 'fernet-healthcheck.sh.j2', 'dest': 'fernet-healthcheck.sh'}) 2026-04-28 03:18:10.534127 | orchestrator | changed: [testbed-node-1] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-28 03:18:10.534130 | orchestrator | changed: [testbed-node-0] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-28 03:18:10.534134 | orchestrator | changed: [testbed-node-2] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-28 03:18:10.534138 | orchestrator | changed: [testbed-node-1] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-28 03:18:10.534149 | orchestrator | changed: [testbed-node-0] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-28 03:18:10.534152 | orchestrator | changed: [testbed-node-2] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-28 03:18:10.534156 | orchestrator | 2026-04-28 03:18:10.534160 | orchestrator | TASK [keystone : Copying files for keystone-ssh] ******************************* 2026-04-28 03:18:10.534164 | orchestrator | Tuesday 28 April 2026 03:18:05 +0000 (0:00:08.847) 0:00:37.175 ********* 2026-04-28 03:18:10.534167 | orchestrator | changed: [testbed-node-0] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-28 03:18:10.534171 | orchestrator | changed: [testbed-node-1] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-28 03:18:10.534175 | orchestrator | changed: [testbed-node-2] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-28 03:18:10.534179 | orchestrator | changed: [testbed-node-0] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-28 03:18:10.534184 | orchestrator | changed: [testbed-node-1] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-28 03:18:10.534188 | orchestrator | changed: [testbed-node-2] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-28 03:18:10.534195 | orchestrator | 2026-04-28 03:18:10.534201 | orchestrator | TASK [keystone : Check keystone containers] ************************************ 2026-04-28 03:18:10.534208 | orchestrator | Tuesday 28 April 2026 03:18:08 +0000 (0:00:02.734) 0:00:39.910 ********* 2026-04-28 03:18:10.534221 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-28 03:18:10.534235 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-28 03:19:51.869710 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin']}}}}) 2026-04-28 03:19:51.869897 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 03:19:51.869934 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 03:19:51.869948 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 03:19:51.869959 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 03:19:51.869989 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 03:19:51.870002 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 03:19:51.870092 | orchestrator | 2026-04-28 03:19:51.870108 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-28 03:19:51.870120 | orchestrator | Tuesday 28 April 2026 03:18:10 +0000 (0:00:02.262) 0:00:42.173 ********* 2026-04-28 03:19:51.870132 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:19:51.870144 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:19:51.870155 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:19:51.870165 | orchestrator | 2026-04-28 03:19:51.870177 | orchestrator | TASK [keystone : Creating keystone database] *********************************** 2026-04-28 03:19:51.870189 | orchestrator | Tuesday 28 April 2026 03:18:11 +0000 (0:00:00.543) 0:00:42.716 ********* 2026-04-28 03:19:51.870202 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:19:51.870214 | orchestrator | 2026-04-28 03:19:51.870226 | orchestrator | TASK [keystone : Creating Keystone database user and setting permissions] ****** 2026-04-28 03:19:51.870239 | orchestrator | Tuesday 28 April 2026 03:18:13 +0000 (0:00:02.159) 0:00:44.876 ********* 2026-04-28 03:19:51.870251 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:19:51.870266 | orchestrator | 2026-04-28 03:19:51.870285 | orchestrator | TASK [keystone : Checking for any running keystone_fernet containers] ********** 2026-04-28 03:19:51.870316 | orchestrator | Tuesday 28 April 2026 03:18:15 +0000 (0:00:02.391) 0:00:47.268 ********* 2026-04-28 03:19:51.870336 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:19:51.870354 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:19:51.870371 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:19:51.870388 | orchestrator | 2026-04-28 03:19:51.870405 | orchestrator | TASK [keystone : Group nodes where keystone_fernet is running] ***************** 2026-04-28 03:19:51.870424 | orchestrator | Tuesday 28 April 2026 03:18:16 +0000 (0:00:00.865) 0:00:48.133 ********* 2026-04-28 03:19:51.870442 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:19:51.870459 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:19:51.870478 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:19:51.870497 | orchestrator | 2026-04-28 03:19:51.870516 | orchestrator | TASK [keystone : Fail if any hosts need bootstrapping and not all hosts targeted] *** 2026-04-28 03:19:51.870536 | orchestrator | Tuesday 28 April 2026 03:18:16 +0000 (0:00:00.328) 0:00:48.462 ********* 2026-04-28 03:19:51.870555 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:19:51.870575 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:19:51.870593 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:19:51.870610 | orchestrator | 2026-04-28 03:19:51.870621 | orchestrator | TASK [keystone : Running Keystone bootstrap container] ************************* 2026-04-28 03:19:51.870641 | orchestrator | Tuesday 28 April 2026 03:18:17 +0000 (0:00:00.620) 0:00:49.082 ********* 2026-04-28 03:19:51.870652 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:19:51.870663 | orchestrator | 2026-04-28 03:19:51.870674 | orchestrator | TASK [keystone : Running Keystone fernet bootstrap container] ****************** 2026-04-28 03:19:51.870685 | orchestrator | Tuesday 28 April 2026 03:18:31 +0000 (0:00:14.525) 0:01:03.608 ********* 2026-04-28 03:19:51.870696 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:19:51.870706 | orchestrator | 2026-04-28 03:19:51.870717 | orchestrator | TASK [keystone : Flush handlers] *********************************************** 2026-04-28 03:19:51.870761 | orchestrator | Tuesday 28 April 2026 03:18:42 +0000 (0:00:10.504) 0:01:14.112 ********* 2026-04-28 03:19:51.870776 | orchestrator | 2026-04-28 03:19:51.870787 | orchestrator | TASK [keystone : Flush handlers] *********************************************** 2026-04-28 03:19:51.870798 | orchestrator | Tuesday 28 April 2026 03:18:42 +0000 (0:00:00.068) 0:01:14.181 ********* 2026-04-28 03:19:51.870809 | orchestrator | 2026-04-28 03:19:51.870819 | orchestrator | TASK [keystone : Flush handlers] *********************************************** 2026-04-28 03:19:51.870841 | orchestrator | Tuesday 28 April 2026 03:18:42 +0000 (0:00:00.071) 0:01:14.253 ********* 2026-04-28 03:19:51.870852 | orchestrator | 2026-04-28 03:19:51.870863 | orchestrator | RUNNING HANDLER [keystone : Restart keystone-ssh container] ******************** 2026-04-28 03:19:51.870873 | orchestrator | Tuesday 28 April 2026 03:18:42 +0000 (0:00:00.075) 0:01:14.328 ********* 2026-04-28 03:19:51.870884 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:19:51.870895 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:19:51.870906 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:19:51.870916 | orchestrator | 2026-04-28 03:19:51.870927 | orchestrator | RUNNING HANDLER [keystone : Restart keystone-fernet container] ***************** 2026-04-28 03:19:51.870938 | orchestrator | Tuesday 28 April 2026 03:19:33 +0000 (0:00:50.831) 0:02:05.160 ********* 2026-04-28 03:19:51.870948 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:19:51.870959 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:19:51.870970 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:19:51.870980 | orchestrator | 2026-04-28 03:19:51.870991 | orchestrator | RUNNING HANDLER [keystone : Restart keystone container] ************************ 2026-04-28 03:19:51.871002 | orchestrator | Tuesday 28 April 2026 03:19:43 +0000 (0:00:10.446) 0:02:15.606 ********* 2026-04-28 03:19:51.871012 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:19:51.871023 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:19:51.871034 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:19:51.871044 | orchestrator | 2026-04-28 03:19:51.871055 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-28 03:19:51.871066 | orchestrator | Tuesday 28 April 2026 03:19:51 +0000 (0:00:07.293) 0:02:22.899 ********* 2026-04-28 03:19:51.871089 | orchestrator | included: /ansible/roles/keystone/tasks/distribute_fernet.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:20:41.551349 | orchestrator | 2026-04-28 03:20:41.551452 | orchestrator | TASK [keystone : Waiting for Keystone SSH port to be UP] *********************** 2026-04-28 03:20:41.551465 | orchestrator | Tuesday 28 April 2026 03:19:51 +0000 (0:00:00.614) 0:02:23.513 ********* 2026-04-28 03:20:41.551474 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:20:41.551482 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:20:41.551490 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:20:41.551497 | orchestrator | 2026-04-28 03:20:41.551505 | orchestrator | TASK [keystone : Run key distribution] ***************************************** 2026-04-28 03:20:41.551510 | orchestrator | Tuesday 28 April 2026 03:19:53 +0000 (0:00:01.225) 0:02:24.739 ********* 2026-04-28 03:20:41.551515 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:20:41.551521 | orchestrator | 2026-04-28 03:20:41.551525 | orchestrator | TASK [keystone : Creating admin project, user, role, service, and endpoint] **** 2026-04-28 03:20:41.551530 | orchestrator | Tuesday 28 April 2026 03:19:54 +0000 (0:00:01.900) 0:02:26.640 ********* 2026-04-28 03:20:41.551535 | orchestrator | changed: [testbed-node-0] => (item=RegionOne) 2026-04-28 03:20:41.551539 | orchestrator | 2026-04-28 03:20:41.551544 | orchestrator | TASK [service-ks-register : keystone | Creating services] ********************** 2026-04-28 03:20:41.551548 | orchestrator | Tuesday 28 April 2026 03:20:06 +0000 (0:00:11.365) 0:02:38.005 ********* 2026-04-28 03:20:41.551552 | orchestrator | changed: [testbed-node-0] => (item=keystone (identity)) 2026-04-28 03:20:41.551557 | orchestrator | 2026-04-28 03:20:41.551561 | orchestrator | TASK [service-ks-register : keystone | Creating endpoints] ********************* 2026-04-28 03:20:41.551566 | orchestrator | Tuesday 28 April 2026 03:20:30 +0000 (0:00:23.973) 0:03:01.978 ********* 2026-04-28 03:20:41.551570 | orchestrator | ok: [testbed-node-0] => (item=keystone -> https://api-int.testbed.osism.xyz:5000 -> internal) 2026-04-28 03:20:41.551576 | orchestrator | ok: [testbed-node-0] => (item=keystone -> https://api.testbed.osism.xyz:5000 -> public) 2026-04-28 03:20:41.551581 | orchestrator | 2026-04-28 03:20:41.551585 | orchestrator | TASK [service-ks-register : keystone | Creating projects] ********************** 2026-04-28 03:20:41.551589 | orchestrator | Tuesday 28 April 2026 03:20:36 +0000 (0:00:05.963) 0:03:07.942 ********* 2026-04-28 03:20:41.551615 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:20:41.551620 | orchestrator | 2026-04-28 03:20:41.551624 | orchestrator | TASK [service-ks-register : keystone | Creating users] ************************* 2026-04-28 03:20:41.551629 | orchestrator | Tuesday 28 April 2026 03:20:36 +0000 (0:00:00.134) 0:03:08.076 ********* 2026-04-28 03:20:41.551633 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:20:41.551637 | orchestrator | 2026-04-28 03:20:41.551642 | orchestrator | TASK [service-ks-register : keystone | Creating roles] ************************* 2026-04-28 03:20:41.551646 | orchestrator | Tuesday 28 April 2026 03:20:36 +0000 (0:00:00.144) 0:03:08.221 ********* 2026-04-28 03:20:41.551650 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:20:41.551655 | orchestrator | 2026-04-28 03:20:41.551659 | orchestrator | TASK [service-ks-register : keystone | Granting user roles] ******************** 2026-04-28 03:20:41.551663 | orchestrator | Tuesday 28 April 2026 03:20:36 +0000 (0:00:00.149) 0:03:08.371 ********* 2026-04-28 03:20:41.551668 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:20:41.551672 | orchestrator | 2026-04-28 03:20:41.551676 | orchestrator | TASK [keystone : Creating default user role] *********************************** 2026-04-28 03:20:41.551693 | orchestrator | Tuesday 28 April 2026 03:20:37 +0000 (0:00:00.617) 0:03:08.988 ********* 2026-04-28 03:20:41.551698 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:20:41.551702 | orchestrator | 2026-04-28 03:20:41.551707 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-28 03:20:41.551711 | orchestrator | Tuesday 28 April 2026 03:20:40 +0000 (0:00:03.250) 0:03:12.239 ********* 2026-04-28 03:20:41.551715 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:20:41.551720 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:20:41.551724 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:20:41.551771 | orchestrator | 2026-04-28 03:20:41.551776 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 03:20:41.551782 | orchestrator | testbed-node-0 : ok=33  changed=19  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-28 03:20:41.551788 | orchestrator | testbed-node-1 : ok=22  changed=12  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-28 03:20:41.551792 | orchestrator | testbed-node-2 : ok=22  changed=12  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-28 03:20:41.551796 | orchestrator | 2026-04-28 03:20:41.551801 | orchestrator | 2026-04-28 03:20:41.551805 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 03:20:41.551810 | orchestrator | Tuesday 28 April 2026 03:20:41 +0000 (0:00:00.495) 0:03:12.735 ********* 2026-04-28 03:20:41.551814 | orchestrator | =============================================================================== 2026-04-28 03:20:41.551818 | orchestrator | keystone : Restart keystone-ssh container ------------------------------ 50.83s 2026-04-28 03:20:41.551823 | orchestrator | service-ks-register : keystone | Creating services --------------------- 23.97s 2026-04-28 03:20:41.551827 | orchestrator | keystone : Running Keystone bootstrap container ------------------------ 14.53s 2026-04-28 03:20:41.551831 | orchestrator | keystone : Creating admin project, user, role, service, and endpoint --- 11.37s 2026-04-28 03:20:41.551836 | orchestrator | keystone : Running Keystone fernet bootstrap container ----------------- 10.50s 2026-04-28 03:20:41.551840 | orchestrator | keystone : Restart keystone-fernet container --------------------------- 10.45s 2026-04-28 03:20:41.551844 | orchestrator | keystone : Copying files for keystone-fernet ---------------------------- 8.85s 2026-04-28 03:20:41.551849 | orchestrator | keystone : Restart keystone container ----------------------------------- 7.29s 2026-04-28 03:20:41.551856 | orchestrator | service-ks-register : keystone | Creating endpoints --------------------- 5.96s 2026-04-28 03:20:41.551881 | orchestrator | keystone : Copying over keystone.conf ----------------------------------- 5.01s 2026-04-28 03:20:41.551891 | orchestrator | keystone : Copying over config.json files for services ------------------ 3.50s 2026-04-28 03:20:41.551907 | orchestrator | keystone : Creating default user role ----------------------------------- 3.25s 2026-04-28 03:20:41.551914 | orchestrator | service-cert-copy : keystone | Copying over extra CA certificates ------- 3.16s 2026-04-28 03:20:41.551920 | orchestrator | keystone : Copying files for keystone-ssh ------------------------------- 2.73s 2026-04-28 03:20:41.551927 | orchestrator | keystone : Creating Keystone database user and setting permissions ------ 2.39s 2026-04-28 03:20:41.551935 | orchestrator | keystone : Check keystone containers ------------------------------------ 2.26s 2026-04-28 03:20:41.551941 | orchestrator | keystone : Creating keystone database ----------------------------------- 2.16s 2026-04-28 03:20:41.551948 | orchestrator | keystone : Run key distribution ----------------------------------------- 1.90s 2026-04-28 03:20:41.551956 | orchestrator | keystone : Copying over wsgi-keystone.conf ------------------------------ 1.86s 2026-04-28 03:20:41.551963 | orchestrator | keystone : Ensuring config directories exist ---------------------------- 1.75s 2026-04-28 03:20:44.087000 | orchestrator | 2026-04-28 03:20:44 | INFO  | Task 45252c35-4b05-4648-8370-72349152b424 (placement) was prepared for execution. 2026-04-28 03:20:44.087105 | orchestrator | 2026-04-28 03:20:44 | INFO  | It takes a moment until task 45252c35-4b05-4648-8370-72349152b424 (placement) has been started and output is visible here. 2026-04-28 03:21:20.521575 | orchestrator | 2026-04-28 03:21:20.521693 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 03:21:20.521707 | orchestrator | 2026-04-28 03:21:20.521714 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 03:21:20.521721 | orchestrator | Tuesday 28 April 2026 03:20:48 +0000 (0:00:00.299) 0:00:00.299 ********* 2026-04-28 03:21:20.521815 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:21:20.521825 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:21:20.521832 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:21:20.521837 | orchestrator | 2026-04-28 03:21:20.521845 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 03:21:20.521853 | orchestrator | Tuesday 28 April 2026 03:20:49 +0000 (0:00:00.375) 0:00:00.674 ********* 2026-04-28 03:21:20.521860 | orchestrator | ok: [testbed-node-0] => (item=enable_placement_True) 2026-04-28 03:21:20.521868 | orchestrator | ok: [testbed-node-1] => (item=enable_placement_True) 2026-04-28 03:21:20.521875 | orchestrator | ok: [testbed-node-2] => (item=enable_placement_True) 2026-04-28 03:21:20.521881 | orchestrator | 2026-04-28 03:21:20.521888 | orchestrator | PLAY [Apply role placement] **************************************************** 2026-04-28 03:21:20.521894 | orchestrator | 2026-04-28 03:21:20.521901 | orchestrator | TASK [placement : include_tasks] *********************************************** 2026-04-28 03:21:20.521908 | orchestrator | Tuesday 28 April 2026 03:20:49 +0000 (0:00:00.462) 0:00:01.137 ********* 2026-04-28 03:21:20.521932 | orchestrator | included: /ansible/roles/placement/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:21:20.521939 | orchestrator | 2026-04-28 03:21:20.521946 | orchestrator | TASK [service-ks-register : placement | Creating services] ********************* 2026-04-28 03:21:20.521953 | orchestrator | Tuesday 28 April 2026 03:20:50 +0000 (0:00:00.587) 0:00:01.725 ********* 2026-04-28 03:21:20.521959 | orchestrator | changed: [testbed-node-0] => (item=placement (placement)) 2026-04-28 03:21:20.521965 | orchestrator | 2026-04-28 03:21:20.521971 | orchestrator | TASK [service-ks-register : placement | Creating endpoints] ******************** 2026-04-28 03:21:20.521977 | orchestrator | Tuesday 28 April 2026 03:20:54 +0000 (0:00:03.927) 0:00:05.652 ********* 2026-04-28 03:21:20.521983 | orchestrator | changed: [testbed-node-0] => (item=placement -> https://api-int.testbed.osism.xyz:8780 -> internal) 2026-04-28 03:21:20.521991 | orchestrator | changed: [testbed-node-0] => (item=placement -> https://api.testbed.osism.xyz:8780 -> public) 2026-04-28 03:21:20.521997 | orchestrator | 2026-04-28 03:21:20.522003 | orchestrator | TASK [service-ks-register : placement | Creating projects] ********************* 2026-04-28 03:21:20.522009 | orchestrator | Tuesday 28 April 2026 03:21:00 +0000 (0:00:06.557) 0:00:12.209 ********* 2026-04-28 03:21:20.522102 | orchestrator | changed: [testbed-node-0] => (item=service) 2026-04-28 03:21:20.522109 | orchestrator | 2026-04-28 03:21:20.522115 | orchestrator | TASK [service-ks-register : placement | Creating users] ************************ 2026-04-28 03:21:20.522121 | orchestrator | Tuesday 28 April 2026 03:21:04 +0000 (0:00:03.923) 0:00:16.133 ********* 2026-04-28 03:21:20.522128 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-28 03:21:20.522134 | orchestrator | changed: [testbed-node-0] => (item=placement -> service) 2026-04-28 03:21:20.522140 | orchestrator | 2026-04-28 03:21:20.522146 | orchestrator | TASK [service-ks-register : placement | Creating roles] ************************ 2026-04-28 03:21:20.522153 | orchestrator | Tuesday 28 April 2026 03:21:09 +0000 (0:00:04.547) 0:00:20.681 ********* 2026-04-28 03:21:20.522159 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-28 03:21:20.522165 | orchestrator | 2026-04-28 03:21:20.522171 | orchestrator | TASK [service-ks-register : placement | Granting user roles] ******************* 2026-04-28 03:21:20.522177 | orchestrator | Tuesday 28 April 2026 03:21:12 +0000 (0:00:03.047) 0:00:23.728 ********* 2026-04-28 03:21:20.522184 | orchestrator | changed: [testbed-node-0] => (item=placement -> service -> admin) 2026-04-28 03:21:20.522190 | orchestrator | 2026-04-28 03:21:20.522196 | orchestrator | TASK [placement : include_tasks] *********************************************** 2026-04-28 03:21:20.522202 | orchestrator | Tuesday 28 April 2026 03:21:15 +0000 (0:00:03.714) 0:00:27.443 ********* 2026-04-28 03:21:20.522208 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:21:20.522215 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:21:20.522221 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:21:20.522227 | orchestrator | 2026-04-28 03:21:20.522233 | orchestrator | TASK [placement : Ensuring config directories exist] *************************** 2026-04-28 03:21:20.522239 | orchestrator | Tuesday 28 April 2026 03:21:16 +0000 (0:00:00.322) 0:00:27.766 ********* 2026-04-28 03:21:20.522250 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-28 03:21:20.522278 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-28 03:21:20.522292 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-28 03:21:20.522307 | orchestrator | 2026-04-28 03:21:20.522314 | orchestrator | TASK [placement : Check if policies shall be overwritten] ********************** 2026-04-28 03:21:20.522320 | orchestrator | Tuesday 28 April 2026 03:21:17 +0000 (0:00:01.128) 0:00:28.894 ********* 2026-04-28 03:21:20.522327 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:21:20.522333 | orchestrator | 2026-04-28 03:21:20.522339 | orchestrator | TASK [placement : Set placement policy file] *********************************** 2026-04-28 03:21:20.522344 | orchestrator | Tuesday 28 April 2026 03:21:17 +0000 (0:00:00.421) 0:00:29.316 ********* 2026-04-28 03:21:20.522350 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:21:20.522355 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:21:20.522361 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:21:20.522366 | orchestrator | 2026-04-28 03:21:20.522372 | orchestrator | TASK [placement : include_tasks] *********************************************** 2026-04-28 03:21:20.522378 | orchestrator | Tuesday 28 April 2026 03:21:18 +0000 (0:00:00.371) 0:00:29.687 ********* 2026-04-28 03:21:20.522384 | orchestrator | included: /ansible/roles/placement/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:21:20.522390 | orchestrator | 2026-04-28 03:21:20.522396 | orchestrator | TASK [service-cert-copy : placement | Copying over extra CA certificates] ****** 2026-04-28 03:21:20.522402 | orchestrator | Tuesday 28 April 2026 03:21:18 +0000 (0:00:00.594) 0:00:30.281 ********* 2026-04-28 03:21:20.522408 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-28 03:21:20.522422 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-28 03:21:23.489717 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-28 03:21:23.489918 | orchestrator | 2026-04-28 03:21:23.489933 | orchestrator | TASK [service-cert-copy : placement | Copying over backend internal TLS certificate] *** 2026-04-28 03:21:23.489943 | orchestrator | Tuesday 28 April 2026 03:21:20 +0000 (0:00:01.793) 0:00:32.075 ********* 2026-04-28 03:21:23.489952 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-28 03:21:23.489960 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:21:23.489968 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-28 03:21:23.489972 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:21:23.489976 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-28 03:21:23.489980 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:21:23.489989 | orchestrator | 2026-04-28 03:21:23.489994 | orchestrator | TASK [service-cert-copy : placement | Copying over backend internal TLS key] *** 2026-04-28 03:21:23.490077 | orchestrator | Tuesday 28 April 2026 03:21:21 +0000 (0:00:00.529) 0:00:32.605 ********* 2026-04-28 03:21:23.490097 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-28 03:21:23.490104 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:21:23.490110 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-28 03:21:23.490118 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:21:23.490124 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-28 03:21:23.490131 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:21:23.490136 | orchestrator | 2026-04-28 03:21:23.490142 | orchestrator | TASK [placement : Copying over config.json files for services] ***************** 2026-04-28 03:21:23.490148 | orchestrator | Tuesday 28 April 2026 03:21:21 +0000 (0:00:00.746) 0:00:33.351 ********* 2026-04-28 03:21:23.490154 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-28 03:21:23.490180 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-28 03:21:31.014199 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-28 03:21:31.014337 | orchestrator | 2026-04-28 03:21:31.014351 | orchestrator | TASK [placement : Copying over placement.conf] ********************************* 2026-04-28 03:21:31.014361 | orchestrator | Tuesday 28 April 2026 03:21:23 +0000 (0:00:01.692) 0:00:35.044 ********* 2026-04-28 03:21:31.014370 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-28 03:21:31.014379 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-28 03:21:31.014412 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-28 03:21:31.014420 | orchestrator | 2026-04-28 03:21:31.014427 | orchestrator | TASK [placement : Copying over placement-api wsgi configuration] *************** 2026-04-28 03:21:31.014466 | orchestrator | Tuesday 28 April 2026 03:21:26 +0000 (0:00:02.569) 0:00:37.613 ********* 2026-04-28 03:21:31.014502 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/placement/templates/placement-api-wsgi.conf.j2) 2026-04-28 03:21:31.014512 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/placement/templates/placement-api-wsgi.conf.j2) 2026-04-28 03:21:31.014520 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/placement/templates/placement-api-wsgi.conf.j2) 2026-04-28 03:21:31.014527 | orchestrator | 2026-04-28 03:21:31.014535 | orchestrator | TASK [placement : Copying over migrate-db.rc.j2 configuration] ***************** 2026-04-28 03:21:31.014542 | orchestrator | Tuesday 28 April 2026 03:21:27 +0000 (0:00:01.502) 0:00:39.115 ********* 2026-04-28 03:21:31.014552 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:21:31.014566 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:21:31.014578 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:21:31.014591 | orchestrator | 2026-04-28 03:21:31.014603 | orchestrator | TASK [placement : Copying over existing policy file] *************************** 2026-04-28 03:21:31.014615 | orchestrator | Tuesday 28 April 2026 03:21:29 +0000 (0:00:01.479) 0:00:40.594 ********* 2026-04-28 03:21:31.014627 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-28 03:21:31.014640 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:21:31.014652 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-28 03:21:31.014677 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:21:31.014690 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}})  2026-04-28 03:21:31.014703 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:21:31.014715 | orchestrator | 2026-04-28 03:21:31.014797 | orchestrator | TASK [placement : Check placement containers] ********************************** 2026-04-28 03:21:31.014812 | orchestrator | Tuesday 28 April 2026 03:21:29 +0000 (0:00:00.818) 0:00:41.413 ********* 2026-04-28 03:21:31.014846 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-28 03:22:00.567641 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-28 03:22:00.567799 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/placement-api:12.0.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no'}}}}) 2026-04-28 03:22:00.567831 | orchestrator | 2026-04-28 03:22:00.567842 | orchestrator | TASK [placement : Creating placement databases] ******************************** 2026-04-28 03:22:00.567851 | orchestrator | Tuesday 28 April 2026 03:21:31 +0000 (0:00:01.158) 0:00:42.571 ********* 2026-04-28 03:22:00.567858 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:22:00.567867 | orchestrator | 2026-04-28 03:22:00.567874 | orchestrator | TASK [placement : Creating placement databases user and setting permissions] *** 2026-04-28 03:22:00.567882 | orchestrator | Tuesday 28 April 2026 03:21:33 +0000 (0:00:02.068) 0:00:44.640 ********* 2026-04-28 03:22:00.567889 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:22:00.567896 | orchestrator | 2026-04-28 03:22:00.567904 | orchestrator | TASK [placement : Running placement bootstrap container] *********************** 2026-04-28 03:22:00.567911 | orchestrator | Tuesday 28 April 2026 03:21:35 +0000 (0:00:02.168) 0:00:46.808 ********* 2026-04-28 03:22:00.567919 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:22:00.567926 | orchestrator | 2026-04-28 03:22:00.567933 | orchestrator | TASK [placement : Flush handlers] ********************************************** 2026-04-28 03:22:00.567941 | orchestrator | Tuesday 28 April 2026 03:21:49 +0000 (0:00:14.159) 0:01:00.968 ********* 2026-04-28 03:22:00.567948 | orchestrator | 2026-04-28 03:22:00.567955 | orchestrator | TASK [placement : Flush handlers] ********************************************** 2026-04-28 03:22:00.567963 | orchestrator | Tuesday 28 April 2026 03:21:49 +0000 (0:00:00.090) 0:01:01.059 ********* 2026-04-28 03:22:00.567970 | orchestrator | 2026-04-28 03:22:00.567977 | orchestrator | TASK [placement : Flush handlers] ********************************************** 2026-04-28 03:22:00.567984 | orchestrator | Tuesday 28 April 2026 03:21:49 +0000 (0:00:00.078) 0:01:01.137 ********* 2026-04-28 03:22:00.567992 | orchestrator | 2026-04-28 03:22:00.567999 | orchestrator | RUNNING HANDLER [placement : Restart placement-api container] ****************** 2026-04-28 03:22:00.568006 | orchestrator | Tuesday 28 April 2026 03:21:49 +0000 (0:00:00.072) 0:01:01.209 ********* 2026-04-28 03:22:00.568014 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:22:00.568021 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:22:00.568028 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:22:00.568035 | orchestrator | 2026-04-28 03:22:00.568043 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 03:22:00.568063 | orchestrator | testbed-node-0 : ok=21  changed=16  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 03:22:00.568072 | orchestrator | testbed-node-1 : ok=12  changed=8  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 03:22:00.568079 | orchestrator | testbed-node-2 : ok=12  changed=8  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 03:22:00.568087 | orchestrator | 2026-04-28 03:22:00.568094 | orchestrator | 2026-04-28 03:22:00.568101 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 03:22:00.568109 | orchestrator | Tuesday 28 April 2026 03:22:00 +0000 (0:00:10.480) 0:01:11.690 ********* 2026-04-28 03:22:00.568116 | orchestrator | =============================================================================== 2026-04-28 03:22:00.568123 | orchestrator | placement : Running placement bootstrap container ---------------------- 14.16s 2026-04-28 03:22:00.568144 | orchestrator | placement : Restart placement-api container ---------------------------- 10.48s 2026-04-28 03:22:00.568159 | orchestrator | service-ks-register : placement | Creating endpoints -------------------- 6.56s 2026-04-28 03:22:00.568167 | orchestrator | service-ks-register : placement | Creating users ------------------------ 4.55s 2026-04-28 03:22:00.568176 | orchestrator | service-ks-register : placement | Creating services --------------------- 3.93s 2026-04-28 03:22:00.568185 | orchestrator | service-ks-register : placement | Creating projects --------------------- 3.92s 2026-04-28 03:22:00.568193 | orchestrator | service-ks-register : placement | Granting user roles ------------------- 3.71s 2026-04-28 03:22:00.568202 | orchestrator | service-ks-register : placement | Creating roles ------------------------ 3.05s 2026-04-28 03:22:00.568211 | orchestrator | placement : Copying over placement.conf --------------------------------- 2.57s 2026-04-28 03:22:00.568219 | orchestrator | placement : Creating placement databases user and setting permissions --- 2.17s 2026-04-28 03:22:00.568227 | orchestrator | placement : Creating placement databases -------------------------------- 2.07s 2026-04-28 03:22:00.568236 | orchestrator | service-cert-copy : placement | Copying over extra CA certificates ------ 1.79s 2026-04-28 03:22:00.568244 | orchestrator | placement : Copying over config.json files for services ----------------- 1.69s 2026-04-28 03:22:00.568253 | orchestrator | placement : Copying over placement-api wsgi configuration --------------- 1.50s 2026-04-28 03:22:00.568260 | orchestrator | placement : Copying over migrate-db.rc.j2 configuration ----------------- 1.48s 2026-04-28 03:22:00.568267 | orchestrator | placement : Check placement containers ---------------------------------- 1.16s 2026-04-28 03:22:00.568274 | orchestrator | placement : Ensuring config directories exist --------------------------- 1.13s 2026-04-28 03:22:00.568281 | orchestrator | placement : Copying over existing policy file --------------------------- 0.82s 2026-04-28 03:22:00.568288 | orchestrator | service-cert-copy : placement | Copying over backend internal TLS key --- 0.75s 2026-04-28 03:22:00.568296 | orchestrator | placement : include_tasks ----------------------------------------------- 0.59s 2026-04-28 03:22:03.156596 | orchestrator | 2026-04-28 03:22:03 | INFO  | Task 91998131-ff79-4c5d-8fe6-b46b330eb43b (neutron) was prepared for execution. 2026-04-28 03:22:03.156717 | orchestrator | 2026-04-28 03:22:03 | INFO  | It takes a moment until task 91998131-ff79-4c5d-8fe6-b46b330eb43b (neutron) has been started and output is visible here. 2026-04-28 03:22:53.189302 | orchestrator | 2026-04-28 03:22:53.189429 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 03:22:53.189445 | orchestrator | 2026-04-28 03:22:53.189455 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 03:22:53.189468 | orchestrator | Tuesday 28 April 2026 03:22:07 +0000 (0:00:00.269) 0:00:00.269 ********* 2026-04-28 03:22:53.189483 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:22:53.189499 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:22:53.189515 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:22:53.189531 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:22:53.189546 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:22:53.189560 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:22:53.189569 | orchestrator | 2026-04-28 03:22:53.189578 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 03:22:53.189587 | orchestrator | Tuesday 28 April 2026 03:22:08 +0000 (0:00:00.758) 0:00:01.028 ********* 2026-04-28 03:22:53.189597 | orchestrator | ok: [testbed-node-0] => (item=enable_neutron_True) 2026-04-28 03:22:53.189606 | orchestrator | ok: [testbed-node-1] => (item=enable_neutron_True) 2026-04-28 03:22:53.189615 | orchestrator | ok: [testbed-node-2] => (item=enable_neutron_True) 2026-04-28 03:22:53.189624 | orchestrator | ok: [testbed-node-3] => (item=enable_neutron_True) 2026-04-28 03:22:53.189633 | orchestrator | ok: [testbed-node-4] => (item=enable_neutron_True) 2026-04-28 03:22:53.189642 | orchestrator | ok: [testbed-node-5] => (item=enable_neutron_True) 2026-04-28 03:22:53.189650 | orchestrator | 2026-04-28 03:22:53.189659 | orchestrator | PLAY [Apply role neutron] ****************************************************** 2026-04-28 03:22:53.189668 | orchestrator | 2026-04-28 03:22:53.189677 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-28 03:22:53.189708 | orchestrator | Tuesday 28 April 2026 03:22:09 +0000 (0:00:00.724) 0:00:01.752 ********* 2026-04-28 03:22:53.189724 | orchestrator | included: /ansible/roles/neutron/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:22:53.189770 | orchestrator | 2026-04-28 03:22:53.189785 | orchestrator | TASK [neutron : Get container facts] ******************************************* 2026-04-28 03:22:53.189799 | orchestrator | Tuesday 28 April 2026 03:22:10 +0000 (0:00:01.375) 0:00:03.128 ********* 2026-04-28 03:22:53.189813 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:22:53.189847 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:22:53.189863 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:22:53.189877 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:22:53.189887 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:22:53.189896 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:22:53.189907 | orchestrator | 2026-04-28 03:22:53.189920 | orchestrator | TASK [neutron : Get container volume facts] ************************************ 2026-04-28 03:22:53.189936 | orchestrator | Tuesday 28 April 2026 03:22:11 +0000 (0:00:01.332) 0:00:04.460 ********* 2026-04-28 03:22:53.189955 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:22:53.189970 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:22:53.189986 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:22:53.190003 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:22:53.190083 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:22:53.190098 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:22:53.190107 | orchestrator | 2026-04-28 03:22:53.190118 | orchestrator | TASK [neutron : Check for ML2/OVN presence] ************************************ 2026-04-28 03:22:53.190129 | orchestrator | Tuesday 28 April 2026 03:22:13 +0000 (0:00:01.158) 0:00:05.619 ********* 2026-04-28 03:22:53.190139 | orchestrator | ok: [testbed-node-0] => { 2026-04-28 03:22:53.190149 | orchestrator |  "changed": false, 2026-04-28 03:22:53.190159 | orchestrator |  "msg": "All assertions passed" 2026-04-28 03:22:53.190170 | orchestrator | } 2026-04-28 03:22:53.190181 | orchestrator | ok: [testbed-node-1] => { 2026-04-28 03:22:53.190190 | orchestrator |  "changed": false, 2026-04-28 03:22:53.190198 | orchestrator |  "msg": "All assertions passed" 2026-04-28 03:22:53.190207 | orchestrator | } 2026-04-28 03:22:53.190215 | orchestrator | ok: [testbed-node-2] => { 2026-04-28 03:22:53.190224 | orchestrator |  "changed": false, 2026-04-28 03:22:53.190232 | orchestrator |  "msg": "All assertions passed" 2026-04-28 03:22:53.190241 | orchestrator | } 2026-04-28 03:22:53.190249 | orchestrator | ok: [testbed-node-3] => { 2026-04-28 03:22:53.190258 | orchestrator |  "changed": false, 2026-04-28 03:22:53.190266 | orchestrator |  "msg": "All assertions passed" 2026-04-28 03:22:53.190275 | orchestrator | } 2026-04-28 03:22:53.190283 | orchestrator | ok: [testbed-node-4] => { 2026-04-28 03:22:53.190292 | orchestrator |  "changed": false, 2026-04-28 03:22:53.190300 | orchestrator |  "msg": "All assertions passed" 2026-04-28 03:22:53.190309 | orchestrator | } 2026-04-28 03:22:53.190318 | orchestrator | ok: [testbed-node-5] => { 2026-04-28 03:22:53.190326 | orchestrator |  "changed": false, 2026-04-28 03:22:53.190335 | orchestrator |  "msg": "All assertions passed" 2026-04-28 03:22:53.190344 | orchestrator | } 2026-04-28 03:22:53.190352 | orchestrator | 2026-04-28 03:22:53.190361 | orchestrator | TASK [neutron : Check for ML2/OVS presence] ************************************ 2026-04-28 03:22:53.190369 | orchestrator | Tuesday 28 April 2026 03:22:13 +0000 (0:00:00.881) 0:00:06.501 ********* 2026-04-28 03:22:53.190378 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:22:53.190386 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:22:53.190395 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:22:53.190403 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:22:53.190412 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:22:53.190420 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:22:53.190429 | orchestrator | 2026-04-28 03:22:53.190437 | orchestrator | TASK [service-ks-register : neutron | Creating services] *********************** 2026-04-28 03:22:53.190459 | orchestrator | Tuesday 28 April 2026 03:22:14 +0000 (0:00:00.638) 0:00:07.140 ********* 2026-04-28 03:22:53.190468 | orchestrator | changed: [testbed-node-0] => (item=neutron (network)) 2026-04-28 03:22:53.190477 | orchestrator | 2026-04-28 03:22:53.190485 | orchestrator | TASK [service-ks-register : neutron | Creating endpoints] ********************** 2026-04-28 03:22:53.190494 | orchestrator | Tuesday 28 April 2026 03:22:18 +0000 (0:00:03.899) 0:00:11.039 ********* 2026-04-28 03:22:53.190503 | orchestrator | changed: [testbed-node-0] => (item=neutron -> https://api-int.testbed.osism.xyz:9696 -> internal) 2026-04-28 03:22:53.190512 | orchestrator | changed: [testbed-node-0] => (item=neutron -> https://api.testbed.osism.xyz:9696 -> public) 2026-04-28 03:22:53.190521 | orchestrator | 2026-04-28 03:22:53.190547 | orchestrator | TASK [service-ks-register : neutron | Creating projects] *********************** 2026-04-28 03:22:53.190556 | orchestrator | Tuesday 28 April 2026 03:22:24 +0000 (0:00:06.482) 0:00:17.522 ********* 2026-04-28 03:22:53.190565 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-28 03:22:53.190573 | orchestrator | 2026-04-28 03:22:53.190582 | orchestrator | TASK [service-ks-register : neutron | Creating users] ************************** 2026-04-28 03:22:53.190590 | orchestrator | Tuesday 28 April 2026 03:22:28 +0000 (0:00:03.121) 0:00:20.643 ********* 2026-04-28 03:22:53.190599 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-28 03:22:53.190607 | orchestrator | changed: [testbed-node-0] => (item=neutron -> service) 2026-04-28 03:22:53.190616 | orchestrator | 2026-04-28 03:22:53.190624 | orchestrator | TASK [service-ks-register : neutron | Creating roles] ************************** 2026-04-28 03:22:53.190633 | orchestrator | Tuesday 28 April 2026 03:22:32 +0000 (0:00:04.012) 0:00:24.656 ********* 2026-04-28 03:22:53.190641 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-28 03:22:53.190650 | orchestrator | 2026-04-28 03:22:53.190658 | orchestrator | TASK [service-ks-register : neutron | Granting user roles] ********************* 2026-04-28 03:22:53.190667 | orchestrator | Tuesday 28 April 2026 03:22:35 +0000 (0:00:03.132) 0:00:27.789 ********* 2026-04-28 03:22:53.190675 | orchestrator | changed: [testbed-node-0] => (item=neutron -> service -> admin) 2026-04-28 03:22:53.190684 | orchestrator | changed: [testbed-node-0] => (item=neutron -> service -> service) 2026-04-28 03:22:53.190692 | orchestrator | 2026-04-28 03:22:53.190701 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-28 03:22:53.190709 | orchestrator | Tuesday 28 April 2026 03:22:42 +0000 (0:00:07.531) 0:00:35.320 ********* 2026-04-28 03:22:53.190718 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:22:53.190747 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:22:53.190756 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:22:53.190765 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:22:53.190774 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:22:53.190782 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:22:53.190791 | orchestrator | 2026-04-28 03:22:53.190799 | orchestrator | TASK [Load and persist kernel modules] ***************************************** 2026-04-28 03:22:53.190808 | orchestrator | Tuesday 28 April 2026 03:22:43 +0000 (0:00:00.951) 0:00:36.271 ********* 2026-04-28 03:22:53.190816 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:22:53.190825 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:22:53.190840 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:22:53.190849 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:22:53.190857 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:22:53.190866 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:22:53.190875 | orchestrator | 2026-04-28 03:22:53.190883 | orchestrator | TASK [neutron : Check IPv6 support] ******************************************** 2026-04-28 03:22:53.190892 | orchestrator | Tuesday 28 April 2026 03:22:46 +0000 (0:00:02.342) 0:00:38.614 ********* 2026-04-28 03:22:53.190900 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:22:53.190909 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:22:53.190918 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:22:53.190927 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:22:53.190942 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:22:53.190951 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:22:53.190959 | orchestrator | 2026-04-28 03:22:53.190968 | orchestrator | TASK [Setting sysctl values] *************************************************** 2026-04-28 03:22:53.190977 | orchestrator | Tuesday 28 April 2026 03:22:47 +0000 (0:00:01.246) 0:00:39.861 ********* 2026-04-28 03:22:53.190985 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:22:53.190994 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:22:53.191002 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:22:53.191011 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:22:53.191019 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:22:53.191027 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:22:53.191036 | orchestrator | 2026-04-28 03:22:53.191045 | orchestrator | TASK [neutron : Ensuring config directories exist] ***************************** 2026-04-28 03:22:53.191053 | orchestrator | Tuesday 28 April 2026 03:22:50 +0000 (0:00:02.819) 0:00:42.680 ********* 2026-04-28 03:22:53.191066 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-28 03:22:53.191101 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-28 03:22:58.977282 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-28 03:22:58.977417 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 03:22:58.977459 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 03:22:58.977472 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 03:22:58.977484 | orchestrator | 2026-04-28 03:22:58.977497 | orchestrator | TASK [neutron : Check if extra ml2 plugins exists] ***************************** 2026-04-28 03:22:58.977508 | orchestrator | Tuesday 28 April 2026 03:22:53 +0000 (0:00:03.072) 0:00:45.752 ********* 2026-04-28 03:22:58.977518 | orchestrator | [WARNING]: Skipped 2026-04-28 03:22:58.977530 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/neutron/plugins/' path 2026-04-28 03:22:58.977542 | orchestrator | due to this access issue: 2026-04-28 03:22:58.977553 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/neutron/plugins/' is not 2026-04-28 03:22:58.977564 | orchestrator | a directory 2026-04-28 03:22:58.977576 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 03:22:58.977586 | orchestrator | 2026-04-28 03:22:58.977597 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-28 03:22:58.977607 | orchestrator | Tuesday 28 April 2026 03:22:54 +0000 (0:00:00.985) 0:00:46.738 ********* 2026-04-28 03:22:58.977619 | orchestrator | included: /ansible/roles/neutron/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:22:58.977631 | orchestrator | 2026-04-28 03:22:58.977641 | orchestrator | TASK [service-cert-copy : neutron | Copying over extra CA certificates] ******** 2026-04-28 03:22:58.977669 | orchestrator | Tuesday 28 April 2026 03:22:55 +0000 (0:00:01.376) 0:00:48.114 ********* 2026-04-28 03:22:58.977680 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-28 03:22:58.977708 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-28 03:22:58.977719 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-28 03:22:58.977789 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 03:22:58.977809 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 03:23:04.499148 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 03:23:04.499239 | orchestrator | 2026-04-28 03:23:04.499249 | orchestrator | TASK [service-cert-copy : neutron | Copying over backend internal TLS certificate] *** 2026-04-28 03:23:04.499258 | orchestrator | Tuesday 28 April 2026 03:22:58 +0000 (0:00:03.419) 0:00:51.534 ********* 2026-04-28 03:23:04.499279 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 03:23:04.499287 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:23:04.499295 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 03:23:04.499301 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:23:04.499317 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 03:23:04.499323 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:23:04.499344 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:23:04.499358 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:23:04.499369 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:23:04.499375 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:23:04.499382 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:23:04.499387 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:23:04.499393 | orchestrator | 2026-04-28 03:23:04.499399 | orchestrator | TASK [service-cert-copy : neutron | Copying over backend internal TLS key] ***** 2026-04-28 03:23:04.499405 | orchestrator | Tuesday 28 April 2026 03:23:01 +0000 (0:00:02.258) 0:00:53.792 ********* 2026-04-28 03:23:04.499411 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 03:23:04.499417 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:23:04.499428 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 03:23:10.839173 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:23:10.839267 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:23:10.839280 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:23:10.839302 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 03:23:10.839310 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:23:10.839317 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:23:10.839324 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:23:10.839330 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:23:10.839337 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:23:10.839344 | orchestrator | 2026-04-28 03:23:10.839351 | orchestrator | TASK [neutron : Creating TLS backend PEM File] ********************************* 2026-04-28 03:23:10.839374 | orchestrator | Tuesday 28 April 2026 03:23:04 +0000 (0:00:03.271) 0:00:57.064 ********* 2026-04-28 03:23:10.839381 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:23:10.839387 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:23:10.839393 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:23:10.839399 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:23:10.839405 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:23:10.839411 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:23:10.839417 | orchestrator | 2026-04-28 03:23:10.839424 | orchestrator | TASK [neutron : Check if policies shall be overwritten] ************************ 2026-04-28 03:23:10.839430 | orchestrator | Tuesday 28 April 2026 03:23:07 +0000 (0:00:03.000) 0:01:00.065 ********* 2026-04-28 03:23:10.839436 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:23:10.839442 | orchestrator | 2026-04-28 03:23:10.839448 | orchestrator | TASK [neutron : Set neutron policy file] *************************************** 2026-04-28 03:23:10.839469 | orchestrator | Tuesday 28 April 2026 03:23:07 +0000 (0:00:00.161) 0:01:00.226 ********* 2026-04-28 03:23:10.839476 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:23:10.839482 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:23:10.839488 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:23:10.839494 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:23:10.839500 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:23:10.839506 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:23:10.839513 | orchestrator | 2026-04-28 03:23:10.839519 | orchestrator | TASK [neutron : Copying over existing policy file] ***************************** 2026-04-28 03:23:10.839525 | orchestrator | Tuesday 28 April 2026 03:23:08 +0000 (0:00:00.686) 0:01:00.912 ********* 2026-04-28 03:23:10.839535 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 03:23:10.839542 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:23:10.839549 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 03:23:10.839555 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:23:10.839562 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 03:23:10.839573 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:23:10.839580 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:23:10.839587 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:23:10.839597 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:23:19.938342 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:23:19.938440 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:23:19.938453 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:23:19.938460 | orchestrator | 2026-04-28 03:23:19.938468 | orchestrator | TASK [neutron : Copying over config.json files for services] ******************* 2026-04-28 03:23:19.938476 | orchestrator | Tuesday 28 April 2026 03:23:10 +0000 (0:00:02.484) 0:01:03.397 ********* 2026-04-28 03:23:19.938483 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-28 03:23:19.938507 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-28 03:23:19.938514 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-28 03:23:19.938557 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 03:23:19.938566 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 03:23:19.938572 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 03:23:19.938584 | orchestrator | 2026-04-28 03:23:19.938590 | orchestrator | TASK [neutron : Copying over neutron.conf] ************************************* 2026-04-28 03:23:19.938597 | orchestrator | Tuesday 28 April 2026 03:23:14 +0000 (0:00:03.374) 0:01:06.772 ********* 2026-04-28 03:23:19.938603 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-28 03:23:19.938610 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-28 03:23:19.938626 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-28 03:23:25.589217 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 03:23:25.589323 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 03:23:25.589330 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 03:23:25.589335 | orchestrator | 2026-04-28 03:23:25.589340 | orchestrator | TASK [neutron : Copying over neutron_vpnaas.conf] ****************************** 2026-04-28 03:23:25.589345 | orchestrator | Tuesday 28 April 2026 03:23:19 +0000 (0:00:05.728) 0:01:12.501 ********* 2026-04-28 03:23:25.589350 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 03:23:25.589378 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 03:23:25.589383 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:23:25.589388 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:23:25.589397 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 03:23:25.589401 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:23:25.589405 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:23:25.589409 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:23:25.589412 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:23:25.589416 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:23:25.589420 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:23:25.589424 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:23:25.589428 | orchestrator | 2026-04-28 03:23:25.589435 | orchestrator | TASK [neutron : Copying over ssh key] ****************************************** 2026-04-28 03:23:25.589439 | orchestrator | Tuesday 28 April 2026 03:23:22 +0000 (0:00:02.401) 0:01:14.902 ********* 2026-04-28 03:23:25.589443 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:23:25.589446 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:23:25.589450 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:23:25.589454 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:23:25.589462 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:23:25.589465 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:23:25.589469 | orchestrator | 2026-04-28 03:23:25.589473 | orchestrator | TASK [neutron : Copying over ml2_conf.ini] ************************************* 2026-04-28 03:23:25.589480 | orchestrator | Tuesday 28 April 2026 03:23:25 +0000 (0:00:03.247) 0:01:18.149 ********* 2026-04-28 03:23:47.092514 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:23:47.092617 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:23:47.092629 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:23:47.092636 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:23:47.092643 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:23:47.092650 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:23:47.092667 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-28 03:23:47.092716 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-28 03:23:47.092785 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-28 03:23:47.092793 | orchestrator | 2026-04-28 03:23:47.092801 | orchestrator | TASK [neutron : Copying over linuxbridge_agent.ini] **************************** 2026-04-28 03:23:47.092808 | orchestrator | Tuesday 28 April 2026 03:23:29 +0000 (0:00:04.317) 0:01:22.467 ********* 2026-04-28 03:23:47.092813 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:23:47.092820 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:23:47.092825 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:23:47.092831 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:23:47.092837 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:23:47.092842 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:23:47.092848 | orchestrator | 2026-04-28 03:23:47.092854 | orchestrator | TASK [neutron : Copying over openvswitch_agent.ini] **************************** 2026-04-28 03:23:47.092859 | orchestrator | Tuesday 28 April 2026 03:23:32 +0000 (0:00:02.481) 0:01:24.949 ********* 2026-04-28 03:23:47.092865 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:23:47.092871 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:23:47.092877 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:23:47.092882 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:23:47.092888 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:23:47.092894 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:23:47.092900 | orchestrator | 2026-04-28 03:23:47.092906 | orchestrator | TASK [neutron : Copying over sriov_agent.ini] ********************************** 2026-04-28 03:23:47.092912 | orchestrator | Tuesday 28 April 2026 03:23:34 +0000 (0:00:02.390) 0:01:27.339 ********* 2026-04-28 03:23:47.092918 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:23:47.092924 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:23:47.092930 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:23:47.092936 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:23:47.092942 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:23:47.092948 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:23:47.092954 | orchestrator | 2026-04-28 03:23:47.092959 | orchestrator | TASK [neutron : Copying over mlnx_agent.ini] *********************************** 2026-04-28 03:23:47.092965 | orchestrator | Tuesday 28 April 2026 03:23:37 +0000 (0:00:02.518) 0:01:29.858 ********* 2026-04-28 03:23:47.092971 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:23:47.092977 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:23:47.092983 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:23:47.092996 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:23:47.093001 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:23:47.093008 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:23:47.093014 | orchestrator | 2026-04-28 03:23:47.093020 | orchestrator | TASK [neutron : Copying over eswitchd.conf] ************************************ 2026-04-28 03:23:47.093026 | orchestrator | Tuesday 28 April 2026 03:23:39 +0000 (0:00:02.365) 0:01:32.224 ********* 2026-04-28 03:23:47.093032 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:23:47.093037 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:23:47.093043 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:23:47.093049 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:23:47.093055 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:23:47.093061 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:23:47.093071 | orchestrator | 2026-04-28 03:23:47.093080 | orchestrator | TASK [neutron : Copying over dhcp_agent.ini] *********************************** 2026-04-28 03:23:47.093090 | orchestrator | Tuesday 28 April 2026 03:23:41 +0000 (0:00:02.345) 0:01:34.570 ********* 2026-04-28 03:23:47.093100 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:23:47.093110 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:23:47.093120 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:23:47.093130 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:23:47.093140 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:23:47.093150 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:23:47.093160 | orchestrator | 2026-04-28 03:23:47.093170 | orchestrator | TASK [neutron : Copying over dnsmasq.conf] ************************************* 2026-04-28 03:23:47.093180 | orchestrator | Tuesday 28 April 2026 03:23:44 +0000 (0:00:02.373) 0:01:36.943 ********* 2026-04-28 03:23:47.093196 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-28 03:23:47.093206 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:23:47.093215 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-28 03:23:47.093226 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:23:47.093237 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-28 03:23:47.093247 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:23:47.093257 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-28 03:23:47.093267 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:23:47.093284 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-28 03:23:51.739356 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:23:51.739493 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-28 03:23:51.739508 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:23:51.739514 | orchestrator | 2026-04-28 03:23:51.739522 | orchestrator | TASK [neutron : Copying over l3_agent.ini] ************************************* 2026-04-28 03:23:51.739530 | orchestrator | Tuesday 28 April 2026 03:23:47 +0000 (0:00:02.706) 0:01:39.650 ********* 2026-04-28 03:23:51.739543 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 03:23:51.739584 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:23:51.739591 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 03:23:51.739598 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:23:51.739606 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 03:23:51.739613 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:23:51.739638 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:23:51.739645 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:23:51.739676 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:23:51.739683 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:23:51.739690 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:23:51.739705 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:23:51.739711 | orchestrator | 2026-04-28 03:23:51.739718 | orchestrator | TASK [neutron : Copying over fwaas_driver.ini] ********************************* 2026-04-28 03:23:51.739774 | orchestrator | Tuesday 28 April 2026 03:23:49 +0000 (0:00:02.380) 0:01:42.030 ********* 2026-04-28 03:23:51.739781 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 03:23:51.739787 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:23:51.739793 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 03:23:51.739805 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:23:51.739820 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:24:20.574361 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:24:20.574463 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 03:24:20.574488 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:24:20.574494 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:24:20.574499 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:24:20.574504 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:24:20.574508 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:24:20.574512 | orchestrator | 2026-04-28 03:24:20.574516 | orchestrator | TASK [neutron : Copying over metadata_agent.ini] ******************************* 2026-04-28 03:24:20.574522 | orchestrator | Tuesday 28 April 2026 03:23:51 +0000 (0:00:02.269) 0:01:44.300 ********* 2026-04-28 03:24:20.574525 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:24:20.574529 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:24:20.574533 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:24:20.574536 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:24:20.574540 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:24:20.574544 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:24:20.574548 | orchestrator | 2026-04-28 03:24:20.574552 | orchestrator | TASK [neutron : Copying over neutron_ovn_metadata_agent.ini] ******************* 2026-04-28 03:24:20.574556 | orchestrator | Tuesday 28 April 2026 03:23:53 +0000 (0:00:02.161) 0:01:46.462 ********* 2026-04-28 03:24:20.574560 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:24:20.574563 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:24:20.574567 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:24:20.574571 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:24:20.574584 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:24:20.574588 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:24:20.574592 | orchestrator | 2026-04-28 03:24:20.574596 | orchestrator | TASK [neutron : Copying over metering_agent.ini] ******************************* 2026-04-28 03:24:20.574599 | orchestrator | Tuesday 28 April 2026 03:23:57 +0000 (0:00:04.069) 0:01:50.531 ********* 2026-04-28 03:24:20.574603 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:24:20.574607 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:24:20.574611 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:24:20.574619 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:24:20.574623 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:24:20.574627 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:24:20.574630 | orchestrator | 2026-04-28 03:24:20.574634 | orchestrator | TASK [neutron : Copying over ironic_neutron_agent.ini] ************************* 2026-04-28 03:24:20.574638 | orchestrator | Tuesday 28 April 2026 03:24:00 +0000 (0:00:02.823) 0:01:53.355 ********* 2026-04-28 03:24:20.574641 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:24:20.574645 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:24:20.574649 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:24:20.574653 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:24:20.574666 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:24:20.574670 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:24:20.574673 | orchestrator | 2026-04-28 03:24:20.574677 | orchestrator | TASK [neutron : Copying over bgp_dragent.ini] ********************************** 2026-04-28 03:24:20.574681 | orchestrator | Tuesday 28 April 2026 03:24:02 +0000 (0:00:02.034) 0:01:55.389 ********* 2026-04-28 03:24:20.574685 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:24:20.574688 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:24:20.574692 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:24:20.574696 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:24:20.574699 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:24:20.574703 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:24:20.574707 | orchestrator | 2026-04-28 03:24:20.574710 | orchestrator | TASK [neutron : Copying over ovn_agent.ini] ************************************ 2026-04-28 03:24:20.574714 | orchestrator | Tuesday 28 April 2026 03:24:05 +0000 (0:00:03.143) 0:01:58.533 ********* 2026-04-28 03:24:20.574718 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:24:20.574722 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:24:20.574725 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:24:20.574757 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:24:20.574761 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:24:20.574764 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:24:20.574768 | orchestrator | 2026-04-28 03:24:20.574772 | orchestrator | TASK [neutron : Copying over nsx.ini] ****************************************** 2026-04-28 03:24:20.574776 | orchestrator | Tuesday 28 April 2026 03:24:08 +0000 (0:00:02.105) 0:02:00.638 ********* 2026-04-28 03:24:20.574779 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:24:20.574783 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:24:20.574787 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:24:20.574790 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:24:20.574794 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:24:20.574798 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:24:20.574802 | orchestrator | 2026-04-28 03:24:20.574805 | orchestrator | TASK [neutron : Copy neutron-l3-agent-wrapper script] ************************** 2026-04-28 03:24:20.574809 | orchestrator | Tuesday 28 April 2026 03:24:10 +0000 (0:00:02.688) 0:02:03.327 ********* 2026-04-28 03:24:20.574813 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:24:20.574816 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:24:20.574820 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:24:20.574824 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:24:20.574827 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:24:20.574831 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:24:20.574835 | orchestrator | 2026-04-28 03:24:20.574839 | orchestrator | TASK [neutron : Copying over extra ml2 plugins] ******************************** 2026-04-28 03:24:20.574842 | orchestrator | Tuesday 28 April 2026 03:24:13 +0000 (0:00:02.294) 0:02:05.622 ********* 2026-04-28 03:24:20.574846 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:24:20.574850 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:24:20.574853 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:24:20.574857 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:24:20.574861 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:24:20.574864 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:24:20.574872 | orchestrator | 2026-04-28 03:24:20.574876 | orchestrator | TASK [neutron : Copying over neutron-tls-proxy.cfg] **************************** 2026-04-28 03:24:20.574879 | orchestrator | Tuesday 28 April 2026 03:24:15 +0000 (0:00:02.811) 0:02:08.433 ********* 2026-04-28 03:24:20.574883 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-28 03:24:20.574888 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:24:20.574892 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-28 03:24:20.574896 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:24:20.574900 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-28 03:24:20.574903 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:24:20.574907 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-28 03:24:20.574911 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:24:20.574915 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-28 03:24:20.574919 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:24:20.574923 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-28 03:24:20.574928 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:24:20.574932 | orchestrator | 2026-04-28 03:24:20.574936 | orchestrator | TASK [neutron : Copying over neutron_taas.conf] ******************************** 2026-04-28 03:24:20.574940 | orchestrator | Tuesday 28 April 2026 03:24:18 +0000 (0:00:02.248) 0:02:10.682 ********* 2026-04-28 03:24:20.574952 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 03:24:23.442207 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:24:23.442288 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 03:24:23.442299 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:24:23.442306 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:24:23.442330 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:24:23.442336 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}})  2026-04-28 03:24:23.442342 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:24:23.442357 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:24:23.442363 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:24:23.442380 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 03:24:23.442385 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:24:23.442391 | orchestrator | 2026-04-28 03:24:23.442397 | orchestrator | TASK [neutron : Check neutron containers] ************************************** 2026-04-28 03:24:23.442403 | orchestrator | Tuesday 28 April 2026 03:24:20 +0000 (0:00:02.447) 0:02:13.129 ********* 2026-04-28 03:24:23.442421 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-28 03:24:23.442439 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 03:24:23.442445 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-28 03:24:23.442454 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696'}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696'}}}}) 2026-04-28 03:24:23.442463 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 03:26:43.856483 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 03:26:43.856627 | orchestrator | 2026-04-28 03:26:43.856641 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-28 03:26:43.856651 | orchestrator | Tuesday 28 April 2026 03:24:23 +0000 (0:00:02.876) 0:02:16.005 ********* 2026-04-28 03:26:43.856659 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:26:43.856668 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:26:43.856675 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:26:43.856682 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:26:43.856689 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:26:43.856696 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:26:43.856704 | orchestrator | 2026-04-28 03:26:43.856711 | orchestrator | TASK [neutron : Creating Neutron database] ************************************* 2026-04-28 03:26:43.856718 | orchestrator | Tuesday 28 April 2026 03:24:24 +0000 (0:00:00.863) 0:02:16.869 ********* 2026-04-28 03:26:43.856725 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:26:43.856732 | orchestrator | 2026-04-28 03:26:43.856740 | orchestrator | TASK [neutron : Creating Neutron database user and setting permissions] ******** 2026-04-28 03:26:43.856747 | orchestrator | Tuesday 28 April 2026 03:24:26 +0000 (0:00:01.837) 0:02:18.707 ********* 2026-04-28 03:26:43.856754 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:26:43.856761 | orchestrator | 2026-04-28 03:26:43.856769 | orchestrator | TASK [neutron : Running Neutron bootstrap container] *************************** 2026-04-28 03:26:43.856776 | orchestrator | Tuesday 28 April 2026 03:24:28 +0000 (0:00:02.111) 0:02:20.818 ********* 2026-04-28 03:26:43.856783 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:26:43.856790 | orchestrator | 2026-04-28 03:26:43.856830 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-28 03:26:43.856842 | orchestrator | Tuesday 28 April 2026 03:25:11 +0000 (0:00:43.026) 0:03:03.844 ********* 2026-04-28 03:26:43.856854 | orchestrator | 2026-04-28 03:26:43.856867 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-28 03:26:43.856880 | orchestrator | Tuesday 28 April 2026 03:25:11 +0000 (0:00:00.090) 0:03:03.935 ********* 2026-04-28 03:26:43.856892 | orchestrator | 2026-04-28 03:26:43.856905 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-28 03:26:43.856917 | orchestrator | Tuesday 28 April 2026 03:25:11 +0000 (0:00:00.071) 0:03:04.007 ********* 2026-04-28 03:26:43.856925 | orchestrator | 2026-04-28 03:26:43.856932 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-28 03:26:43.856939 | orchestrator | Tuesday 28 April 2026 03:25:11 +0000 (0:00:00.074) 0:03:04.081 ********* 2026-04-28 03:26:43.856946 | orchestrator | 2026-04-28 03:26:43.856953 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-28 03:26:43.856960 | orchestrator | Tuesday 28 April 2026 03:25:11 +0000 (0:00:00.104) 0:03:04.185 ********* 2026-04-28 03:26:43.856967 | orchestrator | 2026-04-28 03:26:43.856974 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-28 03:26:43.856995 | orchestrator | Tuesday 28 April 2026 03:25:11 +0000 (0:00:00.076) 0:03:04.261 ********* 2026-04-28 03:26:43.857002 | orchestrator | 2026-04-28 03:26:43.857009 | orchestrator | RUNNING HANDLER [neutron : Restart neutron-server container] ******************* 2026-04-28 03:26:43.857016 | orchestrator | Tuesday 28 April 2026 03:25:11 +0000 (0:00:00.071) 0:03:04.333 ********* 2026-04-28 03:26:43.857023 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:26:43.857030 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:26:43.857038 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:26:43.857047 | orchestrator | 2026-04-28 03:26:43.857060 | orchestrator | RUNNING HANDLER [neutron : Restart neutron-ovn-metadata-agent container] ******* 2026-04-28 03:26:43.857076 | orchestrator | Tuesday 28 April 2026 03:25:37 +0000 (0:00:25.357) 0:03:29.691 ********* 2026-04-28 03:26:43.857083 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:26:43.857090 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:26:43.857097 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:26:43.857104 | orchestrator | 2026-04-28 03:26:43.857112 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 03:26:43.857120 | orchestrator | testbed-node-0 : ok=26  changed=15  unreachable=0 failed=0 skipped=32  rescued=0 ignored=0 2026-04-28 03:26:43.857129 | orchestrator | testbed-node-1 : ok=16  changed=8  unreachable=0 failed=0 skipped=31  rescued=0 ignored=0 2026-04-28 03:26:43.857136 | orchestrator | testbed-node-2 : ok=16  changed=8  unreachable=0 failed=0 skipped=31  rescued=0 ignored=0 2026-04-28 03:26:43.857143 | orchestrator | testbed-node-3 : ok=15  changed=7  unreachable=0 failed=0 skipped=32  rescued=0 ignored=0 2026-04-28 03:26:43.857167 | orchestrator | testbed-node-4 : ok=15  changed=7  unreachable=0 failed=0 skipped=32  rescued=0 ignored=0 2026-04-28 03:26:43.857175 | orchestrator | testbed-node-5 : ok=15  changed=7  unreachable=0 failed=0 skipped=32  rescued=0 ignored=0 2026-04-28 03:26:43.857182 | orchestrator | 2026-04-28 03:26:43.857190 | orchestrator | 2026-04-28 03:26:43.857197 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 03:26:43.857204 | orchestrator | Tuesday 28 April 2026 03:26:43 +0000 (0:01:06.183) 0:04:35.874 ********* 2026-04-28 03:26:43.857212 | orchestrator | =============================================================================== 2026-04-28 03:26:43.857219 | orchestrator | neutron : Restart neutron-ovn-metadata-agent container ----------------- 66.18s 2026-04-28 03:26:43.857226 | orchestrator | neutron : Running Neutron bootstrap container -------------------------- 43.03s 2026-04-28 03:26:43.857233 | orchestrator | neutron : Restart neutron-server container ----------------------------- 25.36s 2026-04-28 03:26:43.857240 | orchestrator | service-ks-register : neutron | Granting user roles --------------------- 7.53s 2026-04-28 03:26:43.857248 | orchestrator | service-ks-register : neutron | Creating endpoints ---------------------- 6.48s 2026-04-28 03:26:43.857255 | orchestrator | neutron : Copying over neutron.conf ------------------------------------- 5.73s 2026-04-28 03:26:43.857262 | orchestrator | neutron : Copying over ml2_conf.ini ------------------------------------- 4.32s 2026-04-28 03:26:43.857269 | orchestrator | neutron : Copying over neutron_ovn_metadata_agent.ini ------------------- 4.07s 2026-04-28 03:26:43.857276 | orchestrator | service-ks-register : neutron | Creating users -------------------------- 4.01s 2026-04-28 03:26:43.857283 | orchestrator | service-ks-register : neutron | Creating services ----------------------- 3.90s 2026-04-28 03:26:43.857290 | orchestrator | service-cert-copy : neutron | Copying over extra CA certificates -------- 3.42s 2026-04-28 03:26:43.857299 | orchestrator | neutron : Copying over config.json files for services ------------------- 3.37s 2026-04-28 03:26:43.857311 | orchestrator | service-cert-copy : neutron | Copying over backend internal TLS key ----- 3.27s 2026-04-28 03:26:43.857323 | orchestrator | neutron : Copying over ssh key ------------------------------------------ 3.25s 2026-04-28 03:26:43.857333 | orchestrator | neutron : Copying over bgp_dragent.ini ---------------------------------- 3.14s 2026-04-28 03:26:43.857343 | orchestrator | service-ks-register : neutron | Creating roles -------------------------- 3.13s 2026-04-28 03:26:43.857353 | orchestrator | service-ks-register : neutron | Creating projects ----------------------- 3.12s 2026-04-28 03:26:43.857363 | orchestrator | neutron : Ensuring config directories exist ----------------------------- 3.07s 2026-04-28 03:26:43.857373 | orchestrator | neutron : Creating TLS backend PEM File --------------------------------- 3.00s 2026-04-28 03:26:43.857394 | orchestrator | neutron : Check neutron containers -------------------------------------- 2.88s 2026-04-28 03:26:46.495493 | orchestrator | 2026-04-28 03:26:46 | INFO  | Task b1a3c88d-d404-4983-a9d7-3aca00662e23 (nova) was prepared for execution. 2026-04-28 03:26:46.495580 | orchestrator | 2026-04-28 03:26:46 | INFO  | It takes a moment until task b1a3c88d-d404-4983-a9d7-3aca00662e23 (nova) has been started and output is visible here. 2026-04-28 03:28:45.480184 | orchestrator | 2026-04-28 03:28:45.480319 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 03:28:45.480338 | orchestrator | 2026-04-28 03:28:45.480348 | orchestrator | TASK [Group hosts based on OpenStack release] ********************************** 2026-04-28 03:28:45.480359 | orchestrator | Tuesday 28 April 2026 03:26:51 +0000 (0:00:00.311) 0:00:00.311 ********* 2026-04-28 03:28:45.480370 | orchestrator | changed: [testbed-manager] 2026-04-28 03:28:45.480390 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:28:45.480416 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:28:45.480427 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:28:45.480438 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:28:45.480448 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:28:45.480459 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:28:45.480469 | orchestrator | 2026-04-28 03:28:45.480478 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 03:28:45.480489 | orchestrator | Tuesday 28 April 2026 03:26:52 +0000 (0:00:00.987) 0:00:01.299 ********* 2026-04-28 03:28:45.480499 | orchestrator | changed: [testbed-manager] 2026-04-28 03:28:45.480509 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:28:45.480518 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:28:45.480528 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:28:45.480539 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:28:45.480549 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:28:45.480560 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:28:45.480571 | orchestrator | 2026-04-28 03:28:45.480581 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 03:28:45.480591 | orchestrator | Tuesday 28 April 2026 03:26:53 +0000 (0:00:00.921) 0:00:02.220 ********* 2026-04-28 03:28:45.480601 | orchestrator | changed: [testbed-manager] => (item=enable_nova_True) 2026-04-28 03:28:45.480613 | orchestrator | changed: [testbed-node-0] => (item=enable_nova_True) 2026-04-28 03:28:45.480624 | orchestrator | changed: [testbed-node-1] => (item=enable_nova_True) 2026-04-28 03:28:45.480634 | orchestrator | changed: [testbed-node-2] => (item=enable_nova_True) 2026-04-28 03:28:45.480643 | orchestrator | changed: [testbed-node-3] => (item=enable_nova_True) 2026-04-28 03:28:45.480654 | orchestrator | changed: [testbed-node-4] => (item=enable_nova_True) 2026-04-28 03:28:45.480666 | orchestrator | changed: [testbed-node-5] => (item=enable_nova_True) 2026-04-28 03:28:45.480676 | orchestrator | 2026-04-28 03:28:45.480686 | orchestrator | PLAY [Bootstrap nova API databases] ******************************************** 2026-04-28 03:28:45.480695 | orchestrator | 2026-04-28 03:28:45.480707 | orchestrator | TASK [Bootstrap deploy] ******************************************************** 2026-04-28 03:28:45.480717 | orchestrator | Tuesday 28 April 2026 03:26:53 +0000 (0:00:00.745) 0:00:02.966 ********* 2026-04-28 03:28:45.480729 | orchestrator | included: nova for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:28:45.480740 | orchestrator | 2026-04-28 03:28:45.480751 | orchestrator | TASK [nova : Creating Nova databases] ****************************************** 2026-04-28 03:28:45.480763 | orchestrator | Tuesday 28 April 2026 03:26:54 +0000 (0:00:00.826) 0:00:03.792 ********* 2026-04-28 03:28:45.480774 | orchestrator | changed: [testbed-node-0] => (item=nova_cell0) 2026-04-28 03:28:45.480786 | orchestrator | changed: [testbed-node-0] => (item=nova_api) 2026-04-28 03:28:45.480849 | orchestrator | 2026-04-28 03:28:45.480862 | orchestrator | TASK [nova : Creating Nova databases user and setting permissions] ************* 2026-04-28 03:28:45.480873 | orchestrator | Tuesday 28 April 2026 03:26:58 +0000 (0:00:03.957) 0:00:07.749 ********* 2026-04-28 03:28:45.480910 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-28 03:28:45.480922 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-28 03:28:45.480932 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:28:45.480943 | orchestrator | 2026-04-28 03:28:45.480954 | orchestrator | TASK [nova : Ensuring config directories exist] ******************************** 2026-04-28 03:28:45.480965 | orchestrator | Tuesday 28 April 2026 03:27:02 +0000 (0:00:04.139) 0:00:11.889 ********* 2026-04-28 03:28:45.480976 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:28:45.480986 | orchestrator | 2026-04-28 03:28:45.480997 | orchestrator | TASK [nova : Copying over config.json files for nova-api-bootstrap] ************ 2026-04-28 03:28:45.481009 | orchestrator | Tuesday 28 April 2026 03:27:03 +0000 (0:00:00.645) 0:00:12.534 ********* 2026-04-28 03:28:45.481019 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:28:45.481030 | orchestrator | 2026-04-28 03:28:45.481041 | orchestrator | TASK [nova : Copying over nova.conf for nova-api-bootstrap] ******************** 2026-04-28 03:28:45.481050 | orchestrator | Tuesday 28 April 2026 03:27:04 +0000 (0:00:01.321) 0:00:13.856 ********* 2026-04-28 03:28:45.481086 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:28:45.481097 | orchestrator | 2026-04-28 03:28:45.481108 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-28 03:28:45.481118 | orchestrator | Tuesday 28 April 2026 03:27:07 +0000 (0:00:02.817) 0:00:16.673 ********* 2026-04-28 03:28:45.481129 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:28:45.481139 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:28:45.481149 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:28:45.481158 | orchestrator | 2026-04-28 03:28:45.481168 | orchestrator | TASK [nova : Running Nova API bootstrap container] ***************************** 2026-04-28 03:28:45.481178 | orchestrator | Tuesday 28 April 2026 03:27:07 +0000 (0:00:00.323) 0:00:16.997 ********* 2026-04-28 03:28:45.481188 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:28:45.481198 | orchestrator | 2026-04-28 03:28:45.481208 | orchestrator | TASK [nova : Create cell0 mappings] ******************************************** 2026-04-28 03:28:45.481219 | orchestrator | Tuesday 28 April 2026 03:27:40 +0000 (0:00:32.329) 0:00:49.327 ********* 2026-04-28 03:28:45.481229 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:28:45.481239 | orchestrator | 2026-04-28 03:28:45.481249 | orchestrator | TASK [nova-cell : Get a list of existing cells] ******************************** 2026-04-28 03:28:45.481259 | orchestrator | Tuesday 28 April 2026 03:27:54 +0000 (0:00:14.343) 0:01:03.671 ********* 2026-04-28 03:28:45.481269 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:28:45.481279 | orchestrator | 2026-04-28 03:28:45.481289 | orchestrator | TASK [nova-cell : Extract current cell settings from list] ********************* 2026-04-28 03:28:45.481299 | orchestrator | Tuesday 28 April 2026 03:28:06 +0000 (0:00:11.979) 0:01:15.650 ********* 2026-04-28 03:28:45.481332 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:28:45.481345 | orchestrator | 2026-04-28 03:28:45.481356 | orchestrator | TASK [nova : Update cell0 mappings] ******************************************** 2026-04-28 03:28:45.481366 | orchestrator | Tuesday 28 April 2026 03:28:07 +0000 (0:00:00.765) 0:01:16.415 ********* 2026-04-28 03:28:45.481376 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:28:45.481387 | orchestrator | 2026-04-28 03:28:45.481397 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-28 03:28:45.481417 | orchestrator | Tuesday 28 April 2026 03:28:07 +0000 (0:00:00.479) 0:01:16.894 ********* 2026-04-28 03:28:45.481428 | orchestrator | included: /ansible/roles/nova/tasks/bootstrap_service.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:28:45.481438 | orchestrator | 2026-04-28 03:28:45.481448 | orchestrator | TASK [nova : Running Nova API bootstrap container] ***************************** 2026-04-28 03:28:45.481459 | orchestrator | Tuesday 28 April 2026 03:28:08 +0000 (0:00:00.745) 0:01:17.640 ********* 2026-04-28 03:28:45.481470 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:28:45.481480 | orchestrator | 2026-04-28 03:28:45.481491 | orchestrator | TASK [Bootstrap upgrade] ******************************************************* 2026-04-28 03:28:45.481514 | orchestrator | Tuesday 28 April 2026 03:28:26 +0000 (0:00:18.190) 0:01:35.831 ********* 2026-04-28 03:28:45.481526 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:28:45.481537 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:28:45.481547 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:28:45.481556 | orchestrator | 2026-04-28 03:28:45.481566 | orchestrator | PLAY [Bootstrap nova cell databases] ******************************************* 2026-04-28 03:28:45.481575 | orchestrator | 2026-04-28 03:28:45.481585 | orchestrator | TASK [Bootstrap deploy] ******************************************************** 2026-04-28 03:28:45.481595 | orchestrator | Tuesday 28 April 2026 03:28:27 +0000 (0:00:00.339) 0:01:36.170 ********* 2026-04-28 03:28:45.481605 | orchestrator | included: nova-cell for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:28:45.481616 | orchestrator | 2026-04-28 03:28:45.481626 | orchestrator | TASK [nova-cell : Creating Nova cell database] ********************************* 2026-04-28 03:28:45.481636 | orchestrator | Tuesday 28 April 2026 03:28:27 +0000 (0:00:00.830) 0:01:37.001 ********* 2026-04-28 03:28:45.481646 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:28:45.481656 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:28:45.481666 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:28:45.481675 | orchestrator | 2026-04-28 03:28:45.481685 | orchestrator | TASK [nova-cell : Creating Nova cell database user and setting permissions] **** 2026-04-28 03:28:45.481696 | orchestrator | Tuesday 28 April 2026 03:28:29 +0000 (0:00:01.942) 0:01:38.944 ********* 2026-04-28 03:28:45.481707 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:28:45.481716 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:28:45.481726 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:28:45.481736 | orchestrator | 2026-04-28 03:28:45.481746 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ vhosts exist] ****************** 2026-04-28 03:28:45.481755 | orchestrator | Tuesday 28 April 2026 03:28:31 +0000 (0:00:02.060) 0:01:41.005 ********* 2026-04-28 03:28:45.481765 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:28:45.481775 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:28:45.481785 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:28:45.481854 | orchestrator | 2026-04-28 03:28:45.481870 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ users exist] ******************* 2026-04-28 03:28:45.481881 | orchestrator | Tuesday 28 April 2026 03:28:32 +0000 (0:00:00.601) 0:01:41.606 ********* 2026-04-28 03:28:45.481891 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-28 03:28:45.481901 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:28:45.481913 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-28 03:28:45.481923 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:28:45.481933 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-28 03:28:45.481943 | orchestrator | ok: [testbed-node-0 -> {{ service_rabbitmq_delegate_host }}] 2026-04-28 03:28:45.481953 | orchestrator | 2026-04-28 03:28:45.481964 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ vhosts exist] ****************** 2026-04-28 03:28:45.481975 | orchestrator | Tuesday 28 April 2026 03:28:39 +0000 (0:00:07.461) 0:01:49.068 ********* 2026-04-28 03:28:45.482004 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:28:45.482072 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:28:45.482087 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:28:45.482097 | orchestrator | 2026-04-28 03:28:45.482107 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ users exist] ******************* 2026-04-28 03:28:45.482119 | orchestrator | Tuesday 28 April 2026 03:28:40 +0000 (0:00:00.396) 0:01:49.464 ********* 2026-04-28 03:28:45.482126 | orchestrator | skipping: [testbed-node-0] => (item=None)  2026-04-28 03:28:45.482132 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:28:45.482138 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-28 03:28:45.482144 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:28:45.482151 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-28 03:28:45.482157 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:28:45.482163 | orchestrator | 2026-04-28 03:28:45.482173 | orchestrator | TASK [nova-cell : Ensuring config directories exist] *************************** 2026-04-28 03:28:45.482196 | orchestrator | Tuesday 28 April 2026 03:28:41 +0000 (0:00:01.201) 0:01:50.665 ********* 2026-04-28 03:28:45.482207 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:28:45.482217 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:28:45.482227 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:28:45.482237 | orchestrator | 2026-04-28 03:28:45.482247 | orchestrator | TASK [nova-cell : Copying over config.json files for nova-cell-bootstrap] ****** 2026-04-28 03:28:45.482258 | orchestrator | Tuesday 28 April 2026 03:28:42 +0000 (0:00:00.469) 0:01:51.135 ********* 2026-04-28 03:28:45.482268 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:28:45.482277 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:28:45.482288 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:28:45.482298 | orchestrator | 2026-04-28 03:28:45.482308 | orchestrator | TASK [nova-cell : Copying over nova.conf for nova-cell-bootstrap] ************** 2026-04-28 03:28:45.482319 | orchestrator | Tuesday 28 April 2026 03:28:43 +0000 (0:00:01.052) 0:01:52.187 ********* 2026-04-28 03:28:45.482329 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:28:45.482340 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:28:45.482365 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:30:05.231625 | orchestrator | 2026-04-28 03:30:05.231716 | orchestrator | TASK [nova-cell : Running Nova cell bootstrap container] *********************** 2026-04-28 03:30:05.231727 | orchestrator | Tuesday 28 April 2026 03:28:45 +0000 (0:00:02.379) 0:01:54.567 ********* 2026-04-28 03:30:05.231735 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:30:05.231742 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:30:05.231749 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:30:05.231757 | orchestrator | 2026-04-28 03:30:05.231776 | orchestrator | TASK [nova-cell : Get a list of existing cells] ******************************** 2026-04-28 03:30:05.231783 | orchestrator | Tuesday 28 April 2026 03:29:07 +0000 (0:00:21.782) 0:02:16.350 ********* 2026-04-28 03:30:05.231790 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:30:05.231796 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:30:05.231802 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:30:05.231809 | orchestrator | 2026-04-28 03:30:05.231890 | orchestrator | TASK [nova-cell : Extract current cell settings from list] ********************* 2026-04-28 03:30:05.231897 | orchestrator | Tuesday 28 April 2026 03:29:20 +0000 (0:00:13.089) 0:02:29.439 ********* 2026-04-28 03:30:05.231903 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:30:05.231910 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:30:05.231916 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:30:05.231923 | orchestrator | 2026-04-28 03:30:05.231929 | orchestrator | TASK [nova-cell : Create cell] ************************************************* 2026-04-28 03:30:05.231935 | orchestrator | Tuesday 28 April 2026 03:29:21 +0000 (0:00:01.157) 0:02:30.597 ********* 2026-04-28 03:30:05.231942 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:30:05.231948 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:30:05.231954 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:30:05.231961 | orchestrator | 2026-04-28 03:30:05.231968 | orchestrator | TASK [nova-cell : Update cell] ************************************************* 2026-04-28 03:30:05.231974 | orchestrator | Tuesday 28 April 2026 03:29:34 +0000 (0:00:13.230) 0:02:43.827 ********* 2026-04-28 03:30:05.231980 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:30:05.231986 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:30:05.231992 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:30:05.231999 | orchestrator | 2026-04-28 03:30:05.232005 | orchestrator | TASK [Bootstrap upgrade] ******************************************************* 2026-04-28 03:30:05.232011 | orchestrator | Tuesday 28 April 2026 03:29:35 +0000 (0:00:01.193) 0:02:45.020 ********* 2026-04-28 03:30:05.232018 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:30:05.232024 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:30:05.232030 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:30:05.232036 | orchestrator | 2026-04-28 03:30:05.232042 | orchestrator | PLAY [Apply role nova] ********************************************************* 2026-04-28 03:30:05.232067 | orchestrator | 2026-04-28 03:30:05.232073 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-28 03:30:05.232080 | orchestrator | Tuesday 28 April 2026 03:29:36 +0000 (0:00:00.341) 0:02:45.362 ********* 2026-04-28 03:30:05.232086 | orchestrator | included: /ansible/roles/nova/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:30:05.232093 | orchestrator | 2026-04-28 03:30:05.232099 | orchestrator | TASK [service-ks-register : nova | Creating services] ************************** 2026-04-28 03:30:05.232106 | orchestrator | Tuesday 28 April 2026 03:29:37 +0000 (0:00:00.875) 0:02:46.237 ********* 2026-04-28 03:30:05.232112 | orchestrator | skipping: [testbed-node-0] => (item=nova_legacy (compute_legacy))  2026-04-28 03:30:05.232118 | orchestrator | changed: [testbed-node-0] => (item=nova (compute)) 2026-04-28 03:30:05.232125 | orchestrator | 2026-04-28 03:30:05.232131 | orchestrator | TASK [service-ks-register : nova | Creating endpoints] ************************* 2026-04-28 03:30:05.232137 | orchestrator | Tuesday 28 April 2026 03:29:40 +0000 (0:00:03.255) 0:02:49.492 ********* 2026-04-28 03:30:05.232143 | orchestrator | skipping: [testbed-node-0] => (item=nova_legacy -> https://api-int.testbed.osism.xyz:8774/v2/%(tenant_id)s -> internal)  2026-04-28 03:30:05.232151 | orchestrator | skipping: [testbed-node-0] => (item=nova_legacy -> https://api.testbed.osism.xyz:8774/v2/%(tenant_id)s -> public)  2026-04-28 03:30:05.232158 | orchestrator | changed: [testbed-node-0] => (item=nova -> https://api-int.testbed.osism.xyz:8774/v2.1 -> internal) 2026-04-28 03:30:05.232164 | orchestrator | changed: [testbed-node-0] => (item=nova -> https://api.testbed.osism.xyz:8774/v2.1 -> public) 2026-04-28 03:30:05.232170 | orchestrator | 2026-04-28 03:30:05.232177 | orchestrator | TASK [service-ks-register : nova | Creating projects] ************************** 2026-04-28 03:30:05.232183 | orchestrator | Tuesday 28 April 2026 03:29:46 +0000 (0:00:06.290) 0:02:55.783 ********* 2026-04-28 03:30:05.232190 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-28 03:30:05.232196 | orchestrator | 2026-04-28 03:30:05.232202 | orchestrator | TASK [service-ks-register : nova | Creating users] ***************************** 2026-04-28 03:30:05.232208 | orchestrator | Tuesday 28 April 2026 03:29:49 +0000 (0:00:03.100) 0:02:58.884 ********* 2026-04-28 03:30:05.232215 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-28 03:30:05.232221 | orchestrator | changed: [testbed-node-0] => (item=nova -> service) 2026-04-28 03:30:05.232227 | orchestrator | 2026-04-28 03:30:05.232233 | orchestrator | TASK [service-ks-register : nova | Creating roles] ***************************** 2026-04-28 03:30:05.232239 | orchestrator | Tuesday 28 April 2026 03:29:53 +0000 (0:00:03.728) 0:03:02.612 ********* 2026-04-28 03:30:05.232246 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-28 03:30:05.232252 | orchestrator | 2026-04-28 03:30:05.232258 | orchestrator | TASK [service-ks-register : nova | Granting user roles] ************************ 2026-04-28 03:30:05.232265 | orchestrator | Tuesday 28 April 2026 03:29:56 +0000 (0:00:03.151) 0:03:05.764 ********* 2026-04-28 03:30:05.232271 | orchestrator | changed: [testbed-node-0] => (item=nova -> service -> admin) 2026-04-28 03:30:05.232277 | orchestrator | changed: [testbed-node-0] => (item=nova -> service -> service) 2026-04-28 03:30:05.232283 | orchestrator | 2026-04-28 03:30:05.232289 | orchestrator | TASK [nova : Ensuring config directories exist] ******************************** 2026-04-28 03:30:05.232308 | orchestrator | Tuesday 28 April 2026 03:30:03 +0000 (0:00:07.157) 0:03:12.922 ********* 2026-04-28 03:30:05.232325 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-28 03:30:05.232346 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-28 03:30:05.232354 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-28 03:30:05.232367 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:30:10.075944 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:30:10.076045 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:30:10.076053 | orchestrator | 2026-04-28 03:30:10.076059 | orchestrator | TASK [nova : Check if policies shall be overwritten] *************************** 2026-04-28 03:30:10.076064 | orchestrator | Tuesday 28 April 2026 03:30:05 +0000 (0:00:01.396) 0:03:14.318 ********* 2026-04-28 03:30:10.076068 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:30:10.076073 | orchestrator | 2026-04-28 03:30:10.076077 | orchestrator | TASK [nova : Set nova policy file] ********************************************* 2026-04-28 03:30:10.076081 | orchestrator | Tuesday 28 April 2026 03:30:05 +0000 (0:00:00.139) 0:03:14.458 ********* 2026-04-28 03:30:10.076085 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:30:10.076089 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:30:10.076093 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:30:10.076096 | orchestrator | 2026-04-28 03:30:10.076100 | orchestrator | TASK [nova : Check for vendordata file] **************************************** 2026-04-28 03:30:10.076104 | orchestrator | Tuesday 28 April 2026 03:30:05 +0000 (0:00:00.336) 0:03:14.794 ********* 2026-04-28 03:30:10.076108 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 03:30:10.076112 | orchestrator | 2026-04-28 03:30:10.076116 | orchestrator | TASK [nova : Set vendordata file path] ***************************************** 2026-04-28 03:30:10.076119 | orchestrator | Tuesday 28 April 2026 03:30:06 +0000 (0:00:00.729) 0:03:15.524 ********* 2026-04-28 03:30:10.076123 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:30:10.076127 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:30:10.076131 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:30:10.076135 | orchestrator | 2026-04-28 03:30:10.076171 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-28 03:30:10.076177 | orchestrator | Tuesday 28 April 2026 03:30:06 +0000 (0:00:00.549) 0:03:16.074 ********* 2026-04-28 03:30:10.076181 | orchestrator | included: /ansible/roles/nova/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:30:10.076186 | orchestrator | 2026-04-28 03:30:10.076191 | orchestrator | TASK [service-cert-copy : nova | Copying over extra CA certificates] *********** 2026-04-28 03:30:10.076196 | orchestrator | Tuesday 28 April 2026 03:30:07 +0000 (0:00:00.663) 0:03:16.737 ********* 2026-04-28 03:30:10.076204 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-28 03:30:10.076231 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-28 03:30:10.076236 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-28 03:30:10.076241 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:30:10.076245 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:30:10.076253 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:30:10.076257 | orchestrator | 2026-04-28 03:30:10.076264 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS certificate] *** 2026-04-28 03:30:11.906489 | orchestrator | Tuesday 28 April 2026 03:30:10 +0000 (0:00:02.419) 0:03:19.157 ********* 2026-04-28 03:30:11.906579 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-28 03:30:11.906593 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:30:11.906602 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:30:11.906611 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-28 03:30:11.906635 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:30:11.906641 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:30:11.906665 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-28 03:30:11.906673 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:30:11.906680 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:30:11.906686 | orchestrator | 2026-04-28 03:30:11.906693 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS key] ******** 2026-04-28 03:30:11.906700 | orchestrator | Tuesday 28 April 2026 03:30:11 +0000 (0:00:00.961) 0:03:20.118 ********* 2026-04-28 03:30:11.906707 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-28 03:30:11.906723 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:30:11.906730 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:30:11.906746 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-28 03:30:14.271312 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:30:14.271402 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:30:14.271419 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-28 03:30:14.271456 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:30:14.271466 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:30:14.271475 | orchestrator | 2026-04-28 03:30:14.271485 | orchestrator | TASK [nova : Copying over config.json files for services] ********************** 2026-04-28 03:30:14.271496 | orchestrator | Tuesday 28 April 2026 03:30:11 +0000 (0:00:00.872) 0:03:20.991 ********* 2026-04-28 03:30:14.271519 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-28 03:30:14.271547 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-28 03:30:14.271559 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-28 03:30:14.271576 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:30:14.271597 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:30:14.271614 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:30:21.154133 | orchestrator | 2026-04-28 03:30:21.154219 | orchestrator | TASK [nova : Copying over nova.conf] ******************************************* 2026-04-28 03:30:21.154228 | orchestrator | Tuesday 28 April 2026 03:30:14 +0000 (0:00:02.368) 0:03:23.359 ********* 2026-04-28 03:30:21.154238 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-28 03:30:21.154273 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-28 03:30:21.154289 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-28 03:30:21.154357 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:30:21.154367 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:30:21.154372 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:30:21.154383 | orchestrator | 2026-04-28 03:30:21.154388 | orchestrator | TASK [nova : Copying over existing policy file] ******************************** 2026-04-28 03:30:21.154393 | orchestrator | Tuesday 28 April 2026 03:30:20 +0000 (0:00:06.260) 0:03:29.619 ********* 2026-04-28 03:30:21.154399 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-28 03:30:21.154409 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:30:21.154414 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:30:21.154426 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-28 03:30:25.622005 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:30:25.622176 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:30:25.622200 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}})  2026-04-28 03:30:25.622241 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:30:25.622268 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:30:25.622284 | orchestrator | 2026-04-28 03:30:25.622302 | orchestrator | TASK [nova : Copying over nova-api-wsgi.conf] ********************************** 2026-04-28 03:30:25.622319 | orchestrator | Tuesday 28 April 2026 03:30:21 +0000 (0:00:00.623) 0:03:30.243 ********* 2026-04-28 03:30:25.622334 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:30:25.622349 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:30:25.622362 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:30:25.622376 | orchestrator | 2026-04-28 03:30:25.622390 | orchestrator | TASK [nova : Copying over vendordata file] ************************************* 2026-04-28 03:30:25.622406 | orchestrator | Tuesday 28 April 2026 03:30:22 +0000 (0:00:01.563) 0:03:31.806 ********* 2026-04-28 03:30:25.622422 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:30:25.622437 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:30:25.622452 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:30:25.622467 | orchestrator | 2026-04-28 03:30:25.622482 | orchestrator | TASK [nova : Check nova containers] ******************************************** 2026-04-28 03:30:25.622498 | orchestrator | Tuesday 28 April 2026 03:30:23 +0000 (0:00:00.354) 0:03:32.161 ********* 2026-04-28 03:30:25.622540 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-28 03:30:25.622576 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-28 03:30:25.622605 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/nova-api:30.2.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no'}, 'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no'}}}}) 2026-04-28 03:30:25.622623 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:30:25.622641 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:30:25.622682 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:03.430746 | orchestrator | 2026-04-28 03:31:03.430987 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-28 03:31:03.431020 | orchestrator | Tuesday 28 April 2026 03:30:25 +0000 (0:00:02.076) 0:03:34.238 ********* 2026-04-28 03:31:03.431040 | orchestrator | 2026-04-28 03:31:03.431060 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-28 03:31:03.431079 | orchestrator | Tuesday 28 April 2026 03:30:25 +0000 (0:00:00.155) 0:03:34.394 ********* 2026-04-28 03:31:03.431098 | orchestrator | 2026-04-28 03:31:03.431117 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-28 03:31:03.431136 | orchestrator | Tuesday 28 April 2026 03:30:25 +0000 (0:00:00.150) 0:03:34.544 ********* 2026-04-28 03:31:03.431155 | orchestrator | 2026-04-28 03:31:03.431175 | orchestrator | RUNNING HANDLER [nova : Restart nova-scheduler container] ********************** 2026-04-28 03:31:03.431194 | orchestrator | Tuesday 28 April 2026 03:30:25 +0000 (0:00:00.161) 0:03:34.706 ********* 2026-04-28 03:31:03.431212 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:31:03.431233 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:31:03.431255 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:31:03.431278 | orchestrator | 2026-04-28 03:31:03.431301 | orchestrator | RUNNING HANDLER [nova : Restart nova-api container] **************************** 2026-04-28 03:31:03.431326 | orchestrator | Tuesday 28 April 2026 03:30:45 +0000 (0:00:19.727) 0:03:54.433 ********* 2026-04-28 03:31:03.431350 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:31:03.431375 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:31:03.431399 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:31:03.431422 | orchestrator | 2026-04-28 03:31:03.431446 | orchestrator | PLAY [Apply role nova-cell] **************************************************** 2026-04-28 03:31:03.431469 | orchestrator | 2026-04-28 03:31:03.431492 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-28 03:31:03.431515 | orchestrator | Tuesday 28 April 2026 03:30:50 +0000 (0:00:05.436) 0:03:59.870 ********* 2026-04-28 03:31:03.431540 | orchestrator | included: /ansible/roles/nova-cell/tasks/deploy.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:31:03.431563 | orchestrator | 2026-04-28 03:31:03.431586 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-28 03:31:03.431610 | orchestrator | Tuesday 28 April 2026 03:30:52 +0000 (0:00:01.429) 0:04:01.300 ********* 2026-04-28 03:31:03.431632 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:31:03.431651 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:31:03.431669 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:31:03.431688 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:31:03.431707 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:31:03.431727 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:31:03.431747 | orchestrator | 2026-04-28 03:31:03.431785 | orchestrator | TASK [Load and persist br_netfilter module] ************************************ 2026-04-28 03:31:03.431859 | orchestrator | Tuesday 28 April 2026 03:30:53 +0000 (0:00:00.870) 0:04:02.171 ********* 2026-04-28 03:31:03.431884 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:31:03.431905 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:31:03.431926 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:31:03.431947 | orchestrator | included: module-load for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:31:03.431968 | orchestrator | 2026-04-28 03:31:03.431988 | orchestrator | TASK [module-load : Load modules] ********************************************** 2026-04-28 03:31:03.432006 | orchestrator | Tuesday 28 April 2026 03:30:53 +0000 (0:00:00.908) 0:04:03.080 ********* 2026-04-28 03:31:03.432025 | orchestrator | ok: [testbed-node-3] => (item=br_netfilter) 2026-04-28 03:31:03.432045 | orchestrator | ok: [testbed-node-4] => (item=br_netfilter) 2026-04-28 03:31:03.432065 | orchestrator | ok: [testbed-node-5] => (item=br_netfilter) 2026-04-28 03:31:03.432086 | orchestrator | 2026-04-28 03:31:03.432106 | orchestrator | TASK [module-load : Persist modules via modules-load.d] ************************ 2026-04-28 03:31:03.432124 | orchestrator | Tuesday 28 April 2026 03:30:54 +0000 (0:00:01.007) 0:04:04.087 ********* 2026-04-28 03:31:03.432143 | orchestrator | changed: [testbed-node-3] => (item=br_netfilter) 2026-04-28 03:31:03.432162 | orchestrator | changed: [testbed-node-4] => (item=br_netfilter) 2026-04-28 03:31:03.432182 | orchestrator | changed: [testbed-node-5] => (item=br_netfilter) 2026-04-28 03:31:03.432202 | orchestrator | 2026-04-28 03:31:03.432221 | orchestrator | TASK [module-load : Drop module persistence] *********************************** 2026-04-28 03:31:03.432239 | orchestrator | Tuesday 28 April 2026 03:30:56 +0000 (0:00:01.290) 0:04:05.378 ********* 2026-04-28 03:31:03.432258 | orchestrator | skipping: [testbed-node-3] => (item=br_netfilter)  2026-04-28 03:31:03.432277 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:31:03.432296 | orchestrator | skipping: [testbed-node-4] => (item=br_netfilter)  2026-04-28 03:31:03.432316 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:31:03.432334 | orchestrator | skipping: [testbed-node-5] => (item=br_netfilter)  2026-04-28 03:31:03.432361 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:31:03.432381 | orchestrator | 2026-04-28 03:31:03.432400 | orchestrator | TASK [nova-cell : Enable bridge-nf-call sysctl variables] ********************** 2026-04-28 03:31:03.432418 | orchestrator | Tuesday 28 April 2026 03:30:56 +0000 (0:00:00.565) 0:04:05.943 ********* 2026-04-28 03:31:03.432439 | orchestrator | changed: [testbed-node-3] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-28 03:31:03.432460 | orchestrator | changed: [testbed-node-4] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-28 03:31:03.432480 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-28 03:31:03.432501 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-28 03:31:03.432521 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:31:03.432540 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-28 03:31:03.432560 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-28 03:31:03.432580 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:31:03.432629 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-28 03:31:03.432650 | orchestrator | changed: [testbed-node-5] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-28 03:31:03.432670 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-28 03:31:03.432690 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:31:03.432709 | orchestrator | changed: [testbed-node-3] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-28 03:31:03.432729 | orchestrator | changed: [testbed-node-4] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-28 03:31:03.432749 | orchestrator | changed: [testbed-node-5] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-28 03:31:03.432770 | orchestrator | 2026-04-28 03:31:03.432790 | orchestrator | TASK [nova-cell : Install udev kolla kvm rules] ******************************** 2026-04-28 03:31:03.432859 | orchestrator | Tuesday 28 April 2026 03:30:58 +0000 (0:00:01.334) 0:04:07.278 ********* 2026-04-28 03:31:03.432879 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:31:03.432898 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:31:03.432917 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:31:03.432936 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:31:03.432955 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:31:03.432973 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:31:03.432991 | orchestrator | 2026-04-28 03:31:03.433011 | orchestrator | TASK [nova-cell : Mask qemu-kvm service] *************************************** 2026-04-28 03:31:03.433030 | orchestrator | Tuesday 28 April 2026 03:30:59 +0000 (0:00:01.220) 0:04:08.498 ********* 2026-04-28 03:31:03.433049 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:31:03.433068 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:31:03.433087 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:31:03.433106 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:31:03.433125 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:31:03.433144 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:31:03.433163 | orchestrator | 2026-04-28 03:31:03.433181 | orchestrator | TASK [nova-cell : Ensuring config directories exist] *************************** 2026-04-28 03:31:03.433198 | orchestrator | Tuesday 28 April 2026 03:31:01 +0000 (0:00:01.912) 0:04:10.411 ********* 2026-04-28 03:31:03.433235 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 03:31:03.433259 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 03:31:03.433295 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 03:31:05.491628 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 03:31:05.491720 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 03:31:05.491731 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 03:31:05.491754 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 03:31:05.491765 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:05.491775 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:05.491814 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 03:31:05.491895 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:05.491908 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 03:31:05.491916 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:05.491924 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:05.491932 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:05.491945 | orchestrator | 2026-04-28 03:31:05.491955 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-28 03:31:05.491964 | orchestrator | Tuesday 28 April 2026 03:31:04 +0000 (0:00:02.701) 0:04:13.112 ********* 2026-04-28 03:31:05.491972 | orchestrator | included: /ansible/roles/nova-cell/tasks/copy-certs.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:31:05.491981 | orchestrator | 2026-04-28 03:31:05.491988 | orchestrator | TASK [service-cert-copy : nova | Copying over extra CA certificates] *********** 2026-04-28 03:31:05.492001 | orchestrator | Tuesday 28 April 2026 03:31:05 +0000 (0:00:01.468) 0:04:14.581 ********* 2026-04-28 03:31:09.067487 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 03:31:09.067575 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 03:31:09.067582 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 03:31:09.067589 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 03:31:09.067609 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 03:31:09.067634 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 03:31:09.067645 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 03:31:09.067651 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 03:31:09.067657 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 03:31:09.067661 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:09.067665 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:09.067675 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:09.067682 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:10.974492 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:10.974605 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:10.974618 | orchestrator | 2026-04-28 03:31:10.974628 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS certificate] *** 2026-04-28 03:31:10.974637 | orchestrator | Tuesday 28 April 2026 03:31:09 +0000 (0:00:03.824) 0:04:18.405 ********* 2026-04-28 03:31:10.974647 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 03:31:10.974677 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 03:31:10.974687 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 03:31:10.974696 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:31:10.974722 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 03:31:10.974736 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 03:31:10.974745 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 03:31:10.974759 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:31:10.974768 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 03:31:10.974778 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 03:31:10.974794 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 03:31:12.597694 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:31:12.597876 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 03:31:12.597911 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 03:31:12.597926 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:31:12.597968 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 03:31:12.597988 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 03:31:12.598008 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:31:12.598092 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 03:31:12.598105 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 03:31:12.598116 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:31:12.598128 | orchestrator | 2026-04-28 03:31:12.598140 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS key] ******** 2026-04-28 03:31:12.598152 | orchestrator | Tuesday 28 April 2026 03:31:11 +0000 (0:00:01.981) 0:04:20.387 ********* 2026-04-28 03:31:12.598195 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 03:31:12.598217 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 03:31:12.598253 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 03:31:12.598276 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:31:12.598298 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 03:31:12.598313 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 03:31:12.598336 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 03:31:20.803040 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:31:20.803135 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 03:31:20.803159 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 03:31:20.803167 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 03:31:20.803173 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:31:20.803179 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 03:31:20.803186 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 03:31:20.803199 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:31:20.803217 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 03:31:20.803227 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 03:31:20.803237 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:31:20.803242 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 03:31:20.803248 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 03:31:20.803253 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:31:20.803258 | orchestrator | 2026-04-28 03:31:20.803264 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-28 03:31:20.803271 | orchestrator | Tuesday 28 April 2026 03:31:13 +0000 (0:00:02.254) 0:04:22.641 ********* 2026-04-28 03:31:20.803276 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:31:20.803281 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:31:20.803286 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:31:20.803292 | orchestrator | included: /ansible/roles/nova-cell/tasks/external_ceph.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:31:20.803297 | orchestrator | 2026-04-28 03:31:20.803302 | orchestrator | TASK [nova-cell : Check nova keyring file] ************************************* 2026-04-28 03:31:20.803307 | orchestrator | Tuesday 28 April 2026 03:31:14 +0000 (0:00:00.946) 0:04:23.587 ********* 2026-04-28 03:31:20.803312 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 03:31:20.803318 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 03:31:20.803323 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 03:31:20.803328 | orchestrator | 2026-04-28 03:31:20.803333 | orchestrator | TASK [nova-cell : Check cinder keyring file] *********************************** 2026-04-28 03:31:20.803339 | orchestrator | Tuesday 28 April 2026 03:31:15 +0000 (0:00:01.296) 0:04:24.884 ********* 2026-04-28 03:31:20.803344 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 03:31:20.803349 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 03:31:20.803354 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 03:31:20.803359 | orchestrator | 2026-04-28 03:31:20.803364 | orchestrator | TASK [nova-cell : Extract nova key from file] ********************************** 2026-04-28 03:31:20.803370 | orchestrator | Tuesday 28 April 2026 03:31:16 +0000 (0:00:00.997) 0:04:25.882 ********* 2026-04-28 03:31:20.803375 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:31:20.803381 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:31:20.803386 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:31:20.803391 | orchestrator | 2026-04-28 03:31:20.803396 | orchestrator | TASK [nova-cell : Extract cinder key from file] ******************************** 2026-04-28 03:31:20.803406 | orchestrator | Tuesday 28 April 2026 03:31:17 +0000 (0:00:00.550) 0:04:26.432 ********* 2026-04-28 03:31:20.803411 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:31:20.803416 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:31:20.803421 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:31:20.803426 | orchestrator | 2026-04-28 03:31:20.803431 | orchestrator | TASK [nova-cell : Copy over ceph nova keyring file] **************************** 2026-04-28 03:31:20.803436 | orchestrator | Tuesday 28 April 2026 03:31:18 +0000 (0:00:00.673) 0:04:27.106 ********* 2026-04-28 03:31:20.803441 | orchestrator | changed: [testbed-node-3] => (item=nova-compute) 2026-04-28 03:31:20.803447 | orchestrator | changed: [testbed-node-4] => (item=nova-compute) 2026-04-28 03:31:20.803452 | orchestrator | changed: [testbed-node-5] => (item=nova-compute) 2026-04-28 03:31:20.803457 | orchestrator | 2026-04-28 03:31:20.803462 | orchestrator | TASK [nova-cell : Copy over ceph cinder keyring file] ************************** 2026-04-28 03:31:20.803467 | orchestrator | Tuesday 28 April 2026 03:31:19 +0000 (0:00:01.508) 0:04:28.615 ********* 2026-04-28 03:31:20.803476 | orchestrator | changed: [testbed-node-3] => (item=nova-compute) 2026-04-28 03:31:40.524144 | orchestrator | changed: [testbed-node-4] => (item=nova-compute) 2026-04-28 03:31:40.524223 | orchestrator | changed: [testbed-node-5] => (item=nova-compute) 2026-04-28 03:31:40.524229 | orchestrator | 2026-04-28 03:31:40.524235 | orchestrator | TASK [nova-cell : Copy over ceph.conf] ***************************************** 2026-04-28 03:31:40.524252 | orchestrator | Tuesday 28 April 2026 03:31:20 +0000 (0:00:01.275) 0:04:29.891 ********* 2026-04-28 03:31:40.524256 | orchestrator | changed: [testbed-node-3] => (item=nova-compute) 2026-04-28 03:31:40.524260 | orchestrator | changed: [testbed-node-4] => (item=nova-compute) 2026-04-28 03:31:40.524264 | orchestrator | changed: [testbed-node-5] => (item=nova-compute) 2026-04-28 03:31:40.524268 | orchestrator | changed: [testbed-node-3] => (item=nova-libvirt) 2026-04-28 03:31:40.524272 | orchestrator | changed: [testbed-node-4] => (item=nova-libvirt) 2026-04-28 03:31:40.524276 | orchestrator | changed: [testbed-node-5] => (item=nova-libvirt) 2026-04-28 03:31:40.524280 | orchestrator | 2026-04-28 03:31:40.524284 | orchestrator | TASK [nova-cell : Ensure /etc/ceph directory exists (host libvirt)] ************ 2026-04-28 03:31:40.524288 | orchestrator | Tuesday 28 April 2026 03:31:24 +0000 (0:00:03.984) 0:04:33.875 ********* 2026-04-28 03:31:40.524292 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:31:40.524296 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:31:40.524300 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:31:40.524304 | orchestrator | 2026-04-28 03:31:40.524308 | orchestrator | TASK [nova-cell : Copy over ceph.conf (host libvirt)] ************************** 2026-04-28 03:31:40.524311 | orchestrator | Tuesday 28 April 2026 03:31:25 +0000 (0:00:00.339) 0:04:34.215 ********* 2026-04-28 03:31:40.524315 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:31:40.524319 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:31:40.524322 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:31:40.524326 | orchestrator | 2026-04-28 03:31:40.524330 | orchestrator | TASK [nova-cell : Ensuring libvirt secrets directory exists] ******************* 2026-04-28 03:31:40.524334 | orchestrator | Tuesday 28 April 2026 03:31:25 +0000 (0:00:00.584) 0:04:34.799 ********* 2026-04-28 03:31:40.524338 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:31:40.524342 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:31:40.524346 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:31:40.524349 | orchestrator | 2026-04-28 03:31:40.524353 | orchestrator | TASK [nova-cell : Pushing nova secret xml for libvirt] ************************* 2026-04-28 03:31:40.524357 | orchestrator | Tuesday 28 April 2026 03:31:27 +0000 (0:00:01.307) 0:04:36.107 ********* 2026-04-28 03:31:40.524361 | orchestrator | changed: [testbed-node-3] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'client.nova secret', 'enabled': True}) 2026-04-28 03:31:40.524367 | orchestrator | changed: [testbed-node-4] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'client.nova secret', 'enabled': True}) 2026-04-28 03:31:40.524386 | orchestrator | changed: [testbed-node-5] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'client.nova secret', 'enabled': True}) 2026-04-28 03:31:40.524390 | orchestrator | changed: [testbed-node-3] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'client.cinder secret', 'enabled': 'yes'}) 2026-04-28 03:31:40.524394 | orchestrator | changed: [testbed-node-4] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'client.cinder secret', 'enabled': 'yes'}) 2026-04-28 03:31:40.524398 | orchestrator | changed: [testbed-node-5] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'client.cinder secret', 'enabled': 'yes'}) 2026-04-28 03:31:40.524401 | orchestrator | 2026-04-28 03:31:40.524405 | orchestrator | TASK [nova-cell : Pushing secrets key for libvirt] ***************************** 2026-04-28 03:31:40.524409 | orchestrator | Tuesday 28 April 2026 03:31:30 +0000 (0:00:03.596) 0:04:39.704 ********* 2026-04-28 03:31:40.524413 | orchestrator | changed: [testbed-node-3] => (item=None) 2026-04-28 03:31:40.524417 | orchestrator | changed: [testbed-node-4] => (item=None) 2026-04-28 03:31:40.524420 | orchestrator | changed: [testbed-node-5] => (item=None) 2026-04-28 03:31:40.524424 | orchestrator | changed: [testbed-node-3] => (item=None) 2026-04-28 03:31:40.524428 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:31:40.524432 | orchestrator | changed: [testbed-node-4] => (item=None) 2026-04-28 03:31:40.524445 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:31:40.524449 | orchestrator | changed: [testbed-node-5] => (item=None) 2026-04-28 03:31:40.524453 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:31:40.524456 | orchestrator | 2026-04-28 03:31:40.524460 | orchestrator | TASK [nova-cell : Check if policies shall be overwritten] ********************** 2026-04-28 03:31:40.524464 | orchestrator | Tuesday 28 April 2026 03:31:34 +0000 (0:00:03.580) 0:04:43.284 ********* 2026-04-28 03:31:40.524468 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:31:40.524477 | orchestrator | 2026-04-28 03:31:40.524481 | orchestrator | TASK [nova-cell : Set nova policy file] **************************************** 2026-04-28 03:31:40.524485 | orchestrator | Tuesday 28 April 2026 03:31:34 +0000 (0:00:00.372) 0:04:43.656 ********* 2026-04-28 03:31:40.524489 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:31:40.524493 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:31:40.524497 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:31:40.524501 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:31:40.524504 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:31:40.524508 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:31:40.524512 | orchestrator | 2026-04-28 03:31:40.524515 | orchestrator | TASK [nova-cell : Check for vendordata file] *********************************** 2026-04-28 03:31:40.524519 | orchestrator | Tuesday 28 April 2026 03:31:35 +0000 (0:00:00.670) 0:04:44.326 ********* 2026-04-28 03:31:40.524523 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 03:31:40.524527 | orchestrator | 2026-04-28 03:31:40.524531 | orchestrator | TASK [nova-cell : Set vendordata file path] ************************************ 2026-04-28 03:31:40.524534 | orchestrator | Tuesday 28 April 2026 03:31:35 +0000 (0:00:00.741) 0:04:45.068 ********* 2026-04-28 03:31:40.524538 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:31:40.524552 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:31:40.524556 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:31:40.524559 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:31:40.524563 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:31:40.524567 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:31:40.524571 | orchestrator | 2026-04-28 03:31:40.524578 | orchestrator | TASK [nova-cell : Copying over config.json files for services] ***************** 2026-04-28 03:31:40.524582 | orchestrator | Tuesday 28 April 2026 03:31:36 +0000 (0:00:00.963) 0:04:46.031 ********* 2026-04-28 03:31:40.524588 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 03:31:40.524601 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 03:31:40.524605 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 03:31:40.524611 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 03:31:40.524620 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 03:31:47.715579 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 03:31:47.715690 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 03:31:47.715700 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 03:31:47.715706 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 03:31:47.715722 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:47.715788 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:47.715809 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:47.715822 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:47.715857 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:47.715863 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:47.715869 | orchestrator | 2026-04-28 03:31:47.715876 | orchestrator | TASK [nova-cell : Copying over nova.conf] ************************************** 2026-04-28 03:31:47.715883 | orchestrator | Tuesday 28 April 2026 03:31:40 +0000 (0:00:04.022) 0:04:50.054 ********* 2026-04-28 03:31:47.715889 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 03:31:47.715896 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 03:31:47.715916 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 03:31:48.002399 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 03:31:48.002509 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 03:31:48.002526 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 03:31:48.002539 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:48.002571 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 03:31:48.002625 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:48.002640 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:48.002652 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 03:31:48.002663 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 03:31:48.002675 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:48.002700 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:48.002713 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 03:31:48.002724 | orchestrator | 2026-04-28 03:31:48.002738 | orchestrator | TASK [nova-cell : Copying over Nova compute provider config] ******************* 2026-04-28 03:31:48.002757 | orchestrator | Tuesday 28 April 2026 03:31:47 +0000 (0:00:07.032) 0:04:57.087 ********* 2026-04-28 03:32:11.420113 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:32:11.420196 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:32:11.420206 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:32:11.420213 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:32:11.420219 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:32:11.420226 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:32:11.420233 | orchestrator | 2026-04-28 03:32:11.420241 | orchestrator | TASK [nova-cell : Copying over libvirt configuration] ************************** 2026-04-28 03:32:11.420249 | orchestrator | Tuesday 28 April 2026 03:31:49 +0000 (0:00:01.526) 0:04:58.613 ********* 2026-04-28 03:32:11.420256 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-28 03:32:11.420264 | orchestrator | changed: [testbed-node-3] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-28 03:32:11.420271 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-28 03:32:11.420277 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-28 03:32:11.420284 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-28 03:32:11.420292 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:32:11.420299 | orchestrator | changed: [testbed-node-4] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-28 03:32:11.420305 | orchestrator | changed: [testbed-node-5] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-28 03:32:11.420312 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-28 03:32:11.420319 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:32:11.420325 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-28 03:32:11.420332 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:32:11.420339 | orchestrator | changed: [testbed-node-3] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-28 03:32:11.420346 | orchestrator | changed: [testbed-node-4] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-28 03:32:11.420352 | orchestrator | changed: [testbed-node-5] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-28 03:32:11.420359 | orchestrator | 2026-04-28 03:32:11.420366 | orchestrator | TASK [nova-cell : Copying over libvirt TLS keys] ******************************* 2026-04-28 03:32:11.420376 | orchestrator | Tuesday 28 April 2026 03:31:53 +0000 (0:00:04.183) 0:05:02.796 ********* 2026-04-28 03:32:11.420413 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:32:11.420425 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:32:11.420434 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:32:11.420445 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:32:11.420456 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:32:11.420465 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:32:11.420476 | orchestrator | 2026-04-28 03:32:11.420486 | orchestrator | TASK [nova-cell : Copying over libvirt SASL configuration] ********************* 2026-04-28 03:32:11.420496 | orchestrator | Tuesday 28 April 2026 03:31:54 +0000 (0:00:00.648) 0:05:03.445 ********* 2026-04-28 03:32:11.420507 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-28 03:32:11.420517 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-28 03:32:11.420528 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-28 03:32:11.420539 | orchestrator | changed: [testbed-node-3] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-28 03:32:11.420550 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-28 03:32:11.420558 | orchestrator | changed: [testbed-node-5] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-28 03:32:11.420564 | orchestrator | changed: [testbed-node-4] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-28 03:32:11.420570 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-28 03:32:11.420589 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-28 03:32:11.420595 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-28 03:32:11.420602 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:32:11.420608 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-28 03:32:11.420614 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:32:11.420620 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-28 03:32:11.420626 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:32:11.420632 | orchestrator | changed: [testbed-node-3] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-28 03:32:11.420638 | orchestrator | changed: [testbed-node-5] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-28 03:32:11.420659 | orchestrator | changed: [testbed-node-4] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-28 03:32:11.420666 | orchestrator | changed: [testbed-node-3] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-28 03:32:11.420672 | orchestrator | changed: [testbed-node-5] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-28 03:32:11.420678 | orchestrator | changed: [testbed-node-4] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-28 03:32:11.420684 | orchestrator | 2026-04-28 03:32:11.420691 | orchestrator | TASK [nova-cell : Copying files for nova-ssh] ********************************** 2026-04-28 03:32:11.420697 | orchestrator | Tuesday 28 April 2026 03:32:00 +0000 (0:00:05.723) 0:05:09.168 ********* 2026-04-28 03:32:11.420703 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-28 03:32:11.420710 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-28 03:32:11.420716 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-28 03:32:11.420729 | orchestrator | changed: [testbed-node-3] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-28 03:32:11.420735 | orchestrator | changed: [testbed-node-4] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-28 03:32:11.420741 | orchestrator | changed: [testbed-node-5] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-28 03:32:11.420747 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-28 03:32:11.420754 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-28 03:32:11.420760 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-28 03:32:11.420766 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-28 03:32:11.420772 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-28 03:32:11.420778 | orchestrator | changed: [testbed-node-3] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-28 03:32:11.420784 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-28 03:32:11.420790 | orchestrator | changed: [testbed-node-4] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-28 03:32:11.420796 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-28 03:32:11.420803 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:32:11.420809 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-28 03:32:11.420815 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:32:11.420821 | orchestrator | changed: [testbed-node-5] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-28 03:32:11.420827 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-28 03:32:11.420882 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:32:11.420888 | orchestrator | changed: [testbed-node-3] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-28 03:32:11.420895 | orchestrator | changed: [testbed-node-4] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-28 03:32:11.420901 | orchestrator | changed: [testbed-node-5] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-28 03:32:11.420907 | orchestrator | changed: [testbed-node-3] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-28 03:32:11.420913 | orchestrator | changed: [testbed-node-4] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-28 03:32:11.420919 | orchestrator | changed: [testbed-node-5] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-28 03:32:11.420925 | orchestrator | 2026-04-28 03:32:11.420931 | orchestrator | TASK [nova-cell : Copying VMware vCenter CA file] ****************************** 2026-04-28 03:32:11.420939 | orchestrator | Tuesday 28 April 2026 03:32:07 +0000 (0:00:07.537) 0:05:16.706 ********* 2026-04-28 03:32:11.420949 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:32:11.420960 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:32:11.420970 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:32:11.420980 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:32:11.420990 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:32:11.421005 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:32:11.421015 | orchestrator | 2026-04-28 03:32:11.421025 | orchestrator | TASK [nova-cell : Copying 'release' file for nova_compute] ********************* 2026-04-28 03:32:11.421033 | orchestrator | Tuesday 28 April 2026 03:32:08 +0000 (0:00:00.885) 0:05:17.591 ********* 2026-04-28 03:32:11.421042 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:32:11.421051 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:32:11.421062 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:32:11.421073 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:32:11.421083 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:32:11.421093 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:32:11.421111 | orchestrator | 2026-04-28 03:32:11.421122 | orchestrator | TASK [nova-cell : Generating 'hostnqn' file for nova_compute] ****************** 2026-04-28 03:32:11.421132 | orchestrator | Tuesday 28 April 2026 03:32:09 +0000 (0:00:00.706) 0:05:18.298 ********* 2026-04-28 03:32:11.421143 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:32:11.421150 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:32:11.421156 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:32:11.421162 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:32:11.421168 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:32:11.421175 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:32:11.421182 | orchestrator | 2026-04-28 03:32:11.421197 | orchestrator | TASK [nova-cell : Copying over existing policy file] *************************** 2026-04-28 03:32:12.693008 | orchestrator | Tuesday 28 April 2026 03:32:11 +0000 (0:00:02.200) 0:05:20.498 ********* 2026-04-28 03:32:12.693092 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 03:32:12.693106 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 03:32:12.693117 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 03:32:12.693126 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:32:12.693149 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 03:32:12.693179 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 03:32:12.693200 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 03:32:12.693208 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:32:12.693216 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 03:32:12.693224 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 03:32:12.693232 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 03:32:12.693239 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:32:12.693258 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 03:32:12.693272 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 03:32:16.884376 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:32:16.884488 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 03:32:16.884509 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 03:32:16.884522 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:32:16.884534 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 03:32:16.884546 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 03:32:16.884558 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:32:16.884569 | orchestrator | 2026-04-28 03:32:16.884604 | orchestrator | TASK [nova-cell : Copying over vendordata file to containers] ****************** 2026-04-28 03:32:16.884617 | orchestrator | Tuesday 28 April 2026 03:32:13 +0000 (0:00:01.663) 0:05:22.161 ********* 2026-04-28 03:32:16.884629 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute)  2026-04-28 03:32:16.884640 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute-ironic)  2026-04-28 03:32:16.884652 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:32:16.884662 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute)  2026-04-28 03:32:16.884674 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute-ironic)  2026-04-28 03:32:16.884684 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:32:16.884695 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute)  2026-04-28 03:32:16.884721 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute-ironic)  2026-04-28 03:32:16.884732 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:32:16.884743 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute)  2026-04-28 03:32:16.884754 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute-ironic)  2026-04-28 03:32:16.884765 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:32:16.884776 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute)  2026-04-28 03:32:16.884787 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute-ironic)  2026-04-28 03:32:16.884797 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:32:16.884808 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute)  2026-04-28 03:32:16.884819 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute-ironic)  2026-04-28 03:32:16.884857 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:32:16.884870 | orchestrator | 2026-04-28 03:32:16.884881 | orchestrator | TASK [nova-cell : Check nova-cell containers] ********************************** 2026-04-28 03:32:16.884892 | orchestrator | Tuesday 28 April 2026 03:32:14 +0000 (0:00:01.016) 0:05:23.178 ********* 2026-04-28 03:32:16.884925 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 03:32:16.884942 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 03:32:16.884955 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 03:32:16.884982 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 03:32:16.885010 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 03:32:16.885044 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 03:33:07.725674 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 03:33:07.725809 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 03:33:07.725827 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 03:33:07.725908 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 03:33:07.725939 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 03:33:07.725952 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 03:33:07.725984 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 03:33:07.725997 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 03:33:07.726009 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 03:33:07.726097 | orchestrator | 2026-04-28 03:33:07.726113 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-28 03:33:07.726126 | orchestrator | Tuesday 28 April 2026 03:32:17 +0000 (0:00:03.286) 0:05:26.465 ********* 2026-04-28 03:33:07.726137 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:33:07.726149 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:33:07.726160 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:33:07.726174 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:33:07.726186 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:33:07.726198 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:33:07.726210 | orchestrator | 2026-04-28 03:33:07.726241 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-28 03:33:07.726260 | orchestrator | Tuesday 28 April 2026 03:32:18 +0000 (0:00:00.910) 0:05:27.375 ********* 2026-04-28 03:33:07.726278 | orchestrator | 2026-04-28 03:33:07.726296 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-28 03:33:07.726315 | orchestrator | Tuesday 28 April 2026 03:32:18 +0000 (0:00:00.170) 0:05:27.546 ********* 2026-04-28 03:33:07.726332 | orchestrator | 2026-04-28 03:33:07.726350 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-28 03:33:07.726368 | orchestrator | Tuesday 28 April 2026 03:32:18 +0000 (0:00:00.167) 0:05:27.714 ********* 2026-04-28 03:33:07.726388 | orchestrator | 2026-04-28 03:33:07.726407 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-28 03:33:07.726426 | orchestrator | Tuesday 28 April 2026 03:32:18 +0000 (0:00:00.162) 0:05:27.876 ********* 2026-04-28 03:33:07.726439 | orchestrator | 2026-04-28 03:33:07.726458 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-28 03:33:07.726469 | orchestrator | Tuesday 28 April 2026 03:32:19 +0000 (0:00:00.330) 0:05:28.206 ********* 2026-04-28 03:33:07.726480 | orchestrator | 2026-04-28 03:33:07.726491 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-28 03:33:07.726501 | orchestrator | Tuesday 28 April 2026 03:32:19 +0000 (0:00:00.149) 0:05:28.356 ********* 2026-04-28 03:33:07.726512 | orchestrator | 2026-04-28 03:33:07.726523 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-conductor container] ***************** 2026-04-28 03:33:07.726534 | orchestrator | Tuesday 28 April 2026 03:32:19 +0000 (0:00:00.160) 0:05:28.516 ********* 2026-04-28 03:33:07.726545 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:33:07.726556 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:33:07.726567 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:33:07.726578 | orchestrator | 2026-04-28 03:33:07.726588 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-novncproxy container] **************** 2026-04-28 03:33:07.726599 | orchestrator | Tuesday 28 April 2026 03:32:29 +0000 (0:00:10.382) 0:05:38.899 ********* 2026-04-28 03:33:07.726610 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:33:07.726620 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:33:07.726631 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:33:07.726642 | orchestrator | 2026-04-28 03:33:07.726653 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-ssh container] *********************** 2026-04-28 03:33:07.726663 | orchestrator | Tuesday 28 April 2026 03:32:45 +0000 (0:00:16.178) 0:05:55.078 ********* 2026-04-28 03:33:07.726674 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:33:07.726685 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:33:07.726698 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:33:07.726729 | orchestrator | 2026-04-28 03:33:07.726761 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-libvirt container] ******************* 2026-04-28 03:35:33.278612 | orchestrator | Tuesday 28 April 2026 03:33:07 +0000 (0:00:21.722) 0:06:16.801 ********* 2026-04-28 03:35:33.278710 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:35:33.278730 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:35:33.278754 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:35:33.278769 | orchestrator | 2026-04-28 03:35:33.278786 | orchestrator | RUNNING HANDLER [nova-cell : Checking libvirt container is ready] ************** 2026-04-28 03:35:33.278800 | orchestrator | Tuesday 28 April 2026 03:33:51 +0000 (0:00:43.979) 0:07:00.780 ********* 2026-04-28 03:35:33.278815 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:35:33.278856 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:35:33.278871 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:35:33.278885 | orchestrator | 2026-04-28 03:35:33.278900 | orchestrator | RUNNING HANDLER [nova-cell : Create libvirt SASL user] ************************* 2026-04-28 03:35:33.278915 | orchestrator | Tuesday 28 April 2026 03:33:52 +0000 (0:00:00.816) 0:07:01.597 ********* 2026-04-28 03:35:33.278930 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:35:33.278946 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:35:33.278961 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:35:33.278975 | orchestrator | 2026-04-28 03:35:33.278990 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-compute container] ******************* 2026-04-28 03:35:33.279004 | orchestrator | Tuesday 28 April 2026 03:33:53 +0000 (0:00:00.797) 0:07:02.394 ********* 2026-04-28 03:35:33.279019 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:35:33.279028 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:35:33.279037 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:35:33.279046 | orchestrator | 2026-04-28 03:35:33.279056 | orchestrator | RUNNING HANDLER [nova-cell : Wait for nova-compute services to update service versions] *** 2026-04-28 03:35:33.279066 | orchestrator | Tuesday 28 April 2026 03:34:22 +0000 (0:00:29.448) 0:07:31.843 ********* 2026-04-28 03:35:33.279074 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:35:33.279083 | orchestrator | 2026-04-28 03:35:33.279092 | orchestrator | TASK [nova-cell : Waiting for nova-compute services to register themselves] **** 2026-04-28 03:35:33.279101 | orchestrator | Tuesday 28 April 2026 03:34:22 +0000 (0:00:00.133) 0:07:31.977 ********* 2026-04-28 03:35:33.279110 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:35:33.279118 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:35:33.279127 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:35:33.279136 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:35:33.279144 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:35:33.279154 | orchestrator | FAILED - RETRYING: [testbed-node-3 -> testbed-node-0]: Waiting for nova-compute services to register themselves (20 retries left). 2026-04-28 03:35:33.279165 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-28 03:35:33.279175 | orchestrator | 2026-04-28 03:35:33.279185 | orchestrator | TASK [nova-cell : Fail if nova-compute service failed to register] ************* 2026-04-28 03:35:33.279195 | orchestrator | Tuesday 28 April 2026 03:34:45 +0000 (0:00:22.434) 0:07:54.411 ********* 2026-04-28 03:35:33.279210 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:35:33.279230 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:35:33.279251 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:35:33.279263 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:35:33.279277 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:35:33.279403 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:35:33.279421 | orchestrator | 2026-04-28 03:35:33.279435 | orchestrator | TASK [nova-cell : Include discover_computes.yml] ******************************* 2026-04-28 03:35:33.279451 | orchestrator | Tuesday 28 April 2026 03:34:55 +0000 (0:00:09.888) 0:08:04.299 ********* 2026-04-28 03:35:33.279466 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:35:33.279480 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:35:33.279495 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:35:33.279511 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:35:33.279557 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:35:33.279567 | orchestrator | included: /ansible/roles/nova-cell/tasks/discover_computes.yml for testbed-node-3 2026-04-28 03:35:33.279576 | orchestrator | 2026-04-28 03:35:33.279586 | orchestrator | TASK [nova-cell : Get a list of existing cells] ******************************** 2026-04-28 03:35:33.279595 | orchestrator | Tuesday 28 April 2026 03:34:59 +0000 (0:00:04.738) 0:08:09.038 ********* 2026-04-28 03:35:33.279603 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-28 03:35:33.279612 | orchestrator | 2026-04-28 03:35:33.279636 | orchestrator | TASK [nova-cell : Extract current cell settings from list] ********************* 2026-04-28 03:35:33.279644 | orchestrator | Tuesday 28 April 2026 03:35:13 +0000 (0:00:13.194) 0:08:22.233 ********* 2026-04-28 03:35:33.279653 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-28 03:35:33.279662 | orchestrator | 2026-04-28 03:35:33.279670 | orchestrator | TASK [nova-cell : Fail if cell settings not found] ***************************** 2026-04-28 03:35:33.279679 | orchestrator | Tuesday 28 April 2026 03:35:14 +0000 (0:00:01.426) 0:08:23.660 ********* 2026-04-28 03:35:33.279688 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:35:33.279696 | orchestrator | 2026-04-28 03:35:33.279705 | orchestrator | TASK [nova-cell : Discover nova hosts] ***************************************** 2026-04-28 03:35:33.279713 | orchestrator | Tuesday 28 April 2026 03:35:16 +0000 (0:00:01.465) 0:08:25.125 ********* 2026-04-28 03:35:33.279722 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-28 03:35:33.279730 | orchestrator | 2026-04-28 03:35:33.279739 | orchestrator | TASK [nova-cell : Remove old nova_libvirt_secrets container volume] ************ 2026-04-28 03:35:33.279747 | orchestrator | Tuesday 28 April 2026 03:35:27 +0000 (0:00:11.286) 0:08:36.411 ********* 2026-04-28 03:35:33.279756 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:35:33.279766 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:35:33.279774 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:35:33.279783 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:35:33.279791 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:35:33.279799 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:35:33.279808 | orchestrator | 2026-04-28 03:35:33.279816 | orchestrator | PLAY [Refresh nova scheduler cell cache] *************************************** 2026-04-28 03:35:33.279903 | orchestrator | 2026-04-28 03:35:33.279915 | orchestrator | TASK [nova : Refresh cell cache in nova scheduler] ***************************** 2026-04-28 03:35:33.279944 | orchestrator | Tuesday 28 April 2026 03:35:29 +0000 (0:00:01.953) 0:08:38.365 ********* 2026-04-28 03:35:33.279954 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:35:33.279962 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:35:33.279971 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:35:33.279982 | orchestrator | 2026-04-28 03:35:33.279997 | orchestrator | PLAY [Reload global Nova super conductor services] ***************************** 2026-04-28 03:35:33.280018 | orchestrator | 2026-04-28 03:35:33.280034 | orchestrator | TASK [nova : Reload nova super conductor services to remove RPC version pin] *** 2026-04-28 03:35:33.280048 | orchestrator | Tuesday 28 April 2026 03:35:30 +0000 (0:00:01.001) 0:08:39.366 ********* 2026-04-28 03:35:33.280061 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:35:33.280074 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:35:33.280088 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:35:33.280100 | orchestrator | 2026-04-28 03:35:33.280113 | orchestrator | PLAY [Reload Nova cell services] *********************************************** 2026-04-28 03:35:33.280129 | orchestrator | 2026-04-28 03:35:33.280143 | orchestrator | TASK [nova-cell : Reload nova cell services to remove RPC version cap] ********* 2026-04-28 03:35:33.280158 | orchestrator | Tuesday 28 April 2026 03:35:31 +0000 (0:00:00.835) 0:08:40.202 ********* 2026-04-28 03:35:33.280172 | orchestrator | skipping: [testbed-node-3] => (item=nova-conductor)  2026-04-28 03:35:33.280186 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute)  2026-04-28 03:35:33.280198 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute-ironic)  2026-04-28 03:35:33.280207 | orchestrator | skipping: [testbed-node-3] => (item=nova-novncproxy)  2026-04-28 03:35:33.280227 | orchestrator | skipping: [testbed-node-3] => (item=nova-serialproxy)  2026-04-28 03:35:33.280237 | orchestrator | skipping: [testbed-node-3] => (item=nova-spicehtml5proxy)  2026-04-28 03:35:33.280252 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:35:33.280267 | orchestrator | skipping: [testbed-node-4] => (item=nova-conductor)  2026-04-28 03:35:33.280281 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute)  2026-04-28 03:35:33.280295 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute-ironic)  2026-04-28 03:35:33.280310 | orchestrator | skipping: [testbed-node-4] => (item=nova-novncproxy)  2026-04-28 03:35:33.280324 | orchestrator | skipping: [testbed-node-4] => (item=nova-serialproxy)  2026-04-28 03:35:33.280339 | orchestrator | skipping: [testbed-node-4] => (item=nova-spicehtml5proxy)  2026-04-28 03:35:33.280354 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:35:33.280368 | orchestrator | skipping: [testbed-node-5] => (item=nova-conductor)  2026-04-28 03:35:33.280383 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute)  2026-04-28 03:35:33.280392 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute-ironic)  2026-04-28 03:35:33.280400 | orchestrator | skipping: [testbed-node-5] => (item=nova-novncproxy)  2026-04-28 03:35:33.280409 | orchestrator | skipping: [testbed-node-5] => (item=nova-serialproxy)  2026-04-28 03:35:33.280418 | orchestrator | skipping: [testbed-node-5] => (item=nova-spicehtml5proxy)  2026-04-28 03:35:33.280428 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:35:33.280442 | orchestrator | skipping: [testbed-node-0] => (item=nova-conductor)  2026-04-28 03:35:33.280498 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute)  2026-04-28 03:35:33.280513 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute-ironic)  2026-04-28 03:35:33.280526 | orchestrator | skipping: [testbed-node-0] => (item=nova-novncproxy)  2026-04-28 03:35:33.280540 | orchestrator | skipping: [testbed-node-0] => (item=nova-serialproxy)  2026-04-28 03:35:33.280554 | orchestrator | skipping: [testbed-node-0] => (item=nova-spicehtml5proxy)  2026-04-28 03:35:33.280568 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:35:33.280581 | orchestrator | skipping: [testbed-node-1] => (item=nova-conductor)  2026-04-28 03:35:33.280594 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute)  2026-04-28 03:35:33.280608 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute-ironic)  2026-04-28 03:35:33.280622 | orchestrator | skipping: [testbed-node-1] => (item=nova-novncproxy)  2026-04-28 03:35:33.280637 | orchestrator | skipping: [testbed-node-1] => (item=nova-serialproxy)  2026-04-28 03:35:33.280651 | orchestrator | skipping: [testbed-node-1] => (item=nova-spicehtml5proxy)  2026-04-28 03:35:33.280667 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:35:33.280694 | orchestrator | skipping: [testbed-node-2] => (item=nova-conductor)  2026-04-28 03:35:33.280708 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute)  2026-04-28 03:35:33.280718 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute-ironic)  2026-04-28 03:35:33.280726 | orchestrator | skipping: [testbed-node-2] => (item=nova-novncproxy)  2026-04-28 03:35:33.280735 | orchestrator | skipping: [testbed-node-2] => (item=nova-serialproxy)  2026-04-28 03:35:33.280743 | orchestrator | skipping: [testbed-node-2] => (item=nova-spicehtml5proxy)  2026-04-28 03:35:33.280756 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:35:33.280768 | orchestrator | 2026-04-28 03:35:33.280777 | orchestrator | PLAY [Reload global Nova API services] ***************************************** 2026-04-28 03:35:33.280785 | orchestrator | 2026-04-28 03:35:33.280794 | orchestrator | TASK [nova : Reload nova API services to remove RPC version pin] *************** 2026-04-28 03:35:33.280802 | orchestrator | Tuesday 28 April 2026 03:35:32 +0000 (0:00:01.499) 0:08:41.701 ********* 2026-04-28 03:35:33.280816 | orchestrator | skipping: [testbed-node-0] => (item=nova-scheduler)  2026-04-28 03:35:33.280867 | orchestrator | skipping: [testbed-node-0] => (item=nova-api)  2026-04-28 03:35:33.280882 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:35:33.280908 | orchestrator | skipping: [testbed-node-1] => (item=nova-scheduler)  2026-04-28 03:35:33.280920 | orchestrator | skipping: [testbed-node-1] => (item=nova-api)  2026-04-28 03:35:33.280933 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:35:33.280945 | orchestrator | skipping: [testbed-node-2] => (item=nova-scheduler)  2026-04-28 03:35:33.280958 | orchestrator | skipping: [testbed-node-2] => (item=nova-api)  2026-04-28 03:35:33.280971 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:35:33.280983 | orchestrator | 2026-04-28 03:35:33.281012 | orchestrator | PLAY [Run Nova API online data migrations] ************************************* 2026-04-28 03:35:35.511266 | orchestrator | 2026-04-28 03:35:35.511376 | orchestrator | TASK [nova : Run Nova API online database migrations] ************************** 2026-04-28 03:35:35.511394 | orchestrator | Tuesday 28 April 2026 03:35:33 +0000 (0:00:00.661) 0:08:42.363 ********* 2026-04-28 03:35:35.511406 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:35:35.511418 | orchestrator | 2026-04-28 03:35:35.511430 | orchestrator | PLAY [Run Nova cell online data migrations] ************************************ 2026-04-28 03:35:35.511441 | orchestrator | 2026-04-28 03:35:35.511452 | orchestrator | TASK [nova-cell : Run Nova cell online database migrations] ******************** 2026-04-28 03:35:35.511463 | orchestrator | Tuesday 28 April 2026 03:35:34 +0000 (0:00:01.240) 0:08:43.603 ********* 2026-04-28 03:35:35.511474 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:35:35.511485 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:35:35.511495 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:35:35.511506 | orchestrator | 2026-04-28 03:35:35.511517 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 03:35:35.511528 | orchestrator | testbed-manager : ok=3  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 03:35:35.511542 | orchestrator | testbed-node-0 : ok=54  changed=35  unreachable=0 failed=0 skipped=44  rescued=0 ignored=0 2026-04-28 03:35:35.511554 | orchestrator | testbed-node-1 : ok=27  changed=19  unreachable=0 failed=0 skipped=51  rescued=0 ignored=0 2026-04-28 03:35:35.511565 | orchestrator | testbed-node-2 : ok=27  changed=19  unreachable=0 failed=0 skipped=51  rescued=0 ignored=0 2026-04-28 03:35:35.511575 | orchestrator | testbed-node-3 : ok=43  changed=27  unreachable=0 failed=0 skipped=20  rescued=0 ignored=0 2026-04-28 03:35:35.511586 | orchestrator | testbed-node-4 : ok=37  changed=27  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-28 03:35:35.511597 | orchestrator | testbed-node-5 : ok=37  changed=27  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-28 03:35:35.511615 | orchestrator | 2026-04-28 03:35:35.511633 | orchestrator | 2026-04-28 03:35:35.511651 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 03:35:35.511669 | orchestrator | Tuesday 28 April 2026 03:35:34 +0000 (0:00:00.487) 0:08:44.091 ********* 2026-04-28 03:35:35.511686 | orchestrator | =============================================================================== 2026-04-28 03:35:35.511706 | orchestrator | nova-cell : Restart nova-libvirt container ----------------------------- 43.98s 2026-04-28 03:35:35.511725 | orchestrator | nova : Running Nova API bootstrap container ---------------------------- 32.33s 2026-04-28 03:35:35.511744 | orchestrator | nova-cell : Restart nova-compute container ----------------------------- 29.45s 2026-04-28 03:35:35.511762 | orchestrator | nova-cell : Waiting for nova-compute services to register themselves --- 22.43s 2026-04-28 03:35:35.511780 | orchestrator | nova-cell : Running Nova cell bootstrap container ---------------------- 21.78s 2026-04-28 03:35:35.511793 | orchestrator | nova-cell : Restart nova-ssh container --------------------------------- 21.72s 2026-04-28 03:35:35.511863 | orchestrator | nova : Restart nova-scheduler container -------------------------------- 19.73s 2026-04-28 03:35:35.511877 | orchestrator | nova : Running Nova API bootstrap container ---------------------------- 18.19s 2026-04-28 03:35:35.511889 | orchestrator | nova-cell : Restart nova-novncproxy container -------------------------- 16.18s 2026-04-28 03:35:35.511902 | orchestrator | nova : Create cell0 mappings ------------------------------------------- 14.34s 2026-04-28 03:35:35.511930 | orchestrator | nova-cell : Create cell ------------------------------------------------ 13.23s 2026-04-28 03:35:35.511943 | orchestrator | nova-cell : Get a list of existing cells ------------------------------- 13.19s 2026-04-28 03:35:35.511955 | orchestrator | nova-cell : Get a list of existing cells ------------------------------- 13.09s 2026-04-28 03:35:35.511968 | orchestrator | nova-cell : Get a list of existing cells ------------------------------- 11.98s 2026-04-28 03:35:35.511980 | orchestrator | nova-cell : Discover nova hosts ---------------------------------------- 11.29s 2026-04-28 03:35:35.511992 | orchestrator | nova-cell : Restart nova-conductor container --------------------------- 10.38s 2026-04-28 03:35:35.512005 | orchestrator | nova-cell : Fail if nova-compute service failed to register ------------- 9.89s 2026-04-28 03:35:35.512017 | orchestrator | nova-cell : Copying files for nova-ssh ---------------------------------- 7.54s 2026-04-28 03:35:35.512030 | orchestrator | service-rabbitmq : nova | Ensure RabbitMQ users exist ------------------- 7.46s 2026-04-28 03:35:35.512042 | orchestrator | service-ks-register : nova | Granting user roles ------------------------ 7.16s 2026-04-28 03:35:38.131424 | orchestrator | 2026-04-28 03:35:38 | INFO  | Task 4fca2556-f451-44da-8a2d-d157b81df8ae (horizon) was prepared for execution. 2026-04-28 03:35:38.131519 | orchestrator | 2026-04-28 03:35:38 | INFO  | It takes a moment until task 4fca2556-f451-44da-8a2d-d157b81df8ae (horizon) has been started and output is visible here. 2026-04-28 03:35:46.352816 | orchestrator | 2026-04-28 03:35:46.353766 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 03:35:46.353806 | orchestrator | 2026-04-28 03:35:46.353817 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 03:35:46.353850 | orchestrator | Tuesday 28 April 2026 03:35:43 +0000 (0:00:00.291) 0:00:00.291 ********* 2026-04-28 03:35:46.353864 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:35:46.353875 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:35:46.353884 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:35:46.353892 | orchestrator | 2026-04-28 03:35:46.353901 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 03:35:46.353909 | orchestrator | Tuesday 28 April 2026 03:35:43 +0000 (0:00:00.335) 0:00:00.626 ********* 2026-04-28 03:35:46.353918 | orchestrator | ok: [testbed-node-0] => (item=enable_horizon_True) 2026-04-28 03:35:46.353926 | orchestrator | ok: [testbed-node-1] => (item=enable_horizon_True) 2026-04-28 03:35:46.353934 | orchestrator | ok: [testbed-node-2] => (item=enable_horizon_True) 2026-04-28 03:35:46.353942 | orchestrator | 2026-04-28 03:35:46.353950 | orchestrator | PLAY [Apply role horizon] ****************************************************** 2026-04-28 03:35:46.353958 | orchestrator | 2026-04-28 03:35:46.353967 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-28 03:35:46.353976 | orchestrator | Tuesday 28 April 2026 03:35:43 +0000 (0:00:00.481) 0:00:01.108 ********* 2026-04-28 03:35:46.353984 | orchestrator | included: /ansible/roles/horizon/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:35:46.353994 | orchestrator | 2026-04-28 03:35:46.354002 | orchestrator | TASK [horizon : Ensuring config directories exist] ***************************** 2026-04-28 03:35:46.354010 | orchestrator | Tuesday 28 April 2026 03:35:44 +0000 (0:00:00.599) 0:00:01.707 ********* 2026-04-28 03:35:46.354088 | orchestrator | changed: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 03:35:46.354148 | orchestrator | changed: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 03:35:46.354165 | orchestrator | changed: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 03:35:46.354180 | orchestrator | 2026-04-28 03:35:46.354189 | orchestrator | TASK [horizon : Set empty custom policy] *************************************** 2026-04-28 03:35:46.354197 | orchestrator | Tuesday 28 April 2026 03:35:45 +0000 (0:00:01.254) 0:00:02.962 ********* 2026-04-28 03:35:46.354205 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:35:46.354212 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:35:46.354220 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:35:46.354228 | orchestrator | 2026-04-28 03:35:46.354236 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-28 03:35:46.354244 | orchestrator | Tuesday 28 April 2026 03:35:46 +0000 (0:00:00.522) 0:00:03.484 ********* 2026-04-28 03:35:46.354257 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'cloudkitty', 'enabled': False})  2026-04-28 03:35:53.107727 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'heat', 'enabled': 'no'})  2026-04-28 03:35:53.107873 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'ironic', 'enabled': False})  2026-04-28 03:35:53.107890 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'masakari', 'enabled': False})  2026-04-28 03:35:53.107901 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'mistral', 'enabled': False})  2026-04-28 03:35:53.107911 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'tacker', 'enabled': False})  2026-04-28 03:35:53.107921 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'trove', 'enabled': False})  2026-04-28 03:35:53.107931 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'watcher', 'enabled': False})  2026-04-28 03:35:53.107941 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'cloudkitty', 'enabled': False})  2026-04-28 03:35:53.107951 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'heat', 'enabled': 'no'})  2026-04-28 03:35:53.107960 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'ironic', 'enabled': False})  2026-04-28 03:35:53.107993 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'masakari', 'enabled': False})  2026-04-28 03:35:53.108004 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'mistral', 'enabled': False})  2026-04-28 03:35:53.108013 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'tacker', 'enabled': False})  2026-04-28 03:35:53.108023 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'trove', 'enabled': False})  2026-04-28 03:35:53.108033 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'watcher', 'enabled': False})  2026-04-28 03:35:53.108042 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'cloudkitty', 'enabled': False})  2026-04-28 03:35:53.108052 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'heat', 'enabled': 'no'})  2026-04-28 03:35:53.108061 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'ironic', 'enabled': False})  2026-04-28 03:35:53.108071 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'masakari', 'enabled': False})  2026-04-28 03:35:53.108081 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'mistral', 'enabled': False})  2026-04-28 03:35:53.108090 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'tacker', 'enabled': False})  2026-04-28 03:35:53.108100 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'trove', 'enabled': False})  2026-04-28 03:35:53.108111 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'watcher', 'enabled': False})  2026-04-28 03:35:53.108122 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'ceilometer', 'enabled': 'yes'}) 2026-04-28 03:35:53.108134 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'cinder', 'enabled': 'yes'}) 2026-04-28 03:35:53.108144 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'designate', 'enabled': True}) 2026-04-28 03:35:53.108153 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'glance', 'enabled': True}) 2026-04-28 03:35:53.108163 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'keystone', 'enabled': True}) 2026-04-28 03:35:53.108173 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'magnum', 'enabled': True}) 2026-04-28 03:35:53.108196 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'manila', 'enabled': True}) 2026-04-28 03:35:53.108206 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'neutron', 'enabled': True}) 2026-04-28 03:35:53.108216 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'nova', 'enabled': True}) 2026-04-28 03:35:53.108227 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'octavia', 'enabled': True}) 2026-04-28 03:35:53.108238 | orchestrator | 2026-04-28 03:35:53.108249 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-28 03:35:53.108259 | orchestrator | Tuesday 28 April 2026 03:35:47 +0000 (0:00:00.813) 0:00:04.298 ********* 2026-04-28 03:35:53.108271 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:35:53.108283 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:35:53.108294 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:35:53.108305 | orchestrator | 2026-04-28 03:35:53.108316 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-28 03:35:53.108328 | orchestrator | Tuesday 28 April 2026 03:35:47 +0000 (0:00:00.377) 0:00:04.676 ********* 2026-04-28 03:35:53.108347 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:35:53.108359 | orchestrator | 2026-04-28 03:35:53.108386 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-28 03:35:53.108399 | orchestrator | Tuesday 28 April 2026 03:35:47 +0000 (0:00:00.348) 0:00:05.024 ********* 2026-04-28 03:35:53.108410 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:35:53.108422 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:35:53.108433 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:35:53.108444 | orchestrator | 2026-04-28 03:35:53.108455 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-28 03:35:53.108465 | orchestrator | Tuesday 28 April 2026 03:35:48 +0000 (0:00:00.355) 0:00:05.380 ********* 2026-04-28 03:35:53.108474 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:35:53.108484 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:35:53.108493 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:35:53.108503 | orchestrator | 2026-04-28 03:35:53.108513 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-28 03:35:53.108522 | orchestrator | Tuesday 28 April 2026 03:35:48 +0000 (0:00:00.354) 0:00:05.734 ********* 2026-04-28 03:35:53.108531 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:35:53.108541 | orchestrator | 2026-04-28 03:35:53.108551 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-28 03:35:53.108560 | orchestrator | Tuesday 28 April 2026 03:35:48 +0000 (0:00:00.138) 0:00:05.873 ********* 2026-04-28 03:35:53.108570 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:35:53.108579 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:35:53.108589 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:35:53.108599 | orchestrator | 2026-04-28 03:35:53.108609 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-28 03:35:53.108618 | orchestrator | Tuesday 28 April 2026 03:35:48 +0000 (0:00:00.305) 0:00:06.179 ********* 2026-04-28 03:35:53.108628 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:35:53.108638 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:35:53.108647 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:35:53.108657 | orchestrator | 2026-04-28 03:35:53.108666 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-28 03:35:53.108676 | orchestrator | Tuesday 28 April 2026 03:35:49 +0000 (0:00:00.582) 0:00:06.761 ********* 2026-04-28 03:35:53.108686 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:35:53.108695 | orchestrator | 2026-04-28 03:35:53.108705 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-28 03:35:53.108714 | orchestrator | Tuesday 28 April 2026 03:35:49 +0000 (0:00:00.145) 0:00:06.907 ********* 2026-04-28 03:35:53.108724 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:35:53.108733 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:35:53.108743 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:35:53.108752 | orchestrator | 2026-04-28 03:35:53.108762 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-28 03:35:53.108771 | orchestrator | Tuesday 28 April 2026 03:35:49 +0000 (0:00:00.324) 0:00:07.232 ********* 2026-04-28 03:35:53.108781 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:35:53.108791 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:35:53.108800 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:35:53.108810 | orchestrator | 2026-04-28 03:35:53.108894 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-28 03:35:53.108907 | orchestrator | Tuesday 28 April 2026 03:35:50 +0000 (0:00:00.354) 0:00:07.586 ********* 2026-04-28 03:35:53.108917 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:35:53.108927 | orchestrator | 2026-04-28 03:35:53.108942 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-28 03:35:53.108960 | orchestrator | Tuesday 28 April 2026 03:35:50 +0000 (0:00:00.135) 0:00:07.721 ********* 2026-04-28 03:35:53.108974 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:35:53.108991 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:35:53.109018 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:35:53.109035 | orchestrator | 2026-04-28 03:35:53.109050 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-28 03:35:53.109067 | orchestrator | Tuesday 28 April 2026 03:35:51 +0000 (0:00:00.590) 0:00:08.312 ********* 2026-04-28 03:35:53.109081 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:35:53.109097 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:35:53.109113 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:35:53.109129 | orchestrator | 2026-04-28 03:35:53.109147 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-28 03:35:53.109162 | orchestrator | Tuesday 28 April 2026 03:35:51 +0000 (0:00:00.348) 0:00:08.661 ********* 2026-04-28 03:35:53.109177 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:35:53.109194 | orchestrator | 2026-04-28 03:35:53.109219 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-28 03:35:53.109237 | orchestrator | Tuesday 28 April 2026 03:35:51 +0000 (0:00:00.149) 0:00:08.810 ********* 2026-04-28 03:35:53.109253 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:35:53.109269 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:35:53.109279 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:35:53.109288 | orchestrator | 2026-04-28 03:35:53.109298 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-28 03:35:53.109307 | orchestrator | Tuesday 28 April 2026 03:35:52 +0000 (0:00:00.475) 0:00:09.286 ********* 2026-04-28 03:35:53.109317 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:35:53.109326 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:35:53.109336 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:35:53.109345 | orchestrator | 2026-04-28 03:35:53.109355 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-28 03:35:53.109365 | orchestrator | Tuesday 28 April 2026 03:35:52 +0000 (0:00:00.370) 0:00:09.657 ********* 2026-04-28 03:35:53.109374 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:35:53.109383 | orchestrator | 2026-04-28 03:35:53.109393 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-28 03:35:53.109402 | orchestrator | Tuesday 28 April 2026 03:35:52 +0000 (0:00:00.347) 0:00:10.004 ********* 2026-04-28 03:35:53.109412 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:35:53.109422 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:35:53.109431 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:35:53.109441 | orchestrator | 2026-04-28 03:35:53.109450 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-28 03:35:53.109471 | orchestrator | Tuesday 28 April 2026 03:35:53 +0000 (0:00:00.361) 0:00:10.366 ********* 2026-04-28 03:36:08.018293 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:36:08.018394 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:36:08.018403 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:36:08.018409 | orchestrator | 2026-04-28 03:36:08.018417 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-28 03:36:08.018425 | orchestrator | Tuesday 28 April 2026 03:35:53 +0000 (0:00:00.364) 0:00:10.730 ********* 2026-04-28 03:36:08.018432 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:36:08.018439 | orchestrator | 2026-04-28 03:36:08.018445 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-28 03:36:08.018451 | orchestrator | Tuesday 28 April 2026 03:35:53 +0000 (0:00:00.149) 0:00:10.879 ********* 2026-04-28 03:36:08.018458 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:36:08.018464 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:36:08.018471 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:36:08.018477 | orchestrator | 2026-04-28 03:36:08.018483 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-28 03:36:08.018489 | orchestrator | Tuesday 28 April 2026 03:35:53 +0000 (0:00:00.336) 0:00:11.215 ********* 2026-04-28 03:36:08.018495 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:36:08.018502 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:36:08.018509 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:36:08.018535 | orchestrator | 2026-04-28 03:36:08.018542 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-28 03:36:08.018549 | orchestrator | Tuesday 28 April 2026 03:35:54 +0000 (0:00:00.630) 0:00:11.845 ********* 2026-04-28 03:36:08.018556 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:36:08.018563 | orchestrator | 2026-04-28 03:36:08.018569 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-28 03:36:08.018576 | orchestrator | Tuesday 28 April 2026 03:35:54 +0000 (0:00:00.143) 0:00:11.989 ********* 2026-04-28 03:36:08.018583 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:36:08.018590 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:36:08.018597 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:36:08.018604 | orchestrator | 2026-04-28 03:36:08.018610 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-28 03:36:08.018617 | orchestrator | Tuesday 28 April 2026 03:35:55 +0000 (0:00:00.335) 0:00:12.324 ********* 2026-04-28 03:36:08.018624 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:36:08.018631 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:36:08.018638 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:36:08.018645 | orchestrator | 2026-04-28 03:36:08.018653 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-28 03:36:08.018660 | orchestrator | Tuesday 28 April 2026 03:35:55 +0000 (0:00:00.366) 0:00:12.691 ********* 2026-04-28 03:36:08.018667 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:36:08.018674 | orchestrator | 2026-04-28 03:36:08.018681 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-28 03:36:08.018688 | orchestrator | Tuesday 28 April 2026 03:35:55 +0000 (0:00:00.138) 0:00:12.830 ********* 2026-04-28 03:36:08.018694 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:36:08.018701 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:36:08.018708 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:36:08.018715 | orchestrator | 2026-04-28 03:36:08.018722 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-28 03:36:08.018729 | orchestrator | Tuesday 28 April 2026 03:35:56 +0000 (0:00:00.540) 0:00:13.371 ********* 2026-04-28 03:36:08.018736 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:36:08.018743 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:36:08.018750 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:36:08.018757 | orchestrator | 2026-04-28 03:36:08.018764 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-28 03:36:08.018770 | orchestrator | Tuesday 28 April 2026 03:35:56 +0000 (0:00:00.341) 0:00:13.713 ********* 2026-04-28 03:36:08.018776 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:36:08.018782 | orchestrator | 2026-04-28 03:36:08.018788 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-28 03:36:08.018794 | orchestrator | Tuesday 28 April 2026 03:35:56 +0000 (0:00:00.139) 0:00:13.852 ********* 2026-04-28 03:36:08.018799 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:36:08.018805 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:36:08.018811 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:36:08.018817 | orchestrator | 2026-04-28 03:36:08.018848 | orchestrator | TASK [horizon : Copying over config.json files for services] ******************* 2026-04-28 03:36:08.018856 | orchestrator | Tuesday 28 April 2026 03:35:56 +0000 (0:00:00.330) 0:00:14.182 ********* 2026-04-28 03:36:08.018861 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:36:08.018882 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:36:08.018889 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:36:08.018897 | orchestrator | 2026-04-28 03:36:08.018903 | orchestrator | TASK [horizon : Copying over horizon.conf] ************************************* 2026-04-28 03:36:08.018911 | orchestrator | Tuesday 28 April 2026 03:35:58 +0000 (0:00:01.984) 0:00:16.167 ********* 2026-04-28 03:36:08.018917 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/horizon/templates/horizon.conf.j2) 2026-04-28 03:36:08.018925 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/horizon/templates/horizon.conf.j2) 2026-04-28 03:36:08.018940 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/horizon/templates/horizon.conf.j2) 2026-04-28 03:36:08.018946 | orchestrator | 2026-04-28 03:36:08.018952 | orchestrator | TASK [horizon : Copying over kolla-settings.py] ******************************** 2026-04-28 03:36:08.018958 | orchestrator | Tuesday 28 April 2026 03:36:00 +0000 (0:00:01.950) 0:00:18.117 ********* 2026-04-28 03:36:08.018965 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/horizon/templates/_9998-kolla-settings.py.j2) 2026-04-28 03:36:08.018973 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/horizon/templates/_9998-kolla-settings.py.j2) 2026-04-28 03:36:08.018979 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/horizon/templates/_9998-kolla-settings.py.j2) 2026-04-28 03:36:08.018986 | orchestrator | 2026-04-28 03:36:08.018993 | orchestrator | TASK [horizon : Copying over custom-settings.py] ******************************* 2026-04-28 03:36:08.019018 | orchestrator | Tuesday 28 April 2026 03:36:02 +0000 (0:00:01.978) 0:00:20.096 ********* 2026-04-28 03:36:08.019025 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/horizon/templates/_9999-custom-settings.py.j2) 2026-04-28 03:36:08.019031 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/horizon/templates/_9999-custom-settings.py.j2) 2026-04-28 03:36:08.019037 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/horizon/templates/_9999-custom-settings.py.j2) 2026-04-28 03:36:08.019042 | orchestrator | 2026-04-28 03:36:08.019048 | orchestrator | TASK [horizon : Copying over existing policy file] ***************************** 2026-04-28 03:36:08.019055 | orchestrator | Tuesday 28 April 2026 03:36:04 +0000 (0:00:01.620) 0:00:21.716 ********* 2026-04-28 03:36:08.019061 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:36:08.019068 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:36:08.019074 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:36:08.019080 | orchestrator | 2026-04-28 03:36:08.019087 | orchestrator | TASK [horizon : Copying over custom themes] ************************************ 2026-04-28 03:36:08.019094 | orchestrator | Tuesday 28 April 2026 03:36:05 +0000 (0:00:00.556) 0:00:22.273 ********* 2026-04-28 03:36:08.019101 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:36:08.019107 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:36:08.019113 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:36:08.019120 | orchestrator | 2026-04-28 03:36:08.019126 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-28 03:36:08.019131 | orchestrator | Tuesday 28 April 2026 03:36:05 +0000 (0:00:00.343) 0:00:22.616 ********* 2026-04-28 03:36:08.019135 | orchestrator | included: /ansible/roles/horizon/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:36:08.019140 | orchestrator | 2026-04-28 03:36:08.019144 | orchestrator | TASK [service-cert-copy : horizon | Copying over extra CA certificates] ******** 2026-04-28 03:36:08.019149 | orchestrator | Tuesday 28 April 2026 03:36:06 +0000 (0:00:00.663) 0:00:23.280 ********* 2026-04-28 03:36:08.019164 | orchestrator | changed: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 03:36:08.019186 | orchestrator | changed: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 03:36:08.739794 | orchestrator | changed: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 03:36:08.739938 | orchestrator | 2026-04-28 03:36:08.739953 | orchestrator | TASK [service-cert-copy : horizon | Copying over backend internal TLS certificate] *** 2026-04-28 03:36:08.739963 | orchestrator | Tuesday 28 April 2026 03:36:08 +0000 (0:00:01.989) 0:00:25.269 ********* 2026-04-28 03:36:08.739988 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-28 03:36:08.740000 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:36:08.740018 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-28 03:36:08.740033 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:36:08.740049 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-28 03:36:11.378286 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:36:11.378407 | orchestrator | 2026-04-28 03:36:11.378424 | orchestrator | TASK [service-cert-copy : horizon | Copying over backend internal TLS key] ***** 2026-04-28 03:36:11.378437 | orchestrator | Tuesday 28 April 2026 03:36:08 +0000 (0:00:00.728) 0:00:25.997 ********* 2026-04-28 03:36:11.378470 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-28 03:36:11.378487 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:36:11.378517 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-28 03:36:11.378550 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:36:11.378567 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-28 03:36:11.378577 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:36:11.378587 | orchestrator | 2026-04-28 03:36:11.378597 | orchestrator | TASK [horizon : Deploy horizon container] ************************************** 2026-04-28 03:36:11.378607 | orchestrator | Tuesday 28 April 2026 03:36:09 +0000 (0:00:00.941) 0:00:26.938 ********* 2026-04-28 03:36:11.378636 | orchestrator | changed: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 03:36:56.813720 | orchestrator | changed: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 03:36:56.813892 | orchestrator | changed: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/horizon:25.1.2.20251130', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 03:36:56.813945 | orchestrator | 2026-04-28 03:36:56.813962 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-28 03:36:56.813978 | orchestrator | Tuesday 28 April 2026 03:36:11 +0000 (0:00:01.696) 0:00:28.635 ********* 2026-04-28 03:36:56.813991 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:36:56.814005 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:36:56.814013 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:36:56.814063 | orchestrator | 2026-04-28 03:36:56.814072 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-28 03:36:56.814079 | orchestrator | Tuesday 28 April 2026 03:36:11 +0000 (0:00:00.339) 0:00:28.974 ********* 2026-04-28 03:36:56.814087 | orchestrator | included: /ansible/roles/horizon/tasks/bootstrap.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:36:56.814094 | orchestrator | 2026-04-28 03:36:56.814102 | orchestrator | TASK [horizon : Creating Horizon database] ************************************* 2026-04-28 03:36:56.814109 | orchestrator | Tuesday 28 April 2026 03:36:12 +0000 (0:00:00.625) 0:00:29.600 ********* 2026-04-28 03:36:56.814117 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:36:56.814124 | orchestrator | 2026-04-28 03:36:56.814131 | orchestrator | TASK [horizon : Creating Horizon database user and setting permissions] ******** 2026-04-28 03:36:56.814139 | orchestrator | Tuesday 28 April 2026 03:36:14 +0000 (0:00:02.278) 0:00:31.879 ********* 2026-04-28 03:36:56.814146 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:36:56.814153 | orchestrator | 2026-04-28 03:36:56.814160 | orchestrator | TASK [horizon : Running Horizon bootstrap container] *************************** 2026-04-28 03:36:56.814167 | orchestrator | Tuesday 28 April 2026 03:36:17 +0000 (0:00:02.750) 0:00:34.629 ********* 2026-04-28 03:36:56.814174 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:36:56.814182 | orchestrator | 2026-04-28 03:36:56.814189 | orchestrator | TASK [horizon : Flush handlers] ************************************************ 2026-04-28 03:36:56.814196 | orchestrator | Tuesday 28 April 2026 03:36:34 +0000 (0:00:16.897) 0:00:51.527 ********* 2026-04-28 03:36:56.814203 | orchestrator | 2026-04-28 03:36:56.814211 | orchestrator | TASK [horizon : Flush handlers] ************************************************ 2026-04-28 03:36:56.814225 | orchestrator | Tuesday 28 April 2026 03:36:34 +0000 (0:00:00.073) 0:00:51.600 ********* 2026-04-28 03:36:56.814232 | orchestrator | 2026-04-28 03:36:56.814240 | orchestrator | TASK [horizon : Flush handlers] ************************************************ 2026-04-28 03:36:56.814247 | orchestrator | Tuesday 28 April 2026 03:36:34 +0000 (0:00:00.105) 0:00:51.706 ********* 2026-04-28 03:36:56.814254 | orchestrator | 2026-04-28 03:36:56.814261 | orchestrator | RUNNING HANDLER [horizon : Restart horizon container] ************************** 2026-04-28 03:36:56.814269 | orchestrator | Tuesday 28 April 2026 03:36:34 +0000 (0:00:00.090) 0:00:51.796 ********* 2026-04-28 03:36:56.814277 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:36:56.814285 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:36:56.814293 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:36:56.814302 | orchestrator | 2026-04-28 03:36:56.814310 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 03:36:56.814319 | orchestrator | testbed-node-0 : ok=37  changed=11  unreachable=0 failed=0 skipped=25  rescued=0 ignored=0 2026-04-28 03:36:56.814329 | orchestrator | testbed-node-1 : ok=34  changed=8  unreachable=0 failed=0 skipped=15  rescued=0 ignored=0 2026-04-28 03:36:56.814376 | orchestrator | testbed-node-2 : ok=34  changed=8  unreachable=0 failed=0 skipped=15  rescued=0 ignored=0 2026-04-28 03:36:56.814386 | orchestrator | 2026-04-28 03:36:56.814394 | orchestrator | 2026-04-28 03:36:56.814402 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 03:36:56.814411 | orchestrator | Tuesday 28 April 2026 03:36:56 +0000 (0:00:22.247) 0:01:14.043 ********* 2026-04-28 03:36:56.814419 | orchestrator | =============================================================================== 2026-04-28 03:36:56.814428 | orchestrator | horizon : Restart horizon container ------------------------------------ 22.25s 2026-04-28 03:36:56.814436 | orchestrator | horizon : Running Horizon bootstrap container -------------------------- 16.90s 2026-04-28 03:36:56.814444 | orchestrator | horizon : Creating Horizon database user and setting permissions -------- 2.75s 2026-04-28 03:36:56.814452 | orchestrator | horizon : Creating Horizon database ------------------------------------- 2.28s 2026-04-28 03:36:56.814460 | orchestrator | service-cert-copy : horizon | Copying over extra CA certificates -------- 1.99s 2026-04-28 03:36:56.814468 | orchestrator | horizon : Copying over config.json files for services ------------------- 1.98s 2026-04-28 03:36:56.814477 | orchestrator | horizon : Copying over kolla-settings.py -------------------------------- 1.98s 2026-04-28 03:36:56.814485 | orchestrator | horizon : Copying over horizon.conf ------------------------------------- 1.95s 2026-04-28 03:36:56.814493 | orchestrator | horizon : Deploy horizon container -------------------------------------- 1.70s 2026-04-28 03:36:56.814505 | orchestrator | horizon : Copying over custom-settings.py ------------------------------- 1.62s 2026-04-28 03:36:56.814514 | orchestrator | horizon : Ensuring config directories exist ----------------------------- 1.25s 2026-04-28 03:36:56.814522 | orchestrator | service-cert-copy : horizon | Copying over backend internal TLS key ----- 0.94s 2026-04-28 03:36:56.814529 | orchestrator | horizon : include_tasks ------------------------------------------------- 0.81s 2026-04-28 03:36:56.814545 | orchestrator | service-cert-copy : horizon | Copying over backend internal TLS certificate --- 0.73s 2026-04-28 03:36:57.283012 | orchestrator | horizon : include_tasks ------------------------------------------------- 0.66s 2026-04-28 03:36:57.283084 | orchestrator | horizon : Update policy file name --------------------------------------- 0.63s 2026-04-28 03:36:57.283093 | orchestrator | horizon : include_tasks ------------------------------------------------- 0.63s 2026-04-28 03:36:57.283102 | orchestrator | horizon : include_tasks ------------------------------------------------- 0.60s 2026-04-28 03:36:57.283109 | orchestrator | horizon : Update custom policy file name -------------------------------- 0.59s 2026-04-28 03:36:57.283118 | orchestrator | horizon : Update policy file name --------------------------------------- 0.58s 2026-04-28 03:37:00.038733 | orchestrator | 2026-04-28 03:37:00 | INFO  | Task e684cb2b-a3f4-40f2-81a8-13ad55c67940 (skyline) was prepared for execution. 2026-04-28 03:37:00.038806 | orchestrator | 2026-04-28 03:37:00 | INFO  | It takes a moment until task e684cb2b-a3f4-40f2-81a8-13ad55c67940 (skyline) has been started and output is visible here. 2026-04-28 03:37:31.443357 | orchestrator | 2026-04-28 03:37:31.443451 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 03:37:31.443462 | orchestrator | 2026-04-28 03:37:31.443470 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 03:37:31.443478 | orchestrator | Tuesday 28 April 2026 03:37:04 +0000 (0:00:00.288) 0:00:00.288 ********* 2026-04-28 03:37:31.443485 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:37:31.443494 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:37:31.443501 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:37:31.443508 | orchestrator | 2026-04-28 03:37:31.443515 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 03:37:31.443523 | orchestrator | Tuesday 28 April 2026 03:37:05 +0000 (0:00:00.437) 0:00:00.725 ********* 2026-04-28 03:37:31.443530 | orchestrator | ok: [testbed-node-0] => (item=enable_skyline_True) 2026-04-28 03:37:31.443538 | orchestrator | ok: [testbed-node-1] => (item=enable_skyline_True) 2026-04-28 03:37:31.443545 | orchestrator | ok: [testbed-node-2] => (item=enable_skyline_True) 2026-04-28 03:37:31.443552 | orchestrator | 2026-04-28 03:37:31.443559 | orchestrator | PLAY [Apply role skyline] ****************************************************** 2026-04-28 03:37:31.443566 | orchestrator | 2026-04-28 03:37:31.443573 | orchestrator | TASK [skyline : include_tasks] ************************************************* 2026-04-28 03:37:31.443580 | orchestrator | Tuesday 28 April 2026 03:37:05 +0000 (0:00:00.567) 0:00:01.292 ********* 2026-04-28 03:37:31.443588 | orchestrator | included: /ansible/roles/skyline/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:37:31.443596 | orchestrator | 2026-04-28 03:37:31.443603 | orchestrator | TASK [service-ks-register : skyline | Creating services] *********************** 2026-04-28 03:37:31.443610 | orchestrator | Tuesday 28 April 2026 03:37:06 +0000 (0:00:00.582) 0:00:01.874 ********* 2026-04-28 03:37:31.443617 | orchestrator | changed: [testbed-node-0] => (item=skyline (panel)) 2026-04-28 03:37:31.443624 | orchestrator | 2026-04-28 03:37:31.443631 | orchestrator | TASK [service-ks-register : skyline | Creating endpoints] ********************** 2026-04-28 03:37:31.443639 | orchestrator | Tuesday 28 April 2026 03:37:09 +0000 (0:00:03.345) 0:00:05.220 ********* 2026-04-28 03:37:31.443646 | orchestrator | changed: [testbed-node-0] => (item=skyline -> https://api-int.testbed.osism.xyz:9998 -> internal) 2026-04-28 03:37:31.443653 | orchestrator | changed: [testbed-node-0] => (item=skyline -> https://api.testbed.osism.xyz:9998 -> public) 2026-04-28 03:37:31.443660 | orchestrator | 2026-04-28 03:37:31.443667 | orchestrator | TASK [service-ks-register : skyline | Creating projects] *********************** 2026-04-28 03:37:31.443675 | orchestrator | Tuesday 28 April 2026 03:37:16 +0000 (0:00:06.453) 0:00:11.673 ********* 2026-04-28 03:37:31.443682 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-28 03:37:31.443690 | orchestrator | 2026-04-28 03:37:31.443697 | orchestrator | TASK [service-ks-register : skyline | Creating users] ************************** 2026-04-28 03:37:31.443704 | orchestrator | Tuesday 28 April 2026 03:37:19 +0000 (0:00:03.198) 0:00:14.872 ********* 2026-04-28 03:37:31.443711 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-28 03:37:31.443719 | orchestrator | changed: [testbed-node-0] => (item=skyline -> service) 2026-04-28 03:37:31.443726 | orchestrator | 2026-04-28 03:37:31.443733 | orchestrator | TASK [service-ks-register : skyline | Creating roles] ************************** 2026-04-28 03:37:31.443740 | orchestrator | Tuesday 28 April 2026 03:37:23 +0000 (0:00:03.901) 0:00:18.774 ********* 2026-04-28 03:37:31.443748 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-28 03:37:31.443758 | orchestrator | 2026-04-28 03:37:31.443769 | orchestrator | TASK [service-ks-register : skyline | Granting user roles] ********************* 2026-04-28 03:37:31.443807 | orchestrator | Tuesday 28 April 2026 03:37:26 +0000 (0:00:03.087) 0:00:21.861 ********* 2026-04-28 03:37:31.443888 | orchestrator | changed: [testbed-node-0] => (item=skyline -> service -> admin) 2026-04-28 03:37:31.443898 | orchestrator | 2026-04-28 03:37:31.443908 | orchestrator | TASK [skyline : Ensuring config directories exist] ***************************** 2026-04-28 03:37:31.443918 | orchestrator | Tuesday 28 April 2026 03:37:30 +0000 (0:00:03.832) 0:00:25.693 ********* 2026-04-28 03:37:31.443951 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:31.443986 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:31.443999 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:31.444012 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:31.444034 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:31.444049 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:35.506381 | orchestrator | 2026-04-28 03:37:35.506453 | orchestrator | TASK [skyline : include_tasks] ************************************************* 2026-04-28 03:37:35.506460 | orchestrator | Tuesday 28 April 2026 03:37:31 +0000 (0:00:01.311) 0:00:27.005 ********* 2026-04-28 03:37:35.506465 | orchestrator | included: /ansible/roles/skyline/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:37:35.506470 | orchestrator | 2026-04-28 03:37:35.506474 | orchestrator | TASK [service-cert-copy : skyline | Copying over extra CA certificates] ******** 2026-04-28 03:37:35.506478 | orchestrator | Tuesday 28 April 2026 03:37:32 +0000 (0:00:00.853) 0:00:27.858 ********* 2026-04-28 03:37:35.506485 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:35.506491 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:35.506523 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:35.506539 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:35.506544 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:35.506548 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:35.506556 | orchestrator | 2026-04-28 03:37:35.506560 | orchestrator | TASK [service-cert-copy : skyline | Copying over backend internal TLS certificate] *** 2026-04-28 03:37:35.506564 | orchestrator | Tuesday 28 April 2026 03:37:34 +0000 (0:00:02.521) 0:00:30.380 ********* 2026-04-28 03:37:35.506571 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-28 03:37:35.506575 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-28 03:37:35.506580 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:37:35.506588 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-28 03:37:36.917128 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-28 03:37:36.917236 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:37:36.917262 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-28 03:37:36.917272 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-28 03:37:36.917280 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:37:36.917287 | orchestrator | 2026-04-28 03:37:36.917296 | orchestrator | TASK [service-cert-copy : skyline | Copying over backend internal TLS key] ***** 2026-04-28 03:37:36.917304 | orchestrator | Tuesday 28 April 2026 03:37:35 +0000 (0:00:00.696) 0:00:31.076 ********* 2026-04-28 03:37:36.917312 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-28 03:37:36.917335 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-28 03:37:36.917349 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:37:36.917361 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-28 03:37:36.917369 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-28 03:37:36.917377 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:37:36.917384 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}})  2026-04-28 03:37:36.917399 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}})  2026-04-28 03:37:45.832308 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:37:45.832414 | orchestrator | 2026-04-28 03:37:45.832429 | orchestrator | TASK [skyline : Copying over skyline.yaml files for services] ****************** 2026-04-28 03:37:45.832441 | orchestrator | Tuesday 28 April 2026 03:37:36 +0000 (0:00:01.400) 0:00:32.477 ********* 2026-04-28 03:37:45.832454 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:45.832512 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:45.832545 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:45.832565 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:45.832627 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:45.832645 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:45.832656 | orchestrator | 2026-04-28 03:37:45.832666 | orchestrator | TASK [skyline : Copying over gunicorn.py files for services] ******************* 2026-04-28 03:37:45.832676 | orchestrator | Tuesday 28 April 2026 03:37:39 +0000 (0:00:02.585) 0:00:35.062 ********* 2026-04-28 03:37:45.832686 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/skyline/templates/gunicorn.py.j2) 2026-04-28 03:37:45.832696 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/skyline/templates/gunicorn.py.j2) 2026-04-28 03:37:45.832705 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/skyline/templates/gunicorn.py.j2) 2026-04-28 03:37:45.832715 | orchestrator | 2026-04-28 03:37:45.832725 | orchestrator | TASK [skyline : Copying over nginx.conf files for services] ******************** 2026-04-28 03:37:45.832734 | orchestrator | Tuesday 28 April 2026 03:37:41 +0000 (0:00:01.665) 0:00:36.727 ********* 2026-04-28 03:37:45.832744 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/skyline/templates/nginx.conf.j2) 2026-04-28 03:37:45.832753 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/skyline/templates/nginx.conf.j2) 2026-04-28 03:37:45.832763 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/skyline/templates/nginx.conf.j2) 2026-04-28 03:37:45.832772 | orchestrator | 2026-04-28 03:37:45.832782 | orchestrator | TASK [skyline : Copying over config.json files for services] ******************* 2026-04-28 03:37:45.832791 | orchestrator | Tuesday 28 April 2026 03:37:43 +0000 (0:00:02.196) 0:00:38.924 ********* 2026-04-28 03:37:45.832810 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:45.832853 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:48.104633 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:48.104758 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:48.104781 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:48.104874 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:48.104888 | orchestrator | 2026-04-28 03:37:48.104899 | orchestrator | TASK [skyline : Copying over custom logos] ************************************* 2026-04-28 03:37:48.104910 | orchestrator | Tuesday 28 April 2026 03:37:45 +0000 (0:00:02.476) 0:00:41.401 ********* 2026-04-28 03:37:48.104919 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:37:48.104929 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:37:48.104938 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:37:48.104946 | orchestrator | 2026-04-28 03:37:48.104973 | orchestrator | TASK [skyline : Check skyline container] *************************************** 2026-04-28 03:37:48.104982 | orchestrator | Tuesday 28 April 2026 03:37:46 +0000 (0:00:00.363) 0:00:41.764 ********* 2026-04-28 03:37:48.105001 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:48.105011 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:48.105027 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:48.105037 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-28 03:37:48.105059 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-28 03:38:22.482596 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no'}}}}) 2026-04-28 03:38:22.482708 | orchestrator | 2026-04-28 03:38:22.482719 | orchestrator | TASK [skyline : Creating Skyline database] ************************************* 2026-04-28 03:38:22.482728 | orchestrator | Tuesday 28 April 2026 03:37:48 +0000 (0:00:01.902) 0:00:43.667 ********* 2026-04-28 03:38:22.482734 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:38:22.482742 | orchestrator | 2026-04-28 03:38:22.482748 | orchestrator | TASK [skyline : Creating Skyline database user and setting permissions] ******** 2026-04-28 03:38:22.482754 | orchestrator | Tuesday 28 April 2026 03:37:50 +0000 (0:00:02.216) 0:00:45.883 ********* 2026-04-28 03:38:22.482760 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:38:22.482768 | orchestrator | 2026-04-28 03:38:22.482778 | orchestrator | TASK [skyline : Running Skyline bootstrap container] *************************** 2026-04-28 03:38:22.482788 | orchestrator | Tuesday 28 April 2026 03:37:52 +0000 (0:00:02.289) 0:00:48.172 ********* 2026-04-28 03:38:22.482806 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:38:22.482836 | orchestrator | 2026-04-28 03:38:22.482846 | orchestrator | TASK [skyline : Flush handlers] ************************************************ 2026-04-28 03:38:22.482856 | orchestrator | Tuesday 28 April 2026 03:37:59 +0000 (0:00:07.097) 0:00:55.270 ********* 2026-04-28 03:38:22.482866 | orchestrator | 2026-04-28 03:38:22.482876 | orchestrator | TASK [skyline : Flush handlers] ************************************************ 2026-04-28 03:38:22.482885 | orchestrator | Tuesday 28 April 2026 03:37:59 +0000 (0:00:00.085) 0:00:55.355 ********* 2026-04-28 03:38:22.482895 | orchestrator | 2026-04-28 03:38:22.482904 | orchestrator | TASK [skyline : Flush handlers] ************************************************ 2026-04-28 03:38:22.482913 | orchestrator | Tuesday 28 April 2026 03:37:59 +0000 (0:00:00.079) 0:00:55.435 ********* 2026-04-28 03:38:22.482923 | orchestrator | 2026-04-28 03:38:22.482932 | orchestrator | RUNNING HANDLER [skyline : Restart skyline-apiserver container] **************** 2026-04-28 03:38:22.482942 | orchestrator | Tuesday 28 April 2026 03:37:59 +0000 (0:00:00.075) 0:00:55.511 ********* 2026-04-28 03:38:22.482953 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:38:22.482963 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:38:22.482973 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:38:22.482983 | orchestrator | 2026-04-28 03:38:22.482992 | orchestrator | RUNNING HANDLER [skyline : Restart skyline-console container] ****************** 2026-04-28 03:38:22.483003 | orchestrator | Tuesday 28 April 2026 03:38:11 +0000 (0:00:11.680) 0:01:07.191 ********* 2026-04-28 03:38:22.483013 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:38:22.483023 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:38:22.483033 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:38:22.483043 | orchestrator | 2026-04-28 03:38:22.483052 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 03:38:22.483064 | orchestrator | testbed-node-0 : ok=22  changed=16  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-28 03:38:22.483075 | orchestrator | testbed-node-1 : ok=13  changed=9  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-28 03:38:22.483086 | orchestrator | testbed-node-2 : ok=13  changed=9  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-28 03:38:22.483096 | orchestrator | 2026-04-28 03:38:22.483106 | orchestrator | 2026-04-28 03:38:22.483117 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 03:38:22.483127 | orchestrator | Tuesday 28 April 2026 03:38:22 +0000 (0:00:10.425) 0:01:17.617 ********* 2026-04-28 03:38:22.483137 | orchestrator | =============================================================================== 2026-04-28 03:38:22.483148 | orchestrator | skyline : Restart skyline-apiserver container -------------------------- 11.68s 2026-04-28 03:38:22.483159 | orchestrator | skyline : Restart skyline-console container ---------------------------- 10.43s 2026-04-28 03:38:22.483170 | orchestrator | skyline : Running Skyline bootstrap container --------------------------- 7.10s 2026-04-28 03:38:22.483192 | orchestrator | service-ks-register : skyline | Creating endpoints ---------------------- 6.45s 2026-04-28 03:38:22.483203 | orchestrator | service-ks-register : skyline | Creating users -------------------------- 3.90s 2026-04-28 03:38:22.483214 | orchestrator | service-ks-register : skyline | Granting user roles --------------------- 3.83s 2026-04-28 03:38:22.483224 | orchestrator | service-ks-register : skyline | Creating services ----------------------- 3.35s 2026-04-28 03:38:22.483249 | orchestrator | service-ks-register : skyline | Creating projects ----------------------- 3.20s 2026-04-28 03:38:22.483277 | orchestrator | service-ks-register : skyline | Creating roles -------------------------- 3.09s 2026-04-28 03:38:22.483290 | orchestrator | skyline : Copying over skyline.yaml files for services ------------------ 2.59s 2026-04-28 03:38:22.483300 | orchestrator | service-cert-copy : skyline | Copying over extra CA certificates -------- 2.52s 2026-04-28 03:38:22.483310 | orchestrator | skyline : Copying over config.json files for services ------------------- 2.48s 2026-04-28 03:38:22.483322 | orchestrator | skyline : Creating Skyline database user and setting permissions -------- 2.29s 2026-04-28 03:38:22.483333 | orchestrator | skyline : Creating Skyline database ------------------------------------- 2.22s 2026-04-28 03:38:22.483344 | orchestrator | skyline : Copying over nginx.conf files for services -------------------- 2.20s 2026-04-28 03:38:22.483354 | orchestrator | skyline : Check skyline container --------------------------------------- 1.90s 2026-04-28 03:38:22.483365 | orchestrator | skyline : Copying over gunicorn.py files for services ------------------- 1.67s 2026-04-28 03:38:22.483376 | orchestrator | service-cert-copy : skyline | Copying over backend internal TLS key ----- 1.40s 2026-04-28 03:38:22.483387 | orchestrator | skyline : Ensuring config directories exist ----------------------------- 1.31s 2026-04-28 03:38:22.483398 | orchestrator | skyline : include_tasks ------------------------------------------------- 0.85s 2026-04-28 03:38:25.049635 | orchestrator | 2026-04-28 03:38:25 | INFO  | Task 06013f9d-785c-407b-ac82-4328ed4aff08 (glance) was prepared for execution. 2026-04-28 03:38:25.049760 | orchestrator | 2026-04-28 03:38:25 | INFO  | It takes a moment until task 06013f9d-785c-407b-ac82-4328ed4aff08 (glance) has been started and output is visible here. 2026-04-28 03:39:00.123041 | orchestrator | 2026-04-28 03:39:00.123126 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 03:39:00.123136 | orchestrator | 2026-04-28 03:39:00.123144 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 03:39:00.123151 | orchestrator | Tuesday 28 April 2026 03:38:29 +0000 (0:00:00.288) 0:00:00.288 ********* 2026-04-28 03:39:00.123157 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:39:00.123165 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:39:00.123171 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:39:00.123177 | orchestrator | 2026-04-28 03:39:00.123183 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 03:39:00.123190 | orchestrator | Tuesday 28 April 2026 03:38:30 +0000 (0:00:00.325) 0:00:00.614 ********* 2026-04-28 03:39:00.123196 | orchestrator | ok: [testbed-node-0] => (item=enable_glance_True) 2026-04-28 03:39:00.123203 | orchestrator | ok: [testbed-node-1] => (item=enable_glance_True) 2026-04-28 03:39:00.123210 | orchestrator | ok: [testbed-node-2] => (item=enable_glance_True) 2026-04-28 03:39:00.123216 | orchestrator | 2026-04-28 03:39:00.123222 | orchestrator | PLAY [Apply role glance] ******************************************************* 2026-04-28 03:39:00.123228 | orchestrator | 2026-04-28 03:39:00.123234 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-28 03:39:00.123240 | orchestrator | Tuesday 28 April 2026 03:38:30 +0000 (0:00:00.495) 0:00:01.109 ********* 2026-04-28 03:39:00.123247 | orchestrator | included: /ansible/roles/glance/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:39:00.123254 | orchestrator | 2026-04-28 03:39:00.123260 | orchestrator | TASK [service-ks-register : glance | Creating services] ************************ 2026-04-28 03:39:00.123266 | orchestrator | Tuesday 28 April 2026 03:38:31 +0000 (0:00:00.587) 0:00:01.697 ********* 2026-04-28 03:39:00.123292 | orchestrator | changed: [testbed-node-0] => (item=glance (image)) 2026-04-28 03:39:00.123299 | orchestrator | 2026-04-28 03:39:00.123305 | orchestrator | TASK [service-ks-register : glance | Creating endpoints] *********************** 2026-04-28 03:39:00.123311 | orchestrator | Tuesday 28 April 2026 03:38:34 +0000 (0:00:03.376) 0:00:05.074 ********* 2026-04-28 03:39:00.123317 | orchestrator | changed: [testbed-node-0] => (item=glance -> https://api-int.testbed.osism.xyz:9292 -> internal) 2026-04-28 03:39:00.123324 | orchestrator | changed: [testbed-node-0] => (item=glance -> https://api.testbed.osism.xyz:9292 -> public) 2026-04-28 03:39:00.123330 | orchestrator | 2026-04-28 03:39:00.123336 | orchestrator | TASK [service-ks-register : glance | Creating projects] ************************ 2026-04-28 03:39:00.123342 | orchestrator | Tuesday 28 April 2026 03:38:40 +0000 (0:00:06.435) 0:00:11.509 ********* 2026-04-28 03:39:00.123349 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-28 03:39:00.123355 | orchestrator | 2026-04-28 03:39:00.123361 | orchestrator | TASK [service-ks-register : glance | Creating users] *************************** 2026-04-28 03:39:00.123368 | orchestrator | Tuesday 28 April 2026 03:38:44 +0000 (0:00:03.194) 0:00:14.704 ********* 2026-04-28 03:39:00.123374 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-28 03:39:00.123381 | orchestrator | changed: [testbed-node-0] => (item=glance -> service) 2026-04-28 03:39:00.123387 | orchestrator | 2026-04-28 03:39:00.123393 | orchestrator | TASK [service-ks-register : glance | Creating roles] *************************** 2026-04-28 03:39:00.123399 | orchestrator | Tuesday 28 April 2026 03:38:48 +0000 (0:00:03.890) 0:00:18.595 ********* 2026-04-28 03:39:00.123406 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-28 03:39:00.123412 | orchestrator | 2026-04-28 03:39:00.123418 | orchestrator | TASK [service-ks-register : glance | Granting user roles] ********************** 2026-04-28 03:39:00.123424 | orchestrator | Tuesday 28 April 2026 03:38:51 +0000 (0:00:03.314) 0:00:21.909 ********* 2026-04-28 03:39:00.123430 | orchestrator | changed: [testbed-node-0] => (item=glance -> service -> admin) 2026-04-28 03:39:00.123436 | orchestrator | 2026-04-28 03:39:00.123443 | orchestrator | TASK [glance : Ensuring config directories exist] ****************************** 2026-04-28 03:39:00.123449 | orchestrator | Tuesday 28 April 2026 03:38:55 +0000 (0:00:03.747) 0:00:25.657 ********* 2026-04-28 03:39:00.123485 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 03:39:00.123501 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 03:39:00.123513 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 03:39:00.123520 | orchestrator | 2026-04-28 03:39:00.123527 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-28 03:39:00.123533 | orchestrator | Tuesday 28 April 2026 03:38:59 +0000 (0:00:04.207) 0:00:29.864 ********* 2026-04-28 03:39:00.123539 | orchestrator | included: /ansible/roles/glance/tasks/external_ceph.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:39:00.123546 | orchestrator | 2026-04-28 03:39:00.123556 | orchestrator | TASK [glance : Ensuring glance service ceph config subdir exists] ************** 2026-04-28 03:39:16.827736 | orchestrator | Tuesday 28 April 2026 03:39:00 +0000 (0:00:00.835) 0:00:30.699 ********* 2026-04-28 03:39:16.827931 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:39:16.827952 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:39:16.827963 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:39:16.827974 | orchestrator | 2026-04-28 03:39:16.827986 | orchestrator | TASK [glance : Copy over multiple ceph configs for Glance] ********************* 2026-04-28 03:39:16.827997 | orchestrator | Tuesday 28 April 2026 03:39:04 +0000 (0:00:04.128) 0:00:34.828 ********* 2026-04-28 03:39:16.828009 | orchestrator | changed: [testbed-node-1] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'enabled': True}) 2026-04-28 03:39:16.828021 | orchestrator | changed: [testbed-node-0] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'enabled': True}) 2026-04-28 03:39:16.828033 | orchestrator | changed: [testbed-node-2] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'enabled': True}) 2026-04-28 03:39:16.828045 | orchestrator | 2026-04-28 03:39:16.828057 | orchestrator | TASK [glance : Copy over ceph Glance keyrings] ********************************* 2026-04-28 03:39:16.828069 | orchestrator | Tuesday 28 April 2026 03:39:05 +0000 (0:00:01.498) 0:00:36.327 ********* 2026-04-28 03:39:16.828082 | orchestrator | changed: [testbed-node-0] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'enabled': True}) 2026-04-28 03:39:16.828093 | orchestrator | changed: [testbed-node-1] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'enabled': True}) 2026-04-28 03:39:16.828105 | orchestrator | changed: [testbed-node-2] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'enabled': True}) 2026-04-28 03:39:16.828117 | orchestrator | 2026-04-28 03:39:16.828129 | orchestrator | TASK [glance : Ensuring config directory has correct owner and permission] ***** 2026-04-28 03:39:16.828141 | orchestrator | Tuesday 28 April 2026 03:39:07 +0000 (0:00:01.485) 0:00:37.812 ********* 2026-04-28 03:39:16.828154 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:39:16.828167 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:39:16.828178 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:39:16.828190 | orchestrator | 2026-04-28 03:39:16.828203 | orchestrator | TASK [glance : Check if policies shall be overwritten] ************************* 2026-04-28 03:39:16.828216 | orchestrator | Tuesday 28 April 2026 03:39:07 +0000 (0:00:00.697) 0:00:38.510 ********* 2026-04-28 03:39:16.828228 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:39:16.828240 | orchestrator | 2026-04-28 03:39:16.828252 | orchestrator | TASK [glance : Set glance policy file] ***************************************** 2026-04-28 03:39:16.828265 | orchestrator | Tuesday 28 April 2026 03:39:08 +0000 (0:00:00.136) 0:00:38.646 ********* 2026-04-28 03:39:16.828279 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:39:16.828293 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:39:16.828308 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:39:16.828320 | orchestrator | 2026-04-28 03:39:16.828331 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-28 03:39:16.828343 | orchestrator | Tuesday 28 April 2026 03:39:08 +0000 (0:00:00.336) 0:00:38.983 ********* 2026-04-28 03:39:16.828354 | orchestrator | included: /ansible/roles/glance/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:39:16.828366 | orchestrator | 2026-04-28 03:39:16.828377 | orchestrator | TASK [service-cert-copy : glance | Copying over extra CA certificates] ********* 2026-04-28 03:39:16.828389 | orchestrator | Tuesday 28 April 2026 03:39:09 +0000 (0:00:00.791) 0:00:39.775 ********* 2026-04-28 03:39:16.828423 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 03:39:16.828475 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 03:39:16.828495 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 03:39:16.828515 | orchestrator | 2026-04-28 03:39:16.828527 | orchestrator | TASK [service-cert-copy : glance | Copying over backend internal TLS certificate] *** 2026-04-28 03:39:16.828577 | orchestrator | Tuesday 28 April 2026 03:39:13 +0000 (0:00:04.379) 0:00:44.154 ********* 2026-04-28 03:39:16.828613 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-28 03:39:20.710443 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:39:20.710572 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-28 03:39:20.710620 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:39:20.710635 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-28 03:39:20.710647 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:39:20.710658 | orchestrator | 2026-04-28 03:39:20.710671 | orchestrator | TASK [service-cert-copy : glance | Copying over backend internal TLS key] ****** 2026-04-28 03:39:20.710683 | orchestrator | Tuesday 28 April 2026 03:39:16 +0000 (0:00:03.249) 0:00:47.404 ********* 2026-04-28 03:39:20.710714 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-28 03:39:20.710727 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:39:20.710744 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-28 03:39:20.710770 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:39:20.710803 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-28 03:39:58.084784 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:39:58.084930 | orchestrator | 2026-04-28 03:39:58.084946 | orchestrator | TASK [glance : Creating TLS backend PEM File] ********************************** 2026-04-28 03:39:58.084958 | orchestrator | Tuesday 28 April 2026 03:39:20 +0000 (0:00:03.882) 0:00:51.287 ********* 2026-04-28 03:39:58.084967 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:39:58.084976 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:39:58.084984 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:39:58.084993 | orchestrator | 2026-04-28 03:39:58.085002 | orchestrator | TASK [glance : Copying over config.json files for services] ******************** 2026-04-28 03:39:58.085011 | orchestrator | Tuesday 28 April 2026 03:39:24 +0000 (0:00:03.536) 0:00:54.824 ********* 2026-04-28 03:39:58.085060 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 03:39:58.085075 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 03:39:58.085107 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 03:39:58.085125 | orchestrator | 2026-04-28 03:39:58.085135 | orchestrator | TASK [glance : Copying over glance-api.conf] *********************************** 2026-04-28 03:39:58.085144 | orchestrator | Tuesday 28 April 2026 03:39:28 +0000 (0:00:04.452) 0:00:59.276 ********* 2026-04-28 03:39:58.085152 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:39:58.085161 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:39:58.085170 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:39:58.085178 | orchestrator | 2026-04-28 03:39:58.085187 | orchestrator | TASK [glance : Copying over glance-cache.conf for glance_api] ****************** 2026-04-28 03:39:58.085195 | orchestrator | Tuesday 28 April 2026 03:39:35 +0000 (0:00:06.402) 0:01:05.679 ********* 2026-04-28 03:39:58.085204 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:39:58.085213 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:39:58.085221 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:39:58.085230 | orchestrator | 2026-04-28 03:39:58.085238 | orchestrator | TASK [glance : Copying over glance-swift.conf for glance_api] ****************** 2026-04-28 03:39:58.085267 | orchestrator | Tuesday 28 April 2026 03:39:38 +0000 (0:00:03.679) 0:01:09.358 ********* 2026-04-28 03:39:58.085295 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:39:58.085310 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:39:58.085324 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:39:58.085337 | orchestrator | 2026-04-28 03:39:58.085351 | orchestrator | TASK [glance : Copying over glance-image-import.conf] ************************** 2026-04-28 03:39:58.085367 | orchestrator | Tuesday 28 April 2026 03:39:42 +0000 (0:00:03.391) 0:01:12.749 ********* 2026-04-28 03:39:58.085381 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:39:58.085397 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:39:58.085412 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:39:58.085427 | orchestrator | 2026-04-28 03:39:58.085443 | orchestrator | TASK [glance : Copying over property-protections-rules.conf] ******************* 2026-04-28 03:39:58.085459 | orchestrator | Tuesday 28 April 2026 03:39:45 +0000 (0:00:03.393) 0:01:16.143 ********* 2026-04-28 03:39:58.085474 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:39:58.085484 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:39:58.085495 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:39:58.085506 | orchestrator | 2026-04-28 03:39:58.085521 | orchestrator | TASK [glance : Copying over existing policy file] ****************************** 2026-04-28 03:39:58.085535 | orchestrator | Tuesday 28 April 2026 03:39:49 +0000 (0:00:03.760) 0:01:19.904 ********* 2026-04-28 03:39:58.085550 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:39:58.085564 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:39:58.085579 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:39:58.085591 | orchestrator | 2026-04-28 03:39:58.085605 | orchestrator | TASK [glance : Copying over glance-haproxy-tls.cfg] **************************** 2026-04-28 03:39:58.085620 | orchestrator | Tuesday 28 April 2026 03:39:49 +0000 (0:00:00.644) 0:01:20.548 ********* 2026-04-28 03:39:58.085646 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/glance/templates/glance-tls-proxy.cfg.j2)  2026-04-28 03:39:58.085664 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:39:58.085679 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/glance/templates/glance-tls-proxy.cfg.j2)  2026-04-28 03:39:58.085695 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:39:58.085709 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/glance/templates/glance-tls-proxy.cfg.j2)  2026-04-28 03:39:58.085723 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:39:58.085737 | orchestrator | 2026-04-28 03:39:58.085752 | orchestrator | TASK [glance : Generating 'hostnqn' file for glance_api] *********************** 2026-04-28 03:39:58.085766 | orchestrator | Tuesday 28 April 2026 03:39:53 +0000 (0:00:03.537) 0:01:24.086 ********* 2026-04-28 03:39:58.085780 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:39:58.085795 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:39:58.085810 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:39:58.085860 | orchestrator | 2026-04-28 03:39:58.085879 | orchestrator | TASK [glance : Check glance containers] **************************************** 2026-04-28 03:39:58.085916 | orchestrator | Tuesday 28 April 2026 03:39:58 +0000 (0:00:04.573) 0:01:28.660 ********* 2026-04-28 03:41:17.813437 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 03:41:17.813563 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 03:41:17.813647 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/glance-api:29.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 03:41:17.813668 | orchestrator | 2026-04-28 03:41:17.813684 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-28 03:41:17.813700 | orchestrator | Tuesday 28 April 2026 03:40:02 +0000 (0:00:04.199) 0:01:32.859 ********* 2026-04-28 03:41:17.813714 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:41:17.813729 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:41:17.813742 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:41:17.813755 | orchestrator | 2026-04-28 03:41:17.813769 | orchestrator | TASK [glance : Creating Glance database] *************************************** 2026-04-28 03:41:17.813782 | orchestrator | Tuesday 28 April 2026 03:40:02 +0000 (0:00:00.659) 0:01:33.519 ********* 2026-04-28 03:41:17.813796 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:41:17.813841 | orchestrator | 2026-04-28 03:41:17.813856 | orchestrator | TASK [glance : Creating Glance database user and setting permissions] ********** 2026-04-28 03:41:17.813870 | orchestrator | Tuesday 28 April 2026 03:40:05 +0000 (0:00:02.154) 0:01:35.673 ********* 2026-04-28 03:41:17.813884 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:41:17.813897 | orchestrator | 2026-04-28 03:41:17.813910 | orchestrator | TASK [glance : Enable log_bin_trust_function_creators function] **************** 2026-04-28 03:41:17.813926 | orchestrator | Tuesday 28 April 2026 03:40:07 +0000 (0:00:02.216) 0:01:37.890 ********* 2026-04-28 03:41:17.813940 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:41:17.813955 | orchestrator | 2026-04-28 03:41:17.813970 | orchestrator | TASK [glance : Running Glance bootstrap container] ***************************** 2026-04-28 03:41:17.813984 | orchestrator | Tuesday 28 April 2026 03:40:09 +0000 (0:00:02.041) 0:01:39.932 ********* 2026-04-28 03:41:17.813999 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:41:17.814094 | orchestrator | 2026-04-28 03:41:17.814117 | orchestrator | TASK [glance : Disable log_bin_trust_function_creators function] *************** 2026-04-28 03:41:17.814133 | orchestrator | Tuesday 28 April 2026 03:40:37 +0000 (0:00:28.041) 0:02:07.973 ********* 2026-04-28 03:41:17.814150 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:41:17.814167 | orchestrator | 2026-04-28 03:41:17.814182 | orchestrator | TASK [glance : Flush handlers] ************************************************* 2026-04-28 03:41:17.814198 | orchestrator | Tuesday 28 April 2026 03:40:39 +0000 (0:00:02.061) 0:02:10.035 ********* 2026-04-28 03:41:17.814214 | orchestrator | 2026-04-28 03:41:17.814230 | orchestrator | TASK [glance : Flush handlers] ************************************************* 2026-04-28 03:41:17.814247 | orchestrator | Tuesday 28 April 2026 03:40:39 +0000 (0:00:00.086) 0:02:10.122 ********* 2026-04-28 03:41:17.814263 | orchestrator | 2026-04-28 03:41:17.814279 | orchestrator | TASK [glance : Flush handlers] ************************************************* 2026-04-28 03:41:17.814294 | orchestrator | Tuesday 28 April 2026 03:40:39 +0000 (0:00:00.075) 0:02:10.198 ********* 2026-04-28 03:41:17.814309 | orchestrator | 2026-04-28 03:41:17.814325 | orchestrator | RUNNING HANDLER [glance : Restart glance-api container] ************************ 2026-04-28 03:41:17.814341 | orchestrator | Tuesday 28 April 2026 03:40:39 +0000 (0:00:00.074) 0:02:10.273 ********* 2026-04-28 03:41:17.814356 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:41:17.814371 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:41:17.814387 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:41:17.814402 | orchestrator | 2026-04-28 03:41:17.814417 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 03:41:17.814434 | orchestrator | testbed-node-0 : ok=27  changed=19  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-28 03:41:17.814451 | orchestrator | testbed-node-1 : ok=16  changed=10  unreachable=0 failed=0 skipped=11  rescued=0 ignored=0 2026-04-28 03:41:17.814466 | orchestrator | testbed-node-2 : ok=16  changed=10  unreachable=0 failed=0 skipped=11  rescued=0 ignored=0 2026-04-28 03:41:17.814481 | orchestrator | 2026-04-28 03:41:17.814496 | orchestrator | 2026-04-28 03:41:17.814512 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 03:41:17.814527 | orchestrator | Tuesday 28 April 2026 03:41:17 +0000 (0:00:38.107) 0:02:48.381 ********* 2026-04-28 03:41:17.814542 | orchestrator | =============================================================================== 2026-04-28 03:41:17.814557 | orchestrator | glance : Restart glance-api container ---------------------------------- 38.11s 2026-04-28 03:41:17.814572 | orchestrator | glance : Running Glance bootstrap container ---------------------------- 28.04s 2026-04-28 03:41:17.814588 | orchestrator | service-ks-register : glance | Creating endpoints ----------------------- 6.44s 2026-04-28 03:41:17.814619 | orchestrator | glance : Copying over glance-api.conf ----------------------------------- 6.40s 2026-04-28 03:41:18.214201 | orchestrator | glance : Generating 'hostnqn' file for glance_api ----------------------- 4.57s 2026-04-28 03:41:18.214311 | orchestrator | glance : Copying over config.json files for services -------------------- 4.45s 2026-04-28 03:41:18.214327 | orchestrator | service-cert-copy : glance | Copying over extra CA certificates --------- 4.38s 2026-04-28 03:41:18.214336 | orchestrator | glance : Ensuring config directories exist ------------------------------ 4.21s 2026-04-28 03:41:18.214343 | orchestrator | glance : Check glance containers ---------------------------------------- 4.20s 2026-04-28 03:41:18.214351 | orchestrator | glance : Ensuring glance service ceph config subdir exists -------------- 4.13s 2026-04-28 03:41:18.214358 | orchestrator | service-ks-register : glance | Creating users --------------------------- 3.89s 2026-04-28 03:41:18.214366 | orchestrator | service-cert-copy : glance | Copying over backend internal TLS key ------ 3.88s 2026-04-28 03:41:18.214373 | orchestrator | glance : Copying over property-protections-rules.conf ------------------- 3.76s 2026-04-28 03:41:18.214380 | orchestrator | service-ks-register : glance | Granting user roles ---------------------- 3.75s 2026-04-28 03:41:18.214429 | orchestrator | glance : Copying over glance-cache.conf for glance_api ------------------ 3.68s 2026-04-28 03:41:18.214443 | orchestrator | glance : Copying over glance-haproxy-tls.cfg ---------------------------- 3.54s 2026-04-28 03:41:18.214455 | orchestrator | glance : Creating TLS backend PEM File ---------------------------------- 3.54s 2026-04-28 03:41:18.214465 | orchestrator | glance : Copying over glance-image-import.conf -------------------------- 3.39s 2026-04-28 03:41:18.214476 | orchestrator | glance : Copying over glance-swift.conf for glance_api ------------------ 3.39s 2026-04-28 03:41:18.214486 | orchestrator | service-ks-register : glance | Creating services ------------------------ 3.38s 2026-04-28 03:41:20.899530 | orchestrator | 2026-04-28 03:41:20 | INFO  | Task d0b2b0df-c90c-4774-a9ef-3c1136187d5d (cinder) was prepared for execution. 2026-04-28 03:41:20.899631 | orchestrator | 2026-04-28 03:41:20 | INFO  | It takes a moment until task d0b2b0df-c90c-4774-a9ef-3c1136187d5d (cinder) has been started and output is visible here. 2026-04-28 03:41:56.703128 | orchestrator | 2026-04-28 03:41:56.703212 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 03:41:56.703222 | orchestrator | 2026-04-28 03:41:56.703229 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 03:41:56.703236 | orchestrator | Tuesday 28 April 2026 03:41:25 +0000 (0:00:00.270) 0:00:00.270 ********* 2026-04-28 03:41:56.703242 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:41:56.703249 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:41:56.703255 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:41:56.703261 | orchestrator | 2026-04-28 03:41:56.703267 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 03:41:56.703273 | orchestrator | Tuesday 28 April 2026 03:41:25 +0000 (0:00:00.345) 0:00:00.616 ********* 2026-04-28 03:41:56.703291 | orchestrator | ok: [testbed-node-0] => (item=enable_cinder_True) 2026-04-28 03:41:56.703302 | orchestrator | ok: [testbed-node-1] => (item=enable_cinder_True) 2026-04-28 03:41:56.703311 | orchestrator | ok: [testbed-node-2] => (item=enable_cinder_True) 2026-04-28 03:41:56.703320 | orchestrator | 2026-04-28 03:41:56.703329 | orchestrator | PLAY [Apply role cinder] ******************************************************* 2026-04-28 03:41:56.703338 | orchestrator | 2026-04-28 03:41:56.703347 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-28 03:41:56.703356 | orchestrator | Tuesday 28 April 2026 03:41:26 +0000 (0:00:00.485) 0:00:01.102 ********* 2026-04-28 03:41:56.703366 | orchestrator | included: /ansible/roles/cinder/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:41:56.703376 | orchestrator | 2026-04-28 03:41:56.703385 | orchestrator | TASK [service-ks-register : cinder | Creating services] ************************ 2026-04-28 03:41:56.703394 | orchestrator | Tuesday 28 April 2026 03:41:26 +0000 (0:00:00.580) 0:00:01.683 ********* 2026-04-28 03:41:56.703404 | orchestrator | changed: [testbed-node-0] => (item=cinderv3 (volumev3)) 2026-04-28 03:41:56.703413 | orchestrator | 2026-04-28 03:41:56.703422 | orchestrator | TASK [service-ks-register : cinder | Creating endpoints] *********************** 2026-04-28 03:41:56.703430 | orchestrator | Tuesday 28 April 2026 03:41:30 +0000 (0:00:03.569) 0:00:05.252 ********* 2026-04-28 03:41:56.703440 | orchestrator | changed: [testbed-node-0] => (item=cinderv3 -> https://api-int.testbed.osism.xyz:8776/v3/%(tenant_id)s -> internal) 2026-04-28 03:41:56.703450 | orchestrator | changed: [testbed-node-0] => (item=cinderv3 -> https://api.testbed.osism.xyz:8776/v3/%(tenant_id)s -> public) 2026-04-28 03:41:56.703459 | orchestrator | 2026-04-28 03:41:56.703468 | orchestrator | TASK [service-ks-register : cinder | Creating projects] ************************ 2026-04-28 03:41:56.703477 | orchestrator | Tuesday 28 April 2026 03:41:37 +0000 (0:00:06.478) 0:00:11.731 ********* 2026-04-28 03:41:56.703486 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-28 03:41:56.703497 | orchestrator | 2026-04-28 03:41:56.703506 | orchestrator | TASK [service-ks-register : cinder | Creating users] *************************** 2026-04-28 03:41:56.703541 | orchestrator | Tuesday 28 April 2026 03:41:40 +0000 (0:00:03.386) 0:00:15.118 ********* 2026-04-28 03:41:56.703550 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-28 03:41:56.703559 | orchestrator | changed: [testbed-node-0] => (item=cinder -> service) 2026-04-28 03:41:56.703568 | orchestrator | 2026-04-28 03:41:56.703577 | orchestrator | TASK [service-ks-register : cinder | Creating roles] *************************** 2026-04-28 03:41:56.703586 | orchestrator | Tuesday 28 April 2026 03:41:44 +0000 (0:00:03.862) 0:00:18.980 ********* 2026-04-28 03:41:56.703595 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-28 03:41:56.703604 | orchestrator | 2026-04-28 03:41:56.703613 | orchestrator | TASK [service-ks-register : cinder | Granting user roles] ********************** 2026-04-28 03:41:56.703622 | orchestrator | Tuesday 28 April 2026 03:41:47 +0000 (0:00:02.905) 0:00:21.886 ********* 2026-04-28 03:41:56.703631 | orchestrator | changed: [testbed-node-0] => (item=cinder -> service -> admin) 2026-04-28 03:41:56.703640 | orchestrator | changed: [testbed-node-0] => (item=cinder -> service -> service) 2026-04-28 03:41:56.703648 | orchestrator | 2026-04-28 03:41:56.703657 | orchestrator | TASK [cinder : Ensuring config directories exist] ****************************** 2026-04-28 03:41:56.703666 | orchestrator | Tuesday 28 April 2026 03:41:54 +0000 (0:00:07.409) 0:00:29.296 ********* 2026-04-28 03:41:56.703693 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-28 03:41:56.703723 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-28 03:41:56.703733 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-28 03:41:56.703750 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:41:56.703762 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:41:56.703771 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:41:56.703785 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 03:41:56.703803 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:02.919104 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:02.919193 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:02.919200 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:02.919215 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:02.919220 | orchestrator | 2026-04-28 03:42:02.919225 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-28 03:42:02.919230 | orchestrator | Tuesday 28 April 2026 03:41:56 +0000 (0:00:02.199) 0:00:31.496 ********* 2026-04-28 03:42:02.919235 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:42:02.919240 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:42:02.919244 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:42:02.919247 | orchestrator | 2026-04-28 03:42:02.919251 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-28 03:42:02.919255 | orchestrator | Tuesday 28 April 2026 03:41:57 +0000 (0:00:00.574) 0:00:32.071 ********* 2026-04-28 03:42:02.919260 | orchestrator | included: /ansible/roles/cinder/tasks/external_ceph.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:42:02.919264 | orchestrator | 2026-04-28 03:42:02.919268 | orchestrator | TASK [cinder : Ensuring cinder service ceph config subdirs exists] ************* 2026-04-28 03:42:02.919272 | orchestrator | Tuesday 28 April 2026 03:41:57 +0000 (0:00:00.600) 0:00:32.671 ********* 2026-04-28 03:42:02.919276 | orchestrator | changed: [testbed-node-0] => (item=cinder-volume) 2026-04-28 03:42:02.919281 | orchestrator | changed: [testbed-node-1] => (item=cinder-volume) 2026-04-28 03:42:02.919285 | orchestrator | changed: [testbed-node-2] => (item=cinder-volume) 2026-04-28 03:42:02.919289 | orchestrator | changed: [testbed-node-0] => (item=cinder-backup) 2026-04-28 03:42:02.919293 | orchestrator | changed: [testbed-node-1] => (item=cinder-backup) 2026-04-28 03:42:02.919297 | orchestrator | changed: [testbed-node-2] => (item=cinder-backup) 2026-04-28 03:42:02.919301 | orchestrator | 2026-04-28 03:42:02.919305 | orchestrator | TASK [cinder : Copying over multiple ceph.conf for cinder services] ************ 2026-04-28 03:42:02.919313 | orchestrator | Tuesday 28 April 2026 03:41:59 +0000 (0:00:01.719) 0:00:34.390 ********* 2026-04-28 03:42:02.919328 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}])  2026-04-28 03:42:02.919335 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}])  2026-04-28 03:42:02.919339 | orchestrator | skipping: [testbed-node-1] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}])  2026-04-28 03:42:02.919346 | orchestrator | skipping: [testbed-node-1] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}])  2026-04-28 03:42:02.919354 | orchestrator | skipping: [testbed-node-2] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}])  2026-04-28 03:42:14.146893 | orchestrator | skipping: [testbed-node-2] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}])  2026-04-28 03:42:14.146974 | orchestrator | changed: [testbed-node-0] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}]) 2026-04-28 03:42:14.146983 | orchestrator | changed: [testbed-node-1] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}]) 2026-04-28 03:42:14.147001 | orchestrator | changed: [testbed-node-2] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}]) 2026-04-28 03:42:14.147007 | orchestrator | changed: [testbed-node-0] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}]) 2026-04-28 03:42:14.147039 | orchestrator | changed: [testbed-node-1] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}]) 2026-04-28 03:42:14.147045 | orchestrator | changed: [testbed-node-2] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}]) 2026-04-28 03:42:14.147050 | orchestrator | 2026-04-28 03:42:14.147057 | orchestrator | TASK [cinder : Copy over Ceph keyring files for cinder-volume] ***************** 2026-04-28 03:42:14.147066 | orchestrator | Tuesday 28 April 2026 03:42:03 +0000 (0:00:03.593) 0:00:37.984 ********* 2026-04-28 03:42:14.147074 | orchestrator | changed: [testbed-node-0] => (item={'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}) 2026-04-28 03:42:14.147082 | orchestrator | changed: [testbed-node-1] => (item={'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}) 2026-04-28 03:42:14.147089 | orchestrator | changed: [testbed-node-2] => (item={'name': 'rbd-1', 'cluster': 'ceph', 'enabled': True}) 2026-04-28 03:42:14.147097 | orchestrator | 2026-04-28 03:42:14.147104 | orchestrator | TASK [cinder : Copy over Ceph keyring files for cinder-backup] ***************** 2026-04-28 03:42:14.147111 | orchestrator | Tuesday 28 April 2026 03:42:04 +0000 (0:00:01.682) 0:00:39.666 ********* 2026-04-28 03:42:14.147119 | orchestrator | changed: [testbed-node-0] => (item=ceph.client.cinder.keyring) 2026-04-28 03:42:14.147126 | orchestrator | changed: [testbed-node-1] => (item=ceph.client.cinder.keyring) 2026-04-28 03:42:14.147133 | orchestrator | changed: [testbed-node-2] => (item=ceph.client.cinder.keyring) 2026-04-28 03:42:14.147140 | orchestrator | changed: [testbed-node-0] => (item=ceph.client.cinder-backup.keyring) 2026-04-28 03:42:14.147147 | orchestrator | changed: [testbed-node-1] => (item=ceph.client.cinder-backup.keyring) 2026-04-28 03:42:14.147154 | orchestrator | changed: [testbed-node-2] => (item=ceph.client.cinder-backup.keyring) 2026-04-28 03:42:14.147161 | orchestrator | 2026-04-28 03:42:14.147168 | orchestrator | TASK [cinder : Ensuring config directory has correct owner and permission] ***** 2026-04-28 03:42:14.147176 | orchestrator | Tuesday 28 April 2026 03:42:07 +0000 (0:00:02.806) 0:00:42.473 ********* 2026-04-28 03:42:14.147189 | orchestrator | ok: [testbed-node-0] => (item=cinder-volume) 2026-04-28 03:42:14.147197 | orchestrator | ok: [testbed-node-1] => (item=cinder-volume) 2026-04-28 03:42:14.147205 | orchestrator | ok: [testbed-node-2] => (item=cinder-volume) 2026-04-28 03:42:14.147213 | orchestrator | ok: [testbed-node-0] => (item=cinder-backup) 2026-04-28 03:42:14.147220 | orchestrator | ok: [testbed-node-1] => (item=cinder-backup) 2026-04-28 03:42:14.147227 | orchestrator | ok: [testbed-node-2] => (item=cinder-backup) 2026-04-28 03:42:14.147243 | orchestrator | 2026-04-28 03:42:14.147248 | orchestrator | TASK [cinder : Check if policies shall be overwritten] ************************* 2026-04-28 03:42:14.147253 | orchestrator | Tuesday 28 April 2026 03:42:08 +0000 (0:00:01.095) 0:00:43.569 ********* 2026-04-28 03:42:14.147257 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:42:14.147262 | orchestrator | 2026-04-28 03:42:14.147267 | orchestrator | TASK [cinder : Set cinder policy file] ***************************************** 2026-04-28 03:42:14.147271 | orchestrator | Tuesday 28 April 2026 03:42:09 +0000 (0:00:00.155) 0:00:43.724 ********* 2026-04-28 03:42:14.147276 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:42:14.147280 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:42:14.147285 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:42:14.147289 | orchestrator | 2026-04-28 03:42:14.147294 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-28 03:42:14.147298 | orchestrator | Tuesday 28 April 2026 03:42:09 +0000 (0:00:00.538) 0:00:44.263 ********* 2026-04-28 03:42:14.147303 | orchestrator | included: /ansible/roles/cinder/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:42:14.147308 | orchestrator | 2026-04-28 03:42:14.147313 | orchestrator | TASK [service-cert-copy : cinder | Copying over extra CA certificates] ********* 2026-04-28 03:42:14.147317 | orchestrator | Tuesday 28 April 2026 03:42:10 +0000 (0:00:00.642) 0:00:44.905 ********* 2026-04-28 03:42:14.147328 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-28 03:42:15.121694 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-28 03:42:15.121787 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-28 03:42:15.121856 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:15.121866 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:15.121873 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:15.121895 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:15.121904 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:15.121910 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:15.121926 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:15.121933 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:15.121940 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:15.121947 | orchestrator | 2026-04-28 03:42:15.121954 | orchestrator | TASK [service-cert-copy : cinder | Copying over backend internal TLS certificate] *** 2026-04-28 03:42:15.121963 | orchestrator | Tuesday 28 April 2026 03:42:14 +0000 (0:00:04.036) 0:00:48.942 ********* 2026-04-28 03:42:15.121976 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-28 03:42:15.225187 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:42:15.225290 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 03:42:15.225301 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 03:42:15.225310 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:42:15.225320 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-28 03:42:15.225340 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:42:15.225365 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 03:42:15.225371 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 03:42:15.225381 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:42:15.225390 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-28 03:42:15.225396 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:42:15.225401 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 03:42:15.225406 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 03:42:15.225410 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:42:15.225415 | orchestrator | 2026-04-28 03:42:15.225421 | orchestrator | TASK [service-cert-copy : cinder | Copying over backend internal TLS key] ****** 2026-04-28 03:42:15.225430 | orchestrator | Tuesday 28 April 2026 03:42:15 +0000 (0:00:00.969) 0:00:49.911 ********* 2026-04-28 03:42:15.932967 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-28 03:42:15.933051 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-28 03:42:15.933059 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:42:15.933066 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:42:15.933071 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 03:42:15.933087 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 03:42:15.933110 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 03:42:15.933118 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 03:42:15.933122 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:42:15.933128 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:42:15.933132 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-28 03:42:15.933136 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:42:15.933144 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 03:42:20.644584 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 03:42:20.644679 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:42:20.644694 | orchestrator | 2026-04-28 03:42:20.644705 | orchestrator | TASK [cinder : Copying over config.json files for services] ******************** 2026-04-28 03:42:20.644715 | orchestrator | Tuesday 28 April 2026 03:42:16 +0000 (0:00:01.028) 0:00:50.939 ********* 2026-04-28 03:42:20.644741 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-28 03:42:20.644752 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-28 03:42:20.644763 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-28 03:42:20.644821 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:20.644949 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:20.644971 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:20.644981 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:20.644992 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:20.645001 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:20.645030 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:34.534393 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:34.534533 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:34.534551 | orchestrator | 2026-04-28 03:42:34.534564 | orchestrator | TASK [cinder : Copying over cinder-wsgi.conf] ********************************** 2026-04-28 03:42:34.534576 | orchestrator | Tuesday 28 April 2026 03:42:20 +0000 (0:00:04.478) 0:00:55.417 ********* 2026-04-28 03:42:34.534587 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/cinder/templates/cinder-wsgi.conf.j2) 2026-04-28 03:42:34.534597 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/cinder/templates/cinder-wsgi.conf.j2) 2026-04-28 03:42:34.534607 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/cinder/templates/cinder-wsgi.conf.j2) 2026-04-28 03:42:34.534617 | orchestrator | 2026-04-28 03:42:34.534627 | orchestrator | TASK [cinder : Copying over cinder.conf] *************************************** 2026-04-28 03:42:34.534636 | orchestrator | Tuesday 28 April 2026 03:42:22 +0000 (0:00:01.988) 0:00:57.406 ********* 2026-04-28 03:42:34.534648 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-28 03:42:34.534680 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-28 03:42:34.534708 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-28 03:42:34.534726 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:34.534738 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:34.534748 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:34.534758 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:34.534776 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:34.534795 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:37.088264 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:37.088373 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:37.088383 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:37.088403 | orchestrator | 2026-04-28 03:42:37.088410 | orchestrator | TASK [cinder : Generating 'hostnqn' file for cinder_volume] ******************** 2026-04-28 03:42:37.089165 | orchestrator | Tuesday 28 April 2026 03:42:34 +0000 (0:00:11.909) 0:01:09.316 ********* 2026-04-28 03:42:37.089227 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:42:37.089237 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:42:37.089244 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:42:37.089251 | orchestrator | 2026-04-28 03:42:37.089258 | orchestrator | TASK [cinder : Copying over existing policy file] ****************************** 2026-04-28 03:42:37.089264 | orchestrator | Tuesday 28 April 2026 03:42:36 +0000 (0:00:01.585) 0:01:10.901 ********* 2026-04-28 03:42:37.089275 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-28 03:42:37.089285 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:42:37.089325 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 03:42:37.089334 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 03:42:37.089353 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:42:37.089359 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-28 03:42:37.089365 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:42:37.089371 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 03:42:37.089384 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 03:42:40.958397 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:42:40.958515 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}})  2026-04-28 03:42:40.958557 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:42:40.958575 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 03:42:40.958584 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 03:42:40.958594 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:42:40.958603 | orchestrator | 2026-04-28 03:42:40.958613 | orchestrator | TASK [cinder : Copying over nfs_shares files for cinder_volume] **************** 2026-04-28 03:42:40.958623 | orchestrator | Tuesday 28 April 2026 03:42:37 +0000 (0:00:00.966) 0:01:11.868 ********* 2026-04-28 03:42:40.958632 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:42:40.958641 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:42:40.958649 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:42:40.958658 | orchestrator | 2026-04-28 03:42:40.958666 | orchestrator | TASK [cinder : Check cinder containers] **************************************** 2026-04-28 03:42:40.958675 | orchestrator | Tuesday 28 April 2026 03:42:37 +0000 (0:00:00.635) 0:01:12.504 ********* 2026-04-28 03:42:40.958705 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-28 03:42:40.958716 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-28 03:42:40.958732 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no'}}}}) 2026-04-28 03:42:40.958741 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:40.958751 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:40.958760 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:42:40.958782 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 03:44:25.245651 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 03:44:25.245741 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 03:44:25.245753 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 03:44:25.245761 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 03:44:25.245767 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 03:44:25.245775 | orchestrator | 2026-04-28 03:44:25.245798 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-28 03:44:25.245823 | orchestrator | Tuesday 28 April 2026 03:42:41 +0000 (0:00:03.260) 0:01:15.764 ********* 2026-04-28 03:44:25.245830 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:44:25.245838 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:44:25.245845 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:44:25.245855 | orchestrator | 2026-04-28 03:44:25.245865 | orchestrator | TASK [cinder : Creating Cinder database] *************************************** 2026-04-28 03:44:25.245903 | orchestrator | Tuesday 28 April 2026 03:42:41 +0000 (0:00:00.396) 0:01:16.161 ********* 2026-04-28 03:44:25.245915 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:44:25.246102 | orchestrator | 2026-04-28 03:44:25.246134 | orchestrator | TASK [cinder : Creating Cinder database user and setting permissions] ********** 2026-04-28 03:44:25.246145 | orchestrator | Tuesday 28 April 2026 03:42:43 +0000 (0:00:02.038) 0:01:18.200 ********* 2026-04-28 03:44:25.246156 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:44:25.246165 | orchestrator | 2026-04-28 03:44:25.246174 | orchestrator | TASK [cinder : Running Cinder bootstrap container] ***************************** 2026-04-28 03:44:25.246184 | orchestrator | Tuesday 28 April 2026 03:42:45 +0000 (0:00:02.180) 0:01:20.381 ********* 2026-04-28 03:44:25.246194 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:44:25.246205 | orchestrator | 2026-04-28 03:44:25.246216 | orchestrator | TASK [cinder : Flush handlers] ************************************************* 2026-04-28 03:44:25.246227 | orchestrator | Tuesday 28 April 2026 03:43:05 +0000 (0:00:19.972) 0:01:40.353 ********* 2026-04-28 03:44:25.246236 | orchestrator | 2026-04-28 03:44:25.246245 | orchestrator | TASK [cinder : Flush handlers] ************************************************* 2026-04-28 03:44:25.246255 | orchestrator | Tuesday 28 April 2026 03:43:05 +0000 (0:00:00.082) 0:01:40.435 ********* 2026-04-28 03:44:25.246264 | orchestrator | 2026-04-28 03:44:25.246275 | orchestrator | TASK [cinder : Flush handlers] ************************************************* 2026-04-28 03:44:25.246285 | orchestrator | Tuesday 28 April 2026 03:43:05 +0000 (0:00:00.081) 0:01:40.517 ********* 2026-04-28 03:44:25.246298 | orchestrator | 2026-04-28 03:44:25.246309 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-api container] ************************ 2026-04-28 03:44:25.246318 | orchestrator | Tuesday 28 April 2026 03:43:05 +0000 (0:00:00.081) 0:01:40.599 ********* 2026-04-28 03:44:25.246328 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:44:25.246338 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:44:25.246349 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:44:25.246358 | orchestrator | 2026-04-28 03:44:25.246381 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-scheduler container] ****************** 2026-04-28 03:44:25.246393 | orchestrator | Tuesday 28 April 2026 03:43:34 +0000 (0:00:29.082) 0:02:09.681 ********* 2026-04-28 03:44:25.246403 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:44:25.246412 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:44:25.246421 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:44:25.246431 | orchestrator | 2026-04-28 03:44:25.246441 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-volume container] ********************* 2026-04-28 03:44:25.246451 | orchestrator | Tuesday 28 April 2026 03:43:45 +0000 (0:00:10.446) 0:02:20.128 ********* 2026-04-28 03:44:25.246460 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:44:25.246470 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:44:25.246480 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:44:25.246490 | orchestrator | 2026-04-28 03:44:25.246499 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-backup container] ********************* 2026-04-28 03:44:25.246508 | orchestrator | Tuesday 28 April 2026 03:44:13 +0000 (0:00:28.355) 0:02:48.483 ********* 2026-04-28 03:44:25.246518 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:44:25.246527 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:44:25.246537 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:44:25.246546 | orchestrator | 2026-04-28 03:44:25.246556 | orchestrator | RUNNING HANDLER [cinder : Wait for cinder services to update service versions] *** 2026-04-28 03:44:25.246567 | orchestrator | Tuesday 28 April 2026 03:44:24 +0000 (0:00:11.108) 0:02:59.592 ********* 2026-04-28 03:44:25.246577 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:44:25.246604 | orchestrator | 2026-04-28 03:44:25.246615 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 03:44:25.246626 | orchestrator | testbed-node-0 : ok=30  changed=22  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-28 03:44:25.246638 | orchestrator | testbed-node-1 : ok=21  changed=15  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-28 03:44:25.246649 | orchestrator | testbed-node-2 : ok=21  changed=15  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-28 03:44:25.246660 | orchestrator | 2026-04-28 03:44:25.246670 | orchestrator | 2026-04-28 03:44:25.246680 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 03:44:25.246691 | orchestrator | Tuesday 28 April 2026 03:44:25 +0000 (0:00:00.326) 0:02:59.919 ********* 2026-04-28 03:44:25.246701 | orchestrator | =============================================================================== 2026-04-28 03:44:25.246710 | orchestrator | cinder : Restart cinder-api container ---------------------------------- 29.08s 2026-04-28 03:44:25.246721 | orchestrator | cinder : Restart cinder-volume container ------------------------------- 28.36s 2026-04-28 03:44:25.246730 | orchestrator | cinder : Running Cinder bootstrap container ---------------------------- 19.97s 2026-04-28 03:44:25.246740 | orchestrator | cinder : Copying over cinder.conf -------------------------------------- 11.91s 2026-04-28 03:44:25.246749 | orchestrator | cinder : Restart cinder-backup container ------------------------------- 11.11s 2026-04-28 03:44:25.246758 | orchestrator | cinder : Restart cinder-scheduler container ---------------------------- 10.45s 2026-04-28 03:44:25.246768 | orchestrator | service-ks-register : cinder | Granting user roles ---------------------- 7.41s 2026-04-28 03:44:25.246787 | orchestrator | service-ks-register : cinder | Creating endpoints ----------------------- 6.48s 2026-04-28 03:44:25.246796 | orchestrator | cinder : Copying over config.json files for services -------------------- 4.48s 2026-04-28 03:44:25.246804 | orchestrator | service-cert-copy : cinder | Copying over extra CA certificates --------- 4.04s 2026-04-28 03:44:25.246813 | orchestrator | service-ks-register : cinder | Creating users --------------------------- 3.86s 2026-04-28 03:44:25.246824 | orchestrator | cinder : Copying over multiple ceph.conf for cinder services ------------ 3.59s 2026-04-28 03:44:25.246834 | orchestrator | service-ks-register : cinder | Creating services ------------------------ 3.57s 2026-04-28 03:44:25.246844 | orchestrator | service-ks-register : cinder | Creating projects ------------------------ 3.39s 2026-04-28 03:44:25.246869 | orchestrator | cinder : Check cinder containers ---------------------------------------- 3.26s 2026-04-28 03:44:25.683400 | orchestrator | service-ks-register : cinder | Creating roles --------------------------- 2.91s 2026-04-28 03:44:25.683477 | orchestrator | cinder : Copy over Ceph keyring files for cinder-backup ----------------- 2.81s 2026-04-28 03:44:25.683486 | orchestrator | cinder : Ensuring config directories exist ------------------------------ 2.20s 2026-04-28 03:44:25.683493 | orchestrator | cinder : Creating Cinder database user and setting permissions ---------- 2.18s 2026-04-28 03:44:25.683499 | orchestrator | cinder : Creating Cinder database --------------------------------------- 2.04s 2026-04-28 03:44:28.334416 | orchestrator | 2026-04-28 03:44:28 | INFO  | Task 18c65dc5-c9c0-44d4-937a-6de38e1eb411 (barbican) was prepared for execution. 2026-04-28 03:44:28.334501 | orchestrator | 2026-04-28 03:44:28 | INFO  | It takes a moment until task 18c65dc5-c9c0-44d4-937a-6de38e1eb411 (barbican) has been started and output is visible here. 2026-04-28 03:45:12.543104 | orchestrator | 2026-04-28 03:45:12.543205 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 03:45:12.543218 | orchestrator | 2026-04-28 03:45:12.543227 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 03:45:12.543235 | orchestrator | Tuesday 28 April 2026 03:44:33 +0000 (0:00:00.288) 0:00:00.288 ********* 2026-04-28 03:45:12.543242 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:45:12.543269 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:45:12.543277 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:45:12.543284 | orchestrator | 2026-04-28 03:45:12.543292 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 03:45:12.543300 | orchestrator | Tuesday 28 April 2026 03:44:33 +0000 (0:00:00.358) 0:00:00.647 ********* 2026-04-28 03:45:12.543307 | orchestrator | ok: [testbed-node-0] => (item=enable_barbican_True) 2026-04-28 03:45:12.543315 | orchestrator | ok: [testbed-node-1] => (item=enable_barbican_True) 2026-04-28 03:45:12.543322 | orchestrator | ok: [testbed-node-2] => (item=enable_barbican_True) 2026-04-28 03:45:12.543330 | orchestrator | 2026-04-28 03:45:12.543337 | orchestrator | PLAY [Apply role barbican] ***************************************************** 2026-04-28 03:45:12.543344 | orchestrator | 2026-04-28 03:45:12.543352 | orchestrator | TASK [barbican : include_tasks] ************************************************ 2026-04-28 03:45:12.543359 | orchestrator | Tuesday 28 April 2026 03:44:33 +0000 (0:00:00.505) 0:00:01.152 ********* 2026-04-28 03:45:12.543367 | orchestrator | included: /ansible/roles/barbican/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:45:12.543375 | orchestrator | 2026-04-28 03:45:12.543382 | orchestrator | TASK [service-ks-register : barbican | Creating services] ********************** 2026-04-28 03:45:12.543389 | orchestrator | Tuesday 28 April 2026 03:44:34 +0000 (0:00:00.618) 0:00:01.771 ********* 2026-04-28 03:45:12.543397 | orchestrator | changed: [testbed-node-0] => (item=barbican (key-manager)) 2026-04-28 03:45:12.543404 | orchestrator | 2026-04-28 03:45:12.543412 | orchestrator | TASK [service-ks-register : barbican | Creating endpoints] ********************* 2026-04-28 03:45:12.543419 | orchestrator | Tuesday 28 April 2026 03:44:38 +0000 (0:00:03.536) 0:00:05.308 ********* 2026-04-28 03:45:12.543426 | orchestrator | changed: [testbed-node-0] => (item=barbican -> https://api-int.testbed.osism.xyz:9311 -> internal) 2026-04-28 03:45:12.543433 | orchestrator | changed: [testbed-node-0] => (item=barbican -> https://api.testbed.osism.xyz:9311 -> public) 2026-04-28 03:45:12.543440 | orchestrator | 2026-04-28 03:45:12.543448 | orchestrator | TASK [service-ks-register : barbican | Creating projects] ********************** 2026-04-28 03:45:12.543455 | orchestrator | Tuesday 28 April 2026 03:44:44 +0000 (0:00:06.578) 0:00:11.886 ********* 2026-04-28 03:45:12.543462 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-28 03:45:12.543469 | orchestrator | 2026-04-28 03:45:12.543477 | orchestrator | TASK [service-ks-register : barbican | Creating users] ************************* 2026-04-28 03:45:12.543484 | orchestrator | Tuesday 28 April 2026 03:44:47 +0000 (0:00:03.179) 0:00:15.066 ********* 2026-04-28 03:45:12.543491 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-28 03:45:12.543498 | orchestrator | changed: [testbed-node-0] => (item=barbican -> service) 2026-04-28 03:45:12.543505 | orchestrator | 2026-04-28 03:45:12.543513 | orchestrator | TASK [service-ks-register : barbican | Creating roles] ************************* 2026-04-28 03:45:12.543520 | orchestrator | Tuesday 28 April 2026 03:44:51 +0000 (0:00:03.990) 0:00:19.056 ********* 2026-04-28 03:45:12.543527 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-28 03:45:12.543534 | orchestrator | changed: [testbed-node-0] => (item=key-manager:service-admin) 2026-04-28 03:45:12.543541 | orchestrator | changed: [testbed-node-0] => (item=creator) 2026-04-28 03:45:12.543549 | orchestrator | changed: [testbed-node-0] => (item=observer) 2026-04-28 03:45:12.543556 | orchestrator | changed: [testbed-node-0] => (item=audit) 2026-04-28 03:45:12.543563 | orchestrator | 2026-04-28 03:45:12.543570 | orchestrator | TASK [service-ks-register : barbican | Granting user roles] ******************** 2026-04-28 03:45:12.543577 | orchestrator | Tuesday 28 April 2026 03:45:07 +0000 (0:00:15.158) 0:00:34.214 ********* 2026-04-28 03:45:12.543598 | orchestrator | changed: [testbed-node-0] => (item=barbican -> service -> admin) 2026-04-28 03:45:12.543606 | orchestrator | 2026-04-28 03:45:12.543613 | orchestrator | TASK [barbican : Ensuring config directories exist] **************************** 2026-04-28 03:45:12.543620 | orchestrator | Tuesday 28 April 2026 03:45:10 +0000 (0:00:03.837) 0:00:38.052 ********* 2026-04-28 03:45:12.543636 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-28 03:45:12.543664 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-28 03:45:12.543674 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-28 03:45:12.543684 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:12.543699 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:12.543714 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:12.543729 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:18.616472 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:18.616600 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:18.616612 | orchestrator | 2026-04-28 03:45:18.616623 | orchestrator | TASK [barbican : Ensuring vassals config directories exist] ******************** 2026-04-28 03:45:18.616633 | orchestrator | Tuesday 28 April 2026 03:45:12 +0000 (0:00:01.651) 0:00:39.704 ********* 2026-04-28 03:45:18.616641 | orchestrator | changed: [testbed-node-0] => (item=barbican-api/vassals) 2026-04-28 03:45:18.616648 | orchestrator | changed: [testbed-node-1] => (item=barbican-api/vassals) 2026-04-28 03:45:18.616656 | orchestrator | changed: [testbed-node-2] => (item=barbican-api/vassals) 2026-04-28 03:45:18.616663 | orchestrator | 2026-04-28 03:45:18.616670 | orchestrator | TASK [barbican : Check if policies shall be overwritten] *********************** 2026-04-28 03:45:18.616677 | orchestrator | Tuesday 28 April 2026 03:45:13 +0000 (0:00:01.155) 0:00:40.860 ********* 2026-04-28 03:45:18.616685 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:45:18.616693 | orchestrator | 2026-04-28 03:45:18.616700 | orchestrator | TASK [barbican : Set barbican policy file] ************************************* 2026-04-28 03:45:18.616707 | orchestrator | Tuesday 28 April 2026 03:45:14 +0000 (0:00:00.352) 0:00:41.212 ********* 2026-04-28 03:45:18.616714 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:45:18.616721 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:45:18.616754 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:45:18.616762 | orchestrator | 2026-04-28 03:45:18.616769 | orchestrator | TASK [barbican : include_tasks] ************************************************ 2026-04-28 03:45:18.616777 | orchestrator | Tuesday 28 April 2026 03:45:14 +0000 (0:00:00.345) 0:00:41.558 ********* 2026-04-28 03:45:18.616785 | orchestrator | included: /ansible/roles/barbican/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:45:18.616793 | orchestrator | 2026-04-28 03:45:18.616800 | orchestrator | TASK [service-cert-copy : barbican | Copying over extra CA certificates] ******* 2026-04-28 03:45:18.616807 | orchestrator | Tuesday 28 April 2026 03:45:14 +0000 (0:00:00.597) 0:00:42.156 ********* 2026-04-28 03:45:18.616832 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-28 03:45:18.616861 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-28 03:45:18.616870 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-28 03:45:18.616878 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:18.616899 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:18.616907 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:18.616914 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:18.616928 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:20.281023 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:20.281131 | orchestrator | 2026-04-28 03:45:20.281145 | orchestrator | TASK [service-cert-copy : barbican | Copying over backend internal TLS certificate] *** 2026-04-28 03:45:20.281156 | orchestrator | Tuesday 28 April 2026 03:45:18 +0000 (0:00:03.622) 0:00:45.778 ********* 2026-04-28 03:45:20.281167 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-28 03:45:20.281211 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 03:45:20.281222 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:45:20.281230 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:45:20.281240 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-28 03:45:20.281266 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 03:45:20.281329 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:45:20.281347 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:45:20.281356 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-28 03:45:20.281369 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 03:45:20.281377 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:45:20.281385 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:45:20.281392 | orchestrator | 2026-04-28 03:45:20.281399 | orchestrator | TASK [service-cert-copy : barbican | Copying over backend internal TLS key] **** 2026-04-28 03:45:20.281406 | orchestrator | Tuesday 28 April 2026 03:45:19 +0000 (0:00:00.800) 0:00:46.578 ********* 2026-04-28 03:45:20.281423 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-28 03:45:23.842864 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 03:45:23.843050 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:45:23.843073 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:45:23.843100 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-28 03:45:23.843110 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 03:45:23.843119 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:45:23.843128 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:45:23.843156 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-28 03:45:23.843173 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 03:45:23.843183 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:45:23.843192 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:45:23.843202 | orchestrator | 2026-04-28 03:45:23.843216 | orchestrator | TASK [barbican : Copying over config.json files for services] ****************** 2026-04-28 03:45:23.843227 | orchestrator | Tuesday 28 April 2026 03:45:20 +0000 (0:00:00.870) 0:00:47.449 ********* 2026-04-28 03:45:23.843236 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-28 03:45:23.843247 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-28 03:45:23.843294 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-28 03:45:34.160307 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:34.161170 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:34.161230 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:34.161239 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:34.161247 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:34.161268 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:34.161274 | orchestrator | 2026-04-28 03:45:34.161280 | orchestrator | TASK [barbican : Copying over barbican-api.ini] ******************************** 2026-04-28 03:45:34.161286 | orchestrator | Tuesday 28 April 2026 03:45:23 +0000 (0:00:03.556) 0:00:51.006 ********* 2026-04-28 03:45:34.161291 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:45:34.161297 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:45:34.161301 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:45:34.161306 | orchestrator | 2026-04-28 03:45:34.161326 | orchestrator | TASK [barbican : Checking whether barbican-api-paste.ini file exists] ********** 2026-04-28 03:45:34.161331 | orchestrator | Tuesday 28 April 2026 03:45:25 +0000 (0:00:01.607) 0:00:52.613 ********* 2026-04-28 03:45:34.161336 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 03:45:34.161341 | orchestrator | 2026-04-28 03:45:34.161346 | orchestrator | TASK [barbican : Copying over barbican-api-paste.ini] ************************** 2026-04-28 03:45:34.161350 | orchestrator | Tuesday 28 April 2026 03:45:26 +0000 (0:00:01.076) 0:00:53.690 ********* 2026-04-28 03:45:34.161355 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:45:34.161359 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:45:34.161364 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:45:34.161368 | orchestrator | 2026-04-28 03:45:34.161373 | orchestrator | TASK [barbican : Copying over barbican.conf] *********************************** 2026-04-28 03:45:34.161377 | orchestrator | Tuesday 28 April 2026 03:45:27 +0000 (0:00:00.630) 0:00:54.321 ********* 2026-04-28 03:45:34.161387 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-28 03:45:34.161393 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-28 03:45:34.161403 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-28 03:45:34.161412 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:35.124226 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:35.124315 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:35.124326 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:35.124335 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:35.124357 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:35.124364 | orchestrator | 2026-04-28 03:45:35.124372 | orchestrator | TASK [barbican : Copying over existing policy file] **************************** 2026-04-28 03:45:35.124379 | orchestrator | Tuesday 28 April 2026 03:45:34 +0000 (0:00:07.002) 0:01:01.323 ********* 2026-04-28 03:45:35.124398 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-28 03:45:35.124405 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 03:45:35.124413 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:45:35.124419 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:45:35.124427 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-28 03:45:35.124467 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 03:45:35.124475 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:45:35.124481 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:45:35.124492 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}})  2026-04-28 03:45:37.684194 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 03:45:37.684307 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:45:37.684346 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:45:37.684359 | orchestrator | 2026-04-28 03:45:37.684368 | orchestrator | TASK [barbican : Check barbican containers] ************************************ 2026-04-28 03:45:37.684377 | orchestrator | Tuesday 28 April 2026 03:45:35 +0000 (0:00:00.968) 0:01:02.292 ********* 2026-04-28 03:45:37.684386 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-28 03:45:37.684395 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-28 03:45:37.684420 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no'}}}}) 2026-04-28 03:45:37.684436 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:37.684446 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:37.684461 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:37.684470 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:37.684479 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:37.684488 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:45:37.684496 | orchestrator | 2026-04-28 03:45:37.684504 | orchestrator | TASK [barbican : include_tasks] ************************************************ 2026-04-28 03:45:37.684546 | orchestrator | Tuesday 28 April 2026 03:45:37 +0000 (0:00:02.548) 0:01:04.841 ********* 2026-04-28 03:46:28.087340 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:46:28.087473 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:46:28.087489 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:46:28.087500 | orchestrator | 2026-04-28 03:46:28.087511 | orchestrator | TASK [barbican : Creating barbican database] *********************************** 2026-04-28 03:46:28.087523 | orchestrator | Tuesday 28 April 2026 03:45:37 +0000 (0:00:00.332) 0:01:05.173 ********* 2026-04-28 03:46:28.087533 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:46:28.087542 | orchestrator | 2026-04-28 03:46:28.087552 | orchestrator | TASK [barbican : Creating barbican database user and setting permissions] ****** 2026-04-28 03:46:28.087598 | orchestrator | Tuesday 28 April 2026 03:45:40 +0000 (0:00:02.115) 0:01:07.289 ********* 2026-04-28 03:46:28.087610 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:46:28.087619 | orchestrator | 2026-04-28 03:46:28.087629 | orchestrator | TASK [barbican : Running barbican bootstrap container] ************************* 2026-04-28 03:46:28.087639 | orchestrator | Tuesday 28 April 2026 03:45:42 +0000 (0:00:02.332) 0:01:09.621 ********* 2026-04-28 03:46:28.087648 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:46:28.087658 | orchestrator | 2026-04-28 03:46:28.087667 | orchestrator | TASK [barbican : Flush handlers] *********************************************** 2026-04-28 03:46:28.087677 | orchestrator | Tuesday 28 April 2026 03:45:54 +0000 (0:00:12.351) 0:01:21.972 ********* 2026-04-28 03:46:28.087686 | orchestrator | 2026-04-28 03:46:28.087696 | orchestrator | TASK [barbican : Flush handlers] *********************************************** 2026-04-28 03:46:28.087705 | orchestrator | Tuesday 28 April 2026 03:45:54 +0000 (0:00:00.078) 0:01:22.051 ********* 2026-04-28 03:46:28.087715 | orchestrator | 2026-04-28 03:46:28.087724 | orchestrator | TASK [barbican : Flush handlers] *********************************************** 2026-04-28 03:46:28.087734 | orchestrator | Tuesday 28 April 2026 03:45:54 +0000 (0:00:00.071) 0:01:22.123 ********* 2026-04-28 03:46:28.087744 | orchestrator | 2026-04-28 03:46:28.087753 | orchestrator | RUNNING HANDLER [barbican : Restart barbican-api container] ******************** 2026-04-28 03:46:28.087763 | orchestrator | Tuesday 28 April 2026 03:45:55 +0000 (0:00:00.097) 0:01:22.220 ********* 2026-04-28 03:46:28.087772 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:46:28.087782 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:46:28.087792 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:46:28.087801 | orchestrator | 2026-04-28 03:46:28.087810 | orchestrator | RUNNING HANDLER [barbican : Restart barbican-keystone-listener container] ****** 2026-04-28 03:46:28.087820 | orchestrator | Tuesday 28 April 2026 03:46:06 +0000 (0:00:11.585) 0:01:33.806 ********* 2026-04-28 03:46:28.087830 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:46:28.087839 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:46:28.087849 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:46:28.087859 | orchestrator | 2026-04-28 03:46:28.087868 | orchestrator | RUNNING HANDLER [barbican : Restart barbican-worker container] ***************** 2026-04-28 03:46:28.087879 | orchestrator | Tuesday 28 April 2026 03:46:16 +0000 (0:00:10.141) 0:01:43.947 ********* 2026-04-28 03:46:28.087891 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:46:28.087902 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:46:28.087913 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:46:28.087924 | orchestrator | 2026-04-28 03:46:28.087935 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 03:46:28.087948 | orchestrator | testbed-node-0 : ok=24  changed=18  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-28 03:46:28.087989 | orchestrator | testbed-node-1 : ok=14  changed=10  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 03:46:28.088001 | orchestrator | testbed-node-2 : ok=14  changed=10  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 03:46:28.088012 | orchestrator | 2026-04-28 03:46:28.088023 | orchestrator | 2026-04-28 03:46:28.088034 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 03:46:28.088045 | orchestrator | Tuesday 28 April 2026 03:46:27 +0000 (0:00:10.901) 0:01:54.849 ********* 2026-04-28 03:46:28.088057 | orchestrator | =============================================================================== 2026-04-28 03:46:28.088068 | orchestrator | service-ks-register : barbican | Creating roles ------------------------ 15.16s 2026-04-28 03:46:28.088079 | orchestrator | barbican : Running barbican bootstrap container ------------------------ 12.35s 2026-04-28 03:46:28.088090 | orchestrator | barbican : Restart barbican-api container ------------------------------ 11.59s 2026-04-28 03:46:28.088101 | orchestrator | barbican : Restart barbican-worker container --------------------------- 10.90s 2026-04-28 03:46:28.088120 | orchestrator | barbican : Restart barbican-keystone-listener container ---------------- 10.14s 2026-04-28 03:46:28.088131 | orchestrator | barbican : Copying over barbican.conf ----------------------------------- 7.00s 2026-04-28 03:46:28.088141 | orchestrator | service-ks-register : barbican | Creating endpoints --------------------- 6.58s 2026-04-28 03:46:28.088150 | orchestrator | service-ks-register : barbican | Creating users ------------------------- 3.99s 2026-04-28 03:46:28.088160 | orchestrator | service-ks-register : barbican | Granting user roles -------------------- 3.84s 2026-04-28 03:46:28.088170 | orchestrator | service-cert-copy : barbican | Copying over extra CA certificates ------- 3.62s 2026-04-28 03:46:28.088179 | orchestrator | barbican : Copying over config.json files for services ------------------ 3.56s 2026-04-28 03:46:28.088189 | orchestrator | service-ks-register : barbican | Creating services ---------------------- 3.54s 2026-04-28 03:46:28.088198 | orchestrator | service-ks-register : barbican | Creating projects ---------------------- 3.18s 2026-04-28 03:46:28.088208 | orchestrator | barbican : Check barbican containers ------------------------------------ 2.55s 2026-04-28 03:46:28.088218 | orchestrator | barbican : Creating barbican database user and setting permissions ------ 2.33s 2026-04-28 03:46:28.088245 | orchestrator | barbican : Creating barbican database ----------------------------------- 2.12s 2026-04-28 03:46:28.088256 | orchestrator | barbican : Ensuring config directories exist ---------------------------- 1.65s 2026-04-28 03:46:28.088266 | orchestrator | barbican : Copying over barbican-api.ini -------------------------------- 1.61s 2026-04-28 03:46:28.088277 | orchestrator | barbican : Ensuring vassals config directories exist -------------------- 1.16s 2026-04-28 03:46:28.088292 | orchestrator | barbican : Checking whether barbican-api-paste.ini file exists ---------- 1.08s 2026-04-28 03:46:30.714367 | orchestrator | 2026-04-28 03:46:30 | INFO  | Task 469dc7a6-d748-4c5b-9ada-5880dec15045 (designate) was prepared for execution. 2026-04-28 03:46:30.714438 | orchestrator | 2026-04-28 03:46:30 | INFO  | It takes a moment until task 469dc7a6-d748-4c5b-9ada-5880dec15045 (designate) has been started and output is visible here. 2026-04-28 03:47:02.941619 | orchestrator | 2026-04-28 03:47:02.942777 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 03:47:02.942853 | orchestrator | 2026-04-28 03:47:02.942875 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 03:47:02.942896 | orchestrator | Tuesday 28 April 2026 03:46:35 +0000 (0:00:00.294) 0:00:00.294 ********* 2026-04-28 03:47:02.942916 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:47:02.942938 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:47:02.942989 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:47:02.943010 | orchestrator | 2026-04-28 03:47:02.943029 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 03:47:02.943049 | orchestrator | Tuesday 28 April 2026 03:46:35 +0000 (0:00:00.356) 0:00:00.650 ********* 2026-04-28 03:47:02.943069 | orchestrator | ok: [testbed-node-0] => (item=enable_designate_True) 2026-04-28 03:47:02.943088 | orchestrator | ok: [testbed-node-1] => (item=enable_designate_True) 2026-04-28 03:47:02.943107 | orchestrator | ok: [testbed-node-2] => (item=enable_designate_True) 2026-04-28 03:47:02.943127 | orchestrator | 2026-04-28 03:47:02.943145 | orchestrator | PLAY [Apply role designate] **************************************************** 2026-04-28 03:47:02.943165 | orchestrator | 2026-04-28 03:47:02.943177 | orchestrator | TASK [designate : include_tasks] *********************************************** 2026-04-28 03:47:02.943189 | orchestrator | Tuesday 28 April 2026 03:46:36 +0000 (0:00:00.485) 0:00:01.136 ********* 2026-04-28 03:47:02.943200 | orchestrator | included: /ansible/roles/designate/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:47:02.943212 | orchestrator | 2026-04-28 03:47:02.943223 | orchestrator | TASK [service-ks-register : designate | Creating services] ********************* 2026-04-28 03:47:02.943234 | orchestrator | Tuesday 28 April 2026 03:46:36 +0000 (0:00:00.564) 0:00:01.700 ********* 2026-04-28 03:47:02.943245 | orchestrator | changed: [testbed-node-0] => (item=designate (dns)) 2026-04-28 03:47:02.943285 | orchestrator | 2026-04-28 03:47:02.943297 | orchestrator | TASK [service-ks-register : designate | Creating endpoints] ******************** 2026-04-28 03:47:02.943308 | orchestrator | Tuesday 28 April 2026 03:46:40 +0000 (0:00:03.465) 0:00:05.166 ********* 2026-04-28 03:47:02.943319 | orchestrator | changed: [testbed-node-0] => (item=designate -> https://api-int.testbed.osism.xyz:9001 -> internal) 2026-04-28 03:47:02.943330 | orchestrator | changed: [testbed-node-0] => (item=designate -> https://api.testbed.osism.xyz:9001 -> public) 2026-04-28 03:47:02.943341 | orchestrator | 2026-04-28 03:47:02.943352 | orchestrator | TASK [service-ks-register : designate | Creating projects] ********************* 2026-04-28 03:47:02.943363 | orchestrator | Tuesday 28 April 2026 03:46:46 +0000 (0:00:06.355) 0:00:11.521 ********* 2026-04-28 03:47:02.943373 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-28 03:47:02.943384 | orchestrator | 2026-04-28 03:47:02.943395 | orchestrator | TASK [service-ks-register : designate | Creating users] ************************ 2026-04-28 03:47:02.943405 | orchestrator | Tuesday 28 April 2026 03:46:49 +0000 (0:00:03.047) 0:00:14.568 ********* 2026-04-28 03:47:02.943416 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-28 03:47:02.943427 | orchestrator | changed: [testbed-node-0] => (item=designate -> service) 2026-04-28 03:47:02.943438 | orchestrator | 2026-04-28 03:47:02.943448 | orchestrator | TASK [service-ks-register : designate | Creating roles] ************************ 2026-04-28 03:47:02.943459 | orchestrator | Tuesday 28 April 2026 03:46:53 +0000 (0:00:03.983) 0:00:18.551 ********* 2026-04-28 03:47:02.943470 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-28 03:47:02.943480 | orchestrator | 2026-04-28 03:47:02.943491 | orchestrator | TASK [service-ks-register : designate | Granting user roles] ******************* 2026-04-28 03:47:02.943502 | orchestrator | Tuesday 28 April 2026 03:46:56 +0000 (0:00:03.174) 0:00:21.726 ********* 2026-04-28 03:47:02.943513 | orchestrator | changed: [testbed-node-0] => (item=designate -> service -> admin) 2026-04-28 03:47:02.943524 | orchestrator | 2026-04-28 03:47:02.943534 | orchestrator | TASK [designate : Ensuring config directories exist] *************************** 2026-04-28 03:47:02.943545 | orchestrator | Tuesday 28 April 2026 03:47:00 +0000 (0:00:03.895) 0:00:25.621 ********* 2026-04-28 03:47:02.943560 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-28 03:47:02.943626 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-28 03:47:02.943648 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-28 03:47:02.943662 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 03:47:02.943675 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 03:47:02.943686 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 03:47:02.943704 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:02.943725 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:09.654430 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:09.654563 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:09.654590 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:09.654631 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:09.654662 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:09.654702 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:09.654745 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:09.654780 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:09.654791 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:09.654825 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:09.654836 | orchestrator | 2026-04-28 03:47:09.654848 | orchestrator | TASK [designate : Check if policies shall be overwritten] ********************** 2026-04-28 03:47:09.654859 | orchestrator | Tuesday 28 April 2026 03:47:03 +0000 (0:00:03.038) 0:00:28.660 ********* 2026-04-28 03:47:09.654869 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:47:09.654879 | orchestrator | 2026-04-28 03:47:09.654889 | orchestrator | TASK [designate : Set designate policy file] *********************************** 2026-04-28 03:47:09.654899 | orchestrator | Tuesday 28 April 2026 03:47:03 +0000 (0:00:00.185) 0:00:28.846 ********* 2026-04-28 03:47:09.654908 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:47:09.654918 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:47:09.654930 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:47:09.654948 | orchestrator | 2026-04-28 03:47:09.655039 | orchestrator | TASK [designate : include_tasks] *********************************************** 2026-04-28 03:47:09.655056 | orchestrator | Tuesday 28 April 2026 03:47:04 +0000 (0:00:00.590) 0:00:29.437 ********* 2026-04-28 03:47:09.655071 | orchestrator | included: /ansible/roles/designate/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:47:09.655105 | orchestrator | 2026-04-28 03:47:09.655122 | orchestrator | TASK [service-cert-copy : designate | Copying over extra CA certificates] ****** 2026-04-28 03:47:09.655139 | orchestrator | Tuesday 28 April 2026 03:47:05 +0000 (0:00:00.628) 0:00:30.065 ********* 2026-04-28 03:47:09.655168 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-28 03:47:09.655202 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-28 03:47:11.477097 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-28 03:47:11.477211 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 03:47:11.477226 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 03:47:11.477250 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 03:47:11.477285 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:11.477315 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:11.477326 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:11.477338 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:11.477352 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:11.477364 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:11.477391 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:11.477406 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:11.477423 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:12.449442 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:12.449520 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:12.449529 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:12.449536 | orchestrator | 2026-04-28 03:47:12.449543 | orchestrator | TASK [service-cert-copy : designate | Copying over backend internal TLS certificate] *** 2026-04-28 03:47:12.449568 | orchestrator | Tuesday 28 April 2026 03:47:11 +0000 (0:00:06.272) 0:00:36.338 ********* 2026-04-28 03:47:12.449588 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-28 03:47:12.449595 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 03:47:12.449613 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 03:47:12.449620 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 03:47:12.449627 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 03:47:12.449633 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:47:12.449644 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:47:12.449653 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-28 03:47:12.449660 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 03:47:12.449665 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 03:47:12.449675 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 03:47:13.262922 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 03:47:13.263045 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:47:13.263085 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:47:13.263112 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-28 03:47:13.263124 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 03:47:13.263134 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 03:47:13.263144 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 03:47:13.263169 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 03:47:13.263179 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:47:13.263194 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:47:13.263203 | orchestrator | 2026-04-28 03:47:13.263213 | orchestrator | TASK [service-cert-copy : designate | Copying over backend internal TLS key] *** 2026-04-28 03:47:13.263223 | orchestrator | Tuesday 28 April 2026 03:47:12 +0000 (0:00:01.102) 0:00:37.440 ********* 2026-04-28 03:47:13.263237 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-28 03:47:13.263247 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 03:47:13.263257 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 03:47:13.263272 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 03:47:13.671315 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 03:47:13.671476 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:47:13.671494 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:47:13.671534 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-28 03:47:13.671548 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 03:47:13.671561 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 03:47:13.671584 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 03:47:13.671615 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 03:47:13.671635 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:47:13.671646 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:47:13.671664 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-28 03:47:13.671676 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 03:47:13.671687 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 03:47:13.671699 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 03:47:13.671718 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 03:47:18.095385 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:47:18.095476 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:47:18.095489 | orchestrator | 2026-04-28 03:47:18.095497 | orchestrator | TASK [designate : Copying over config.json files for services] ***************** 2026-04-28 03:47:18.095506 | orchestrator | Tuesday 28 April 2026 03:47:13 +0000 (0:00:01.091) 0:00:38.532 ********* 2026-04-28 03:47:18.095529 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-28 03:47:18.095538 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-28 03:47:18.095545 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-28 03:47:18.095598 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 03:47:18.095619 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 03:47:18.095632 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 03:47:18.095651 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:18.095665 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:18.095673 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:18.095688 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:18.095703 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:30.429684 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:30.430618 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:30.430692 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:30.430703 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:30.430712 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:30.430739 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:30.430768 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:30.430776 | orchestrator | 2026-04-28 03:47:30.430784 | orchestrator | TASK [designate : Copying over designate.conf] ********************************* 2026-04-28 03:47:30.430793 | orchestrator | Tuesday 28 April 2026 03:47:19 +0000 (0:00:06.271) 0:00:44.804 ********* 2026-04-28 03:47:30.430802 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-28 03:47:30.430814 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-28 03:47:30.430822 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-28 03:47:30.430860 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 03:47:30.430887 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 03:47:39.554483 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 03:47:39.554633 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:39.554661 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:39.554678 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:39.554723 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:39.554744 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:39.554783 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:39.554802 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:39.554826 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:39.554844 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:39.554872 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:39.554890 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:39.554906 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:39.554924 | orchestrator | 2026-04-28 03:47:39.554942 | orchestrator | TASK [designate : Copying over pools.yaml] ************************************* 2026-04-28 03:47:39.554997 | orchestrator | Tuesday 28 April 2026 03:47:35 +0000 (0:00:15.596) 0:01:00.400 ********* 2026-04-28 03:47:39.555028 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/designate/templates/pools.yaml.j2) 2026-04-28 03:47:44.217398 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/designate/templates/pools.yaml.j2) 2026-04-28 03:47:44.217475 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/designate/templates/pools.yaml.j2) 2026-04-28 03:47:44.217483 | orchestrator | 2026-04-28 03:47:44.217490 | orchestrator | TASK [designate : Copying over named.conf] ************************************* 2026-04-28 03:47:44.217497 | orchestrator | Tuesday 28 April 2026 03:47:39 +0000 (0:00:04.017) 0:01:04.417 ********* 2026-04-28 03:47:44.217503 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/designate/templates/named.conf.j2) 2026-04-28 03:47:44.217509 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/designate/templates/named.conf.j2) 2026-04-28 03:47:44.217515 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/designate/templates/named.conf.j2) 2026-04-28 03:47:44.217521 | orchestrator | 2026-04-28 03:47:44.217526 | orchestrator | TASK [designate : Copying over rndc.conf] ************************************** 2026-04-28 03:47:44.217532 | orchestrator | Tuesday 28 April 2026 03:47:42 +0000 (0:00:02.661) 0:01:07.078 ********* 2026-04-28 03:47:44.217555 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-28 03:47:44.217583 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-28 03:47:44.217590 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-28 03:47:44.217608 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 03:47:44.217617 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 03:47:44.217628 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 03:47:44.217641 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 03:47:44.217648 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 03:47:44.217654 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 03:47:44.217660 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 03:47:44.217672 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 03:47:47.196304 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 03:47:47.196440 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 03:47:47.196457 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 03:47:47.196463 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 03:47:47.196470 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:47.196478 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:47.196501 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:47.196508 | orchestrator | 2026-04-28 03:47:47.196515 | orchestrator | TASK [designate : Copying over rndc.key] *************************************** 2026-04-28 03:47:47.196523 | orchestrator | Tuesday 28 April 2026 03:47:45 +0000 (0:00:03.091) 0:01:10.170 ********* 2026-04-28 03:47:47.196535 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-28 03:47:47.196549 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-28 03:47:47.196556 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-28 03:47:47.196563 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 03:47:47.196574 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 03:47:48.253524 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 03:47:48.254828 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 03:47:48.254915 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 03:47:48.254942 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 03:47:48.255010 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 03:47:48.255031 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 03:47:48.255085 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 03:47:48.255125 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 03:47:48.255137 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 03:47:48.255149 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 03:47:48.255160 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:48.255172 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:48.255183 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:48.255202 | orchestrator | 2026-04-28 03:47:48.255216 | orchestrator | TASK [designate : include_tasks] *********************************************** 2026-04-28 03:47:48.255237 | orchestrator | Tuesday 28 April 2026 03:47:48 +0000 (0:00:02.942) 0:01:13.112 ********* 2026-04-28 03:47:49.415230 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:47:49.415310 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:47:49.415319 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:47:49.415327 | orchestrator | 2026-04-28 03:47:49.415335 | orchestrator | TASK [designate : Copying over existing policy file] *************************** 2026-04-28 03:47:49.415343 | orchestrator | Tuesday 28 April 2026 03:47:48 +0000 (0:00:00.330) 0:01:13.442 ********* 2026-04-28 03:47:49.415368 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-28 03:47:49.415381 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 03:47:49.415390 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 03:47:49.415399 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 03:47:49.415407 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 03:47:49.415459 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-28 03:47:49.415496 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:47:49.415519 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 03:47:49.415531 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:47:49.415543 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 03:47:49.415555 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 03:47:49.415565 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 03:47:49.415595 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:47:52.800074 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:47:52.800187 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}})  2026-04-28 03:47:52.800204 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 03:47:52.800215 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 03:47:52.800225 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 03:47:52.800234 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 03:47:52.800261 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:47:52.800270 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:47:52.800278 | orchestrator | 2026-04-28 03:47:52.800302 | orchestrator | TASK [designate : Check designate containers] ********************************** 2026-04-28 03:47:52.800312 | orchestrator | Tuesday 28 April 2026 03:47:49 +0000 (0:00:00.940) 0:01:14.383 ********* 2026-04-28 03:47:52.800324 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-28 03:47:52.800334 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-28 03:47:52.800343 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-api:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001'}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001'}}}}) 2026-04-28 03:47:52.800357 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 03:47:52.800371 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 03:47:54.685149 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 03:47:54.685274 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:54.685293 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:54.685304 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-central:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:54.685340 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:54.685352 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:54.685381 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:54.685399 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:54.685410 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:54.685420 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:54.685430 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:54.685448 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:54.685458 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:47:54.685468 | orchestrator | 2026-04-28 03:47:54.685481 | orchestrator | TASK [designate : include_tasks] *********************************************** 2026-04-28 03:47:54.685492 | orchestrator | Tuesday 28 April 2026 03:47:54 +0000 (0:00:04.827) 0:01:19.211 ********* 2026-04-28 03:47:54.685503 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:47:54.685524 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:49:15.772724 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:49:15.772831 | orchestrator | 2026-04-28 03:49:15.772847 | orchestrator | TASK [designate : Creating Designate databases] ******************************** 2026-04-28 03:49:15.772859 | orchestrator | Tuesday 28 April 2026 03:47:54 +0000 (0:00:00.336) 0:01:19.548 ********* 2026-04-28 03:49:15.772869 | orchestrator | changed: [testbed-node-0] => (item=designate) 2026-04-28 03:49:15.772891 | orchestrator | 2026-04-28 03:49:15.772901 | orchestrator | TASK [designate : Creating Designate databases user and setting permissions] *** 2026-04-28 03:49:15.772911 | orchestrator | Tuesday 28 April 2026 03:47:56 +0000 (0:00:02.146) 0:01:21.694 ********* 2026-04-28 03:49:15.772936 | orchestrator | changed: [testbed-node-0] => (item=None) 2026-04-28 03:49:15.772947 | orchestrator | changed: [testbed-node-0 -> {{ groups['designate-central'][0] }}] 2026-04-28 03:49:15.773012 | orchestrator | 2026-04-28 03:49:15.773031 | orchestrator | TASK [designate : Running Designate bootstrap container] *********************** 2026-04-28 03:49:15.773049 | orchestrator | Tuesday 28 April 2026 03:47:59 +0000 (0:00:02.217) 0:01:23.911 ********* 2026-04-28 03:49:15.773066 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:49:15.773082 | orchestrator | 2026-04-28 03:49:15.773094 | orchestrator | TASK [designate : Flush handlers] ********************************************** 2026-04-28 03:49:15.773103 | orchestrator | Tuesday 28 April 2026 03:48:14 +0000 (0:00:15.690) 0:01:39.602 ********* 2026-04-28 03:49:15.773113 | orchestrator | 2026-04-28 03:49:15.773123 | orchestrator | TASK [designate : Flush handlers] ********************************************** 2026-04-28 03:49:15.773133 | orchestrator | Tuesday 28 April 2026 03:48:14 +0000 (0:00:00.073) 0:01:39.676 ********* 2026-04-28 03:49:15.773143 | orchestrator | 2026-04-28 03:49:15.773153 | orchestrator | TASK [designate : Flush handlers] ********************************************** 2026-04-28 03:49:15.773162 | orchestrator | Tuesday 28 April 2026 03:48:14 +0000 (0:00:00.079) 0:01:39.755 ********* 2026-04-28 03:49:15.773172 | orchestrator | 2026-04-28 03:49:15.773182 | orchestrator | RUNNING HANDLER [designate : Restart designate-backend-bind9 container] ******** 2026-04-28 03:49:15.773212 | orchestrator | Tuesday 28 April 2026 03:48:14 +0000 (0:00:00.086) 0:01:39.842 ********* 2026-04-28 03:49:15.773222 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:49:15.773232 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:49:15.773242 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:49:15.773252 | orchestrator | 2026-04-28 03:49:15.773263 | orchestrator | RUNNING HANDLER [designate : Restart designate-api container] ****************** 2026-04-28 03:49:15.773274 | orchestrator | Tuesday 28 April 2026 03:48:24 +0000 (0:00:09.227) 0:01:49.069 ********* 2026-04-28 03:49:15.773285 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:49:15.773296 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:49:15.773306 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:49:15.773317 | orchestrator | 2026-04-28 03:49:15.773328 | orchestrator | RUNNING HANDLER [designate : Restart designate-central container] ************** 2026-04-28 03:49:15.773339 | orchestrator | Tuesday 28 April 2026 03:48:32 +0000 (0:00:08.793) 0:01:57.863 ********* 2026-04-28 03:49:15.773350 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:49:15.773360 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:49:15.773372 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:49:15.773383 | orchestrator | 2026-04-28 03:49:15.773393 | orchestrator | RUNNING HANDLER [designate : Restart designate-producer container] ************* 2026-04-28 03:49:15.773404 | orchestrator | Tuesday 28 April 2026 03:48:44 +0000 (0:00:11.037) 0:02:08.901 ********* 2026-04-28 03:49:15.773415 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:49:15.773426 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:49:15.773437 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:49:15.773447 | orchestrator | 2026-04-28 03:49:15.773458 | orchestrator | RUNNING HANDLER [designate : Restart designate-mdns container] ***************** 2026-04-28 03:49:15.773469 | orchestrator | Tuesday 28 April 2026 03:48:50 +0000 (0:00:05.988) 0:02:14.889 ********* 2026-04-28 03:49:15.773479 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:49:15.773490 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:49:15.773501 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:49:15.773512 | orchestrator | 2026-04-28 03:49:15.773523 | orchestrator | RUNNING HANDLER [designate : Restart designate-worker container] *************** 2026-04-28 03:49:15.773534 | orchestrator | Tuesday 28 April 2026 03:48:59 +0000 (0:00:09.145) 0:02:24.035 ********* 2026-04-28 03:49:15.773544 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:49:15.773555 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:49:15.773566 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:49:15.773576 | orchestrator | 2026-04-28 03:49:15.773588 | orchestrator | TASK [designate : Non-destructive DNS pools update] **************************** 2026-04-28 03:49:15.773599 | orchestrator | Tuesday 28 April 2026 03:49:08 +0000 (0:00:08.887) 0:02:32.922 ********* 2026-04-28 03:49:15.773610 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:49:15.773624 | orchestrator | 2026-04-28 03:49:15.773640 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 03:49:15.773664 | orchestrator | testbed-node-0 : ok=29  changed=23  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-28 03:49:15.773685 | orchestrator | testbed-node-1 : ok=19  changed=15  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 03:49:15.773701 | orchestrator | testbed-node-2 : ok=19  changed=15  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 03:49:15.773716 | orchestrator | 2026-04-28 03:49:15.773732 | orchestrator | 2026-04-28 03:49:15.773746 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 03:49:15.773761 | orchestrator | Tuesday 28 April 2026 03:49:15 +0000 (0:00:07.246) 0:02:40.169 ********* 2026-04-28 03:49:15.773776 | orchestrator | =============================================================================== 2026-04-28 03:49:15.773792 | orchestrator | designate : Running Designate bootstrap container ---------------------- 15.69s 2026-04-28 03:49:15.773823 | orchestrator | designate : Copying over designate.conf -------------------------------- 15.60s 2026-04-28 03:49:15.773861 | orchestrator | designate : Restart designate-central container ------------------------ 11.04s 2026-04-28 03:49:15.773878 | orchestrator | designate : Restart designate-backend-bind9 container ------------------- 9.23s 2026-04-28 03:49:15.773892 | orchestrator | designate : Restart designate-mdns container ---------------------------- 9.15s 2026-04-28 03:49:15.773902 | orchestrator | designate : Restart designate-worker container -------------------------- 8.89s 2026-04-28 03:49:15.773912 | orchestrator | designate : Restart designate-api container ----------------------------- 8.79s 2026-04-28 03:49:15.773922 | orchestrator | designate : Non-destructive DNS pools update ---------------------------- 7.25s 2026-04-28 03:49:15.773939 | orchestrator | service-ks-register : designate | Creating endpoints -------------------- 6.36s 2026-04-28 03:49:15.773949 | orchestrator | service-cert-copy : designate | Copying over extra CA certificates ------ 6.27s 2026-04-28 03:49:15.773986 | orchestrator | designate : Copying over config.json files for services ----------------- 6.27s 2026-04-28 03:49:15.773998 | orchestrator | designate : Restart designate-producer container ------------------------ 5.99s 2026-04-28 03:49:15.774007 | orchestrator | designate : Check designate containers ---------------------------------- 4.83s 2026-04-28 03:49:15.774142 | orchestrator | designate : Copying over pools.yaml ------------------------------------- 4.02s 2026-04-28 03:49:15.774157 | orchestrator | service-ks-register : designate | Creating users ------------------------ 3.98s 2026-04-28 03:49:15.774166 | orchestrator | service-ks-register : designate | Granting user roles ------------------- 3.90s 2026-04-28 03:49:15.774176 | orchestrator | service-ks-register : designate | Creating services --------------------- 3.47s 2026-04-28 03:49:15.774185 | orchestrator | service-ks-register : designate | Creating roles ------------------------ 3.17s 2026-04-28 03:49:15.774195 | orchestrator | designate : Copying over rndc.conf -------------------------------------- 3.09s 2026-04-28 03:49:15.774204 | orchestrator | service-ks-register : designate | Creating projects --------------------- 3.05s 2026-04-28 03:49:18.312177 | orchestrator | 2026-04-28 03:49:18 | INFO  | Task a6864d49-a024-4d4f-a252-7920abdf07bf (octavia) was prepared for execution. 2026-04-28 03:49:18.312277 | orchestrator | 2026-04-28 03:49:18 | INFO  | It takes a moment until task a6864d49-a024-4d4f-a252-7920abdf07bf (octavia) has been started and output is visible here. 2026-04-28 03:51:24.488027 | orchestrator | 2026-04-28 03:51:24.488127 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 03:51:24.488147 | orchestrator | 2026-04-28 03:51:24.488165 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 03:51:24.488181 | orchestrator | Tuesday 28 April 2026 03:49:22 +0000 (0:00:00.292) 0:00:00.292 ********* 2026-04-28 03:51:24.488197 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:51:24.488215 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:51:24.488233 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:51:24.488250 | orchestrator | 2026-04-28 03:51:24.488268 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 03:51:24.488278 | orchestrator | Tuesday 28 April 2026 03:49:23 +0000 (0:00:00.328) 0:00:00.620 ********* 2026-04-28 03:51:24.488288 | orchestrator | ok: [testbed-node-0] => (item=enable_octavia_True) 2026-04-28 03:51:24.488299 | orchestrator | ok: [testbed-node-1] => (item=enable_octavia_True) 2026-04-28 03:51:24.488308 | orchestrator | ok: [testbed-node-2] => (item=enable_octavia_True) 2026-04-28 03:51:24.488318 | orchestrator | 2026-04-28 03:51:24.488328 | orchestrator | PLAY [Apply role octavia] ****************************************************** 2026-04-28 03:51:24.488337 | orchestrator | 2026-04-28 03:51:24.488348 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-28 03:51:24.488358 | orchestrator | Tuesday 28 April 2026 03:49:23 +0000 (0:00:00.462) 0:00:01.083 ********* 2026-04-28 03:51:24.488368 | orchestrator | included: /ansible/roles/octavia/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:51:24.488379 | orchestrator | 2026-04-28 03:51:24.488414 | orchestrator | TASK [service-ks-register : octavia | Creating services] *********************** 2026-04-28 03:51:24.488424 | orchestrator | Tuesday 28 April 2026 03:49:24 +0000 (0:00:00.618) 0:00:01.701 ********* 2026-04-28 03:51:24.488435 | orchestrator | changed: [testbed-node-0] => (item=octavia (load-balancer)) 2026-04-28 03:51:24.488444 | orchestrator | 2026-04-28 03:51:24.488454 | orchestrator | TASK [service-ks-register : octavia | Creating endpoints] ********************** 2026-04-28 03:51:24.488464 | orchestrator | Tuesday 28 April 2026 03:49:27 +0000 (0:00:03.360) 0:00:05.062 ********* 2026-04-28 03:51:24.488473 | orchestrator | changed: [testbed-node-0] => (item=octavia -> https://api-int.testbed.osism.xyz:9876 -> internal) 2026-04-28 03:51:24.488483 | orchestrator | changed: [testbed-node-0] => (item=octavia -> https://api.testbed.osism.xyz:9876 -> public) 2026-04-28 03:51:24.488493 | orchestrator | 2026-04-28 03:51:24.488503 | orchestrator | TASK [service-ks-register : octavia | Creating projects] *********************** 2026-04-28 03:51:24.488512 | orchestrator | Tuesday 28 April 2026 03:49:33 +0000 (0:00:06.282) 0:00:11.345 ********* 2026-04-28 03:51:24.488522 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-28 03:51:24.488532 | orchestrator | 2026-04-28 03:51:24.488542 | orchestrator | TASK [service-ks-register : octavia | Creating users] ************************** 2026-04-28 03:51:24.488553 | orchestrator | Tuesday 28 April 2026 03:49:37 +0000 (0:00:03.257) 0:00:14.602 ********* 2026-04-28 03:51:24.488564 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-28 03:51:24.488575 | orchestrator | changed: [testbed-node-0] => (item=octavia -> service) 2026-04-28 03:51:24.488585 | orchestrator | changed: [testbed-node-0] => (item=octavia -> service) 2026-04-28 03:51:24.488597 | orchestrator | 2026-04-28 03:51:24.488608 | orchestrator | TASK [service-ks-register : octavia | Creating roles] ************************** 2026-04-28 03:51:24.488619 | orchestrator | Tuesday 28 April 2026 03:49:45 +0000 (0:00:08.410) 0:00:23.013 ********* 2026-04-28 03:51:24.488630 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-28 03:51:24.488641 | orchestrator | 2026-04-28 03:51:24.488652 | orchestrator | TASK [service-ks-register : octavia | Granting user roles] ********************* 2026-04-28 03:51:24.488662 | orchestrator | Tuesday 28 April 2026 03:49:48 +0000 (0:00:03.166) 0:00:26.179 ********* 2026-04-28 03:51:24.488673 | orchestrator | changed: [testbed-node-0] => (item=octavia -> service -> admin) 2026-04-28 03:51:24.488683 | orchestrator | ok: [testbed-node-0] => (item=octavia -> service -> admin) 2026-04-28 03:51:24.488694 | orchestrator | 2026-04-28 03:51:24.488705 | orchestrator | TASK [octavia : Adding octavia related roles] ********************************** 2026-04-28 03:51:24.488728 | orchestrator | Tuesday 28 April 2026 03:49:55 +0000 (0:00:07.008) 0:00:33.188 ********* 2026-04-28 03:51:24.488740 | orchestrator | changed: [testbed-node-0] => (item=load-balancer_observer) 2026-04-28 03:51:24.488750 | orchestrator | changed: [testbed-node-0] => (item=load-balancer_global_observer) 2026-04-28 03:51:24.488761 | orchestrator | changed: [testbed-node-0] => (item=load-balancer_member) 2026-04-28 03:51:24.488772 | orchestrator | changed: [testbed-node-0] => (item=load-balancer_admin) 2026-04-28 03:51:24.488783 | orchestrator | changed: [testbed-node-0] => (item=load-balancer_quota_admin) 2026-04-28 03:51:24.488794 | orchestrator | 2026-04-28 03:51:24.488805 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-28 03:51:24.488816 | orchestrator | Tuesday 28 April 2026 03:50:11 +0000 (0:00:15.384) 0:00:48.573 ********* 2026-04-28 03:51:24.488826 | orchestrator | included: /ansible/roles/octavia/tasks/prepare.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:51:24.488837 | orchestrator | 2026-04-28 03:51:24.488848 | orchestrator | TASK [octavia : Create amphora flavor] ***************************************** 2026-04-28 03:51:24.488859 | orchestrator | Tuesday 28 April 2026 03:50:11 +0000 (0:00:00.816) 0:00:49.390 ********* 2026-04-28 03:51:24.488870 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:51:24.488881 | orchestrator | 2026-04-28 03:51:24.488892 | orchestrator | TASK [octavia : Create nova keypair for amphora] ******************************* 2026-04-28 03:51:24.488912 | orchestrator | Tuesday 28 April 2026 03:50:16 +0000 (0:00:04.765) 0:00:54.155 ********* 2026-04-28 03:51:24.488922 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:51:24.488931 | orchestrator | 2026-04-28 03:51:24.488941 | orchestrator | TASK [octavia : Get service project id] **************************************** 2026-04-28 03:51:24.489035 | orchestrator | Tuesday 28 April 2026 03:50:20 +0000 (0:00:04.074) 0:00:58.230 ********* 2026-04-28 03:51:24.489047 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:51:24.489057 | orchestrator | 2026-04-28 03:51:24.489066 | orchestrator | TASK [octavia : Create security groups for octavia] **************************** 2026-04-28 03:51:24.489076 | orchestrator | Tuesday 28 April 2026 03:50:23 +0000 (0:00:03.138) 0:01:01.368 ********* 2026-04-28 03:51:24.489085 | orchestrator | changed: [testbed-node-0] => (item=lb-mgmt-sec-grp) 2026-04-28 03:51:24.489095 | orchestrator | changed: [testbed-node-0] => (item=lb-health-mgr-sec-grp) 2026-04-28 03:51:24.489104 | orchestrator | 2026-04-28 03:51:24.489114 | orchestrator | TASK [octavia : Add rules for security groups] ********************************* 2026-04-28 03:51:24.489123 | orchestrator | Tuesday 28 April 2026 03:50:34 +0000 (0:00:10.258) 0:01:11.627 ********* 2026-04-28 03:51:24.489134 | orchestrator | changed: [testbed-node-0] => (item=[{'name': 'lb-mgmt-sec-grp', 'enabled': True}, {'protocol': 'icmp'}]) 2026-04-28 03:51:24.489151 | orchestrator | changed: [testbed-node-0] => (item=[{'name': 'lb-mgmt-sec-grp', 'enabled': True}, {'protocol': 'tcp', 'src_port': 22, 'dst_port': 22}]) 2026-04-28 03:51:24.489168 | orchestrator | changed: [testbed-node-0] => (item=[{'name': 'lb-mgmt-sec-grp', 'enabled': True}, {'protocol': 'tcp', 'src_port': '9443', 'dst_port': '9443'}]) 2026-04-28 03:51:24.489185 | orchestrator | changed: [testbed-node-0] => (item=[{'name': 'lb-health-mgr-sec-grp', 'enabled': True}, {'protocol': 'udp', 'src_port': '5555', 'dst_port': '5555'}]) 2026-04-28 03:51:24.489202 | orchestrator | 2026-04-28 03:51:24.489220 | orchestrator | TASK [octavia : Create loadbalancer management network] ************************ 2026-04-28 03:51:24.489236 | orchestrator | Tuesday 28 April 2026 03:50:49 +0000 (0:00:15.620) 0:01:27.247 ********* 2026-04-28 03:51:24.489249 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:51:24.489258 | orchestrator | 2026-04-28 03:51:24.489271 | orchestrator | TASK [octavia : Create loadbalancer management subnet] ************************* 2026-04-28 03:51:24.489281 | orchestrator | Tuesday 28 April 2026 03:50:54 +0000 (0:00:04.533) 0:01:31.781 ********* 2026-04-28 03:51:24.489291 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:51:24.489300 | orchestrator | 2026-04-28 03:51:24.489310 | orchestrator | TASK [octavia : Create loadbalancer management router for IPv6] **************** 2026-04-28 03:51:24.489319 | orchestrator | Tuesday 28 April 2026 03:50:59 +0000 (0:00:05.359) 0:01:37.140 ********* 2026-04-28 03:51:24.489329 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:51:24.489338 | orchestrator | 2026-04-28 03:51:24.489348 | orchestrator | TASK [octavia : Update loadbalancer management subnet] ************************* 2026-04-28 03:51:24.489357 | orchestrator | Tuesday 28 April 2026 03:50:59 +0000 (0:00:00.234) 0:01:37.375 ********* 2026-04-28 03:51:24.489367 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:51:24.489377 | orchestrator | 2026-04-28 03:51:24.489386 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-28 03:51:24.489396 | orchestrator | Tuesday 28 April 2026 03:51:04 +0000 (0:00:04.543) 0:01:41.918 ********* 2026-04-28 03:51:24.489406 | orchestrator | included: /ansible/roles/octavia/tasks/hm-interface.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:51:24.489415 | orchestrator | 2026-04-28 03:51:24.489425 | orchestrator | TASK [octavia : Create ports for Octavia health-manager nodes] ***************** 2026-04-28 03:51:24.489435 | orchestrator | Tuesday 28 April 2026 03:51:05 +0000 (0:00:01.319) 0:01:43.237 ********* 2026-04-28 03:51:24.489444 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:51:24.489454 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:51:24.489463 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:51:24.489473 | orchestrator | 2026-04-28 03:51:24.489482 | orchestrator | TASK [octavia : Update Octavia health manager port host_id] ******************** 2026-04-28 03:51:24.489501 | orchestrator | Tuesday 28 April 2026 03:51:11 +0000 (0:00:05.386) 0:01:48.624 ********* 2026-04-28 03:51:24.489510 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:51:24.489520 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:51:24.489530 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:51:24.489539 | orchestrator | 2026-04-28 03:51:24.489549 | orchestrator | TASK [octavia : Add Octavia port to openvswitch br-int] ************************ 2026-04-28 03:51:24.489565 | orchestrator | Tuesday 28 April 2026 03:51:16 +0000 (0:00:05.478) 0:01:54.102 ********* 2026-04-28 03:51:24.489575 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:51:24.489584 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:51:24.489594 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:51:24.489603 | orchestrator | 2026-04-28 03:51:24.489613 | orchestrator | TASK [octavia : Install isc-dhcp-client package] ******************************* 2026-04-28 03:51:24.489623 | orchestrator | Tuesday 28 April 2026 03:51:17 +0000 (0:00:01.148) 0:01:55.251 ********* 2026-04-28 03:51:24.489632 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:51:24.489642 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:51:24.489651 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:51:24.489661 | orchestrator | 2026-04-28 03:51:24.489671 | orchestrator | TASK [octavia : Create octavia dhclient conf] ********************************** 2026-04-28 03:51:24.489681 | orchestrator | Tuesday 28 April 2026 03:51:19 +0000 (0:00:01.831) 0:01:57.083 ********* 2026-04-28 03:51:24.489690 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:51:24.489700 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:51:24.489709 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:51:24.489719 | orchestrator | 2026-04-28 03:51:24.489729 | orchestrator | TASK [octavia : Create octavia-interface service] ****************************** 2026-04-28 03:51:24.489738 | orchestrator | Tuesday 28 April 2026 03:51:20 +0000 (0:00:01.228) 0:01:58.311 ********* 2026-04-28 03:51:24.489748 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:51:24.489758 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:51:24.489767 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:51:24.489777 | orchestrator | 2026-04-28 03:51:24.489786 | orchestrator | TASK [octavia : Restart octavia-interface.service if required] ***************** 2026-04-28 03:51:24.489796 | orchestrator | Tuesday 28 April 2026 03:51:22 +0000 (0:00:01.248) 0:01:59.560 ********* 2026-04-28 03:51:24.489805 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:51:24.489815 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:51:24.489824 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:51:24.489834 | orchestrator | 2026-04-28 03:51:24.489850 | orchestrator | TASK [octavia : Enable and start octavia-interface.service] ******************** 2026-04-28 03:51:50.484754 | orchestrator | Tuesday 28 April 2026 03:51:24 +0000 (0:00:02.326) 0:02:01.886 ********* 2026-04-28 03:51:50.484863 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:51:50.484878 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:51:50.484887 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:51:50.484894 | orchestrator | 2026-04-28 03:51:50.484903 | orchestrator | TASK [octavia : Wait for interface ohm0 ip appear] ***************************** 2026-04-28 03:51:50.484911 | orchestrator | Tuesday 28 April 2026 03:51:26 +0000 (0:00:01.632) 0:02:03.518 ********* 2026-04-28 03:51:50.484920 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:51:50.484928 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:51:50.484936 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:51:50.484943 | orchestrator | 2026-04-28 03:51:50.485004 | orchestrator | TASK [octavia : Gather facts] ************************************************** 2026-04-28 03:51:50.485013 | orchestrator | Tuesday 28 April 2026 03:51:26 +0000 (0:00:00.685) 0:02:04.204 ********* 2026-04-28 03:51:50.485022 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:51:50.485029 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:51:50.485036 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:51:50.485043 | orchestrator | 2026-04-28 03:51:50.485051 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-28 03:51:50.485058 | orchestrator | Tuesday 28 April 2026 03:51:29 +0000 (0:00:03.088) 0:02:07.292 ********* 2026-04-28 03:51:50.485091 | orchestrator | included: /ansible/roles/octavia/tasks/get_resources_info.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:51:50.485100 | orchestrator | 2026-04-28 03:51:50.485108 | orchestrator | TASK [octavia : Get amphora flavor info] *************************************** 2026-04-28 03:51:50.485116 | orchestrator | Tuesday 28 April 2026 03:51:30 +0000 (0:00:00.613) 0:02:07.906 ********* 2026-04-28 03:51:50.485123 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:51:50.485130 | orchestrator | 2026-04-28 03:51:50.485138 | orchestrator | TASK [octavia : Get service project id] **************************************** 2026-04-28 03:51:50.485145 | orchestrator | Tuesday 28 April 2026 03:51:33 +0000 (0:00:03.457) 0:02:11.363 ********* 2026-04-28 03:51:50.485152 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:51:50.485160 | orchestrator | 2026-04-28 03:51:50.485169 | orchestrator | TASK [octavia : Get security groups for octavia] ******************************* 2026-04-28 03:51:50.485177 | orchestrator | Tuesday 28 April 2026 03:51:37 +0000 (0:00:03.191) 0:02:14.554 ********* 2026-04-28 03:51:50.485185 | orchestrator | ok: [testbed-node-0] => (item=lb-mgmt-sec-grp) 2026-04-28 03:51:50.485194 | orchestrator | ok: [testbed-node-0] => (item=lb-health-mgr-sec-grp) 2026-04-28 03:51:50.485201 | orchestrator | 2026-04-28 03:51:50.485209 | orchestrator | TASK [octavia : Get loadbalancer management network] *************************** 2026-04-28 03:51:50.485217 | orchestrator | Tuesday 28 April 2026 03:51:44 +0000 (0:00:07.198) 0:02:21.752 ********* 2026-04-28 03:51:50.485224 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:51:50.485232 | orchestrator | 2026-04-28 03:51:50.485240 | orchestrator | TASK [octavia : Set octavia resources facts] *********************************** 2026-04-28 03:51:50.485247 | orchestrator | Tuesday 28 April 2026 03:51:47 +0000 (0:00:03.429) 0:02:25.182 ********* 2026-04-28 03:51:50.485253 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:51:50.485260 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:51:50.485267 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:51:50.485274 | orchestrator | 2026-04-28 03:51:50.485281 | orchestrator | TASK [octavia : Ensuring config directories exist] ***************************** 2026-04-28 03:51:50.485289 | orchestrator | Tuesday 28 April 2026 03:51:48 +0000 (0:00:00.549) 0:02:25.731 ********* 2026-04-28 03:51:50.485316 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 03:51:50.485350 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 03:51:50.485367 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 03:51:50.485376 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 03:51:50.485386 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 03:51:50.485394 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 03:51:50.485408 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 03:51:50.485418 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 03:51:50.485433 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 03:51:52.034067 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 03:51:52.034136 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 03:51:52.034144 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 03:51:52.034161 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:51:52.034166 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:51:52.034171 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:51:52.034195 | orchestrator | 2026-04-28 03:51:52.034201 | orchestrator | TASK [octavia : Check if policies shall be overwritten] ************************ 2026-04-28 03:51:52.034206 | orchestrator | Tuesday 28 April 2026 03:51:50 +0000 (0:00:02.616) 0:02:28.347 ********* 2026-04-28 03:51:52.034210 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:51:52.034215 | orchestrator | 2026-04-28 03:51:52.034219 | orchestrator | TASK [octavia : Set octavia policy file] *************************************** 2026-04-28 03:51:52.034223 | orchestrator | Tuesday 28 April 2026 03:51:51 +0000 (0:00:00.139) 0:02:28.486 ********* 2026-04-28 03:51:52.034227 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:51:52.034238 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:51:52.034243 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:51:52.034247 | orchestrator | 2026-04-28 03:51:52.034250 | orchestrator | TASK [octavia : Copying over existing policy file] ***************************** 2026-04-28 03:51:52.034254 | orchestrator | Tuesday 28 April 2026 03:51:51 +0000 (0:00:00.328) 0:02:28.815 ********* 2026-04-28 03:51:52.034260 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 03:51:52.034265 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 03:51:52.034271 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 03:51:52.034278 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 03:51:52.034287 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:51:52.034291 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:51:52.034300 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 03:51:57.218442 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 03:51:57.218520 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 03:51:57.218530 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 03:51:57.218550 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:51:57.218569 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:51:57.218577 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 03:51:57.218583 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 03:51:57.218599 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 03:51:57.218605 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 03:51:57.218610 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:51:57.218615 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:51:57.218620 | orchestrator | 2026-04-28 03:51:57.218626 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-28 03:51:57.218632 | orchestrator | Tuesday 28 April 2026 03:51:52 +0000 (0:00:00.727) 0:02:29.543 ********* 2026-04-28 03:51:57.218645 | orchestrator | included: /ansible/roles/octavia/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:51:57.218650 | orchestrator | 2026-04-28 03:51:57.218655 | orchestrator | TASK [service-cert-copy : octavia | Copying over extra CA certificates] ******** 2026-04-28 03:51:57.218660 | orchestrator | Tuesday 28 April 2026 03:51:52 +0000 (0:00:00.839) 0:02:30.383 ********* 2026-04-28 03:51:57.218665 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 03:51:57.218672 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 03:51:57.218682 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 03:51:58.890905 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 03:51:58.891138 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 03:51:58.891186 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 03:51:58.891201 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 03:51:58.891214 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 03:51:58.891225 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 03:51:58.891257 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 03:51:58.891269 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 03:51:58.891294 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 03:51:58.891307 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:51:58.891319 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:51:58.891330 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:51:58.891342 | orchestrator | 2026-04-28 03:51:58.891355 | orchestrator | TASK [service-cert-copy : octavia | Copying over backend internal TLS certificate] *** 2026-04-28 03:51:58.891368 | orchestrator | Tuesday 28 April 2026 03:51:58 +0000 (0:00:05.298) 0:02:35.682 ********* 2026-04-28 03:51:58.891390 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 03:51:59.016786 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 03:51:59.017017 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 03:51:59.017037 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 03:51:59.017053 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:51:59.017066 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:51:59.017081 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 03:51:59.017094 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 03:51:59.017126 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 03:51:59.017158 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 03:51:59.017170 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:51:59.017181 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:51:59.017193 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 03:51:59.017205 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 03:51:59.017229 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 03:51:59.017251 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 03:51:59.856459 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:51:59.856571 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:51:59.856589 | orchestrator | 2026-04-28 03:51:59.856602 | orchestrator | TASK [service-cert-copy : octavia | Copying over backend internal TLS key] ***** 2026-04-28 03:51:59.856615 | orchestrator | Tuesday 28 April 2026 03:51:59 +0000 (0:00:00.744) 0:02:36.426 ********* 2026-04-28 03:51:59.856628 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 03:51:59.856641 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 03:51:59.856655 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 03:51:59.856667 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 03:51:59.856721 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:51:59.856734 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:51:59.856753 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 03:51:59.856765 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 03:51:59.856782 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 03:51:59.856802 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 03:51:59.856821 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:51:59.856850 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:51:59.856879 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 03:52:04.774556 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 03:52:04.774654 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 03:52:04.774669 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 03:52:04.774680 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 03:52:04.774690 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:52:04.774701 | orchestrator | 2026-04-28 03:52:04.774712 | orchestrator | TASK [octavia : Copying over config.json files for services] ******************* 2026-04-28 03:52:04.774742 | orchestrator | Tuesday 28 April 2026 03:52:00 +0000 (0:00:01.369) 0:02:37.796 ********* 2026-04-28 03:52:04.774753 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 03:52:04.774783 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 03:52:04.774794 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 03:52:04.774803 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 03:52:04.774813 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 03:52:04.774855 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 03:52:04.774865 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 03:52:04.774880 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 03:52:22.029662 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 03:52:22.029778 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 03:52:22.029803 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 03:52:22.029830 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 03:52:22.029876 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:52:22.029894 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:52:22.029945 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:52:22.030118 | orchestrator | 2026-04-28 03:52:22.030171 | orchestrator | TASK [octavia : Copying over octavia-wsgi.conf] ******************************** 2026-04-28 03:52:22.030186 | orchestrator | Tuesday 28 April 2026 03:52:05 +0000 (0:00:05.450) 0:02:43.246 ********* 2026-04-28 03:52:22.030198 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/octavia/templates/octavia-wsgi.conf.j2) 2026-04-28 03:52:22.030210 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/octavia/templates/octavia-wsgi.conf.j2) 2026-04-28 03:52:22.030222 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/octavia/templates/octavia-wsgi.conf.j2) 2026-04-28 03:52:22.030233 | orchestrator | 2026-04-28 03:52:22.030245 | orchestrator | TASK [octavia : Copying over octavia.conf] ************************************* 2026-04-28 03:52:22.030255 | orchestrator | Tuesday 28 April 2026 03:52:07 +0000 (0:00:01.732) 0:02:44.979 ********* 2026-04-28 03:52:22.030268 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 03:52:22.030295 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 03:52:22.030314 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 03:52:22.030345 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 03:52:38.475663 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 03:52:38.475771 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 03:52:38.475789 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 03:52:38.475836 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 03:52:38.475866 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 03:52:38.475884 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 03:52:38.475931 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 03:52:38.476043 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 03:52:38.476063 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:52:38.476092 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:52:38.476109 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:52:38.476127 | orchestrator | 2026-04-28 03:52:38.476145 | orchestrator | TASK [octavia : Copying over Octavia SSH key] ********************************** 2026-04-28 03:52:38.476163 | orchestrator | Tuesday 28 April 2026 03:52:25 +0000 (0:00:18.283) 0:03:03.263 ********* 2026-04-28 03:52:38.476178 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:52:38.476191 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:52:38.476202 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:52:38.476213 | orchestrator | 2026-04-28 03:52:38.476225 | orchestrator | TASK [octavia : Copying certificate files for octavia-worker] ****************** 2026-04-28 03:52:38.476237 | orchestrator | Tuesday 28 April 2026 03:52:27 +0000 (0:00:01.878) 0:03:05.141 ********* 2026-04-28 03:52:38.476248 | orchestrator | changed: [testbed-node-0] => (item=client.cert-and-key.pem) 2026-04-28 03:52:38.476259 | orchestrator | changed: [testbed-node-1] => (item=client.cert-and-key.pem) 2026-04-28 03:52:38.476270 | orchestrator | changed: [testbed-node-2] => (item=client.cert-and-key.pem) 2026-04-28 03:52:38.476281 | orchestrator | changed: [testbed-node-0] => (item=client_ca.cert.pem) 2026-04-28 03:52:38.476292 | orchestrator | changed: [testbed-node-1] => (item=client_ca.cert.pem) 2026-04-28 03:52:38.476303 | orchestrator | changed: [testbed-node-2] => (item=client_ca.cert.pem) 2026-04-28 03:52:38.476313 | orchestrator | changed: [testbed-node-0] => (item=server_ca.cert.pem) 2026-04-28 03:52:38.476324 | orchestrator | changed: [testbed-node-1] => (item=server_ca.cert.pem) 2026-04-28 03:52:38.476335 | orchestrator | changed: [testbed-node-2] => (item=server_ca.cert.pem) 2026-04-28 03:52:38.476346 | orchestrator | changed: [testbed-node-0] => (item=server_ca.key.pem) 2026-04-28 03:52:38.476356 | orchestrator | changed: [testbed-node-1] => (item=server_ca.key.pem) 2026-04-28 03:52:38.476367 | orchestrator | changed: [testbed-node-2] => (item=server_ca.key.pem) 2026-04-28 03:52:38.476379 | orchestrator | 2026-04-28 03:52:38.476390 | orchestrator | TASK [octavia : Copying certificate files for octavia-housekeeping] ************ 2026-04-28 03:52:38.476401 | orchestrator | Tuesday 28 April 2026 03:52:32 +0000 (0:00:05.109) 0:03:10.250 ********* 2026-04-28 03:52:38.476412 | orchestrator | changed: [testbed-node-0] => (item=client.cert-and-key.pem) 2026-04-28 03:52:38.476423 | orchestrator | changed: [testbed-node-1] => (item=client.cert-and-key.pem) 2026-04-28 03:52:38.476444 | orchestrator | changed: [testbed-node-2] => (item=client.cert-and-key.pem) 2026-04-28 03:52:47.892900 | orchestrator | changed: [testbed-node-0] => (item=client_ca.cert.pem) 2026-04-28 03:52:47.893059 | orchestrator | changed: [testbed-node-1] => (item=client_ca.cert.pem) 2026-04-28 03:52:47.893070 | orchestrator | changed: [testbed-node-2] => (item=client_ca.cert.pem) 2026-04-28 03:52:47.893077 | orchestrator | changed: [testbed-node-0] => (item=server_ca.cert.pem) 2026-04-28 03:52:47.893101 | orchestrator | changed: [testbed-node-1] => (item=server_ca.cert.pem) 2026-04-28 03:52:47.893108 | orchestrator | changed: [testbed-node-2] => (item=server_ca.cert.pem) 2026-04-28 03:52:47.893115 | orchestrator | changed: [testbed-node-0] => (item=server_ca.key.pem) 2026-04-28 03:52:47.893121 | orchestrator | changed: [testbed-node-1] => (item=server_ca.key.pem) 2026-04-28 03:52:47.893128 | orchestrator | changed: [testbed-node-2] => (item=server_ca.key.pem) 2026-04-28 03:52:47.893134 | orchestrator | 2026-04-28 03:52:47.893142 | orchestrator | TASK [octavia : Copying certificate files for octavia-health-manager] ********** 2026-04-28 03:52:47.893150 | orchestrator | Tuesday 28 April 2026 03:52:38 +0000 (0:00:05.630) 0:03:15.881 ********* 2026-04-28 03:52:47.893156 | orchestrator | changed: [testbed-node-0] => (item=client.cert-and-key.pem) 2026-04-28 03:52:47.893163 | orchestrator | changed: [testbed-node-1] => (item=client.cert-and-key.pem) 2026-04-28 03:52:47.893170 | orchestrator | changed: [testbed-node-2] => (item=client.cert-and-key.pem) 2026-04-28 03:52:47.893176 | orchestrator | changed: [testbed-node-0] => (item=client_ca.cert.pem) 2026-04-28 03:52:47.893183 | orchestrator | changed: [testbed-node-1] => (item=client_ca.cert.pem) 2026-04-28 03:52:47.893189 | orchestrator | changed: [testbed-node-2] => (item=client_ca.cert.pem) 2026-04-28 03:52:47.893196 | orchestrator | changed: [testbed-node-0] => (item=server_ca.cert.pem) 2026-04-28 03:52:47.893202 | orchestrator | changed: [testbed-node-1] => (item=server_ca.cert.pem) 2026-04-28 03:52:47.893209 | orchestrator | changed: [testbed-node-2] => (item=server_ca.cert.pem) 2026-04-28 03:52:47.893215 | orchestrator | changed: [testbed-node-0] => (item=server_ca.key.pem) 2026-04-28 03:52:47.893222 | orchestrator | changed: [testbed-node-1] => (item=server_ca.key.pem) 2026-04-28 03:52:47.893228 | orchestrator | changed: [testbed-node-2] => (item=server_ca.key.pem) 2026-04-28 03:52:47.893235 | orchestrator | 2026-04-28 03:52:47.893242 | orchestrator | TASK [octavia : Check octavia containers] ************************************** 2026-04-28 03:52:47.893248 | orchestrator | Tuesday 28 April 2026 03:52:44 +0000 (0:00:05.823) 0:03:21.705 ********* 2026-04-28 03:52:47.893259 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 03:52:47.893269 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 03:52:47.893308 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 03:52:47.893317 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 03:52:47.893326 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 03:52:47.893333 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 03:52:47.893341 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 03:52:47.893350 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 03:52:47.893357 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 03:52:47.893376 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 03:54:15.814248 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 03:54:15.814367 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 03:54:15.814385 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:54:15.814398 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:54:15.814415 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 03:54:15.814466 | orchestrator | 2026-04-28 03:54:15.814490 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-28 03:54:15.814510 | orchestrator | Tuesday 28 April 2026 03:52:48 +0000 (0:00:04.262) 0:03:25.967 ********* 2026-04-28 03:54:15.814528 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:54:15.814545 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:54:15.814566 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:54:15.814582 | orchestrator | 2026-04-28 03:54:15.814601 | orchestrator | TASK [octavia : Creating Octavia database] ************************************* 2026-04-28 03:54:15.814618 | orchestrator | Tuesday 28 April 2026 03:52:49 +0000 (0:00:00.573) 0:03:26.540 ********* 2026-04-28 03:54:15.814637 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:54:15.814657 | orchestrator | 2026-04-28 03:54:15.814675 | orchestrator | TASK [octavia : Creating Octavia persistence database] ************************* 2026-04-28 03:54:15.814713 | orchestrator | Tuesday 28 April 2026 03:52:51 +0000 (0:00:02.322) 0:03:28.863 ********* 2026-04-28 03:54:15.814732 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:54:15.814746 | orchestrator | 2026-04-28 03:54:15.814764 | orchestrator | TASK [octavia : Creating Octavia database user and setting permissions] ******** 2026-04-28 03:54:15.814782 | orchestrator | Tuesday 28 April 2026 03:52:53 +0000 (0:00:02.129) 0:03:30.992 ********* 2026-04-28 03:54:15.814801 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:54:15.814819 | orchestrator | 2026-04-28 03:54:15.814836 | orchestrator | TASK [octavia : Creating Octavia persistence database user and setting permissions] *** 2026-04-28 03:54:15.814855 | orchestrator | Tuesday 28 April 2026 03:52:55 +0000 (0:00:02.245) 0:03:33.237 ********* 2026-04-28 03:54:15.814898 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:54:15.814921 | orchestrator | 2026-04-28 03:54:15.814969 | orchestrator | TASK [octavia : Running Octavia bootstrap container] *************************** 2026-04-28 03:54:15.814989 | orchestrator | Tuesday 28 April 2026 03:52:58 +0000 (0:00:02.307) 0:03:35.544 ********* 2026-04-28 03:54:15.815010 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:54:15.815028 | orchestrator | 2026-04-28 03:54:15.815048 | orchestrator | TASK [octavia : Flush handlers] ************************************************ 2026-04-28 03:54:15.815067 | orchestrator | Tuesday 28 April 2026 03:53:20 +0000 (0:00:22.253) 0:03:57.798 ********* 2026-04-28 03:54:15.815086 | orchestrator | 2026-04-28 03:54:15.815103 | orchestrator | TASK [octavia : Flush handlers] ************************************************ 2026-04-28 03:54:15.815121 | orchestrator | Tuesday 28 April 2026 03:53:20 +0000 (0:00:00.070) 0:03:57.869 ********* 2026-04-28 03:54:15.815139 | orchestrator | 2026-04-28 03:54:15.815158 | orchestrator | TASK [octavia : Flush handlers] ************************************************ 2026-04-28 03:54:15.815178 | orchestrator | Tuesday 28 April 2026 03:53:20 +0000 (0:00:00.074) 0:03:57.943 ********* 2026-04-28 03:54:15.815197 | orchestrator | 2026-04-28 03:54:15.815215 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-api container] ********************** 2026-04-28 03:54:15.815236 | orchestrator | Tuesday 28 April 2026 03:53:20 +0000 (0:00:00.074) 0:03:58.017 ********* 2026-04-28 03:54:15.815254 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:54:15.815273 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:54:15.815293 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:54:15.815312 | orchestrator | 2026-04-28 03:54:15.815332 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-driver-agent container] ************* 2026-04-28 03:54:15.815352 | orchestrator | Tuesday 28 April 2026 03:53:38 +0000 (0:00:17.803) 0:04:15.820 ********* 2026-04-28 03:54:15.815369 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:54:15.815390 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:54:15.815408 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:54:15.815427 | orchestrator | 2026-04-28 03:54:15.815446 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-health-manager container] *********** 2026-04-28 03:54:15.815482 | orchestrator | Tuesday 28 April 2026 03:53:50 +0000 (0:00:11.727) 0:04:27.548 ********* 2026-04-28 03:54:15.815495 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:54:15.815506 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:54:15.815517 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:54:15.815527 | orchestrator | 2026-04-28 03:54:15.815538 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-housekeeping container] ************* 2026-04-28 03:54:15.815549 | orchestrator | Tuesday 28 April 2026 03:53:58 +0000 (0:00:08.311) 0:04:35.859 ********* 2026-04-28 03:54:15.815560 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:54:15.815571 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:54:15.815581 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:54:15.815592 | orchestrator | 2026-04-28 03:54:15.815810 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-worker container] ******************* 2026-04-28 03:54:15.815828 | orchestrator | Tuesday 28 April 2026 03:54:06 +0000 (0:00:08.548) 0:04:44.408 ********* 2026-04-28 03:54:15.815839 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:54:15.815850 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:54:15.815861 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:54:15.815872 | orchestrator | 2026-04-28 03:54:15.815883 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 03:54:15.815895 | orchestrator | testbed-node-0 : ok=57  changed=38  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-28 03:54:15.815908 | orchestrator | testbed-node-1 : ok=33  changed=22  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 03:54:15.815919 | orchestrator | testbed-node-2 : ok=33  changed=22  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 03:54:15.815930 | orchestrator | 2026-04-28 03:54:15.816036 | orchestrator | 2026-04-28 03:54:15.816055 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 03:54:15.816069 | orchestrator | Tuesday 28 April 2026 03:54:15 +0000 (0:00:08.795) 0:04:53.204 ********* 2026-04-28 03:54:15.816081 | orchestrator | =============================================================================== 2026-04-28 03:54:15.816092 | orchestrator | octavia : Running Octavia bootstrap container -------------------------- 22.25s 2026-04-28 03:54:15.816102 | orchestrator | octavia : Copying over octavia.conf ------------------------------------ 18.28s 2026-04-28 03:54:15.816113 | orchestrator | octavia : Restart octavia-api container -------------------------------- 17.80s 2026-04-28 03:54:15.816124 | orchestrator | octavia : Add rules for security groups -------------------------------- 15.62s 2026-04-28 03:54:15.816134 | orchestrator | octavia : Adding octavia related roles --------------------------------- 15.39s 2026-04-28 03:54:15.816145 | orchestrator | octavia : Restart octavia-driver-agent container ----------------------- 11.73s 2026-04-28 03:54:15.816156 | orchestrator | octavia : Create security groups for octavia --------------------------- 10.26s 2026-04-28 03:54:15.816166 | orchestrator | octavia : Restart octavia-worker container ------------------------------ 8.80s 2026-04-28 03:54:15.816177 | orchestrator | octavia : Restart octavia-housekeeping container ------------------------ 8.55s 2026-04-28 03:54:15.816201 | orchestrator | service-ks-register : octavia | Creating users -------------------------- 8.41s 2026-04-28 03:54:15.816212 | orchestrator | octavia : Restart octavia-health-manager container ---------------------- 8.31s 2026-04-28 03:54:15.816223 | orchestrator | octavia : Get security groups for octavia ------------------------------- 7.20s 2026-04-28 03:54:15.816234 | orchestrator | service-ks-register : octavia | Granting user roles --------------------- 7.01s 2026-04-28 03:54:15.816244 | orchestrator | service-ks-register : octavia | Creating endpoints ---------------------- 6.28s 2026-04-28 03:54:15.816271 | orchestrator | octavia : Copying certificate files for octavia-health-manager ---------- 5.82s 2026-04-28 03:54:16.232244 | orchestrator | octavia : Copying certificate files for octavia-housekeeping ------------ 5.63s 2026-04-28 03:54:16.232393 | orchestrator | octavia : Update Octavia health manager port host_id -------------------- 5.48s 2026-04-28 03:54:16.232415 | orchestrator | octavia : Copying over config.json files for services ------------------- 5.45s 2026-04-28 03:54:16.232431 | orchestrator | octavia : Create ports for Octavia health-manager nodes ----------------- 5.39s 2026-04-28 03:54:16.232446 | orchestrator | octavia : Create loadbalancer management subnet ------------------------- 5.36s 2026-04-28 03:54:18.829591 | orchestrator | 2026-04-28 03:54:18 | INFO  | Task 8ee88b5c-755e-4f89-ba9f-cf2467cb9816 (ceilometer) was prepared for execution. 2026-04-28 03:54:18.830590 | orchestrator | 2026-04-28 03:54:18 | INFO  | It takes a moment until task 8ee88b5c-755e-4f89-ba9f-cf2467cb9816 (ceilometer) has been started and output is visible here. 2026-04-28 03:54:42.996349 | orchestrator | 2026-04-28 03:54:42.996465 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 03:54:42.996483 | orchestrator | 2026-04-28 03:54:42.996495 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 03:54:42.996507 | orchestrator | Tuesday 28 April 2026 03:54:23 +0000 (0:00:00.284) 0:00:00.284 ********* 2026-04-28 03:54:42.996518 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:54:42.996530 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:54:42.996541 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:54:42.996552 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:54:42.996564 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:54:42.996575 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:54:42.996586 | orchestrator | 2026-04-28 03:54:42.996597 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 03:54:42.996609 | orchestrator | Tuesday 28 April 2026 03:54:24 +0000 (0:00:00.792) 0:00:01.076 ********* 2026-04-28 03:54:42.996620 | orchestrator | ok: [testbed-node-0] => (item=enable_ceilometer_True) 2026-04-28 03:54:42.996632 | orchestrator | ok: [testbed-node-1] => (item=enable_ceilometer_True) 2026-04-28 03:54:42.996642 | orchestrator | ok: [testbed-node-2] => (item=enable_ceilometer_True) 2026-04-28 03:54:42.996653 | orchestrator | ok: [testbed-node-3] => (item=enable_ceilometer_True) 2026-04-28 03:54:42.996665 | orchestrator | ok: [testbed-node-4] => (item=enable_ceilometer_True) 2026-04-28 03:54:42.996676 | orchestrator | ok: [testbed-node-5] => (item=enable_ceilometer_True) 2026-04-28 03:54:42.996687 | orchestrator | 2026-04-28 03:54:42.996698 | orchestrator | PLAY [Apply role ceilometer] *************************************************** 2026-04-28 03:54:42.996709 | orchestrator | 2026-04-28 03:54:42.996720 | orchestrator | TASK [ceilometer : include_tasks] ********************************************** 2026-04-28 03:54:42.996730 | orchestrator | Tuesday 28 April 2026 03:54:24 +0000 (0:00:00.669) 0:00:01.745 ********* 2026-04-28 03:54:42.996743 | orchestrator | included: /ansible/roles/ceilometer/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:54:42.996755 | orchestrator | 2026-04-28 03:54:42.996766 | orchestrator | TASK [service-ks-register : ceilometer | Creating services] ******************** 2026-04-28 03:54:42.996777 | orchestrator | Tuesday 28 April 2026 03:54:26 +0000 (0:00:01.339) 0:00:03.085 ********* 2026-04-28 03:54:42.996788 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:54:42.996799 | orchestrator | 2026-04-28 03:54:42.996810 | orchestrator | TASK [service-ks-register : ceilometer | Creating endpoints] ******************* 2026-04-28 03:54:42.996821 | orchestrator | Tuesday 28 April 2026 03:54:26 +0000 (0:00:00.132) 0:00:03.217 ********* 2026-04-28 03:54:42.996832 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:54:42.996843 | orchestrator | 2026-04-28 03:54:42.996853 | orchestrator | TASK [service-ks-register : ceilometer | Creating projects] ******************** 2026-04-28 03:54:42.996864 | orchestrator | Tuesday 28 April 2026 03:54:26 +0000 (0:00:00.336) 0:00:03.554 ********* 2026-04-28 03:54:42.996875 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-28 03:54:42.996886 | orchestrator | 2026-04-28 03:54:42.996897 | orchestrator | TASK [service-ks-register : ceilometer | Creating users] *********************** 2026-04-28 03:54:42.996908 | orchestrator | Tuesday 28 April 2026 03:54:30 +0000 (0:00:03.510) 0:00:07.064 ********* 2026-04-28 03:54:42.996974 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-28 03:54:42.996988 | orchestrator | changed: [testbed-node-0] => (item=ceilometer -> service) 2026-04-28 03:54:42.996999 | orchestrator | 2026-04-28 03:54:42.997010 | orchestrator | TASK [service-ks-register : ceilometer | Creating roles] *********************** 2026-04-28 03:54:42.997021 | orchestrator | Tuesday 28 April 2026 03:54:33 +0000 (0:00:03.705) 0:00:10.769 ********* 2026-04-28 03:54:42.997032 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-28 03:54:42.997043 | orchestrator | 2026-04-28 03:54:42.997054 | orchestrator | TASK [service-ks-register : ceilometer | Granting user roles] ****************** 2026-04-28 03:54:42.997065 | orchestrator | Tuesday 28 April 2026 03:54:37 +0000 (0:00:03.261) 0:00:14.031 ********* 2026-04-28 03:54:42.997076 | orchestrator | changed: [testbed-node-0] => (item=ceilometer -> service -> admin) 2026-04-28 03:54:42.997087 | orchestrator | 2026-04-28 03:54:42.997098 | orchestrator | TASK [ceilometer : Associate the ResellerAdmin role and ceilometer user] ******* 2026-04-28 03:54:42.997109 | orchestrator | Tuesday 28 April 2026 03:54:41 +0000 (0:00:04.242) 0:00:18.274 ********* 2026-04-28 03:54:42.997134 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:54:42.997146 | orchestrator | 2026-04-28 03:54:42.997157 | orchestrator | TASK [ceilometer : Ensuring config directories exist] ************************** 2026-04-28 03:54:42.997168 | orchestrator | Tuesday 28 April 2026 03:54:41 +0000 (0:00:00.140) 0:00:18.414 ********* 2026-04-28 03:54:42.997183 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 03:54:42.997217 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 03:54:42.997230 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 03:54:42.997244 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-28 03:54:42.997266 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 03:54:42.997285 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-28 03:54:42.997297 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 03:54:42.997317 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-28 03:54:48.057351 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 03:54:48.057441 | orchestrator | 2026-04-28 03:54:48.057454 | orchestrator | TASK [ceilometer : Check if the folder for custom meter definitions exist] ***** 2026-04-28 03:54:48.057463 | orchestrator | Tuesday 28 April 2026 03:54:42 +0000 (0:00:01.492) 0:00:19.907 ********* 2026-04-28 03:54:48.057471 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-28 03:54:48.057484 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-28 03:54:48.057496 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 03:54:48.057533 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 03:54:48.057547 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 03:54:48.057558 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 03:54:48.057565 | orchestrator | 2026-04-28 03:54:48.057573 | orchestrator | TASK [ceilometer : Set variable that indicates if we have a folder for custom meter YAML files] *** 2026-04-28 03:54:48.057582 | orchestrator | Tuesday 28 April 2026 03:54:44 +0000 (0:00:01.691) 0:00:21.598 ********* 2026-04-28 03:54:48.057589 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:54:48.057597 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:54:48.057604 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:54:48.057611 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:54:48.057619 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:54:48.057626 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:54:48.057633 | orchestrator | 2026-04-28 03:54:48.057640 | orchestrator | TASK [ceilometer : Find all *.yaml files in custom meter definitions folder (if the folder exist)] *** 2026-04-28 03:54:48.057648 | orchestrator | Tuesday 28 April 2026 03:54:45 +0000 (0:00:00.691) 0:00:22.290 ********* 2026-04-28 03:54:48.057655 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:54:48.057663 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:54:48.057670 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:54:48.057677 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:54:48.057684 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:54:48.057692 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:54:48.057699 | orchestrator | 2026-04-28 03:54:48.057706 | orchestrator | TASK [ceilometer : Set the variable that control the copy of custom meter definitions] *** 2026-04-28 03:54:48.057714 | orchestrator | Tuesday 28 April 2026 03:54:46 +0000 (0:00:00.857) 0:00:23.147 ********* 2026-04-28 03:54:48.057722 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:54:48.057729 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:54:48.057736 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:54:48.057743 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:54:48.057750 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:54:48.057757 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:54:48.057764 | orchestrator | 2026-04-28 03:54:48.057771 | orchestrator | TASK [ceilometer : Create default folder for custom meter definitions] ********* 2026-04-28 03:54:48.057779 | orchestrator | Tuesday 28 April 2026 03:54:46 +0000 (0:00:00.656) 0:00:23.804 ********* 2026-04-28 03:54:48.057799 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:54:48.057809 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:54:48.057818 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:54:48.057840 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:54:48.057855 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:54:48.057863 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:54:48.057871 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:54:48.057878 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:54:48.057892 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:54:48.057902 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:54:48.057911 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:54:48.057920 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:54:48.057929 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:54:48.058119 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:54:53.028665 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:54:53.028779 | orchestrator | 2026-04-28 03:54:53.028800 | orchestrator | TASK [ceilometer : Copying custom meter definitions to Ceilometer] ************* 2026-04-28 03:54:53.028816 | orchestrator | Tuesday 28 April 2026 03:54:48 +0000 (0:00:01.164) 0:00:24.968 ********* 2026-04-28 03:54:53.028832 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:54:53.028850 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:54:53.028866 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:54:53.028880 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:54:53.028896 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:54:53.028911 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:54:53.029012 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:54:53.029030 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:54:53.029044 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:54:53.029131 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:54:53.029150 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:54:53.029163 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:54:53.029175 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:54:53.029189 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:54:53.029203 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:54:53.029217 | orchestrator | 2026-04-28 03:54:53.029238 | orchestrator | TASK [ceilometer : Check if the folder ["/opt/configuration/environments/kolla/files/overlays/ceilometer/pollsters.d"] for dynamic pollsters definitions exist] *** 2026-04-28 03:54:53.029255 | orchestrator | Tuesday 28 April 2026 03:54:48 +0000 (0:00:00.939) 0:00:25.908 ********* 2026-04-28 03:54:53.029269 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 03:54:53.029283 | orchestrator | 2026-04-28 03:54:53.029309 | orchestrator | TASK [ceilometer : Set the variable that control the copy of dynamic pollsters definitions] *** 2026-04-28 03:54:53.029326 | orchestrator | Tuesday 28 April 2026 03:54:49 +0000 (0:00:00.724) 0:00:26.633 ********* 2026-04-28 03:54:53.029341 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:54:53.029356 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:54:53.029369 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:54:53.029383 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:54:53.029397 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:54:53.029411 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:54:53.029424 | orchestrator | 2026-04-28 03:54:53.029438 | orchestrator | TASK [ceilometer : Clean default folder for dynamic pollsters definitions] ***** 2026-04-28 03:54:53.029447 | orchestrator | Tuesday 28 April 2026 03:54:50 +0000 (0:00:00.916) 0:00:27.549 ********* 2026-04-28 03:54:53.029456 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:54:53.029465 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:54:53.029474 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:54:53.029483 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:54:53.029492 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:54:53.029501 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:54:53.029509 | orchestrator | 2026-04-28 03:54:53.029517 | orchestrator | TASK [ceilometer : Create default folder for dynamic pollsters definitions] **** 2026-04-28 03:54:53.029524 | orchestrator | Tuesday 28 April 2026 03:54:51 +0000 (0:00:00.931) 0:00:28.481 ********* 2026-04-28 03:54:53.029532 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:54:53.029540 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:54:53.029548 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:54:53.029556 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:54:53.029563 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:54:53.029571 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:54:53.029579 | orchestrator | 2026-04-28 03:54:53.029587 | orchestrator | TASK [ceilometer : Copying dynamic pollsters definitions] ********************** 2026-04-28 03:54:53.029594 | orchestrator | Tuesday 28 April 2026 03:54:52 +0000 (0:00:00.843) 0:00:29.325 ********* 2026-04-28 03:54:53.029602 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:54:53.029610 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:54:53.029618 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:54:53.029625 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:54:53.029633 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:54:53.029641 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:54:53.029649 | orchestrator | 2026-04-28 03:54:58.638348 | orchestrator | TASK [ceilometer : Check if custom polling.yaml exists] ************************ 2026-04-28 03:54:58.638480 | orchestrator | Tuesday 28 April 2026 03:54:53 +0000 (0:00:00.621) 0:00:29.946 ********* 2026-04-28 03:54:58.638505 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 03:54:58.638523 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-28 03:54:58.638539 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-28 03:54:58.638554 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 03:54:58.638569 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 03:54:58.638584 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 03:54:58.638593 | orchestrator | 2026-04-28 03:54:58.638625 | orchestrator | TASK [ceilometer : Copying over polling.yaml] ********************************** 2026-04-28 03:54:58.638634 | orchestrator | Tuesday 28 April 2026 03:54:54 +0000 (0:00:01.746) 0:00:31.692 ********* 2026-04-28 03:54:58.638647 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:54:58.638686 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:54:58.638696 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:54:58.638720 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:54:58.638730 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:54:58.638740 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:54:58.638749 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:54:58.638808 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:54:58.638818 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:54:58.638829 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:54:58.638848 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:54:58.638859 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:54:58.638883 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:54:58.638909 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:54:58.638919 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:54:58.638930 | orchestrator | 2026-04-28 03:54:58.638975 | orchestrator | TASK [ceilometer : Set ceilometer polling file's path] ************************* 2026-04-28 03:54:58.638986 | orchestrator | Tuesday 28 April 2026 03:54:55 +0000 (0:00:00.897) 0:00:32.590 ********* 2026-04-28 03:54:58.638996 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:54:58.639006 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:54:58.639015 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:54:58.639026 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:54:58.639036 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:54:58.639045 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:54:58.639055 | orchestrator | 2026-04-28 03:54:58.639065 | orchestrator | TASK [ceilometer : Check custom gnocchi_resources.yaml exists] ***************** 2026-04-28 03:54:58.639075 | orchestrator | Tuesday 28 April 2026 03:54:56 +0000 (0:00:00.929) 0:00:33.520 ********* 2026-04-28 03:54:58.639085 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 03:54:58.639094 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-28 03:54:58.639104 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-28 03:54:58.639115 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 03:54:58.639124 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 03:54:58.639134 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 03:54:58.639143 | orchestrator | 2026-04-28 03:54:58.639153 | orchestrator | TASK [ceilometer : Copying over gnocchi_resources.yaml] ************************ 2026-04-28 03:54:58.639163 | orchestrator | Tuesday 28 April 2026 03:54:58 +0000 (0:00:01.684) 0:00:35.204 ********* 2026-04-28 03:54:58.639182 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:55:05.252818 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:55:05.252913 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:55:05.252923 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:55:05.252929 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:55:05.253050 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:55:05.253059 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:55:05.253066 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:55:05.253074 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:55:05.253102 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:55:05.253109 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:55:05.253131 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:55:05.253137 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:55:05.253144 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:55:05.253150 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:55:05.253156 | orchestrator | 2026-04-28 03:55:05.253165 | orchestrator | TASK [ceilometer : Set ceilometer gnocchi_resources file's path] *************** 2026-04-28 03:55:05.253170 | orchestrator | Tuesday 28 April 2026 03:54:59 +0000 (0:00:00.934) 0:00:36.139 ********* 2026-04-28 03:55:05.253173 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:55:05.253177 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:55:05.253181 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:55:05.253184 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:55:05.253188 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:55:05.253192 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:55:05.253195 | orchestrator | 2026-04-28 03:55:05.253199 | orchestrator | TASK [ceilometer : Check if policies shall be overwritten] ********************* 2026-04-28 03:55:05.253203 | orchestrator | Tuesday 28 April 2026 03:55:00 +0000 (0:00:00.847) 0:00:36.986 ********* 2026-04-28 03:55:05.253207 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:55:05.253210 | orchestrator | 2026-04-28 03:55:05.253218 | orchestrator | TASK [ceilometer : Set ceilometer policy file] ********************************* 2026-04-28 03:55:05.253222 | orchestrator | Tuesday 28 April 2026 03:55:00 +0000 (0:00:00.144) 0:00:37.131 ********* 2026-04-28 03:55:05.253226 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:55:05.253229 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:55:05.253233 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:55:05.253237 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:55:05.253241 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:55:05.253244 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:55:05.253248 | orchestrator | 2026-04-28 03:55:05.253252 | orchestrator | TASK [ceilometer : include_tasks] ********************************************** 2026-04-28 03:55:05.253256 | orchestrator | Tuesday 28 April 2026 03:55:00 +0000 (0:00:00.659) 0:00:37.790 ********* 2026-04-28 03:55:05.253261 | orchestrator | included: /ansible/roles/ceilometer/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:55:05.253266 | orchestrator | 2026-04-28 03:55:05.253269 | orchestrator | TASK [service-cert-copy : ceilometer | Copying over extra CA certificates] ***** 2026-04-28 03:55:05.253278 | orchestrator | Tuesday 28 April 2026 03:55:02 +0000 (0:00:01.644) 0:00:39.434 ********* 2026-04-28 03:55:05.253282 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:05.253291 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:05.883399 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:05.883487 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:05.883512 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:05.883519 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:05.883546 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 03:55:05.883555 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 03:55:05.883576 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 03:55:05.883583 | orchestrator | 2026-04-28 03:55:05.883590 | orchestrator | TASK [service-cert-copy : ceilometer | Copying over backend internal TLS certificate] *** 2026-04-28 03:55:05.883598 | orchestrator | Tuesday 28 April 2026 03:55:05 +0000 (0:00:02.729) 0:00:42.164 ********* 2026-04-28 03:55:05.883606 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:55:05.883615 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:55:05.883622 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:55:05.883629 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:55:05.883640 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:55:05.883646 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:55:05.883652 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:55:05.883663 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:55:07.983806 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:55:07.983897 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:55:07.983910 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:55:07.983974 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:55:07.984003 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:55:07.984009 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:55:07.984015 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:55:07.984022 | orchestrator | 2026-04-28 03:55:07.984029 | orchestrator | TASK [service-cert-copy : ceilometer | Copying over backend internal TLS key] *** 2026-04-28 03:55:07.984037 | orchestrator | Tuesday 28 April 2026 03:55:06 +0000 (0:00:01.040) 0:00:43.204 ********* 2026-04-28 03:55:07.984044 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:55:07.984051 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:55:07.984058 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:55:07.984079 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:55:07.984085 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:55:07.984092 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:55:07.984103 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:55:07.984115 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:55:07.984121 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:55:07.984127 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:55:07.984133 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:55:07.984139 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:55:07.984146 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:55:07.984159 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:55:16.346270 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:55:16.346372 | orchestrator | 2026-04-28 03:55:16.346386 | orchestrator | TASK [ceilometer : Copying over config.json files for services] **************** 2026-04-28 03:55:16.346397 | orchestrator | Tuesday 28 April 2026 03:55:07 +0000 (0:00:01.691) 0:00:44.895 ********* 2026-04-28 03:55:16.346408 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:16.346453 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:16.346464 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:16.346475 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:16.346486 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:16.346510 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 03:55:16.346520 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:16.346541 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 03:55:16.346551 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 03:55:16.346560 | orchestrator | 2026-04-28 03:55:16.346569 | orchestrator | TASK [ceilometer : Copying over ceilometer.conf] ******************************* 2026-04-28 03:55:16.346578 | orchestrator | Tuesday 28 April 2026 03:55:10 +0000 (0:00:02.612) 0:00:47.508 ********* 2026-04-28 03:55:16.346588 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:16.346597 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:16.346611 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:25.972784 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:25.972896 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:25.972910 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:25.972921 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 03:55:25.972982 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 03:55:25.972994 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 03:55:25.973022 | orchestrator | 2026-04-28 03:55:25.973032 | orchestrator | TASK [ceilometer : Check custom event_definitions.yaml exists] ***************** 2026-04-28 03:55:25.973055 | orchestrator | Tuesday 28 April 2026 03:55:16 +0000 (0:00:05.754) 0:00:53.263 ********* 2026-04-28 03:55:25.973064 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 03:55:25.973073 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-28 03:55:25.973081 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-28 03:55:25.973089 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 03:55:25.973097 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 03:55:25.973105 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 03:55:25.973113 | orchestrator | 2026-04-28 03:55:25.973121 | orchestrator | TASK [ceilometer : Copying over event_definitions.yaml] ************************ 2026-04-28 03:55:25.973129 | orchestrator | Tuesday 28 April 2026 03:55:18 +0000 (0:00:01.761) 0:00:55.025 ********* 2026-04-28 03:55:25.973137 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:55:25.973145 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:55:25.973153 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:55:25.973161 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:55:25.973168 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:55:25.973176 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:55:25.973184 | orchestrator | 2026-04-28 03:55:25.973192 | orchestrator | TASK [ceilometer : Copying over event_definitions.yaml for notification service] *** 2026-04-28 03:55:25.973200 | orchestrator | Tuesday 28 April 2026 03:55:18 +0000 (0:00:00.877) 0:00:55.902 ********* 2026-04-28 03:55:25.973208 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:55:25.973216 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:55:25.973228 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:55:25.973237 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:55:25.973244 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:55:25.973252 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:55:25.973260 | orchestrator | 2026-04-28 03:55:25.973268 | orchestrator | TASK [ceilometer : Copying over event_pipeline.yaml] *************************** 2026-04-28 03:55:25.973279 | orchestrator | Tuesday 28 April 2026 03:55:20 +0000 (0:00:01.541) 0:00:57.443 ********* 2026-04-28 03:55:25.973293 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:55:25.973305 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:55:25.973318 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:55:25.973334 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:55:25.973349 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:55:25.973363 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:55:25.973377 | orchestrator | 2026-04-28 03:55:25.973392 | orchestrator | TASK [ceilometer : Check custom pipeline.yaml exists] ************************** 2026-04-28 03:55:25.973407 | orchestrator | Tuesday 28 April 2026 03:55:21 +0000 (0:00:01.454) 0:00:58.898 ********* 2026-04-28 03:55:25.973434 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-28 03:55:25.973443 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 03:55:25.973452 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-28 03:55:25.973461 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 03:55:25.973469 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 03:55:25.973478 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 03:55:25.973487 | orchestrator | 2026-04-28 03:55:25.973496 | orchestrator | TASK [ceilometer : Copying over custom pipeline.yaml file] ********************* 2026-04-28 03:55:25.973504 | orchestrator | Tuesday 28 April 2026 03:55:23 +0000 (0:00:01.554) 0:01:00.452 ********* 2026-04-28 03:55:25.973514 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:25.973533 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:25.973543 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:25.973560 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:26.996783 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:26.996878 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 03:55:26.996893 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-28 03:55:26.996928 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 03:55:26.997040 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 03:55:26.997052 | orchestrator | 2026-04-28 03:55:26.997065 | orchestrator | TASK [ceilometer : Copying over pipeline.yaml file] **************************** 2026-04-28 03:55:26.997076 | orchestrator | Tuesday 28 April 2026 03:55:25 +0000 (0:00:02.434) 0:01:02.887 ********* 2026-04-28 03:55:26.997087 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:55:26.997124 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:55:26.997137 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:55:26.997148 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:55:26.997169 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:55:26.997179 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:55:26.997189 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:55:26.997199 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:55:26.997210 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:55:26.997220 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:55:26.997230 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:55:26.997251 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:55:30.896534 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:55:30.896612 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:55:30.896643 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:55:30.896649 | orchestrator | 2026-04-28 03:55:30.896655 | orchestrator | TASK [ceilometer : Copying VMware vCenter CA file] ***************************** 2026-04-28 03:55:30.896662 | orchestrator | Tuesday 28 April 2026 03:55:26 +0000 (0:00:01.027) 0:01:03.914 ********* 2026-04-28 03:55:30.896762 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:55:30.896768 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:55:30.896773 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:55:30.896779 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:55:30.896784 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:55:30.896790 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:55:30.896795 | orchestrator | 2026-04-28 03:55:30.896801 | orchestrator | TASK [ceilometer : Copying over existing policy file] ************************** 2026-04-28 03:55:30.896806 | orchestrator | Tuesday 28 April 2026 03:55:27 +0000 (0:00:00.911) 0:01:04.825 ********* 2026-04-28 03:55:30.896813 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:55:30.896821 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:55:30.896829 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:55:30.896835 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:55:30.896854 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:55:30.896866 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:55:30.896885 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 03:55:30.896891 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 03:55:30.896897 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:55:30.896903 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:55:30.896908 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:55:30.896914 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:55:30.896919 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:55:30.896925 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}})  2026-04-28 03:55:30.897007 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:55:30.897015 | orchestrator | 2026-04-28 03:55:30.897020 | orchestrator | TASK [ceilometer : Check ceilometer containers] ******************************** 2026-04-28 03:55:30.897031 | orchestrator | Tuesday 28 April 2026 03:55:28 +0000 (0:00:00.967) 0:01:05.793 ********* 2026-04-28 03:55:30.897049 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 03:56:09.599186 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 03:56:09.599271 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 03:56:09.599278 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-28 03:56:09.599285 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-28 03:56:09.599290 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 03:56:09.599320 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-polling 5672'], 'timeout': '30'}}}) 2026-04-28 03:56:09.599335 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 03:56:09.599341 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 03:56:09.599345 | orchestrator | 2026-04-28 03:56:09.599350 | orchestrator | TASK [ceilometer : include_tasks] ********************************************** 2026-04-28 03:56:09.599355 | orchestrator | Tuesday 28 April 2026 03:55:30 +0000 (0:00:02.014) 0:01:07.808 ********* 2026-04-28 03:56:09.599360 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:56:09.599365 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:56:09.599368 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:56:09.599372 | orchestrator | skipping: [testbed-node-3] 2026-04-28 03:56:09.599376 | orchestrator | skipping: [testbed-node-4] 2026-04-28 03:56:09.599380 | orchestrator | skipping: [testbed-node-5] 2026-04-28 03:56:09.599384 | orchestrator | 2026-04-28 03:56:09.599387 | orchestrator | TASK [ceilometer : Running Ceilometer bootstrap container] ********************* 2026-04-28 03:56:09.599391 | orchestrator | Tuesday 28 April 2026 03:55:31 +0000 (0:00:00.670) 0:01:08.479 ********* 2026-04-28 03:56:09.599395 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:56:09.599399 | orchestrator | 2026-04-28 03:56:09.599403 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-28 03:56:09.599407 | orchestrator | Tuesday 28 April 2026 03:55:36 +0000 (0:00:05.261) 0:01:13.741 ********* 2026-04-28 03:56:09.599411 | orchestrator | 2026-04-28 03:56:09.599414 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-28 03:56:09.599418 | orchestrator | Tuesday 28 April 2026 03:55:37 +0000 (0:00:00.316) 0:01:14.057 ********* 2026-04-28 03:56:09.599422 | orchestrator | 2026-04-28 03:56:09.599426 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-28 03:56:09.599430 | orchestrator | Tuesday 28 April 2026 03:55:37 +0000 (0:00:00.123) 0:01:14.180 ********* 2026-04-28 03:56:09.599433 | orchestrator | 2026-04-28 03:56:09.599437 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-28 03:56:09.599445 | orchestrator | Tuesday 28 April 2026 03:55:37 +0000 (0:00:00.078) 0:01:14.259 ********* 2026-04-28 03:56:09.599448 | orchestrator | 2026-04-28 03:56:09.599452 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-28 03:56:09.599456 | orchestrator | Tuesday 28 April 2026 03:55:37 +0000 (0:00:00.071) 0:01:14.330 ********* 2026-04-28 03:56:09.599460 | orchestrator | 2026-04-28 03:56:09.599464 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-28 03:56:09.599468 | orchestrator | Tuesday 28 April 2026 03:55:37 +0000 (0:00:00.074) 0:01:14.405 ********* 2026-04-28 03:56:09.599472 | orchestrator | 2026-04-28 03:56:09.599475 | orchestrator | RUNNING HANDLER [ceilometer : Restart ceilometer-notification container] ******* 2026-04-28 03:56:09.599479 | orchestrator | Tuesday 28 April 2026 03:55:37 +0000 (0:00:00.074) 0:01:14.480 ********* 2026-04-28 03:56:09.599483 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:56:09.599487 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:56:09.599490 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:56:09.599494 | orchestrator | 2026-04-28 03:56:09.599498 | orchestrator | RUNNING HANDLER [ceilometer : Restart ceilometer-central container] ************ 2026-04-28 03:56:09.599502 | orchestrator | Tuesday 28 April 2026 03:55:48 +0000 (0:00:10.483) 0:01:24.964 ********* 2026-04-28 03:56:09.599505 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:56:09.599509 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:56:09.599513 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:56:09.599517 | orchestrator | 2026-04-28 03:56:09.599521 | orchestrator | RUNNING HANDLER [ceilometer : Restart ceilometer-compute container] ************ 2026-04-28 03:56:09.599524 | orchestrator | Tuesday 28 April 2026 03:55:58 +0000 (0:00:10.110) 0:01:35.074 ********* 2026-04-28 03:56:09.599528 | orchestrator | changed: [testbed-node-5] 2026-04-28 03:56:09.599532 | orchestrator | changed: [testbed-node-3] 2026-04-28 03:56:09.599538 | orchestrator | changed: [testbed-node-4] 2026-04-28 03:56:09.599542 | orchestrator | 2026-04-28 03:56:09.599546 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 03:56:09.599551 | orchestrator | testbed-node-0 : ok=29  changed=13  unreachable=0 failed=0 skipped=21  rescued=0 ignored=0 2026-04-28 03:56:09.599558 | orchestrator | testbed-node-1 : ok=23  changed=10  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-28 03:56:09.599568 | orchestrator | testbed-node-2 : ok=23  changed=10  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-28 03:56:10.160892 | orchestrator | testbed-node-3 : ok=20  changed=7  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-28 03:56:10.161008 | orchestrator | testbed-node-4 : ok=20  changed=7  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-28 03:56:10.161018 | orchestrator | testbed-node-5 : ok=20  changed=7  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-28 03:56:10.161024 | orchestrator | 2026-04-28 03:56:10.161032 | orchestrator | 2026-04-28 03:56:10.161039 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 03:56:10.161047 | orchestrator | Tuesday 28 April 2026 03:56:09 +0000 (0:00:11.431) 0:01:46.506 ********* 2026-04-28 03:56:10.161054 | orchestrator | =============================================================================== 2026-04-28 03:56:10.161060 | orchestrator | ceilometer : Restart ceilometer-compute container ---------------------- 11.43s 2026-04-28 03:56:10.161066 | orchestrator | ceilometer : Restart ceilometer-notification container ----------------- 10.48s 2026-04-28 03:56:10.161073 | orchestrator | ceilometer : Restart ceilometer-central container ---------------------- 10.11s 2026-04-28 03:56:10.161079 | orchestrator | ceilometer : Copying over ceilometer.conf ------------------------------- 5.76s 2026-04-28 03:56:10.161085 | orchestrator | ceilometer : Running Ceilometer bootstrap container --------------------- 5.26s 2026-04-28 03:56:10.161114 | orchestrator | service-ks-register : ceilometer | Granting user roles ------------------ 4.24s 2026-04-28 03:56:10.161121 | orchestrator | service-ks-register : ceilometer | Creating users ----------------------- 3.71s 2026-04-28 03:56:10.161127 | orchestrator | service-ks-register : ceilometer | Creating projects -------------------- 3.51s 2026-04-28 03:56:10.161136 | orchestrator | service-ks-register : ceilometer | Creating roles ----------------------- 3.26s 2026-04-28 03:56:10.161146 | orchestrator | service-cert-copy : ceilometer | Copying over extra CA certificates ----- 2.73s 2026-04-28 03:56:10.161156 | orchestrator | ceilometer : Copying over config.json files for services ---------------- 2.61s 2026-04-28 03:56:10.161165 | orchestrator | ceilometer : Copying over custom pipeline.yaml file --------------------- 2.43s 2026-04-28 03:56:10.161175 | orchestrator | ceilometer : Check ceilometer containers -------------------------------- 2.02s 2026-04-28 03:56:10.161185 | orchestrator | ceilometer : Check custom event_definitions.yaml exists ----------------- 1.76s 2026-04-28 03:56:10.161193 | orchestrator | ceilometer : Check if custom polling.yaml exists ------------------------ 1.75s 2026-04-28 03:56:10.161203 | orchestrator | service-cert-copy : ceilometer | Copying over backend internal TLS key --- 1.69s 2026-04-28 03:56:10.161213 | orchestrator | ceilometer : Check if the folder for custom meter definitions exist ----- 1.69s 2026-04-28 03:56:10.161223 | orchestrator | ceilometer : Check custom gnocchi_resources.yaml exists ----------------- 1.68s 2026-04-28 03:56:10.161234 | orchestrator | ceilometer : include_tasks ---------------------------------------------- 1.64s 2026-04-28 03:56:10.161244 | orchestrator | ceilometer : Check custom pipeline.yaml exists -------------------------- 1.55s 2026-04-28 03:56:12.743273 | orchestrator | 2026-04-28 03:56:12 | INFO  | Task f3132a1f-1491-4e61-869e-e9acf7806b5c (aodh) was prepared for execution. 2026-04-28 03:56:12.743374 | orchestrator | 2026-04-28 03:56:12 | INFO  | It takes a moment until task f3132a1f-1491-4e61-869e-e9acf7806b5c (aodh) has been started and output is visible here. 2026-04-28 03:56:44.802063 | orchestrator | 2026-04-28 03:56:44.802155 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 03:56:44.802168 | orchestrator | 2026-04-28 03:56:44.802176 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 03:56:44.802183 | orchestrator | Tuesday 28 April 2026 03:56:17 +0000 (0:00:00.309) 0:00:00.309 ********* 2026-04-28 03:56:44.802191 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:56:44.802200 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:56:44.802208 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:56:44.802216 | orchestrator | 2026-04-28 03:56:44.802223 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 03:56:44.802232 | orchestrator | Tuesday 28 April 2026 03:56:17 +0000 (0:00:00.340) 0:00:00.649 ********* 2026-04-28 03:56:44.802239 | orchestrator | ok: [testbed-node-0] => (item=enable_aodh_True) 2026-04-28 03:56:44.802248 | orchestrator | ok: [testbed-node-1] => (item=enable_aodh_True) 2026-04-28 03:56:44.802256 | orchestrator | ok: [testbed-node-2] => (item=enable_aodh_True) 2026-04-28 03:56:44.802264 | orchestrator | 2026-04-28 03:56:44.802273 | orchestrator | PLAY [Apply role aodh] ********************************************************* 2026-04-28 03:56:44.802280 | orchestrator | 2026-04-28 03:56:44.802287 | orchestrator | TASK [aodh : include_tasks] **************************************************** 2026-04-28 03:56:44.802309 | orchestrator | Tuesday 28 April 2026 03:56:18 +0000 (0:00:00.471) 0:00:01.120 ********* 2026-04-28 03:56:44.802318 | orchestrator | included: /ansible/roles/aodh/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:56:44.802328 | orchestrator | 2026-04-28 03:56:44.802336 | orchestrator | TASK [service-ks-register : aodh | Creating services] ************************** 2026-04-28 03:56:44.802344 | orchestrator | Tuesday 28 April 2026 03:56:18 +0000 (0:00:00.616) 0:00:01.737 ********* 2026-04-28 03:56:44.802352 | orchestrator | changed: [testbed-node-0] => (item=aodh (alarming)) 2026-04-28 03:56:44.802360 | orchestrator | 2026-04-28 03:56:44.802367 | orchestrator | TASK [service-ks-register : aodh | Creating endpoints] ************************* 2026-04-28 03:56:44.802397 | orchestrator | Tuesday 28 April 2026 03:56:22 +0000 (0:00:03.323) 0:00:05.061 ********* 2026-04-28 03:56:44.802405 | orchestrator | changed: [testbed-node-0] => (item=aodh -> https://api-int.testbed.osism.xyz:8042 -> internal) 2026-04-28 03:56:44.802413 | orchestrator | changed: [testbed-node-0] => (item=aodh -> https://api.testbed.osism.xyz:8042 -> public) 2026-04-28 03:56:44.802421 | orchestrator | 2026-04-28 03:56:44.802428 | orchestrator | TASK [service-ks-register : aodh | Creating projects] ************************** 2026-04-28 03:56:44.802435 | orchestrator | Tuesday 28 April 2026 03:56:28 +0000 (0:00:06.411) 0:00:11.472 ********* 2026-04-28 03:56:44.802442 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-28 03:56:44.802451 | orchestrator | 2026-04-28 03:56:44.802460 | orchestrator | TASK [service-ks-register : aodh | Creating users] ***************************** 2026-04-28 03:56:44.802467 | orchestrator | Tuesday 28 April 2026 03:56:31 +0000 (0:00:03.468) 0:00:14.941 ********* 2026-04-28 03:56:44.802475 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-28 03:56:44.802482 | orchestrator | changed: [testbed-node-0] => (item=aodh -> service) 2026-04-28 03:56:44.802491 | orchestrator | 2026-04-28 03:56:44.802499 | orchestrator | TASK [service-ks-register : aodh | Creating roles] ***************************** 2026-04-28 03:56:44.802506 | orchestrator | Tuesday 28 April 2026 03:56:35 +0000 (0:00:03.844) 0:00:18.785 ********* 2026-04-28 03:56:44.802514 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-28 03:56:44.802522 | orchestrator | 2026-04-28 03:56:44.802531 | orchestrator | TASK [service-ks-register : aodh | Granting user roles] ************************ 2026-04-28 03:56:44.802539 | orchestrator | Tuesday 28 April 2026 03:56:38 +0000 (0:00:03.116) 0:00:21.901 ********* 2026-04-28 03:56:44.802547 | orchestrator | changed: [testbed-node-0] => (item=aodh -> service -> admin) 2026-04-28 03:56:44.802556 | orchestrator | 2026-04-28 03:56:44.802563 | orchestrator | TASK [aodh : Ensuring config directories exist] ******************************** 2026-04-28 03:56:44.802572 | orchestrator | Tuesday 28 April 2026 03:56:42 +0000 (0:00:03.775) 0:00:25.676 ********* 2026-04-28 03:56:44.802583 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-28 03:56:44.802616 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-28 03:56:44.802632 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-28 03:56:44.802649 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 03:56:44.802659 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 03:56:44.802668 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 03:56:44.802677 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:56:44.802692 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:56:46.286492 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:56:46.286592 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 03:56:46.286600 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 03:56:46.286605 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 03:56:46.286609 | orchestrator | 2026-04-28 03:56:46.286615 | orchestrator | TASK [aodh : Check if policies shall be overwritten] *************************** 2026-04-28 03:56:46.286620 | orchestrator | Tuesday 28 April 2026 03:56:44 +0000 (0:00:02.136) 0:00:27.813 ********* 2026-04-28 03:56:46.286624 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:56:46.286629 | orchestrator | 2026-04-28 03:56:46.286633 | orchestrator | TASK [aodh : Set aodh policy file] ********************************************* 2026-04-28 03:56:46.286637 | orchestrator | Tuesday 28 April 2026 03:56:44 +0000 (0:00:00.163) 0:00:27.976 ********* 2026-04-28 03:56:46.286640 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:56:46.286644 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:56:46.286648 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:56:46.286652 | orchestrator | 2026-04-28 03:56:46.286655 | orchestrator | TASK [aodh : Copying over existing policy file] ******************************** 2026-04-28 03:56:46.286659 | orchestrator | Tuesday 28 April 2026 03:56:45 +0000 (0:00:00.565) 0:00:28.541 ********* 2026-04-28 03:56:46.286664 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-28 03:56:46.286682 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 03:56:46.286691 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 03:56:46.286695 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 03:56:46.286699 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:56:46.286703 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-28 03:56:46.286707 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 03:56:46.286711 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 03:56:46.286723 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 03:56:51.525837 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:56:51.526110 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-28 03:56:51.526145 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 03:56:51.526169 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 03:56:51.526188 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 03:56:51.526208 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:56:51.526227 | orchestrator | 2026-04-28 03:56:51.526247 | orchestrator | TASK [aodh : include_tasks] **************************************************** 2026-04-28 03:56:51.526267 | orchestrator | Tuesday 28 April 2026 03:56:46 +0000 (0:00:00.761) 0:00:29.302 ********* 2026-04-28 03:56:51.526286 | orchestrator | included: /ansible/roles/aodh/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:56:51.526307 | orchestrator | 2026-04-28 03:56:51.526326 | orchestrator | TASK [service-cert-copy : aodh | Copying over extra CA certificates] *********** 2026-04-28 03:56:51.526345 | orchestrator | Tuesday 28 April 2026 03:56:47 +0000 (0:00:00.781) 0:00:30.084 ********* 2026-04-28 03:56:51.526395 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-28 03:56:51.526440 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-28 03:56:51.526454 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-28 03:56:51.526466 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 03:56:51.526477 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 03:56:51.526488 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 03:56:51.526509 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:56:51.526527 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:56:52.223815 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:56:52.223896 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 03:56:52.223904 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 03:56:52.223908 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 03:56:52.223962 | orchestrator | 2026-04-28 03:56:52.223969 | orchestrator | TASK [service-cert-copy : aodh | Copying over backend internal TLS certificate] *** 2026-04-28 03:56:52.223974 | orchestrator | Tuesday 28 April 2026 03:56:51 +0000 (0:00:04.451) 0:00:34.536 ********* 2026-04-28 03:56:52.223981 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-28 03:56:52.223985 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 03:56:52.224011 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 03:56:52.224016 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 03:56:52.224021 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:56:52.224026 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-28 03:56:52.224034 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 03:56:52.224038 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 03:56:52.224042 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 03:56:52.224046 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:56:52.224057 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-28 03:56:53.299283 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 03:56:53.299414 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 03:56:53.299472 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 03:56:53.299493 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:56:53.299514 | orchestrator | 2026-04-28 03:56:53.299535 | orchestrator | TASK [service-cert-copy : aodh | Copying over backend internal TLS key] ******** 2026-04-28 03:56:53.299555 | orchestrator | Tuesday 28 April 2026 03:56:52 +0000 (0:00:00.702) 0:00:35.238 ********* 2026-04-28 03:56:53.299575 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-28 03:56:53.299596 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 03:56:53.299637 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 03:56:53.299682 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 03:56:53.299703 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:56:53.299722 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-28 03:56:53.299759 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 03:56:53.299781 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 03:56:53.299804 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 03:56:53.299824 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:56:53.299860 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}})  2026-04-28 03:56:57.654354 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 03:56:57.654477 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 03:56:57.654527 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 03:56:57.654540 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:56:57.654551 | orchestrator | 2026-04-28 03:56:57.654561 | orchestrator | TASK [aodh : Copying over config.json files for services] ********************** 2026-04-28 03:56:57.654570 | orchestrator | Tuesday 28 April 2026 03:56:53 +0000 (0:00:01.078) 0:00:36.317 ********* 2026-04-28 03:56:57.654579 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-28 03:56:57.654602 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-28 03:56:57.654631 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-28 03:56:57.654654 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 03:56:57.654663 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 03:56:57.654671 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 03:56:57.654680 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:56:57.654688 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:56:57.654700 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:56:57.654715 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 03:57:06.889862 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 03:57:06.890774 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 03:57:06.890803 | orchestrator | 2026-04-28 03:57:06.890810 | orchestrator | TASK [aodh : Copying over aodh.conf] ******************************************* 2026-04-28 03:57:06.890816 | orchestrator | Tuesday 28 April 2026 03:56:57 +0000 (0:00:04.348) 0:00:40.665 ********* 2026-04-28 03:57:06.890822 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-28 03:57:06.890828 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-28 03:57:06.890847 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-28 03:57:06.890882 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 03:57:06.890888 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 03:57:06.890893 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 03:57:06.890898 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:57:06.890903 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:57:06.890910 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:57:06.890919 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 03:57:06.890961 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 03:57:12.322435 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 03:57:12.323431 | orchestrator | 2026-04-28 03:57:12.323474 | orchestrator | TASK [aodh : Copying over wsgi-aodh files for services] ************************ 2026-04-28 03:57:12.323486 | orchestrator | Tuesday 28 April 2026 03:57:06 +0000 (0:00:09.234) 0:00:49.899 ********* 2026-04-28 03:57:12.323500 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:57:12.323515 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:57:12.323528 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:57:12.323541 | orchestrator | 2026-04-28 03:57:12.323555 | orchestrator | TASK [aodh : Check aodh containers] ******************************************** 2026-04-28 03:57:12.323570 | orchestrator | Tuesday 28 April 2026 03:57:08 +0000 (0:00:01.984) 0:00:51.883 ********* 2026-04-28 03:57:12.323587 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-28 03:57:12.323624 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-28 03:57:12.323663 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042'}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042'}}}}) 2026-04-28 03:57:12.323703 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 03:57:12.323719 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 03:57:12.323734 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 03:57:12.323749 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:57:12.323765 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:57:12.323794 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 03:57:12.323809 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 03:57:12.323833 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 03:58:04.452773 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 03:58:04.452955 | orchestrator | 2026-04-28 03:58:04.452986 | orchestrator | TASK [aodh : include_tasks] **************************************************** 2026-04-28 03:58:04.453008 | orchestrator | Tuesday 28 April 2026 03:57:12 +0000 (0:00:03.448) 0:00:55.332 ********* 2026-04-28 03:58:04.453028 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:58:04.453048 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:58:04.453066 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:58:04.453086 | orchestrator | 2026-04-28 03:58:04.453104 | orchestrator | TASK [aodh : Creating aodh database] ******************************************* 2026-04-28 03:58:04.453123 | orchestrator | Tuesday 28 April 2026 03:57:12 +0000 (0:00:00.362) 0:00:55.694 ********* 2026-04-28 03:58:04.453142 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:58:04.453161 | orchestrator | 2026-04-28 03:58:04.453184 | orchestrator | TASK [aodh : Creating aodh database user and setting permissions] ************** 2026-04-28 03:58:04.453202 | orchestrator | Tuesday 28 April 2026 03:57:14 +0000 (0:00:02.092) 0:00:57.787 ********* 2026-04-28 03:58:04.453221 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:58:04.453239 | orchestrator | 2026-04-28 03:58:04.453262 | orchestrator | TASK [aodh : Running aodh bootstrap container] ********************************* 2026-04-28 03:58:04.453285 | orchestrator | Tuesday 28 April 2026 03:57:16 +0000 (0:00:02.215) 0:01:00.002 ********* 2026-04-28 03:58:04.453307 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:58:04.453330 | orchestrator | 2026-04-28 03:58:04.453430 | orchestrator | TASK [aodh : Flush handlers] *************************************************** 2026-04-28 03:58:04.453451 | orchestrator | Tuesday 28 April 2026 03:57:30 +0000 (0:00:13.475) 0:01:13.478 ********* 2026-04-28 03:58:04.453468 | orchestrator | 2026-04-28 03:58:04.453487 | orchestrator | TASK [aodh : Flush handlers] *************************************************** 2026-04-28 03:58:04.453507 | orchestrator | Tuesday 28 April 2026 03:57:30 +0000 (0:00:00.082) 0:01:13.560 ********* 2026-04-28 03:58:04.453527 | orchestrator | 2026-04-28 03:58:04.453546 | orchestrator | TASK [aodh : Flush handlers] *************************************************** 2026-04-28 03:58:04.453566 | orchestrator | Tuesday 28 April 2026 03:57:30 +0000 (0:00:00.076) 0:01:13.636 ********* 2026-04-28 03:58:04.453585 | orchestrator | 2026-04-28 03:58:04.453604 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-api container] **************************** 2026-04-28 03:58:04.453623 | orchestrator | Tuesday 28 April 2026 03:57:30 +0000 (0:00:00.282) 0:01:13.919 ********* 2026-04-28 03:58:04.453655 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:58:04.453675 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:58:04.453694 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:58:04.453713 | orchestrator | 2026-04-28 03:58:04.453733 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-evaluator container] ********************** 2026-04-28 03:58:04.453752 | orchestrator | Tuesday 28 April 2026 03:57:39 +0000 (0:00:08.157) 0:01:22.076 ********* 2026-04-28 03:58:04.453771 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:58:04.453808 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:58:04.453828 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:58:04.453848 | orchestrator | 2026-04-28 03:58:04.453867 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-listener container] *********************** 2026-04-28 03:58:04.453886 | orchestrator | Tuesday 28 April 2026 03:57:49 +0000 (0:00:10.614) 0:01:32.691 ********* 2026-04-28 03:58:04.453905 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:58:04.454091 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:58:04.454119 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:58:04.454138 | orchestrator | 2026-04-28 03:58:04.454157 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-notifier container] *********************** 2026-04-28 03:58:04.454176 | orchestrator | Tuesday 28 April 2026 03:57:58 +0000 (0:00:08.343) 0:01:41.034 ********* 2026-04-28 03:58:04.454194 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:58:04.454213 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:58:04.454233 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:58:04.454252 | orchestrator | 2026-04-28 03:58:04.454272 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 03:58:04.454292 | orchestrator | testbed-node-0 : ok=23  changed=17  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 03:58:04.454313 | orchestrator | testbed-node-1 : ok=14  changed=10  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 03:58:04.454333 | orchestrator | testbed-node-2 : ok=14  changed=10  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 03:58:04.454351 | orchestrator | 2026-04-28 03:58:04.454370 | orchestrator | 2026-04-28 03:58:04.454385 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 03:58:04.454402 | orchestrator | Tuesday 28 April 2026 03:58:04 +0000 (0:00:06.033) 0:01:47.068 ********* 2026-04-28 03:58:04.454418 | orchestrator | =============================================================================== 2026-04-28 03:58:04.454437 | orchestrator | aodh : Running aodh bootstrap container -------------------------------- 13.48s 2026-04-28 03:58:04.454455 | orchestrator | aodh : Restart aodh-evaluator container -------------------------------- 10.61s 2026-04-28 03:58:04.454504 | orchestrator | aodh : Copying over aodh.conf ------------------------------------------- 9.23s 2026-04-28 03:58:04.454523 | orchestrator | aodh : Restart aodh-listener container ---------------------------------- 8.34s 2026-04-28 03:58:04.454542 | orchestrator | aodh : Restart aodh-api container --------------------------------------- 8.16s 2026-04-28 03:58:04.454579 | orchestrator | service-ks-register : aodh | Creating endpoints ------------------------- 6.41s 2026-04-28 03:58:04.454600 | orchestrator | aodh : Restart aodh-notifier container ---------------------------------- 6.03s 2026-04-28 03:58:04.454617 | orchestrator | service-cert-copy : aodh | Copying over extra CA certificates ----------- 4.45s 2026-04-28 03:58:04.454637 | orchestrator | aodh : Copying over config.json files for services ---------------------- 4.35s 2026-04-28 03:58:04.454657 | orchestrator | service-ks-register : aodh | Creating users ----------------------------- 3.84s 2026-04-28 03:58:04.454676 | orchestrator | service-ks-register : aodh | Granting user roles ------------------------ 3.78s 2026-04-28 03:58:04.454695 | orchestrator | service-ks-register : aodh | Creating projects -------------------------- 3.47s 2026-04-28 03:58:04.454714 | orchestrator | aodh : Check aodh containers -------------------------------------------- 3.45s 2026-04-28 03:58:04.454731 | orchestrator | service-ks-register : aodh | Creating services -------------------------- 3.32s 2026-04-28 03:58:04.454750 | orchestrator | service-ks-register : aodh | Creating roles ----------------------------- 3.12s 2026-04-28 03:58:04.454767 | orchestrator | aodh : Creating aodh database user and setting permissions -------------- 2.22s 2026-04-28 03:58:04.454785 | orchestrator | aodh : Ensuring config directories exist -------------------------------- 2.14s 2026-04-28 03:58:04.454803 | orchestrator | aodh : Creating aodh database ------------------------------------------- 2.09s 2026-04-28 03:58:04.454822 | orchestrator | aodh : Copying over wsgi-aodh files for services ------------------------ 1.98s 2026-04-28 03:58:04.454842 | orchestrator | service-cert-copy : aodh | Copying over backend internal TLS key -------- 1.08s 2026-04-28 03:58:07.060420 | orchestrator | 2026-04-28 03:58:07 | INFO  | Task adda4b12-0964-4390-b1bd-fcb689cf2ced (kolla-ceph-rgw) was prepared for execution. 2026-04-28 03:58:07.060523 | orchestrator | 2026-04-28 03:58:07 | INFO  | It takes a moment until task adda4b12-0964-4390-b1bd-fcb689cf2ced (kolla-ceph-rgw) has been started and output is visible here. 2026-04-28 03:58:45.600293 | orchestrator | 2026-04-28 03:58:45.600391 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 03:58:45.600405 | orchestrator | 2026-04-28 03:58:45.600414 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 03:58:45.600423 | orchestrator | Tuesday 28 April 2026 03:58:11 +0000 (0:00:00.328) 0:00:00.328 ********* 2026-04-28 03:58:45.600431 | orchestrator | ok: [testbed-manager] 2026-04-28 03:58:45.600440 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:58:45.600448 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:58:45.600456 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:58:45.600463 | orchestrator | ok: [testbed-node-3] 2026-04-28 03:58:45.600471 | orchestrator | ok: [testbed-node-4] 2026-04-28 03:58:45.600479 | orchestrator | ok: [testbed-node-5] 2026-04-28 03:58:45.600487 | orchestrator | 2026-04-28 03:58:45.600495 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 03:58:45.600503 | orchestrator | Tuesday 28 April 2026 03:58:12 +0000 (0:00:00.924) 0:00:01.252 ********* 2026-04-28 03:58:45.600511 | orchestrator | ok: [testbed-manager] => (item=enable_ceph_rgw_True) 2026-04-28 03:58:45.600533 | orchestrator | ok: [testbed-node-0] => (item=enable_ceph_rgw_True) 2026-04-28 03:58:45.600542 | orchestrator | ok: [testbed-node-1] => (item=enable_ceph_rgw_True) 2026-04-28 03:58:45.600550 | orchestrator | ok: [testbed-node-2] => (item=enable_ceph_rgw_True) 2026-04-28 03:58:45.600557 | orchestrator | ok: [testbed-node-3] => (item=enable_ceph_rgw_True) 2026-04-28 03:58:45.600565 | orchestrator | ok: [testbed-node-4] => (item=enable_ceph_rgw_True) 2026-04-28 03:58:45.600573 | orchestrator | ok: [testbed-node-5] => (item=enable_ceph_rgw_True) 2026-04-28 03:58:45.600581 | orchestrator | 2026-04-28 03:58:45.600589 | orchestrator | PLAY [Apply role ceph-rgw] ***************************************************** 2026-04-28 03:58:45.600596 | orchestrator | 2026-04-28 03:58:45.600604 | orchestrator | TASK [ceph-rgw : include_tasks] ************************************************ 2026-04-28 03:58:45.600612 | orchestrator | Tuesday 28 April 2026 03:58:13 +0000 (0:00:01.004) 0:00:02.256 ********* 2026-04-28 03:58:45.600641 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/deploy.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 03:58:45.600651 | orchestrator | 2026-04-28 03:58:45.600659 | orchestrator | TASK [service-ks-register : ceph-rgw | Creating services] ********************** 2026-04-28 03:58:45.600667 | orchestrator | Tuesday 28 April 2026 03:58:15 +0000 (0:00:01.499) 0:00:03.756 ********* 2026-04-28 03:58:45.600675 | orchestrator | changed: [testbed-manager] => (item=swift (object-store)) 2026-04-28 03:58:45.600682 | orchestrator | 2026-04-28 03:58:45.600691 | orchestrator | TASK [service-ks-register : ceph-rgw | Creating endpoints] ********************* 2026-04-28 03:58:45.600699 | orchestrator | Tuesday 28 April 2026 03:58:19 +0000 (0:00:04.015) 0:00:07.771 ********* 2026-04-28 03:58:45.600707 | orchestrator | changed: [testbed-manager] => (item=swift -> https://api-int.testbed.osism.xyz:6780/swift/v1/AUTH_%(project_id)s -> internal) 2026-04-28 03:58:45.600731 | orchestrator | changed: [testbed-manager] => (item=swift -> https://api.testbed.osism.xyz:6780/swift/v1/AUTH_%(project_id)s -> public) 2026-04-28 03:58:45.600740 | orchestrator | 2026-04-28 03:58:45.600756 | orchestrator | TASK [service-ks-register : ceph-rgw | Creating projects] ********************** 2026-04-28 03:58:45.600764 | orchestrator | Tuesday 28 April 2026 03:58:26 +0000 (0:00:06.839) 0:00:14.611 ********* 2026-04-28 03:58:45.600772 | orchestrator | ok: [testbed-manager] => (item=service) 2026-04-28 03:58:45.600780 | orchestrator | 2026-04-28 03:58:45.600788 | orchestrator | TASK [service-ks-register : ceph-rgw | Creating users] ************************* 2026-04-28 03:58:45.600795 | orchestrator | Tuesday 28 April 2026 03:58:29 +0000 (0:00:03.441) 0:00:18.052 ********* 2026-04-28 03:58:45.600803 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-28 03:58:45.600811 | orchestrator | changed: [testbed-manager] => (item=ceph_rgw -> service) 2026-04-28 03:58:45.600819 | orchestrator | 2026-04-28 03:58:45.600826 | orchestrator | TASK [service-ks-register : ceph-rgw | Creating roles] ************************* 2026-04-28 03:58:45.600834 | orchestrator | Tuesday 28 April 2026 03:58:33 +0000 (0:00:04.019) 0:00:22.072 ********* 2026-04-28 03:58:45.600843 | orchestrator | ok: [testbed-manager] => (item=admin) 2026-04-28 03:58:45.600853 | orchestrator | changed: [testbed-manager] => (item=ResellerAdmin) 2026-04-28 03:58:45.600862 | orchestrator | 2026-04-28 03:58:45.600870 | orchestrator | TASK [service-ks-register : ceph-rgw | Granting user roles] ******************** 2026-04-28 03:58:45.600880 | orchestrator | Tuesday 28 April 2026 03:58:39 +0000 (0:00:06.470) 0:00:28.543 ********* 2026-04-28 03:58:45.600889 | orchestrator | changed: [testbed-manager] => (item=ceph_rgw -> service -> admin) 2026-04-28 03:58:45.600897 | orchestrator | 2026-04-28 03:58:45.600907 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 03:58:45.600916 | orchestrator | testbed-manager : ok=9  changed=5  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 03:58:45.600943 | orchestrator | testbed-node-0 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 03:58:45.600952 | orchestrator | testbed-node-1 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 03:58:45.600962 | orchestrator | testbed-node-2 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 03:58:45.600971 | orchestrator | testbed-node-3 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 03:58:45.600995 | orchestrator | testbed-node-4 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 03:58:45.601005 | orchestrator | testbed-node-5 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 03:58:45.601022 | orchestrator | 2026-04-28 03:58:45.601031 | orchestrator | 2026-04-28 03:58:45.601040 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 03:58:45.601049 | orchestrator | Tuesday 28 April 2026 03:58:45 +0000 (0:00:05.103) 0:00:33.647 ********* 2026-04-28 03:58:45.601058 | orchestrator | =============================================================================== 2026-04-28 03:58:45.601067 | orchestrator | service-ks-register : ceph-rgw | Creating endpoints --------------------- 6.84s 2026-04-28 03:58:45.601076 | orchestrator | service-ks-register : ceph-rgw | Creating roles ------------------------- 6.47s 2026-04-28 03:58:45.601085 | orchestrator | service-ks-register : ceph-rgw | Granting user roles -------------------- 5.10s 2026-04-28 03:58:45.601094 | orchestrator | service-ks-register : ceph-rgw | Creating users ------------------------- 4.02s 2026-04-28 03:58:45.601108 | orchestrator | service-ks-register : ceph-rgw | Creating services ---------------------- 4.02s 2026-04-28 03:58:45.601117 | orchestrator | service-ks-register : ceph-rgw | Creating projects ---------------------- 3.44s 2026-04-28 03:58:45.601126 | orchestrator | ceph-rgw : include_tasks ------------------------------------------------ 1.50s 2026-04-28 03:58:45.601135 | orchestrator | Group hosts based on enabled services ----------------------------------- 1.00s 2026-04-28 03:58:45.601144 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.92s 2026-04-28 03:58:48.139432 | orchestrator | 2026-04-28 03:58:48 | INFO  | Task 5381cd92-3cfa-44aa-9e73-4bf5ae2aadda (gnocchi) was prepared for execution. 2026-04-28 03:58:48.139540 | orchestrator | 2026-04-28 03:58:48 | INFO  | It takes a moment until task 5381cd92-3cfa-44aa-9e73-4bf5ae2aadda (gnocchi) has been started and output is visible here. 2026-04-28 03:58:53.834074 | orchestrator | 2026-04-28 03:58:53.834183 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 03:58:53.834202 | orchestrator | 2026-04-28 03:58:53.834215 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 03:58:53.834228 | orchestrator | Tuesday 28 April 2026 03:58:52 +0000 (0:00:00.285) 0:00:00.285 ********* 2026-04-28 03:58:53.834240 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:58:53.834254 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:58:53.834266 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:58:53.834279 | orchestrator | 2026-04-28 03:58:53.834292 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 03:58:53.834305 | orchestrator | Tuesday 28 April 2026 03:58:53 +0000 (0:00:00.336) 0:00:00.622 ********* 2026-04-28 03:58:53.834318 | orchestrator | ok: [testbed-node-0] => (item=enable_gnocchi_False) 2026-04-28 03:58:53.834330 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: enable_gnocchi_True 2026-04-28 03:58:53.834343 | orchestrator | ok: [testbed-node-1] => (item=enable_gnocchi_False) 2026-04-28 03:58:53.834355 | orchestrator | ok: [testbed-node-2] => (item=enable_gnocchi_False) 2026-04-28 03:58:53.834367 | orchestrator | 2026-04-28 03:58:53.834378 | orchestrator | PLAY [Apply role gnocchi] ****************************************************** 2026-04-28 03:58:53.834391 | orchestrator | skipping: no hosts matched 2026-04-28 03:58:53.834404 | orchestrator | 2026-04-28 03:58:53.834416 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 03:58:53.834429 | orchestrator | testbed-node-0 : ok=2  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 03:58:53.834443 | orchestrator | testbed-node-1 : ok=2  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 03:58:53.834455 | orchestrator | testbed-node-2 : ok=2  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 03:58:53.834467 | orchestrator | 2026-04-28 03:58:53.834479 | orchestrator | 2026-04-28 03:58:53.834492 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 03:58:53.834504 | orchestrator | Tuesday 28 April 2026 03:58:53 +0000 (0:00:00.413) 0:00:01.035 ********* 2026-04-28 03:58:53.834623 | orchestrator | =============================================================================== 2026-04-28 03:58:53.834640 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.41s 2026-04-28 03:58:53.834652 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.34s 2026-04-28 03:58:56.456350 | orchestrator | 2026-04-28 03:58:56 | INFO  | Task 1a57e42f-911f-4b5a-a7c2-1f3edbb5d7d3 (manila) was prepared for execution. 2026-04-28 03:58:56.456455 | orchestrator | 2026-04-28 03:58:56 | INFO  | It takes a moment until task 1a57e42f-911f-4b5a-a7c2-1f3edbb5d7d3 (manila) has been started and output is visible here. 2026-04-28 03:59:38.580838 | orchestrator | 2026-04-28 03:59:38.581013 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 03:59:38.581027 | orchestrator | 2026-04-28 03:59:38.581034 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 03:59:38.581042 | orchestrator | Tuesday 28 April 2026 03:59:01 +0000 (0:00:00.405) 0:00:00.406 ********* 2026-04-28 03:59:38.581049 | orchestrator | ok: [testbed-node-0] 2026-04-28 03:59:38.581057 | orchestrator | ok: [testbed-node-1] 2026-04-28 03:59:38.581063 | orchestrator | ok: [testbed-node-2] 2026-04-28 03:59:38.581070 | orchestrator | 2026-04-28 03:59:38.581077 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 03:59:38.581085 | orchestrator | Tuesday 28 April 2026 03:59:01 +0000 (0:00:00.388) 0:00:00.794 ********* 2026-04-28 03:59:38.581096 | orchestrator | ok: [testbed-node-0] => (item=enable_manila_True) 2026-04-28 03:59:38.581107 | orchestrator | ok: [testbed-node-1] => (item=enable_manila_True) 2026-04-28 03:59:38.581117 | orchestrator | ok: [testbed-node-2] => (item=enable_manila_True) 2026-04-28 03:59:38.581127 | orchestrator | 2026-04-28 03:59:38.581138 | orchestrator | PLAY [Apply role manila] ******************************************************* 2026-04-28 03:59:38.581149 | orchestrator | 2026-04-28 03:59:38.581160 | orchestrator | TASK [manila : include_tasks] ************************************************** 2026-04-28 03:59:38.581171 | orchestrator | Tuesday 28 April 2026 03:59:02 +0000 (0:00:00.488) 0:00:01.282 ********* 2026-04-28 03:59:38.581182 | orchestrator | included: /ansible/roles/manila/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:59:38.581192 | orchestrator | 2026-04-28 03:59:38.581198 | orchestrator | TASK [manila : include_tasks] ************************************************** 2026-04-28 03:59:38.581205 | orchestrator | Tuesday 28 April 2026 03:59:02 +0000 (0:00:00.628) 0:00:01.911 ********* 2026-04-28 03:59:38.581212 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:59:38.581234 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:59:38.581244 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:59:38.581255 | orchestrator | 2026-04-28 03:59:38.581265 | orchestrator | TASK [service-ks-register : manila | Creating services] ************************ 2026-04-28 03:59:38.581275 | orchestrator | Tuesday 28 April 2026 03:59:03 +0000 (0:00:00.521) 0:00:02.432 ********* 2026-04-28 03:59:38.581284 | orchestrator | changed: [testbed-node-0] => (item=manila (share)) 2026-04-28 03:59:38.581294 | orchestrator | changed: [testbed-node-0] => (item=manilav2 (sharev2)) 2026-04-28 03:59:38.581304 | orchestrator | 2026-04-28 03:59:38.581315 | orchestrator | TASK [service-ks-register : manila | Creating endpoints] *********************** 2026-04-28 03:59:38.581325 | orchestrator | Tuesday 28 April 2026 03:59:09 +0000 (0:00:06.446) 0:00:08.878 ********* 2026-04-28 03:59:38.581337 | orchestrator | changed: [testbed-node-0] => (item=manila -> https://api-int.testbed.osism.xyz:8786/v1/%(tenant_id)s -> internal) 2026-04-28 03:59:38.581349 | orchestrator | changed: [testbed-node-0] => (item=manila -> https://api.testbed.osism.xyz:8786/v1/%(tenant_id)s -> public) 2026-04-28 03:59:38.581360 | orchestrator | changed: [testbed-node-0] => (item=manilav2 -> https://api-int.testbed.osism.xyz:8786/v2 -> internal) 2026-04-28 03:59:38.581371 | orchestrator | changed: [testbed-node-0] => (item=manilav2 -> https://api.testbed.osism.xyz:8786/v2 -> public) 2026-04-28 03:59:38.581380 | orchestrator | 2026-04-28 03:59:38.581415 | orchestrator | TASK [service-ks-register : manila | Creating projects] ************************ 2026-04-28 03:59:38.581426 | orchestrator | Tuesday 28 April 2026 03:59:22 +0000 (0:00:12.662) 0:00:21.541 ********* 2026-04-28 03:59:38.581436 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-28 03:59:38.581447 | orchestrator | 2026-04-28 03:59:38.581458 | orchestrator | TASK [service-ks-register : manila | Creating users] *************************** 2026-04-28 03:59:38.581469 | orchestrator | Tuesday 28 April 2026 03:59:25 +0000 (0:00:03.263) 0:00:24.804 ********* 2026-04-28 03:59:38.581480 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-28 03:59:38.581491 | orchestrator | changed: [testbed-node-0] => (item=manila -> service) 2026-04-28 03:59:38.581502 | orchestrator | 2026-04-28 03:59:38.581513 | orchestrator | TASK [service-ks-register : manila | Creating roles] *************************** 2026-04-28 03:59:38.581523 | orchestrator | Tuesday 28 April 2026 03:59:29 +0000 (0:00:03.733) 0:00:28.538 ********* 2026-04-28 03:59:38.581532 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-28 03:59:38.581539 | orchestrator | 2026-04-28 03:59:38.581546 | orchestrator | TASK [service-ks-register : manila | Granting user roles] ********************** 2026-04-28 03:59:38.581553 | orchestrator | Tuesday 28 April 2026 03:59:32 +0000 (0:00:03.139) 0:00:31.677 ********* 2026-04-28 03:59:38.581560 | orchestrator | changed: [testbed-node-0] => (item=manila -> service -> admin) 2026-04-28 03:59:38.581567 | orchestrator | 2026-04-28 03:59:38.581574 | orchestrator | TASK [manila : Ensuring config directories exist] ****************************** 2026-04-28 03:59:38.581582 | orchestrator | Tuesday 28 April 2026 03:59:36 +0000 (0:00:03.709) 0:00:35.387 ********* 2026-04-28 03:59:38.581611 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-28 03:59:38.581622 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-28 03:59:38.581636 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-28 03:59:38.581651 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:59:38.581660 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:59:38.581667 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:59:38.581682 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 03:59:49.883712 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 03:59:49.883841 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 03:59:49.883883 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 03:59:49.883896 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 03:59:49.883907 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 03:59:49.884010 | orchestrator | 2026-04-28 03:59:49.884026 | orchestrator | TASK [manila : include_tasks] ************************************************** 2026-04-28 03:59:49.884039 | orchestrator | Tuesday 28 April 2026 03:59:38 +0000 (0:00:02.493) 0:00:37.881 ********* 2026-04-28 03:59:49.884050 | orchestrator | included: /ansible/roles/manila/tasks/external_ceph.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:59:49.884061 | orchestrator | 2026-04-28 03:59:49.884072 | orchestrator | TASK [manila : Ensuring manila service ceph config subdir exists] ************** 2026-04-28 03:59:49.884083 | orchestrator | Tuesday 28 April 2026 03:59:39 +0000 (0:00:00.612) 0:00:38.494 ********* 2026-04-28 03:59:49.884094 | orchestrator | changed: [testbed-node-0] 2026-04-28 03:59:49.884106 | orchestrator | changed: [testbed-node-1] 2026-04-28 03:59:49.884117 | orchestrator | changed: [testbed-node-2] 2026-04-28 03:59:49.884127 | orchestrator | 2026-04-28 03:59:49.884138 | orchestrator | TASK [manila : Copy over multiple ceph configs for Manila] ********************* 2026-04-28 03:59:49.884149 | orchestrator | Tuesday 28 April 2026 03:59:40 +0000 (0:00:01.078) 0:00:39.572 ********* 2026-04-28 03:59:49.884161 | orchestrator | changed: [testbed-node-1] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-28 03:59:49.884190 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-28 03:59:49.884203 | orchestrator | changed: [testbed-node-0] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-28 03:59:49.884213 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-28 03:59:49.884224 | orchestrator | changed: [testbed-node-2] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-28 03:59:49.884244 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-28 03:59:49.884259 | orchestrator | 2026-04-28 03:59:49.884272 | orchestrator | TASK [manila : Copy over ceph Manila keyrings] ********************************* 2026-04-28 03:59:49.884291 | orchestrator | Tuesday 28 April 2026 03:59:42 +0000 (0:00:01.950) 0:00:41.522 ********* 2026-04-28 03:59:49.884303 | orchestrator | changed: [testbed-node-0] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-28 03:59:49.884316 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-28 03:59:49.884328 | orchestrator | changed: [testbed-node-1] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-28 03:59:49.884340 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-28 03:59:49.884352 | orchestrator | changed: [testbed-node-2] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-28 03:59:49.884365 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-28 03:59:49.884377 | orchestrator | 2026-04-28 03:59:49.884390 | orchestrator | TASK [manila : Ensuring config directory has correct owner and permission] ***** 2026-04-28 03:59:49.884403 | orchestrator | Tuesday 28 April 2026 03:59:43 +0000 (0:00:01.309) 0:00:42.831 ********* 2026-04-28 03:59:49.884416 | orchestrator | ok: [testbed-node-0] => (item=manila-share) 2026-04-28 03:59:49.884430 | orchestrator | ok: [testbed-node-1] => (item=manila-share) 2026-04-28 03:59:49.884441 | orchestrator | ok: [testbed-node-2] => (item=manila-share) 2026-04-28 03:59:49.884451 | orchestrator | 2026-04-28 03:59:49.884462 | orchestrator | TASK [manila : Check if policies shall be overwritten] ************************* 2026-04-28 03:59:49.884473 | orchestrator | Tuesday 28 April 2026 03:59:44 +0000 (0:00:00.732) 0:00:43.564 ********* 2026-04-28 03:59:49.884484 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:59:49.884494 | orchestrator | 2026-04-28 03:59:49.884505 | orchestrator | TASK [manila : Set manila policy file] ***************************************** 2026-04-28 03:59:49.884516 | orchestrator | Tuesday 28 April 2026 03:59:44 +0000 (0:00:00.142) 0:00:43.706 ********* 2026-04-28 03:59:49.884526 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:59:49.884537 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:59:49.884548 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:59:49.884558 | orchestrator | 2026-04-28 03:59:49.884569 | orchestrator | TASK [manila : include_tasks] ************************************************** 2026-04-28 03:59:49.884580 | orchestrator | Tuesday 28 April 2026 03:59:45 +0000 (0:00:00.598) 0:00:44.304 ********* 2026-04-28 03:59:49.884590 | orchestrator | included: /ansible/roles/manila/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 03:59:49.884601 | orchestrator | 2026-04-28 03:59:49.884612 | orchestrator | TASK [service-cert-copy : manila | Copying over extra CA certificates] ********* 2026-04-28 03:59:49.884623 | orchestrator | Tuesday 28 April 2026 03:59:45 +0000 (0:00:00.621) 0:00:44.926 ********* 2026-04-28 03:59:49.884642 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-28 03:59:50.891175 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-28 03:59:50.891301 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-28 03:59:50.891329 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:59:50.891349 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:59:50.891369 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 03:59:50.891437 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 03:59:50.891451 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 03:59:50.891470 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 03:59:50.891481 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 03:59:50.891492 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 03:59:50.891502 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 03:59:50.891521 | orchestrator | 2026-04-28 03:59:50.891534 | orchestrator | TASK [service-cert-copy : manila | Copying over backend internal TLS certificate] *** 2026-04-28 03:59:50.891545 | orchestrator | Tuesday 28 April 2026 03:59:50 +0000 (0:00:04.283) 0:00:49.209 ********* 2026-04-28 03:59:50.891564 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-28 03:59:51.580317 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:59:51.580412 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 03:59:51.580424 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 03:59:51.580432 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:59:51.580441 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-28 03:59:51.580466 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:59:51.580473 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 03:59:51.580492 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 03:59:51.580504 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:59:51.580510 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-28 03:59:51.580517 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:59:51.580523 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 03:59:51.580534 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 03:59:51.580540 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:59:51.580547 | orchestrator | 2026-04-28 03:59:51.580554 | orchestrator | TASK [service-cert-copy : manila | Copying over backend internal TLS key] ****** 2026-04-28 03:59:51.580561 | orchestrator | Tuesday 28 April 2026 03:59:50 +0000 (0:00:00.978) 0:00:50.187 ********* 2026-04-28 03:59:51.580573 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-28 03:59:56.341889 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:59:56.342059 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 03:59:56.342072 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 03:59:56.342098 | orchestrator | skipping: [testbed-node-0] 2026-04-28 03:59:56.342108 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-28 03:59:56.342114 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:59:56.342120 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 03:59:56.342144 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 03:59:56.342151 | orchestrator | skipping: [testbed-node-1] 2026-04-28 03:59:56.342156 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-28 03:59:56.342162 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 03:59:56.342173 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 03:59:56.342179 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 03:59:56.342184 | orchestrator | skipping: [testbed-node-2] 2026-04-28 03:59:56.342190 | orchestrator | 2026-04-28 03:59:56.342197 | orchestrator | TASK [manila : Copying over config.json files for services] ******************** 2026-04-28 03:59:56.342204 | orchestrator | Tuesday 28 April 2026 03:59:51 +0000 (0:00:00.930) 0:00:51.118 ********* 2026-04-28 03:59:56.342219 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-28 04:00:03.882206 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-28 04:00:03.882291 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-28 04:00:03.882317 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:03.882324 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:03.882328 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:03.882353 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:03.882359 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:03.882363 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:03.882372 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:03.882376 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:03.882380 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:03.882384 | orchestrator | 2026-04-28 04:00:03.882390 | orchestrator | TASK [manila : Copying over manila.conf] *************************************** 2026-04-28 04:00:03.882395 | orchestrator | Tuesday 28 April 2026 03:59:56 +0000 (0:00:04.738) 0:00:55.857 ********* 2026-04-28 04:00:03.882404 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-28 04:00:09.158111 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-28 04:00:09.158289 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-28 04:00:09.158319 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:09.158336 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 04:00:09.158351 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:09.158402 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 04:00:09.158419 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:09.158446 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 04:00:09.158460 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:09.158474 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:09.158488 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:09.158504 | orchestrator | 2026-04-28 04:00:09.158519 | orchestrator | TASK [manila : Copying over manila-share.conf] ********************************* 2026-04-28 04:00:09.158535 | orchestrator | Tuesday 28 April 2026 04:00:03 +0000 (0:00:07.313) 0:01:03.170 ********* 2026-04-28 04:00:09.158551 | orchestrator | changed: [testbed-node-0] => (item=manila-share) 2026-04-28 04:00:09.158567 | orchestrator | changed: [testbed-node-2] => (item=manila-share) 2026-04-28 04:00:09.158581 | orchestrator | changed: [testbed-node-1] => (item=manila-share) 2026-04-28 04:00:09.158594 | orchestrator | 2026-04-28 04:00:09.158609 | orchestrator | TASK [manila : Copying over existing policy file] ****************************** 2026-04-28 04:00:09.158623 | orchestrator | Tuesday 28 April 2026 04:00:08 +0000 (0:00:04.549) 0:01:07.719 ********* 2026-04-28 04:00:09.158655 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-28 04:00:12.598303 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 04:00:12.598395 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 04:00:12.598415 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 04:00:12.598430 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:00:12.598447 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-28 04:00:12.598475 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 04:00:12.598506 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 04:00:12.598537 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 04:00:12.598552 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:00:12.598566 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}})  2026-04-28 04:00:12.598580 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 04:00:12.598594 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 04:00:12.598615 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 04:00:12.598636 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:00:12.598645 | orchestrator | 2026-04-28 04:00:12.598653 | orchestrator | TASK [manila : Check manila containers] **************************************** 2026-04-28 04:00:12.598664 | orchestrator | Tuesday 28 April 2026 04:00:09 +0000 (0:00:00.739) 0:01:08.459 ********* 2026-04-28 04:00:12.598688 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-28 04:00:53.473825 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-28 04:00:53.473978 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/manila-api:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786'}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786'}}}}) 2026-04-28 04:00:53.473998 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:53.474067 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:53.474097 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:53.474121 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:53.474130 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:53.474137 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/manila-share:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:53.474143 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:53.474149 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:53.474166 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/manila-data:19.1.1.20251130', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 04:00:53.474172 | orchestrator | 2026-04-28 04:00:53.474180 | orchestrator | TASK [manila : Creating Manila database] *************************************** 2026-04-28 04:00:53.474187 | orchestrator | Tuesday 28 April 2026 04:00:12 +0000 (0:00:03.441) 0:01:11.901 ********* 2026-04-28 04:00:53.474193 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:00:53.474202 | orchestrator | 2026-04-28 04:00:53.474207 | orchestrator | TASK [manila : Creating Manila database user and setting permissions] ********** 2026-04-28 04:00:53.474213 | orchestrator | Tuesday 28 April 2026 04:00:14 +0000 (0:00:02.116) 0:01:14.017 ********* 2026-04-28 04:00:53.474219 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:00:53.474225 | orchestrator | 2026-04-28 04:00:53.474231 | orchestrator | TASK [manila : Running Manila bootstrap container] ***************************** 2026-04-28 04:00:53.474237 | orchestrator | Tuesday 28 April 2026 04:00:17 +0000 (0:00:02.219) 0:01:16.237 ********* 2026-04-28 04:00:53.474243 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:00:53.474249 | orchestrator | 2026-04-28 04:00:53.474254 | orchestrator | TASK [manila : Flush handlers] ************************************************* 2026-04-28 04:00:53.474260 | orchestrator | Tuesday 28 April 2026 04:00:53 +0000 (0:00:36.172) 0:01:52.410 ********* 2026-04-28 04:00:53.474265 | orchestrator | 2026-04-28 04:00:53.474278 | orchestrator | TASK [manila : Flush handlers] ************************************************* 2026-04-28 04:01:40.866806 | orchestrator | Tuesday 28 April 2026 04:00:53 +0000 (0:00:00.093) 0:01:52.503 ********* 2026-04-28 04:01:40.866922 | orchestrator | 2026-04-28 04:01:40.867012 | orchestrator | TASK [manila : Flush handlers] ************************************************* 2026-04-28 04:01:40.867026 | orchestrator | Tuesday 28 April 2026 04:00:53 +0000 (0:00:00.077) 0:01:52.580 ********* 2026-04-28 04:01:40.867038 | orchestrator | 2026-04-28 04:01:40.867049 | orchestrator | RUNNING HANDLER [manila : Restart manila-api container] ************************ 2026-04-28 04:01:40.867060 | orchestrator | Tuesday 28 April 2026 04:00:53 +0000 (0:00:00.073) 0:01:52.654 ********* 2026-04-28 04:01:40.867071 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:01:40.867084 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:01:40.867094 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:01:40.867105 | orchestrator | 2026-04-28 04:01:40.867116 | orchestrator | RUNNING HANDLER [manila : Restart manila-data container] *********************** 2026-04-28 04:01:40.867127 | orchestrator | Tuesday 28 April 2026 04:01:09 +0000 (0:00:16.224) 0:02:08.879 ********* 2026-04-28 04:01:40.867138 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:01:40.867149 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:01:40.867160 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:01:40.867170 | orchestrator | 2026-04-28 04:01:40.867181 | orchestrator | RUNNING HANDLER [manila : Restart manila-scheduler container] ****************** 2026-04-28 04:01:40.867192 | orchestrator | Tuesday 28 April 2026 04:01:20 +0000 (0:00:10.585) 0:02:19.465 ********* 2026-04-28 04:01:40.867203 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:01:40.867214 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:01:40.867224 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:01:40.867264 | orchestrator | 2026-04-28 04:01:40.867276 | orchestrator | RUNNING HANDLER [manila : Restart manila-share container] ********************** 2026-04-28 04:01:40.867287 | orchestrator | Tuesday 28 April 2026 04:01:25 +0000 (0:00:05.671) 0:02:25.136 ********* 2026-04-28 04:01:40.867298 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:01:40.867308 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:01:40.867319 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:01:40.867330 | orchestrator | 2026-04-28 04:01:40.867341 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:01:40.867354 | orchestrator | testbed-node-0 : ok=28  changed=20  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 04:01:40.867366 | orchestrator | testbed-node-1 : ok=19  changed=13  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 04:01:40.867376 | orchestrator | testbed-node-2 : ok=19  changed=13  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 04:01:40.867387 | orchestrator | 2026-04-28 04:01:40.867398 | orchestrator | 2026-04-28 04:01:40.867409 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 04:01:40.867420 | orchestrator | Tuesday 28 April 2026 04:01:40 +0000 (0:00:14.406) 0:02:39.542 ********* 2026-04-28 04:01:40.867430 | orchestrator | =============================================================================== 2026-04-28 04:01:40.867441 | orchestrator | manila : Running Manila bootstrap container ---------------------------- 36.17s 2026-04-28 04:01:40.867452 | orchestrator | manila : Restart manila-api container ---------------------------------- 16.22s 2026-04-28 04:01:40.867463 | orchestrator | manila : Restart manila-share container -------------------------------- 14.41s 2026-04-28 04:01:40.867473 | orchestrator | service-ks-register : manila | Creating endpoints ---------------------- 12.66s 2026-04-28 04:01:40.867484 | orchestrator | manila : Restart manila-data container --------------------------------- 10.59s 2026-04-28 04:01:40.867495 | orchestrator | manila : Copying over manila.conf --------------------------------------- 7.31s 2026-04-28 04:01:40.867505 | orchestrator | service-ks-register : manila | Creating services ------------------------ 6.45s 2026-04-28 04:01:40.867516 | orchestrator | manila : Restart manila-scheduler container ----------------------------- 5.67s 2026-04-28 04:01:40.867542 | orchestrator | manila : Copying over config.json files for services -------------------- 4.74s 2026-04-28 04:01:40.867554 | orchestrator | manila : Copying over manila-share.conf --------------------------------- 4.55s 2026-04-28 04:01:40.867564 | orchestrator | service-cert-copy : manila | Copying over extra CA certificates --------- 4.28s 2026-04-28 04:01:40.867575 | orchestrator | service-ks-register : manila | Creating users --------------------------- 3.73s 2026-04-28 04:01:40.867586 | orchestrator | service-ks-register : manila | Granting user roles ---------------------- 3.71s 2026-04-28 04:01:40.867597 | orchestrator | manila : Check manila containers ---------------------------------------- 3.44s 2026-04-28 04:01:40.867608 | orchestrator | service-ks-register : manila | Creating projects ------------------------ 3.26s 2026-04-28 04:01:40.867618 | orchestrator | service-ks-register : manila | Creating roles --------------------------- 3.14s 2026-04-28 04:01:40.867629 | orchestrator | manila : Ensuring config directories exist ------------------------------ 2.49s 2026-04-28 04:01:40.867640 | orchestrator | manila : Creating Manila database user and setting permissions ---------- 2.22s 2026-04-28 04:01:40.867651 | orchestrator | manila : Creating Manila database --------------------------------------- 2.12s 2026-04-28 04:01:40.867662 | orchestrator | manila : Copy over multiple ceph configs for Manila --------------------- 1.95s 2026-04-28 04:01:41.234213 | orchestrator | + sh -c /opt/configuration/scripts/deploy/400-monitoring.sh 2026-04-28 04:01:53.508974 | orchestrator | 2026-04-28 04:01:53 | INFO  | Task 17954b02-166a-42d2-a247-1443411c718b (netdata) was prepared for execution. 2026-04-28 04:01:53.509072 | orchestrator | 2026-04-28 04:01:53 | INFO  | It takes a moment until task 17954b02-166a-42d2-a247-1443411c718b (netdata) has been started and output is visible here. 2026-04-28 04:03:14.279788 | orchestrator | 2026-04-28 04:03:14.279897 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 04:03:14.279912 | orchestrator | 2026-04-28 04:03:14.279920 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 04:03:14.279928 | orchestrator | Tuesday 28 April 2026 04:01:58 +0000 (0:00:00.249) 0:00:00.249 ********* 2026-04-28 04:03:14.280018 | orchestrator | changed: [testbed-manager] => (item=enable_netdata_True) 2026-04-28 04:03:14.280027 | orchestrator | changed: [testbed-node-0] => (item=enable_netdata_True) 2026-04-28 04:03:14.280034 | orchestrator | changed: [testbed-node-1] => (item=enable_netdata_True) 2026-04-28 04:03:14.280042 | orchestrator | changed: [testbed-node-2] => (item=enable_netdata_True) 2026-04-28 04:03:14.280049 | orchestrator | changed: [testbed-node-3] => (item=enable_netdata_True) 2026-04-28 04:03:14.280057 | orchestrator | changed: [testbed-node-4] => (item=enable_netdata_True) 2026-04-28 04:03:14.280065 | orchestrator | changed: [testbed-node-5] => (item=enable_netdata_True) 2026-04-28 04:03:14.280072 | orchestrator | 2026-04-28 04:03:14.280079 | orchestrator | PLAY [Apply role netdata] ****************************************************** 2026-04-28 04:03:14.280086 | orchestrator | 2026-04-28 04:03:14.280094 | orchestrator | TASK [osism.services.netdata : Include distribution specific install tasks] **** 2026-04-28 04:03:14.280101 | orchestrator | Tuesday 28 April 2026 04:01:59 +0000 (0:00:00.931) 0:00:01.181 ********* 2026-04-28 04:03:14.280110 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/netdata/tasks/install-Debian-family.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 04:03:14.280123 | orchestrator | 2026-04-28 04:03:14.280135 | orchestrator | TASK [osism.services.netdata : Remove old architecture-dependent repository] *** 2026-04-28 04:03:14.280148 | orchestrator | Tuesday 28 April 2026 04:02:00 +0000 (0:00:01.512) 0:00:02.693 ********* 2026-04-28 04:03:14.280161 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:03:14.280174 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:03:14.280186 | orchestrator | ok: [testbed-manager] 2026-04-28 04:03:14.280195 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:03:14.280203 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:03:14.280211 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:03:14.280218 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:03:14.280225 | orchestrator | 2026-04-28 04:03:14.280233 | orchestrator | TASK [osism.services.netdata : Install apt-transport-https package] ************ 2026-04-28 04:03:14.280240 | orchestrator | Tuesday 28 April 2026 04:02:02 +0000 (0:00:01.968) 0:00:04.662 ********* 2026-04-28 04:03:14.280249 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:03:14.280261 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:03:14.280274 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:03:14.280292 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:03:14.280305 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:03:14.280316 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:03:14.280328 | orchestrator | ok: [testbed-manager] 2026-04-28 04:03:14.280339 | orchestrator | 2026-04-28 04:03:14.280351 | orchestrator | TASK [osism.services.netdata : Add repository gpg key] ************************* 2026-04-28 04:03:14.280363 | orchestrator | Tuesday 28 April 2026 04:02:05 +0000 (0:00:02.397) 0:00:07.059 ********* 2026-04-28 04:03:14.280375 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:03:14.280385 | orchestrator | changed: [testbed-manager] 2026-04-28 04:03:14.280395 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:03:14.280407 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:03:14.280419 | orchestrator | changed: [testbed-node-3] 2026-04-28 04:03:14.280431 | orchestrator | changed: [testbed-node-4] 2026-04-28 04:03:14.280442 | orchestrator | changed: [testbed-node-5] 2026-04-28 04:03:14.280453 | orchestrator | 2026-04-28 04:03:14.280464 | orchestrator | TASK [osism.services.netdata : Add repository] ********************************* 2026-04-28 04:03:14.280477 | orchestrator | Tuesday 28 April 2026 04:02:06 +0000 (0:00:01.598) 0:00:08.658 ********* 2026-04-28 04:03:14.280518 | orchestrator | changed: [testbed-node-3] 2026-04-28 04:03:14.280531 | orchestrator | changed: [testbed-manager] 2026-04-28 04:03:14.280543 | orchestrator | changed: [testbed-node-5] 2026-04-28 04:03:14.280555 | orchestrator | changed: [testbed-node-4] 2026-04-28 04:03:14.280567 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:03:14.280579 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:03:14.280591 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:03:14.280603 | orchestrator | 2026-04-28 04:03:14.280629 | orchestrator | TASK [osism.services.netdata : Install package netdata] ************************ 2026-04-28 04:03:14.280637 | orchestrator | Tuesday 28 April 2026 04:02:22 +0000 (0:00:15.380) 0:00:24.039 ********* 2026-04-28 04:03:14.280645 | orchestrator | changed: [testbed-node-3] 2026-04-28 04:03:14.280652 | orchestrator | changed: [testbed-node-5] 2026-04-28 04:03:14.280659 | orchestrator | changed: [testbed-node-4] 2026-04-28 04:03:14.280666 | orchestrator | changed: [testbed-manager] 2026-04-28 04:03:14.280673 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:03:14.280680 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:03:14.280687 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:03:14.280694 | orchestrator | 2026-04-28 04:03:14.280702 | orchestrator | TASK [osism.services.netdata : Include config tasks] *************************** 2026-04-28 04:03:14.280709 | orchestrator | Tuesday 28 April 2026 04:02:47 +0000 (0:00:25.368) 0:00:49.407 ********* 2026-04-28 04:03:14.280717 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/netdata/tasks/config.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 04:03:14.280727 | orchestrator | 2026-04-28 04:03:14.280740 | orchestrator | TASK [osism.services.netdata : Copy configuration files] *********************** 2026-04-28 04:03:14.280750 | orchestrator | Tuesday 28 April 2026 04:02:49 +0000 (0:00:01.758) 0:00:51.166 ********* 2026-04-28 04:03:14.280771 | orchestrator | changed: [testbed-node-0] => (item=netdata.conf) 2026-04-28 04:03:14.280783 | orchestrator | changed: [testbed-manager] => (item=netdata.conf) 2026-04-28 04:03:14.280794 | orchestrator | changed: [testbed-node-1] => (item=netdata.conf) 2026-04-28 04:03:14.280806 | orchestrator | changed: [testbed-node-3] => (item=netdata.conf) 2026-04-28 04:03:14.280838 | orchestrator | changed: [testbed-node-2] => (item=netdata.conf) 2026-04-28 04:03:14.280850 | orchestrator | changed: [testbed-node-4] => (item=netdata.conf) 2026-04-28 04:03:14.280863 | orchestrator | changed: [testbed-node-5] => (item=netdata.conf) 2026-04-28 04:03:14.280875 | orchestrator | changed: [testbed-manager] => (item=stream.conf) 2026-04-28 04:03:14.280924 | orchestrator | changed: [testbed-node-0] => (item=stream.conf) 2026-04-28 04:03:14.280970 | orchestrator | changed: [testbed-node-1] => (item=stream.conf) 2026-04-28 04:03:14.280981 | orchestrator | changed: [testbed-node-3] => (item=stream.conf) 2026-04-28 04:03:14.280992 | orchestrator | changed: [testbed-node-2] => (item=stream.conf) 2026-04-28 04:03:14.281003 | orchestrator | changed: [testbed-node-4] => (item=stream.conf) 2026-04-28 04:03:14.281015 | orchestrator | changed: [testbed-node-5] => (item=stream.conf) 2026-04-28 04:03:14.281026 | orchestrator | 2026-04-28 04:03:14.281037 | orchestrator | TASK [osism.services.netdata : Retrieve /etc/netdata/.opt-out-from-anonymous-statistics status] *** 2026-04-28 04:03:14.281051 | orchestrator | Tuesday 28 April 2026 04:02:53 +0000 (0:00:03.973) 0:00:55.140 ********* 2026-04-28 04:03:14.281064 | orchestrator | ok: [testbed-manager] 2026-04-28 04:03:14.281076 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:03:14.281087 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:03:14.281099 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:03:14.281111 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:03:14.281123 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:03:14.281135 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:03:14.281146 | orchestrator | 2026-04-28 04:03:14.281159 | orchestrator | TASK [osism.services.netdata : Opt out from anonymous statistics] ************** 2026-04-28 04:03:14.281183 | orchestrator | Tuesday 28 April 2026 04:02:54 +0000 (0:00:01.323) 0:00:56.463 ********* 2026-04-28 04:03:14.281195 | orchestrator | changed: [testbed-manager] 2026-04-28 04:03:14.281207 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:03:14.281219 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:03:14.281232 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:03:14.281243 | orchestrator | changed: [testbed-node-3] 2026-04-28 04:03:14.281255 | orchestrator | changed: [testbed-node-4] 2026-04-28 04:03:14.281267 | orchestrator | changed: [testbed-node-5] 2026-04-28 04:03:14.281279 | orchestrator | 2026-04-28 04:03:14.281291 | orchestrator | TASK [osism.services.netdata : Add netdata user to docker group] *************** 2026-04-28 04:03:14.281303 | orchestrator | Tuesday 28 April 2026 04:02:55 +0000 (0:00:01.384) 0:00:57.848 ********* 2026-04-28 04:03:14.281316 | orchestrator | ok: [testbed-manager] 2026-04-28 04:03:14.281328 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:03:14.281340 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:03:14.281353 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:03:14.281364 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:03:14.281376 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:03:14.281388 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:03:14.281400 | orchestrator | 2026-04-28 04:03:14.281412 | orchestrator | TASK [osism.services.netdata : Manage service netdata] ************************* 2026-04-28 04:03:14.281425 | orchestrator | Tuesday 28 April 2026 04:02:57 +0000 (0:00:01.338) 0:00:59.186 ********* 2026-04-28 04:03:14.281437 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:03:14.281450 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:03:14.281462 | orchestrator | ok: [testbed-manager] 2026-04-28 04:03:14.281473 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:03:14.281486 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:03:14.281499 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:03:14.281511 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:03:14.281523 | orchestrator | 2026-04-28 04:03:14.281534 | orchestrator | TASK [osism.services.netdata : Include host type specific tasks] *************** 2026-04-28 04:03:14.281546 | orchestrator | Tuesday 28 April 2026 04:02:58 +0000 (0:00:01.728) 0:01:00.914 ********* 2026-04-28 04:03:14.281558 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/netdata/tasks/server.yml for testbed-manager 2026-04-28 04:03:14.281572 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/netdata/tasks/client.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 04:03:14.281587 | orchestrator | 2026-04-28 04:03:14.281599 | orchestrator | TASK [osism.services.netdata : Set sysctl vm.max_map_count parameter] ********** 2026-04-28 04:03:14.281620 | orchestrator | Tuesday 28 April 2026 04:03:00 +0000 (0:00:01.529) 0:01:02.443 ********* 2026-04-28 04:03:14.281632 | orchestrator | changed: [testbed-manager] 2026-04-28 04:03:14.281644 | orchestrator | 2026-04-28 04:03:14.281656 | orchestrator | RUNNING HANDLER [osism.services.netdata : Restart service netdata] ************* 2026-04-28 04:03:14.281668 | orchestrator | Tuesday 28 April 2026 04:03:02 +0000 (0:00:02.364) 0:01:04.808 ********* 2026-04-28 04:03:14.281678 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:03:14.281688 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:03:14.281698 | orchestrator | changed: [testbed-node-3] 2026-04-28 04:03:14.281708 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:03:14.281718 | orchestrator | changed: [testbed-node-4] 2026-04-28 04:03:14.281729 | orchestrator | changed: [testbed-node-5] 2026-04-28 04:03:14.281741 | orchestrator | changed: [testbed-manager] 2026-04-28 04:03:14.281753 | orchestrator | 2026-04-28 04:03:14.281766 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:03:14.281777 | orchestrator | testbed-manager : ok=16  changed=8  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 04:03:14.281789 | orchestrator | testbed-node-0 : ok=15  changed=7  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 04:03:14.281809 | orchestrator | testbed-node-1 : ok=15  changed=7  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 04:03:14.281821 | orchestrator | testbed-node-2 : ok=15  changed=7  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 04:03:14.281845 | orchestrator | testbed-node-3 : ok=15  changed=7  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 04:03:14.831386 | orchestrator | testbed-node-4 : ok=15  changed=7  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 04:03:14.831462 | orchestrator | testbed-node-5 : ok=15  changed=7  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 04:03:14.831470 | orchestrator | 2026-04-28 04:03:14.831476 | orchestrator | 2026-04-28 04:03:14.831481 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 04:03:14.831487 | orchestrator | Tuesday 28 April 2026 04:03:14 +0000 (0:00:11.436) 0:01:16.244 ********* 2026-04-28 04:03:14.831492 | orchestrator | =============================================================================== 2026-04-28 04:03:14.831497 | orchestrator | osism.services.netdata : Install package netdata ----------------------- 25.37s 2026-04-28 04:03:14.831502 | orchestrator | osism.services.netdata : Add repository -------------------------------- 15.38s 2026-04-28 04:03:14.831507 | orchestrator | osism.services.netdata : Restart service netdata ----------------------- 11.44s 2026-04-28 04:03:14.831511 | orchestrator | osism.services.netdata : Copy configuration files ----------------------- 3.97s 2026-04-28 04:03:14.831516 | orchestrator | osism.services.netdata : Install apt-transport-https package ------------ 2.40s 2026-04-28 04:03:14.831520 | orchestrator | osism.services.netdata : Set sysctl vm.max_map_count parameter ---------- 2.36s 2026-04-28 04:03:14.831524 | orchestrator | osism.services.netdata : Remove old architecture-dependent repository --- 1.97s 2026-04-28 04:03:14.831529 | orchestrator | osism.services.netdata : Include config tasks --------------------------- 1.76s 2026-04-28 04:03:14.831533 | orchestrator | osism.services.netdata : Manage service netdata ------------------------- 1.73s 2026-04-28 04:03:14.831538 | orchestrator | osism.services.netdata : Add repository gpg key ------------------------- 1.60s 2026-04-28 04:03:14.831542 | orchestrator | osism.services.netdata : Include host type specific tasks --------------- 1.53s 2026-04-28 04:03:14.831547 | orchestrator | osism.services.netdata : Include distribution specific install tasks ---- 1.51s 2026-04-28 04:03:14.831552 | orchestrator | osism.services.netdata : Opt out from anonymous statistics -------------- 1.38s 2026-04-28 04:03:14.831556 | orchestrator | osism.services.netdata : Add netdata user to docker group --------------- 1.34s 2026-04-28 04:03:14.831561 | orchestrator | osism.services.netdata : Retrieve /etc/netdata/.opt-out-from-anonymous-statistics status --- 1.32s 2026-04-28 04:03:14.831566 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.93s 2026-04-28 04:03:20.928523 | orchestrator | 2026-04-28 04:03:20 | INFO  | Task d93aabfe-c9ea-4616-8de0-a034685e4532 (prometheus) was prepared for execution. 2026-04-28 04:03:20.928625 | orchestrator | 2026-04-28 04:03:20 | INFO  | It takes a moment until task d93aabfe-c9ea-4616-8de0-a034685e4532 (prometheus) has been started and output is visible here. 2026-04-28 04:03:31.095419 | orchestrator | 2026-04-28 04:03:31.095515 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 04:03:31.095526 | orchestrator | 2026-04-28 04:03:31.095533 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 04:03:31.095540 | orchestrator | Tuesday 28 April 2026 04:03:25 +0000 (0:00:00.297) 0:00:00.297 ********* 2026-04-28 04:03:31.095547 | orchestrator | ok: [testbed-manager] 2026-04-28 04:03:31.095554 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:03:31.095561 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:03:31.095568 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:03:31.095597 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:03:31.095603 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:03:31.095610 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:03:31.095616 | orchestrator | 2026-04-28 04:03:31.095623 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 04:03:31.095642 | orchestrator | Tuesday 28 April 2026 04:03:26 +0000 (0:00:00.946) 0:00:01.243 ********* 2026-04-28 04:03:31.095649 | orchestrator | ok: [testbed-manager] => (item=enable_prometheus_True) 2026-04-28 04:03:31.095656 | orchestrator | ok: [testbed-node-0] => (item=enable_prometheus_True) 2026-04-28 04:03:31.095662 | orchestrator | ok: [testbed-node-1] => (item=enable_prometheus_True) 2026-04-28 04:03:31.095668 | orchestrator | ok: [testbed-node-2] => (item=enable_prometheus_True) 2026-04-28 04:03:31.095674 | orchestrator | ok: [testbed-node-3] => (item=enable_prometheus_True) 2026-04-28 04:03:31.095680 | orchestrator | ok: [testbed-node-4] => (item=enable_prometheus_True) 2026-04-28 04:03:31.095687 | orchestrator | ok: [testbed-node-5] => (item=enable_prometheus_True) 2026-04-28 04:03:31.095693 | orchestrator | 2026-04-28 04:03:31.095699 | orchestrator | PLAY [Apply role prometheus] *************************************************** 2026-04-28 04:03:31.095705 | orchestrator | 2026-04-28 04:03:31.095711 | orchestrator | TASK [prometheus : include_tasks] ********************************************** 2026-04-28 04:03:31.095717 | orchestrator | Tuesday 28 April 2026 04:03:27 +0000 (0:00:01.006) 0:00:02.249 ********* 2026-04-28 04:03:31.095724 | orchestrator | included: /ansible/roles/prometheus/tasks/deploy.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 04:03:31.095731 | orchestrator | 2026-04-28 04:03:31.095737 | orchestrator | TASK [prometheus : Ensuring config directories exist] ************************** 2026-04-28 04:03:31.095743 | orchestrator | Tuesday 28 April 2026 04:03:29 +0000 (0:00:01.517) 0:00:03.767 ********* 2026-04-28 04:03:31.095754 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}}) 2026-04-28 04:03:31.095763 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:03:31.095770 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:03:31.095776 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:03:31.095804 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:03:31.095814 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:31.095823 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:31.095829 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:03:31.095836 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:03:31.095845 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:03:31.095851 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:03:31.095868 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:32.307016 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:32.307115 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:32.307126 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:03:32.307133 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 04:03:32.307140 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}}) 2026-04-28 04:03:32.307147 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:03:32.307179 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:03:32.307187 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:32.307192 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:03:32.307197 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:03:32.307202 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 04:03:32.307206 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:32.307211 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:32.307221 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:32.307230 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:03:37.985816 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 04:03:37.985907 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:37.985919 | orchestrator | 2026-04-28 04:03:37.985984 | orchestrator | TASK [prometheus : include_tasks] ********************************************** 2026-04-28 04:03:37.985998 | orchestrator | Tuesday 28 April 2026 04:03:32 +0000 (0:00:03.250) 0:00:07.017 ********* 2026-04-28 04:03:37.986007 | orchestrator | included: /ansible/roles/prometheus/tasks/copy-certs.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 04:03:37.986066 | orchestrator | 2026-04-28 04:03:37.986076 | orchestrator | TASK [service-cert-copy : prometheus | Copying over extra CA certificates] ***** 2026-04-28 04:03:37.986084 | orchestrator | Tuesday 28 April 2026 04:03:33 +0000 (0:00:01.558) 0:00:08.576 ********* 2026-04-28 04:03:37.986093 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:03:37.986102 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:03:37.986130 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}}) 2026-04-28 04:03:37.986140 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:03:37.986169 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:03:37.986179 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:03:37.986187 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:37.986196 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:37.986204 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:03:37.986227 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:03:37.986241 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:03:37.986256 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:03:37.986284 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:40.316735 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:40.316829 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:03:40.316843 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:40.316874 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:03:40.316920 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 04:03:40.316989 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 04:03:40.316999 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:40.317036 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}}) 2026-04-28 04:03:40.317046 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:03:40.317053 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:03:40.317069 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 04:03:40.317076 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:03:40.317084 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:40.317095 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:40.317109 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:41.402877 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:41.403030 | orchestrator | 2026-04-28 04:03:41.403056 | orchestrator | TASK [service-cert-copy : prometheus | Copying over backend internal TLS certificate] *** 2026-04-28 04:03:41.403066 | orchestrator | Tuesday 28 April 2026 04:03:40 +0000 (0:00:06.451) 0:00:15.028 ********* 2026-04-28 04:03:41.403099 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}})  2026-04-28 04:03:41.403110 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 04:03:41.403118 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 04:03:41.403143 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}})  2026-04-28 04:03:41.403168 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:03:41.403177 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:03:41.403185 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 04:03:41.403199 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:03:41.403207 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:03:41.403215 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 04:03:41.403223 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:03:41.403230 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 04:03:41.403238 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:03:41.403251 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:03:41.403266 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:03:42.058216 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 04:03:42.058326 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:03:42.058338 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:03:42.058349 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 04:03:42.058358 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:03:42.058367 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:03:42.058376 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 04:03:42.058384 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:03:42.058391 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:03:42.058413 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 04:03:42.058432 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 04:03:42.058440 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 04:03:42.058448 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:03:42.058456 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 04:03:42.058463 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 04:03:42.058471 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 04:03:42.058479 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:03:42.058528 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 04:03:42.058544 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 04:03:42.977129 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 04:03:42.977216 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:03:42.977228 | orchestrator | 2026-04-28 04:03:42.977236 | orchestrator | TASK [service-cert-copy : prometheus | Copying over backend internal TLS key] *** 2026-04-28 04:03:42.977244 | orchestrator | Tuesday 28 April 2026 04:03:42 +0000 (0:00:01.740) 0:00:16.768 ********* 2026-04-28 04:03:42.977252 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}})  2026-04-28 04:03:42.977260 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 04:03:42.977269 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 04:03:42.977294 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}})  2026-04-28 04:03:42.977331 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:03:42.977339 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 04:03:42.977345 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:03:42.977352 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:03:42.977359 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 04:03:42.977365 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:03:42.977372 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 04:03:42.977387 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:03:42.977400 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:03:44.293691 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 04:03:44.293778 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:03:44.293786 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:03:44.293793 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:03:44.293797 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:03:44.293801 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 04:03:44.293806 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:03:44.293811 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:03:44.293850 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 04:03:44.293858 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:03:44.293864 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:03:44.293885 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 04:03:44.293892 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 04:03:44.293898 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 04:03:44.293904 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:03:44.293910 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 04:03:44.293915 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 04:03:44.293929 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 04:03:44.294092 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:03:44.294105 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 04:03:44.294123 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 04:03:48.067543 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 04:03:48.067651 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:03:48.067666 | orchestrator | 2026-04-28 04:03:48.067677 | orchestrator | TASK [prometheus : Copying over config.json files] ***************************** 2026-04-28 04:03:48.067688 | orchestrator | Tuesday 28 April 2026 04:03:44 +0000 (0:00:02.223) 0:00:18.991 ********* 2026-04-28 04:03:48.067698 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}}) 2026-04-28 04:03:48.067709 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:03:48.067738 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:03:48.067753 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:03:48.067815 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:03:48.067841 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:03:48.067851 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:03:48.067860 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:03:48.067869 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:48.067878 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:48.067895 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:03:48.067911 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:03:48.067921 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:03:48.067969 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:51.165820 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:03:51.166004 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:51.166081 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:51.166122 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 04:03:51.166135 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 04:03:51.166163 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}}) 2026-04-28 04:03:51.166199 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 04:03:51.166212 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:51.166223 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:03:51.166236 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:03:51.166257 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:51.166268 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:03:51.166285 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:51.166297 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:51.166318 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:03:55.478308 | orchestrator | 2026-04-28 04:03:55.478416 | orchestrator | TASK [prometheus : Find custom prometheus alert rules files] ******************* 2026-04-28 04:03:55.478430 | orchestrator | Tuesday 28 April 2026 04:03:51 +0000 (0:00:06.882) 0:00:25.874 ********* 2026-04-28 04:03:55.478439 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-28 04:03:55.478450 | orchestrator | 2026-04-28 04:03:55.478459 | orchestrator | TASK [prometheus : Copying over custom prometheus alert rules files] *********** 2026-04-28 04:03:55.478467 | orchestrator | Tuesday 28 April 2026 04:03:52 +0000 (0:00:01.114) 0:00:26.988 ********* 2026-04-28 04:03:55.478479 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/fluentd-aggregator.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 996, 'inode': 1102330, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1863396, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:55.478516 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/fluentd-aggregator.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 996, 'inode': 1102330, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1863396, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:55.478526 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/fluentd-aggregator.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 996, 'inode': 1102330, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1863396, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 04:03:55.478551 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/prometheus.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12980, 'inode': 1102362, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.20118, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:55.478563 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/prometheus.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12980, 'inode': 1102362, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.20118, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:55.478573 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/fluentd-aggregator.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 996, 'inode': 1102330, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1863396, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:55.478601 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/fluentd-aggregator.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 996, 'inode': 1102330, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1863396, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:55.478618 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/fluentd-aggregator.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 996, 'inode': 1102330, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1863396, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:55.478628 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/fluentd-aggregator.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 996, 'inode': 1102330, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1863396, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:55.478637 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/ceph.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 55956, 'inode': 1102327, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1843398, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:55.478650 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/prometheus.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12980, 'inode': 1102362, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.20118, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:55.478660 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/ceph.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 55956, 'inode': 1102327, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1843398, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:55.478670 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/ceph.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 55956, 'inode': 1102327, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1843398, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:55.478687 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/prometheus.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12980, 'inode': 1102362, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.20118, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:57.411358 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/prometheus.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12980, 'inode': 1102362, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.20118, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:57.411471 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/prometheus.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12980, 'inode': 1102362, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.20118, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:57.411486 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/openstack.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12293, 'inode': 1102339, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.191186, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:57.411515 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/openstack.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12293, 'inode': 1102339, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.191186, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:57.411525 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/cadvisor.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3900, 'inode': 1102325, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.182892, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:57.411534 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/openstack.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12293, 'inode': 1102339, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.191186, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:57.411544 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/prometheus.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12980, 'inode': 1102362, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.20118, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 04:03:57.411593 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/ceph.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 55956, 'inode': 1102327, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1843398, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:57.411604 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/ceph.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 55956, 'inode': 1102327, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1843398, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:57.411613 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/ceph.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 55956, 'inode': 1102327, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1843398, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:57.411622 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/cadvisor.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3900, 'inode': 1102325, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.182892, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:57.411636 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/openstack.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12293, 'inode': 1102339, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.191186, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:57.411645 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/haproxy.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7933, 'inode': 1102332, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1880994, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:57.411654 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/openstack.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12293, 'inode': 1102339, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.191186, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:57.411676 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/cadvisor.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3900, 'inode': 1102325, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.182892, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:59.381525 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/openstack.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12293, 'inode': 1102339, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.191186, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:59.381630 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/cadvisor.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3900, 'inode': 1102325, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.182892, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:59.381646 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/haproxy.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7933, 'inode': 1102332, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1880994, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:59.381675 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/node.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 13522, 'inode': 1102338, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1907508, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:59.381686 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/haproxy.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7933, 'inode': 1102332, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1880994, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:59.381720 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/cadvisor.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3900, 'inode': 1102325, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.182892, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:59.381732 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/cadvisor.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3900, 'inode': 1102325, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.182892, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:59.381760 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/node.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 13522, 'inode': 1102338, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1907508, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:59.381771 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/haproxy.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7933, 'inode': 1102332, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1880994, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:59.381781 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/ceph.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 55956, 'inode': 1102327, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1843398, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 04:03:59.381796 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/haproxy.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7933, 'inode': 1102332, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1880994, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:59.381807 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/hardware.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5593, 'inode': 1102333, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.188804, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:59.381827 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/haproxy.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7933, 'inode': 1102332, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1880994, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:59.381838 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/hardware.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5593, 'inode': 1102333, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.188804, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:03:59.381878 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/node.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 13522, 'inode': 1102338, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1907508, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:01.128281 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/node.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 13522, 'inode': 1102338, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1907508, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:01.128396 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/elasticsearch.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5987, 'inode': 1102328, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1853397, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:01.128435 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/node.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 13522, 'inode': 1102338, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1907508, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:01.128450 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/elasticsearch.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5987, 'inode': 1102328, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1853397, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:01.128490 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/node.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 13522, 'inode': 1102338, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1907508, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:01.128519 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/hardware.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5593, 'inode': 1102333, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.188804, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:01.128530 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/hardware.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5593, 'inode': 1102333, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.188804, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:01.128557 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/prometheus.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1102359, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.2005737, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:01.128572 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/openstack.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12293, 'inode': 1102339, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.191186, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 04:04:01.128592 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/prometheus.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1102359, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.2005737, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:01.128606 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/hardware.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5593, 'inode': 1102333, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.188804, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:01.128630 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/alertmanager.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1102322, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1819685, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:01.128644 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/alertmanager.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1102322, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1819685, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:01.128658 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/elasticsearch.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5987, 'inode': 1102328, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1853397, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:01.128683 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/elasticsearch.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5987, 'inode': 1102328, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1853397, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:03.151146 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/elasticsearch.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5987, 'inode': 1102328, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1853397, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:03.151307 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/hardware.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5593, 'inode': 1102333, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.188804, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:03.151368 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/redfish.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 334, 'inode': 1103115, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.3653336, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:03.151383 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/redfish.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 334, 'inode': 1103115, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.3653336, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:03.151395 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/prometheus-extra.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7408, 'inode': 1102356, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.198852, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:03.151406 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/prometheus.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1102359, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.2005737, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:03.151418 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/prometheus.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1102359, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.2005737, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:03.151451 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/ceph.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1102326, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1833668, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:03.151470 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/elasticsearch.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5987, 'inode': 1102328, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1853397, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:03.151490 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/prometheus.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1102359, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.2005737, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:03.151501 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/alertmanager.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1102322, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1819685, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:03.151513 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/cadvisor.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3900, 'inode': 1102325, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.182892, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 04:04:03.151524 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/alertmanager.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5051, 'inode': 1102323, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1825652, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:03.151536 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/prometheus-extra.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7408, 'inode': 1102356, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.198852, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:03.151555 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/prometheus.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1102359, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.2005737, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:04.781700 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/alertmanager.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1102322, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1819685, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:04.781839 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/alertmanager.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1102322, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1819685, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:04.781863 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/ceph.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1102326, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1833668, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:04.781877 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/node.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2309, 'inode': 1102337, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1893396, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:04.781890 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/redfish.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 334, 'inode': 1103115, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.3653336, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:04.781902 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/redfish.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 334, 'inode': 1103115, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.3653336, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:04.781914 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/redfish.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 334, 'inode': 1103115, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.3653336, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:04.781993 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/alertmanager.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1102322, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1819685, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:04.782009 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/prometheus-extra.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7408, 'inode': 1102356, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.198852, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:04.782071 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/prometheus-extra.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7408, 'inode': 1102356, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.198852, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:04.782079 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/alertmanager.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5051, 'inode': 1102323, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1825652, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:04.782087 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/ceph.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1102326, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1833668, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:04.782095 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/mysql.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3792, 'inode': 1102335, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.189227, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:04.782102 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/ceph.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1102326, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1833668, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:04.782133 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/prometheus-extra.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7408, 'inode': 1102356, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.198852, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:06.869335 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/alertmanager.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5051, 'inode': 1102323, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1825652, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:06.869424 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/node.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2309, 'inode': 1102337, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1893396, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:06.869494 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/redfish.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 334, 'inode': 1103115, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.3653336, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:06.869502 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/alertmanager.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5051, 'inode': 1102323, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1825652, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:06.869506 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/haproxy.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7933, 'inode': 1102332, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1880994, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 04:04:06.869511 | orchestrator | skipping: [testbed-node-1] => (item={'path': '/operations/prometheus/rabbitmq.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3539, 'inode': 1103113, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.3643336, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:06.869534 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:04:06.869551 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/node.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2309, 'inode': 1102337, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1893396, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:06.869570 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/mysql.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3792, 'inode': 1102335, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.189227, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:06.869575 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/prometheus-extra.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7408, 'inode': 1102356, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.198852, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:06.869580 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/ceph.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1102326, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1833668, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:06.869584 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/mysql.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3792, 'inode': 1102335, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.189227, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:06.869589 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/node.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2309, 'inode': 1102337, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1893396, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:06.869594 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/ceph.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1102326, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1833668, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:06.869606 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/alertmanager.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5051, 'inode': 1102323, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1825652, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:06.869615 | orchestrator | skipping: [testbed-node-0] => (item={'path': '/operations/prometheus/rabbitmq.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3539, 'inode': 1103113, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.3643336, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:13.677235 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:04:13.677362 | orchestrator | skipping: [testbed-node-5] => (item={'path': '/operations/prometheus/rabbitmq.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3539, 'inode': 1103113, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.3643336, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:13.677390 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:04:13.677412 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/node.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2309, 'inode': 1102337, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1893396, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:13.677432 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/alertmanager.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5051, 'inode': 1102323, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1825652, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:13.677451 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/mysql.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3792, 'inode': 1102335, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.189227, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:13.677504 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/node.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 13522, 'inode': 1102338, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1907508, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 04:04:13.677544 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/node.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2309, 'inode': 1102337, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1893396, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:13.677588 | orchestrator | skipping: [testbed-node-2] => (item={'path': '/operations/prometheus/rabbitmq.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3539, 'inode': 1103113, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.3643336, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:13.677609 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:04:13.677628 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/mysql.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3792, 'inode': 1102335, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.189227, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:13.677648 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/mysql.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3792, 'inode': 1102335, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.189227, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:13.677667 | orchestrator | skipping: [testbed-node-3] => (item={'path': '/operations/prometheus/rabbitmq.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3539, 'inode': 1103113, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.3643336, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:13.677686 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:04:13.677704 | orchestrator | skipping: [testbed-node-4] => (item={'path': '/operations/prometheus/rabbitmq.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3539, 'inode': 1103113, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.3643336, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False})  2026-04-28 04:04:13.677735 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:04:13.677755 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/hardware.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5593, 'inode': 1102333, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.188804, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 04:04:13.677782 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/elasticsearch.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5987, 'inode': 1102328, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1853397, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 04:04:13.677816 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/prometheus.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1102359, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.2005737, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 04:04:43.140893 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/alertmanager.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1102322, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1819685, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 04:04:43.141058 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/redfish.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 334, 'inode': 1103115, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.3653336, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 04:04:43.141072 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/prometheus-extra.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 7408, 'inode': 1102356, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.198852, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 04:04:43.141101 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/ceph.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3, 'inode': 1102326, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1833668, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 04:04:43.141108 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/alertmanager.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 5051, 'inode': 1102323, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1825652, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 04:04:43.141127 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/node.rec.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2309, 'inode': 1102337, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1893396, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 04:04:43.141134 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/mysql.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3792, 'inode': 1102335, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.189227, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 04:04:43.141156 | orchestrator | changed: [testbed-manager] => (item={'path': '/operations/prometheus/rabbitmq.rules', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 3539, 'inode': 1103113, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.3643336, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2026-04-28 04:04:43.141164 | orchestrator | 2026-04-28 04:04:43.141173 | orchestrator | TASK [prometheus : Find prometheus common config overrides] ******************** 2026-04-28 04:04:43.141181 | orchestrator | Tuesday 28 April 2026 04:04:21 +0000 (0:00:29.397) 0:00:56.385 ********* 2026-04-28 04:04:43.141187 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-28 04:04:43.141195 | orchestrator | 2026-04-28 04:04:43.141202 | orchestrator | TASK [prometheus : Find prometheus host config overrides] ********************** 2026-04-28 04:04:43.141209 | orchestrator | Tuesday 28 April 2026 04:04:22 +0000 (0:00:00.850) 0:00:57.236 ********* 2026-04-28 04:04:43.141214 | orchestrator | [WARNING]: Skipped 2026-04-28 04:04:43.141219 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 04:04:43.141224 | orchestrator | node-0/prometheus.yml.d' path due to this access issue: 2026-04-28 04:04:43.141228 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 04:04:43.141236 | orchestrator | node-0/prometheus.yml.d' is not a directory 2026-04-28 04:04:43.141240 | orchestrator | [WARNING]: Skipped 2026-04-28 04:04:43.141244 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 04:04:43.141248 | orchestrator | manager/prometheus.yml.d' path due to this access issue: 2026-04-28 04:04:43.141252 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 04:04:43.141255 | orchestrator | manager/prometheus.yml.d' is not a directory 2026-04-28 04:04:43.141259 | orchestrator | [WARNING]: Skipped 2026-04-28 04:04:43.141263 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 04:04:43.141267 | orchestrator | node-1/prometheus.yml.d' path due to this access issue: 2026-04-28 04:04:43.141270 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 04:04:43.141274 | orchestrator | node-1/prometheus.yml.d' is not a directory 2026-04-28 04:04:43.141278 | orchestrator | [WARNING]: Skipped 2026-04-28 04:04:43.141282 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 04:04:43.141286 | orchestrator | node-3/prometheus.yml.d' path due to this access issue: 2026-04-28 04:04:43.141289 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 04:04:43.141301 | orchestrator | node-3/prometheus.yml.d' is not a directory 2026-04-28 04:04:43.141306 | orchestrator | [WARNING]: Skipped 2026-04-28 04:04:43.141312 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 04:04:43.141318 | orchestrator | node-2/prometheus.yml.d' path due to this access issue: 2026-04-28 04:04:43.141324 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 04:04:43.141330 | orchestrator | node-2/prometheus.yml.d' is not a directory 2026-04-28 04:04:43.141337 | orchestrator | [WARNING]: Skipped 2026-04-28 04:04:43.141343 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 04:04:43.141349 | orchestrator | node-4/prometheus.yml.d' path due to this access issue: 2026-04-28 04:04:43.141356 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 04:04:43.141362 | orchestrator | node-4/prometheus.yml.d' is not a directory 2026-04-28 04:04:43.141368 | orchestrator | [WARNING]: Skipped 2026-04-28 04:04:43.141374 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 04:04:43.141380 | orchestrator | node-5/prometheus.yml.d' path due to this access issue: 2026-04-28 04:04:43.141387 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 04:04:43.141393 | orchestrator | node-5/prometheus.yml.d' is not a directory 2026-04-28 04:04:43.141400 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 04:04:43.141410 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-28 04:04:43.141416 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-28 04:04:43.141422 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 04:04:43.141427 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-28 04:04:43.141434 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 04:04:43.141441 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 04:04:43.141447 | orchestrator | 2026-04-28 04:04:43.141453 | orchestrator | TASK [prometheus : Copying over prometheus config file] ************************ 2026-04-28 04:04:43.141459 | orchestrator | Tuesday 28 April 2026 04:04:24 +0000 (0:00:01.930) 0:00:59.166 ********* 2026-04-28 04:04:43.141465 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-28 04:04:43.141473 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-28 04:04:43.141480 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:04:43.141486 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:04:43.141498 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-28 04:04:43.141504 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:04:43.141516 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-28 04:05:01.193905 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:05:01.194076 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-28 04:05:01.194090 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:05:01.194098 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-28 04:05:01.194106 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:05:01.194113 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2) 2026-04-28 04:05:01.194121 | orchestrator | 2026-04-28 04:05:01.194130 | orchestrator | TASK [prometheus : Copying over prometheus web config file] ******************** 2026-04-28 04:05:01.194138 | orchestrator | Tuesday 28 April 2026 04:04:43 +0000 (0:00:18.678) 0:01:17.845 ********* 2026-04-28 04:05:01.194146 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-28 04:05:01.194153 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-28 04:05:01.194161 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:05:01.194168 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:05:01.194175 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-28 04:05:01.194183 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:05:01.194190 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-28 04:05:01.194197 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:05:01.194204 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-28 04:05:01.194212 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:05:01.194219 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-28 04:05:01.194226 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:05:01.194234 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2) 2026-04-28 04:05:01.194241 | orchestrator | 2026-04-28 04:05:01.194248 | orchestrator | TASK [prometheus : Copying over prometheus alertmanager config file] *********** 2026-04-28 04:05:01.194256 | orchestrator | Tuesday 28 April 2026 04:04:46 +0000 (0:00:03.089) 0:01:20.935 ********* 2026-04-28 04:05:01.194263 | orchestrator | skipping: [testbed-node-0] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-28 04:05:01.194272 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:05:01.194280 | orchestrator | skipping: [testbed-node-1] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-28 04:05:01.194287 | orchestrator | skipping: [testbed-node-2] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-28 04:05:01.194296 | orchestrator | skipping: [testbed-node-3] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-28 04:05:01.194303 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:05:01.194311 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:05:01.194318 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:05:01.194325 | orchestrator | changed: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml) 2026-04-28 04:05:01.194333 | orchestrator | skipping: [testbed-node-4] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-28 04:05:01.194364 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:05:01.194372 | orchestrator | skipping: [testbed-node-5] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-28 04:05:01.194379 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:05:01.194386 | orchestrator | 2026-04-28 04:05:01.194394 | orchestrator | TASK [prometheus : Find custom Alertmanager alert notification templates] ****** 2026-04-28 04:05:01.194401 | orchestrator | Tuesday 28 April 2026 04:04:48 +0000 (0:00:01.813) 0:01:22.748 ********* 2026-04-28 04:05:01.194408 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-28 04:05:01.194416 | orchestrator | 2026-04-28 04:05:01.194435 | orchestrator | TASK [prometheus : Copying over custom Alertmanager alert notification templates] *** 2026-04-28 04:05:01.194444 | orchestrator | Tuesday 28 April 2026 04:04:48 +0000 (0:00:00.819) 0:01:23.568 ********* 2026-04-28 04:05:01.194453 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:05:01.194462 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:05:01.194470 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:05:01.194478 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:05:01.194487 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:05:01.194495 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:05:01.194504 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:05:01.194512 | orchestrator | 2026-04-28 04:05:01.194523 | orchestrator | TASK [prometheus : Copying over my.cnf for mysqld_exporter] ******************** 2026-04-28 04:05:01.194536 | orchestrator | Tuesday 28 April 2026 04:04:49 +0000 (0:00:00.797) 0:01:24.366 ********* 2026-04-28 04:05:01.194548 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:05:01.194561 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:05:01.194573 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:05:01.194585 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:05:01.194597 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:05:01.194610 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:05:01.194622 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:05:01.194635 | orchestrator | 2026-04-28 04:05:01.194647 | orchestrator | TASK [prometheus : Copying cloud config file for openstack exporter] *********** 2026-04-28 04:05:01.194676 | orchestrator | Tuesday 28 April 2026 04:04:52 +0000 (0:00:02.507) 0:01:26.874 ********* 2026-04-28 04:05:01.194689 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-28 04:05:01.194701 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-28 04:05:01.194713 | orchestrator | skipping: [testbed-manager] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-28 04:05:01.194727 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:05:01.194739 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:05:01.194751 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:05:01.194762 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-28 04:05:01.194775 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:05:01.194788 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-28 04:05:01.194800 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:05:01.194812 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-28 04:05:01.194825 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:05:01.194838 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-28 04:05:01.194850 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:05:01.194862 | orchestrator | 2026-04-28 04:05:01.194875 | orchestrator | TASK [prometheus : Copying config file for blackbox exporter] ****************** 2026-04-28 04:05:01.194887 | orchestrator | Tuesday 28 April 2026 04:04:53 +0000 (0:00:01.609) 0:01:28.483 ********* 2026-04-28 04:05:01.194899 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-28 04:05:01.194908 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-28 04:05:01.194928 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:05:01.195001 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:05:01.195013 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-28 04:05:01.195024 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:05:01.195036 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-28 04:05:01.195048 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:05:01.195059 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-28 04:05:01.195072 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:05:01.195084 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2) 2026-04-28 04:05:01.195096 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-28 04:05:01.195109 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:05:01.195121 | orchestrator | 2026-04-28 04:05:01.195132 | orchestrator | TASK [prometheus : Find extra prometheus server config files] ****************** 2026-04-28 04:05:01.195145 | orchestrator | Tuesday 28 April 2026 04:04:55 +0000 (0:00:01.603) 0:01:30.087 ********* 2026-04-28 04:05:01.195157 | orchestrator | [WARNING]: Skipped 2026-04-28 04:05:01.195171 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/extras/' path 2026-04-28 04:05:01.195180 | orchestrator | due to this access issue: 2026-04-28 04:05:01.195187 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/extras/' is 2026-04-28 04:05:01.195194 | orchestrator | not a directory 2026-04-28 04:05:01.195202 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-28 04:05:01.195210 | orchestrator | 2026-04-28 04:05:01.195222 | orchestrator | TASK [prometheus : Create subdirectories for extra config files] *************** 2026-04-28 04:05:01.195234 | orchestrator | Tuesday 28 April 2026 04:04:56 +0000 (0:00:01.219) 0:01:31.307 ********* 2026-04-28 04:05:01.195246 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:05:01.195258 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:05:01.195270 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:05:01.195281 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:05:01.195293 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:05:01.195305 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:05:01.195327 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:05:01.195340 | orchestrator | 2026-04-28 04:05:01.195376 | orchestrator | TASK [prometheus : Template extra prometheus server config files] ************** 2026-04-28 04:05:01.195385 | orchestrator | Tuesday 28 April 2026 04:04:57 +0000 (0:00:01.052) 0:01:32.359 ********* 2026-04-28 04:05:01.195392 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:05:01.195399 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:05:01.195406 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:05:01.195413 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:05:01.195420 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:05:01.195428 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:05:01.195438 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:05:01.195449 | orchestrator | 2026-04-28 04:05:01.195461 | orchestrator | TASK [prometheus : Check prometheus containers] ******************************** 2026-04-28 04:05:01.195474 | orchestrator | Tuesday 28 April 2026 04:04:58 +0000 (0:00:01.009) 0:01:33.369 ********* 2026-04-28 04:05:01.195502 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:05:02.984458 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_v2:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True}}}}) 2026-04-28 04:05:02.984563 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:05:02.984574 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:05:02.984581 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:05:02.984588 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:05:02.984610 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:05:02.984625 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:05:02.984666 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 04:05:02.984674 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:05:02.984682 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:05:02.984689 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:05:02.984697 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:05:02.984708 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:05:02.984716 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:05:02.984732 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:05:05.271506 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:05:05.271588 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 04:05:05.271597 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:05:05.271603 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 04:05:05.271611 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 04:05:05.271635 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True}}}}) 2026-04-28 04:05:05.271674 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:05:05.271683 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:05:05.271689 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 04:05:05.271694 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:05:05.271701 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:05:05.271707 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:05:05.271717 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:05:05.271730 | orchestrator | 2026-04-28 04:05:05.271738 | orchestrator | TASK [prometheus : Creating prometheus database user and setting permissions] *** 2026-04-28 04:05:05.271746 | orchestrator | Tuesday 28 April 2026 04:05:02 +0000 (0:00:04.333) 0:01:37.702 ********* 2026-04-28 04:05:05.271755 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-0)  2026-04-28 04:05:05.271760 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:05:05.271764 | orchestrator | 2026-04-28 04:05:05.271768 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-28 04:05:05.271772 | orchestrator | Tuesday 28 April 2026 04:05:04 +0000 (0:00:01.647) 0:01:39.350 ********* 2026-04-28 04:05:05.271776 | orchestrator | 2026-04-28 04:05:05.271781 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-28 04:05:05.271785 | orchestrator | Tuesday 28 April 2026 04:05:04 +0000 (0:00:00.087) 0:01:39.438 ********* 2026-04-28 04:05:05.271789 | orchestrator | 2026-04-28 04:05:05.271793 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-28 04:05:05.271797 | orchestrator | Tuesday 28 April 2026 04:05:04 +0000 (0:00:00.105) 0:01:39.543 ********* 2026-04-28 04:05:05.271801 | orchestrator | 2026-04-28 04:05:05.271805 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-28 04:05:05.271813 | orchestrator | Tuesday 28 April 2026 04:05:04 +0000 (0:00:00.076) 0:01:39.619 ********* 2026-04-28 04:06:54.685793 | orchestrator | 2026-04-28 04:06:54.685889 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-28 04:06:54.685903 | orchestrator | Tuesday 28 April 2026 04:05:04 +0000 (0:00:00.071) 0:01:39.691 ********* 2026-04-28 04:06:54.685912 | orchestrator | 2026-04-28 04:06:54.685920 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-28 04:06:54.685949 | orchestrator | Tuesday 28 April 2026 04:05:05 +0000 (0:00:00.102) 0:01:39.793 ********* 2026-04-28 04:06:54.685958 | orchestrator | 2026-04-28 04:06:54.685967 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-28 04:06:54.685975 | orchestrator | Tuesday 28 April 2026 04:05:05 +0000 (0:00:00.070) 0:01:39.864 ********* 2026-04-28 04:06:54.685984 | orchestrator | 2026-04-28 04:06:54.685993 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-server container] ************* 2026-04-28 04:06:54.686001 | orchestrator | Tuesday 28 April 2026 04:05:05 +0000 (0:00:00.105) 0:01:39.970 ********* 2026-04-28 04:06:54.686010 | orchestrator | changed: [testbed-manager] 2026-04-28 04:06:54.686148 | orchestrator | 2026-04-28 04:06:54.686159 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-node-exporter container] ****** 2026-04-28 04:06:54.686168 | orchestrator | Tuesday 28 April 2026 04:05:27 +0000 (0:00:21.754) 0:02:01.724 ********* 2026-04-28 04:06:54.686177 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:06:54.686185 | orchestrator | changed: [testbed-node-3] 2026-04-28 04:06:54.686195 | orchestrator | changed: [testbed-manager] 2026-04-28 04:06:54.686203 | orchestrator | changed: [testbed-node-5] 2026-04-28 04:06:54.686212 | orchestrator | changed: [testbed-node-4] 2026-04-28 04:06:54.686220 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:06:54.686228 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:06:54.686237 | orchestrator | 2026-04-28 04:06:54.686247 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-mysqld-exporter container] **** 2026-04-28 04:06:54.686256 | orchestrator | Tuesday 28 April 2026 04:05:41 +0000 (0:00:14.016) 0:02:15.741 ********* 2026-04-28 04:06:54.686265 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:06:54.686273 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:06:54.686282 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:06:54.686291 | orchestrator | 2026-04-28 04:06:54.686300 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-memcached-exporter container] *** 2026-04-28 04:06:54.686310 | orchestrator | Tuesday 28 April 2026 04:05:51 +0000 (0:00:10.834) 0:02:26.575 ********* 2026-04-28 04:06:54.686343 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:06:54.686352 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:06:54.686361 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:06:54.686369 | orchestrator | 2026-04-28 04:06:54.686378 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-cadvisor container] *********** 2026-04-28 04:06:54.686388 | orchestrator | Tuesday 28 April 2026 04:05:58 +0000 (0:00:06.228) 0:02:32.803 ********* 2026-04-28 04:06:54.686397 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:06:54.686406 | orchestrator | changed: [testbed-node-4] 2026-04-28 04:06:54.686415 | orchestrator | changed: [testbed-node-3] 2026-04-28 04:06:54.686423 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:06:54.686429 | orchestrator | changed: [testbed-manager] 2026-04-28 04:06:54.686435 | orchestrator | changed: [testbed-node-5] 2026-04-28 04:06:54.686441 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:06:54.686447 | orchestrator | 2026-04-28 04:06:54.686453 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-alertmanager container] ******* 2026-04-28 04:06:54.686459 | orchestrator | Tuesday 28 April 2026 04:06:12 +0000 (0:00:14.573) 0:02:47.377 ********* 2026-04-28 04:06:54.686465 | orchestrator | changed: [testbed-manager] 2026-04-28 04:06:54.686471 | orchestrator | 2026-04-28 04:06:54.686477 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-elasticsearch-exporter container] *** 2026-04-28 04:06:54.686484 | orchestrator | Tuesday 28 April 2026 04:06:26 +0000 (0:00:14.312) 0:03:01.690 ********* 2026-04-28 04:06:54.686489 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:06:54.686495 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:06:54.686501 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:06:54.686507 | orchestrator | 2026-04-28 04:06:54.686512 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-blackbox-exporter container] *** 2026-04-28 04:06:54.686518 | orchestrator | Tuesday 28 April 2026 04:06:38 +0000 (0:00:11.241) 0:03:12.931 ********* 2026-04-28 04:06:54.686524 | orchestrator | changed: [testbed-manager] 2026-04-28 04:06:54.686530 | orchestrator | 2026-04-28 04:06:54.686547 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-libvirt-exporter container] *** 2026-04-28 04:06:54.686554 | orchestrator | Tuesday 28 April 2026 04:06:43 +0000 (0:00:05.153) 0:03:18.084 ********* 2026-04-28 04:06:54.686559 | orchestrator | changed: [testbed-node-3] 2026-04-28 04:06:54.686565 | orchestrator | changed: [testbed-node-4] 2026-04-28 04:06:54.686571 | orchestrator | changed: [testbed-node-5] 2026-04-28 04:06:54.686577 | orchestrator | 2026-04-28 04:06:54.686583 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:06:54.686591 | orchestrator | testbed-manager : ok=23  changed=14  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2026-04-28 04:06:54.686599 | orchestrator | testbed-node-0 : ok=15  changed=10  unreachable=0 failed=0 skipped=11  rescued=0 ignored=0 2026-04-28 04:06:54.686605 | orchestrator | testbed-node-1 : ok=15  changed=10  unreachable=0 failed=0 skipped=11  rescued=0 ignored=0 2026-04-28 04:06:54.686611 | orchestrator | testbed-node-2 : ok=15  changed=10  unreachable=0 failed=0 skipped=11  rescued=0 ignored=0 2026-04-28 04:06:54.686617 | orchestrator | testbed-node-3 : ok=12  changed=7  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-28 04:06:54.686637 | orchestrator | testbed-node-4 : ok=12  changed=7  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-28 04:06:54.686644 | orchestrator | testbed-node-5 : ok=12  changed=7  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-28 04:06:54.686649 | orchestrator | 2026-04-28 04:06:54.686654 | orchestrator | 2026-04-28 04:06:54.686660 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 04:06:54.686671 | orchestrator | Tuesday 28 April 2026 04:06:54 +0000 (0:00:10.696) 0:03:28.781 ********* 2026-04-28 04:06:54.686676 | orchestrator | =============================================================================== 2026-04-28 04:06:54.686681 | orchestrator | prometheus : Copying over custom prometheus alert rules files ---------- 29.40s 2026-04-28 04:06:54.686687 | orchestrator | prometheus : Restart prometheus-server container ----------------------- 21.75s 2026-04-28 04:06:54.686692 | orchestrator | prometheus : Copying over prometheus config file ----------------------- 18.68s 2026-04-28 04:06:54.686697 | orchestrator | prometheus : Restart prometheus-cadvisor container --------------------- 14.57s 2026-04-28 04:06:54.686702 | orchestrator | prometheus : Restart prometheus-alertmanager container ----------------- 14.31s 2026-04-28 04:06:54.686707 | orchestrator | prometheus : Restart prometheus-node-exporter container ---------------- 14.02s 2026-04-28 04:06:54.686712 | orchestrator | prometheus : Restart prometheus-elasticsearch-exporter container ------- 11.24s 2026-04-28 04:06:54.686717 | orchestrator | prometheus : Restart prometheus-mysqld-exporter container -------------- 10.83s 2026-04-28 04:06:54.686722 | orchestrator | prometheus : Restart prometheus-libvirt-exporter container ------------- 10.70s 2026-04-28 04:06:54.686727 | orchestrator | prometheus : Copying over config.json files ----------------------------- 6.88s 2026-04-28 04:06:54.686732 | orchestrator | service-cert-copy : prometheus | Copying over extra CA certificates ----- 6.45s 2026-04-28 04:06:54.686737 | orchestrator | prometheus : Restart prometheus-memcached-exporter container ------------ 6.23s 2026-04-28 04:06:54.686742 | orchestrator | prometheus : Restart prometheus-blackbox-exporter container ------------- 5.15s 2026-04-28 04:06:54.686747 | orchestrator | prometheus : Check prometheus containers -------------------------------- 4.33s 2026-04-28 04:06:54.686753 | orchestrator | prometheus : Ensuring config directories exist -------------------------- 3.25s 2026-04-28 04:06:54.686758 | orchestrator | prometheus : Copying over prometheus web config file -------------------- 3.09s 2026-04-28 04:06:54.686763 | orchestrator | prometheus : Copying over my.cnf for mysqld_exporter -------------------- 2.51s 2026-04-28 04:06:54.686768 | orchestrator | service-cert-copy : prometheus | Copying over backend internal TLS key --- 2.22s 2026-04-28 04:06:54.686773 | orchestrator | prometheus : Find prometheus host config overrides ---------------------- 1.93s 2026-04-28 04:06:54.686778 | orchestrator | prometheus : Copying over prometheus alertmanager config file ----------- 1.81s 2026-04-28 04:06:57.647469 | orchestrator | 2026-04-28 04:06:57 | INFO  | Task 0495ded7-777b-43f7-a54e-2ee9e1c124cf (grafana) was prepared for execution. 2026-04-28 04:06:57.647598 | orchestrator | 2026-04-28 04:06:57 | INFO  | It takes a moment until task 0495ded7-777b-43f7-a54e-2ee9e1c124cf (grafana) has been started and output is visible here. 2026-04-28 04:07:08.908767 | orchestrator | 2026-04-28 04:07:08.908870 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 04:07:08.908887 | orchestrator | 2026-04-28 04:07:08.908899 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 04:07:08.908911 | orchestrator | Tuesday 28 April 2026 04:07:02 +0000 (0:00:00.275) 0:00:00.275 ********* 2026-04-28 04:07:08.908922 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:07:08.908975 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:07:08.908996 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:07:08.909015 | orchestrator | 2026-04-28 04:07:08.909034 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 04:07:08.909070 | orchestrator | Tuesday 28 April 2026 04:07:03 +0000 (0:00:00.400) 0:00:00.676 ********* 2026-04-28 04:07:08.909082 | orchestrator | ok: [testbed-node-0] => (item=enable_grafana_True) 2026-04-28 04:07:08.909094 | orchestrator | ok: [testbed-node-1] => (item=enable_grafana_True) 2026-04-28 04:07:08.909105 | orchestrator | ok: [testbed-node-2] => (item=enable_grafana_True) 2026-04-28 04:07:08.909116 | orchestrator | 2026-04-28 04:07:08.909127 | orchestrator | PLAY [Apply role grafana] ****************************************************** 2026-04-28 04:07:08.909138 | orchestrator | 2026-04-28 04:07:08.909149 | orchestrator | TASK [grafana : include_tasks] ************************************************* 2026-04-28 04:07:08.909205 | orchestrator | Tuesday 28 April 2026 04:07:03 +0000 (0:00:00.519) 0:00:01.195 ********* 2026-04-28 04:07:08.909228 | orchestrator | included: /ansible/roles/grafana/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:07:08.909246 | orchestrator | 2026-04-28 04:07:08.909262 | orchestrator | TASK [grafana : Ensuring config directories exist] ***************************** 2026-04-28 04:07:08.909280 | orchestrator | Tuesday 28 April 2026 04:07:04 +0000 (0:00:00.648) 0:00:01.844 ********* 2026-04-28 04:07:08.909300 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-28 04:07:08.909325 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-28 04:07:08.909347 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-28 04:07:08.909368 | orchestrator | 2026-04-28 04:07:08.909388 | orchestrator | TASK [grafana : Check if extra configuration file exists] ********************** 2026-04-28 04:07:08.909405 | orchestrator | Tuesday 28 April 2026 04:07:05 +0000 (0:00:01.019) 0:00:02.864 ********* 2026-04-28 04:07:08.909417 | orchestrator | [WARNING]: Skipped '/operations/prometheus/grafana' path due to this access 2026-04-28 04:07:08.909428 | orchestrator | issue: '/operations/prometheus/grafana' is not a directory 2026-04-28 04:07:08.909439 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 04:07:08.909451 | orchestrator | 2026-04-28 04:07:08.909461 | orchestrator | TASK [grafana : include_tasks] ************************************************* 2026-04-28 04:07:08.909472 | orchestrator | Tuesday 28 April 2026 04:07:06 +0000 (0:00:00.941) 0:00:03.805 ********* 2026-04-28 04:07:08.909483 | orchestrator | included: /ansible/roles/grafana/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:07:08.909494 | orchestrator | 2026-04-28 04:07:08.909505 | orchestrator | TASK [service-cert-copy : grafana | Copying over extra CA certificates] ******** 2026-04-28 04:07:08.909516 | orchestrator | Tuesday 28 April 2026 04:07:06 +0000 (0:00:00.679) 0:00:04.484 ********* 2026-04-28 04:07:08.909557 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-28 04:07:08.909581 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-28 04:07:08.909593 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-28 04:07:08.909604 | orchestrator | 2026-04-28 04:07:08.909615 | orchestrator | TASK [service-cert-copy : grafana | Copying over backend internal TLS certificate] *** 2026-04-28 04:07:08.909627 | orchestrator | Tuesday 28 April 2026 04:07:08 +0000 (0:00:01.451) 0:00:05.936 ********* 2026-04-28 04:07:08.909638 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-28 04:07:08.909650 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:07:08.909662 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-28 04:07:08.909673 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:07:08.909695 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-28 04:07:16.265851 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:07:16.265980 | orchestrator | 2026-04-28 04:07:16.265994 | orchestrator | TASK [service-cert-copy : grafana | Copying over backend internal TLS key] ***** 2026-04-28 04:07:16.266003 | orchestrator | Tuesday 28 April 2026 04:07:08 +0000 (0:00:00.620) 0:00:06.557 ********* 2026-04-28 04:07:16.266072 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-28 04:07:16.266086 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:07:16.266094 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-28 04:07:16.266102 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:07:16.266133 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}})  2026-04-28 04:07:16.266141 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:07:16.266149 | orchestrator | 2026-04-28 04:07:16.266157 | orchestrator | TASK [grafana : Copying over config.json files] ******************************** 2026-04-28 04:07:16.266164 | orchestrator | Tuesday 28 April 2026 04:07:09 +0000 (0:00:00.662) 0:00:07.219 ********* 2026-04-28 04:07:16.266171 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-28 04:07:16.266180 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-28 04:07:16.266224 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-28 04:07:16.266233 | orchestrator | 2026-04-28 04:07:16.266241 | orchestrator | TASK [grafana : Copying over grafana.ini] ************************************** 2026-04-28 04:07:16.266248 | orchestrator | Tuesday 28 April 2026 04:07:10 +0000 (0:00:01.311) 0:00:08.531 ********* 2026-04-28 04:07:16.266256 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-28 04:07:16.266264 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-28 04:07:16.266272 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-28 04:07:16.266279 | orchestrator | 2026-04-28 04:07:16.266286 | orchestrator | TASK [grafana : Copying over extra configuration file] ************************* 2026-04-28 04:07:16.266294 | orchestrator | Tuesday 28 April 2026 04:07:12 +0000 (0:00:01.749) 0:00:10.281 ********* 2026-04-28 04:07:16.266301 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:07:16.266309 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:07:16.266321 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:07:16.266329 | orchestrator | 2026-04-28 04:07:16.266336 | orchestrator | TASK [grafana : Configuring Prometheus as data source for Grafana] ************* 2026-04-28 04:07:16.266343 | orchestrator | Tuesday 28 April 2026 04:07:12 +0000 (0:00:00.332) 0:00:10.613 ********* 2026-04-28 04:07:16.266350 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/grafana/templates/prometheus.yaml.j2) 2026-04-28 04:07:16.266359 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/grafana/templates/prometheus.yaml.j2) 2026-04-28 04:07:16.266366 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/grafana/templates/prometheus.yaml.j2) 2026-04-28 04:07:16.266373 | orchestrator | 2026-04-28 04:07:16.266380 | orchestrator | TASK [grafana : Configuring dashboards provisioning] *************************** 2026-04-28 04:07:16.266387 | orchestrator | Tuesday 28 April 2026 04:07:14 +0000 (0:00:01.400) 0:00:12.014 ********* 2026-04-28 04:07:16.266395 | orchestrator | changed: [testbed-node-0] => (item=/opt/configuration/environments/kolla/files/overlays/grafana/provisioning.yaml) 2026-04-28 04:07:16.266403 | orchestrator | changed: [testbed-node-1] => (item=/opt/configuration/environments/kolla/files/overlays/grafana/provisioning.yaml) 2026-04-28 04:07:16.266411 | orchestrator | changed: [testbed-node-2] => (item=/opt/configuration/environments/kolla/files/overlays/grafana/provisioning.yaml) 2026-04-28 04:07:16.266420 | orchestrator | 2026-04-28 04:07:16.266429 | orchestrator | TASK [grafana : Find custom grafana dashboards] ******************************** 2026-04-28 04:07:16.266442 | orchestrator | Tuesday 28 April 2026 04:07:16 +0000 (0:00:01.893) 0:00:13.908 ********* 2026-04-28 04:07:22.842212 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 04:07:22.842309 | orchestrator | 2026-04-28 04:07:22.842327 | orchestrator | TASK [grafana : Find templated grafana dashboards] ***************************** 2026-04-28 04:07:22.842359 | orchestrator | Tuesday 28 April 2026 04:07:17 +0000 (0:00:00.786) 0:00:14.694 ********* 2026-04-28 04:07:22.842372 | orchestrator | [WARNING]: Skipped '/etc/kolla/grafana/dashboards' path due to this access 2026-04-28 04:07:22.842386 | orchestrator | issue: '/etc/kolla/grafana/dashboards' is not a directory 2026-04-28 04:07:22.842400 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:07:22.842414 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:07:22.842427 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:07:22.842440 | orchestrator | 2026-04-28 04:07:22.842448 | orchestrator | TASK [grafana : Prune templated Grafana dashboards] **************************** 2026-04-28 04:07:22.842455 | orchestrator | Tuesday 28 April 2026 04:07:17 +0000 (0:00:00.744) 0:00:15.439 ********* 2026-04-28 04:07:22.842463 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:07:22.842470 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:07:22.842477 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:07:22.842485 | orchestrator | 2026-04-28 04:07:22.842492 | orchestrator | TASK [grafana : Copying over custom dashboards] ******************************** 2026-04-28 04:07:22.842499 | orchestrator | Tuesday 28 April 2026 04:07:18 +0000 (0:00:00.394) 0:00:15.833 ********* 2026-04-28 04:07:22.842511 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/ceph-cluster-advanced.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph-cluster-advanced.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 117836, 'inode': 1102143, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1092908, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:22.842522 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/ceph-cluster-advanced.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph-cluster-advanced.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 117836, 'inode': 1102143, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1092908, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:22.842551 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/ceph-cluster-advanced.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph-cluster-advanced.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 117836, 'inode': 1102143, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1092908, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:22.842560 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/rbd-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rbd-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 25686, 'inode': 1102196, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1301892, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:22.842583 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/rbd-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rbd-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 25686, 'inode': 1102196, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1301892, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:22.842597 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/rbd-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rbd-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 25686, 'inode': 1102196, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1301892, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:22.842605 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/ceph_pools.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph_pools.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 25279, 'inode': 1102158, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1153421, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:22.842612 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/ceph_pools.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph_pools.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 25279, 'inode': 1102158, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1153421, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:22.842625 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/ceph_pools.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph_pools.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 25279, 'inode': 1102158, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1153421, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:22.842633 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/rgw-s3-analytics.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rgw-s3-analytics.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 167897, 'inode': 1102200, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1333249, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:22.842640 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/rgw-s3-analytics.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rgw-s3-analytics.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 167897, 'inode': 1102200, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1333249, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:22.842658 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/rgw-s3-analytics.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rgw-s3-analytics.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 167897, 'inode': 1102200, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1333249, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:26.781098 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/osd-device-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/osd-device-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 26655, 'inode': 1102172, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.121342, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:26.781193 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/osd-device-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/osd-device-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 26655, 'inode': 1102172, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.121342, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:26.781226 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/osd-device-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/osd-device-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 26655, 'inode': 1102172, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.121342, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:26.781236 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/radosgw-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 39556, 'inode': 1102191, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.127749, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:26.781244 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/radosgw-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 39556, 'inode': 1102191, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.127749, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:26.781264 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/radosgw-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 39556, 'inode': 1102191, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.127749, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:26.781287 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/README.md', 'value': {'path': '/operations/grafana/dashboards/ceph/README.md', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 84, 'inode': 1102141, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1055348, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:26.781296 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/README.md', 'value': {'path': '/operations/grafana/dashboards/ceph/README.md', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 84, 'inode': 1102141, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1055348, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:26.781309 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/README.md', 'value': {'path': '/operations/grafana/dashboards/ceph/README.md', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 84, 'inode': 1102141, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1055348, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:26.781317 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/ceph-cluster.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph-cluster.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 34113, 'inode': 1102151, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1103423, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:26.781325 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/ceph-cluster.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph-cluster.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 34113, 'inode': 1102151, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1103423, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:26.781332 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/ceph-cluster.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph-cluster.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 34113, 'inode': 1102151, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1103423, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:26.781350 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/cephfs-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/cephfs-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 9025, 'inode': 1102161, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1153421, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:30.783855 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/cephfs-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/cephfs-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 9025, 'inode': 1102161, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1153421, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:30.783997 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/cephfs-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/cephfs-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 9025, 'inode': 1102161, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1153421, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:30.784006 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/pool-detail.json', 'value': {'path': '/operations/grafana/dashboards/ceph/pool-detail.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 19609, 'inode': 1102179, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1243417, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:30.784011 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/pool-detail.json', 'value': {'path': '/operations/grafana/dashboards/ceph/pool-detail.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 19609, 'inode': 1102179, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1243417, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:30.784015 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/pool-detail.json', 'value': {'path': '/operations/grafana/dashboards/ceph/pool-detail.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 19609, 'inode': 1102179, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1243417, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:30.784028 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/rbd-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rbd-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12997, 'inode': 1102194, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1293802, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:30.784043 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/rbd-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rbd-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12997, 'inode': 1102194, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1293802, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:30.784048 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/rbd-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/rbd-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 12997, 'inode': 1102194, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1293802, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:30.784056 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/ceph_overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph_overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 80386, 'inode': 1102154, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1139128, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:30.784060 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/ceph_overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph_overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 80386, 'inode': 1102154, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1139128, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:30.784064 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/ceph_overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/ceph_overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 80386, 'inode': 1102154, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1139128, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:30.784068 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/radosgw-detail.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-detail.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 19695, 'inode': 1102188, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1270099, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:30.784079 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/radosgw-detail.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-detail.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 19695, 'inode': 1102188, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1270099, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:34.965802 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/radosgw-detail.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-detail.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 19695, 'inode': 1102188, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1270099, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:34.965895 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/osds-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/osds-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 38432, 'inode': 1102175, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1223419, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:34.965903 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/osds-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/osds-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 38432, 'inode': 1102175, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1223419, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:34.965907 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/osds-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/osds-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 38432, 'inode': 1102175, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1223419, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:34.965913 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/multi-cluster-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/multi-cluster-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 62676, 'inode': 1102167, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.120342, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:34.965969 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/multi-cluster-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/multi-cluster-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 62676, 'inode': 1102167, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.120342, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:34.965988 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/multi-cluster-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/multi-cluster-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 62676, 'inode': 1102167, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.120342, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:34.965997 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/hosts-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/hosts-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 27218, 'inode': 1102165, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.117342, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:34.966002 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/hosts-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/hosts-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 27218, 'inode': 1102165, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.117342, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:34.966006 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/hosts-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/hosts-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 27218, 'inode': 1102165, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.117342, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:34.966010 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/pool-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/pool-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 49139, 'inode': 1102181, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1253417, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:34.966064 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/pool-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/pool-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 49139, 'inode': 1102181, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1253417, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:34.966074 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/pool-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/pool-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 49139, 'inode': 1102181, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1253417, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:38.910546 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/host-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/host-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 44791, 'inode': 1102163, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.116342, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:38.910681 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/host-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/host-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 44791, 'inode': 1102163, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.116342, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:38.910696 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/host-details.json', 'value': {'path': '/operations/grafana/dashboards/ceph/host-details.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 44791, 'inode': 1102163, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.116342, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:38.910710 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph/radosgw-sync-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-sync-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 16156, 'inode': 1102193, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1288323, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:38.910723 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph/radosgw-sync-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-sync-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 16156, 'inode': 1102193, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1288323, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:38.910755 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph/radosgw-sync-overview.json', 'value': {'path': '/operations/grafana/dashboards/ceph/radosgw-sync-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 16156, 'inode': 1102193, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1288323, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:38.910812 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openstack/openstack.json', 'value': {'path': '/operations/grafana/dashboards/openstack/openstack.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 57270, 'inode': 1102309, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1755924, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:38.910825 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openstack/openstack.json', 'value': {'path': '/operations/grafana/dashboards/openstack/openstack.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 57270, 'inode': 1102309, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1755924, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:38.910836 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openstack/openstack.json', 'value': {'path': '/operations/grafana/dashboards/openstack/openstack.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 57270, 'inode': 1102309, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1755924, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:38.910848 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/haproxy.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/haproxy.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 410814, 'inode': 1102227, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1459343, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:38.910859 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/haproxy.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/haproxy.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 410814, 'inode': 1102227, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1459343, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:38.910877 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/haproxy.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/haproxy.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 410814, 'inode': 1102227, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1459343, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:38.910903 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/database.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/database.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 30898, 'inode': 1102213, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1365833, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:42.957057 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/database.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/database.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 30898, 'inode': 1102213, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1365833, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:42.957183 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/database.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/database.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 30898, 'inode': 1102213, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1365833, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:42.957204 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/node-rsrc-use.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node-rsrc-use.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 15725, 'inode': 1102256, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1493545, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:42.957219 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/node-rsrc-use.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node-rsrc-use.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 15725, 'inode': 1102256, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1493545, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:42.957253 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/node-rsrc-use.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node-rsrc-use.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 15725, 'inode': 1102256, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1493545, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:42.957294 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/alertmanager-overview.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/alertmanager-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 9645, 'inode': 1102205, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1340642, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:42.957333 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/alertmanager-overview.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/alertmanager-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 9645, 'inode': 1102205, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1340642, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:42.957346 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/alertmanager-overview.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/alertmanager-overview.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 9645, 'inode': 1102205, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1340642, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:42.957386 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/opensearch.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/opensearch.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 65458, 'inode': 1102277, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.16147, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:42.957399 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/opensearch.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/opensearch.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 65458, 'inode': 1102277, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.16147, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:42.957411 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/opensearch.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/opensearch.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 65458, 'inode': 1102277, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.16147, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:42.957438 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/node_exporter_full.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node_exporter_full.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 682774, 'inode': 1102257, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1563406, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:42.957460 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/node_exporter_full.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node_exporter_full.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 682774, 'inode': 1102257, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1563406, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:47.035016 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/node_exporter_full.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node_exporter_full.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 682774, 'inode': 1102257, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1563406, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:47.035102 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/prometheus-remote-write.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus-remote-write.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 22317, 'inode': 1102281, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.162507, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:47.035111 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/prometheus-remote-write.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus-remote-write.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 22317, 'inode': 1102281, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.162507, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:47.035119 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/prometheus-remote-write.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus-remote-write.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 22317, 'inode': 1102281, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.162507, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:47.035163 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/redfish.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/redfish.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 38087, 'inode': 1102305, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1699157, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:47.035176 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/redfish.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/redfish.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 38087, 'inode': 1102305, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1699157, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:47.035197 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/redfish.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/redfish.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 38087, 'inode': 1102305, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1699157, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:47.035206 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/nodes.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/nodes.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 21109, 'inode': 1102275, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1608312, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:47.035214 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/nodes.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/nodes.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 21109, 'inode': 1102275, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1608312, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:47.035221 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/nodes.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/nodes.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 21109, 'inode': 1102275, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1608312, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:47.035237 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/memcached.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/memcached.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 24243, 'inode': 1102252, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1477299, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:47.035245 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/memcached.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/memcached.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 24243, 'inode': 1102252, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1477299, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:47.035257 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/memcached.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/memcached.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 24243, 'inode': 1102252, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1477299, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:50.796514 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/fluentd.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/fluentd.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 82960, 'inode': 1102222, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1393414, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:50.796685 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/fluentd.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/fluentd.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 82960, 'inode': 1102222, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1393414, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:50.796713 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/fluentd.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/fluentd.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 82960, 'inode': 1102222, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1393414, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:50.796787 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/libvirt.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/libvirt.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 29672, 'inode': 1102248, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1477299, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:50.796804 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/libvirt.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/libvirt.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 29672, 'inode': 1102248, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1477299, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:50.796816 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/libvirt.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/libvirt.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 29672, 'inode': 1102248, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1477299, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:50.796848 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/elasticsearch.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/elasticsearch.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 187864, 'inode': 1102216, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1383247, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:50.796862 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/elasticsearch.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/elasticsearch.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 187864, 'inode': 1102216, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1383247, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:50.796873 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/elasticsearch.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/elasticsearch.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 187864, 'inode': 1102216, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1383247, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:50.796893 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/node-cluster-rsrc-use.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node-cluster-rsrc-use.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 16098, 'inode': 1102253, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1488008, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:50.796912 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/node-cluster-rsrc-use.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node-cluster-rsrc-use.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 16098, 'inode': 1102253, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1488008, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:50.797013 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/node-cluster-rsrc-use.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node-cluster-rsrc-use.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 16098, 'inode': 1102253, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1488008, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:50.797042 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/rabbitmq.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/rabbitmq.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 222049, 'inode': 1102291, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1687815, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:54.952902 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/rabbitmq.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/rabbitmq.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 222049, 'inode': 1102291, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1687815, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:54.953086 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/rabbitmq.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/rabbitmq.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 222049, 'inode': 1102291, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1687815, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:54.953115 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/prometheus_alertmanager.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus_alertmanager.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 115472, 'inode': 1102286, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.164785, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:54.953133 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/prometheus_alertmanager.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus_alertmanager.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 115472, 'inode': 1102286, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.164785, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:54.953137 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/prometheus_alertmanager.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus_alertmanager.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 115472, 'inode': 1102286, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.164785, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:54.953142 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/blackbox.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/blackbox.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 31128, 'inode': 1102208, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1344852, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:54.953158 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/blackbox.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/blackbox.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 31128, 'inode': 1102208, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1344852, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:54.953163 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/blackbox.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/blackbox.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 31128, 'inode': 1102208, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1344852, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:54.953178 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/cadvisor.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/cadvisor.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 53882, 'inode': 1102209, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1353414, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:54.953192 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/cadvisor.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/cadvisor.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 53882, 'inode': 1102209, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1353414, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:54.953196 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/cadvisor.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/cadvisor.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 53882, 'inode': 1102209, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1353414, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:54.953200 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/node_exporter_side_by_side.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node_exporter_side_by_side.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 70691, 'inode': 1102269, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1589658, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:07:54.953209 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/node_exporter_side_by_side.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node_exporter_side_by_side.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 70691, 'inode': 1102269, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1589658, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:09:38.300354 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/node_exporter_side_by_side.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/node_exporter_side_by_side.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 70691, 'inode': 1102269, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.1589658, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:09:38.300457 | orchestrator | changed: [testbed-node-1] => (item={'key': 'infrastructure/prometheus.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 21898, 'inode': 1102283, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.163412, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:09:38.300476 | orchestrator | changed: [testbed-node-0] => (item={'key': 'infrastructure/prometheus.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 21898, 'inode': 1102283, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.163412, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:09:38.300482 | orchestrator | changed: [testbed-node-2] => (item={'key': 'infrastructure/prometheus.json', 'value': {'path': '/operations/grafana/dashboards/infrastructure/prometheus.json', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 21898, 'inode': 1102283, 'dev': 78, 'nlink': 1, 'atime': 1764530892.0, 'mtime': 1764530892.0, 'ctime': 1777341612.163412, 'gr_name': 'root', 'pw_name': 'root', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}}) 2026-04-28 04:09:38.300488 | orchestrator | 2026-04-28 04:09:38.300494 | orchestrator | TASK [grafana : Check grafana containers] ************************************** 2026-04-28 04:09:38.300501 | orchestrator | Tuesday 28 April 2026 04:07:56 +0000 (0:00:38.092) 0:00:53.925 ********* 2026-04-28 04:09:38.300506 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-28 04:09:38.300523 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-28 04:09:38.300533 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/grafana:12.3.0.20251130', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000'}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000'}}}}) 2026-04-28 04:09:38.300538 | orchestrator | 2026-04-28 04:09:38.300543 | orchestrator | TASK [grafana : Creating grafana database] ************************************* 2026-04-28 04:09:38.300547 | orchestrator | Tuesday 28 April 2026 04:07:57 +0000 (0:00:01.004) 0:00:54.930 ********* 2026-04-28 04:09:38.300552 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:09:38.300558 | orchestrator | 2026-04-28 04:09:38.300563 | orchestrator | TASK [grafana : Creating grafana database user and setting permissions] ******** 2026-04-28 04:09:38.300567 | orchestrator | Tuesday 28 April 2026 04:07:59 +0000 (0:00:02.409) 0:00:57.339 ********* 2026-04-28 04:09:38.300572 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:09:38.300576 | orchestrator | 2026-04-28 04:09:38.300581 | orchestrator | TASK [grafana : Flush handlers] ************************************************ 2026-04-28 04:09:38.300586 | orchestrator | Tuesday 28 April 2026 04:08:01 +0000 (0:00:02.200) 0:00:59.540 ********* 2026-04-28 04:09:38.300590 | orchestrator | 2026-04-28 04:09:38.300595 | orchestrator | TASK [grafana : Flush handlers] ************************************************ 2026-04-28 04:09:38.300600 | orchestrator | Tuesday 28 April 2026 04:08:01 +0000 (0:00:00.074) 0:00:59.615 ********* 2026-04-28 04:09:38.300604 | orchestrator | 2026-04-28 04:09:38.300609 | orchestrator | TASK [grafana : Flush handlers] ************************************************ 2026-04-28 04:09:38.300613 | orchestrator | Tuesday 28 April 2026 04:08:02 +0000 (0:00:00.076) 0:00:59.691 ********* 2026-04-28 04:09:38.300618 | orchestrator | 2026-04-28 04:09:38.300625 | orchestrator | RUNNING HANDLER [grafana : Restart first grafana container] ******************** 2026-04-28 04:09:38.300630 | orchestrator | Tuesday 28 April 2026 04:08:02 +0000 (0:00:00.075) 0:00:59.767 ********* 2026-04-28 04:09:38.300635 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:09:38.300640 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:09:38.300645 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:09:38.300649 | orchestrator | 2026-04-28 04:09:38.300654 | orchestrator | RUNNING HANDLER [grafana : Waiting for grafana to start on first node] ********* 2026-04-28 04:09:38.300659 | orchestrator | Tuesday 28 April 2026 04:08:09 +0000 (0:00:07.377) 0:01:07.145 ********* 2026-04-28 04:09:38.300663 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:09:38.300668 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:09:38.300672 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Waiting for grafana to start on first node (12 retries left). 2026-04-28 04:09:38.300678 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Waiting for grafana to start on first node (11 retries left). 2026-04-28 04:09:38.300682 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Waiting for grafana to start on first node (10 retries left). 2026-04-28 04:09:38.300687 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Waiting for grafana to start on first node (9 retries left). 2026-04-28 04:09:38.300692 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:09:38.300697 | orchestrator | 2026-04-28 04:09:38.300702 | orchestrator | RUNNING HANDLER [grafana : Restart remaining grafana containers] *************** 2026-04-28 04:09:38.300706 | orchestrator | Tuesday 28 April 2026 04:09:00 +0000 (0:00:50.536) 0:01:57.681 ********* 2026-04-28 04:09:38.300715 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:09:38.300720 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:09:38.300725 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:09:38.300729 | orchestrator | 2026-04-28 04:09:38.300734 | orchestrator | TASK [grafana : Wait for grafana application ready] **************************** 2026-04-28 04:09:38.300738 | orchestrator | Tuesday 28 April 2026 04:09:33 +0000 (0:00:33.074) 0:02:30.756 ********* 2026-04-28 04:09:38.300743 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:09:38.300747 | orchestrator | 2026-04-28 04:09:38.300752 | orchestrator | TASK [grafana : Remove old grafana docker volume] ****************************** 2026-04-28 04:09:38.300757 | orchestrator | Tuesday 28 April 2026 04:09:35 +0000 (0:00:02.129) 0:02:32.885 ********* 2026-04-28 04:09:38.300761 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:09:38.300766 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:09:38.300770 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:09:38.300775 | orchestrator | 2026-04-28 04:09:38.300780 | orchestrator | TASK [grafana : Enable grafana datasources] ************************************ 2026-04-28 04:09:38.300784 | orchestrator | Tuesday 28 April 2026 04:09:35 +0000 (0:00:00.420) 0:02:33.306 ********* 2026-04-28 04:09:38.300790 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'influxdb', 'value': {'enabled': False, 'data': {'isDefault': True, 'database': 'telegraf', 'name': 'telegraf', 'type': 'influxdb', 'url': 'https://api-int.testbed.osism.xyz:8086', 'access': 'proxy', 'basicAuth': False}}})  2026-04-28 04:09:38.300802 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'enabled': True, 'data': {'name': 'opensearch', 'type': 'grafana-opensearch-datasource', 'access': 'proxy', 'url': 'https://api-int.testbed.osism.xyz:9200', 'jsonData': {'flavor': 'OpenSearch', 'database': 'flog-*', 'version': '2.11.1', 'timeField': '@timestamp', 'logLevelField': 'log_level'}}}}) 2026-04-28 04:09:39.057601 | orchestrator | 2026-04-28 04:09:39.057672 | orchestrator | TASK [grafana : Disable Getting Started panel] ********************************* 2026-04-28 04:09:39.057679 | orchestrator | Tuesday 28 April 2026 04:09:38 +0000 (0:00:02.642) 0:02:35.948 ********* 2026-04-28 04:09:39.057683 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:09:39.057689 | orchestrator | 2026-04-28 04:09:39.057693 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:09:39.057698 | orchestrator | testbed-node-0 : ok=21  changed=12  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-28 04:09:39.057704 | orchestrator | testbed-node-1 : ok=14  changed=9  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-28 04:09:39.057708 | orchestrator | testbed-node-2 : ok=14  changed=9  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-28 04:09:39.057712 | orchestrator | 2026-04-28 04:09:39.057715 | orchestrator | 2026-04-28 04:09:39.057719 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 04:09:39.057723 | orchestrator | Tuesday 28 April 2026 04:09:38 +0000 (0:00:00.325) 0:02:36.273 ********* 2026-04-28 04:09:39.057727 | orchestrator | =============================================================================== 2026-04-28 04:09:39.057731 | orchestrator | grafana : Waiting for grafana to start on first node ------------------- 50.54s 2026-04-28 04:09:39.057734 | orchestrator | grafana : Copying over custom dashboards ------------------------------- 38.09s 2026-04-28 04:09:39.057738 | orchestrator | grafana : Restart remaining grafana containers ------------------------- 33.07s 2026-04-28 04:09:39.057742 | orchestrator | grafana : Restart first grafana container ------------------------------- 7.38s 2026-04-28 04:09:39.057746 | orchestrator | grafana : Enable grafana datasources ------------------------------------ 2.64s 2026-04-28 04:09:39.057751 | orchestrator | grafana : Creating grafana database ------------------------------------- 2.41s 2026-04-28 04:09:39.057758 | orchestrator | grafana : Creating grafana database user and setting permissions -------- 2.20s 2026-04-28 04:09:39.057803 | orchestrator | grafana : Wait for grafana application ready ---------------------------- 2.13s 2026-04-28 04:09:39.057810 | orchestrator | grafana : Configuring dashboards provisioning --------------------------- 1.89s 2026-04-28 04:09:39.057815 | orchestrator | grafana : Copying over grafana.ini -------------------------------------- 1.75s 2026-04-28 04:09:39.057822 | orchestrator | service-cert-copy : grafana | Copying over extra CA certificates -------- 1.45s 2026-04-28 04:09:39.057828 | orchestrator | grafana : Configuring Prometheus as data source for Grafana ------------- 1.40s 2026-04-28 04:09:39.057834 | orchestrator | grafana : Copying over config.json files -------------------------------- 1.31s 2026-04-28 04:09:39.057840 | orchestrator | grafana : Ensuring config directories exist ----------------------------- 1.02s 2026-04-28 04:09:39.057846 | orchestrator | grafana : Check grafana containers -------------------------------------- 1.00s 2026-04-28 04:09:39.057852 | orchestrator | grafana : Check if extra configuration file exists ---------------------- 0.94s 2026-04-28 04:09:39.057859 | orchestrator | grafana : Find custom grafana dashboards -------------------------------- 0.79s 2026-04-28 04:09:39.057865 | orchestrator | grafana : Find templated grafana dashboards ----------------------------- 0.74s 2026-04-28 04:09:39.057873 | orchestrator | grafana : include_tasks ------------------------------------------------- 0.68s 2026-04-28 04:09:39.057879 | orchestrator | service-cert-copy : grafana | Copying over backend internal TLS key ----- 0.66s 2026-04-28 04:09:39.452846 | orchestrator | + sh -c /opt/configuration/scripts/deploy/510-clusterapi.sh 2026-04-28 04:09:39.462112 | orchestrator | + set -e 2026-04-28 04:09:39.462212 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-28 04:09:39.462231 | orchestrator | ++ export INTERACTIVE=false 2026-04-28 04:09:39.462244 | orchestrator | ++ INTERACTIVE=false 2026-04-28 04:09:39.462277 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-28 04:09:39.462284 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-28 04:09:39.462291 | orchestrator | + source /opt/manager-vars.sh 2026-04-28 04:09:39.462298 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-28 04:09:39.462304 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-28 04:09:39.462311 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-28 04:09:39.462318 | orchestrator | ++ CEPH_VERSION=reef 2026-04-28 04:09:39.462338 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-28 04:09:39.462350 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-28 04:09:39.462361 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-28 04:09:39.462372 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-28 04:09:39.462384 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-28 04:09:39.462393 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-28 04:09:39.462401 | orchestrator | ++ export ARA=false 2026-04-28 04:09:39.462408 | orchestrator | ++ ARA=false 2026-04-28 04:09:39.462415 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-28 04:09:39.462422 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-28 04:09:39.462429 | orchestrator | ++ export TEMPEST=false 2026-04-28 04:09:39.462436 | orchestrator | ++ TEMPEST=false 2026-04-28 04:09:39.462442 | orchestrator | ++ export IS_ZUUL=true 2026-04-28 04:09:39.462449 | orchestrator | ++ IS_ZUUL=true 2026-04-28 04:09:39.462455 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 04:09:39.462463 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 04:09:39.462470 | orchestrator | ++ export EXTERNAL_API=false 2026-04-28 04:09:39.462477 | orchestrator | ++ EXTERNAL_API=false 2026-04-28 04:09:39.462483 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-28 04:09:39.462490 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-28 04:09:39.462496 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-28 04:09:39.462503 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-28 04:09:39.462509 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-28 04:09:39.462516 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-28 04:09:39.462959 | orchestrator | ++ semver 9.5.0 8.0.0 2026-04-28 04:09:39.529024 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-28 04:09:39.529125 | orchestrator | + osism apply clusterapi 2026-04-28 04:09:41.933094 | orchestrator | 2026-04-28 04:09:41 | INFO  | Task f538370b-e213-456d-b116-755056817905 (clusterapi) was prepared for execution. 2026-04-28 04:09:41.933171 | orchestrator | 2026-04-28 04:09:41 | INFO  | It takes a moment until task f538370b-e213-456d-b116-755056817905 (clusterapi) has been started and output is visible here. 2026-04-28 04:11:06.455152 | orchestrator | 2026-04-28 04:11:06.455297 | orchestrator | PLAY [Apply cert_manager role] ************************************************* 2026-04-28 04:11:06.455364 | orchestrator | 2026-04-28 04:11:06.455387 | orchestrator | TASK [Include cert_manager role] *********************************************** 2026-04-28 04:11:06.455406 | orchestrator | Tuesday 28 April 2026 04:09:47 +0000 (0:00:00.214) 0:00:00.214 ********* 2026-04-28 04:11:06.455426 | orchestrator | included: cert_manager for testbed-manager 2026-04-28 04:11:06.455446 | orchestrator | 2026-04-28 04:11:06.455466 | orchestrator | TASK [cert_manager : Deploy cert-manager crds] ********************************* 2026-04-28 04:11:06.455485 | orchestrator | Tuesday 28 April 2026 04:09:47 +0000 (0:00:00.309) 0:00:00.524 ********* 2026-04-28 04:11:06.455505 | orchestrator | changed: [testbed-manager] 2026-04-28 04:11:06.455525 | orchestrator | 2026-04-28 04:11:06.455544 | orchestrator | TASK [cert_manager : Deploy cert-manager] ************************************** 2026-04-28 04:11:06.455563 | orchestrator | Tuesday 28 April 2026 04:09:52 +0000 (0:00:05.598) 0:00:06.122 ********* 2026-04-28 04:11:06.455583 | orchestrator | changed: [testbed-manager] 2026-04-28 04:11:06.455595 | orchestrator | 2026-04-28 04:11:06.455606 | orchestrator | PLAY [Initialize or upgrade the CAPI management cluster] *********************** 2026-04-28 04:11:06.455617 | orchestrator | 2026-04-28 04:11:06.455627 | orchestrator | TASK [Get capi-system namespace phase] ***************************************** 2026-04-28 04:11:06.455638 | orchestrator | Tuesday 28 April 2026 04:10:45 +0000 (0:00:52.107) 0:00:58.230 ********* 2026-04-28 04:11:06.455649 | orchestrator | ok: [testbed-manager] 2026-04-28 04:11:06.455660 | orchestrator | 2026-04-28 04:11:06.455671 | orchestrator | TASK [Set capi-system-phase fact] ********************************************** 2026-04-28 04:11:06.455682 | orchestrator | Tuesday 28 April 2026 04:10:46 +0000 (0:00:01.247) 0:00:59.477 ********* 2026-04-28 04:11:06.455695 | orchestrator | ok: [testbed-manager] 2026-04-28 04:11:06.455708 | orchestrator | 2026-04-28 04:11:06.455720 | orchestrator | TASK [Initialize the CAPI management cluster] ********************************** 2026-04-28 04:11:06.455733 | orchestrator | Tuesday 28 April 2026 04:10:46 +0000 (0:00:00.185) 0:00:59.663 ********* 2026-04-28 04:11:06.455745 | orchestrator | ok: [testbed-manager] 2026-04-28 04:11:06.455758 | orchestrator | 2026-04-28 04:11:06.455771 | orchestrator | TASK [Upgrade the CAPI management cluster] ************************************* 2026-04-28 04:11:06.455784 | orchestrator | Tuesday 28 April 2026 04:11:03 +0000 (0:00:16.891) 0:01:16.555 ********* 2026-04-28 04:11:06.455797 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:11:06.455810 | orchestrator | 2026-04-28 04:11:06.455822 | orchestrator | TASK [Install openstack-resource-controller] *********************************** 2026-04-28 04:11:06.455851 | orchestrator | Tuesday 28 April 2026 04:11:03 +0000 (0:00:00.165) 0:01:16.721 ********* 2026-04-28 04:11:06.455864 | orchestrator | changed: [testbed-manager] 2026-04-28 04:11:06.455876 | orchestrator | 2026-04-28 04:11:06.455888 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:11:06.455903 | orchestrator | testbed-manager : ok=7  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 04:11:06.455955 | orchestrator | 2026-04-28 04:11:06.455968 | orchestrator | 2026-04-28 04:11:06.455980 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 04:11:06.455992 | orchestrator | Tuesday 28 April 2026 04:11:06 +0000 (0:00:02.472) 0:01:19.194 ********* 2026-04-28 04:11:06.456005 | orchestrator | =============================================================================== 2026-04-28 04:11:06.456018 | orchestrator | cert_manager : Deploy cert-manager ------------------------------------- 52.11s 2026-04-28 04:11:06.456030 | orchestrator | Initialize the CAPI management cluster --------------------------------- 16.89s 2026-04-28 04:11:06.456043 | orchestrator | cert_manager : Deploy cert-manager crds --------------------------------- 5.60s 2026-04-28 04:11:06.456053 | orchestrator | Install openstack-resource-controller ----------------------------------- 2.47s 2026-04-28 04:11:06.456064 | orchestrator | Get capi-system namespace phase ----------------------------------------- 1.25s 2026-04-28 04:11:06.456075 | orchestrator | Include cert_manager role ----------------------------------------------- 0.31s 2026-04-28 04:11:06.456098 | orchestrator | Set capi-system-phase fact ---------------------------------------------- 0.19s 2026-04-28 04:11:06.456108 | orchestrator | Upgrade the CAPI management cluster ------------------------------------- 0.17s 2026-04-28 04:11:06.827876 | orchestrator | + osism apply magnum 2026-04-28 04:11:09.188142 | orchestrator | 2026-04-28 04:11:09 | INFO  | Task 443281c1-14ce-4dd5-8e00-2d3197561957 (magnum) was prepared for execution. 2026-04-28 04:11:09.188296 | orchestrator | 2026-04-28 04:11:09 | INFO  | It takes a moment until task 443281c1-14ce-4dd5-8e00-2d3197561957 (magnum) has been started and output is visible here. 2026-04-28 04:11:52.935324 | orchestrator | 2026-04-28 04:11:52.935413 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 04:11:52.935423 | orchestrator | 2026-04-28 04:11:52.935430 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 04:11:52.935437 | orchestrator | Tuesday 28 April 2026 04:11:13 +0000 (0:00:00.283) 0:00:00.283 ********* 2026-04-28 04:11:52.935443 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:11:52.935451 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:11:52.935458 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:11:52.935464 | orchestrator | 2026-04-28 04:11:52.935470 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 04:11:52.935477 | orchestrator | Tuesday 28 April 2026 04:11:14 +0000 (0:00:00.350) 0:00:00.634 ********* 2026-04-28 04:11:52.935483 | orchestrator | ok: [testbed-node-0] => (item=enable_magnum_True) 2026-04-28 04:11:52.935490 | orchestrator | ok: [testbed-node-1] => (item=enable_magnum_True) 2026-04-28 04:11:52.935496 | orchestrator | ok: [testbed-node-2] => (item=enable_magnum_True) 2026-04-28 04:11:52.935502 | orchestrator | 2026-04-28 04:11:52.935509 | orchestrator | PLAY [Apply role magnum] ******************************************************* 2026-04-28 04:11:52.935516 | orchestrator | 2026-04-28 04:11:52.935524 | orchestrator | TASK [magnum : include_tasks] ************************************************** 2026-04-28 04:11:52.935531 | orchestrator | Tuesday 28 April 2026 04:11:14 +0000 (0:00:00.541) 0:00:01.176 ********* 2026-04-28 04:11:52.935538 | orchestrator | included: /ansible/roles/magnum/tasks/deploy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:11:52.935546 | orchestrator | 2026-04-28 04:11:52.935553 | orchestrator | TASK [service-ks-register : magnum | Creating services] ************************ 2026-04-28 04:11:52.935560 | orchestrator | Tuesday 28 April 2026 04:11:15 +0000 (0:00:00.663) 0:00:01.840 ********* 2026-04-28 04:11:52.935568 | orchestrator | changed: [testbed-node-0] => (item=magnum (container-infra)) 2026-04-28 04:11:52.935575 | orchestrator | 2026-04-28 04:11:52.935582 | orchestrator | TASK [service-ks-register : magnum | Creating endpoints] *********************** 2026-04-28 04:11:52.935589 | orchestrator | Tuesday 28 April 2026 04:11:19 +0000 (0:00:03.596) 0:00:05.437 ********* 2026-04-28 04:11:52.935597 | orchestrator | changed: [testbed-node-0] => (item=magnum -> https://api-int.testbed.osism.xyz:9511/v1 -> internal) 2026-04-28 04:11:52.935604 | orchestrator | changed: [testbed-node-0] => (item=magnum -> https://api.testbed.osism.xyz:9511/v1 -> public) 2026-04-28 04:11:52.935611 | orchestrator | 2026-04-28 04:11:52.935618 | orchestrator | TASK [service-ks-register : magnum | Creating projects] ************************ 2026-04-28 04:11:52.935639 | orchestrator | Tuesday 28 April 2026 04:11:25 +0000 (0:00:06.586) 0:00:12.024 ********* 2026-04-28 04:11:52.935647 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-28 04:11:52.935654 | orchestrator | 2026-04-28 04:11:52.935671 | orchestrator | TASK [service-ks-register : magnum | Creating users] *************************** 2026-04-28 04:11:52.935678 | orchestrator | Tuesday 28 April 2026 04:11:29 +0000 (0:00:03.447) 0:00:15.471 ********* 2026-04-28 04:11:52.935685 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-28 04:11:52.935693 | orchestrator | changed: [testbed-node-0] => (item=magnum -> service) 2026-04-28 04:11:52.935700 | orchestrator | 2026-04-28 04:11:52.935707 | orchestrator | TASK [service-ks-register : magnum | Creating roles] *************************** 2026-04-28 04:11:52.935714 | orchestrator | Tuesday 28 April 2026 04:11:33 +0000 (0:00:03.981) 0:00:19.453 ********* 2026-04-28 04:11:52.935746 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-28 04:11:52.935753 | orchestrator | 2026-04-28 04:11:52.935761 | orchestrator | TASK [service-ks-register : magnum | Granting user roles] ********************** 2026-04-28 04:11:52.935780 | orchestrator | Tuesday 28 April 2026 04:11:36 +0000 (0:00:03.336) 0:00:22.789 ********* 2026-04-28 04:11:52.935787 | orchestrator | changed: [testbed-node-0] => (item=magnum -> service -> admin) 2026-04-28 04:11:52.935794 | orchestrator | 2026-04-28 04:11:52.935801 | orchestrator | TASK [magnum : Creating Magnum trustee domain] ********************************* 2026-04-28 04:11:52.935808 | orchestrator | Tuesday 28 April 2026 04:11:40 +0000 (0:00:03.879) 0:00:26.668 ********* 2026-04-28 04:11:52.935816 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:11:52.935823 | orchestrator | 2026-04-28 04:11:52.935830 | orchestrator | TASK [magnum : Creating Magnum trustee user] *********************************** 2026-04-28 04:11:52.935838 | orchestrator | Tuesday 28 April 2026 04:11:43 +0000 (0:00:03.394) 0:00:30.063 ********* 2026-04-28 04:11:52.935845 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:11:52.935852 | orchestrator | 2026-04-28 04:11:52.935859 | orchestrator | TASK [magnum : Creating Magnum trustee user role] ****************************** 2026-04-28 04:11:52.935866 | orchestrator | Tuesday 28 April 2026 04:11:47 +0000 (0:00:04.044) 0:00:34.107 ********* 2026-04-28 04:11:52.935885 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:11:52.935899 | orchestrator | 2026-04-28 04:11:52.935953 | orchestrator | TASK [magnum : Ensuring config directories exist] ****************************** 2026-04-28 04:11:52.935964 | orchestrator | Tuesday 28 April 2026 04:11:51 +0000 (0:00:03.444) 0:00:37.551 ********* 2026-04-28 04:11:52.936000 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-28 04:11:52.936019 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-28 04:11:52.936033 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-28 04:11:52.936061 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 04:11:52.936072 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 04:11:52.936087 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 04:12:00.792742 | orchestrator | 2026-04-28 04:12:00.792863 | orchestrator | TASK [magnum : Check if policies shall be overwritten] ************************* 2026-04-28 04:12:00.792888 | orchestrator | Tuesday 28 April 2026 04:11:52 +0000 (0:00:01.679) 0:00:39.231 ********* 2026-04-28 04:12:00.793003 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:12:00.793024 | orchestrator | 2026-04-28 04:12:00.793040 | orchestrator | TASK [magnum : Set magnum policy file] ***************************************** 2026-04-28 04:12:00.793056 | orchestrator | Tuesday 28 April 2026 04:11:53 +0000 (0:00:00.154) 0:00:39.385 ********* 2026-04-28 04:12:00.793072 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:12:00.793088 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:12:00.793103 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:12:00.793118 | orchestrator | 2026-04-28 04:12:00.793133 | orchestrator | TASK [magnum : Check if kubeconfig file is supplied] *************************** 2026-04-28 04:12:00.793149 | orchestrator | Tuesday 28 April 2026 04:11:53 +0000 (0:00:00.339) 0:00:39.725 ********* 2026-04-28 04:12:00.793163 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 04:12:00.793179 | orchestrator | 2026-04-28 04:12:00.793195 | orchestrator | TASK [magnum : Copying over kubeconfig file] *********************************** 2026-04-28 04:12:00.793211 | orchestrator | Tuesday 28 April 2026 04:11:54 +0000 (0:00:00.956) 0:00:40.682 ********* 2026-04-28 04:12:00.793265 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-28 04:12:00.793311 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-28 04:12:00.793331 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-28 04:12:00.793376 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 04:12:00.793397 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 04:12:00.793426 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 04:12:00.793444 | orchestrator | 2026-04-28 04:12:00.793459 | orchestrator | TASK [magnum : Set magnum kubeconfig file's path] ****************************** 2026-04-28 04:12:00.793474 | orchestrator | Tuesday 28 April 2026 04:11:56 +0000 (0:00:02.530) 0:00:43.212 ********* 2026-04-28 04:12:00.793490 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:12:00.793506 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:12:00.793521 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:12:00.793536 | orchestrator | 2026-04-28 04:12:00.793551 | orchestrator | TASK [magnum : include_tasks] ************************************************** 2026-04-28 04:12:00.793567 | orchestrator | Tuesday 28 April 2026 04:11:57 +0000 (0:00:00.624) 0:00:43.836 ********* 2026-04-28 04:12:00.793583 | orchestrator | included: /ansible/roles/magnum/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:12:00.793597 | orchestrator | 2026-04-28 04:12:00.793621 | orchestrator | TASK [service-cert-copy : magnum | Copying over extra CA certificates] ********* 2026-04-28 04:12:00.793638 | orchestrator | Tuesday 28 April 2026 04:11:58 +0000 (0:00:00.622) 0:00:44.459 ********* 2026-04-28 04:12:00.793653 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-28 04:12:00.793685 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-28 04:12:01.812209 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-28 04:12:01.812286 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 04:12:01.812309 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 04:12:01.812316 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 04:12:01.812322 | orchestrator | 2026-04-28 04:12:01.812330 | orchestrator | TASK [service-cert-copy : magnum | Copying over backend internal TLS certificate] *** 2026-04-28 04:12:01.812338 | orchestrator | Tuesday 28 April 2026 04:12:00 +0000 (0:00:02.637) 0:00:47.097 ********* 2026-04-28 04:12:01.812357 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-28 04:12:01.812380 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 04:12:01.812387 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:12:01.812395 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-28 04:12:01.812405 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 04:12:01.812411 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:12:01.812417 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-28 04:12:01.812428 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 04:12:05.540226 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:12:05.540343 | orchestrator | 2026-04-28 04:12:05.540357 | orchestrator | TASK [service-cert-copy : magnum | Copying over backend internal TLS key] ****** 2026-04-28 04:12:05.540367 | orchestrator | Tuesday 28 April 2026 04:12:01 +0000 (0:00:01.012) 0:00:48.109 ********* 2026-04-28 04:12:05.540378 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-28 04:12:05.540391 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 04:12:05.540400 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:12:05.540426 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-28 04:12:05.540435 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 04:12:05.540464 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:12:05.540489 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-28 04:12:05.540498 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 04:12:05.540506 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:12:05.540514 | orchestrator | 2026-04-28 04:12:05.540523 | orchestrator | TASK [magnum : Copying over config.json files for services] ******************** 2026-04-28 04:12:05.540531 | orchestrator | Tuesday 28 April 2026 04:12:02 +0000 (0:00:00.949) 0:00:49.059 ********* 2026-04-28 04:12:05.540544 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-28 04:12:05.540554 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-28 04:12:05.540575 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-28 04:12:12.397780 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 04:12:12.397892 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 04:12:12.397973 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 04:12:12.397998 | orchestrator | 2026-04-28 04:12:12.398086 | orchestrator | TASK [magnum : Copying over magnum.conf] *************************************** 2026-04-28 04:12:12.398104 | orchestrator | Tuesday 28 April 2026 04:12:05 +0000 (0:00:02.785) 0:00:51.845 ********* 2026-04-28 04:12:12.398116 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-28 04:12:12.398176 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-28 04:12:12.398190 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-28 04:12:12.398202 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 04:12:12.398219 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 04:12:12.398240 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 04:12:12.398252 | orchestrator | 2026-04-28 04:12:12.398271 | orchestrator | TASK [magnum : Copying over existing policy file] ****************************** 2026-04-28 04:12:12.398290 | orchestrator | Tuesday 28 April 2026 04:12:11 +0000 (0:00:06.158) 0:00:58.003 ********* 2026-04-28 04:12:12.398322 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-28 04:12:14.368840 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 04:12:14.368947 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:12:14.368967 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-28 04:12:14.368974 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 04:12:14.368992 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:12:14.368996 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}})  2026-04-28 04:12:14.369011 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 04:12:14.369015 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:12:14.369019 | orchestrator | 2026-04-28 04:12:14.369024 | orchestrator | TASK [magnum : Check magnum containers] **************************************** 2026-04-28 04:12:14.369029 | orchestrator | Tuesday 28 April 2026 04:12:12 +0000 (0:00:00.702) 0:00:58.706 ********* 2026-04-28 04:12:14.369034 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-28 04:12:14.369042 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-28 04:12:14.369050 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511'}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511'}}}}) 2026-04-28 04:12:14.369054 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 04:12:14.369062 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 04:13:08.119590 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 04:13:08.120615 | orchestrator | 2026-04-28 04:13:08.120665 | orchestrator | TASK [magnum : include_tasks] ************************************************** 2026-04-28 04:13:08.120676 | orchestrator | Tuesday 28 April 2026 04:12:14 +0000 (0:00:01.962) 0:01:00.668 ********* 2026-04-28 04:13:08.120683 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:13:08.120692 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:13:08.120722 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:13:08.120729 | orchestrator | 2026-04-28 04:13:08.120736 | orchestrator | TASK [magnum : Creating Magnum database] *************************************** 2026-04-28 04:13:08.120755 | orchestrator | Tuesday 28 April 2026 04:12:15 +0000 (0:00:00.740) 0:01:01.409 ********* 2026-04-28 04:13:08.120762 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:13:08.120768 | orchestrator | 2026-04-28 04:13:08.120775 | orchestrator | TASK [magnum : Creating Magnum database user and setting permissions] ********** 2026-04-28 04:13:08.120781 | orchestrator | Tuesday 28 April 2026 04:12:17 +0000 (0:00:02.230) 0:01:03.639 ********* 2026-04-28 04:13:08.120787 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:13:08.120793 | orchestrator | 2026-04-28 04:13:08.120799 | orchestrator | TASK [magnum : Running Magnum bootstrap container] ***************************** 2026-04-28 04:13:08.120806 | orchestrator | Tuesday 28 April 2026 04:12:19 +0000 (0:00:02.397) 0:01:06.037 ********* 2026-04-28 04:13:08.120812 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:13:08.120818 | orchestrator | 2026-04-28 04:13:08.120825 | orchestrator | TASK [magnum : Flush handlers] ************************************************* 2026-04-28 04:13:08.120831 | orchestrator | Tuesday 28 April 2026 04:12:36 +0000 (0:00:16.348) 0:01:22.385 ********* 2026-04-28 04:13:08.120838 | orchestrator | 2026-04-28 04:13:08.120844 | orchestrator | TASK [magnum : Flush handlers] ************************************************* 2026-04-28 04:13:08.120850 | orchestrator | Tuesday 28 April 2026 04:12:36 +0000 (0:00:00.098) 0:01:22.484 ********* 2026-04-28 04:13:08.120857 | orchestrator | 2026-04-28 04:13:08.120863 | orchestrator | TASK [magnum : Flush handlers] ************************************************* 2026-04-28 04:13:08.120870 | orchestrator | Tuesday 28 April 2026 04:12:36 +0000 (0:00:00.073) 0:01:22.558 ********* 2026-04-28 04:13:08.120876 | orchestrator | 2026-04-28 04:13:08.120882 | orchestrator | RUNNING HANDLER [magnum : Restart magnum-api container] ************************ 2026-04-28 04:13:08.120889 | orchestrator | Tuesday 28 April 2026 04:12:36 +0000 (0:00:00.081) 0:01:22.640 ********* 2026-04-28 04:13:08.120939 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:13:08.120946 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:13:08.120953 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:13:08.120959 | orchestrator | 2026-04-28 04:13:08.120965 | orchestrator | RUNNING HANDLER [magnum : Restart magnum-conductor container] ****************** 2026-04-28 04:13:08.120971 | orchestrator | Tuesday 28 April 2026 04:12:56 +0000 (0:00:19.797) 0:01:42.437 ********* 2026-04-28 04:13:08.120977 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:13:08.120984 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:13:08.120990 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:13:08.120996 | orchestrator | 2026-04-28 04:13:08.121002 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:13:08.121010 | orchestrator | testbed-node-0 : ok=26  changed=18  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 04:13:08.121018 | orchestrator | testbed-node-1 : ok=13  changed=8  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 04:13:08.121024 | orchestrator | testbed-node-2 : ok=13  changed=8  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 04:13:08.121031 | orchestrator | 2026-04-28 04:13:08.121037 | orchestrator | 2026-04-28 04:13:08.121043 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 04:13:08.121050 | orchestrator | Tuesday 28 April 2026 04:13:07 +0000 (0:00:11.557) 0:01:53.995 ********* 2026-04-28 04:13:08.121056 | orchestrator | =============================================================================== 2026-04-28 04:13:08.121062 | orchestrator | magnum : Restart magnum-api container ---------------------------------- 19.80s 2026-04-28 04:13:08.121069 | orchestrator | magnum : Running Magnum bootstrap container ---------------------------- 16.35s 2026-04-28 04:13:08.121075 | orchestrator | magnum : Restart magnum-conductor container ---------------------------- 11.56s 2026-04-28 04:13:08.121081 | orchestrator | service-ks-register : magnum | Creating endpoints ----------------------- 6.59s 2026-04-28 04:13:08.121098 | orchestrator | magnum : Copying over magnum.conf --------------------------------------- 6.16s 2026-04-28 04:13:08.121106 | orchestrator | magnum : Creating Magnum trustee user ----------------------------------- 4.04s 2026-04-28 04:13:08.121113 | orchestrator | service-ks-register : magnum | Creating users --------------------------- 3.98s 2026-04-28 04:13:08.121141 | orchestrator | service-ks-register : magnum | Granting user roles ---------------------- 3.88s 2026-04-28 04:13:08.121147 | orchestrator | service-ks-register : magnum | Creating services ------------------------ 3.60s 2026-04-28 04:13:08.121154 | orchestrator | service-ks-register : magnum | Creating projects ------------------------ 3.45s 2026-04-28 04:13:08.121160 | orchestrator | magnum : Creating Magnum trustee user role ------------------------------ 3.44s 2026-04-28 04:13:08.121166 | orchestrator | magnum : Creating Magnum trustee domain --------------------------------- 3.39s 2026-04-28 04:13:08.121172 | orchestrator | service-ks-register : magnum | Creating roles --------------------------- 3.34s 2026-04-28 04:13:08.121178 | orchestrator | magnum : Copying over config.json files for services -------------------- 2.79s 2026-04-28 04:13:08.121185 | orchestrator | service-cert-copy : magnum | Copying over extra CA certificates --------- 2.64s 2026-04-28 04:13:08.121191 | orchestrator | magnum : Copying over kubeconfig file ----------------------------------- 2.53s 2026-04-28 04:13:08.121198 | orchestrator | magnum : Creating Magnum database user and setting permissions ---------- 2.40s 2026-04-28 04:13:08.121204 | orchestrator | magnum : Creating Magnum database --------------------------------------- 2.23s 2026-04-28 04:13:08.121211 | orchestrator | magnum : Check magnum containers ---------------------------------------- 1.96s 2026-04-28 04:13:08.121217 | orchestrator | magnum : Ensuring config directories exist ------------------------------ 1.68s 2026-04-28 04:13:08.931986 | orchestrator | ok: Runtime: 1:47:46.898118 2026-04-28 04:13:09.175647 | 2026-04-28 04:13:09.175785 | TASK [Deploy in a nutshell] 2026-04-28 04:13:09.709822 | orchestrator | skipping: Conditional result was False 2026-04-28 04:13:09.732412 | 2026-04-28 04:13:09.732572 | TASK [Bootstrap services] 2026-04-28 04:13:10.463427 | orchestrator | 2026-04-28 04:13:10.463553 | orchestrator | # BOOTSTRAP 2026-04-28 04:13:10.463563 | orchestrator | 2026-04-28 04:13:10.463568 | orchestrator | + set -e 2026-04-28 04:13:10.463573 | orchestrator | + echo 2026-04-28 04:13:10.463580 | orchestrator | + echo '# BOOTSTRAP' 2026-04-28 04:13:10.463587 | orchestrator | + echo 2026-04-28 04:13:10.463608 | orchestrator | + sh -c /opt/configuration/scripts/bootstrap-services.sh 2026-04-28 04:13:10.469811 | orchestrator | + set -e 2026-04-28 04:13:10.469925 | orchestrator | + sh -c /opt/configuration/scripts/bootstrap/300-openstack.sh 2026-04-28 04:13:12.825158 | orchestrator | 2026-04-28 04:13:12 | INFO  | It takes a moment until task 81f7e4dc-fa3f-4878-a68e-022f62f2ba8d (flavor-manager) has been started and output is visible here. 2026-04-28 04:13:21.492636 | orchestrator | 2026-04-28 04:13:16 | INFO  | Flavor SCS-1L-1 created 2026-04-28 04:13:21.492796 | orchestrator | 2026-04-28 04:13:16 | INFO  | Flavor SCS-1L-1-5 created 2026-04-28 04:13:21.492827 | orchestrator | 2026-04-28 04:13:17 | INFO  | Flavor SCS-1V-2 created 2026-04-28 04:13:21.492845 | orchestrator | 2026-04-28 04:13:17 | INFO  | Flavor SCS-1V-2-5 created 2026-04-28 04:13:21.492862 | orchestrator | 2026-04-28 04:13:17 | INFO  | Flavor SCS-1V-4 created 2026-04-28 04:13:21.492878 | orchestrator | 2026-04-28 04:13:17 | INFO  | Flavor SCS-1V-4-10 created 2026-04-28 04:13:21.492926 | orchestrator | 2026-04-28 04:13:17 | INFO  | Flavor SCS-1V-8 created 2026-04-28 04:13:21.492962 | orchestrator | 2026-04-28 04:13:17 | INFO  | Flavor SCS-1V-8-20 created 2026-04-28 04:13:21.493008 | orchestrator | 2026-04-28 04:13:18 | INFO  | Flavor SCS-2V-4 created 2026-04-28 04:13:21.493029 | orchestrator | 2026-04-28 04:13:18 | INFO  | Flavor SCS-2V-4-10 created 2026-04-28 04:13:21.493046 | orchestrator | 2026-04-28 04:13:18 | INFO  | Flavor SCS-2V-8 created 2026-04-28 04:13:21.493062 | orchestrator | 2026-04-28 04:13:18 | INFO  | Flavor SCS-2V-8-20 created 2026-04-28 04:13:21.493078 | orchestrator | 2026-04-28 04:13:18 | INFO  | Flavor SCS-2V-16 created 2026-04-28 04:13:21.493094 | orchestrator | 2026-04-28 04:13:18 | INFO  | Flavor SCS-2V-16-50 created 2026-04-28 04:13:21.493111 | orchestrator | 2026-04-28 04:13:19 | INFO  | Flavor SCS-4V-8 created 2026-04-28 04:13:21.493128 | orchestrator | 2026-04-28 04:13:19 | INFO  | Flavor SCS-4V-8-20 created 2026-04-28 04:13:21.493145 | orchestrator | 2026-04-28 04:13:19 | INFO  | Flavor SCS-4V-16 created 2026-04-28 04:13:21.493161 | orchestrator | 2026-04-28 04:13:19 | INFO  | Flavor SCS-4V-16-50 created 2026-04-28 04:13:21.493178 | orchestrator | 2026-04-28 04:13:19 | INFO  | Flavor SCS-4V-32 created 2026-04-28 04:13:21.493195 | orchestrator | 2026-04-28 04:13:19 | INFO  | Flavor SCS-4V-32-100 created 2026-04-28 04:13:21.493212 | orchestrator | 2026-04-28 04:13:19 | INFO  | Flavor SCS-8V-16 created 2026-04-28 04:13:21.493230 | orchestrator | 2026-04-28 04:13:20 | INFO  | Flavor SCS-8V-16-50 created 2026-04-28 04:13:21.493247 | orchestrator | 2026-04-28 04:13:20 | INFO  | Flavor SCS-8V-32 created 2026-04-28 04:13:21.493264 | orchestrator | 2026-04-28 04:13:20 | INFO  | Flavor SCS-8V-32-100 created 2026-04-28 04:13:21.493281 | orchestrator | 2026-04-28 04:13:20 | INFO  | Flavor SCS-16V-32 created 2026-04-28 04:13:21.493298 | orchestrator | 2026-04-28 04:13:20 | INFO  | Flavor SCS-16V-32-100 created 2026-04-28 04:13:21.493315 | orchestrator | 2026-04-28 04:13:20 | INFO  | Flavor SCS-2V-4-20s created 2026-04-28 04:13:21.493332 | orchestrator | 2026-04-28 04:13:21 | INFO  | Flavor SCS-4V-8-50s created 2026-04-28 04:13:21.493348 | orchestrator | 2026-04-28 04:13:21 | INFO  | Flavor SCS-8V-32-100s created 2026-04-28 04:13:24.230639 | orchestrator | 2026-04-28 04:13:24 | INFO  | Trying to run play bootstrap-basic in environment openstack 2026-04-28 04:13:34.373126 | orchestrator | 2026-04-28 04:13:34 | INFO  | Task c03fff1c-cd8d-47ff-b04d-0adf28ca32c4 (bootstrap-basic) was prepared for execution. 2026-04-28 04:13:34.373210 | orchestrator | 2026-04-28 04:13:34 | INFO  | It takes a moment until task c03fff1c-cd8d-47ff-b04d-0adf28ca32c4 (bootstrap-basic) has been started and output is visible here. 2026-04-28 04:14:22.381712 | orchestrator | 2026-04-28 04:14:22.381827 | orchestrator | PLAY [Bootstrap basic OpenStack services] ************************************** 2026-04-28 04:14:22.381843 | orchestrator | 2026-04-28 04:14:22.381849 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-28 04:14:22.381855 | orchestrator | Tuesday 28 April 2026 04:13:39 +0000 (0:00:00.108) 0:00:00.108 ********* 2026-04-28 04:14:22.381861 | orchestrator | ok: [localhost] 2026-04-28 04:14:22.381868 | orchestrator | 2026-04-28 04:14:22.381874 | orchestrator | TASK [Get volume type LUKS] **************************************************** 2026-04-28 04:14:22.381879 | orchestrator | Tuesday 28 April 2026 04:13:41 +0000 (0:00:02.120) 0:00:02.229 ********* 2026-04-28 04:14:22.381885 | orchestrator | ok: [localhost] 2026-04-28 04:14:22.381930 | orchestrator | 2026-04-28 04:14:22.381936 | orchestrator | TASK [Create volume type LUKS] ************************************************* 2026-04-28 04:14:22.381942 | orchestrator | Tuesday 28 April 2026 04:13:49 +0000 (0:00:08.430) 0:00:10.659 ********* 2026-04-28 04:14:22.381948 | orchestrator | changed: [localhost] 2026-04-28 04:14:22.381954 | orchestrator | 2026-04-28 04:14:22.381960 | orchestrator | TASK [Create public network] *************************************************** 2026-04-28 04:14:22.381967 | orchestrator | Tuesday 28 April 2026 04:13:56 +0000 (0:00:06.948) 0:00:17.608 ********* 2026-04-28 04:14:22.381972 | orchestrator | changed: [localhost] 2026-04-28 04:14:22.381978 | orchestrator | 2026-04-28 04:14:22.381984 | orchestrator | TASK [Set public network to default] ******************************************* 2026-04-28 04:14:22.381990 | orchestrator | Tuesday 28 April 2026 04:14:02 +0000 (0:00:05.587) 0:00:23.196 ********* 2026-04-28 04:14:22.381999 | orchestrator | changed: [localhost] 2026-04-28 04:14:22.382005 | orchestrator | 2026-04-28 04:14:22.382010 | orchestrator | TASK [Create public subnet] **************************************************** 2026-04-28 04:14:22.382064 | orchestrator | Tuesday 28 April 2026 04:14:09 +0000 (0:00:06.927) 0:00:30.123 ********* 2026-04-28 04:14:22.382072 | orchestrator | changed: [localhost] 2026-04-28 04:14:22.382080 | orchestrator | 2026-04-28 04:14:22.382089 | orchestrator | TASK [Create default IPv4 subnet pool] ***************************************** 2026-04-28 04:14:22.382097 | orchestrator | Tuesday 28 April 2026 04:14:14 +0000 (0:00:04.773) 0:00:34.896 ********* 2026-04-28 04:14:22.382106 | orchestrator | changed: [localhost] 2026-04-28 04:14:22.382114 | orchestrator | 2026-04-28 04:14:22.382123 | orchestrator | TASK [Create manager role] ***************************************************** 2026-04-28 04:14:22.382143 | orchestrator | Tuesday 28 April 2026 04:14:18 +0000 (0:00:04.158) 0:00:39.055 ********* 2026-04-28 04:14:22.382148 | orchestrator | ok: [localhost] 2026-04-28 04:14:22.382154 | orchestrator | 2026-04-28 04:14:22.382159 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:14:22.382164 | orchestrator | localhost : ok=8  changed=5  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 04:14:22.382171 | orchestrator | 2026-04-28 04:14:22.382176 | orchestrator | 2026-04-28 04:14:22.382181 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 04:14:22.382186 | orchestrator | Tuesday 28 April 2026 04:14:22 +0000 (0:00:03.890) 0:00:42.945 ********* 2026-04-28 04:14:22.382192 | orchestrator | =============================================================================== 2026-04-28 04:14:22.382197 | orchestrator | Get volume type LUKS ---------------------------------------------------- 8.43s 2026-04-28 04:14:22.382202 | orchestrator | Create volume type LUKS ------------------------------------------------- 6.95s 2026-04-28 04:14:22.382207 | orchestrator | Set public network to default ------------------------------------------- 6.93s 2026-04-28 04:14:22.382212 | orchestrator | Create public network --------------------------------------------------- 5.59s 2026-04-28 04:14:22.382236 | orchestrator | Create public subnet ---------------------------------------------------- 4.77s 2026-04-28 04:14:22.382241 | orchestrator | Create default IPv4 subnet pool ----------------------------------------- 4.16s 2026-04-28 04:14:22.382247 | orchestrator | Create manager role ----------------------------------------------------- 3.89s 2026-04-28 04:14:22.382252 | orchestrator | Gathering Facts --------------------------------------------------------- 2.12s 2026-04-28 04:14:25.117089 | orchestrator | 2026-04-28 04:14:25 | INFO  | It takes a moment until task 644e6891-476f-4a01-9a60-aa73d5be7f9f (image-manager) has been started and output is visible here. 2026-04-28 04:15:08.687798 | orchestrator | 2026-04-28 04:14:28 | INFO  | Processing image 'Cirros 0.6.2' 2026-04-28 04:15:08.687936 | orchestrator | 2026-04-28 04:14:28 | INFO  | Tested URL https://github.com/cirros-dev/cirros/releases/download/0.6.2/cirros-0.6.2-x86_64-disk.img: 302 2026-04-28 04:15:08.687954 | orchestrator | 2026-04-28 04:14:28 | INFO  | Importing image Cirros 0.6.2 2026-04-28 04:15:08.687966 | orchestrator | 2026-04-28 04:14:28 | INFO  | Importing from URL https://github.com/cirros-dev/cirros/releases/download/0.6.2/cirros-0.6.2-x86_64-disk.img 2026-04-28 04:15:08.687977 | orchestrator | 2026-04-28 04:14:30 | INFO  | Waiting for image to leave queued state... 2026-04-28 04:15:08.687989 | orchestrator | 2026-04-28 04:14:32 | INFO  | Waiting for import to complete... 2026-04-28 04:15:08.688000 | orchestrator | 2026-04-28 04:14:42 | INFO  | Import of 'Cirros 0.6.2' successfully completed, reloading images 2026-04-28 04:15:08.688010 | orchestrator | 2026-04-28 04:14:43 | INFO  | Checking parameters of 'Cirros 0.6.2' 2026-04-28 04:15:08.688020 | orchestrator | 2026-04-28 04:14:43 | INFO  | Setting internal_version = 0.6.2 2026-04-28 04:15:08.688031 | orchestrator | 2026-04-28 04:14:43 | INFO  | Setting image_original_user = cirros 2026-04-28 04:15:08.688041 | orchestrator | 2026-04-28 04:14:43 | INFO  | Adding tag os:cirros 2026-04-28 04:15:08.688051 | orchestrator | 2026-04-28 04:14:43 | INFO  | Setting property architecture: x86_64 2026-04-28 04:15:08.688061 | orchestrator | 2026-04-28 04:14:43 | INFO  | Setting property hw_disk_bus: scsi 2026-04-28 04:15:08.688071 | orchestrator | 2026-04-28 04:14:43 | INFO  | Setting property hw_rng_model: virtio 2026-04-28 04:15:08.688081 | orchestrator | 2026-04-28 04:14:44 | INFO  | Setting property hw_scsi_model: virtio-scsi 2026-04-28 04:15:08.688091 | orchestrator | 2026-04-28 04:14:44 | INFO  | Setting property hw_watchdog_action: reset 2026-04-28 04:15:08.688101 | orchestrator | 2026-04-28 04:14:44 | INFO  | Setting property hypervisor_type: qemu 2026-04-28 04:15:08.688111 | orchestrator | 2026-04-28 04:14:45 | INFO  | Setting property os_distro: cirros 2026-04-28 04:15:08.688121 | orchestrator | 2026-04-28 04:14:45 | INFO  | Setting property os_purpose: minimal 2026-04-28 04:15:08.688130 | orchestrator | 2026-04-28 04:14:45 | INFO  | Setting property replace_frequency: never 2026-04-28 04:15:08.688140 | orchestrator | 2026-04-28 04:14:45 | INFO  | Setting property uuid_validity: none 2026-04-28 04:15:08.688150 | orchestrator | 2026-04-28 04:14:46 | INFO  | Setting property provided_until: none 2026-04-28 04:15:08.688159 | orchestrator | 2026-04-28 04:14:46 | INFO  | Setting property image_description: Cirros 2026-04-28 04:15:08.688169 | orchestrator | 2026-04-28 04:14:46 | INFO  | Setting property image_name: Cirros 2026-04-28 04:15:08.688179 | orchestrator | 2026-04-28 04:14:46 | INFO  | Setting property internal_version: 0.6.2 2026-04-28 04:15:08.688201 | orchestrator | 2026-04-28 04:14:47 | INFO  | Setting property image_original_user: cirros 2026-04-28 04:15:08.688244 | orchestrator | 2026-04-28 04:14:47 | INFO  | Setting property os_version: 0.6.2 2026-04-28 04:15:08.688264 | orchestrator | 2026-04-28 04:14:47 | INFO  | Setting property image_source: https://github.com/cirros-dev/cirros/releases/download/0.6.2/cirros-0.6.2-x86_64-disk.img 2026-04-28 04:15:08.688275 | orchestrator | 2026-04-28 04:14:47 | INFO  | Setting property image_build_date: 2023-05-30 2026-04-28 04:15:08.688285 | orchestrator | 2026-04-28 04:14:48 | INFO  | Checking status of 'Cirros 0.6.2' 2026-04-28 04:15:08.688295 | orchestrator | 2026-04-28 04:14:48 | INFO  | Checking visibility of 'Cirros 0.6.2' 2026-04-28 04:15:08.688305 | orchestrator | 2026-04-28 04:14:48 | INFO  | Setting visibility of 'Cirros 0.6.2' to 'public' 2026-04-28 04:15:08.688314 | orchestrator | 2026-04-28 04:14:48 | INFO  | Processing image 'Cirros 0.6.3' 2026-04-28 04:15:08.688332 | orchestrator | 2026-04-28 04:14:48 | INFO  | Tested URL https://github.com/cirros-dev/cirros/releases/download/0.6.3/cirros-0.6.3-x86_64-disk.img: 302 2026-04-28 04:15:08.688344 | orchestrator | 2026-04-28 04:14:48 | INFO  | Importing image Cirros 0.6.3 2026-04-28 04:15:08.688355 | orchestrator | 2026-04-28 04:14:48 | INFO  | Importing from URL https://github.com/cirros-dev/cirros/releases/download/0.6.3/cirros-0.6.3-x86_64-disk.img 2026-04-28 04:15:08.688368 | orchestrator | 2026-04-28 04:14:49 | INFO  | Waiting for image to leave queued state... 2026-04-28 04:15:08.688379 | orchestrator | 2026-04-28 04:14:51 | INFO  | Waiting for import to complete... 2026-04-28 04:15:08.688407 | orchestrator | 2026-04-28 04:15:02 | INFO  | Import of 'Cirros 0.6.3' successfully completed, reloading images 2026-04-28 04:15:08.688420 | orchestrator | 2026-04-28 04:15:02 | INFO  | Checking parameters of 'Cirros 0.6.3' 2026-04-28 04:15:08.688432 | orchestrator | 2026-04-28 04:15:02 | INFO  | Setting internal_version = 0.6.3 2026-04-28 04:15:08.688443 | orchestrator | 2026-04-28 04:15:02 | INFO  | Setting image_original_user = cirros 2026-04-28 04:15:08.688454 | orchestrator | 2026-04-28 04:15:02 | INFO  | Adding tag os:cirros 2026-04-28 04:15:08.688465 | orchestrator | 2026-04-28 04:15:02 | INFO  | Setting property architecture: x86_64 2026-04-28 04:15:08.688476 | orchestrator | 2026-04-28 04:15:03 | INFO  | Setting property hw_disk_bus: scsi 2026-04-28 04:15:08.688487 | orchestrator | 2026-04-28 04:15:03 | INFO  | Setting property hw_rng_model: virtio 2026-04-28 04:15:08.688498 | orchestrator | 2026-04-28 04:15:03 | INFO  | Setting property hw_scsi_model: virtio-scsi 2026-04-28 04:15:08.688509 | orchestrator | 2026-04-28 04:15:04 | INFO  | Setting property hw_watchdog_action: reset 2026-04-28 04:15:08.688521 | orchestrator | 2026-04-28 04:15:04 | INFO  | Setting property hypervisor_type: qemu 2026-04-28 04:15:08.688533 | orchestrator | 2026-04-28 04:15:04 | INFO  | Setting property os_distro: cirros 2026-04-28 04:15:08.688544 | orchestrator | 2026-04-28 04:15:04 | INFO  | Setting property os_purpose: minimal 2026-04-28 04:15:08.688555 | orchestrator | 2026-04-28 04:15:05 | INFO  | Setting property replace_frequency: never 2026-04-28 04:15:08.688566 | orchestrator | 2026-04-28 04:15:05 | INFO  | Setting property uuid_validity: none 2026-04-28 04:15:08.688578 | orchestrator | 2026-04-28 04:15:05 | INFO  | Setting property provided_until: none 2026-04-28 04:15:08.688589 | orchestrator | 2026-04-28 04:15:05 | INFO  | Setting property image_description: Cirros 2026-04-28 04:15:08.688601 | orchestrator | 2026-04-28 04:15:06 | INFO  | Setting property image_name: Cirros 2026-04-28 04:15:08.688612 | orchestrator | 2026-04-28 04:15:06 | INFO  | Setting property internal_version: 0.6.3 2026-04-28 04:15:08.688631 | orchestrator | 2026-04-28 04:15:06 | INFO  | Setting property image_original_user: cirros 2026-04-28 04:15:08.688643 | orchestrator | 2026-04-28 04:15:06 | INFO  | Setting property os_version: 0.6.3 2026-04-28 04:15:08.688654 | orchestrator | 2026-04-28 04:15:07 | INFO  | Setting property image_source: https://github.com/cirros-dev/cirros/releases/download/0.6.3/cirros-0.6.3-x86_64-disk.img 2026-04-28 04:15:08.688666 | orchestrator | 2026-04-28 04:15:07 | INFO  | Setting property image_build_date: 2024-09-26 2026-04-28 04:15:08.688677 | orchestrator | 2026-04-28 04:15:07 | INFO  | Checking status of 'Cirros 0.6.3' 2026-04-28 04:15:08.688689 | orchestrator | 2026-04-28 04:15:07 | INFO  | Checking visibility of 'Cirros 0.6.3' 2026-04-28 04:15:08.688700 | orchestrator | 2026-04-28 04:15:07 | INFO  | Setting visibility of 'Cirros 0.6.3' to 'public' 2026-04-28 04:15:09.069815 | orchestrator | + sh -c /opt/configuration/scripts/bootstrap/301-openstack-octavia-amphora-image.sh 2026-04-28 04:15:11.765442 | orchestrator | 2026-04-28 04:15:11 | INFO  | date: 2026-04-28 2026-04-28 04:15:11.765565 | orchestrator | 2026-04-28 04:15:11 | INFO  | image: octavia-amphora-haproxy-2024.2.20260428.qcow2 2026-04-28 04:15:11.765618 | orchestrator | 2026-04-28 04:15:11 | INFO  | url: https://nbg1.your-objectstorage.com/osism/openstack-octavia-amphora-image/octavia-amphora-haproxy-2024.2.20260428.qcow2 2026-04-28 04:15:11.765846 | orchestrator | 2026-04-28 04:15:11 | INFO  | checksum_url: https://nbg1.your-objectstorage.com/osism/openstack-octavia-amphora-image/octavia-amphora-haproxy-2024.2.20260428.qcow2.CHECKSUM 2026-04-28 04:15:11.947010 | orchestrator | 2026-04-28 04:15:11 | INFO  | checksum: 1c706f8ba02b62c8d8d8497a321f84b02a6950343946751a2c9bd8530f198577 2026-04-28 04:15:12.029508 | orchestrator | 2026-04-28 04:15:12 | INFO  | It takes a moment until task 99e892ab-4e45-4ec0-a52f-235b157e4c11 (image-manager) has been started and output is visible here. 2026-04-28 04:16:25.455459 | orchestrator | 2026-04-28 04:15:14 | INFO  | Processing image 'OpenStack Octavia Amphora 2026-04-28' 2026-04-28 04:16:25.455579 | orchestrator | 2026-04-28 04:15:14 | INFO  | Tested URL https://nbg1.your-objectstorage.com/osism/openstack-octavia-amphora-image/octavia-amphora-haproxy-2024.2.20260428.qcow2: 200 2026-04-28 04:16:25.455600 | orchestrator | 2026-04-28 04:15:14 | INFO  | Importing image OpenStack Octavia Amphora 2026-04-28 2026-04-28 04:16:25.455614 | orchestrator | 2026-04-28 04:15:14 | INFO  | Importing from URL https://nbg1.your-objectstorage.com/osism/openstack-octavia-amphora-image/octavia-amphora-haproxy-2024.2.20260428.qcow2 2026-04-28 04:16:25.455628 | orchestrator | 2026-04-28 04:15:16 | INFO  | Waiting for image to leave queued state... 2026-04-28 04:16:25.455642 | orchestrator | 2026-04-28 04:15:18 | INFO  | Waiting for import to complete... 2026-04-28 04:16:25.455654 | orchestrator | 2026-04-28 04:15:28 | INFO  | Waiting for import to complete... 2026-04-28 04:16:25.455667 | orchestrator | 2026-04-28 04:15:38 | INFO  | Waiting for import to complete... 2026-04-28 04:16:25.455679 | orchestrator | 2026-04-28 04:15:48 | INFO  | Waiting for import to complete... 2026-04-28 04:16:25.455693 | orchestrator | 2026-04-28 04:15:58 | INFO  | Waiting for import to complete... 2026-04-28 04:16:25.455706 | orchestrator | 2026-04-28 04:16:08 | INFO  | Waiting for import to complete... 2026-04-28 04:16:25.455719 | orchestrator | 2026-04-28 04:16:18 | INFO  | Import of 'OpenStack Octavia Amphora 2026-04-28' successfully completed, reloading images 2026-04-28 04:16:25.455732 | orchestrator | 2026-04-28 04:16:19 | INFO  | Checking parameters of 'OpenStack Octavia Amphora 2026-04-28' 2026-04-28 04:16:25.455770 | orchestrator | 2026-04-28 04:16:19 | INFO  | Setting internal_version = 2026-04-28 2026-04-28 04:16:25.455783 | orchestrator | 2026-04-28 04:16:19 | INFO  | Setting image_original_user = ubuntu 2026-04-28 04:16:25.455796 | orchestrator | 2026-04-28 04:16:19 | INFO  | Adding tag amphora 2026-04-28 04:16:25.455808 | orchestrator | 2026-04-28 04:16:19 | INFO  | Adding tag os:ubuntu 2026-04-28 04:16:25.455821 | orchestrator | 2026-04-28 04:16:20 | INFO  | Setting property architecture: x86_64 2026-04-28 04:16:25.455833 | orchestrator | 2026-04-28 04:16:20 | INFO  | Setting property hw_disk_bus: scsi 2026-04-28 04:16:25.455845 | orchestrator | 2026-04-28 04:16:20 | INFO  | Setting property hw_rng_model: virtio 2026-04-28 04:16:25.455856 | orchestrator | 2026-04-28 04:16:20 | INFO  | Setting property hw_scsi_model: virtio-scsi 2026-04-28 04:16:25.455868 | orchestrator | 2026-04-28 04:16:21 | INFO  | Setting property hw_watchdog_action: reset 2026-04-28 04:16:25.455934 | orchestrator | 2026-04-28 04:16:21 | INFO  | Setting property hypervisor_type: qemu 2026-04-28 04:16:25.455947 | orchestrator | 2026-04-28 04:16:21 | INFO  | Setting property os_distro: ubuntu 2026-04-28 04:16:25.455959 | orchestrator | 2026-04-28 04:16:22 | INFO  | Setting property replace_frequency: quarterly 2026-04-28 04:16:25.455971 | orchestrator | 2026-04-28 04:16:22 | INFO  | Setting property uuid_validity: last-1 2026-04-28 04:16:25.455983 | orchestrator | 2026-04-28 04:16:22 | INFO  | Setting property provided_until: none 2026-04-28 04:16:25.455997 | orchestrator | 2026-04-28 04:16:22 | INFO  | Setting property os_purpose: network 2026-04-28 04:16:25.456026 | orchestrator | 2026-04-28 04:16:23 | INFO  | Setting property image_description: OpenStack Octavia Amphora 2026-04-28 04:16:25.456041 | orchestrator | 2026-04-28 04:16:23 | INFO  | Setting property image_name: OpenStack Octavia Amphora 2026-04-28 04:16:25.456054 | orchestrator | 2026-04-28 04:16:23 | INFO  | Setting property internal_version: 2026-04-28 2026-04-28 04:16:25.456062 | orchestrator | 2026-04-28 04:16:23 | INFO  | Setting property image_original_user: ubuntu 2026-04-28 04:16:25.456071 | orchestrator | 2026-04-28 04:16:23 | INFO  | Setting property os_version: 2026-04-28 2026-04-28 04:16:25.456080 | orchestrator | 2026-04-28 04:16:24 | INFO  | Setting property image_source: https://nbg1.your-objectstorage.com/osism/openstack-octavia-amphora-image/octavia-amphora-haproxy-2024.2.20260428.qcow2 2026-04-28 04:16:25.456089 | orchestrator | 2026-04-28 04:16:24 | INFO  | Setting property image_build_date: 2026-04-28 2026-04-28 04:16:25.456098 | orchestrator | 2026-04-28 04:16:24 | INFO  | Checking status of 'OpenStack Octavia Amphora 2026-04-28' 2026-04-28 04:16:25.456106 | orchestrator | 2026-04-28 04:16:24 | INFO  | Checking visibility of 'OpenStack Octavia Amphora 2026-04-28' 2026-04-28 04:16:25.456130 | orchestrator | 2026-04-28 04:16:25 | INFO  | Processing image 'Cirros 0.6.3' (removal candidate) 2026-04-28 04:16:25.456140 | orchestrator | 2026-04-28 04:16:25 | WARNING  | No image definition found for 'Cirros 0.6.3', image will be ignored 2026-04-28 04:16:25.456150 | orchestrator | 2026-04-28 04:16:25 | INFO  | Processing image 'Cirros 0.6.2' (removal candidate) 2026-04-28 04:16:25.456159 | orchestrator | 2026-04-28 04:16:25 | WARNING  | No image definition found for 'Cirros 0.6.2', image will be ignored 2026-04-28 04:16:25.924172 | orchestrator | ok: Runtime: 0:03:15.785566 2026-04-28 04:16:25.936477 | 2026-04-28 04:16:25.936595 | TASK [Run checks] 2026-04-28 04:16:26.658333 | orchestrator | + set -e 2026-04-28 04:16:26.658485 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-28 04:16:26.658501 | orchestrator | ++ export INTERACTIVE=false 2026-04-28 04:16:26.658517 | orchestrator | ++ INTERACTIVE=false 2026-04-28 04:16:26.658526 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-28 04:16:26.658535 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-28 04:16:26.658543 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-28 04:16:26.658870 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-28 04:16:26.663493 | orchestrator | 2026-04-28 04:16:26.663569 | orchestrator | # CHECK 2026-04-28 04:16:26.663577 | orchestrator | 2026-04-28 04:16:26.663585 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-28 04:16:26.663597 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-28 04:16:26.663604 | orchestrator | + echo 2026-04-28 04:16:26.663611 | orchestrator | + echo '# CHECK' 2026-04-28 04:16:26.663618 | orchestrator | + echo 2026-04-28 04:16:26.663630 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-28 04:16:26.664784 | orchestrator | ++ semver 9.5.0 5.0.0 2026-04-28 04:16:26.728163 | orchestrator | 2026-04-28 04:16:26.728258 | orchestrator | ## Containers @ testbed-manager 2026-04-28 04:16:26.728272 | orchestrator | 2026-04-28 04:16:26.728285 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-28 04:16:26.728294 | orchestrator | + echo 2026-04-28 04:16:26.728304 | orchestrator | + echo '## Containers @ testbed-manager' 2026-04-28 04:16:26.728313 | orchestrator | + echo 2026-04-28 04:16:26.728324 | orchestrator | + osism container testbed-manager ps 2026-04-28 04:16:28.899971 | orchestrator | 2026-04-28 04:16:28 | INFO  | Creating empty known_hosts file: /share/known_hosts 2026-04-28 04:16:29.406458 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-28 04:16:29.406547 | orchestrator | 50ed7796a94a registry.osism.tech/kolla/release/prometheus-blackbox-exporter:0.25.0.20251130 "dumb-init --single-…" 9 minutes ago Up 9 minutes prometheus_blackbox_exporter 2026-04-28 04:16:29.406558 | orchestrator | ef89c02b271e registry.osism.tech/kolla/release/prometheus-alertmanager:0.28.0.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_alertmanager 2026-04-28 04:16:29.406567 | orchestrator | 3aea4d3c59f7 registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_cadvisor 2026-04-28 04:16:29.406571 | orchestrator | f625f68a1560 registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_node_exporter 2026-04-28 04:16:29.406575 | orchestrator | 179a60c455bf registry.osism.tech/kolla/release/prometheus-v2-server:2.55.1.20251130 "dumb-init --single-…" 11 minutes ago Up 11 minutes prometheus_server 2026-04-28 04:16:29.406583 | orchestrator | 93662d7e2df3 registry.osism.tech/osism/cephclient:18.2.7 "/usr/bin/dumb-init …" About an hour ago Up About an hour cephclient 2026-04-28 04:16:29.406587 | orchestrator | e1385ea000c4 registry.osism.tech/kolla/release/cron:3.0.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours cron 2026-04-28 04:16:29.406592 | orchestrator | bfcd857977fe registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours kolla_toolbox 2026-04-28 04:16:29.406612 | orchestrator | d190c1278e9b registry.osism.tech/kolla/release/fluentd:5.0.8.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours fluentd 2026-04-28 04:16:29.406617 | orchestrator | b489859771b2 registry.osism.tech/osism/openstackclient:2024.2 "/usr/bin/dumb-init …" 2 hours ago Up 2 hours openstackclient 2026-04-28 04:16:29.406621 | orchestrator | 4d601f170cd5 phpmyadmin/phpmyadmin:5.2 "/docker-entrypoint.…" 2 hours ago Up 2 hours (healthy) 80/tcp phpmyadmin 2026-04-28 04:16:29.406625 | orchestrator | 4c795f03ad96 registry.osism.tech/osism/homer:v25.10.1 "/bin/sh /entrypoint…" 2 hours ago Up 2 hours (healthy) 8080/tcp homer 2026-04-28 04:16:29.406630 | orchestrator | 303bf550d9e5 registry.osism.tech/osism/cgit:1.2.3 "httpd-foreground" 2 hours ago Up 2 hours 80/tcp cgit 2026-04-28 04:16:29.406634 | orchestrator | 39308879d123 registry.osism.tech/dockerhub/ubuntu/squid:6.1-23.10_beta "entrypoint.sh -f /e…" 2 hours ago Up 2 hours (healthy) 192.168.16.5:3128->3128/tcp squid 2026-04-28 04:16:29.406653 | orchestrator | 5184cd74ab6f registry.osism.tech/osism/inventory-reconciler:0.20251130.0 "/sbin/tini -- /entr…" 2 hours ago Up 2 hours (healthy) manager-inventory_reconciler-1 2026-04-28 04:16:29.406658 | orchestrator | 109fa24fc06e registry.osism.tech/osism/osism-ansible:0.20251130.0 "/entrypoint.sh osis…" 2 hours ago Up 2 hours (healthy) osism-ansible 2026-04-28 04:16:29.406662 | orchestrator | 3396e1878922 registry.osism.tech/osism/kolla-ansible:0.20251130.0 "/entrypoint.sh osis…" 2 hours ago Up 2 hours (healthy) kolla-ansible 2026-04-28 04:16:29.406666 | orchestrator | 2fd887a28928 registry.osism.tech/osism/ceph-ansible:0.20251130.0 "/entrypoint.sh osis…" 2 hours ago Up 2 hours (healthy) ceph-ansible 2026-04-28 04:16:29.406670 | orchestrator | 327cce383194 registry.osism.tech/osism/osism-kubernetes:0.20251130.0 "/entrypoint.sh osis…" 2 hours ago Up 2 hours (healthy) osism-kubernetes 2026-04-28 04:16:29.406674 | orchestrator | e388e46cef8d registry.osism.tech/osism/ara-server:1.7.3 "sh -c '/wait && /ru…" 2 hours ago Up 2 hours (healthy) 8000/tcp manager-ara-server-1 2026-04-28 04:16:29.406678 | orchestrator | 4f70aa5706ca registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" 2 hours ago Up 2 hours (healthy) manager-flower-1 2026-04-28 04:16:29.406682 | orchestrator | 2b489d7bddfe registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" 2 hours ago Up 2 hours (healthy) manager-listener-1 2026-04-28 04:16:29.406690 | orchestrator | cfce9e53d2e1 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" 2 hours ago Up 2 hours (healthy) manager-openstack-1 2026-04-28 04:16:29.406694 | orchestrator | 55ea3032f79d registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- sleep…" 2 hours ago Up 2 hours (healthy) osismclient 2026-04-28 04:16:29.406699 | orchestrator | 4e2c787be401 registry.osism.tech/dockerhub/library/redis:7.4.7-alpine "docker-entrypoint.s…" 2 hours ago Up 2 hours (healthy) 6379/tcp manager-redis-1 2026-04-28 04:16:29.406703 | orchestrator | a39dbaf4304e registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" 2 hours ago Up 2 hours (healthy) 192.168.16.5:8000->8000/tcp manager-api-1 2026-04-28 04:16:29.406706 | orchestrator | 032068142f52 registry.osism.tech/dockerhub/library/mariadb:11.8.4 "docker-entrypoint.s…" 2 hours ago Up 2 hours (healthy) 3306/tcp manager-mariadb-1 2026-04-28 04:16:29.406710 | orchestrator | c78c3ecdd801 registry.osism.tech/osism/osism:0.20251130.1 "/sbin/tini -- osism…" 2 hours ago Up 2 hours (healthy) manager-beat-1 2026-04-28 04:16:29.406717 | orchestrator | 00694dd18236 registry.osism.tech/osism/osism-frontend:0.20251130.1 "docker-entrypoint.s…" 2 hours ago Up 2 hours 192.168.16.5:3000->3000/tcp osism-frontend 2026-04-28 04:16:29.406722 | orchestrator | 1f789320b934 registry.osism.tech/dockerhub/library/traefik:v3.5.0 "/entrypoint.sh trae…" 2 hours ago Up 2 hours (healthy) 192.168.16.5:80->80/tcp, 192.168.16.5:443->443/tcp, 192.168.16.5:8122->8080/tcp traefik 2026-04-28 04:16:29.800993 | orchestrator | 2026-04-28 04:16:29.801076 | orchestrator | ## Images @ testbed-manager 2026-04-28 04:16:29.801085 | orchestrator | 2026-04-28 04:16:29.801091 | orchestrator | + echo 2026-04-28 04:16:29.801097 | orchestrator | + echo '## Images @ testbed-manager' 2026-04-28 04:16:29.801103 | orchestrator | + echo 2026-04-28 04:16:29.801111 | orchestrator | + osism container testbed-manager images 2026-04-28 04:16:32.374933 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-28 04:16:32.375058 | orchestrator | registry.osism.tech/osism/openstackclient 2024.2 ce33602ef9c5 16 hours ago 238MB 2026-04-28 04:16:32.375073 | orchestrator | registry.osism.tech/dockerhub/library/redis 7.4.7-alpine e08bd8d5a677 3 months ago 41.4MB 2026-04-28 04:16:32.375086 | orchestrator | registry.osism.tech/osism/homer v25.10.1 ea34b371c716 4 months ago 11.5MB 2026-04-28 04:16:32.375097 | orchestrator | registry.osism.tech/osism/kolla-ansible 0.20251130.0 0f140ec71e5f 4 months ago 608MB 2026-04-28 04:16:32.375112 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-28 04:16:32.375123 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-28 04:16:32.375133 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-28 04:16:32.375145 | orchestrator | registry.osism.tech/kolla/release/prometheus-blackbox-exporter 0.25.0.20251130 7bbb4f6f4831 4 months ago 308MB 2026-04-28 04:16:32.375155 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-28 04:16:32.375194 | orchestrator | registry.osism.tech/kolla/release/prometheus-alertmanager 0.28.0.20251130 ba994ea4acda 4 months ago 404MB 2026-04-28 04:16:32.375205 | orchestrator | registry.osism.tech/kolla/release/prometheus-v2-server 2.55.1.20251130 56b43d5c716a 4 months ago 839MB 2026-04-28 04:16:32.375216 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-28 04:16:32.375227 | orchestrator | registry.osism.tech/osism/inventory-reconciler 0.20251130.0 1bfc1dadeee1 4 months ago 330MB 2026-04-28 04:16:32.375238 | orchestrator | registry.osism.tech/osism/osism-ansible 0.20251130.0 42988b2d229c 4 months ago 613MB 2026-04-28 04:16:32.375249 | orchestrator | registry.osism.tech/osism/ceph-ansible 0.20251130.0 a212d8ca4a50 4 months ago 560MB 2026-04-28 04:16:32.375260 | orchestrator | registry.osism.tech/osism/osism-kubernetes 0.20251130.0 9beff03cb77b 4 months ago 1.23GB 2026-04-28 04:16:32.375271 | orchestrator | registry.osism.tech/osism/osism 0.20251130.1 95213af683ec 4 months ago 383MB 2026-04-28 04:16:32.375282 | orchestrator | registry.osism.tech/osism/osism-frontend 0.20251130.1 2cb6e7609620 4 months ago 238MB 2026-04-28 04:16:32.375293 | orchestrator | registry.osism.tech/dockerhub/library/mariadb 11.8.4 70745dd8f1d0 5 months ago 334MB 2026-04-28 04:16:32.375303 | orchestrator | phpmyadmin/phpmyadmin 5.2 e66b1f5a8c58 6 months ago 742MB 2026-04-28 04:16:32.375314 | orchestrator | registry.osism.tech/osism/ara-server 1.7.3 d1b687333f2f 8 months ago 275MB 2026-04-28 04:16:32.375325 | orchestrator | registry.osism.tech/dockerhub/library/traefik v3.5.0 11cc59587f6a 9 months ago 226MB 2026-04-28 04:16:32.375336 | orchestrator | registry.osism.tech/osism/cephclient 18.2.7 ae977aa79826 11 months ago 453MB 2026-04-28 04:16:32.375347 | orchestrator | registry.osism.tech/dockerhub/ubuntu/squid 6.1-23.10_beta 34b6bbbcf74b 22 months ago 146MB 2026-04-28 04:16:32.375358 | orchestrator | registry.osism.tech/osism/cgit 1.2.3 16e7285642b1 2 years ago 545MB 2026-04-28 04:16:32.745525 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-28 04:16:32.745655 | orchestrator | ++ semver 9.5.0 5.0.0 2026-04-28 04:16:32.816456 | orchestrator | 2026-04-28 04:16:32.816593 | orchestrator | ## Containers @ testbed-node-0 2026-04-28 04:16:32.816619 | orchestrator | 2026-04-28 04:16:32.816639 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-28 04:16:32.816658 | orchestrator | + echo 2026-04-28 04:16:32.816678 | orchestrator | + echo '## Containers @ testbed-node-0' 2026-04-28 04:16:32.816699 | orchestrator | + echo 2026-04-28 04:16:32.816719 | orchestrator | + osism container testbed-node-0 ps 2026-04-28 04:16:35.464778 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-28 04:16:35.464936 | orchestrator | d8296cf7421f registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130 "dumb-init --single-…" 3 minutes ago Up 3 minutes (healthy) magnum_conductor 2026-04-28 04:16:35.464953 | orchestrator | a3cbd807ba8b registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130 "dumb-init --single-…" 3 minutes ago Up 3 minutes (healthy) magnum_api 2026-04-28 04:16:35.464965 | orchestrator | 9b6eb3e458e7 registry.osism.tech/kolla/release/grafana:12.3.0.20251130 "dumb-init --single-…" 8 minutes ago Up 8 minutes grafana 2026-04-28 04:16:35.464975 | orchestrator | 196a5ba183cb registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_elasticsearch_exporter 2026-04-28 04:16:35.465006 | orchestrator | 2979c27c546c registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_cadvisor 2026-04-28 04:16:35.465015 | orchestrator | 3453ade2bd7b registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_memcached_exporter 2026-04-28 04:16:35.465032 | orchestrator | 82178d0410f1 registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_mysqld_exporter 2026-04-28 04:16:35.465042 | orchestrator | 9e0d37eb9700 registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130 "dumb-init --single-…" 11 minutes ago Up 10 minutes prometheus_node_exporter 2026-04-28 04:16:35.465052 | orchestrator | aa9fcdf26053 registry.osism.tech/kolla/release/manila-share:19.1.1.20251130 "dumb-init --single-…" 14 minutes ago Up 14 minutes (healthy) manila_share 2026-04-28 04:16:35.465061 | orchestrator | e7c03b56ed1c registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) manila_scheduler 2026-04-28 04:16:35.465071 | orchestrator | 814e8be3fdb4 registry.osism.tech/kolla/release/manila-data:19.1.1.20251130 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) manila_data 2026-04-28 04:16:35.465080 | orchestrator | 3b957ef47ffc registry.osism.tech/kolla/release/manila-api:19.1.1.20251130 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) manila_api 2026-04-28 04:16:35.465090 | orchestrator | ff69ee89c5f6 registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130 "dumb-init --single-…" 18 minutes ago Up 18 minutes (healthy) aodh_notifier 2026-04-28 04:16:35.465099 | orchestrator | 8048612f7912 registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130 "dumb-init --single-…" 18 minutes ago Up 18 minutes (healthy) aodh_listener 2026-04-28 04:16:35.465109 | orchestrator | d54b5b19a083 registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130 "dumb-init --single-…" 18 minutes ago Up 18 minutes (healthy) aodh_evaluator 2026-04-28 04:16:35.465118 | orchestrator | 3492db76e10c registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130 "dumb-init --single-…" 19 minutes ago Up 19 minutes (healthy) aodh_api 2026-04-28 04:16:35.465988 | orchestrator | 4b1ba337b951 registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130 "dumb-init --single-…" 20 minutes ago Up 20 minutes ceilometer_central 2026-04-28 04:16:35.466092 | orchestrator | cd1372ef28a7 registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) ceilometer_notification 2026-04-28 04:16:35.466112 | orchestrator | ef68fec881d0 registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130 "dumb-init --single-…" 22 minutes ago Up 22 minutes (healthy) octavia_worker 2026-04-28 04:16:35.466130 | orchestrator | 2593ad49c860 registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130 "dumb-init --single-…" 22 minutes ago Up 22 minutes (healthy) octavia_housekeeping 2026-04-28 04:16:35.466145 | orchestrator | 69ba270e0ad2 registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130 "dumb-init --single-…" 22 minutes ago Up 22 minutes (healthy) octavia_health_manager 2026-04-28 04:16:35.466159 | orchestrator | 70ac625af021 registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130 "dumb-init --single-…" 22 minutes ago Up 22 minutes octavia_driver_agent 2026-04-28 04:16:35.466191 | orchestrator | 0ff7d47d0266 registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130 "dumb-init --single-…" 23 minutes ago Up 23 minutes (healthy) octavia_api 2026-04-28 04:16:35.466205 | orchestrator | e140c6634f56 registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130 "dumb-init --single-…" 27 minutes ago Up 27 minutes (healthy) designate_worker 2026-04-28 04:16:35.466220 | orchestrator | c77064e1adf8 registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130 "dumb-init --single-…" 27 minutes ago Up 27 minutes (healthy) designate_mdns 2026-04-28 04:16:35.466239 | orchestrator | 85017cd71b86 registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130 "dumb-init --single-…" 27 minutes ago Up 27 minutes (healthy) designate_producer 2026-04-28 04:16:35.466254 | orchestrator | b267a3c0e09b registry.osism.tech/kolla/release/designate-central:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 27 minutes (healthy) designate_central 2026-04-28 04:16:35.466268 | orchestrator | 6426557ac6da registry.osism.tech/kolla/release/designate-api:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) designate_api 2026-04-28 04:16:35.466282 | orchestrator | cf793fc68faf registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) designate_backend_bind9 2026-04-28 04:16:35.466296 | orchestrator | be38e59742f0 registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) barbican_worker 2026-04-28 04:16:35.466310 | orchestrator | 75cb2e1a77cb registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) barbican_keystone_listener 2026-04-28 04:16:35.466326 | orchestrator | 1684c7c24f15 registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) barbican_api 2026-04-28 04:16:35.466340 | orchestrator | 1bb63bc6fadc registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130 "dumb-init --single-…" 32 minutes ago Up 32 minutes (healthy) cinder_backup 2026-04-28 04:16:35.466353 | orchestrator | 4d54f2d33264 registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130 "dumb-init --single-…" 32 minutes ago Up 32 minutes (healthy) cinder_volume 2026-04-28 04:16:35.466367 | orchestrator | c8967f26db3e registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130 "dumb-init --single-…" 32 minutes ago Up 32 minutes (healthy) cinder_scheduler 2026-04-28 04:16:35.466380 | orchestrator | 6799f82d7fb5 registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130 "dumb-init --single-…" 33 minutes ago Up 33 minutes (healthy) cinder_api 2026-04-28 04:16:35.466413 | orchestrator | 30e636cfc955 registry.osism.tech/kolla/release/glance-api:29.0.1.20251130 "dumb-init --single-…" 35 minutes ago Up 35 minutes (healthy) glance_api 2026-04-28 04:16:35.466428 | orchestrator | bcf50a235c0b registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130 "dumb-init --single-…" 38 minutes ago Up 38 minutes (healthy) skyline_console 2026-04-28 04:16:35.466449 | orchestrator | d031add992fc registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130 "dumb-init --single-…" 38 minutes ago Up 38 minutes (healthy) skyline_apiserver 2026-04-28 04:16:35.466473 | orchestrator | a4ed7800fb36 registry.osism.tech/kolla/release/horizon:25.1.2.20251130 "dumb-init --single-…" 39 minutes ago Up 39 minutes (healthy) horizon 2026-04-28 04:16:35.466487 | orchestrator | a4d2f5e827a5 registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130 "dumb-init --single-…" 44 minutes ago Up 44 minutes (healthy) nova_novncproxy 2026-04-28 04:16:35.466501 | orchestrator | c3ff71c3b3fb registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130 "dumb-init --single-…" 44 minutes ago Up 44 minutes (healthy) nova_conductor 2026-04-28 04:16:35.466516 | orchestrator | 5c29c0cbffd2 registry.osism.tech/kolla/release/nova-api:30.2.1.20251130 "dumb-init --single-…" 45 minutes ago Up 45 minutes (healthy) nova_api 2026-04-28 04:16:35.466530 | orchestrator | 90d1c5579a81 registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130 "dumb-init --single-…" 46 minutes ago Up 46 minutes (healthy) nova_scheduler 2026-04-28 04:16:35.466544 | orchestrator | 8a2020fb847e registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130 "dumb-init --single-…" 51 minutes ago Up 51 minutes (healthy) neutron_server 2026-04-28 04:16:35.466558 | orchestrator | b917ef615f5b registry.osism.tech/kolla/release/placement-api:12.0.1.20251130 "dumb-init --single-…" 54 minutes ago Up 54 minutes (healthy) placement_api 2026-04-28 04:16:35.466572 | orchestrator | ffdc26127bb7 registry.osism.tech/kolla/release/keystone:26.0.1.20251130 "dumb-init --single-…" 56 minutes ago Up 56 minutes (healthy) keystone 2026-04-28 04:16:35.466586 | orchestrator | 4bdf0f7272b4 registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130 "dumb-init --single-…" 57 minutes ago Up 56 minutes (healthy) keystone_fernet 2026-04-28 04:16:35.466600 | orchestrator | 46331cd32032 registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130 "dumb-init --single-…" 57 minutes ago Up 57 minutes (healthy) keystone_ssh 2026-04-28 04:16:35.466614 | orchestrator | afb72062a17e registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mgr -…" 59 minutes ago Up 59 minutes ceph-mgr-testbed-node-0 2026-04-28 04:16:35.466629 | orchestrator | a5d7349e6468 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-crash" About an hour ago Up About an hour ceph-crash-testbed-node-0 2026-04-28 04:16:35.466649 | orchestrator | 87fa47a77fbc registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mon -…" About an hour ago Up About an hour ceph-mon-testbed-node-0 2026-04-28 04:16:35.466663 | orchestrator | 82a1b80c6d77 registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_northd 2026-04-28 04:16:35.466677 | orchestrator | 08850637b3a2 registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_sb_db 2026-04-28 04:16:35.466691 | orchestrator | defe05d2b2a5 registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_nb_db 2026-04-28 04:16:35.466705 | orchestrator | 0f7a70518b5d registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_controller 2026-04-28 04:16:35.466720 | orchestrator | cea9ddfbc977 registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) openvswitch_vswitchd 2026-04-28 04:16:35.466750 | orchestrator | 1a1b2ccd0727 registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) openvswitch_db 2026-04-28 04:16:35.466765 | orchestrator | 7408912882fa registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) rabbitmq 2026-04-28 04:16:35.466778 | orchestrator | c0f8c80a452b registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130 "dumb-init -- kolla_…" About an hour ago Up About an hour (healthy) mariadb 2026-04-28 04:16:35.466792 | orchestrator | 43129c7c2fdb registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) redis_sentinel 2026-04-28 04:16:35.466807 | orchestrator | b25d27e37d89 registry.osism.tech/kolla/release/redis:7.0.15.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) redis 2026-04-28 04:16:35.466832 | orchestrator | 65ab28738a9e registry.osism.tech/kolla/release/memcached:1.6.24.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) memcached 2026-04-28 04:16:35.466845 | orchestrator | a9f561dd26b2 registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) opensearch_dashboards 2026-04-28 04:16:35.466859 | orchestrator | b99bdeda4f5c registry.osism.tech/kolla/release/opensearch:2.19.4.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) opensearch 2026-04-28 04:16:35.466872 | orchestrator | 9ea0d54b0ebe registry.osism.tech/kolla/release/keepalived:2.2.8.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours keepalived 2026-04-28 04:16:35.466908 | orchestrator | 44d9a0a1153d registry.osism.tech/kolla/release/proxysql:3.0.3.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) proxysql 2026-04-28 04:16:35.466922 | orchestrator | faedf8e10df5 registry.osism.tech/kolla/release/haproxy:2.8.15.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) haproxy 2026-04-28 04:16:35.466936 | orchestrator | 35b89e153888 registry.osism.tech/kolla/release/cron:3.0.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours cron 2026-04-28 04:16:35.466950 | orchestrator | aa94e3016754 registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours kolla_toolbox 2026-04-28 04:16:35.466963 | orchestrator | f3e9ea7919a4 registry.osism.tech/kolla/release/fluentd:5.0.8.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours fluentd 2026-04-28 04:16:36.047475 | orchestrator | 2026-04-28 04:16:36.047557 | orchestrator | ## Images @ testbed-node-0 2026-04-28 04:16:36.047567 | orchestrator | 2026-04-28 04:16:36.047574 | orchestrator | + echo 2026-04-28 04:16:36.047581 | orchestrator | + echo '## Images @ testbed-node-0' 2026-04-28 04:16:36.047588 | orchestrator | + echo 2026-04-28 04:16:36.047594 | orchestrator | + osism container testbed-node-0 images 2026-04-28 04:16:38.677373 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-28 04:16:38.677504 | orchestrator | registry.osism.tech/kolla/release/rabbitmq 3.13.7.20251130 618df24dfbf4 4 months ago 322MB 2026-04-28 04:16:38.677524 | orchestrator | registry.osism.tech/kolla/release/memcached 1.6.24.20251130 8a9865997707 4 months ago 266MB 2026-04-28 04:16:38.677540 | orchestrator | registry.osism.tech/kolla/release/opensearch 2.19.4.20251130 dc62f23331d2 4 months ago 1.56GB 2026-04-28 04:16:38.677584 | orchestrator | registry.osism.tech/kolla/release/keepalived 2.2.8.20251130 94862d07fc5a 4 months ago 276MB 2026-04-28 04:16:38.677600 | orchestrator | registry.osism.tech/kolla/release/opensearch-dashboards 2.19.4.20251130 3b3613dd9b1a 4 months ago 1.53GB 2026-04-28 04:16:38.677613 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-28 04:16:38.677626 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-28 04:16:38.677640 | orchestrator | registry.osism.tech/kolla/release/grafana 12.3.0.20251130 6eb3b7b1dbf2 4 months ago 1.02GB 2026-04-28 04:16:38.677655 | orchestrator | registry.osism.tech/kolla/release/proxysql 3.0.3.20251130 2c7177938c0e 4 months ago 412MB 2026-04-28 04:16:38.677669 | orchestrator | registry.osism.tech/kolla/release/haproxy 2.8.15.20251130 6d4c583df983 4 months ago 274MB 2026-04-28 04:16:38.677683 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-28 04:16:38.677699 | orchestrator | registry.osism.tech/kolla/release/redis 7.0.15.20251130 5548a8ce5b5c 4 months ago 273MB 2026-04-28 04:16:38.677715 | orchestrator | registry.osism.tech/kolla/release/redis-sentinel 7.0.15.20251130 62d0b016058f 4 months ago 273MB 2026-04-28 04:16:38.677729 | orchestrator | registry.osism.tech/kolla/release/mariadb-server 10.11.15.20251130 77db67eebcc3 4 months ago 452MB 2026-04-28 04:16:38.677744 | orchestrator | registry.osism.tech/kolla/release/horizon 25.1.2.20251130 d7257ed845e9 4 months ago 1.15GB 2026-04-28 04:16:38.677759 | orchestrator | registry.osism.tech/kolla/release/prometheus-mysqld-exporter 0.16.0.20251130 aedc672fb472 4 months ago 301MB 2026-04-28 04:16:38.677774 | orchestrator | registry.osism.tech/kolla/release/prometheus-memcached-exporter 0.15.0.20251130 7b077076926d 4 months ago 298MB 2026-04-28 04:16:38.677811 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-28 04:16:38.677827 | orchestrator | registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter 1.8.0.20251130 bcaaf5d64345 4 months ago 292MB 2026-04-28 04:16:38.677843 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-28 04:16:38.677853 | orchestrator | registry.osism.tech/kolla/release/openvswitch-db-server 3.4.3.20251130 3e6f3fe8823c 4 months ago 279MB 2026-04-28 04:16:38.677862 | orchestrator | registry.osism.tech/kolla/release/placement-api 12.0.1.20251130 20317ff6dfb9 4 months ago 975MB 2026-04-28 04:16:38.677870 | orchestrator | registry.osism.tech/kolla/release/openvswitch-vswitchd 3.4.3.20251130 ad8bb4636454 4 months ago 279MB 2026-04-28 04:16:38.677899 | orchestrator | registry.osism.tech/kolla/release/nova-novncproxy 30.2.1.20251130 99323056afa4 4 months ago 1.37GB 2026-04-28 04:16:38.677915 | orchestrator | registry.osism.tech/kolla/release/nova-conductor 30.2.1.20251130 92609e648215 4 months ago 1.21GB 2026-04-28 04:16:38.677924 | orchestrator | registry.osism.tech/kolla/release/nova-api 30.2.1.20251130 2d78e7fdfb9a 4 months ago 1.21GB 2026-04-28 04:16:38.677933 | orchestrator | registry.osism.tech/kolla/release/nova-scheduler 30.2.1.20251130 4c3c59730530 4 months ago 1.21GB 2026-04-28 04:16:38.677941 | orchestrator | registry.osism.tech/kolla/release/ceilometer-central 23.0.2.20251130 37cb6975d4a5 4 months ago 976MB 2026-04-28 04:16:38.677950 | orchestrator | registry.osism.tech/kolla/release/ceilometer-notification 23.0.2.20251130 bb2927b293dc 4 months ago 976MB 2026-04-28 04:16:38.677968 | orchestrator | registry.osism.tech/kolla/release/magnum-api 19.0.1.20251130 a85fdbb4bbba 4 months ago 1.13GB 2026-04-28 04:16:38.677977 | orchestrator | registry.osism.tech/kolla/release/magnum-conductor 19.0.1.20251130 a98ee1099aad 4 months ago 1.24GB 2026-04-28 04:16:38.678005 | orchestrator | registry.osism.tech/kolla/release/manila-share 19.1.1.20251130 df44f491f2c1 4 months ago 1.22GB 2026-04-28 04:16:38.678065 | orchestrator | registry.osism.tech/kolla/release/manila-data 19.1.1.20251130 cd8b74c8a47a 4 months ago 1.06GB 2026-04-28 04:16:38.678075 | orchestrator | registry.osism.tech/kolla/release/manila-api 19.1.1.20251130 654f9bd3c940 4 months ago 1.05GB 2026-04-28 04:16:38.678083 | orchestrator | registry.osism.tech/kolla/release/manila-scheduler 19.1.1.20251130 e0864fa03a78 4 months ago 1.05GB 2026-04-28 04:16:38.678092 | orchestrator | registry.osism.tech/kolla/release/aodh-listener 19.0.0.20251130 1e68c23a9d38 4 months ago 974MB 2026-04-28 04:16:38.678100 | orchestrator | registry.osism.tech/kolla/release/aodh-evaluator 19.0.0.20251130 1726a7592f93 4 months ago 974MB 2026-04-28 04:16:38.678111 | orchestrator | registry.osism.tech/kolla/release/aodh-notifier 19.0.0.20251130 abbd6e9f87e2 4 months ago 974MB 2026-04-28 04:16:38.678126 | orchestrator | registry.osism.tech/kolla/release/aodh-api 19.0.0.20251130 82a64f1d056d 4 months ago 973MB 2026-04-28 04:16:38.678140 | orchestrator | registry.osism.tech/kolla/release/barbican-worker 19.0.1.20251130 2cef5d51872b 4 months ago 991MB 2026-04-28 04:16:38.678154 | orchestrator | registry.osism.tech/kolla/release/barbican-keystone-listener 19.0.1.20251130 bfcd8631a126 4 months ago 991MB 2026-04-28 04:16:38.678168 | orchestrator | registry.osism.tech/kolla/release/barbican-api 19.0.1.20251130 9195ddc3e4c5 4 months ago 990MB 2026-04-28 04:16:38.678182 | orchestrator | registry.osism.tech/kolla/release/keystone 26.0.1.20251130 6c1543e94c06 4 months ago 1.09GB 2026-04-28 04:16:38.678196 | orchestrator | registry.osism.tech/kolla/release/keystone-fernet 26.0.1.20251130 36669c355898 4 months ago 1.04GB 2026-04-28 04:16:38.678209 | orchestrator | registry.osism.tech/kolla/release/keystone-ssh 26.0.1.20251130 e002cffc8eb8 4 months ago 1.04GB 2026-04-28 04:16:38.678222 | orchestrator | registry.osism.tech/kolla/release/octavia-health-manager 15.0.2.20251130 059dc6d4a159 4 months ago 1.03GB 2026-04-28 04:16:38.678245 | orchestrator | registry.osism.tech/kolla/release/octavia-housekeeping 15.0.2.20251130 c9059accdc4a 4 months ago 1.03GB 2026-04-28 04:16:38.678259 | orchestrator | registry.osism.tech/kolla/release/octavia-api 15.0.2.20251130 9375641bed7a 4 months ago 1.05GB 2026-04-28 04:16:38.678273 | orchestrator | registry.osism.tech/kolla/release/octavia-worker 15.0.2.20251130 708f50e37fa7 4 months ago 1.03GB 2026-04-28 04:16:38.678288 | orchestrator | registry.osism.tech/kolla/release/octavia-driver-agent 15.0.2.20251130 045f928baedc 4 months ago 1.05GB 2026-04-28 04:16:38.678304 | orchestrator | registry.osism.tech/kolla/release/neutron-server 25.2.2.20251130 fa71fe0a109e 4 months ago 1.16GB 2026-04-28 04:16:38.678318 | orchestrator | registry.osism.tech/kolla/release/glance-api 29.0.1.20251130 b1fcfbc49057 4 months ago 1.1GB 2026-04-28 04:16:38.678333 | orchestrator | registry.osism.tech/kolla/release/designate-central 19.0.1.20251130 00b6af03994a 4 months ago 983MB 2026-04-28 04:16:38.678348 | orchestrator | registry.osism.tech/kolla/release/designate-worker 19.0.1.20251130 18bc80370e46 4 months ago 989MB 2026-04-28 04:16:38.678362 | orchestrator | registry.osism.tech/kolla/release/designate-producer 19.0.1.20251130 eac4506bf51f 4 months ago 984MB 2026-04-28 04:16:38.678388 | orchestrator | registry.osism.tech/kolla/release/designate-api 19.0.1.20251130 ad5d5cd1392a 4 months ago 984MB 2026-04-28 04:16:38.678404 | orchestrator | registry.osism.tech/kolla/release/designate-backend-bind9 19.0.1.20251130 4e19a1dc9c8a 4 months ago 989MB 2026-04-28 04:16:38.678413 | orchestrator | registry.osism.tech/kolla/release/designate-mdns 19.0.1.20251130 4ad9e0017d6e 4 months ago 984MB 2026-04-28 04:16:38.678422 | orchestrator | registry.osism.tech/kolla/release/skyline-console 5.0.1.20251130 20430a0acd38 4 months ago 1.05GB 2026-04-28 04:16:38.678430 | orchestrator | registry.osism.tech/kolla/release/skyline-apiserver 5.0.1.20251130 20bbe1600b66 4 months ago 990MB 2026-04-28 04:16:38.678439 | orchestrator | registry.osism.tech/kolla/release/cinder-volume 25.3.1.20251130 ab7ee3c06214 4 months ago 1.72GB 2026-04-28 04:16:38.678447 | orchestrator | registry.osism.tech/kolla/release/cinder-scheduler 25.3.1.20251130 47d31cd2c25d 4 months ago 1.4GB 2026-04-28 04:16:38.678456 | orchestrator | registry.osism.tech/kolla/release/cinder-backup 25.3.1.20251130 c09074b62f18 4 months ago 1.41GB 2026-04-28 04:16:38.678475 | orchestrator | registry.osism.tech/kolla/release/cinder-api 25.3.1.20251130 ceaaac81e8af 4 months ago 1.4GB 2026-04-28 04:16:38.678484 | orchestrator | registry.osism.tech/kolla/release/ovn-controller 24.9.3.20251130 fcd09e53d925 4 months ago 840MB 2026-04-28 04:16:38.678493 | orchestrator | registry.osism.tech/kolla/release/ovn-nb-db-server 24.9.3.20251130 e52b6499881a 4 months ago 840MB 2026-04-28 04:16:38.678501 | orchestrator | registry.osism.tech/kolla/release/ovn-sb-db-server 24.9.3.20251130 2fcefdb5b030 4 months ago 840MB 2026-04-28 04:16:38.678510 | orchestrator | registry.osism.tech/kolla/release/ovn-northd 24.9.3.20251130 948e5d22de86 4 months ago 840MB 2026-04-28 04:16:38.678518 | orchestrator | registry.osism.tech/osism/ceph-daemon 18.2.7 5f92363b1f93 11 months ago 1.27GB 2026-04-28 04:16:39.068711 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-28 04:16:39.070303 | orchestrator | ++ semver 9.5.0 5.0.0 2026-04-28 04:16:39.126754 | orchestrator | 2026-04-28 04:16:39.126870 | orchestrator | ## Containers @ testbed-node-1 2026-04-28 04:16:39.126962 | orchestrator | 2026-04-28 04:16:39.126983 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-28 04:16:39.127001 | orchestrator | + echo 2026-04-28 04:16:39.127017 | orchestrator | + echo '## Containers @ testbed-node-1' 2026-04-28 04:16:39.127035 | orchestrator | + echo 2026-04-28 04:16:39.127053 | orchestrator | + osism container testbed-node-1 ps 2026-04-28 04:16:41.748546 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-28 04:16:41.748638 | orchestrator | a44ceb385762 registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130 "dumb-init --single-…" 3 minutes ago Up 3 minutes (healthy) magnum_conductor 2026-04-28 04:16:41.748650 | orchestrator | ad17e4a91b62 registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130 "dumb-init --single-…" 3 minutes ago Up 3 minutes (healthy) magnum_api 2026-04-28 04:16:41.748659 | orchestrator | e773351ca677 registry.osism.tech/kolla/release/grafana:12.3.0.20251130 "dumb-init --single-…" 7 minutes ago Up 7 minutes grafana 2026-04-28 04:16:41.748666 | orchestrator | a029868ced24 registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_elasticsearch_exporter 2026-04-28 04:16:41.748685 | orchestrator | e6f47ecfcc9f registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_cadvisor 2026-04-28 04:16:41.748708 | orchestrator | 516b70245d74 registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_memcached_exporter 2026-04-28 04:16:41.748716 | orchestrator | 176d2c534a8f registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_mysqld_exporter 2026-04-28 04:16:41.748727 | orchestrator | 938a2dcfa3f8 registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130 "dumb-init --single-…" 11 minutes ago Up 11 minutes prometheus_node_exporter 2026-04-28 04:16:41.748735 | orchestrator | 270fc3c791a1 registry.osism.tech/kolla/release/manila-share:19.1.1.20251130 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) manila_share 2026-04-28 04:16:41.748742 | orchestrator | cf4d96152064 registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) manila_scheduler 2026-04-28 04:16:41.748749 | orchestrator | 10183b33e4c9 registry.osism.tech/kolla/release/manila-data:19.1.1.20251130 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) manila_data 2026-04-28 04:16:41.748757 | orchestrator | c4a7c23a2678 registry.osism.tech/kolla/release/manila-api:19.1.1.20251130 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) manila_api 2026-04-28 04:16:41.748764 | orchestrator | 23a2da27bbd0 registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130 "dumb-init --single-…" 18 minutes ago Up 18 minutes (healthy) aodh_notifier 2026-04-28 04:16:41.748771 | orchestrator | 6d3db84a1e57 registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130 "dumb-init --single-…" 18 minutes ago Up 18 minutes (healthy) aodh_listener 2026-04-28 04:16:41.748778 | orchestrator | 8d8d344bea51 registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130 "dumb-init --single-…" 18 minutes ago Up 18 minutes (healthy) aodh_evaluator 2026-04-28 04:16:41.748785 | orchestrator | 3d68bfcb9d5c registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130 "dumb-init --single-…" 19 minutes ago Up 19 minutes (healthy) aodh_api 2026-04-28 04:16:41.748793 | orchestrator | 2eda2ce806d5 registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130 "dumb-init --single-…" 20 minutes ago Up 20 minutes ceilometer_central 2026-04-28 04:16:41.748800 | orchestrator | 87880b1fe81d registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) ceilometer_notification 2026-04-28 04:16:41.748807 | orchestrator | 91119be301fd registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130 "dumb-init --single-…" 22 minutes ago Up 22 minutes (healthy) octavia_worker 2026-04-28 04:16:41.748828 | orchestrator | 825c54d0cb0e registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130 "dumb-init --single-…" 22 minutes ago Up 22 minutes (healthy) octavia_housekeeping 2026-04-28 04:16:41.748836 | orchestrator | 8ae0995651bd registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130 "dumb-init --single-…" 22 minutes ago Up 22 minutes (healthy) octavia_health_manager 2026-04-28 04:16:41.748844 | orchestrator | 1d4b7c9dac9d registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130 "dumb-init --single-…" 22 minutes ago Up 22 minutes octavia_driver_agent 2026-04-28 04:16:41.748851 | orchestrator | 003101ad0df3 registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130 "dumb-init --single-…" 23 minutes ago Up 23 minutes (healthy) octavia_api 2026-04-28 04:16:41.748864 | orchestrator | feb15b74d38e registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130 "dumb-init --single-…" 27 minutes ago Up 27 minutes (healthy) designate_worker 2026-04-28 04:16:41.748871 | orchestrator | 1e67d99d94d0 registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130 "dumb-init --single-…" 27 minutes ago Up 27 minutes (healthy) designate_mdns 2026-04-28 04:16:41.748916 | orchestrator | 4f2055c3ce73 registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130 "dumb-init --single-…" 27 minutes ago Up 27 minutes (healthy) designate_producer 2026-04-28 04:16:41.748928 | orchestrator | 31227f203883 registry.osism.tech/kolla/release/designate-central:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) designate_central 2026-04-28 04:16:41.748942 | orchestrator | 1db4fe60fd46 registry.osism.tech/kolla/release/designate-api:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) designate_api 2026-04-28 04:16:41.748960 | orchestrator | 297dfd27a50c registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) designate_backend_bind9 2026-04-28 04:16:41.748975 | orchestrator | 9aa61b1b741e registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) barbican_worker 2026-04-28 04:16:41.748986 | orchestrator | a76ef68a120c registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) barbican_keystone_listener 2026-04-28 04:16:41.748998 | orchestrator | 2c8f76bea9b7 registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) barbican_api 2026-04-28 04:16:41.749009 | orchestrator | 02a8d79ff7b5 registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130 "dumb-init --single-…" 32 minutes ago Up 32 minutes (healthy) cinder_backup 2026-04-28 04:16:41.749020 | orchestrator | fb9bbc73d336 registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130 "dumb-init --single-…" 32 minutes ago Up 32 minutes (healthy) cinder_volume 2026-04-28 04:16:41.749031 | orchestrator | 103a4515318a registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130 "dumb-init --single-…" 33 minutes ago Up 33 minutes (healthy) cinder_scheduler 2026-04-28 04:16:41.749044 | orchestrator | 415e2e6131d6 registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130 "dumb-init --single-…" 33 minutes ago Up 33 minutes (healthy) cinder_api 2026-04-28 04:16:41.749056 | orchestrator | 853fd10369a6 registry.osism.tech/kolla/release/glance-api:29.0.1.20251130 "dumb-init --single-…" 35 minutes ago Up 35 minutes (healthy) glance_api 2026-04-28 04:16:41.749069 | orchestrator | b0d493f9c7f7 registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130 "dumb-init --single-…" 38 minutes ago Up 38 minutes (healthy) skyline_console 2026-04-28 04:16:41.749080 | orchestrator | 31dbbe5fae66 registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130 "dumb-init --single-…" 38 minutes ago Up 38 minutes (healthy) skyline_apiserver 2026-04-28 04:16:41.749102 | orchestrator | 3bbd28853939 registry.osism.tech/kolla/release/horizon:25.1.2.20251130 "dumb-init --single-…" 39 minutes ago Up 39 minutes (healthy) horizon 2026-04-28 04:16:41.749113 | orchestrator | 5e27236ca3e5 registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130 "dumb-init --single-…" 43 minutes ago Up 43 minutes (healthy) nova_novncproxy 2026-04-28 04:16:41.749136 | orchestrator | eb463dcc8975 registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130 "dumb-init --single-…" 44 minutes ago Up 44 minutes (healthy) nova_conductor 2026-04-28 04:16:41.749149 | orchestrator | 8f5aad1ad5de registry.osism.tech/kolla/release/nova-api:30.2.1.20251130 "dumb-init --single-…" 45 minutes ago Up 45 minutes (healthy) nova_api 2026-04-28 04:16:41.749162 | orchestrator | 6ad5a850ab41 registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130 "dumb-init --single-…" 45 minutes ago Up 45 minutes (healthy) nova_scheduler 2026-04-28 04:16:41.749174 | orchestrator | 8b6d56782640 registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130 "dumb-init --single-…" 51 minutes ago Up 51 minutes (healthy) neutron_server 2026-04-28 04:16:41.749186 | orchestrator | b63bc3071b1b registry.osism.tech/kolla/release/placement-api:12.0.1.20251130 "dumb-init --single-…" 54 minutes ago Up 54 minutes (healthy) placement_api 2026-04-28 04:16:41.749199 | orchestrator | 7e0f6e8c0e82 registry.osism.tech/kolla/release/keystone:26.0.1.20251130 "dumb-init --single-…" 56 minutes ago Up 56 minutes (healthy) keystone 2026-04-28 04:16:41.749212 | orchestrator | 3269a11e2c20 registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130 "dumb-init --single-…" 57 minutes ago Up 57 minutes (healthy) keystone_fernet 2026-04-28 04:16:41.749224 | orchestrator | 26c5443ad557 registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130 "dumb-init --single-…" 57 minutes ago Up 57 minutes (healthy) keystone_ssh 2026-04-28 04:16:41.749237 | orchestrator | e510b299ebe5 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mgr -…" 59 minutes ago Up 59 minutes ceph-mgr-testbed-node-1 2026-04-28 04:16:41.749247 | orchestrator | df405501d6a3 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-crash" About an hour ago Up About an hour ceph-crash-testbed-node-1 2026-04-28 04:16:41.749255 | orchestrator | 90eb2d51595d registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mon -…" About an hour ago Up About an hour ceph-mon-testbed-node-1 2026-04-28 04:16:41.749264 | orchestrator | 1b9ed6e46861 registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_northd 2026-04-28 04:16:41.749272 | orchestrator | 67b51274c743 registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_sb_db 2026-04-28 04:16:41.749286 | orchestrator | 92107d9b53b1 registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_nb_db 2026-04-28 04:16:41.749294 | orchestrator | c63a1a8a9c1c registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_controller 2026-04-28 04:16:41.749302 | orchestrator | 703dd31f05e5 registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) openvswitch_vswitchd 2026-04-28 04:16:41.749310 | orchestrator | ebc9715d752f registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) openvswitch_db 2026-04-28 04:16:41.749325 | orchestrator | e260c9168b18 registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) rabbitmq 2026-04-28 04:16:41.749344 | orchestrator | e29b751a8675 registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130 "dumb-init -- kolla_…" About an hour ago Up About an hour (healthy) mariadb 2026-04-28 04:16:41.749355 | orchestrator | 289c0cc754c0 registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) redis_sentinel 2026-04-28 04:16:41.749366 | orchestrator | acc99ce13915 registry.osism.tech/kolla/release/redis:7.0.15.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) redis 2026-04-28 04:16:41.749378 | orchestrator | e67f4c189b8e registry.osism.tech/kolla/release/memcached:1.6.24.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) memcached 2026-04-28 04:16:41.749389 | orchestrator | 4cb5db37e9ba registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) opensearch_dashboards 2026-04-28 04:16:41.749400 | orchestrator | 4582d842c117 registry.osism.tech/kolla/release/opensearch:2.19.4.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) opensearch 2026-04-28 04:16:41.749413 | orchestrator | 4dbc83079704 registry.osism.tech/kolla/release/keepalived:2.2.8.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours keepalived 2026-04-28 04:16:41.749425 | orchestrator | 319cad671556 registry.osism.tech/kolla/release/proxysql:3.0.3.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) proxysql 2026-04-28 04:16:41.749437 | orchestrator | 98b2a542ed71 registry.osism.tech/kolla/release/haproxy:2.8.15.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) haproxy 2026-04-28 04:16:41.749449 | orchestrator | 3fd9fd045092 registry.osism.tech/kolla/release/cron:3.0.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours cron 2026-04-28 04:16:41.749460 | orchestrator | 3b4f7d5193b1 registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours kolla_toolbox 2026-04-28 04:16:41.749467 | orchestrator | b50982d75868 registry.osism.tech/kolla/release/fluentd:5.0.8.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours fluentd 2026-04-28 04:16:42.276905 | orchestrator | 2026-04-28 04:16:42.277014 | orchestrator | ## Images @ testbed-node-1 2026-04-28 04:16:42.277036 | orchestrator | 2026-04-28 04:16:42.277060 | orchestrator | + echo 2026-04-28 04:16:42.277078 | orchestrator | + echo '## Images @ testbed-node-1' 2026-04-28 04:16:42.277095 | orchestrator | + echo 2026-04-28 04:16:42.277111 | orchestrator | + osism container testbed-node-1 images 2026-04-28 04:16:44.891819 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-28 04:16:44.891960 | orchestrator | registry.osism.tech/kolla/release/rabbitmq 3.13.7.20251130 618df24dfbf4 4 months ago 322MB 2026-04-28 04:16:44.891971 | orchestrator | registry.osism.tech/kolla/release/memcached 1.6.24.20251130 8a9865997707 4 months ago 266MB 2026-04-28 04:16:44.891980 | orchestrator | registry.osism.tech/kolla/release/opensearch 2.19.4.20251130 dc62f23331d2 4 months ago 1.56GB 2026-04-28 04:16:44.891989 | orchestrator | registry.osism.tech/kolla/release/opensearch-dashboards 2.19.4.20251130 3b3613dd9b1a 4 months ago 1.53GB 2026-04-28 04:16:44.891996 | orchestrator | registry.osism.tech/kolla/release/keepalived 2.2.8.20251130 94862d07fc5a 4 months ago 276MB 2026-04-28 04:16:44.892024 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-28 04:16:44.892032 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-28 04:16:44.892039 | orchestrator | registry.osism.tech/kolla/release/grafana 12.3.0.20251130 6eb3b7b1dbf2 4 months ago 1.02GB 2026-04-28 04:16:44.892046 | orchestrator | registry.osism.tech/kolla/release/proxysql 3.0.3.20251130 2c7177938c0e 4 months ago 412MB 2026-04-28 04:16:44.892053 | orchestrator | registry.osism.tech/kolla/release/haproxy 2.8.15.20251130 6d4c583df983 4 months ago 274MB 2026-04-28 04:16:44.892061 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-28 04:16:44.892069 | orchestrator | registry.osism.tech/kolla/release/redis 7.0.15.20251130 5548a8ce5b5c 4 months ago 273MB 2026-04-28 04:16:44.892076 | orchestrator | registry.osism.tech/kolla/release/redis-sentinel 7.0.15.20251130 62d0b016058f 4 months ago 273MB 2026-04-28 04:16:44.892083 | orchestrator | registry.osism.tech/kolla/release/mariadb-server 10.11.15.20251130 77db67eebcc3 4 months ago 452MB 2026-04-28 04:16:44.892090 | orchestrator | registry.osism.tech/kolla/release/horizon 25.1.2.20251130 d7257ed845e9 4 months ago 1.15GB 2026-04-28 04:16:44.892098 | orchestrator | registry.osism.tech/kolla/release/prometheus-mysqld-exporter 0.16.0.20251130 aedc672fb472 4 months ago 301MB 2026-04-28 04:16:44.892105 | orchestrator | registry.osism.tech/kolla/release/prometheus-memcached-exporter 0.15.0.20251130 7b077076926d 4 months ago 298MB 2026-04-28 04:16:44.892112 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-28 04:16:44.892119 | orchestrator | registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter 1.8.0.20251130 bcaaf5d64345 4 months ago 292MB 2026-04-28 04:16:44.892141 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-28 04:16:44.892148 | orchestrator | registry.osism.tech/kolla/release/openvswitch-db-server 3.4.3.20251130 3e6f3fe8823c 4 months ago 279MB 2026-04-28 04:16:44.892155 | orchestrator | registry.osism.tech/kolla/release/placement-api 12.0.1.20251130 20317ff6dfb9 4 months ago 975MB 2026-04-28 04:16:44.892163 | orchestrator | registry.osism.tech/kolla/release/openvswitch-vswitchd 3.4.3.20251130 ad8bb4636454 4 months ago 279MB 2026-04-28 04:16:44.892170 | orchestrator | registry.osism.tech/kolla/release/nova-novncproxy 30.2.1.20251130 99323056afa4 4 months ago 1.37GB 2026-04-28 04:16:44.892177 | orchestrator | registry.osism.tech/kolla/release/nova-conductor 30.2.1.20251130 92609e648215 4 months ago 1.21GB 2026-04-28 04:16:44.892184 | orchestrator | registry.osism.tech/kolla/release/nova-api 30.2.1.20251130 2d78e7fdfb9a 4 months ago 1.21GB 2026-04-28 04:16:44.892196 | orchestrator | registry.osism.tech/kolla/release/nova-scheduler 30.2.1.20251130 4c3c59730530 4 months ago 1.21GB 2026-04-28 04:16:44.892203 | orchestrator | registry.osism.tech/kolla/release/ceilometer-central 23.0.2.20251130 37cb6975d4a5 4 months ago 976MB 2026-04-28 04:16:44.892210 | orchestrator | registry.osism.tech/kolla/release/ceilometer-notification 23.0.2.20251130 bb2927b293dc 4 months ago 976MB 2026-04-28 04:16:44.892218 | orchestrator | registry.osism.tech/kolla/release/magnum-api 19.0.1.20251130 a85fdbb4bbba 4 months ago 1.13GB 2026-04-28 04:16:44.892225 | orchestrator | registry.osism.tech/kolla/release/magnum-conductor 19.0.1.20251130 a98ee1099aad 4 months ago 1.24GB 2026-04-28 04:16:44.892254 | orchestrator | registry.osism.tech/kolla/release/manila-share 19.1.1.20251130 df44f491f2c1 4 months ago 1.22GB 2026-04-28 04:16:44.892262 | orchestrator | registry.osism.tech/kolla/release/manila-data 19.1.1.20251130 cd8b74c8a47a 4 months ago 1.06GB 2026-04-28 04:16:44.892270 | orchestrator | registry.osism.tech/kolla/release/manila-api 19.1.1.20251130 654f9bd3c940 4 months ago 1.05GB 2026-04-28 04:16:44.892277 | orchestrator | registry.osism.tech/kolla/release/manila-scheduler 19.1.1.20251130 e0864fa03a78 4 months ago 1.05GB 2026-04-28 04:16:44.892284 | orchestrator | registry.osism.tech/kolla/release/aodh-listener 19.0.0.20251130 1e68c23a9d38 4 months ago 974MB 2026-04-28 04:16:44.892291 | orchestrator | registry.osism.tech/kolla/release/aodh-evaluator 19.0.0.20251130 1726a7592f93 4 months ago 974MB 2026-04-28 04:16:44.892298 | orchestrator | registry.osism.tech/kolla/release/aodh-notifier 19.0.0.20251130 abbd6e9f87e2 4 months ago 974MB 2026-04-28 04:16:44.892305 | orchestrator | registry.osism.tech/kolla/release/aodh-api 19.0.0.20251130 82a64f1d056d 4 months ago 973MB 2026-04-28 04:16:44.892312 | orchestrator | registry.osism.tech/kolla/release/barbican-worker 19.0.1.20251130 2cef5d51872b 4 months ago 991MB 2026-04-28 04:16:44.892319 | orchestrator | registry.osism.tech/kolla/release/barbican-keystone-listener 19.0.1.20251130 bfcd8631a126 4 months ago 991MB 2026-04-28 04:16:44.892327 | orchestrator | registry.osism.tech/kolla/release/barbican-api 19.0.1.20251130 9195ddc3e4c5 4 months ago 990MB 2026-04-28 04:16:44.892334 | orchestrator | registry.osism.tech/kolla/release/keystone 26.0.1.20251130 6c1543e94c06 4 months ago 1.09GB 2026-04-28 04:16:44.892341 | orchestrator | registry.osism.tech/kolla/release/keystone-fernet 26.0.1.20251130 36669c355898 4 months ago 1.04GB 2026-04-28 04:16:44.892348 | orchestrator | registry.osism.tech/kolla/release/keystone-ssh 26.0.1.20251130 e002cffc8eb8 4 months ago 1.04GB 2026-04-28 04:16:44.892355 | orchestrator | registry.osism.tech/kolla/release/octavia-health-manager 15.0.2.20251130 059dc6d4a159 4 months ago 1.03GB 2026-04-28 04:16:44.892363 | orchestrator | registry.osism.tech/kolla/release/octavia-housekeeping 15.0.2.20251130 c9059accdc4a 4 months ago 1.03GB 2026-04-28 04:16:44.892370 | orchestrator | registry.osism.tech/kolla/release/octavia-api 15.0.2.20251130 9375641bed7a 4 months ago 1.05GB 2026-04-28 04:16:44.892377 | orchestrator | registry.osism.tech/kolla/release/octavia-worker 15.0.2.20251130 708f50e37fa7 4 months ago 1.03GB 2026-04-28 04:16:44.892384 | orchestrator | registry.osism.tech/kolla/release/octavia-driver-agent 15.0.2.20251130 045f928baedc 4 months ago 1.05GB 2026-04-28 04:16:44.892391 | orchestrator | registry.osism.tech/kolla/release/neutron-server 25.2.2.20251130 fa71fe0a109e 4 months ago 1.16GB 2026-04-28 04:16:44.892398 | orchestrator | registry.osism.tech/kolla/release/glance-api 29.0.1.20251130 b1fcfbc49057 4 months ago 1.1GB 2026-04-28 04:16:44.892406 | orchestrator | registry.osism.tech/kolla/release/designate-central 19.0.1.20251130 00b6af03994a 4 months ago 983MB 2026-04-28 04:16:44.892413 | orchestrator | registry.osism.tech/kolla/release/designate-worker 19.0.1.20251130 18bc80370e46 4 months ago 989MB 2026-04-28 04:16:44.892420 | orchestrator | registry.osism.tech/kolla/release/designate-producer 19.0.1.20251130 eac4506bf51f 4 months ago 984MB 2026-04-28 04:16:44.892428 | orchestrator | registry.osism.tech/kolla/release/designate-api 19.0.1.20251130 ad5d5cd1392a 4 months ago 984MB 2026-04-28 04:16:44.892435 | orchestrator | registry.osism.tech/kolla/release/designate-backend-bind9 19.0.1.20251130 4e19a1dc9c8a 4 months ago 989MB 2026-04-28 04:16:44.892447 | orchestrator | registry.osism.tech/kolla/release/designate-mdns 19.0.1.20251130 4ad9e0017d6e 4 months ago 984MB 2026-04-28 04:16:44.892454 | orchestrator | registry.osism.tech/kolla/release/skyline-console 5.0.1.20251130 20430a0acd38 4 months ago 1.05GB 2026-04-28 04:16:44.892461 | orchestrator | registry.osism.tech/kolla/release/skyline-apiserver 5.0.1.20251130 20bbe1600b66 4 months ago 990MB 2026-04-28 04:16:44.892468 | orchestrator | registry.osism.tech/kolla/release/cinder-volume 25.3.1.20251130 ab7ee3c06214 4 months ago 1.72GB 2026-04-28 04:16:44.892475 | orchestrator | registry.osism.tech/kolla/release/cinder-scheduler 25.3.1.20251130 47d31cd2c25d 4 months ago 1.4GB 2026-04-28 04:16:44.892482 | orchestrator | registry.osism.tech/kolla/release/cinder-backup 25.3.1.20251130 c09074b62f18 4 months ago 1.41GB 2026-04-28 04:16:44.892494 | orchestrator | registry.osism.tech/kolla/release/cinder-api 25.3.1.20251130 ceaaac81e8af 4 months ago 1.4GB 2026-04-28 04:16:44.892501 | orchestrator | registry.osism.tech/kolla/release/ovn-nb-db-server 24.9.3.20251130 e52b6499881a 4 months ago 840MB 2026-04-28 04:16:44.892508 | orchestrator | registry.osism.tech/kolla/release/ovn-controller 24.9.3.20251130 fcd09e53d925 4 months ago 840MB 2026-04-28 04:16:44.892515 | orchestrator | registry.osism.tech/kolla/release/ovn-sb-db-server 24.9.3.20251130 2fcefdb5b030 4 months ago 840MB 2026-04-28 04:16:44.892523 | orchestrator | registry.osism.tech/kolla/release/ovn-northd 24.9.3.20251130 948e5d22de86 4 months ago 840MB 2026-04-28 04:16:44.892530 | orchestrator | registry.osism.tech/osism/ceph-daemon 18.2.7 5f92363b1f93 11 months ago 1.27GB 2026-04-28 04:16:45.345468 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-28 04:16:45.346167 | orchestrator | ++ semver 9.5.0 5.0.0 2026-04-28 04:16:45.407741 | orchestrator | 2026-04-28 04:16:45.407864 | orchestrator | ## Containers @ testbed-node-2 2026-04-28 04:16:45.408002 | orchestrator | 2026-04-28 04:16:45.408024 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-28 04:16:45.408045 | orchestrator | + echo 2026-04-28 04:16:45.408066 | orchestrator | + echo '## Containers @ testbed-node-2' 2026-04-28 04:16:45.408087 | orchestrator | + echo 2026-04-28 04:16:45.408108 | orchestrator | + osism container testbed-node-2 ps 2026-04-28 04:16:48.143474 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-28 04:16:48.144633 | orchestrator | 4438cd280fef registry.osism.tech/kolla/release/magnum-conductor:19.0.1.20251130 "dumb-init --single-…" 3 minutes ago Up 3 minutes (healthy) magnum_conductor 2026-04-28 04:16:48.144699 | orchestrator | 8e7b82913846 registry.osism.tech/kolla/release/magnum-api:19.0.1.20251130 "dumb-init --single-…" 3 minutes ago Up 3 minutes (healthy) magnum_api 2026-04-28 04:16:48.144718 | orchestrator | eeb50a3c677b registry.osism.tech/kolla/release/grafana:12.3.0.20251130 "dumb-init --single-…" 7 minutes ago Up 7 minutes grafana 2026-04-28 04:16:48.144733 | orchestrator | 98c5504f0bf8 registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter:1.8.0.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_elasticsearch_exporter 2026-04-28 04:16:48.144778 | orchestrator | d129db4b2508 registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_cadvisor 2026-04-28 04:16:48.144794 | orchestrator | 343415d06489 registry.osism.tech/kolla/release/prometheus-memcached-exporter:0.15.0.20251130 "dumb-init --single-…" 10 minutes ago Up 10 minutes prometheus_memcached_exporter 2026-04-28 04:16:48.144810 | orchestrator | 0ca11996297e registry.osism.tech/kolla/release/prometheus-mysqld-exporter:0.16.0.20251130 "dumb-init --single-…" 11 minutes ago Up 11 minutes prometheus_mysqld_exporter 2026-04-28 04:16:48.144969 | orchestrator | 94a29327349c registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130 "dumb-init --single-…" 11 minutes ago Up 11 minutes prometheus_node_exporter 2026-04-28 04:16:48.144993 | orchestrator | 0f80768500f9 registry.osism.tech/kolla/release/manila-share:19.1.1.20251130 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) manila_share 2026-04-28 04:16:48.145011 | orchestrator | 745df11bfdf8 registry.osism.tech/kolla/release/manila-scheduler:19.1.1.20251130 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) manila_scheduler 2026-04-28 04:16:48.145029 | orchestrator | f413622edebf registry.osism.tech/kolla/release/manila-data:19.1.1.20251130 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) manila_data 2026-04-28 04:16:48.145057 | orchestrator | ff4dfac8d7c8 registry.osism.tech/kolla/release/manila-api:19.1.1.20251130 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) manila_api 2026-04-28 04:16:48.145068 | orchestrator | 480c500fee69 registry.osism.tech/kolla/release/aodh-notifier:19.0.0.20251130 "dumb-init --single-…" 18 minutes ago Up 18 minutes (healthy) aodh_notifier 2026-04-28 04:16:48.145078 | orchestrator | a37ce9dbadac registry.osism.tech/kolla/release/aodh-listener:19.0.0.20251130 "dumb-init --single-…" 18 minutes ago Up 18 minutes (healthy) aodh_listener 2026-04-28 04:16:48.145087 | orchestrator | dff5e4c29903 registry.osism.tech/kolla/release/aodh-evaluator:19.0.0.20251130 "dumb-init --single-…" 19 minutes ago Up 19 minutes (healthy) aodh_evaluator 2026-04-28 04:16:48.145097 | orchestrator | 400f1be66919 registry.osism.tech/kolla/release/aodh-api:19.0.0.20251130 "dumb-init --single-…" 19 minutes ago Up 19 minutes (healthy) aodh_api 2026-04-28 04:16:48.145107 | orchestrator | 832d06a72268 registry.osism.tech/kolla/release/ceilometer-central:23.0.2.20251130 "dumb-init --single-…" 20 minutes ago Up 20 minutes ceilometer_central 2026-04-28 04:16:48.145117 | orchestrator | 62125701dcb2 registry.osism.tech/kolla/release/ceilometer-notification:23.0.2.20251130 "dumb-init --single-…" 21 minutes ago Up 21 minutes (healthy) ceilometer_notification 2026-04-28 04:16:48.145126 | orchestrator | a41cb9ae44b6 registry.osism.tech/kolla/release/octavia-worker:15.0.2.20251130 "dumb-init --single-…" 22 minutes ago Up 22 minutes (healthy) octavia_worker 2026-04-28 04:16:48.145155 | orchestrator | ebf059940d3c registry.osism.tech/kolla/release/octavia-housekeeping:15.0.2.20251130 "dumb-init --single-…" 22 minutes ago Up 22 minutes (healthy) octavia_housekeeping 2026-04-28 04:16:48.145165 | orchestrator | 1c6b87b6b57c registry.osism.tech/kolla/release/octavia-health-manager:15.0.2.20251130 "dumb-init --single-…" 22 minutes ago Up 22 minutes (healthy) octavia_health_manager 2026-04-28 04:16:48.145175 | orchestrator | d994532251f0 registry.osism.tech/kolla/release/octavia-driver-agent:15.0.2.20251130 "dumb-init --single-…" 23 minutes ago Up 23 minutes octavia_driver_agent 2026-04-28 04:16:48.145184 | orchestrator | 68aa8f03fe1f registry.osism.tech/kolla/release/octavia-api:15.0.2.20251130 "dumb-init --single-…" 23 minutes ago Up 23 minutes (healthy) octavia_api 2026-04-28 04:16:48.145194 | orchestrator | 18dbe53b29de registry.osism.tech/kolla/release/designate-worker:19.0.1.20251130 "dumb-init --single-…" 27 minutes ago Up 27 minutes (healthy) designate_worker 2026-04-28 04:16:48.145214 | orchestrator | 1357f3a20283 registry.osism.tech/kolla/release/designate-mdns:19.0.1.20251130 "dumb-init --single-…" 27 minutes ago Up 27 minutes (healthy) designate_mdns 2026-04-28 04:16:48.145223 | orchestrator | 9495ee679bfd registry.osism.tech/kolla/release/designate-producer:19.0.1.20251130 "dumb-init --single-…" 27 minutes ago Up 27 minutes (healthy) designate_producer 2026-04-28 04:16:48.145233 | orchestrator | 0c94bff5b763 registry.osism.tech/kolla/release/designate-central:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) designate_central 2026-04-28 04:16:48.145243 | orchestrator | 1981a9837199 registry.osism.tech/kolla/release/designate-api:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) designate_api 2026-04-28 04:16:48.145252 | orchestrator | ddef7ae0d523 registry.osism.tech/kolla/release/designate-backend-bind9:19.0.1.20251130 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) designate_backend_bind9 2026-04-28 04:16:48.145262 | orchestrator | db4d52f94425 registry.osism.tech/kolla/release/barbican-worker:19.0.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) barbican_worker 2026-04-28 04:16:48.145272 | orchestrator | 39ee6f72b35a registry.osism.tech/kolla/release/barbican-keystone-listener:19.0.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) barbican_keystone_listener 2026-04-28 04:16:48.145281 | orchestrator | b9c72f1e6f3a registry.osism.tech/kolla/release/barbican-api:19.0.1.20251130 "dumb-init --single-…" 30 minutes ago Up 30 minutes (healthy) barbican_api 2026-04-28 04:16:48.145291 | orchestrator | c4802529c647 registry.osism.tech/kolla/release/cinder-backup:25.3.1.20251130 "dumb-init --single-…" 32 minutes ago Up 32 minutes (healthy) cinder_backup 2026-04-28 04:16:48.145301 | orchestrator | 58b805641797 registry.osism.tech/kolla/release/cinder-volume:25.3.1.20251130 "dumb-init --single-…" 32 minutes ago Up 32 minutes (healthy) cinder_volume 2026-04-28 04:16:48.145310 | orchestrator | e0494c94c802 registry.osism.tech/kolla/release/cinder-scheduler:25.3.1.20251130 "dumb-init --single-…" 33 minutes ago Up 33 minutes (healthy) cinder_scheduler 2026-04-28 04:16:48.145337 | orchestrator | 728051055a4e registry.osism.tech/kolla/release/cinder-api:25.3.1.20251130 "dumb-init --single-…" 33 minutes ago Up 33 minutes (healthy) cinder_api 2026-04-28 04:16:48.145357 | orchestrator | 98a826d0b3e9 registry.osism.tech/kolla/release/glance-api:29.0.1.20251130 "dumb-init --single-…" 35 minutes ago Up 35 minutes (healthy) glance_api 2026-04-28 04:16:48.145368 | orchestrator | 131914a711a3 registry.osism.tech/kolla/release/skyline-console:5.0.1.20251130 "dumb-init --single-…" 38 minutes ago Up 38 minutes (healthy) skyline_console 2026-04-28 04:16:48.145385 | orchestrator | 180a982edc8d registry.osism.tech/kolla/release/skyline-apiserver:5.0.1.20251130 "dumb-init --single-…" 38 minutes ago Up 38 minutes (healthy) skyline_apiserver 2026-04-28 04:16:48.145406 | orchestrator | f8a269b51e5e registry.osism.tech/kolla/release/horizon:25.1.2.20251130 "dumb-init --single-…" 39 minutes ago Up 39 minutes (healthy) horizon 2026-04-28 04:16:48.145417 | orchestrator | 2c4e26f55edb registry.osism.tech/kolla/release/nova-novncproxy:30.2.1.20251130 "dumb-init --single-…" 44 minutes ago Up 44 minutes (healthy) nova_novncproxy 2026-04-28 04:16:48.145426 | orchestrator | 5112b2c922f1 registry.osism.tech/kolla/release/nova-conductor:30.2.1.20251130 "dumb-init --single-…" 44 minutes ago Up 44 minutes (healthy) nova_conductor 2026-04-28 04:16:48.145443 | orchestrator | ef74b22e1c35 registry.osism.tech/kolla/release/nova-api:30.2.1.20251130 "dumb-init --single-…" 45 minutes ago Up 45 minutes (healthy) nova_api 2026-04-28 04:16:48.145452 | orchestrator | 54cdb23e3a91 registry.osism.tech/kolla/release/nova-scheduler:30.2.1.20251130 "dumb-init --single-…" 46 minutes ago Up 46 minutes (healthy) nova_scheduler 2026-04-28 04:16:48.145462 | orchestrator | cc10555d621d registry.osism.tech/kolla/release/neutron-server:25.2.2.20251130 "dumb-init --single-…" 51 minutes ago Up 51 minutes (healthy) neutron_server 2026-04-28 04:16:48.145472 | orchestrator | f92089d1724e registry.osism.tech/kolla/release/placement-api:12.0.1.20251130 "dumb-init --single-…" 54 minutes ago Up 54 minutes (healthy) placement_api 2026-04-28 04:16:48.145482 | orchestrator | cb3ae13e2240 registry.osism.tech/kolla/release/keystone:26.0.1.20251130 "dumb-init --single-…" 56 minutes ago Up 56 minutes (healthy) keystone 2026-04-28 04:16:48.145491 | orchestrator | 1fee35874b5f registry.osism.tech/kolla/release/keystone-fernet:26.0.1.20251130 "dumb-init --single-…" 57 minutes ago Up 57 minutes (healthy) keystone_fernet 2026-04-28 04:16:48.145501 | orchestrator | 325a0ce7594d registry.osism.tech/kolla/release/keystone-ssh:26.0.1.20251130 "dumb-init --single-…" 57 minutes ago Up 57 minutes (healthy) keystone_ssh 2026-04-28 04:16:48.145510 | orchestrator | a9ba8b8b0189 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mgr -…" 59 minutes ago Up 59 minutes ceph-mgr-testbed-node-2 2026-04-28 04:16:48.145520 | orchestrator | d009e9f9145f registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-crash" About an hour ago Up About an hour ceph-crash-testbed-node-2 2026-04-28 04:16:48.145530 | orchestrator | ba47649d1789 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mon -…" About an hour ago Up About an hour ceph-mon-testbed-node-2 2026-04-28 04:16:48.145544 | orchestrator | 49ab7159fdc8 registry.osism.tech/kolla/release/ovn-northd:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_northd 2026-04-28 04:16:48.145554 | orchestrator | ad78b044b809 registry.osism.tech/kolla/release/ovn-sb-db-server:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_sb_db 2026-04-28 04:16:48.145563 | orchestrator | d5ff4dc7de76 registry.osism.tech/kolla/release/ovn-nb-db-server:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_nb_db 2026-04-28 04:16:48.145573 | orchestrator | 006c1d02a184 registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour ovn_controller 2026-04-28 04:16:48.145583 | orchestrator | 0776fbafe523 registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) openvswitch_vswitchd 2026-04-28 04:16:48.145593 | orchestrator | fd616fe89887 registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) openvswitch_db 2026-04-28 04:16:48.145602 | orchestrator | 6a1cd119ce7a registry.osism.tech/kolla/release/rabbitmq:3.13.7.20251130 "dumb-init --single-…" About an hour ago Up About an hour (healthy) rabbitmq 2026-04-28 04:16:48.145618 | orchestrator | 8c84677fa82f registry.osism.tech/kolla/release/mariadb-server:10.11.15.20251130 "dumb-init -- kolla_…" About an hour ago Up About an hour (healthy) mariadb 2026-04-28 04:16:48.145634 | orchestrator | dac809763647 registry.osism.tech/kolla/release/redis-sentinel:7.0.15.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) redis_sentinel 2026-04-28 04:16:48.145644 | orchestrator | b11cf2e39662 registry.osism.tech/kolla/release/redis:7.0.15.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) redis 2026-04-28 04:16:48.145654 | orchestrator | e805804463fd registry.osism.tech/kolla/release/memcached:1.6.24.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) memcached 2026-04-28 04:16:48.145664 | orchestrator | ad36c06d433b registry.osism.tech/kolla/release/opensearch-dashboards:2.19.4.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) opensearch_dashboards 2026-04-28 04:16:48.145673 | orchestrator | 2c754e05a667 registry.osism.tech/kolla/release/opensearch:2.19.4.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) opensearch 2026-04-28 04:16:48.145684 | orchestrator | ebc02f1d94be registry.osism.tech/kolla/release/keepalived:2.2.8.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours keepalived 2026-04-28 04:16:48.145693 | orchestrator | ec48490627f4 registry.osism.tech/kolla/release/proxysql:3.0.3.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) proxysql 2026-04-28 04:16:48.145703 | orchestrator | 0e8afd1ce9fb registry.osism.tech/kolla/release/haproxy:2.8.15.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours (healthy) haproxy 2026-04-28 04:16:48.145713 | orchestrator | f8d13e153115 registry.osism.tech/kolla/release/cron:3.0.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours cron 2026-04-28 04:16:48.145723 | orchestrator | cbf0d94decb1 registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours kolla_toolbox 2026-04-28 04:16:48.145733 | orchestrator | 0db08abf76fa registry.osism.tech/kolla/release/fluentd:5.0.8.20251130 "dumb-init --single-…" 2 hours ago Up 2 hours fluentd 2026-04-28 04:16:48.537481 | orchestrator | 2026-04-28 04:16:48.537578 | orchestrator | ## Images @ testbed-node-2 2026-04-28 04:16:48.537593 | orchestrator | 2026-04-28 04:16:48.537604 | orchestrator | + echo 2026-04-28 04:16:48.537615 | orchestrator | + echo '## Images @ testbed-node-2' 2026-04-28 04:16:48.537627 | orchestrator | + echo 2026-04-28 04:16:48.537636 | orchestrator | + osism container testbed-node-2 images 2026-04-28 04:16:51.271702 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-28 04:16:51.271802 | orchestrator | registry.osism.tech/kolla/release/rabbitmq 3.13.7.20251130 618df24dfbf4 4 months ago 322MB 2026-04-28 04:16:51.271817 | orchestrator | registry.osism.tech/kolla/release/memcached 1.6.24.20251130 8a9865997707 4 months ago 266MB 2026-04-28 04:16:51.271830 | orchestrator | registry.osism.tech/kolla/release/opensearch 2.19.4.20251130 dc62f23331d2 4 months ago 1.56GB 2026-04-28 04:16:51.271841 | orchestrator | registry.osism.tech/kolla/release/opensearch-dashboards 2.19.4.20251130 3b3613dd9b1a 4 months ago 1.53GB 2026-04-28 04:16:51.271852 | orchestrator | registry.osism.tech/kolla/release/keepalived 2.2.8.20251130 94862d07fc5a 4 months ago 276MB 2026-04-28 04:16:51.271863 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-28 04:16:51.271955 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-28 04:16:51.271995 | orchestrator | registry.osism.tech/kolla/release/grafana 12.3.0.20251130 6eb3b7b1dbf2 4 months ago 1.02GB 2026-04-28 04:16:51.272007 | orchestrator | registry.osism.tech/kolla/release/proxysql 3.0.3.20251130 2c7177938c0e 4 months ago 412MB 2026-04-28 04:16:51.272018 | orchestrator | registry.osism.tech/kolla/release/haproxy 2.8.15.20251130 6d4c583df983 4 months ago 274MB 2026-04-28 04:16:51.272034 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-28 04:16:51.272045 | orchestrator | registry.osism.tech/kolla/release/redis 7.0.15.20251130 5548a8ce5b5c 4 months ago 273MB 2026-04-28 04:16:51.272057 | orchestrator | registry.osism.tech/kolla/release/redis-sentinel 7.0.15.20251130 62d0b016058f 4 months ago 273MB 2026-04-28 04:16:51.272068 | orchestrator | registry.osism.tech/kolla/release/mariadb-server 10.11.15.20251130 77db67eebcc3 4 months ago 452MB 2026-04-28 04:16:51.272097 | orchestrator | registry.osism.tech/kolla/release/horizon 25.1.2.20251130 d7257ed845e9 4 months ago 1.15GB 2026-04-28 04:16:51.272117 | orchestrator | registry.osism.tech/kolla/release/prometheus-mysqld-exporter 0.16.0.20251130 aedc672fb472 4 months ago 301MB 2026-04-28 04:16:51.272137 | orchestrator | registry.osism.tech/kolla/release/prometheus-memcached-exporter 0.15.0.20251130 7b077076926d 4 months ago 298MB 2026-04-28 04:16:51.272162 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-28 04:16:51.272188 | orchestrator | registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter 1.8.0.20251130 bcaaf5d64345 4 months ago 292MB 2026-04-28 04:16:51.272207 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-28 04:16:51.272227 | orchestrator | registry.osism.tech/kolla/release/openvswitch-db-server 3.4.3.20251130 3e6f3fe8823c 4 months ago 279MB 2026-04-28 04:16:51.272244 | orchestrator | registry.osism.tech/kolla/release/openvswitch-vswitchd 3.4.3.20251130 ad8bb4636454 4 months ago 279MB 2026-04-28 04:16:51.272263 | orchestrator | registry.osism.tech/kolla/release/placement-api 12.0.1.20251130 20317ff6dfb9 4 months ago 975MB 2026-04-28 04:16:51.272280 | orchestrator | registry.osism.tech/kolla/release/nova-novncproxy 30.2.1.20251130 99323056afa4 4 months ago 1.37GB 2026-04-28 04:16:51.272300 | orchestrator | registry.osism.tech/kolla/release/nova-conductor 30.2.1.20251130 92609e648215 4 months ago 1.21GB 2026-04-28 04:16:51.272335 | orchestrator | registry.osism.tech/kolla/release/nova-api 30.2.1.20251130 2d78e7fdfb9a 4 months ago 1.21GB 2026-04-28 04:16:51.272364 | orchestrator | registry.osism.tech/kolla/release/nova-scheduler 30.2.1.20251130 4c3c59730530 4 months ago 1.21GB 2026-04-28 04:16:51.272380 | orchestrator | registry.osism.tech/kolla/release/ceilometer-central 23.0.2.20251130 37cb6975d4a5 4 months ago 976MB 2026-04-28 04:16:51.272397 | orchestrator | registry.osism.tech/kolla/release/ceilometer-notification 23.0.2.20251130 bb2927b293dc 4 months ago 976MB 2026-04-28 04:16:51.272413 | orchestrator | registry.osism.tech/kolla/release/magnum-api 19.0.1.20251130 a85fdbb4bbba 4 months ago 1.13GB 2026-04-28 04:16:51.272431 | orchestrator | registry.osism.tech/kolla/release/magnum-conductor 19.0.1.20251130 a98ee1099aad 4 months ago 1.24GB 2026-04-28 04:16:51.272468 | orchestrator | registry.osism.tech/kolla/release/manila-share 19.1.1.20251130 df44f491f2c1 4 months ago 1.22GB 2026-04-28 04:16:51.272488 | orchestrator | registry.osism.tech/kolla/release/manila-data 19.1.1.20251130 cd8b74c8a47a 4 months ago 1.06GB 2026-04-28 04:16:51.272532 | orchestrator | registry.osism.tech/kolla/release/manila-api 19.1.1.20251130 654f9bd3c940 4 months ago 1.05GB 2026-04-28 04:16:51.272550 | orchestrator | registry.osism.tech/kolla/release/manila-scheduler 19.1.1.20251130 e0864fa03a78 4 months ago 1.05GB 2026-04-28 04:16:51.272568 | orchestrator | registry.osism.tech/kolla/release/aodh-listener 19.0.0.20251130 1e68c23a9d38 4 months ago 974MB 2026-04-28 04:16:51.272585 | orchestrator | registry.osism.tech/kolla/release/aodh-evaluator 19.0.0.20251130 1726a7592f93 4 months ago 974MB 2026-04-28 04:16:51.272603 | orchestrator | registry.osism.tech/kolla/release/aodh-notifier 19.0.0.20251130 abbd6e9f87e2 4 months ago 974MB 2026-04-28 04:16:51.272621 | orchestrator | registry.osism.tech/kolla/release/aodh-api 19.0.0.20251130 82a64f1d056d 4 months ago 973MB 2026-04-28 04:16:51.272639 | orchestrator | registry.osism.tech/kolla/release/barbican-worker 19.0.1.20251130 2cef5d51872b 4 months ago 991MB 2026-04-28 04:16:51.272657 | orchestrator | registry.osism.tech/kolla/release/barbican-keystone-listener 19.0.1.20251130 bfcd8631a126 4 months ago 991MB 2026-04-28 04:16:51.272674 | orchestrator | registry.osism.tech/kolla/release/barbican-api 19.0.1.20251130 9195ddc3e4c5 4 months ago 990MB 2026-04-28 04:16:51.272685 | orchestrator | registry.osism.tech/kolla/release/keystone 26.0.1.20251130 6c1543e94c06 4 months ago 1.09GB 2026-04-28 04:16:51.272695 | orchestrator | registry.osism.tech/kolla/release/keystone-fernet 26.0.1.20251130 36669c355898 4 months ago 1.04GB 2026-04-28 04:16:51.272706 | orchestrator | registry.osism.tech/kolla/release/keystone-ssh 26.0.1.20251130 e002cffc8eb8 4 months ago 1.04GB 2026-04-28 04:16:51.272716 | orchestrator | registry.osism.tech/kolla/release/octavia-health-manager 15.0.2.20251130 059dc6d4a159 4 months ago 1.03GB 2026-04-28 04:16:51.272727 | orchestrator | registry.osism.tech/kolla/release/octavia-housekeeping 15.0.2.20251130 c9059accdc4a 4 months ago 1.03GB 2026-04-28 04:16:51.272738 | orchestrator | registry.osism.tech/kolla/release/octavia-api 15.0.2.20251130 9375641bed7a 4 months ago 1.05GB 2026-04-28 04:16:51.272749 | orchestrator | registry.osism.tech/kolla/release/octavia-worker 15.0.2.20251130 708f50e37fa7 4 months ago 1.03GB 2026-04-28 04:16:51.272759 | orchestrator | registry.osism.tech/kolla/release/octavia-driver-agent 15.0.2.20251130 045f928baedc 4 months ago 1.05GB 2026-04-28 04:16:51.272770 | orchestrator | registry.osism.tech/kolla/release/neutron-server 25.2.2.20251130 fa71fe0a109e 4 months ago 1.16GB 2026-04-28 04:16:51.272780 | orchestrator | registry.osism.tech/kolla/release/glance-api 29.0.1.20251130 b1fcfbc49057 4 months ago 1.1GB 2026-04-28 04:16:51.272791 | orchestrator | registry.osism.tech/kolla/release/designate-central 19.0.1.20251130 00b6af03994a 4 months ago 983MB 2026-04-28 04:16:51.272802 | orchestrator | registry.osism.tech/kolla/release/designate-worker 19.0.1.20251130 18bc80370e46 4 months ago 989MB 2026-04-28 04:16:51.272812 | orchestrator | registry.osism.tech/kolla/release/designate-producer 19.0.1.20251130 eac4506bf51f 4 months ago 984MB 2026-04-28 04:16:51.272839 | orchestrator | registry.osism.tech/kolla/release/designate-api 19.0.1.20251130 ad5d5cd1392a 4 months ago 984MB 2026-04-28 04:16:51.272860 | orchestrator | registry.osism.tech/kolla/release/designate-backend-bind9 19.0.1.20251130 4e19a1dc9c8a 4 months ago 989MB 2026-04-28 04:16:51.272897 | orchestrator | registry.osism.tech/kolla/release/designate-mdns 19.0.1.20251130 4ad9e0017d6e 4 months ago 984MB 2026-04-28 04:16:51.272917 | orchestrator | registry.osism.tech/kolla/release/skyline-console 5.0.1.20251130 20430a0acd38 4 months ago 1.05GB 2026-04-28 04:16:51.272947 | orchestrator | registry.osism.tech/kolla/release/skyline-apiserver 5.0.1.20251130 20bbe1600b66 4 months ago 990MB 2026-04-28 04:16:51.272963 | orchestrator | registry.osism.tech/kolla/release/cinder-volume 25.3.1.20251130 ab7ee3c06214 4 months ago 1.72GB 2026-04-28 04:16:51.272981 | orchestrator | registry.osism.tech/kolla/release/cinder-scheduler 25.3.1.20251130 47d31cd2c25d 4 months ago 1.4GB 2026-04-28 04:16:51.272997 | orchestrator | registry.osism.tech/kolla/release/cinder-backup 25.3.1.20251130 c09074b62f18 4 months ago 1.41GB 2026-04-28 04:16:51.273028 | orchestrator | registry.osism.tech/kolla/release/cinder-api 25.3.1.20251130 ceaaac81e8af 4 months ago 1.4GB 2026-04-28 04:16:51.273046 | orchestrator | registry.osism.tech/kolla/release/ovn-controller 24.9.3.20251130 fcd09e53d925 4 months ago 840MB 2026-04-28 04:16:51.273062 | orchestrator | registry.osism.tech/kolla/release/ovn-nb-db-server 24.9.3.20251130 e52b6499881a 4 months ago 840MB 2026-04-28 04:16:51.273080 | orchestrator | registry.osism.tech/kolla/release/ovn-sb-db-server 24.9.3.20251130 2fcefdb5b030 4 months ago 840MB 2026-04-28 04:16:51.273097 | orchestrator | registry.osism.tech/kolla/release/ovn-northd 24.9.3.20251130 948e5d22de86 4 months ago 840MB 2026-04-28 04:16:51.273117 | orchestrator | registry.osism.tech/osism/ceph-daemon 18.2.7 5f92363b1f93 11 months ago 1.27GB 2026-04-28 04:16:51.681007 | orchestrator | + sh -c /opt/configuration/scripts/check-services.sh 2026-04-28 04:16:51.691519 | orchestrator | + set -e 2026-04-28 04:16:51.691600 | orchestrator | + source /opt/manager-vars.sh 2026-04-28 04:16:51.691613 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-28 04:16:51.691623 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-28 04:16:51.691632 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-28 04:16:51.691641 | orchestrator | ++ CEPH_VERSION=reef 2026-04-28 04:16:51.691651 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-28 04:16:51.691661 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-28 04:16:51.691670 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-28 04:16:51.691679 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-28 04:16:51.691688 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-28 04:16:51.691696 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-28 04:16:51.691705 | orchestrator | ++ export ARA=false 2026-04-28 04:16:51.691714 | orchestrator | ++ ARA=false 2026-04-28 04:16:51.691723 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-28 04:16:51.691732 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-28 04:16:51.691741 | orchestrator | ++ export TEMPEST=false 2026-04-28 04:16:51.691749 | orchestrator | ++ TEMPEST=false 2026-04-28 04:16:51.691759 | orchestrator | ++ export IS_ZUUL=true 2026-04-28 04:16:51.691774 | orchestrator | ++ IS_ZUUL=true 2026-04-28 04:16:51.691789 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 04:16:51.691805 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 04:16:51.691820 | orchestrator | ++ export EXTERNAL_API=false 2026-04-28 04:16:51.691834 | orchestrator | ++ EXTERNAL_API=false 2026-04-28 04:16:51.691849 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-28 04:16:51.691863 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-28 04:16:51.691906 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-28 04:16:51.691920 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-28 04:16:51.691935 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-28 04:16:51.691947 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-28 04:16:51.691962 | orchestrator | + [[ ceph-ansible == \c\e\p\h\-\a\n\s\i\b\l\e ]] 2026-04-28 04:16:51.691976 | orchestrator | + sh -c /opt/configuration/scripts/check/100-ceph-with-ansible.sh 2026-04-28 04:16:51.702245 | orchestrator | + set -e 2026-04-28 04:16:51.702324 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-28 04:16:51.703338 | orchestrator | ++ export INTERACTIVE=false 2026-04-28 04:16:51.703456 | orchestrator | ++ INTERACTIVE=false 2026-04-28 04:16:51.703471 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-28 04:16:51.703482 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-28 04:16:51.703493 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-28 04:16:51.703566 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-28 04:16:51.707992 | orchestrator | 2026-04-28 04:16:51.708089 | orchestrator | # Ceph status 2026-04-28 04:16:51.708106 | orchestrator | 2026-04-28 04:16:51.708118 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-28 04:16:51.708131 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-28 04:16:51.708143 | orchestrator | + echo 2026-04-28 04:16:51.708154 | orchestrator | + echo '# Ceph status' 2026-04-28 04:16:51.708165 | orchestrator | + echo 2026-04-28 04:16:51.708176 | orchestrator | + ceph -s 2026-04-28 04:16:52.377823 | orchestrator | cluster: 2026-04-28 04:16:52.377939 | orchestrator | id: 11111111-1111-1111-1111-111111111111 2026-04-28 04:16:52.377954 | orchestrator | health: HEALTH_OK 2026-04-28 04:16:52.377964 | orchestrator | 2026-04-28 04:16:52.377973 | orchestrator | services: 2026-04-28 04:16:52.377982 | orchestrator | mon: 3 daemons, quorum testbed-node-0,testbed-node-1,testbed-node-2 (age 72m) 2026-04-28 04:16:52.378004 | orchestrator | mgr: testbed-node-1(active, since 59m), standbys: testbed-node-0, testbed-node-2 2026-04-28 04:16:52.378058 | orchestrator | mds: 1/1 daemons up, 2 standby 2026-04-28 04:16:52.378069 | orchestrator | osd: 6 osds: 6 up (since 68m), 6 in (since 69m) 2026-04-28 04:16:52.378079 | orchestrator | rgw: 3 daemons active (3 hosts, 1 zones) 2026-04-28 04:16:52.378088 | orchestrator | 2026-04-28 04:16:52.378097 | orchestrator | data: 2026-04-28 04:16:52.378106 | orchestrator | volumes: 1/1 healthy 2026-04-28 04:16:52.378115 | orchestrator | pools: 14 pools, 401 pgs 2026-04-28 04:16:52.378124 | orchestrator | objects: 556 objects, 2.2 GiB 2026-04-28 04:16:52.378133 | orchestrator | usage: 7.0 GiB used, 113 GiB / 120 GiB avail 2026-04-28 04:16:52.378142 | orchestrator | pgs: 401 active+clean 2026-04-28 04:16:52.378151 | orchestrator | 2026-04-28 04:16:52.436596 | orchestrator | 2026-04-28 04:16:52.436724 | orchestrator | # Ceph versions 2026-04-28 04:16:52.436732 | orchestrator | 2026-04-28 04:16:52.436736 | orchestrator | + echo 2026-04-28 04:16:52.436741 | orchestrator | + echo '# Ceph versions' 2026-04-28 04:16:52.436746 | orchestrator | + echo 2026-04-28 04:16:52.436750 | orchestrator | + ceph versions 2026-04-28 04:16:53.077779 | orchestrator | { 2026-04-28 04:16:53.077933 | orchestrator | "mon": { 2026-04-28 04:16:53.077954 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-28 04:16:53.077965 | orchestrator | }, 2026-04-28 04:16:53.077975 | orchestrator | "mgr": { 2026-04-28 04:16:53.077984 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-28 04:16:53.077994 | orchestrator | }, 2026-04-28 04:16:53.078003 | orchestrator | "osd": { 2026-04-28 04:16:53.078055 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 6 2026-04-28 04:16:53.078067 | orchestrator | }, 2026-04-28 04:16:53.078077 | orchestrator | "mds": { 2026-04-28 04:16:53.078087 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-28 04:16:53.078098 | orchestrator | }, 2026-04-28 04:16:53.078109 | orchestrator | "rgw": { 2026-04-28 04:16:53.078118 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-28 04:16:53.078128 | orchestrator | }, 2026-04-28 04:16:53.078139 | orchestrator | "overall": { 2026-04-28 04:16:53.078170 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 18 2026-04-28 04:16:53.078178 | orchestrator | } 2026-04-28 04:16:53.078183 | orchestrator | } 2026-04-28 04:16:53.130843 | orchestrator | 2026-04-28 04:16:53.130962 | orchestrator | # Ceph OSD tree 2026-04-28 04:16:53.130976 | orchestrator | 2026-04-28 04:16:53.130986 | orchestrator | + echo 2026-04-28 04:16:53.130995 | orchestrator | + echo '# Ceph OSD tree' 2026-04-28 04:16:53.131005 | orchestrator | + echo 2026-04-28 04:16:53.131015 | orchestrator | + ceph osd df tree 2026-04-28 04:16:53.654009 | orchestrator | ID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP META AVAIL %USE VAR PGS STATUS TYPE NAME 2026-04-28 04:16:53.654212 | orchestrator | -1 0.11691 - 120 GiB 7.0 GiB 6.7 GiB 6 KiB 352 MiB 113 GiB 5.85 1.00 - root default 2026-04-28 04:16:53.654239 | orchestrator | -3 0.03897 - 40 GiB 2.3 GiB 2.2 GiB 2 KiB 105 MiB 38 GiB 5.82 0.99 - host testbed-node-3 2026-04-28 04:16:53.654259 | orchestrator | 0 hdd 0.01949 1.00000 20 GiB 1.0 GiB 986 MiB 1 KiB 44 MiB 19 GiB 5.04 0.86 189 up osd.0 2026-04-28 04:16:53.654278 | orchestrator | 3 hdd 0.01949 1.00000 20 GiB 1.3 GiB 1.3 GiB 1 KiB 62 MiB 19 GiB 6.61 1.13 201 up osd.3 2026-04-28 04:16:53.654333 | orchestrator | -7 0.03897 - 40 GiB 2.3 GiB 2.2 GiB 2 KiB 123 MiB 38 GiB 5.87 1.00 - host testbed-node-4 2026-04-28 04:16:53.654375 | orchestrator | 1 hdd 0.01949 1.00000 20 GiB 1.2 GiB 1.1 GiB 1 KiB 62 MiB 19 GiB 5.94 1.02 192 up osd.1 2026-04-28 04:16:53.654397 | orchestrator | 4 hdd 0.01949 1.00000 20 GiB 1.2 GiB 1.1 GiB 1 KiB 62 MiB 19 GiB 5.79 0.99 196 up osd.4 2026-04-28 04:16:53.654414 | orchestrator | -5 0.03897 - 40 GiB 2.3 GiB 2.2 GiB 2 KiB 123 MiB 38 GiB 5.87 1.00 - host testbed-node-5 2026-04-28 04:16:53.654431 | orchestrator | 2 hdd 0.01949 1.00000 20 GiB 1.4 GiB 1.3 GiB 1 KiB 62 MiB 19 GiB 7.00 1.20 206 up osd.2 2026-04-28 04:16:53.654448 | orchestrator | 5 hdd 0.01949 1.00000 20 GiB 968 MiB 906 MiB 1 KiB 62 MiB 19 GiB 4.73 0.81 186 up osd.5 2026-04-28 04:16:53.654465 | orchestrator | TOTAL 120 GiB 7.0 GiB 6.7 GiB 9.3 KiB 352 MiB 113 GiB 5.85 2026-04-28 04:16:53.654484 | orchestrator | MIN/MAX VAR: 0.81/1.20 STDDEV: 0.80 2026-04-28 04:16:53.702315 | orchestrator | 2026-04-28 04:16:53.702409 | orchestrator | # Ceph monitor status 2026-04-28 04:16:53.702426 | orchestrator | 2026-04-28 04:16:53.702440 | orchestrator | + echo 2026-04-28 04:16:53.702452 | orchestrator | + echo '# Ceph monitor status' 2026-04-28 04:16:53.702464 | orchestrator | + echo 2026-04-28 04:16:53.702475 | orchestrator | + ceph mon stat 2026-04-28 04:16:54.389221 | orchestrator | e1: 3 mons at {testbed-node-0=[v2:192.168.16.10:3300/0,v1:192.168.16.10:6789/0],testbed-node-1=[v2:192.168.16.11:3300/0,v1:192.168.16.11:6789/0],testbed-node-2=[v2:192.168.16.12:3300/0,v1:192.168.16.12:6789/0]} removed_ranks: {} disallowed_leaders: {}, election epoch 6, leader 0 testbed-node-0, quorum 0,1,2 testbed-node-0,testbed-node-1,testbed-node-2 2026-04-28 04:16:54.445200 | orchestrator | 2026-04-28 04:16:54.445298 | orchestrator | # Ceph quorum status 2026-04-28 04:16:54.445317 | orchestrator | 2026-04-28 04:16:54.445330 | orchestrator | + echo 2026-04-28 04:16:54.445341 | orchestrator | + echo '# Ceph quorum status' 2026-04-28 04:16:54.445353 | orchestrator | + echo 2026-04-28 04:16:54.445991 | orchestrator | + ceph quorum_status 2026-04-28 04:16:54.446076 | orchestrator | + jq 2026-04-28 04:16:55.138202 | orchestrator | { 2026-04-28 04:16:55.138283 | orchestrator | "election_epoch": 6, 2026-04-28 04:16:55.138296 | orchestrator | "quorum": [ 2026-04-28 04:16:55.138303 | orchestrator | 0, 2026-04-28 04:16:55.138371 | orchestrator | 1, 2026-04-28 04:16:55.138379 | orchestrator | 2 2026-04-28 04:16:55.138385 | orchestrator | ], 2026-04-28 04:16:55.138393 | orchestrator | "quorum_names": [ 2026-04-28 04:16:55.138400 | orchestrator | "testbed-node-0", 2026-04-28 04:16:55.138407 | orchestrator | "testbed-node-1", 2026-04-28 04:16:55.138414 | orchestrator | "testbed-node-2" 2026-04-28 04:16:55.138421 | orchestrator | ], 2026-04-28 04:16:55.138428 | orchestrator | "quorum_leader_name": "testbed-node-0", 2026-04-28 04:16:55.138438 | orchestrator | "quorum_age": 4327, 2026-04-28 04:16:55.138445 | orchestrator | "features": { 2026-04-28 04:16:55.138452 | orchestrator | "quorum_con": "4540138322906710015", 2026-04-28 04:16:55.138459 | orchestrator | "quorum_mon": [ 2026-04-28 04:16:55.138466 | orchestrator | "kraken", 2026-04-28 04:16:55.138470 | orchestrator | "luminous", 2026-04-28 04:16:55.138475 | orchestrator | "mimic", 2026-04-28 04:16:55.138479 | orchestrator | "osdmap-prune", 2026-04-28 04:16:55.138484 | orchestrator | "nautilus", 2026-04-28 04:16:55.138488 | orchestrator | "octopus", 2026-04-28 04:16:55.138493 | orchestrator | "pacific", 2026-04-28 04:16:55.138497 | orchestrator | "elector-pinging", 2026-04-28 04:16:55.138501 | orchestrator | "quincy", 2026-04-28 04:16:55.138506 | orchestrator | "reef" 2026-04-28 04:16:55.138511 | orchestrator | ] 2026-04-28 04:16:55.138515 | orchestrator | }, 2026-04-28 04:16:55.138519 | orchestrator | "monmap": { 2026-04-28 04:16:55.138523 | orchestrator | "epoch": 1, 2026-04-28 04:16:55.138528 | orchestrator | "fsid": "11111111-1111-1111-1111-111111111111", 2026-04-28 04:16:55.138533 | orchestrator | "modified": "2026-04-28T03:04:25.035097Z", 2026-04-28 04:16:55.138538 | orchestrator | "created": "2026-04-28T03:04:25.035097Z", 2026-04-28 04:16:55.138542 | orchestrator | "min_mon_release": 18, 2026-04-28 04:16:55.138547 | orchestrator | "min_mon_release_name": "reef", 2026-04-28 04:16:55.138551 | orchestrator | "election_strategy": 1, 2026-04-28 04:16:55.138556 | orchestrator | "disallowed_leaders: ": "", 2026-04-28 04:16:55.138560 | orchestrator | "stretch_mode": false, 2026-04-28 04:16:55.138585 | orchestrator | "tiebreaker_mon": "", 2026-04-28 04:16:55.138589 | orchestrator | "removed_ranks: ": "", 2026-04-28 04:16:55.138593 | orchestrator | "features": { 2026-04-28 04:16:55.138598 | orchestrator | "persistent": [ 2026-04-28 04:16:55.138602 | orchestrator | "kraken", 2026-04-28 04:16:55.138606 | orchestrator | "luminous", 2026-04-28 04:16:55.138610 | orchestrator | "mimic", 2026-04-28 04:16:55.138615 | orchestrator | "osdmap-prune", 2026-04-28 04:16:55.138619 | orchestrator | "nautilus", 2026-04-28 04:16:55.138623 | orchestrator | "octopus", 2026-04-28 04:16:55.138627 | orchestrator | "pacific", 2026-04-28 04:16:55.138632 | orchestrator | "elector-pinging", 2026-04-28 04:16:55.138636 | orchestrator | "quincy", 2026-04-28 04:16:55.138640 | orchestrator | "reef" 2026-04-28 04:16:55.138645 | orchestrator | ], 2026-04-28 04:16:55.138649 | orchestrator | "optional": [] 2026-04-28 04:16:55.138653 | orchestrator | }, 2026-04-28 04:16:55.138658 | orchestrator | "mons": [ 2026-04-28 04:16:55.138662 | orchestrator | { 2026-04-28 04:16:55.138666 | orchestrator | "rank": 0, 2026-04-28 04:16:55.138671 | orchestrator | "name": "testbed-node-0", 2026-04-28 04:16:55.138675 | orchestrator | "public_addrs": { 2026-04-28 04:16:55.138679 | orchestrator | "addrvec": [ 2026-04-28 04:16:55.138683 | orchestrator | { 2026-04-28 04:16:55.138688 | orchestrator | "type": "v2", 2026-04-28 04:16:55.138693 | orchestrator | "addr": "192.168.16.10:3300", 2026-04-28 04:16:55.138697 | orchestrator | "nonce": 0 2026-04-28 04:16:55.138701 | orchestrator | }, 2026-04-28 04:16:55.138706 | orchestrator | { 2026-04-28 04:16:55.138710 | orchestrator | "type": "v1", 2026-04-28 04:16:55.138714 | orchestrator | "addr": "192.168.16.10:6789", 2026-04-28 04:16:55.138718 | orchestrator | "nonce": 0 2026-04-28 04:16:55.138723 | orchestrator | } 2026-04-28 04:16:55.138727 | orchestrator | ] 2026-04-28 04:16:55.138731 | orchestrator | }, 2026-04-28 04:16:55.138735 | orchestrator | "addr": "192.168.16.10:6789/0", 2026-04-28 04:16:55.138740 | orchestrator | "public_addr": "192.168.16.10:6789/0", 2026-04-28 04:16:55.138744 | orchestrator | "priority": 0, 2026-04-28 04:16:55.138748 | orchestrator | "weight": 0, 2026-04-28 04:16:55.138752 | orchestrator | "crush_location": "{}" 2026-04-28 04:16:55.138757 | orchestrator | }, 2026-04-28 04:16:55.138762 | orchestrator | { 2026-04-28 04:16:55.138767 | orchestrator | "rank": 1, 2026-04-28 04:16:55.138773 | orchestrator | "name": "testbed-node-1", 2026-04-28 04:16:55.138778 | orchestrator | "public_addrs": { 2026-04-28 04:16:55.138782 | orchestrator | "addrvec": [ 2026-04-28 04:16:55.138787 | orchestrator | { 2026-04-28 04:16:55.138792 | orchestrator | "type": "v2", 2026-04-28 04:16:55.138797 | orchestrator | "addr": "192.168.16.11:3300", 2026-04-28 04:16:55.138802 | orchestrator | "nonce": 0 2026-04-28 04:16:55.138807 | orchestrator | }, 2026-04-28 04:16:55.138812 | orchestrator | { 2026-04-28 04:16:55.138817 | orchestrator | "type": "v1", 2026-04-28 04:16:55.138822 | orchestrator | "addr": "192.168.16.11:6789", 2026-04-28 04:16:55.138827 | orchestrator | "nonce": 0 2026-04-28 04:16:55.138832 | orchestrator | } 2026-04-28 04:16:55.138837 | orchestrator | ] 2026-04-28 04:16:55.138841 | orchestrator | }, 2026-04-28 04:16:55.138846 | orchestrator | "addr": "192.168.16.11:6789/0", 2026-04-28 04:16:55.138851 | orchestrator | "public_addr": "192.168.16.11:6789/0", 2026-04-28 04:16:55.138856 | orchestrator | "priority": 0, 2026-04-28 04:16:55.138861 | orchestrator | "weight": 0, 2026-04-28 04:16:55.138866 | orchestrator | "crush_location": "{}" 2026-04-28 04:16:55.138871 | orchestrator | }, 2026-04-28 04:16:55.138892 | orchestrator | { 2026-04-28 04:16:55.138897 | orchestrator | "rank": 2, 2026-04-28 04:16:55.138902 | orchestrator | "name": "testbed-node-2", 2026-04-28 04:16:55.138907 | orchestrator | "public_addrs": { 2026-04-28 04:16:55.138912 | orchestrator | "addrvec": [ 2026-04-28 04:16:55.138917 | orchestrator | { 2026-04-28 04:16:55.138922 | orchestrator | "type": "v2", 2026-04-28 04:16:55.138927 | orchestrator | "addr": "192.168.16.12:3300", 2026-04-28 04:16:55.138932 | orchestrator | "nonce": 0 2026-04-28 04:16:55.138937 | orchestrator | }, 2026-04-28 04:16:55.138942 | orchestrator | { 2026-04-28 04:16:55.138947 | orchestrator | "type": "v1", 2026-04-28 04:16:55.138952 | orchestrator | "addr": "192.168.16.12:6789", 2026-04-28 04:16:55.138957 | orchestrator | "nonce": 0 2026-04-28 04:16:55.138968 | orchestrator | } 2026-04-28 04:16:55.138973 | orchestrator | ] 2026-04-28 04:16:55.138978 | orchestrator | }, 2026-04-28 04:16:55.138983 | orchestrator | "addr": "192.168.16.12:6789/0", 2026-04-28 04:16:55.138987 | orchestrator | "public_addr": "192.168.16.12:6789/0", 2026-04-28 04:16:55.138992 | orchestrator | "priority": 0, 2026-04-28 04:16:55.139007 | orchestrator | "weight": 0, 2026-04-28 04:16:55.139012 | orchestrator | "crush_location": "{}" 2026-04-28 04:16:55.139018 | orchestrator | } 2026-04-28 04:16:55.139023 | orchestrator | ] 2026-04-28 04:16:55.139027 | orchestrator | } 2026-04-28 04:16:55.139031 | orchestrator | } 2026-04-28 04:16:55.139110 | orchestrator | 2026-04-28 04:16:55.139117 | orchestrator | # Ceph free space status 2026-04-28 04:16:55.139121 | orchestrator | 2026-04-28 04:16:55.139126 | orchestrator | + echo 2026-04-28 04:16:55.139130 | orchestrator | + echo '# Ceph free space status' 2026-04-28 04:16:55.139134 | orchestrator | + echo 2026-04-28 04:16:55.139139 | orchestrator | + ceph df 2026-04-28 04:16:55.833014 | orchestrator | --- RAW STORAGE --- 2026-04-28 04:16:55.833103 | orchestrator | CLASS SIZE AVAIL USED RAW USED %RAW USED 2026-04-28 04:16:55.833130 | orchestrator | hdd 120 GiB 113 GiB 7.0 GiB 7.0 GiB 5.85 2026-04-28 04:16:55.833140 | orchestrator | TOTAL 120 GiB 113 GiB 7.0 GiB 7.0 GiB 5.85 2026-04-28 04:16:55.833149 | orchestrator | 2026-04-28 04:16:55.833158 | orchestrator | --- POOLS --- 2026-04-28 04:16:55.833167 | orchestrator | POOL ID PGS STORED OBJECTS USED %USED MAX AVAIL 2026-04-28 04:16:55.833177 | orchestrator | .mgr 1 1 577 KiB 2 1.1 MiB 0 53 GiB 2026-04-28 04:16:55.833186 | orchestrator | cephfs_data 2 32 0 B 0 0 B 0 35 GiB 2026-04-28 04:16:55.833195 | orchestrator | cephfs_metadata 3 16 4.4 KiB 22 96 KiB 0 35 GiB 2026-04-28 04:16:55.833204 | orchestrator | default.rgw.buckets.data 4 32 0 B 0 0 B 0 35 GiB 2026-04-28 04:16:55.833211 | orchestrator | default.rgw.buckets.index 5 32 0 B 0 0 B 0 35 GiB 2026-04-28 04:16:55.833220 | orchestrator | default.rgw.control 6 32 0 B 8 0 B 0 35 GiB 2026-04-28 04:16:55.833229 | orchestrator | default.rgw.log 7 32 3.6 KiB 209 408 KiB 0 35 GiB 2026-04-28 04:16:55.833239 | orchestrator | default.rgw.meta 8 32 0 B 0 0 B 0 35 GiB 2026-04-28 04:16:55.833248 | orchestrator | .rgw.root 9 32 3.9 KiB 8 64 KiB 0 53 GiB 2026-04-28 04:16:55.833256 | orchestrator | backups 10 32 19 B 2 12 KiB 0 35 GiB 2026-04-28 04:16:55.833264 | orchestrator | volumes 11 32 19 B 2 12 KiB 0 35 GiB 2026-04-28 04:16:55.833273 | orchestrator | images 12 32 2.2 GiB 299 6.7 GiB 5.94 35 GiB 2026-04-28 04:16:55.833281 | orchestrator | metrics 13 32 19 B 2 12 KiB 0 35 GiB 2026-04-28 04:16:55.833291 | orchestrator | vms 14 32 19 B 2 12 KiB 0 35 GiB 2026-04-28 04:16:55.890364 | orchestrator | ++ semver 9.5.0 5.0.0 2026-04-28 04:16:55.940955 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-28 04:16:55.941058 | orchestrator | + osism apply facts 2026-04-28 04:16:58.209050 | orchestrator | 2026-04-28 04:16:58 | INFO  | Task 07c95c93-9ab5-4637-8010-b1a19cde9097 (facts) was prepared for execution. 2026-04-28 04:16:58.209136 | orchestrator | 2026-04-28 04:16:58 | INFO  | It takes a moment until task 07c95c93-9ab5-4637-8010-b1a19cde9097 (facts) has been started and output is visible here. 2026-04-28 04:17:12.923164 | orchestrator | 2026-04-28 04:17:12.923254 | orchestrator | PLAY [Apply role facts] ******************************************************** 2026-04-28 04:17:12.923265 | orchestrator | 2026-04-28 04:17:12.923272 | orchestrator | TASK [osism.commons.facts : Create custom facts directory] ********************* 2026-04-28 04:17:12.923280 | orchestrator | Tuesday 28 April 2026 04:17:03 +0000 (0:00:00.341) 0:00:00.341 ********* 2026-04-28 04:17:12.923287 | orchestrator | ok: [testbed-manager] 2026-04-28 04:17:12.923294 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:17:12.923300 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:17:12.923306 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:17:12.923313 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:17:12.923319 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:17:12.923350 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:17:12.923357 | orchestrator | 2026-04-28 04:17:12.923363 | orchestrator | TASK [osism.commons.facts : Copy fact files] *********************************** 2026-04-28 04:17:12.923369 | orchestrator | Tuesday 28 April 2026 04:17:04 +0000 (0:00:01.298) 0:00:01.640 ********* 2026-04-28 04:17:12.923375 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:17:12.923382 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:17:12.923389 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:17:12.923394 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:17:12.923400 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:17:12.923407 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:17:12.923413 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:17:12.923420 | orchestrator | 2026-04-28 04:17:12.923426 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-28 04:17:12.923432 | orchestrator | 2026-04-28 04:17:12.923438 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-28 04:17:12.923444 | orchestrator | Tuesday 28 April 2026 04:17:05 +0000 (0:00:01.530) 0:00:03.170 ********* 2026-04-28 04:17:12.923450 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:17:12.923457 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:17:12.923462 | orchestrator | ok: [testbed-manager] 2026-04-28 04:17:12.923469 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:17:12.923474 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:17:12.923480 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:17:12.923487 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:17:12.923493 | orchestrator | 2026-04-28 04:17:12.923499 | orchestrator | PLAY [Gather facts for all hosts if using --limit] ***************************** 2026-04-28 04:17:12.923505 | orchestrator | 2026-04-28 04:17:12.923511 | orchestrator | TASK [Gather facts for all hosts] ********************************************** 2026-04-28 04:17:12.923518 | orchestrator | Tuesday 28 April 2026 04:17:11 +0000 (0:00:05.751) 0:00:08.921 ********* 2026-04-28 04:17:12.923524 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:17:12.923530 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:17:12.923536 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:17:12.923543 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:17:12.923549 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:17:12.923555 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:17:12.923561 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:17:12.923567 | orchestrator | 2026-04-28 04:17:12.923573 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:17:12.923580 | orchestrator | testbed-manager : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 04:17:12.923587 | orchestrator | testbed-node-0 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 04:17:12.923592 | orchestrator | testbed-node-1 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 04:17:12.923599 | orchestrator | testbed-node-2 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 04:17:12.923605 | orchestrator | testbed-node-3 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 04:17:12.923611 | orchestrator | testbed-node-4 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 04:17:12.923615 | orchestrator | testbed-node-5 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 04:17:12.923619 | orchestrator | 2026-04-28 04:17:12.923622 | orchestrator | 2026-04-28 04:17:12.923626 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 04:17:12.923630 | orchestrator | Tuesday 28 April 2026 04:17:12 +0000 (0:00:00.655) 0:00:09.577 ********* 2026-04-28 04:17:12.923638 | orchestrator | =============================================================================== 2026-04-28 04:17:12.923641 | orchestrator | Gathers facts about hosts ----------------------------------------------- 5.75s 2026-04-28 04:17:12.923645 | orchestrator | osism.commons.facts : Copy fact files ----------------------------------- 1.53s 2026-04-28 04:17:12.923649 | orchestrator | osism.commons.facts : Create custom facts directory --------------------- 1.30s 2026-04-28 04:17:12.923653 | orchestrator | Gather facts for all hosts ---------------------------------------------- 0.66s 2026-04-28 04:17:13.285260 | orchestrator | + osism validate ceph-mons 2026-04-28 04:17:48.269249 | orchestrator | 2026-04-28 04:17:48.269371 | orchestrator | PLAY [Ceph validate mons] ****************************************************** 2026-04-28 04:17:48.269385 | orchestrator | 2026-04-28 04:17:48.269394 | orchestrator | TASK [Get timestamp for report file] ******************************************* 2026-04-28 04:17:48.269422 | orchestrator | Tuesday 28 April 2026 04:17:31 +0000 (0:00:00.520) 0:00:00.520 ********* 2026-04-28 04:17:48.269439 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 04:17:48.269449 | orchestrator | 2026-04-28 04:17:48.269459 | orchestrator | TASK [Create report output directory] ****************************************** 2026-04-28 04:17:48.269469 | orchestrator | Tuesday 28 April 2026 04:17:31 +0000 (0:00:00.915) 0:00:01.435 ********* 2026-04-28 04:17:48.269479 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 04:17:48.269488 | orchestrator | 2026-04-28 04:17:48.269498 | orchestrator | TASK [Define report vars] ****************************************************** 2026-04-28 04:17:48.269508 | orchestrator | Tuesday 28 April 2026 04:17:33 +0000 (0:00:01.109) 0:00:02.545 ********* 2026-04-28 04:17:48.269517 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:17:48.269527 | orchestrator | 2026-04-28 04:17:48.269536 | orchestrator | TASK [Prepare test data for container existance test] ************************** 2026-04-28 04:17:48.269546 | orchestrator | Tuesday 28 April 2026 04:17:33 +0000 (0:00:00.123) 0:00:02.669 ********* 2026-04-28 04:17:48.269555 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:17:48.269564 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:17:48.269572 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:17:48.269581 | orchestrator | 2026-04-28 04:17:48.269590 | orchestrator | TASK [Get container info] ****************************************************** 2026-04-28 04:17:48.269599 | orchestrator | Tuesday 28 April 2026 04:17:33 +0000 (0:00:00.317) 0:00:02.986 ********* 2026-04-28 04:17:48.269609 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:17:48.269618 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:17:48.269627 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:17:48.269636 | orchestrator | 2026-04-28 04:17:48.269646 | orchestrator | TASK [Set test result to failed if container is missing] *********************** 2026-04-28 04:17:48.269655 | orchestrator | Tuesday 28 April 2026 04:17:34 +0000 (0:00:01.087) 0:00:04.073 ********* 2026-04-28 04:17:48.269665 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:17:48.269674 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:17:48.269684 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:17:48.269693 | orchestrator | 2026-04-28 04:17:48.269703 | orchestrator | TASK [Set test result to passed if container is existing] ********************** 2026-04-28 04:17:48.269760 | orchestrator | Tuesday 28 April 2026 04:17:34 +0000 (0:00:00.372) 0:00:04.446 ********* 2026-04-28 04:17:48.269772 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:17:48.269783 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:17:48.269792 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:17:48.269801 | orchestrator | 2026-04-28 04:17:48.269811 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-28 04:17:48.269821 | orchestrator | Tuesday 28 April 2026 04:17:35 +0000 (0:00:00.593) 0:00:05.040 ********* 2026-04-28 04:17:48.269831 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:17:48.269841 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:17:48.269851 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:17:48.269860 | orchestrator | 2026-04-28 04:17:48.269894 | orchestrator | TASK [Set test result to failed if ceph-mon is not running] ******************** 2026-04-28 04:17:48.269925 | orchestrator | Tuesday 28 April 2026 04:17:35 +0000 (0:00:00.360) 0:00:05.400 ********* 2026-04-28 04:17:48.269934 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:17:48.269943 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:17:48.269952 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:17:48.269962 | orchestrator | 2026-04-28 04:17:48.269971 | orchestrator | TASK [Set test result to passed if ceph-mon is running] ************************ 2026-04-28 04:17:48.269980 | orchestrator | Tuesday 28 April 2026 04:17:36 +0000 (0:00:00.370) 0:00:05.771 ********* 2026-04-28 04:17:48.269989 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:17:48.269999 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:17:48.270008 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:17:48.270064 | orchestrator | 2026-04-28 04:17:48.270083 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-28 04:17:48.270094 | orchestrator | Tuesday 28 April 2026 04:17:36 +0000 (0:00:00.563) 0:00:06.335 ********* 2026-04-28 04:17:48.270103 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:17:48.270112 | orchestrator | 2026-04-28 04:17:48.270121 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-28 04:17:48.270130 | orchestrator | Tuesday 28 April 2026 04:17:37 +0000 (0:00:00.290) 0:00:06.625 ********* 2026-04-28 04:17:48.270138 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:17:48.270149 | orchestrator | 2026-04-28 04:17:48.270159 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-28 04:17:48.270169 | orchestrator | Tuesday 28 April 2026 04:17:37 +0000 (0:00:00.317) 0:00:06.942 ********* 2026-04-28 04:17:48.270178 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:17:48.270188 | orchestrator | 2026-04-28 04:17:48.270198 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 04:17:48.270208 | orchestrator | Tuesday 28 April 2026 04:17:37 +0000 (0:00:00.294) 0:00:07.237 ********* 2026-04-28 04:17:48.270217 | orchestrator | 2026-04-28 04:17:48.270226 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 04:17:48.270234 | orchestrator | Tuesday 28 April 2026 04:17:37 +0000 (0:00:00.085) 0:00:07.322 ********* 2026-04-28 04:17:48.270243 | orchestrator | 2026-04-28 04:17:48.270252 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 04:17:48.270261 | orchestrator | Tuesday 28 April 2026 04:17:37 +0000 (0:00:00.093) 0:00:07.415 ********* 2026-04-28 04:17:48.270270 | orchestrator | 2026-04-28 04:17:48.270279 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-28 04:17:48.270289 | orchestrator | Tuesday 28 April 2026 04:17:38 +0000 (0:00:00.087) 0:00:07.502 ********* 2026-04-28 04:17:48.270297 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:17:48.270305 | orchestrator | 2026-04-28 04:17:48.270315 | orchestrator | TASK [Fail due to missing containers] ****************************************** 2026-04-28 04:17:48.270323 | orchestrator | Tuesday 28 April 2026 04:17:38 +0000 (0:00:00.278) 0:00:07.781 ********* 2026-04-28 04:17:48.270333 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:17:48.270342 | orchestrator | 2026-04-28 04:17:48.270373 | orchestrator | TASK [Prepare quorum test vars] ************************************************ 2026-04-28 04:17:48.270382 | orchestrator | Tuesday 28 April 2026 04:17:38 +0000 (0:00:00.258) 0:00:08.040 ********* 2026-04-28 04:17:48.270390 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:17:48.270398 | orchestrator | 2026-04-28 04:17:48.270408 | orchestrator | TASK [Get monmap info from one mon container] ********************************** 2026-04-28 04:17:48.270417 | orchestrator | Tuesday 28 April 2026 04:17:38 +0000 (0:00:00.127) 0:00:08.167 ********* 2026-04-28 04:17:48.270426 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:17:48.270435 | orchestrator | 2026-04-28 04:17:48.270448 | orchestrator | TASK [Set quorum test data] **************************************************** 2026-04-28 04:17:48.270456 | orchestrator | Tuesday 28 April 2026 04:17:40 +0000 (0:00:01.703) 0:00:09.870 ********* 2026-04-28 04:17:48.270464 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:17:48.270472 | orchestrator | 2026-04-28 04:17:48.270491 | orchestrator | TASK [Fail quorum test if not all monitors are in quorum] ********************** 2026-04-28 04:17:48.270500 | orchestrator | Tuesday 28 April 2026 04:17:40 +0000 (0:00:00.612) 0:00:10.483 ********* 2026-04-28 04:17:48.270507 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:17:48.270515 | orchestrator | 2026-04-28 04:17:48.270523 | orchestrator | TASK [Pass quorum test if all monitors are in quorum] ************************** 2026-04-28 04:17:48.270532 | orchestrator | Tuesday 28 April 2026 04:17:41 +0000 (0:00:00.148) 0:00:10.632 ********* 2026-04-28 04:17:48.270541 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:17:48.270549 | orchestrator | 2026-04-28 04:17:48.270557 | orchestrator | TASK [Set fsid test vars] ****************************************************** 2026-04-28 04:17:48.270567 | orchestrator | Tuesday 28 April 2026 04:17:41 +0000 (0:00:00.342) 0:00:10.974 ********* 2026-04-28 04:17:48.270576 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:17:48.270584 | orchestrator | 2026-04-28 04:17:48.270592 | orchestrator | TASK [Fail Cluster FSID test if FSID does not match configuration] ************* 2026-04-28 04:17:48.270601 | orchestrator | Tuesday 28 April 2026 04:17:41 +0000 (0:00:00.326) 0:00:11.301 ********* 2026-04-28 04:17:48.270610 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:17:48.270618 | orchestrator | 2026-04-28 04:17:48.270627 | orchestrator | TASK [Pass Cluster FSID test if it matches configuration] ********************** 2026-04-28 04:17:48.270636 | orchestrator | Tuesday 28 April 2026 04:17:41 +0000 (0:00:00.132) 0:00:11.433 ********* 2026-04-28 04:17:48.270644 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:17:48.270653 | orchestrator | 2026-04-28 04:17:48.270661 | orchestrator | TASK [Prepare status test vars] ************************************************ 2026-04-28 04:17:48.270669 | orchestrator | Tuesday 28 April 2026 04:17:42 +0000 (0:00:00.148) 0:00:11.581 ********* 2026-04-28 04:17:48.270677 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:17:48.270685 | orchestrator | 2026-04-28 04:17:48.270693 | orchestrator | TASK [Gather status data] ****************************************************** 2026-04-28 04:17:48.270701 | orchestrator | Tuesday 28 April 2026 04:17:42 +0000 (0:00:00.113) 0:00:11.695 ********* 2026-04-28 04:17:48.270710 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:17:48.270718 | orchestrator | 2026-04-28 04:17:48.270726 | orchestrator | TASK [Set health test data] **************************************************** 2026-04-28 04:17:48.270735 | orchestrator | Tuesday 28 April 2026 04:17:43 +0000 (0:00:01.396) 0:00:13.091 ********* 2026-04-28 04:17:48.270743 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:17:48.270751 | orchestrator | 2026-04-28 04:17:48.270760 | orchestrator | TASK [Fail cluster-health if health is not acceptable] ************************* 2026-04-28 04:17:48.270770 | orchestrator | Tuesday 28 April 2026 04:17:43 +0000 (0:00:00.387) 0:00:13.479 ********* 2026-04-28 04:17:48.270779 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:17:48.270788 | orchestrator | 2026-04-28 04:17:48.270797 | orchestrator | TASK [Pass cluster-health if health is acceptable] ***************************** 2026-04-28 04:17:48.270804 | orchestrator | Tuesday 28 April 2026 04:17:44 +0000 (0:00:00.149) 0:00:13.628 ********* 2026-04-28 04:17:48.270813 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:17:48.270821 | orchestrator | 2026-04-28 04:17:48.270830 | orchestrator | TASK [Fail cluster-health if health is not acceptable (strict)] **************** 2026-04-28 04:17:48.270845 | orchestrator | Tuesday 28 April 2026 04:17:44 +0000 (0:00:00.175) 0:00:13.803 ********* 2026-04-28 04:17:48.270855 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:17:48.270863 | orchestrator | 2026-04-28 04:17:48.270901 | orchestrator | TASK [Pass cluster-health if status is OK (strict)] **************************** 2026-04-28 04:17:48.270909 | orchestrator | Tuesday 28 April 2026 04:17:44 +0000 (0:00:00.164) 0:00:13.968 ********* 2026-04-28 04:17:48.270916 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:17:48.270924 | orchestrator | 2026-04-28 04:17:48.270932 | orchestrator | TASK [Set validation result to passed if no test failed] *********************** 2026-04-28 04:17:48.270939 | orchestrator | Tuesday 28 April 2026 04:17:44 +0000 (0:00:00.358) 0:00:14.327 ********* 2026-04-28 04:17:48.270948 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 04:17:48.270965 | orchestrator | 2026-04-28 04:17:48.270973 | orchestrator | TASK [Set validation result to failed if a test failed] ************************ 2026-04-28 04:17:48.270980 | orchestrator | Tuesday 28 April 2026 04:17:45 +0000 (0:00:00.282) 0:00:14.610 ********* 2026-04-28 04:17:48.270988 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:17:48.270996 | orchestrator | 2026-04-28 04:17:48.271003 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-28 04:17:48.271011 | orchestrator | Tuesday 28 April 2026 04:17:45 +0000 (0:00:00.275) 0:00:14.885 ********* 2026-04-28 04:17:48.271019 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 04:17:48.271028 | orchestrator | 2026-04-28 04:17:48.271036 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-28 04:17:48.271044 | orchestrator | Tuesday 28 April 2026 04:17:47 +0000 (0:00:01.980) 0:00:16.866 ********* 2026-04-28 04:17:48.271052 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 04:17:48.271060 | orchestrator | 2026-04-28 04:17:48.271068 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-28 04:17:48.271076 | orchestrator | Tuesday 28 April 2026 04:17:47 +0000 (0:00:00.308) 0:00:17.175 ********* 2026-04-28 04:17:48.271085 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 04:17:48.271093 | orchestrator | 2026-04-28 04:17:48.271112 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 04:17:51.307975 | orchestrator | Tuesday 28 April 2026 04:17:48 +0000 (0:00:00.330) 0:00:17.505 ********* 2026-04-28 04:17:51.308046 | orchestrator | 2026-04-28 04:17:51.308052 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 04:17:51.308057 | orchestrator | Tuesday 28 April 2026 04:17:48 +0000 (0:00:00.072) 0:00:17.578 ********* 2026-04-28 04:17:51.308061 | orchestrator | 2026-04-28 04:17:51.308065 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 04:17:51.308070 | orchestrator | Tuesday 28 April 2026 04:17:48 +0000 (0:00:00.076) 0:00:17.654 ********* 2026-04-28 04:17:51.308074 | orchestrator | 2026-04-28 04:17:51.308078 | orchestrator | RUNNING HANDLER [Write report file] ******************************************** 2026-04-28 04:17:51.308082 | orchestrator | Tuesday 28 April 2026 04:17:48 +0000 (0:00:00.091) 0:00:17.746 ********* 2026-04-28 04:17:51.308087 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 04:17:51.308091 | orchestrator | 2026-04-28 04:17:51.308095 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-28 04:17:51.308099 | orchestrator | Tuesday 28 April 2026 04:17:49 +0000 (0:00:01.685) 0:00:19.431 ********* 2026-04-28 04:17:51.308103 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => { 2026-04-28 04:17:51.308107 | orchestrator |  "msg": [ 2026-04-28 04:17:51.308112 | orchestrator |  "Validator run completed.", 2026-04-28 04:17:51.308116 | orchestrator |  "You can find the report file here:", 2026-04-28 04:17:51.308120 | orchestrator |  "/opt/reports/validator/ceph-mons-validator-2026-04-28T04:17:31+00:00-report.json", 2026-04-28 04:17:51.308125 | orchestrator |  "on the following host:", 2026-04-28 04:17:51.308129 | orchestrator |  "testbed-manager" 2026-04-28 04:17:51.308133 | orchestrator |  ] 2026-04-28 04:17:51.308137 | orchestrator | } 2026-04-28 04:17:51.308142 | orchestrator | 2026-04-28 04:17:51.308145 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:17:51.308151 | orchestrator | testbed-node-0 : ok=24  changed=5  unreachable=0 failed=0 skipped=13  rescued=0 ignored=0 2026-04-28 04:17:51.308156 | orchestrator | testbed-node-1 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 04:17:51.308161 | orchestrator | testbed-node-2 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 04:17:51.308164 | orchestrator | 2026-04-28 04:17:51.308192 | orchestrator | 2026-04-28 04:17:51.308199 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 04:17:51.308205 | orchestrator | Tuesday 28 April 2026 04:17:50 +0000 (0:00:00.954) 0:00:20.386 ********* 2026-04-28 04:17:51.308210 | orchestrator | =============================================================================== 2026-04-28 04:17:51.308216 | orchestrator | Aggregate test results step one ----------------------------------------- 1.98s 2026-04-28 04:17:51.308221 | orchestrator | Get monmap info from one mon container ---------------------------------- 1.70s 2026-04-28 04:17:51.308230 | orchestrator | Write report file ------------------------------------------------------- 1.69s 2026-04-28 04:17:51.308238 | orchestrator | Gather status data ------------------------------------------------------ 1.40s 2026-04-28 04:17:51.308244 | orchestrator | Create report output directory ------------------------------------------ 1.11s 2026-04-28 04:17:51.308250 | orchestrator | Get container info ------------------------------------------------------ 1.09s 2026-04-28 04:17:51.308256 | orchestrator | Print report file information ------------------------------------------- 0.95s 2026-04-28 04:17:51.308262 | orchestrator | Get timestamp for report file ------------------------------------------- 0.92s 2026-04-28 04:17:51.308268 | orchestrator | Set quorum test data ---------------------------------------------------- 0.61s 2026-04-28 04:17:51.308274 | orchestrator | Set test result to passed if container is existing ---------------------- 0.59s 2026-04-28 04:17:51.308280 | orchestrator | Set test result to passed if ceph-mon is running ------------------------ 0.56s 2026-04-28 04:17:51.308287 | orchestrator | Set health test data ---------------------------------------------------- 0.39s 2026-04-28 04:17:51.308293 | orchestrator | Set test result to failed if container is missing ----------------------- 0.37s 2026-04-28 04:17:51.308299 | orchestrator | Set test result to failed if ceph-mon is not running -------------------- 0.37s 2026-04-28 04:17:51.308305 | orchestrator | Prepare test data ------------------------------------------------------- 0.36s 2026-04-28 04:17:51.308312 | orchestrator | Pass cluster-health if status is OK (strict) ---------------------------- 0.36s 2026-04-28 04:17:51.308318 | orchestrator | Pass quorum test if all monitors are in quorum -------------------------- 0.34s 2026-04-28 04:17:51.308324 | orchestrator | Aggregate test results step three --------------------------------------- 0.33s 2026-04-28 04:17:51.308331 | orchestrator | Set fsid test vars ------------------------------------------------------ 0.33s 2026-04-28 04:17:51.308337 | orchestrator | Aggregate test results step two ----------------------------------------- 0.32s 2026-04-28 04:17:51.727236 | orchestrator | + osism validate ceph-mgrs 2026-04-28 04:18:23.972358 | orchestrator | 2026-04-28 04:18:23.972473 | orchestrator | PLAY [Ceph validate mgrs] ****************************************************** 2026-04-28 04:18:23.972492 | orchestrator | 2026-04-28 04:18:23.972501 | orchestrator | TASK [Get timestamp for report file] ******************************************* 2026-04-28 04:18:23.972512 | orchestrator | Tuesday 28 April 2026 04:18:09 +0000 (0:00:00.441) 0:00:00.441 ********* 2026-04-28 04:18:23.972521 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 04:18:23.972531 | orchestrator | 2026-04-28 04:18:23.972539 | orchestrator | TASK [Create report output directory] ****************************************** 2026-04-28 04:18:23.972549 | orchestrator | Tuesday 28 April 2026 04:18:09 +0000 (0:00:00.752) 0:00:01.193 ********* 2026-04-28 04:18:23.972580 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 04:18:23.972596 | orchestrator | 2026-04-28 04:18:23.972606 | orchestrator | TASK [Define report vars] ****************************************************** 2026-04-28 04:18:23.972615 | orchestrator | Tuesday 28 April 2026 04:18:10 +0000 (0:00:01.022) 0:00:02.216 ********* 2026-04-28 04:18:23.972624 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:18:23.972636 | orchestrator | 2026-04-28 04:18:23.972653 | orchestrator | TASK [Prepare test data for container existance test] ************************** 2026-04-28 04:18:23.972664 | orchestrator | Tuesday 28 April 2026 04:18:10 +0000 (0:00:00.123) 0:00:02.340 ********* 2026-04-28 04:18:23.972672 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:18:23.972681 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:18:23.972710 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:18:23.972720 | orchestrator | 2026-04-28 04:18:23.972728 | orchestrator | TASK [Get container info] ****************************************************** 2026-04-28 04:18:23.972737 | orchestrator | Tuesday 28 April 2026 04:18:11 +0000 (0:00:00.278) 0:00:02.618 ********* 2026-04-28 04:18:23.972746 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:18:23.972754 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:18:23.972763 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:18:23.972771 | orchestrator | 2026-04-28 04:18:23.972780 | orchestrator | TASK [Set test result to failed if container is missing] *********************** 2026-04-28 04:18:23.972789 | orchestrator | Tuesday 28 April 2026 04:18:12 +0000 (0:00:01.019) 0:00:03.638 ********* 2026-04-28 04:18:23.972798 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:18:23.972806 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:18:23.972815 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:18:23.972823 | orchestrator | 2026-04-28 04:18:23.972832 | orchestrator | TASK [Set test result to passed if container is existing] ********************** 2026-04-28 04:18:23.972841 | orchestrator | Tuesday 28 April 2026 04:18:12 +0000 (0:00:00.275) 0:00:03.914 ********* 2026-04-28 04:18:23.972849 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:18:23.972858 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:18:23.972941 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:18:23.972958 | orchestrator | 2026-04-28 04:18:23.972973 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-28 04:18:23.972987 | orchestrator | Tuesday 28 April 2026 04:18:12 +0000 (0:00:00.444) 0:00:04.359 ********* 2026-04-28 04:18:23.973001 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:18:23.973015 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:18:23.973030 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:18:23.973046 | orchestrator | 2026-04-28 04:18:23.973060 | orchestrator | TASK [Set test result to failed if ceph-mgr is not running] ******************** 2026-04-28 04:18:23.973075 | orchestrator | Tuesday 28 April 2026 04:18:13 +0000 (0:00:00.307) 0:00:04.666 ********* 2026-04-28 04:18:23.973091 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:18:23.973105 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:18:23.973121 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:18:23.973137 | orchestrator | 2026-04-28 04:18:23.973151 | orchestrator | TASK [Set test result to passed if ceph-mgr is running] ************************ 2026-04-28 04:18:23.973162 | orchestrator | Tuesday 28 April 2026 04:18:13 +0000 (0:00:00.274) 0:00:04.940 ********* 2026-04-28 04:18:23.973172 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:18:23.973182 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:18:23.973191 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:18:23.973201 | orchestrator | 2026-04-28 04:18:23.973211 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-28 04:18:23.973221 | orchestrator | Tuesday 28 April 2026 04:18:14 +0000 (0:00:00.445) 0:00:05.386 ********* 2026-04-28 04:18:23.973232 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:18:23.973244 | orchestrator | 2026-04-28 04:18:23.973260 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-28 04:18:23.973274 | orchestrator | Tuesday 28 April 2026 04:18:14 +0000 (0:00:00.241) 0:00:05.628 ********* 2026-04-28 04:18:23.973283 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:18:23.973291 | orchestrator | 2026-04-28 04:18:23.973300 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-28 04:18:23.973317 | orchestrator | Tuesday 28 April 2026 04:18:14 +0000 (0:00:00.263) 0:00:05.892 ********* 2026-04-28 04:18:23.973326 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:18:23.973335 | orchestrator | 2026-04-28 04:18:23.973344 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 04:18:23.973352 | orchestrator | Tuesday 28 April 2026 04:18:14 +0000 (0:00:00.248) 0:00:06.141 ********* 2026-04-28 04:18:23.973361 | orchestrator | 2026-04-28 04:18:23.973369 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 04:18:23.973378 | orchestrator | Tuesday 28 April 2026 04:18:14 +0000 (0:00:00.095) 0:00:06.236 ********* 2026-04-28 04:18:23.973396 | orchestrator | 2026-04-28 04:18:23.973405 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 04:18:23.973413 | orchestrator | Tuesday 28 April 2026 04:18:14 +0000 (0:00:00.086) 0:00:06.323 ********* 2026-04-28 04:18:23.973422 | orchestrator | 2026-04-28 04:18:23.973430 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-28 04:18:23.973439 | orchestrator | Tuesday 28 April 2026 04:18:15 +0000 (0:00:00.104) 0:00:06.428 ********* 2026-04-28 04:18:23.973448 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:18:23.973456 | orchestrator | 2026-04-28 04:18:23.973465 | orchestrator | TASK [Fail due to missing containers] ****************************************** 2026-04-28 04:18:23.973474 | orchestrator | Tuesday 28 April 2026 04:18:15 +0000 (0:00:00.308) 0:00:06.737 ********* 2026-04-28 04:18:23.973482 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:18:23.973491 | orchestrator | 2026-04-28 04:18:23.973518 | orchestrator | TASK [Define mgr module test vars] ********************************************* 2026-04-28 04:18:23.973528 | orchestrator | Tuesday 28 April 2026 04:18:15 +0000 (0:00:00.244) 0:00:06.982 ********* 2026-04-28 04:18:23.973537 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:18:23.973545 | orchestrator | 2026-04-28 04:18:23.973554 | orchestrator | TASK [Gather list of mgr modules] ********************************************** 2026-04-28 04:18:23.973563 | orchestrator | Tuesday 28 April 2026 04:18:15 +0000 (0:00:00.132) 0:00:07.114 ********* 2026-04-28 04:18:23.973572 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:18:23.973581 | orchestrator | 2026-04-28 04:18:23.973589 | orchestrator | TASK [Parse mgr module list from json] ***************************************** 2026-04-28 04:18:23.973598 | orchestrator | Tuesday 28 April 2026 04:18:17 +0000 (0:00:02.056) 0:00:09.170 ********* 2026-04-28 04:18:23.973606 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:18:23.973615 | orchestrator | 2026-04-28 04:18:23.973624 | orchestrator | TASK [Extract list of enabled mgr modules] ************************************* 2026-04-28 04:18:23.973632 | orchestrator | Tuesday 28 April 2026 04:18:18 +0000 (0:00:00.518) 0:00:09.689 ********* 2026-04-28 04:18:23.973641 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:18:23.973650 | orchestrator | 2026-04-28 04:18:23.973658 | orchestrator | TASK [Fail test if mgr modules are disabled that should be enabled] ************ 2026-04-28 04:18:23.973667 | orchestrator | Tuesday 28 April 2026 04:18:18 +0000 (0:00:00.360) 0:00:10.050 ********* 2026-04-28 04:18:23.973676 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:18:23.973684 | orchestrator | 2026-04-28 04:18:23.973693 | orchestrator | TASK [Pass test if required mgr modules are enabled] *************************** 2026-04-28 04:18:23.973702 | orchestrator | Tuesday 28 April 2026 04:18:18 +0000 (0:00:00.171) 0:00:10.222 ********* 2026-04-28 04:18:23.973710 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:18:23.973719 | orchestrator | 2026-04-28 04:18:23.973727 | orchestrator | TASK [Set validation result to passed if no test failed] *********************** 2026-04-28 04:18:23.973736 | orchestrator | Tuesday 28 April 2026 04:18:19 +0000 (0:00:00.160) 0:00:10.382 ********* 2026-04-28 04:18:23.973745 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 04:18:23.973753 | orchestrator | 2026-04-28 04:18:23.973762 | orchestrator | TASK [Set validation result to failed if a test failed] ************************ 2026-04-28 04:18:23.973771 | orchestrator | Tuesday 28 April 2026 04:18:19 +0000 (0:00:00.314) 0:00:10.697 ********* 2026-04-28 04:18:23.973780 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:18:23.973788 | orchestrator | 2026-04-28 04:18:23.973797 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-28 04:18:23.973806 | orchestrator | Tuesday 28 April 2026 04:18:19 +0000 (0:00:00.267) 0:00:10.965 ********* 2026-04-28 04:18:23.973814 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 04:18:23.973823 | orchestrator | 2026-04-28 04:18:23.973831 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-28 04:18:23.973840 | orchestrator | Tuesday 28 April 2026 04:18:21 +0000 (0:00:01.470) 0:00:12.436 ********* 2026-04-28 04:18:23.973849 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 04:18:23.973886 | orchestrator | 2026-04-28 04:18:23.973896 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-28 04:18:23.973905 | orchestrator | Tuesday 28 April 2026 04:18:21 +0000 (0:00:00.265) 0:00:12.701 ********* 2026-04-28 04:18:23.973914 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 04:18:23.973923 | orchestrator | 2026-04-28 04:18:23.973931 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 04:18:23.973940 | orchestrator | Tuesday 28 April 2026 04:18:21 +0000 (0:00:00.270) 0:00:12.972 ********* 2026-04-28 04:18:23.973948 | orchestrator | 2026-04-28 04:18:23.973957 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 04:18:23.973966 | orchestrator | Tuesday 28 April 2026 04:18:21 +0000 (0:00:00.079) 0:00:13.051 ********* 2026-04-28 04:18:23.973974 | orchestrator | 2026-04-28 04:18:23.973983 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 04:18:23.973992 | orchestrator | Tuesday 28 April 2026 04:18:21 +0000 (0:00:00.075) 0:00:13.127 ********* 2026-04-28 04:18:23.974000 | orchestrator | 2026-04-28 04:18:23.974012 | orchestrator | RUNNING HANDLER [Write report file] ******************************************** 2026-04-28 04:18:23.974110 | orchestrator | Tuesday 28 April 2026 04:18:22 +0000 (0:00:00.329) 0:00:13.457 ********* 2026-04-28 04:18:23.974126 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 04:18:23.974135 | orchestrator | 2026-04-28 04:18:23.974150 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-28 04:18:23.974160 | orchestrator | Tuesday 28 April 2026 04:18:23 +0000 (0:00:01.410) 0:00:14.867 ********* 2026-04-28 04:18:23.974168 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => { 2026-04-28 04:18:23.974177 | orchestrator |  "msg": [ 2026-04-28 04:18:23.974186 | orchestrator |  "Validator run completed.", 2026-04-28 04:18:23.974195 | orchestrator |  "You can find the report file here:", 2026-04-28 04:18:23.974204 | orchestrator |  "/opt/reports/validator/ceph-mgrs-validator-2026-04-28T04:18:09+00:00-report.json", 2026-04-28 04:18:23.974215 | orchestrator |  "on the following host:", 2026-04-28 04:18:23.974223 | orchestrator |  "testbed-manager" 2026-04-28 04:18:23.974232 | orchestrator |  ] 2026-04-28 04:18:23.974241 | orchestrator | } 2026-04-28 04:18:23.974249 | orchestrator | 2026-04-28 04:18:23.974258 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:18:23.974268 | orchestrator | testbed-node-0 : ok=19  changed=3  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-28 04:18:23.974278 | orchestrator | testbed-node-1 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 04:18:23.974296 | orchestrator | testbed-node-2 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 04:18:24.424302 | orchestrator | 2026-04-28 04:18:24.424404 | orchestrator | 2026-04-28 04:18:24.424419 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 04:18:24.424430 | orchestrator | Tuesday 28 April 2026 04:18:23 +0000 (0:00:00.466) 0:00:15.334 ********* 2026-04-28 04:18:24.424452 | orchestrator | =============================================================================== 2026-04-28 04:18:24.424469 | orchestrator | Gather list of mgr modules ---------------------------------------------- 2.06s 2026-04-28 04:18:24.424477 | orchestrator | Aggregate test results step one ----------------------------------------- 1.47s 2026-04-28 04:18:24.424484 | orchestrator | Write report file ------------------------------------------------------- 1.41s 2026-04-28 04:18:24.424492 | orchestrator | Create report output directory ------------------------------------------ 1.02s 2026-04-28 04:18:24.424500 | orchestrator | Get container info ------------------------------------------------------ 1.02s 2026-04-28 04:18:24.424508 | orchestrator | Get timestamp for report file ------------------------------------------- 0.75s 2026-04-28 04:18:24.424542 | orchestrator | Parse mgr module list from json ----------------------------------------- 0.52s 2026-04-28 04:18:24.424550 | orchestrator | Flush handlers ---------------------------------------------------------- 0.48s 2026-04-28 04:18:24.424559 | orchestrator | Print report file information ------------------------------------------- 0.47s 2026-04-28 04:18:24.424567 | orchestrator | Set test result to passed if ceph-mgr is running ------------------------ 0.45s 2026-04-28 04:18:24.424574 | orchestrator | Set test result to passed if container is existing ---------------------- 0.44s 2026-04-28 04:18:24.424582 | orchestrator | Extract list of enabled mgr modules ------------------------------------- 0.36s 2026-04-28 04:18:24.424591 | orchestrator | Set validation result to passed if no test failed ----------------------- 0.32s 2026-04-28 04:18:24.424598 | orchestrator | Print report file information ------------------------------------------- 0.31s 2026-04-28 04:18:24.424607 | orchestrator | Prepare test data ------------------------------------------------------- 0.31s 2026-04-28 04:18:24.424614 | orchestrator | Flush handlers ---------------------------------------------------------- 0.29s 2026-04-28 04:18:24.424622 | orchestrator | Prepare test data for container existance test -------------------------- 0.28s 2026-04-28 04:18:24.424628 | orchestrator | Set test result to failed if container is missing ----------------------- 0.28s 2026-04-28 04:18:24.424635 | orchestrator | Set test result to failed if ceph-mgr is not running -------------------- 0.27s 2026-04-28 04:18:24.424642 | orchestrator | Aggregate test results step three --------------------------------------- 0.27s 2026-04-28 04:18:24.804313 | orchestrator | + osism validate ceph-osds 2026-04-28 04:18:47.609536 | orchestrator | 2026-04-28 04:18:47.609614 | orchestrator | PLAY [Ceph validate OSDs] ****************************************************** 2026-04-28 04:18:47.609621 | orchestrator | 2026-04-28 04:18:47.609625 | orchestrator | TASK [Get timestamp for report file] ******************************************* 2026-04-28 04:18:47.609630 | orchestrator | Tuesday 28 April 2026 04:18:42 +0000 (0:00:00.485) 0:00:00.485 ********* 2026-04-28 04:18:47.609635 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-28 04:18:47.609639 | orchestrator | 2026-04-28 04:18:47.609643 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-28 04:18:47.609647 | orchestrator | Tuesday 28 April 2026 04:18:43 +0000 (0:00:00.989) 0:00:01.475 ********* 2026-04-28 04:18:47.609651 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-28 04:18:47.609655 | orchestrator | 2026-04-28 04:18:47.609658 | orchestrator | TASK [Create report output directory] ****************************************** 2026-04-28 04:18:47.609662 | orchestrator | Tuesday 28 April 2026 04:18:44 +0000 (0:00:00.606) 0:00:02.082 ********* 2026-04-28 04:18:47.609666 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-28 04:18:47.609669 | orchestrator | 2026-04-28 04:18:47.609673 | orchestrator | TASK [Define report vars] ****************************************************** 2026-04-28 04:18:47.609677 | orchestrator | Tuesday 28 April 2026 04:18:44 +0000 (0:00:00.770) 0:00:02.852 ********* 2026-04-28 04:18:47.609681 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:18:47.609686 | orchestrator | 2026-04-28 04:18:47.609690 | orchestrator | TASK [Define OSD test variables] *********************************************** 2026-04-28 04:18:47.609694 | orchestrator | Tuesday 28 April 2026 04:18:45 +0000 (0:00:00.181) 0:00:03.033 ********* 2026-04-28 04:18:47.609698 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:18:47.609702 | orchestrator | 2026-04-28 04:18:47.609706 | orchestrator | TASK [Calculate OSD devices for each host] ************************************* 2026-04-28 04:18:47.609710 | orchestrator | Tuesday 28 April 2026 04:18:45 +0000 (0:00:00.148) 0:00:03.182 ********* 2026-04-28 04:18:47.609713 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:18:47.609717 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:18:47.609721 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:18:47.609725 | orchestrator | 2026-04-28 04:18:47.609729 | orchestrator | TASK [Define OSD test variables] *********************************************** 2026-04-28 04:18:47.609733 | orchestrator | Tuesday 28 April 2026 04:18:45 +0000 (0:00:00.376) 0:00:03.558 ********* 2026-04-28 04:18:47.609754 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:18:47.609757 | orchestrator | 2026-04-28 04:18:47.609761 | orchestrator | TASK [Calculate OSD devices for each host] ************************************* 2026-04-28 04:18:47.609766 | orchestrator | Tuesday 28 April 2026 04:18:45 +0000 (0:00:00.160) 0:00:03.719 ********* 2026-04-28 04:18:47.609772 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:18:47.609777 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:18:47.609785 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:18:47.609794 | orchestrator | 2026-04-28 04:18:47.609800 | orchestrator | TASK [Calculate total number of OSDs in cluster] ******************************* 2026-04-28 04:18:47.609808 | orchestrator | Tuesday 28 April 2026 04:18:46 +0000 (0:00:00.371) 0:00:04.091 ********* 2026-04-28 04:18:47.609814 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:18:47.609820 | orchestrator | 2026-04-28 04:18:47.609826 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-28 04:18:47.609832 | orchestrator | Tuesday 28 April 2026 04:18:46 +0000 (0:00:00.836) 0:00:04.928 ********* 2026-04-28 04:18:47.609839 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:18:47.609844 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:18:47.609850 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:18:47.609855 | orchestrator | 2026-04-28 04:18:47.609904 | orchestrator | TASK [Get list of ceph-osd containers on host] ********************************* 2026-04-28 04:18:47.609910 | orchestrator | Tuesday 28 April 2026 04:18:47 +0000 (0:00:00.340) 0:00:05.268 ********* 2026-04-28 04:18:47.609918 | orchestrator | skipping: [testbed-node-3] => (item={'id': '4086ca03abc84eca5983f45efc3f46fc39c4ffde4828378e0705f51598b3d08f', 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'name': '/prometheus_libvirt_exporter', 'state': 'running', 'status': 'Up 10 minutes'})  2026-04-28 04:18:47.609928 | orchestrator | skipping: [testbed-node-3] => (item={'id': '0b9ab54d1f62a7578b9c88901c7be2ec92a2b6a1b49484ecec626c2e097c3d8e', 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'name': '/prometheus_cadvisor', 'state': 'running', 'status': 'Up 11 minutes'})  2026-04-28 04:18:47.609936 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'ff389ae0840278df75a50b2358c59f0b6ceecf2b35103c5b1245b6cb4544925e', 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'name': '/prometheus_node_exporter', 'state': 'running', 'status': 'Up 11 minutes'})  2026-04-28 04:18:47.609942 | orchestrator | skipping: [testbed-node-3] => (item={'id': '67e8926e3b4c80c25c83193bd9370a5413dddd323e9b8f813baf7615980fc2b9', 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'name': '/ceilometer_compute', 'state': 'running', 'status': 'Up 21 minutes (unhealthy)'})  2026-04-28 04:18:47.609949 | orchestrator | skipping: [testbed-node-3] => (item={'id': '23640538d127905d1ea580d2fc53099e594df4b6c208a055fa1b9ad18a937481', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'name': '/nova_compute', 'state': 'running', 'status': 'Up 42 minutes (healthy)'})  2026-04-28 04:18:47.610046 | orchestrator | skipping: [testbed-node-3] => (item={'id': '324ccfffa500326da1a8b4853a5d5ed0beba63f33e542f96fe6d8f14a62eeb7d', 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'name': '/nova_libvirt', 'state': 'running', 'status': 'Up 43 minutes (healthy)'})  2026-04-28 04:18:47.610059 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'bc61b0b38b49aa4162f341e5a1fa33657c6b043a660b49bb594ac79e8d1876f6', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'name': '/nova_ssh', 'state': 'running', 'status': 'Up 44 minutes (healthy)'})  2026-04-28 04:18:47.610063 | orchestrator | skipping: [testbed-node-3] => (item={'id': '3d61ebcc94ebfbf4b673e7552a911e3a1fc5221770e0376725a5c296973c4187', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'name': '/neutron_ovn_metadata_agent', 'state': 'running', 'status': 'Up 50 minutes (healthy)'})  2026-04-28 04:18:47.610074 | orchestrator | skipping: [testbed-node-3] => (item={'id': '95fc1db0224e7d5a8bee751df83c12eab1edb0ec514f7c9093c004b7be16d955', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-rgw-default-testbed-node-3-rgw0', 'state': 'running', 'status': 'Up About an hour'})  2026-04-28 04:18:47.610085 | orchestrator | skipping: [testbed-node-3] => (item={'id': '46d246d5b8b9b55959b02c19b702b7091ffcb83efba4cfbb454259dff275f323', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-mds-testbed-node-3', 'state': 'running', 'status': 'Up About an hour'})  2026-04-28 04:18:47.610093 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'fb305f4dbd6912a2361e11d929bf0414d6aaa43a031d9c9b4f75d102e5f4a3e6', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-crash-testbed-node-3', 'state': 'running', 'status': 'Up About an hour'})  2026-04-28 04:18:47.610101 | orchestrator | ok: [testbed-node-3] => (item={'id': '51fe79c8a6c32d418ea8662a014593a28e041c70f4bf8effa4387f05ba809bc7', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-0', 'state': 'running', 'status': 'Up About an hour'}) 2026-04-28 04:18:47.610108 | orchestrator | ok: [testbed-node-3] => (item={'id': '8e2f444b947d675f9e8e1141cffd9b180129ef5abee2f074c1547b9517de8c7e', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-3', 'state': 'running', 'status': 'Up About an hour'}) 2026-04-28 04:18:47.610115 | orchestrator | skipping: [testbed-node-3] => (item={'id': '5f8d446915d24ec0a3c8c6fd724389ae9cef80fbfd8ccd0fa5404343b8c143fb', 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'name': '/ovn_controller', 'state': 'running', 'status': 'Up About an hour'})  2026-04-28 04:18:47.610122 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'b7af1feeee89f5e605bc213357925181534f2a481a154679346729d0bb22a2c1', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'name': '/openvswitch_vswitchd', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-28 04:18:47.610128 | orchestrator | skipping: [testbed-node-3] => (item={'id': '057e0498f03650a5fd3ce9509a58bfe53843932ad52a82f69b3a1f6223d35975', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'name': '/openvswitch_db', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-28 04:18:47.610135 | orchestrator | skipping: [testbed-node-3] => (item={'id': '947b387273f3579011248a508c06ef86b4f68a4b0627517dd2a9e7f5455ecb0c', 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'name': '/cron', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-28 04:18:47.610143 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'bed145665d73182d47d7238859d11652ffccd5f626b07cafce7a11872f7d51bb', 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'name': '/kolla_toolbox', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-28 04:18:47.610150 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'afeeed3ce694011ffbc9e2c7be22c29882ade9d078c08f19a064f53145104b1b', 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'name': '/fluentd', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-28 04:18:47.610157 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'a7a6f8db40fa5dbbff6472f8684dad943f7d7591087450320de6bc148d408f67', 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'name': '/prometheus_libvirt_exporter', 'state': 'running', 'status': 'Up 10 minutes'})  2026-04-28 04:18:47.610171 | orchestrator | skipping: [testbed-node-4] => (item={'id': '4b702ee2fbab9f44bd4d7ef76b6ba96332c44e278beeaa8b09f78afa833863c9', 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'name': '/prometheus_cadvisor', 'state': 'running', 'status': 'Up 11 minutes'})  2026-04-28 04:18:47.880039 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'b4c19d40d74d842ebd01517d0f4bf3e55a443874218a63fed39b0a898a2559c1', 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'name': '/prometheus_node_exporter', 'state': 'running', 'status': 'Up 11 minutes'})  2026-04-28 04:18:47.880162 | orchestrator | skipping: [testbed-node-4] => (item={'id': '1fc22b9358517efa02d80a5584e67505198ec31393a7acea18a29f45618c6842', 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'name': '/ceilometer_compute', 'state': 'running', 'status': 'Up 21 minutes (unhealthy)'})  2026-04-28 04:18:47.880174 | orchestrator | skipping: [testbed-node-4] => (item={'id': '56b82175b8bc6e70a16a63a8afbbd69a8ce9728512a0fb1aa282fa2fc53aec22', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'name': '/nova_compute', 'state': 'running', 'status': 'Up 42 minutes (healthy)'})  2026-04-28 04:18:47.880196 | orchestrator | skipping: [testbed-node-4] => (item={'id': '28449b2e083172ebd05e5beb8165483eefbe43327e5285e67735511bac27837c', 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'name': '/nova_libvirt', 'state': 'running', 'status': 'Up 43 minutes (healthy)'})  2026-04-28 04:18:47.880204 | orchestrator | skipping: [testbed-node-4] => (item={'id': '572faffff4df05aadfcc74ed334f7a1e224c95463caa3c3f9ae3374a6baf4e02', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'name': '/nova_ssh', 'state': 'running', 'status': 'Up 43 minutes (healthy)'})  2026-04-28 04:18:47.880210 | orchestrator | skipping: [testbed-node-4] => (item={'id': '3a139aa37ccf06e61cc168f24a17a09bbb4965cb77b642dd528d7f3ccb8b649c', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'name': '/neutron_ovn_metadata_agent', 'state': 'running', 'status': 'Up 50 minutes (healthy)'})  2026-04-28 04:18:47.880217 | orchestrator | skipping: [testbed-node-4] => (item={'id': '3ecb2ff99c1cccb9189d23cb75b098cd2e42c4d385a41d021bee40c520ebd136', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-rgw-default-testbed-node-4-rgw0', 'state': 'running', 'status': 'Up About an hour'})  2026-04-28 04:18:47.880225 | orchestrator | skipping: [testbed-node-4] => (item={'id': '90578cf9d5cc1dcb8b531cd10a3539d76e762dc921bbaffd04593e5156355b5b', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-mds-testbed-node-4', 'state': 'running', 'status': 'Up About an hour'})  2026-04-28 04:18:47.880233 | orchestrator | skipping: [testbed-node-4] => (item={'id': '8a64d3ac50e2a3045e82e2631d1bd52dccebee3480a2810721f400d4cae69da8', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-crash-testbed-node-4', 'state': 'running', 'status': 'Up About an hour'})  2026-04-28 04:18:47.880243 | orchestrator | ok: [testbed-node-4] => (item={'id': '2c3bc755971c4f3c72539ee4230f2f8af63c63b088dd101ace73bb940d59e2e8', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-4', 'state': 'running', 'status': 'Up About an hour'}) 2026-04-28 04:18:47.880250 | orchestrator | ok: [testbed-node-4] => (item={'id': 'aa38cb513cea0f19fdfed06c7ddafc9a25360eecf83ed5fa5a92e2fdb03f70d8', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-1', 'state': 'running', 'status': 'Up About an hour'}) 2026-04-28 04:18:47.880257 | orchestrator | skipping: [testbed-node-4] => (item={'id': '60d12b1b9de0d23c1e491f3545d64dce3f61ca85fd648a7f20c8817bd173aaa9', 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'name': '/ovn_controller', 'state': 'running', 'status': 'Up About an hour'})  2026-04-28 04:18:47.880264 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'fe3f5df2338d40da395aee4e75021b131ca4aa22546b63d5914c6bf7256c1f17', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'name': '/openvswitch_vswitchd', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-28 04:18:47.880271 | orchestrator | skipping: [testbed-node-4] => (item={'id': '87d143aab933b09a5f3a632bbd17974274fd703fe96e70efc444adbe0ba7171b', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'name': '/openvswitch_db', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-28 04:18:47.880298 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'e9ec6a837dc4fc8d08366627cf2e5a1c95bb825cc229626a03db948bd971a3c5', 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'name': '/cron', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-28 04:18:47.880310 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'ed6f6a94df9502a4642da2dbcb38309d9fbeff612c24d441bbd9bf47cd6706bb', 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'name': '/kolla_toolbox', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-28 04:18:47.880321 | orchestrator | skipping: [testbed-node-4] => (item={'id': '0020ad40b64acea397d673516421f6f333563f09cfbdd012f3f3569a3495e668', 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'name': '/fluentd', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-28 04:18:47.880332 | orchestrator | skipping: [testbed-node-5] => (item={'id': '558f368c259193f5cb908fe3dfc94c1ffc2cbd9deaa34227db0bfb296ba5c073', 'image': 'registry.osism.tech/kolla/release/prometheus-libvirt-exporter:2.2.0.20251130', 'name': '/prometheus_libvirt_exporter', 'state': 'running', 'status': 'Up 10 minutes'})  2026-04-28 04:18:47.880347 | orchestrator | skipping: [testbed-node-5] => (item={'id': '867e49a786c705fc168b63bcba333790d0551862ae6d5bde4b5229b56a318fb1', 'image': 'registry.osism.tech/kolla/release/prometheus-cadvisor:0.49.2.20251130', 'name': '/prometheus_cadvisor', 'state': 'running', 'status': 'Up 11 minutes'})  2026-04-28 04:18:47.880358 | orchestrator | skipping: [testbed-node-5] => (item={'id': '9d9d9e490f062079a421871db584e21fe49afc11d4f0c71c8b8cfabb0b6a2f0e', 'image': 'registry.osism.tech/kolla/release/prometheus-node-exporter:1.8.2.20251130', 'name': '/prometheus_node_exporter', 'state': 'running', 'status': 'Up 11 minutes'})  2026-04-28 04:18:47.880368 | orchestrator | skipping: [testbed-node-5] => (item={'id': '9949840ae8e1e8b2f59789cc6d4607e0bd4d616d507eb27f9518616f26a65c75', 'image': 'registry.osism.tech/kolla/release/ceilometer-compute:23.0.2.20251130', 'name': '/ceilometer_compute', 'state': 'running', 'status': 'Up 21 minutes (unhealthy)'})  2026-04-28 04:18:47.880378 | orchestrator | skipping: [testbed-node-5] => (item={'id': '66b63b27c3b03f78bb10dc2b6d2a9bd763e1105801ce06af65e046c297925a6f', 'image': 'registry.osism.tech/kolla/release/nova-compute:30.2.1.20251130', 'name': '/nova_compute', 'state': 'running', 'status': 'Up 42 minutes (healthy)'})  2026-04-28 04:18:47.880388 | orchestrator | skipping: [testbed-node-5] => (item={'id': '44a1ddd9c96628bb0dd943a33a46fa2772e704625bb94910d487d6409a201802', 'image': 'registry.osism.tech/kolla/release/nova-libvirt:10.0.0.20251130', 'name': '/nova_libvirt', 'state': 'running', 'status': 'Up 43 minutes (healthy)'})  2026-04-28 04:18:47.880399 | orchestrator | skipping: [testbed-node-5] => (item={'id': '9632e09fce4fa2c13175ebcc55dea82b968cb9e79b08a517ac3211405f420b3e', 'image': 'registry.osism.tech/kolla/release/nova-ssh:30.2.1.20251130', 'name': '/nova_ssh', 'state': 'running', 'status': 'Up 44 minutes (healthy)'})  2026-04-28 04:18:47.880409 | orchestrator | skipping: [testbed-node-5] => (item={'id': '2f2e98a82474600c2efbdbc2e262edf3fd957174cb2a3ab8f2ed14b94e3db487', 'image': 'registry.osism.tech/kolla/release/neutron-metadata-agent:25.2.2.20251130', 'name': '/neutron_ovn_metadata_agent', 'state': 'running', 'status': 'Up 50 minutes (healthy)'})  2026-04-28 04:18:47.880419 | orchestrator | skipping: [testbed-node-5] => (item={'id': '2bb9965f28c128606eee73883f2f989dc4a4ed36daba1a9251cfaa88c55590a2', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-rgw-default-testbed-node-5-rgw0', 'state': 'running', 'status': 'Up About an hour'})  2026-04-28 04:18:47.880428 | orchestrator | skipping: [testbed-node-5] => (item={'id': '2b9fa65ce64779568952fa9364166022e5e8b5b3dbadbf4ba1df3ae4eaf3e856', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-mds-testbed-node-5', 'state': 'running', 'status': 'Up About an hour'})  2026-04-28 04:18:47.880439 | orchestrator | skipping: [testbed-node-5] => (item={'id': '7ccff0598549d3f495b7ba97553b64508e567c76540f05f04f651f50457094aa', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-crash-testbed-node-5', 'state': 'running', 'status': 'Up About an hour'})  2026-04-28 04:18:47.880456 | orchestrator | ok: [testbed-node-5] => (item={'id': 'c60cc7de2e2ba535e3553d62923d2493b43fd28297f3065e2a9708caaccb31a6', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-2', 'state': 'running', 'status': 'Up About an hour'}) 2026-04-28 04:18:47.880476 | orchestrator | ok: [testbed-node-5] => (item={'id': '4c93199a2255d36b52b1c0f0acddd4ae6d39e3b5f52d8c8ac1edf789815f28da', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-5', 'state': 'running', 'status': 'Up About an hour'}) 2026-04-28 04:19:00.166176 | orchestrator | skipping: [testbed-node-5] => (item={'id': '1b8cc569142c5290c5e486ec5dfa186d9c29213e206b0ecf0208dbb6a5926dcd', 'image': 'registry.osism.tech/kolla/release/ovn-controller:24.9.3.20251130', 'name': '/ovn_controller', 'state': 'running', 'status': 'Up About an hour'})  2026-04-28 04:19:00.166272 | orchestrator | skipping: [testbed-node-5] => (item={'id': '3314f32657ccd97ffaeb2af67cb50a087fde2e89036e36bc6b4123b894873c60', 'image': 'registry.osism.tech/kolla/release/openvswitch-vswitchd:3.4.3.20251130', 'name': '/openvswitch_vswitchd', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-28 04:19:00.166287 | orchestrator | skipping: [testbed-node-5] => (item={'id': '1e078ea2a5a470353ddbd76ad2d166c57db219e08fa4c1eeed447157dd191911', 'image': 'registry.osism.tech/kolla/release/openvswitch-db-server:3.4.3.20251130', 'name': '/openvswitch_db', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-28 04:19:00.166296 | orchestrator | skipping: [testbed-node-5] => (item={'id': '3a0cca0d0a43787841d31f19af71d9e7ab2925bdd0fc1f4bb6dce4ce1eab8725', 'image': 'registry.osism.tech/kolla/release/cron:3.0.20251130', 'name': '/cron', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-28 04:19:00.166305 | orchestrator | skipping: [testbed-node-5] => (item={'id': '3125734cb500c21bdbaccf80493f1c4ab6e4fb39d0ae81ffd9d96cfc3c339e8d', 'image': 'registry.osism.tech/kolla/release/kolla-toolbox:19.7.1.20251130', 'name': '/kolla_toolbox', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-28 04:19:00.166312 | orchestrator | skipping: [testbed-node-5] => (item={'id': '81ca784fbfbdd76fed82405aed13999398d06940e1310487da1cbcc029bb70e6', 'image': 'registry.osism.tech/kolla/release/fluentd:5.0.8.20251130', 'name': '/fluentd', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-28 04:19:00.166319 | orchestrator | 2026-04-28 04:19:00.166327 | orchestrator | TASK [Get count of ceph-osd containers on host] ******************************** 2026-04-28 04:19:00.166336 | orchestrator | Tuesday 28 April 2026 04:18:47 +0000 (0:00:00.567) 0:00:05.835 ********* 2026-04-28 04:19:00.166343 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:19:00.166350 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:19:00.166357 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:19:00.166364 | orchestrator | 2026-04-28 04:19:00.166371 | orchestrator | TASK [Set test result to failed when count of containers is wrong] ************* 2026-04-28 04:19:00.166378 | orchestrator | Tuesday 28 April 2026 04:18:48 +0000 (0:00:00.355) 0:00:06.191 ********* 2026-04-28 04:19:00.166386 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:19:00.166393 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:19:00.166400 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:19:00.166407 | orchestrator | 2026-04-28 04:19:00.166414 | orchestrator | TASK [Set test result to passed if count matches] ****************************** 2026-04-28 04:19:00.166421 | orchestrator | Tuesday 28 April 2026 04:18:48 +0000 (0:00:00.559) 0:00:06.751 ********* 2026-04-28 04:19:00.166429 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:19:00.166436 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:19:00.166443 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:19:00.166460 | orchestrator | 2026-04-28 04:19:00.166465 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-28 04:19:00.166488 | orchestrator | Tuesday 28 April 2026 04:18:49 +0000 (0:00:00.310) 0:00:07.061 ********* 2026-04-28 04:19:00.166492 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:19:00.166496 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:19:00.166499 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:19:00.166503 | orchestrator | 2026-04-28 04:19:00.166507 | orchestrator | TASK [Get list of ceph-osd containers that are not running] ******************** 2026-04-28 04:19:00.166511 | orchestrator | Tuesday 28 April 2026 04:18:49 +0000 (0:00:00.332) 0:00:07.394 ********* 2026-04-28 04:19:00.166528 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'ceph-osd-0', 'osd_id': '0', 'state': 'running'})  2026-04-28 04:19:00.166533 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'ceph-osd-3', 'osd_id': '3', 'state': 'running'})  2026-04-28 04:19:00.166537 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:19:00.166541 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'ceph-osd-4', 'osd_id': '4', 'state': 'running'})  2026-04-28 04:19:00.166545 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'ceph-osd-1', 'osd_id': '1', 'state': 'running'})  2026-04-28 04:19:00.166549 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:19:00.166552 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'ceph-osd-2', 'osd_id': '2', 'state': 'running'})  2026-04-28 04:19:00.166556 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'ceph-osd-5', 'osd_id': '5', 'state': 'running'})  2026-04-28 04:19:00.166560 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:19:00.166564 | orchestrator | 2026-04-28 04:19:00.166568 | orchestrator | TASK [Get count of ceph-osd containers that are not running] ******************* 2026-04-28 04:19:00.166572 | orchestrator | Tuesday 28 April 2026 04:18:49 +0000 (0:00:00.345) 0:00:07.740 ********* 2026-04-28 04:19:00.166575 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:19:00.166579 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:19:00.166583 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:19:00.166587 | orchestrator | 2026-04-28 04:19:00.166590 | orchestrator | TASK [Set test result to failed if an OSD is not running] ********************** 2026-04-28 04:19:00.166594 | orchestrator | Tuesday 28 April 2026 04:18:50 +0000 (0:00:00.570) 0:00:08.311 ********* 2026-04-28 04:19:00.166598 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:19:00.166621 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:19:00.166630 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:19:00.166636 | orchestrator | 2026-04-28 04:19:00.166642 | orchestrator | TASK [Set test result to failed if an OSD is not running] ********************** 2026-04-28 04:19:00.166648 | orchestrator | Tuesday 28 April 2026 04:18:50 +0000 (0:00:00.351) 0:00:08.662 ********* 2026-04-28 04:19:00.166654 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:19:00.166660 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:19:00.166666 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:19:00.166672 | orchestrator | 2026-04-28 04:19:00.166678 | orchestrator | TASK [Set test result to passed if all containers are running] ***************** 2026-04-28 04:19:00.166684 | orchestrator | Tuesday 28 April 2026 04:18:51 +0000 (0:00:00.359) 0:00:09.022 ********* 2026-04-28 04:19:00.166691 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:19:00.166697 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:19:00.166703 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:19:00.166709 | orchestrator | 2026-04-28 04:19:00.166715 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-28 04:19:00.166722 | orchestrator | Tuesday 28 April 2026 04:18:51 +0000 (0:00:00.319) 0:00:09.342 ********* 2026-04-28 04:19:00.166728 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:19:00.166734 | orchestrator | 2026-04-28 04:19:00.166740 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-28 04:19:00.166750 | orchestrator | Tuesday 28 April 2026 04:18:52 +0000 (0:00:00.769) 0:00:10.111 ********* 2026-04-28 04:19:00.166757 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:19:00.166763 | orchestrator | 2026-04-28 04:19:00.166769 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-28 04:19:00.166790 | orchestrator | Tuesday 28 April 2026 04:18:52 +0000 (0:00:00.259) 0:00:10.371 ********* 2026-04-28 04:19:00.166796 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:19:00.166802 | orchestrator | 2026-04-28 04:19:00.166808 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 04:19:00.166814 | orchestrator | Tuesday 28 April 2026 04:18:52 +0000 (0:00:00.272) 0:00:10.643 ********* 2026-04-28 04:19:00.166820 | orchestrator | 2026-04-28 04:19:00.166826 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 04:19:00.166832 | orchestrator | Tuesday 28 April 2026 04:18:52 +0000 (0:00:00.074) 0:00:10.718 ********* 2026-04-28 04:19:00.166837 | orchestrator | 2026-04-28 04:19:00.166843 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 04:19:00.166849 | orchestrator | Tuesday 28 April 2026 04:18:52 +0000 (0:00:00.071) 0:00:10.789 ********* 2026-04-28 04:19:00.166855 | orchestrator | 2026-04-28 04:19:00.166883 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-28 04:19:00.166889 | orchestrator | Tuesday 28 April 2026 04:18:52 +0000 (0:00:00.079) 0:00:10.869 ********* 2026-04-28 04:19:00.166895 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:19:00.166901 | orchestrator | 2026-04-28 04:19:00.166907 | orchestrator | TASK [Fail early due to containers not running] ******************************** 2026-04-28 04:19:00.166913 | orchestrator | Tuesday 28 April 2026 04:18:53 +0000 (0:00:00.293) 0:00:11.162 ********* 2026-04-28 04:19:00.166919 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:19:00.166925 | orchestrator | 2026-04-28 04:19:00.166931 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-28 04:19:00.166937 | orchestrator | Tuesday 28 April 2026 04:18:53 +0000 (0:00:00.291) 0:00:11.454 ********* 2026-04-28 04:19:00.166943 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:19:00.166950 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:19:00.166956 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:19:00.166962 | orchestrator | 2026-04-28 04:19:00.166968 | orchestrator | TASK [Set _mon_hostname fact] ************************************************** 2026-04-28 04:19:00.166974 | orchestrator | Tuesday 28 April 2026 04:18:53 +0000 (0:00:00.314) 0:00:11.769 ********* 2026-04-28 04:19:00.166980 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:19:00.166987 | orchestrator | 2026-04-28 04:19:00.166993 | orchestrator | TASK [Get ceph osd tree] ******************************************************* 2026-04-28 04:19:00.166999 | orchestrator | Tuesday 28 April 2026 04:18:54 +0000 (0:00:00.818) 0:00:12.588 ********* 2026-04-28 04:19:00.167005 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-28 04:19:00.167011 | orchestrator | 2026-04-28 04:19:00.167017 | orchestrator | TASK [Parse osd tree from JSON] ************************************************ 2026-04-28 04:19:00.167023 | orchestrator | Tuesday 28 April 2026 04:18:56 +0000 (0:00:01.643) 0:00:14.231 ********* 2026-04-28 04:19:00.167029 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:19:00.167035 | orchestrator | 2026-04-28 04:19:00.167041 | orchestrator | TASK [Get OSDs that are not up or in] ****************************************** 2026-04-28 04:19:00.167047 | orchestrator | Tuesday 28 April 2026 04:18:56 +0000 (0:00:00.142) 0:00:14.374 ********* 2026-04-28 04:19:00.167053 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:19:00.167059 | orchestrator | 2026-04-28 04:19:00.167065 | orchestrator | TASK [Fail test if OSDs are not up or in] ************************************** 2026-04-28 04:19:00.167071 | orchestrator | Tuesday 28 April 2026 04:18:56 +0000 (0:00:00.326) 0:00:14.701 ********* 2026-04-28 04:19:00.167077 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:19:00.167082 | orchestrator | 2026-04-28 04:19:00.167089 | orchestrator | TASK [Pass test if OSDs are all up and in] ************************************* 2026-04-28 04:19:00.167094 | orchestrator | Tuesday 28 April 2026 04:18:56 +0000 (0:00:00.133) 0:00:14.834 ********* 2026-04-28 04:19:00.167100 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:19:00.167106 | orchestrator | 2026-04-28 04:19:00.167112 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-28 04:19:00.167118 | orchestrator | Tuesday 28 April 2026 04:18:57 +0000 (0:00:00.151) 0:00:14.986 ********* 2026-04-28 04:19:00.167131 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:19:00.167137 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:19:00.167143 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:19:00.167149 | orchestrator | 2026-04-28 04:19:00.167155 | orchestrator | TASK [List ceph LVM volumes and collect data] ********************************** 2026-04-28 04:19:00.167160 | orchestrator | Tuesday 28 April 2026 04:18:57 +0000 (0:00:00.349) 0:00:15.335 ********* 2026-04-28 04:19:00.167167 | orchestrator | changed: [testbed-node-4] 2026-04-28 04:19:00.167173 | orchestrator | changed: [testbed-node-3] 2026-04-28 04:19:00.167179 | orchestrator | changed: [testbed-node-5] 2026-04-28 04:19:11.846977 | orchestrator | 2026-04-28 04:19:11.847064 | orchestrator | TASK [Parse LVM data as JSON] ************************************************** 2026-04-28 04:19:11.847078 | orchestrator | Tuesday 28 April 2026 04:19:00 +0000 (0:00:02.780) 0:00:18.116 ********* 2026-04-28 04:19:11.847091 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:19:11.847107 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:19:11.847117 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:19:11.847127 | orchestrator | 2026-04-28 04:19:11.847137 | orchestrator | TASK [Get unencrypted and encrypted OSDs] ************************************** 2026-04-28 04:19:11.847147 | orchestrator | Tuesday 28 April 2026 04:19:00 +0000 (0:00:00.349) 0:00:18.466 ********* 2026-04-28 04:19:11.847157 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:19:11.847167 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:19:11.847176 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:19:11.847187 | orchestrator | 2026-04-28 04:19:11.847197 | orchestrator | TASK [Fail if count of encrypted OSDs does not match] ************************** 2026-04-28 04:19:11.847207 | orchestrator | Tuesday 28 April 2026 04:19:01 +0000 (0:00:00.547) 0:00:19.013 ********* 2026-04-28 04:19:11.847217 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:19:11.847228 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:19:11.847238 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:19:11.847248 | orchestrator | 2026-04-28 04:19:11.847258 | orchestrator | TASK [Pass if count of encrypted OSDs equals count of OSDs] ******************** 2026-04-28 04:19:11.847288 | orchestrator | Tuesday 28 April 2026 04:19:01 +0000 (0:00:00.351) 0:00:19.365 ********* 2026-04-28 04:19:11.847300 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:19:11.847311 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:19:11.847321 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:19:11.847331 | orchestrator | 2026-04-28 04:19:11.847340 | orchestrator | TASK [Fail if count of unencrypted OSDs does not match] ************************ 2026-04-28 04:19:11.847346 | orchestrator | Tuesday 28 April 2026 04:19:02 +0000 (0:00:00.605) 0:00:19.971 ********* 2026-04-28 04:19:11.847352 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:19:11.847358 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:19:11.847363 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:19:11.847369 | orchestrator | 2026-04-28 04:19:11.847375 | orchestrator | TASK [Pass if count of unencrypted OSDs equals count of OSDs] ****************** 2026-04-28 04:19:11.847382 | orchestrator | Tuesday 28 April 2026 04:19:02 +0000 (0:00:00.339) 0:00:20.310 ********* 2026-04-28 04:19:11.847387 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:19:11.847393 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:19:11.847399 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:19:11.847405 | orchestrator | 2026-04-28 04:19:11.847410 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-28 04:19:11.847416 | orchestrator | Tuesday 28 April 2026 04:19:02 +0000 (0:00:00.341) 0:00:20.652 ********* 2026-04-28 04:19:11.847422 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:19:11.847428 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:19:11.847433 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:19:11.847439 | orchestrator | 2026-04-28 04:19:11.847445 | orchestrator | TASK [Get CRUSH node data of each OSD host and root node childs] *************** 2026-04-28 04:19:11.847450 | orchestrator | Tuesday 28 April 2026 04:19:03 +0000 (0:00:00.569) 0:00:21.222 ********* 2026-04-28 04:19:11.847456 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:19:11.847480 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:19:11.847487 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:19:11.847494 | orchestrator | 2026-04-28 04:19:11.847500 | orchestrator | TASK [Calculate sub test expression results] *********************************** 2026-04-28 04:19:11.847507 | orchestrator | Tuesday 28 April 2026 04:19:04 +0000 (0:00:00.815) 0:00:22.038 ********* 2026-04-28 04:19:11.847514 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:19:11.847520 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:19:11.847527 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:19:11.847533 | orchestrator | 2026-04-28 04:19:11.847540 | orchestrator | TASK [Fail test if any sub test failed] **************************************** 2026-04-28 04:19:11.847547 | orchestrator | Tuesday 28 April 2026 04:19:04 +0000 (0:00:00.347) 0:00:22.385 ********* 2026-04-28 04:19:11.847553 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:19:11.847560 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:19:11.847566 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:19:11.847573 | orchestrator | 2026-04-28 04:19:11.847580 | orchestrator | TASK [Pass test if no sub test failed] ***************************************** 2026-04-28 04:19:11.847586 | orchestrator | Tuesday 28 April 2026 04:19:04 +0000 (0:00:00.348) 0:00:22.734 ********* 2026-04-28 04:19:11.847593 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:19:11.847600 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:19:11.847606 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:19:11.847612 | orchestrator | 2026-04-28 04:19:11.847619 | orchestrator | TASK [Set validation result to passed if no test failed] *********************** 2026-04-28 04:19:11.847626 | orchestrator | Tuesday 28 April 2026 04:19:05 +0000 (0:00:00.597) 0:00:23.331 ********* 2026-04-28 04:19:11.847632 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-28 04:19:11.847639 | orchestrator | 2026-04-28 04:19:11.847646 | orchestrator | TASK [Set validation result to failed if a test failed] ************************ 2026-04-28 04:19:11.847653 | orchestrator | Tuesday 28 April 2026 04:19:05 +0000 (0:00:00.296) 0:00:23.628 ********* 2026-04-28 04:19:11.847659 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:19:11.847666 | orchestrator | 2026-04-28 04:19:11.847672 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-28 04:19:11.847679 | orchestrator | Tuesday 28 April 2026 04:19:05 +0000 (0:00:00.307) 0:00:23.935 ********* 2026-04-28 04:19:11.847686 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-28 04:19:11.847692 | orchestrator | 2026-04-28 04:19:11.847699 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-28 04:19:11.847706 | orchestrator | Tuesday 28 April 2026 04:19:07 +0000 (0:00:01.959) 0:00:25.894 ********* 2026-04-28 04:19:11.847712 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-28 04:19:11.847719 | orchestrator | 2026-04-28 04:19:11.847726 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-28 04:19:11.847732 | orchestrator | Tuesday 28 April 2026 04:19:08 +0000 (0:00:00.302) 0:00:26.196 ********* 2026-04-28 04:19:11.847739 | orchestrator | changed: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-28 04:19:11.847746 | orchestrator | 2026-04-28 04:19:11.847768 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 04:19:11.847775 | orchestrator | Tuesday 28 April 2026 04:19:08 +0000 (0:00:00.288) 0:00:26.485 ********* 2026-04-28 04:19:11.847782 | orchestrator | 2026-04-28 04:19:11.847789 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 04:19:11.847795 | orchestrator | Tuesday 28 April 2026 04:19:08 +0000 (0:00:00.136) 0:00:26.622 ********* 2026-04-28 04:19:11.847803 | orchestrator | 2026-04-28 04:19:11.847809 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 04:19:11.847816 | orchestrator | Tuesday 28 April 2026 04:19:08 +0000 (0:00:00.135) 0:00:26.757 ********* 2026-04-28 04:19:11.847823 | orchestrator | 2026-04-28 04:19:11.847829 | orchestrator | RUNNING HANDLER [Write report file] ******************************************** 2026-04-28 04:19:11.847836 | orchestrator | Tuesday 28 April 2026 04:19:08 +0000 (0:00:00.140) 0:00:26.898 ********* 2026-04-28 04:19:11.847848 | orchestrator | changed: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-28 04:19:11.847854 | orchestrator | 2026-04-28 04:19:11.847875 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-28 04:19:11.847881 | orchestrator | Tuesday 28 April 2026 04:19:10 +0000 (0:00:01.845) 0:00:28.744 ********* 2026-04-28 04:19:11.847891 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => { 2026-04-28 04:19:11.847897 | orchestrator |  "msg": [ 2026-04-28 04:19:11.847903 | orchestrator |  "Validator run completed.", 2026-04-28 04:19:11.847909 | orchestrator |  "You can find the report file here:", 2026-04-28 04:19:11.847915 | orchestrator |  "/opt/reports/validator/ceph-osds-validator-2026-04-28T04:18:43+00:00-report.json", 2026-04-28 04:19:11.847922 | orchestrator |  "on the following host:", 2026-04-28 04:19:11.847928 | orchestrator |  "testbed-manager" 2026-04-28 04:19:11.847934 | orchestrator |  ] 2026-04-28 04:19:11.847940 | orchestrator | } 2026-04-28 04:19:11.847945 | orchestrator | 2026-04-28 04:19:11.847951 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:19:11.847958 | orchestrator | testbed-node-3 : ok=35  changed=4  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-28 04:19:11.847966 | orchestrator | testbed-node-4 : ok=18  changed=1  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-28 04:19:11.847971 | orchestrator | testbed-node-5 : ok=18  changed=1  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-28 04:19:11.847977 | orchestrator | 2026-04-28 04:19:11.847983 | orchestrator | 2026-04-28 04:19:11.847989 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 04:19:11.847994 | orchestrator | Tuesday 28 April 2026 04:19:11 +0000 (0:00:00.663) 0:00:29.407 ********* 2026-04-28 04:19:11.848000 | orchestrator | =============================================================================== 2026-04-28 04:19:11.848006 | orchestrator | List ceph LVM volumes and collect data ---------------------------------- 2.78s 2026-04-28 04:19:11.848011 | orchestrator | Aggregate test results step one ----------------------------------------- 1.96s 2026-04-28 04:19:11.848017 | orchestrator | Write report file ------------------------------------------------------- 1.85s 2026-04-28 04:19:11.848023 | orchestrator | Get ceph osd tree ------------------------------------------------------- 1.64s 2026-04-28 04:19:11.848028 | orchestrator | Get timestamp for report file ------------------------------------------- 0.99s 2026-04-28 04:19:11.848034 | orchestrator | Calculate total number of OSDs in cluster ------------------------------- 0.84s 2026-04-28 04:19:11.848040 | orchestrator | Set _mon_hostname fact -------------------------------------------------- 0.82s 2026-04-28 04:19:11.848045 | orchestrator | Get CRUSH node data of each OSD host and root node childs --------------- 0.82s 2026-04-28 04:19:11.848051 | orchestrator | Create report output directory ------------------------------------------ 0.77s 2026-04-28 04:19:11.848057 | orchestrator | Aggregate test results step one ----------------------------------------- 0.77s 2026-04-28 04:19:11.848062 | orchestrator | Print report file information ------------------------------------------- 0.66s 2026-04-28 04:19:11.848068 | orchestrator | Get extra vars for Ceph configuration ----------------------------------- 0.61s 2026-04-28 04:19:11.848074 | orchestrator | Pass if count of encrypted OSDs equals count of OSDs -------------------- 0.61s 2026-04-28 04:19:11.848079 | orchestrator | Pass test if no sub test failed ----------------------------------------- 0.60s 2026-04-28 04:19:11.848085 | orchestrator | Get count of ceph-osd containers that are not running ------------------- 0.57s 2026-04-28 04:19:11.848091 | orchestrator | Prepare test data ------------------------------------------------------- 0.57s 2026-04-28 04:19:11.848096 | orchestrator | Get list of ceph-osd containers on host --------------------------------- 0.57s 2026-04-28 04:19:11.848102 | orchestrator | Set test result to failed when count of containers is wrong ------------- 0.56s 2026-04-28 04:19:11.848115 | orchestrator | Get unencrypted and encrypted OSDs -------------------------------------- 0.55s 2026-04-28 04:19:11.848121 | orchestrator | Flush handlers ---------------------------------------------------------- 0.41s 2026-04-28 04:19:12.305500 | orchestrator | + sh -c /opt/configuration/scripts/check/200-infrastructure.sh 2026-04-28 04:19:12.312375 | orchestrator | + set -e 2026-04-28 04:19:12.312458 | orchestrator | + source /opt/manager-vars.sh 2026-04-28 04:19:12.313542 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-28 04:19:12.313574 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-28 04:19:12.313580 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-28 04:19:12.313585 | orchestrator | ++ CEPH_VERSION=reef 2026-04-28 04:19:12.313590 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-28 04:19:12.313596 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-28 04:19:12.313601 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-28 04:19:12.313606 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-28 04:19:12.313611 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-28 04:19:12.313616 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-28 04:19:12.313621 | orchestrator | ++ export ARA=false 2026-04-28 04:19:12.313626 | orchestrator | ++ ARA=false 2026-04-28 04:19:12.313631 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-28 04:19:12.313635 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-28 04:19:12.313640 | orchestrator | ++ export TEMPEST=false 2026-04-28 04:19:12.313645 | orchestrator | ++ TEMPEST=false 2026-04-28 04:19:12.313649 | orchestrator | ++ export IS_ZUUL=true 2026-04-28 04:19:12.313654 | orchestrator | ++ IS_ZUUL=true 2026-04-28 04:19:12.313659 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 04:19:12.313664 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 04:19:12.313668 | orchestrator | ++ export EXTERNAL_API=false 2026-04-28 04:19:12.313673 | orchestrator | ++ EXTERNAL_API=false 2026-04-28 04:19:12.313677 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-28 04:19:12.313682 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-28 04:19:12.313687 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-28 04:19:12.313692 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-28 04:19:12.313696 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-28 04:19:12.313701 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-28 04:19:12.313705 | orchestrator | + source /etc/os-release 2026-04-28 04:19:12.313710 | orchestrator | ++ PRETTY_NAME='Ubuntu 24.04.4 LTS' 2026-04-28 04:19:12.313715 | orchestrator | ++ NAME=Ubuntu 2026-04-28 04:19:12.313720 | orchestrator | ++ VERSION_ID=24.04 2026-04-28 04:19:12.313724 | orchestrator | ++ VERSION='24.04.4 LTS (Noble Numbat)' 2026-04-28 04:19:12.313729 | orchestrator | ++ VERSION_CODENAME=noble 2026-04-28 04:19:12.313733 | orchestrator | ++ ID=ubuntu 2026-04-28 04:19:12.313738 | orchestrator | ++ ID_LIKE=debian 2026-04-28 04:19:12.313743 | orchestrator | ++ HOME_URL=https://www.ubuntu.com/ 2026-04-28 04:19:12.313747 | orchestrator | ++ SUPPORT_URL=https://help.ubuntu.com/ 2026-04-28 04:19:12.313752 | orchestrator | ++ BUG_REPORT_URL=https://bugs.launchpad.net/ubuntu/ 2026-04-28 04:19:12.313757 | orchestrator | ++ PRIVACY_POLICY_URL=https://www.ubuntu.com/legal/terms-and-policies/privacy-policy 2026-04-28 04:19:12.313762 | orchestrator | ++ UBUNTU_CODENAME=noble 2026-04-28 04:19:12.313766 | orchestrator | ++ LOGO=ubuntu-logo 2026-04-28 04:19:12.313771 | orchestrator | + [[ ubuntu == \u\b\u\n\t\u ]] 2026-04-28 04:19:12.313777 | orchestrator | + packages='libmonitoring-plugin-perl libwww-perl libjson-perl monitoring-plugins-basic mysql-client' 2026-04-28 04:19:12.313783 | orchestrator | + dpkg -s libmonitoring-plugin-perl libwww-perl libjson-perl monitoring-plugins-basic mysql-client 2026-04-28 04:19:12.345139 | orchestrator | + sudo apt-get install -y libmonitoring-plugin-perl libwww-perl libjson-perl monitoring-plugins-basic mysql-client 2026-04-28 04:19:37.264292 | orchestrator | 2026-04-28 04:19:37.264396 | orchestrator | # Status of Elasticsearch 2026-04-28 04:19:37.264410 | orchestrator | 2026-04-28 04:19:37.264421 | orchestrator | + pushd /opt/configuration/contrib 2026-04-28 04:19:37.264432 | orchestrator | + echo 2026-04-28 04:19:37.264442 | orchestrator | + echo '# Status of Elasticsearch' 2026-04-28 04:19:37.264451 | orchestrator | + echo 2026-04-28 04:19:37.264461 | orchestrator | + bash nagios-plugins/check_elasticsearch -H api-int.testbed.osism.xyz -s 2026-04-28 04:19:37.453057 | orchestrator | OK - elasticsearch (kolla_logging) is running. status: green; timed_out: false; number_of_nodes: 3; number_of_data_nodes: 3; active_primary_shards: 9; active_shards: 22; relocating_shards: 0; initializing_shards: 0; delayed_unassigned_shards: 0; unassigned_shards: 0 | 'active_primary'=9 'active'=22 'relocating'=0 'init'=0 'delay_unass'=0 'unass'=0 2026-04-28 04:19:37.453185 | orchestrator | 2026-04-28 04:19:37.453203 | orchestrator | # Status of MariaDB 2026-04-28 04:19:37.453216 | orchestrator | 2026-04-28 04:19:37.453227 | orchestrator | + echo 2026-04-28 04:19:37.453239 | orchestrator | + echo '# Status of MariaDB' 2026-04-28 04:19:37.453251 | orchestrator | + echo 2026-04-28 04:19:37.454327 | orchestrator | ++ semver 9.5.0 10.0.0-0 2026-04-28 04:19:37.521012 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-28 04:19:37.521085 | orchestrator | + [[ 9.5.0 == \l\a\t\e\s\t ]] 2026-04-28 04:19:37.521093 | orchestrator | + MARIADB_USER=root_shard_0 2026-04-28 04:19:37.521100 | orchestrator | + bash nagios-plugins/check_galera_cluster -u root_shard_0 -p password -H api-int.testbed.osism.xyz -c 1 2026-04-28 04:19:37.587656 | orchestrator | Reading package lists... 2026-04-28 04:19:38.000238 | orchestrator | Building dependency tree... 2026-04-28 04:19:38.001005 | orchestrator | Reading state information... 2026-04-28 04:19:38.566230 | orchestrator | bc is already the newest version (1.07.1-3ubuntu4). 2026-04-28 04:19:38.566316 | orchestrator | bc set to manually installed. 2026-04-28 04:19:38.566328 | orchestrator | 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 2026-04-28 04:19:39.291760 | orchestrator | OK: number of NODES = 3 (wsrep_cluster_size) 2026-04-28 04:19:39.291946 | orchestrator | 2026-04-28 04:19:39.291978 | orchestrator | # Status of Prometheus 2026-04-28 04:19:39.292000 | orchestrator | 2026-04-28 04:19:39.292019 | orchestrator | + echo 2026-04-28 04:19:39.292039 | orchestrator | + echo '# Status of Prometheus' 2026-04-28 04:19:39.292058 | orchestrator | + echo 2026-04-28 04:19:39.292075 | orchestrator | + curl -s https://api-int.testbed.osism.xyz:9091/-/healthy 2026-04-28 04:19:39.360457 | orchestrator | Unauthorized 2026-04-28 04:19:39.365075 | orchestrator | + curl -s https://api-int.testbed.osism.xyz:9091/-/ready 2026-04-28 04:19:39.438239 | orchestrator | Unauthorized 2026-04-28 04:19:39.441352 | orchestrator | 2026-04-28 04:19:39.441453 | orchestrator | # Status of RabbitMQ 2026-04-28 04:19:39.441476 | orchestrator | 2026-04-28 04:19:39.441494 | orchestrator | + echo 2026-04-28 04:19:39.441511 | orchestrator | + echo '# Status of RabbitMQ' 2026-04-28 04:19:39.441529 | orchestrator | + echo 2026-04-28 04:19:39.442989 | orchestrator | ++ semver 9.5.0 10.0.0-0 2026-04-28 04:19:39.495345 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-28 04:19:39.495452 | orchestrator | + [[ 9.5.0 == \l\a\t\e\s\t ]] 2026-04-28 04:19:39.495474 | orchestrator | + perl nagios-plugins/check_rabbitmq_cluster --ssl 1 -H api-int.testbed.osism.xyz -u openstack -p password 2026-04-28 04:19:40.067021 | orchestrator | RABBITMQ_CLUSTER OK - nb_running_node OK (3) nb_running_disc_node OK (3) nb_running_ram_node OK (0) 2026-04-28 04:19:40.077923 | orchestrator | 2026-04-28 04:19:40.078071 | orchestrator | # Status of Redis 2026-04-28 04:19:40.078086 | orchestrator | 2026-04-28 04:19:40.078092 | orchestrator | + echo 2026-04-28 04:19:40.078097 | orchestrator | + echo '# Status of Redis' 2026-04-28 04:19:40.078102 | orchestrator | + echo 2026-04-28 04:19:40.078109 | orchestrator | + /usr/lib/nagios/plugins/check_tcp -H 192.168.16.10 -p 6379 -A -E -s 'AUTH QHNA1SZRlOKzLADhUd5ZDgpHfQe6dNfr3bwEdY24\r\nPING\r\nINFO replication\r\nQUIT\r\n' -e PONG -e role:master -e slave0:ip=192.168.16.1 -e,port=6379 -j 2026-04-28 04:19:40.082569 | orchestrator | TCP OK - 0.002 second response time on 192.168.16.10 port 6379|time=0.001619s;;;0.000000;10.000000 2026-04-28 04:19:40.083406 | orchestrator | 2026-04-28 04:19:40.083451 | orchestrator | # Create backup of MariaDB database 2026-04-28 04:19:40.083463 | orchestrator | 2026-04-28 04:19:40.083473 | orchestrator | + popd 2026-04-28 04:19:40.083481 | orchestrator | + echo 2026-04-28 04:19:40.083488 | orchestrator | + echo '# Create backup of MariaDB database' 2026-04-28 04:19:40.083497 | orchestrator | + echo 2026-04-28 04:19:40.083506 | orchestrator | + osism apply mariadb_backup -e mariadb_backup_type=full 2026-04-28 04:19:42.471161 | orchestrator | 2026-04-28 04:19:42 | INFO  | Task 1c053c11-bb6a-4902-8cee-9a65dc3f50e8 (mariadb_backup) was prepared for execution. 2026-04-28 04:19:42.471269 | orchestrator | 2026-04-28 04:19:42 | INFO  | It takes a moment until task 1c053c11-bb6a-4902-8cee-9a65dc3f50e8 (mariadb_backup) has been started and output is visible here. 2026-04-28 04:23:48.709786 | orchestrator | 2026-04-28 04:23:48.709875 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 04:23:48.709885 | orchestrator | 2026-04-28 04:23:48.709906 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 04:23:48.709914 | orchestrator | Tuesday 28 April 2026 04:19:47 +0000 (0:00:00.211) 0:00:00.211 ********* 2026-04-28 04:23:48.709920 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:23:48.709944 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:23:48.709950 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:23:48.709955 | orchestrator | 2026-04-28 04:23:48.709961 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 04:23:48.709967 | orchestrator | Tuesday 28 April 2026 04:19:47 +0000 (0:00:00.378) 0:00:00.589 ********* 2026-04-28 04:23:48.710052 | orchestrator | ok: [testbed-node-0] => (item=enable_mariadb_True) 2026-04-28 04:23:48.710059 | orchestrator | ok: [testbed-node-1] => (item=enable_mariadb_True) 2026-04-28 04:23:48.710065 | orchestrator | ok: [testbed-node-2] => (item=enable_mariadb_True) 2026-04-28 04:23:48.710071 | orchestrator | 2026-04-28 04:23:48.710077 | orchestrator | PLAY [Apply role mariadb] ****************************************************** 2026-04-28 04:23:48.710083 | orchestrator | 2026-04-28 04:23:48.710088 | orchestrator | TASK [mariadb : Group MariaDB hosts based on shards] *************************** 2026-04-28 04:23:48.710094 | orchestrator | Tuesday 28 April 2026 04:19:48 +0000 (0:00:00.627) 0:00:01.216 ********* 2026-04-28 04:23:48.710100 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 04:23:48.710106 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-28 04:23:48.710112 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-28 04:23:48.710118 | orchestrator | 2026-04-28 04:23:48.710124 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-28 04:23:48.710134 | orchestrator | Tuesday 28 April 2026 04:19:48 +0000 (0:00:00.444) 0:00:01.661 ********* 2026-04-28 04:23:48.710141 | orchestrator | included: /ansible/roles/mariadb/tasks/backup.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:23:48.710148 | orchestrator | 2026-04-28 04:23:48.710154 | orchestrator | TASK [mariadb : Get MariaDB container facts] *********************************** 2026-04-28 04:23:48.710161 | orchestrator | Tuesday 28 April 2026 04:19:49 +0000 (0:00:00.610) 0:00:02.272 ********* 2026-04-28 04:23:48.710167 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:23:48.710172 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:23:48.710178 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:23:48.710184 | orchestrator | 2026-04-28 04:23:48.710190 | orchestrator | TASK [mariadb : Taking full database backup via Mariabackup] ******************* 2026-04-28 04:23:48.710196 | orchestrator | Tuesday 28 April 2026 04:19:52 +0000 (0:00:03.500) 0:00:05.772 ********* 2026-04-28 04:23:48.710206 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:23:48.710219 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:23:48.710234 | orchestrator | 2026-04-28 04:23:48.710243 | orchestrator | STILL ALIVE [task 'mariadb : Taking full database backup via Mariabackup' is running] *** 2026-04-28 04:23:48.710251 | orchestrator | 2026-04-28 04:23:48.710260 | orchestrator | STILL ALIVE [task 'mariadb : Taking full database backup via Mariabackup' is running] *** 2026-04-28 04:23:48.710269 | orchestrator | 2026-04-28 04:23:48.710277 | orchestrator | STILL ALIVE [task 'mariadb : Taking full database backup via Mariabackup' is running] *** 2026-04-28 04:23:48.710286 | orchestrator | 2026-04-28 04:23:48.710295 | orchestrator | STILL ALIVE [task 'mariadb : Taking full database backup via Mariabackup' is running] *** 2026-04-28 04:23:48.710304 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: mariadb_restart 2026-04-28 04:23:48.710312 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: mariadb_start 2026-04-28 04:23:48.710320 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: 2026-04-28 04:23:48.710329 | orchestrator | mariadb_bootstrap_restart 2026-04-28 04:23:48.710338 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:23:48.710348 | orchestrator | 2026-04-28 04:23:48.710358 | orchestrator | PLAY [Restart mariadb services] ************************************************ 2026-04-28 04:23:48.710368 | orchestrator | skipping: no hosts matched 2026-04-28 04:23:48.710377 | orchestrator | 2026-04-28 04:23:48.710387 | orchestrator | PLAY [Start mariadb services] ************************************************** 2026-04-28 04:23:48.710398 | orchestrator | skipping: no hosts matched 2026-04-28 04:23:48.710408 | orchestrator | 2026-04-28 04:23:48.710418 | orchestrator | PLAY [Restart bootstrap mariadb service] *************************************** 2026-04-28 04:23:48.710435 | orchestrator | skipping: no hosts matched 2026-04-28 04:23:48.710443 | orchestrator | 2026-04-28 04:23:48.710449 | orchestrator | PLAY [Apply mariadb post-configuration] **************************************** 2026-04-28 04:23:48.710456 | orchestrator | 2026-04-28 04:23:48.710463 | orchestrator | TASK [Include mariadb post-deploy.yml] ***************************************** 2026-04-28 04:23:48.710469 | orchestrator | Tuesday 28 April 2026 04:23:47 +0000 (0:03:54.800) 0:04:00.573 ********* 2026-04-28 04:23:48.710475 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:23:48.710482 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:23:48.710489 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:23:48.710495 | orchestrator | 2026-04-28 04:23:48.710502 | orchestrator | TASK [Include mariadb post-upgrade.yml] **************************************** 2026-04-28 04:23:48.710508 | orchestrator | Tuesday 28 April 2026 04:23:47 +0000 (0:00:00.344) 0:04:00.917 ********* 2026-04-28 04:23:48.710515 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:23:48.710521 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:23:48.710528 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:23:48.710535 | orchestrator | 2026-04-28 04:23:48.710541 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:23:48.710550 | orchestrator | testbed-node-0 : ok=6  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 04:23:48.710557 | orchestrator | testbed-node-1 : ok=4  changed=0 unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-28 04:23:48.710577 | orchestrator | testbed-node-2 : ok=4  changed=0 unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-28 04:23:48.710583 | orchestrator | 2026-04-28 04:23:48.710589 | orchestrator | 2026-04-28 04:23:48.710595 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 04:23:48.710601 | orchestrator | Tuesday 28 April 2026 04:23:48 +0000 (0:00:00.464) 0:04:01.382 ********* 2026-04-28 04:23:48.710606 | orchestrator | =============================================================================== 2026-04-28 04:23:48.710612 | orchestrator | mariadb : Taking full database backup via Mariabackup ----------------- 234.80s 2026-04-28 04:23:48.710618 | orchestrator | mariadb : Get MariaDB container facts ----------------------------------- 3.50s 2026-04-28 04:23:48.710623 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.63s 2026-04-28 04:23:48.710629 | orchestrator | mariadb : include_tasks ------------------------------------------------- 0.61s 2026-04-28 04:23:48.710635 | orchestrator | Include mariadb post-upgrade.yml ---------------------------------------- 0.46s 2026-04-28 04:23:48.710641 | orchestrator | mariadb : Group MariaDB hosts based on shards --------------------------- 0.44s 2026-04-28 04:23:48.710646 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.38s 2026-04-28 04:23:48.710652 | orchestrator | Include mariadb post-deploy.yml ----------------------------------------- 0.34s 2026-04-28 04:23:49.079467 | orchestrator | + sh -c /opt/configuration/scripts/check/300-openstack.sh 2026-04-28 04:23:49.087162 | orchestrator | + set -e 2026-04-28 04:23:49.087234 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-28 04:23:49.088240 | orchestrator | ++ export INTERACTIVE=false 2026-04-28 04:23:49.088286 | orchestrator | ++ INTERACTIVE=false 2026-04-28 04:23:49.088297 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-28 04:23:49.088307 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-28 04:23:49.088314 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-28 04:23:49.089210 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-28 04:23:49.094568 | orchestrator | 2026-04-28 04:23:49.094593 | orchestrator | # OpenStack endpoints 2026-04-28 04:23:49.094601 | orchestrator | 2026-04-28 04:23:49.094608 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-28 04:23:49.094614 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-28 04:23:49.094621 | orchestrator | + export OS_CLOUD=admin 2026-04-28 04:23:49.094627 | orchestrator | + OS_CLOUD=admin 2026-04-28 04:23:49.094633 | orchestrator | + echo 2026-04-28 04:23:49.094660 | orchestrator | + echo '# OpenStack endpoints' 2026-04-28 04:23:49.094667 | orchestrator | + echo 2026-04-28 04:23:49.094673 | orchestrator | + openstack endpoint list 2026-04-28 04:23:52.625723 | orchestrator | +----------------------------------+-----------+--------------+-----------------+---------+-----------+---------------------------------------------------------------------+ 2026-04-28 04:23:52.625835 | orchestrator | | ID | Region | Service Name | Service Type | Enabled | Interface | URL | 2026-04-28 04:23:52.625851 | orchestrator | +----------------------------------+-----------+--------------+-----------------+---------+-----------+---------------------------------------------------------------------+ 2026-04-28 04:23:52.625866 | orchestrator | | 0cf185a520ba45359be315f83cd9615c | RegionOne | keystone | identity | True | internal | https://api-int.testbed.osism.xyz:5000 | 2026-04-28 04:23:52.625880 | orchestrator | | 1061433da7784e6c8ab401b1bea0ff79 | RegionOne | magnum | container-infra | True | internal | https://api-int.testbed.osism.xyz:9511/v1 | 2026-04-28 04:23:52.625892 | orchestrator | | 166ba1ff0f57419280b58cdf4d451995 | RegionOne | glance | image | True | public | https://api.testbed.osism.xyz:9292 | 2026-04-28 04:23:52.625901 | orchestrator | | 1f07aa031104487b9569ee2aade040cb | RegionOne | barbican | key-manager | True | internal | https://api-int.testbed.osism.xyz:9311 | 2026-04-28 04:23:52.625909 | orchestrator | | 36f1acb4397e4dcc8ae5c4ab01512b82 | RegionOne | manilav2 | sharev2 | True | public | https://api.testbed.osism.xyz:8786/v2 | 2026-04-28 04:23:52.625917 | orchestrator | | 38c749f4ec7f4cbe92407ea8899b798b | RegionOne | nova | compute | True | internal | https://api-int.testbed.osism.xyz:8774/v2.1 | 2026-04-28 04:23:52.625925 | orchestrator | | 3a47ee2ef43b4e518f3c0017b3537862 | RegionOne | octavia | load-balancer | True | internal | https://api-int.testbed.osism.xyz:9876 | 2026-04-28 04:23:52.625933 | orchestrator | | 3dba1f3694884c2d9e409a6bf89bac59 | RegionOne | neutron | network | True | internal | https://api-int.testbed.osism.xyz:9696 | 2026-04-28 04:23:52.625941 | orchestrator | | 4210108fbfd6448191c3c613ac83671f | RegionOne | aodh | alarming | True | internal | https://api-int.testbed.osism.xyz:8042 | 2026-04-28 04:23:52.625948 | orchestrator | | 4ca7a0048d2145fb8180e0d636a2c9ae | RegionOne | nova | compute | True | public | https://api.testbed.osism.xyz:8774/v2.1 | 2026-04-28 04:23:52.625956 | orchestrator | | 4ea98bfb634346e985d130ad5f0e9179 | RegionOne | manilav2 | sharev2 | True | internal | https://api-int.testbed.osism.xyz:8786/v2 | 2026-04-28 04:23:52.625968 | orchestrator | | 6043d57f915a4da4b9bfa75e62c83699 | RegionOne | neutron | network | True | public | https://api.testbed.osism.xyz:9696 | 2026-04-28 04:23:52.626095 | orchestrator | | 61a6912cbb3841e98784c217b4c78df6 | RegionOne | swift | object-store | True | internal | https://api-int.testbed.osism.xyz:6780/swift/v1/AUTH_%(project_id)s | 2026-04-28 04:23:52.626112 | orchestrator | | 687a394942a84d74a696dd274c9d3be3 | RegionOne | keystone | identity | True | public | https://api.testbed.osism.xyz:5000 | 2026-04-28 04:23:52.626126 | orchestrator | | 704fd9bdca1b4e2c8b2f9bfd35c9108d | RegionOne | designate | dns | True | public | https://api.testbed.osism.xyz:9001 | 2026-04-28 04:23:52.626138 | orchestrator | | 72b7433133d8439d91dbe53300246b58 | RegionOne | placement | placement | True | public | https://api.testbed.osism.xyz:8780 | 2026-04-28 04:23:52.626146 | orchestrator | | 7bc01012e71e48ae9831b7d4aa08315c | RegionOne | barbican | key-manager | True | public | https://api.testbed.osism.xyz:9311 | 2026-04-28 04:23:52.626179 | orchestrator | | 7de877361a2847fb9282f575f59f7aee | RegionOne | placement | placement | True | internal | https://api-int.testbed.osism.xyz:8780 | 2026-04-28 04:23:52.626187 | orchestrator | | 7fddbde5e6414b0a89ce3dcb87069390 | RegionOne | swift | object-store | True | public | https://api.testbed.osism.xyz:6780/swift/v1/AUTH_%(project_id)s | 2026-04-28 04:23:52.626207 | orchestrator | | 86e03157e64e4ef2b924569e94c26aee | RegionOne | skyline | panel | True | internal | https://api-int.testbed.osism.xyz:9998 | 2026-04-28 04:23:52.626232 | orchestrator | | 9291ed2a486e4735b0fb0070270a7748 | RegionOne | manila | share | True | public | https://api.testbed.osism.xyz:8786/v1/%(tenant_id)s | 2026-04-28 04:23:52.626241 | orchestrator | | 997701cea5e047d6844a3e979a79c8ae | RegionOne | aodh | alarming | True | public | https://api.testbed.osism.xyz:8042 | 2026-04-28 04:23:52.626250 | orchestrator | | 9da5ae47a2e9428f81fa15cd24e20439 | RegionOne | designate | dns | True | internal | https://api-int.testbed.osism.xyz:9001 | 2026-04-28 04:23:52.626259 | orchestrator | | a85f9c418d944b27934d64ba4cbbb75f | RegionOne | cinderv3 | volumev3 | True | public | https://api.testbed.osism.xyz:8776/v3/%(tenant_id)s | 2026-04-28 04:23:52.626268 | orchestrator | | c5535f48c73e4a20aed3c3edf2507b28 | RegionOne | cinderv3 | volumev3 | True | internal | https://api-int.testbed.osism.xyz:8776/v3/%(tenant_id)s | 2026-04-28 04:23:52.626277 | orchestrator | | d8cd3d32a2d946db8a520f4ab5ca1932 | RegionOne | skyline | panel | True | public | https://api.testbed.osism.xyz:9998 | 2026-04-28 04:23:52.626288 | orchestrator | | e0747d5303e24e5baa1a2cf59d12064a | RegionOne | manila | share | True | internal | https://api-int.testbed.osism.xyz:8786/v1/%(tenant_id)s | 2026-04-28 04:23:52.626302 | orchestrator | | e9adaa09bb3d42e1b9e89be6ddc5165b | RegionOne | glance | image | True | internal | https://api-int.testbed.osism.xyz:9292 | 2026-04-28 04:23:52.626336 | orchestrator | | ef2d4dbc6c00485e9852431f8088a268 | RegionOne | octavia | load-balancer | True | public | https://api.testbed.osism.xyz:9876 | 2026-04-28 04:23:52.626363 | orchestrator | | fcb200db9da5425c8bc4fd7d2256a74f | RegionOne | magnum | container-infra | True | public | https://api.testbed.osism.xyz:9511/v1 | 2026-04-28 04:23:52.626377 | orchestrator | +----------------------------------+-----------+--------------+-----------------+---------+-----------+---------------------------------------------------------------------+ 2026-04-28 04:23:52.934758 | orchestrator | 2026-04-28 04:23:52.934879 | orchestrator | # Cinder 2026-04-28 04:23:52.934906 | orchestrator | 2026-04-28 04:23:52.934926 | orchestrator | + echo 2026-04-28 04:23:52.934939 | orchestrator | + echo '# Cinder' 2026-04-28 04:23:52.934950 | orchestrator | + echo 2026-04-28 04:23:52.934962 | orchestrator | + openstack volume service list 2026-04-28 04:23:56.102277 | orchestrator | +------------------+----------------------------+----------+---------+-------+----------------------------+ 2026-04-28 04:23:56.102375 | orchestrator | | Binary | Host | Zone | Status | State | Updated At | 2026-04-28 04:23:56.102387 | orchestrator | +------------------+----------------------------+----------+---------+-------+----------------------------+ 2026-04-28 04:23:56.102393 | orchestrator | | cinder-scheduler | testbed-node-0 | internal | enabled | up | 2026-04-28T04:23:51.000000 | 2026-04-28 04:23:56.102400 | orchestrator | | cinder-scheduler | testbed-node-1 | internal | enabled | up | 2026-04-28T04:23:52.000000 | 2026-04-28 04:23:56.102406 | orchestrator | | cinder-scheduler | testbed-node-2 | internal | enabled | up | 2026-04-28T04:23:52.000000 | 2026-04-28 04:23:56.102412 | orchestrator | | cinder-volume | testbed-node-0@rbd-volumes | nova | enabled | up | 2026-04-28T04:23:51.000000 | 2026-04-28 04:23:56.102440 | orchestrator | | cinder-volume | testbed-node-1@rbd-volumes | nova | enabled | up | 2026-04-28T04:23:49.000000 | 2026-04-28 04:23:56.102446 | orchestrator | | cinder-volume | testbed-node-2@rbd-volumes | nova | enabled | up | 2026-04-28T04:23:50.000000 | 2026-04-28 04:23:56.102452 | orchestrator | | cinder-backup | testbed-node-0 | nova | enabled | up | 2026-04-28T04:23:47.000000 | 2026-04-28 04:23:56.102459 | orchestrator | | cinder-backup | testbed-node-1 | nova | enabled | up | 2026-04-28T04:23:49.000000 | 2026-04-28 04:23:56.102465 | orchestrator | | cinder-backup | testbed-node-2 | nova | enabled | up | 2026-04-28T04:23:51.000000 | 2026-04-28 04:23:56.102471 | orchestrator | +------------------+----------------------------+----------+---------+-------+----------------------------+ 2026-04-28 04:23:56.451861 | orchestrator | 2026-04-28 04:23:56.451943 | orchestrator | # Neutron 2026-04-28 04:23:56.451959 | orchestrator | 2026-04-28 04:23:56.451968 | orchestrator | + echo 2026-04-28 04:23:56.452024 | orchestrator | + echo '# Neutron' 2026-04-28 04:23:56.452034 | orchestrator | + echo 2026-04-28 04:23:56.452043 | orchestrator | + openstack network agent list 2026-04-28 04:23:59.220249 | orchestrator | +--------------------------------------+------------------------------+----------------+-------------------+-------+-------+----------------------------+ 2026-04-28 04:23:59.220388 | orchestrator | | ID | Agent Type | Host | Availability Zone | Alive | State | Binary | 2026-04-28 04:23:59.220403 | orchestrator | +--------------------------------------+------------------------------+----------------+-------------------+-------+-------+----------------------------+ 2026-04-28 04:23:59.220440 | orchestrator | | testbed-node-4 | OVN Controller agent | testbed-node-4 | | :-) | UP | ovn-controller | 2026-04-28 04:23:59.220451 | orchestrator | | testbed-node-5 | OVN Controller agent | testbed-node-5 | | :-) | UP | ovn-controller | 2026-04-28 04:23:59.220461 | orchestrator | | testbed-node-3 | OVN Controller agent | testbed-node-3 | | :-) | UP | ovn-controller | 2026-04-28 04:23:59.220471 | orchestrator | | testbed-node-1 | OVN Controller Gateway agent | testbed-node-1 | nova | :-) | UP | ovn-controller | 2026-04-28 04:23:59.220480 | orchestrator | | testbed-node-0 | OVN Controller Gateway agent | testbed-node-0 | nova | :-) | UP | ovn-controller | 2026-04-28 04:23:59.220490 | orchestrator | | testbed-node-2 | OVN Controller Gateway agent | testbed-node-2 | nova | :-) | UP | ovn-controller | 2026-04-28 04:23:59.220499 | orchestrator | | 36b9d21c-9928-5c0a-9b27-73ac7a3e770c | OVN Metadata agent | testbed-node-5 | | :-) | UP | neutron-ovn-metadata-agent | 2026-04-28 04:23:59.220514 | orchestrator | | e645415a-98f5-5758-8cd1-c47af282b5c0 | OVN Metadata agent | testbed-node-3 | | :-) | UP | neutron-ovn-metadata-agent | 2026-04-28 04:23:59.220531 | orchestrator | | 4939696e-6092-5a33-bb73-b850064684df | OVN Metadata agent | testbed-node-4 | | :-) | UP | neutron-ovn-metadata-agent | 2026-04-28 04:23:59.220548 | orchestrator | +--------------------------------------+------------------------------+----------------+-------------------+-------+-------+----------------------------+ 2026-04-28 04:23:59.620276 | orchestrator | + openstack network service provider list 2026-04-28 04:24:02.450818 | orchestrator | +---------------+------+---------+ 2026-04-28 04:24:02.450902 | orchestrator | | Service Type | Name | Default | 2026-04-28 04:24:02.450908 | orchestrator | +---------------+------+---------+ 2026-04-28 04:24:02.450913 | orchestrator | | L3_ROUTER_NAT | ovn | True | 2026-04-28 04:24:02.450917 | orchestrator | +---------------+------+---------+ 2026-04-28 04:24:02.790129 | orchestrator | 2026-04-28 04:24:02.790234 | orchestrator | # Nova 2026-04-28 04:24:02.790252 | orchestrator | 2026-04-28 04:24:02.790268 | orchestrator | + echo 2026-04-28 04:24:02.790318 | orchestrator | + echo '# Nova' 2026-04-28 04:24:02.790334 | orchestrator | + echo 2026-04-28 04:24:02.790349 | orchestrator | + openstack compute service list 2026-04-28 04:24:05.825471 | orchestrator | +--------------------------------------+----------------+----------------+----------+---------+-------+----------------------------+ 2026-04-28 04:24:05.825563 | orchestrator | | ID | Binary | Host | Zone | Status | State | Updated At | 2026-04-28 04:24:05.825572 | orchestrator | +--------------------------------------+----------------+----------------+----------+---------+-------+----------------------------+ 2026-04-28 04:24:05.825578 | orchestrator | | f1d52eff-8836-4516-b8c0-1d5ada9eaf44 | nova-scheduler | testbed-node-0 | internal | enabled | up | 2026-04-28T04:24:05.000000 | 2026-04-28 04:24:05.825584 | orchestrator | | 59f6e554-64b3-4013-b7ef-93c67e5ab5d7 | nova-scheduler | testbed-node-1 | internal | enabled | up | 2026-04-28T04:24:00.000000 | 2026-04-28 04:24:05.825589 | orchestrator | | 8f3b264e-b971-4753-9905-44019094b8e8 | nova-scheduler | testbed-node-2 | internal | enabled | up | 2026-04-28T04:24:01.000000 | 2026-04-28 04:24:05.825595 | orchestrator | | 968c0306-85fc-4cb0-b6ad-a97ff536cbaa | nova-conductor | testbed-node-0 | internal | enabled | up | 2026-04-28T04:24:01.000000 | 2026-04-28 04:24:05.825600 | orchestrator | | ec0dc2d0-fe49-4a6d-91b9-4f02dec6638d | nova-conductor | testbed-node-1 | internal | enabled | up | 2026-04-28T04:24:03.000000 | 2026-04-28 04:24:05.825606 | orchestrator | | 7771f3c5-8cfe-4654-9275-c05a270e9a4f | nova-conductor | testbed-node-2 | internal | enabled | up | 2026-04-28T04:24:03.000000 | 2026-04-28 04:24:05.825611 | orchestrator | | 7eab1d23-c588-4be5-88dc-2d6545bd5de0 | nova-compute | testbed-node-4 | nova | enabled | up | 2026-04-28T04:23:55.000000 | 2026-04-28 04:24:05.825617 | orchestrator | | 56a396c3-5580-4498-aec1-c2fdb3cd869e | nova-compute | testbed-node-3 | nova | enabled | up | 2026-04-28T04:23:57.000000 | 2026-04-28 04:24:05.825622 | orchestrator | | e749ece8-93a4-4494-bb23-f2b9da2014a0 | nova-compute | testbed-node-5 | nova | enabled | up | 2026-04-28T04:23:58.000000 | 2026-04-28 04:24:05.825628 | orchestrator | +--------------------------------------+----------------+----------------+----------+---------+-------+----------------------------+ 2026-04-28 04:24:06.197210 | orchestrator | + openstack hypervisor list 2026-04-28 04:24:09.002505 | orchestrator | +--------------------------------------+---------------------+-----------------+---------------+-------+ 2026-04-28 04:24:09.002609 | orchestrator | | ID | Hypervisor Hostname | Hypervisor Type | Host IP | State | 2026-04-28 04:24:09.002620 | orchestrator | +--------------------------------------+---------------------+-----------------+---------------+-------+ 2026-04-28 04:24:09.002628 | orchestrator | | 002a496d-d64b-4edb-99f9-ddc868fc16bd | testbed-node-4 | QEMU | 192.168.16.14 | up | 2026-04-28 04:24:09.002639 | orchestrator | | e62fd76e-7c31-42ce-bad8-58b6eb79c589 | testbed-node-3 | QEMU | 192.168.16.13 | up | 2026-04-28 04:24:09.002647 | orchestrator | | cab64296-ea16-431e-ab95-797072768ab0 | testbed-node-5 | QEMU | 192.168.16.15 | up | 2026-04-28 04:24:09.002655 | orchestrator | +--------------------------------------+---------------------+-----------------+---------------+-------+ 2026-04-28 04:24:09.343232 | orchestrator | 2026-04-28 04:24:09.343311 | orchestrator | # Run OpenStack test play 2026-04-28 04:24:09.343324 | orchestrator | 2026-04-28 04:24:09.343335 | orchestrator | + echo 2026-04-28 04:24:09.343344 | orchestrator | + echo '# Run OpenStack test play' 2026-04-28 04:24:09.343355 | orchestrator | + echo 2026-04-28 04:24:09.343363 | orchestrator | + osism apply --environment openstack test 2026-04-28 04:24:11.574155 | orchestrator | 2026-04-28 04:24:11 | INFO  | Trying to run play test in environment openstack 2026-04-28 04:24:21.694291 | orchestrator | 2026-04-28 04:24:21 | INFO  | Task a528b55b-fa79-42c8-bf72-ef25f43f983e (test) was prepared for execution. 2026-04-28 04:24:21.694382 | orchestrator | 2026-04-28 04:24:21 | INFO  | It takes a moment until task a528b55b-fa79-42c8-bf72-ef25f43f983e (test) has been started and output is visible here. 2026-04-28 04:27:31.770104 | orchestrator | 2026-04-28 04:27:31.770249 | orchestrator | PLAY [Create test project] ***************************************************** 2026-04-28 04:27:31.770261 | orchestrator | 2026-04-28 04:27:31.770268 | orchestrator | TASK [Create test domain] ****************************************************** 2026-04-28 04:27:31.770274 | orchestrator | Tuesday 28 April 2026 04:24:26 +0000 (0:00:00.084) 0:00:00.084 ********* 2026-04-28 04:27:31.770280 | orchestrator | changed: [localhost] 2026-04-28 04:27:31.770286 | orchestrator | 2026-04-28 04:27:31.770292 | orchestrator | TASK [Create test-admin user] ************************************************** 2026-04-28 04:27:31.770298 | orchestrator | Tuesday 28 April 2026 04:24:30 +0000 (0:00:03.960) 0:00:04.045 ********* 2026-04-28 04:27:31.770303 | orchestrator | changed: [localhost] 2026-04-28 04:27:31.770308 | orchestrator | 2026-04-28 04:27:31.770314 | orchestrator | TASK [Add manager role to user test-admin] ************************************* 2026-04-28 04:27:31.770319 | orchestrator | Tuesday 28 April 2026 04:24:35 +0000 (0:00:05.076) 0:00:09.122 ********* 2026-04-28 04:27:31.770325 | orchestrator | changed: [localhost] 2026-04-28 04:27:31.770330 | orchestrator | 2026-04-28 04:27:31.770335 | orchestrator | TASK [Create test project] ***************************************************** 2026-04-28 04:27:31.770341 | orchestrator | Tuesday 28 April 2026 04:24:42 +0000 (0:00:07.276) 0:00:16.399 ********* 2026-04-28 04:27:31.770346 | orchestrator | changed: [localhost] 2026-04-28 04:27:31.770352 | orchestrator | 2026-04-28 04:27:31.770358 | orchestrator | TASK [Create test user] ******************************************************** 2026-04-28 04:27:31.770363 | orchestrator | Tuesday 28 April 2026 04:24:47 +0000 (0:00:04.548) 0:00:20.947 ********* 2026-04-28 04:27:31.770368 | orchestrator | changed: [localhost] 2026-04-28 04:27:31.770374 | orchestrator | 2026-04-28 04:27:31.770379 | orchestrator | TASK [Add member roles to user test] ******************************************* 2026-04-28 04:27:31.770385 | orchestrator | Tuesday 28 April 2026 04:24:51 +0000 (0:00:04.357) 0:00:25.304 ********* 2026-04-28 04:27:31.770404 | orchestrator | changed: [localhost] => (item=load-balancer_member) 2026-04-28 04:27:31.770410 | orchestrator | changed: [localhost] => (item=member) 2026-04-28 04:27:31.770416 | orchestrator | changed: [localhost] => (item=creator) 2026-04-28 04:27:31.770421 | orchestrator | 2026-04-28 04:27:31.770427 | orchestrator | TASK [Create test server group] ************************************************ 2026-04-28 04:27:31.770432 | orchestrator | Tuesday 28 April 2026 04:25:04 +0000 (0:00:12.305) 0:00:37.610 ********* 2026-04-28 04:27:31.770438 | orchestrator | changed: [localhost] 2026-04-28 04:27:31.770443 | orchestrator | 2026-04-28 04:27:31.770449 | orchestrator | TASK [Create ssh security group] *********************************************** 2026-04-28 04:27:31.770454 | orchestrator | Tuesday 28 April 2026 04:25:08 +0000 (0:00:04.526) 0:00:42.136 ********* 2026-04-28 04:27:31.770460 | orchestrator | changed: [localhost] 2026-04-28 04:27:31.770465 | orchestrator | 2026-04-28 04:27:31.770471 | orchestrator | TASK [Add rule to ssh security group] ****************************************** 2026-04-28 04:27:31.770476 | orchestrator | Tuesday 28 April 2026 04:25:13 +0000 (0:00:05.172) 0:00:47.309 ********* 2026-04-28 04:27:31.770481 | orchestrator | changed: [localhost] 2026-04-28 04:27:31.770487 | orchestrator | 2026-04-28 04:27:31.770492 | orchestrator | TASK [Create icmp security group] ********************************************** 2026-04-28 04:27:31.770498 | orchestrator | Tuesday 28 April 2026 04:25:18 +0000 (0:00:04.707) 0:00:52.016 ********* 2026-04-28 04:27:31.770503 | orchestrator | changed: [localhost] 2026-04-28 04:27:31.770508 | orchestrator | 2026-04-28 04:27:31.770514 | orchestrator | TASK [Add rule to icmp security group] ***************************************** 2026-04-28 04:27:31.770519 | orchestrator | Tuesday 28 April 2026 04:25:22 +0000 (0:00:04.033) 0:00:56.050 ********* 2026-04-28 04:27:31.770525 | orchestrator | changed: [localhost] 2026-04-28 04:27:31.770530 | orchestrator | 2026-04-28 04:27:31.770536 | orchestrator | TASK [Create test keypair] ***************************************************** 2026-04-28 04:27:31.770541 | orchestrator | Tuesday 28 April 2026 04:25:26 +0000 (0:00:04.212) 0:01:00.263 ********* 2026-04-28 04:27:31.770547 | orchestrator | changed: [localhost] 2026-04-28 04:27:31.770554 | orchestrator | 2026-04-28 04:27:31.770564 | orchestrator | TASK [Create test networks] **************************************************** 2026-04-28 04:27:31.770579 | orchestrator | Tuesday 28 April 2026 04:25:30 +0000 (0:00:04.062) 0:01:04.325 ********* 2026-04-28 04:27:31.770588 | orchestrator | changed: [localhost] => (item={'name': 'test-1'}) 2026-04-28 04:27:31.770600 | orchestrator | changed: [localhost] => (item={'name': 'test-2'}) 2026-04-28 04:27:31.770608 | orchestrator | changed: [localhost] => (item={'name': 'test-3'}) 2026-04-28 04:27:31.770617 | orchestrator | 2026-04-28 04:27:31.770625 | orchestrator | TASK [Create test subnets] ***************************************************** 2026-04-28 04:27:31.770634 | orchestrator | Tuesday 28 April 2026 04:25:44 +0000 (0:00:14.010) 0:01:18.335 ********* 2026-04-28 04:27:31.770644 | orchestrator | changed: [localhost] => (item={'name': 'test-1', 'subnet': 'subnet-test-1', 'cidr': '192.168.200.0/24'}) 2026-04-28 04:27:31.770653 | orchestrator | changed: [localhost] => (item={'name': 'test-2', 'subnet': 'subnet-test-2', 'cidr': '192.168.201.0/24'}) 2026-04-28 04:27:31.770666 | orchestrator | changed: [localhost] => (item={'name': 'test-3', 'subnet': 'subnet-test-3', 'cidr': '192.168.202.0/24'}) 2026-04-28 04:27:31.770675 | orchestrator | 2026-04-28 04:27:31.770683 | orchestrator | TASK [Create test routers] ***************************************************** 2026-04-28 04:27:31.770692 | orchestrator | Tuesday 28 April 2026 04:26:00 +0000 (0:00:15.670) 0:01:34.006 ********* 2026-04-28 04:27:31.770701 | orchestrator | changed: [localhost] => (item={'router': 'router-test-1', 'subnet': 'subnet-test-1'}) 2026-04-28 04:27:31.770710 | orchestrator | changed: [localhost] => (item={'router': 'router-test-2', 'subnet': 'subnet-test-2'}) 2026-04-28 04:27:31.770719 | orchestrator | changed: [localhost] => (item={'router': 'router-test-3', 'subnet': 'subnet-test-3'}) 2026-04-28 04:27:31.770728 | orchestrator | 2026-04-28 04:27:31.770738 | orchestrator | PLAY [Manage test instances and volumes] *************************************** 2026-04-28 04:27:31.770747 | orchestrator | 2026-04-28 04:27:31.770757 | orchestrator | TASK [Get test server group] *************************************************** 2026-04-28 04:27:31.770784 | orchestrator | Tuesday 28 April 2026 04:26:30 +0000 (0:00:29.572) 0:02:03.579 ********* 2026-04-28 04:27:31.770793 | orchestrator | ok: [localhost] 2026-04-28 04:27:31.770800 | orchestrator | 2026-04-28 04:27:31.770806 | orchestrator | TASK [Detach test volume] ****************************************************** 2026-04-28 04:27:31.770812 | orchestrator | Tuesday 28 April 2026 04:26:33 +0000 (0:00:03.863) 0:02:07.443 ********* 2026-04-28 04:27:31.770818 | orchestrator | skipping: [localhost] 2026-04-28 04:27:31.770825 | orchestrator | 2026-04-28 04:27:31.770832 | orchestrator | TASK [Delete test volume] ****************************************************** 2026-04-28 04:27:31.770838 | orchestrator | Tuesday 28 April 2026 04:26:33 +0000 (0:00:00.052) 0:02:07.496 ********* 2026-04-28 04:27:31.770845 | orchestrator | skipping: [localhost] 2026-04-28 04:27:31.770851 | orchestrator | 2026-04-28 04:27:31.770856 | orchestrator | TASK [Delete test instances] *************************************************** 2026-04-28 04:27:31.770862 | orchestrator | Tuesday 28 April 2026 04:26:33 +0000 (0:00:00.053) 0:02:07.550 ********* 2026-04-28 04:27:31.770867 | orchestrator | skipping: [localhost] => (item={'name': 'test-4', 'network': 'test-3'})  2026-04-28 04:27:31.770872 | orchestrator | skipping: [localhost] => (item={'name': 'test-3', 'network': 'test-2'})  2026-04-28 04:27:31.770878 | orchestrator | skipping: [localhost] => (item={'name': 'test-2', 'network': 'test-2'})  2026-04-28 04:27:31.770883 | orchestrator | skipping: [localhost] => (item={'name': 'test-1', 'network': 'test-1'})  2026-04-28 04:27:31.770888 | orchestrator | skipping: [localhost] => (item={'name': 'test', 'network': 'test-1'})  2026-04-28 04:27:31.770894 | orchestrator | skipping: [localhost] 2026-04-28 04:27:31.770899 | orchestrator | 2026-04-28 04:27:31.770904 | orchestrator | TASK [Wait for instance deletion to complete] ********************************** 2026-04-28 04:27:31.770910 | orchestrator | Tuesday 28 April 2026 04:26:34 +0000 (0:00:00.183) 0:02:07.734 ********* 2026-04-28 04:27:31.770915 | orchestrator | skipping: [localhost] 2026-04-28 04:27:31.770921 | orchestrator | 2026-04-28 04:27:31.770926 | orchestrator | TASK [Create test instances] *************************************************** 2026-04-28 04:27:31.770941 | orchestrator | Tuesday 28 April 2026 04:26:34 +0000 (0:00:00.166) 0:02:07.900 ********* 2026-04-28 04:27:31.770950 | orchestrator | changed: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-28 04:27:31.770958 | orchestrator | changed: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-28 04:27:31.770966 | orchestrator | changed: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-28 04:27:31.770974 | orchestrator | changed: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-28 04:27:31.770982 | orchestrator | changed: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-28 04:27:31.770991 | orchestrator | 2026-04-28 04:27:31.770999 | orchestrator | TASK [Wait for instance creation to complete] ********************************** 2026-04-28 04:27:31.771008 | orchestrator | Tuesday 28 April 2026 04:26:39 +0000 (0:00:05.186) 0:02:13.087 ********* 2026-04-28 04:27:31.771017 | orchestrator | FAILED - RETRYING: [localhost]: Wait for instance creation to complete (60 retries left). 2026-04-28 04:27:31.771027 | orchestrator | FAILED - RETRYING: [localhost]: Wait for instance creation to complete (59 retries left). 2026-04-28 04:27:31.771037 | orchestrator | FAILED - RETRYING: [localhost]: Wait for instance creation to complete (58 retries left). 2026-04-28 04:27:31.771046 | orchestrator | FAILED - RETRYING: [localhost]: Wait for instance creation to complete (57 retries left). 2026-04-28 04:27:31.771057 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j823012980936.3873', 'results_file': '/ansible/.ansible_async/j823012980936.3873', 'changed': True, 'item': {'name': 'test', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-28 04:27:31.771070 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j361986216536.3898', 'results_file': '/ansible/.ansible_async/j361986216536.3898', 'changed': True, 'item': {'name': 'test-1', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-28 04:27:31.771079 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j722792684700.3923', 'results_file': '/ansible/.ansible_async/j722792684700.3923', 'changed': True, 'item': {'name': 'test-2', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-28 04:27:31.771095 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j446307146382.3948', 'results_file': '/ansible/.ansible_async/j446307146382.3948', 'changed': True, 'item': {'name': 'test-3', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-28 04:27:31.771101 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j885602876414.3973', 'results_file': '/ansible/.ansible_async/j885602876414.3973', 'changed': True, 'item': {'name': 'test-4', 'network': 'test-3'}, 'ansible_loop_var': 'item'}) 2026-04-28 04:27:31.771107 | orchestrator | 2026-04-28 04:27:31.771116 | orchestrator | TASK [Add metadata to instances] *********************************************** 2026-04-28 04:27:31.771125 | orchestrator | Tuesday 28 April 2026 04:27:26 +0000 (0:00:47.296) 0:03:00.383 ********* 2026-04-28 04:27:31.771134 | orchestrator | changed: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-28 04:27:31.771196 | orchestrator | changed: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-28 04:28:43.652278 | orchestrator | changed: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-28 04:28:43.652451 | orchestrator | changed: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-28 04:28:43.652471 | orchestrator | changed: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-28 04:28:43.652481 | orchestrator | 2026-04-28 04:28:43.652491 | orchestrator | TASK [Wait for metadata to be added] ******************************************* 2026-04-28 04:28:43.652500 | orchestrator | Tuesday 28 April 2026 04:27:31 +0000 (0:00:04.941) 0:03:05.325 ********* 2026-04-28 04:28:43.652539 | orchestrator | FAILED - RETRYING: [localhost]: Wait for metadata to be added (30 retries left). 2026-04-28 04:28:43.652558 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j498211347396.4076', 'results_file': '/ansible/.ansible_async/j498211347396.4076', 'changed': True, 'item': {'name': 'test', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-28 04:28:43.652574 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j291403935586.4101', 'results_file': '/ansible/.ansible_async/j291403935586.4101', 'changed': True, 'item': {'name': 'test-1', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-28 04:28:43.652588 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j77688751484.4126', 'results_file': '/ansible/.ansible_async/j77688751484.4126', 'changed': True, 'item': {'name': 'test-2', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-28 04:28:43.652601 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j961562523971.4151', 'results_file': '/ansible/.ansible_async/j961562523971.4151', 'changed': True, 'item': {'name': 'test-3', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-28 04:28:43.652613 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j516633940798.4176', 'results_file': '/ansible/.ansible_async/j516633940798.4176', 'changed': True, 'item': {'name': 'test-4', 'network': 'test-3'}, 'ansible_loop_var': 'item'}) 2026-04-28 04:28:43.652624 | orchestrator | 2026-04-28 04:28:43.652638 | orchestrator | TASK [Add tag to instances] **************************************************** 2026-04-28 04:28:43.652650 | orchestrator | Tuesday 28 April 2026 04:27:41 +0000 (0:00:10.028) 0:03:15.356 ********* 2026-04-28 04:28:43.652662 | orchestrator | changed: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-28 04:28:43.652673 | orchestrator | changed: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-28 04:28:43.652685 | orchestrator | changed: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-28 04:28:43.652698 | orchestrator | changed: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-28 04:28:43.652710 | orchestrator | changed: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-28 04:28:43.652722 | orchestrator | 2026-04-28 04:28:43.652735 | orchestrator | TASK [Wait for tags to be added] *********************************************** 2026-04-28 04:28:43.652747 | orchestrator | Tuesday 28 April 2026 04:27:47 +0000 (0:00:05.223) 0:03:20.579 ********* 2026-04-28 04:28:43.652760 | orchestrator | FAILED - RETRYING: [localhost]: Wait for tags to be added (30 retries left). 2026-04-28 04:28:43.652774 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j225749655420.4245', 'results_file': '/ansible/.ansible_async/j225749655420.4245', 'changed': True, 'item': {'name': 'test', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-28 04:28:43.652787 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j915058911864.4276', 'results_file': '/ansible/.ansible_async/j915058911864.4276', 'changed': True, 'item': {'name': 'test-1', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-28 04:28:43.652821 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j318861282288.4302', 'results_file': '/ansible/.ansible_async/j318861282288.4302', 'changed': True, 'item': {'name': 'test-2', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-28 04:28:43.652836 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j476519588658.4328', 'results_file': '/ansible/.ansible_async/j476519588658.4328', 'changed': True, 'item': {'name': 'test-3', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-28 04:28:43.652888 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j478836096947.4354', 'results_file': '/ansible/.ansible_async/j478836096947.4354', 'changed': True, 'item': {'name': 'test-4', 'network': 'test-3'}, 'ansible_loop_var': 'item'}) 2026-04-28 04:28:43.652902 | orchestrator | 2026-04-28 04:28:43.652915 | orchestrator | TASK [Create test volume] ****************************************************** 2026-04-28 04:28:43.652929 | orchestrator | Tuesday 28 April 2026 04:27:57 +0000 (0:00:10.368) 0:03:30.948 ********* 2026-04-28 04:28:43.652938 | orchestrator | changed: [localhost] 2026-04-28 04:28:43.652948 | orchestrator | 2026-04-28 04:28:43.652956 | orchestrator | TASK [Attach test volume] ****************************************************** 2026-04-28 04:28:43.652964 | orchestrator | Tuesday 28 April 2026 04:28:04 +0000 (0:00:06.963) 0:03:37.911 ********* 2026-04-28 04:28:43.652972 | orchestrator | changed: [localhost] 2026-04-28 04:28:43.652979 | orchestrator | 2026-04-28 04:28:43.652987 | orchestrator | TASK [Create floating ip addresses] ******************************************** 2026-04-28 04:28:43.652995 | orchestrator | Tuesday 28 April 2026 04:28:18 +0000 (0:00:13.727) 0:03:51.639 ********* 2026-04-28 04:28:43.653004 | orchestrator | ok: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-28 04:28:43.653012 | orchestrator | ok: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-28 04:28:43.653020 | orchestrator | ok: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-28 04:28:43.653028 | orchestrator | ok: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-28 04:28:43.653035 | orchestrator | ok: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-28 04:28:43.653043 | orchestrator | 2026-04-28 04:28:43.653051 | orchestrator | TASK [Print floating ip addresses] ********************************************* 2026-04-28 04:28:43.653059 | orchestrator | Tuesday 28 April 2026 04:28:43 +0000 (0:00:25.078) 0:04:16.718 ********* 2026-04-28 04:28:43.653067 | orchestrator | ok: [localhost] => (item=test) => { 2026-04-28 04:28:43.653075 | orchestrator |  "msg": "test: 192.168.112.192" 2026-04-28 04:28:43.653083 | orchestrator | } 2026-04-28 04:28:43.653092 | orchestrator | ok: [localhost] => (item=test-1) => { 2026-04-28 04:28:43.653101 | orchestrator |  "msg": "test-1: 192.168.112.186" 2026-04-28 04:28:43.653109 | orchestrator | } 2026-04-28 04:28:43.653117 | orchestrator | ok: [localhost] => (item=test-2) => { 2026-04-28 04:28:43.653124 | orchestrator |  "msg": "test-2: 192.168.112.153" 2026-04-28 04:28:43.653132 | orchestrator | } 2026-04-28 04:28:43.653140 | orchestrator | ok: [localhost] => (item=test-3) => { 2026-04-28 04:28:43.653152 | orchestrator |  "msg": "test-3: 192.168.112.100" 2026-04-28 04:28:43.653165 | orchestrator | } 2026-04-28 04:28:43.653178 | orchestrator | ok: [localhost] => (item=test-4) => { 2026-04-28 04:28:43.653217 | orchestrator |  "msg": "test-4: 192.168.112.145" 2026-04-28 04:28:43.653230 | orchestrator | } 2026-04-28 04:28:43.653243 | orchestrator | 2026-04-28 04:28:43.653257 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:28:43.653273 | orchestrator | localhost : ok=26  changed=23  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-28 04:28:43.653288 | orchestrator | 2026-04-28 04:28:43.653298 | orchestrator | 2026-04-28 04:28:43.653306 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 04:28:43.653315 | orchestrator | Tuesday 28 April 2026 04:28:43 +0000 (0:00:00.158) 0:04:16.876 ********* 2026-04-28 04:28:43.653322 | orchestrator | =============================================================================== 2026-04-28 04:28:43.653330 | orchestrator | Wait for instance creation to complete --------------------------------- 47.30s 2026-04-28 04:28:43.653338 | orchestrator | Create test routers ---------------------------------------------------- 29.57s 2026-04-28 04:28:43.653346 | orchestrator | Create floating ip addresses ------------------------------------------- 25.08s 2026-04-28 04:28:43.653354 | orchestrator | Create test subnets ---------------------------------------------------- 15.67s 2026-04-28 04:28:43.653377 | orchestrator | Create test networks --------------------------------------------------- 14.01s 2026-04-28 04:28:43.653391 | orchestrator | Attach test volume ----------------------------------------------------- 13.73s 2026-04-28 04:28:43.653402 | orchestrator | Add member roles to user test ------------------------------------------ 12.31s 2026-04-28 04:28:43.653414 | orchestrator | Wait for tags to be added ---------------------------------------------- 10.37s 2026-04-28 04:28:43.653427 | orchestrator | Wait for metadata to be added ------------------------------------------ 10.03s 2026-04-28 04:28:43.653440 | orchestrator | Add manager role to user test-admin ------------------------------------- 7.28s 2026-04-28 04:28:43.653453 | orchestrator | Create test volume ------------------------------------------------------ 6.96s 2026-04-28 04:28:43.653466 | orchestrator | Add tag to instances ---------------------------------------------------- 5.22s 2026-04-28 04:28:43.653480 | orchestrator | Create test instances --------------------------------------------------- 5.19s 2026-04-28 04:28:43.653494 | orchestrator | Create ssh security group ----------------------------------------------- 5.17s 2026-04-28 04:28:43.653515 | orchestrator | Create test-admin user -------------------------------------------------- 5.08s 2026-04-28 04:28:43.653529 | orchestrator | Add metadata to instances ----------------------------------------------- 4.94s 2026-04-28 04:28:43.653543 | orchestrator | Add rule to ssh security group ------------------------------------------ 4.71s 2026-04-28 04:28:43.653556 | orchestrator | Create test project ----------------------------------------------------- 4.55s 2026-04-28 04:28:43.653568 | orchestrator | Create test server group ------------------------------------------------ 4.53s 2026-04-28 04:28:43.653582 | orchestrator | Create test user -------------------------------------------------------- 4.36s 2026-04-28 04:28:44.047206 | orchestrator | + server_list 2026-04-28 04:28:44.047349 | orchestrator | + openstack --os-cloud test server list 2026-04-28 04:28:47.846646 | orchestrator | +--------------------------------------+--------+--------+-----------------------------------------+--------------------------+----------+ 2026-04-28 04:28:47.846738 | orchestrator | | ID | Name | Status | Networks | Image | Flavor | 2026-04-28 04:28:47.846751 | orchestrator | +--------------------------------------+--------+--------+-----------------------------------------+--------------------------+----------+ 2026-04-28 04:28:47.846761 | orchestrator | | 3b98f333-de2a-4f24-b675-7df3094a053a | test-4 | ACTIVE | test-3=192.168.112.145, 192.168.202.9 | N/A (booted from volume) | SCS-1L-1 | 2026-04-28 04:28:47.846771 | orchestrator | | 4015d761-0309-45a6-b607-f3f64c2b76aa | test-3 | ACTIVE | test-2=192.168.112.100, 192.168.201.65 | N/A (booted from volume) | SCS-1L-1 | 2026-04-28 04:28:47.846780 | orchestrator | | 0b36f9e7-9e53-4847-80d0-bea26dca6a3c | test | ACTIVE | test-1=192.168.112.192, 192.168.200.245 | N/A (booted from volume) | SCS-1L-1 | 2026-04-28 04:28:47.846788 | orchestrator | | 425cac63-54d5-4b17-b7c7-322093929ccd | test-1 | ACTIVE | test-1=192.168.112.186, 192.168.200.143 | N/A (booted from volume) | SCS-1L-1 | 2026-04-28 04:28:47.846797 | orchestrator | | b718a576-bf72-4733-a15e-81732ad456a9 | test-2 | ACTIVE | test-2=192.168.112.153, 192.168.201.246 | N/A (booted from volume) | SCS-1L-1 | 2026-04-28 04:28:47.846806 | orchestrator | +--------------------------------------+--------+--------+-----------------------------------------+--------------------------+----------+ 2026-04-28 04:28:48.194163 | orchestrator | + openstack --os-cloud test server show test 2026-04-28 04:28:51.642471 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 04:28:51.642581 | orchestrator | | Field | Value | 2026-04-28 04:28:51.642623 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 04:28:51.642636 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-28 04:28:51.642649 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-28 04:28:51.642662 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-28 04:28:51.642674 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test | 2026-04-28 04:28:51.642687 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-28 04:28:51.642699 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-28 04:28:51.642727 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-28 04:28:51.642736 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-28 04:28:51.642754 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-28 04:28:51.642762 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-28 04:28:51.642777 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-28 04:28:51.642785 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-28 04:28:51.642822 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-28 04:28:51.642830 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-28 04:28:51.642837 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-28 04:28:51.642845 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-28T04:27:10.000000 | 2026-04-28 04:28:51.642858 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-28 04:28:51.642872 | orchestrator | | accessIPv4 | | 2026-04-28 04:28:51.642879 | orchestrator | | accessIPv6 | | 2026-04-28 04:28:51.642887 | orchestrator | | addresses | test-1=192.168.112.192, 192.168.200.245 | 2026-04-28 04:28:51.642894 | orchestrator | | config_drive | | 2026-04-28 04:28:51.642902 | orchestrator | | created | 2026-04-28T04:26:44Z | 2026-04-28 04:28:51.642913 | orchestrator | | description | None | 2026-04-28 04:28:51.642921 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-28 04:28:51.642928 | orchestrator | | hostId | 76db464fef8bcf34a95a14fa14980f46148158759396db2434bda2ec | 2026-04-28 04:28:51.642936 | orchestrator | | host_status | None | 2026-04-28 04:28:51.642949 | orchestrator | | id | 0b36f9e7-9e53-4847-80d0-bea26dca6a3c | 2026-04-28 04:28:51.642962 | orchestrator | | image | N/A (booted from volume) | 2026-04-28 04:28:51.642970 | orchestrator | | key_name | test | 2026-04-28 04:28:51.642977 | orchestrator | | locked | False | 2026-04-28 04:28:51.642985 | orchestrator | | locked_reason | None | 2026-04-28 04:28:51.642992 | orchestrator | | name | test | 2026-04-28 04:28:51.643004 | orchestrator | | pinned_availability_zone | None | 2026-04-28 04:28:51.643012 | orchestrator | | progress | 0 | 2026-04-28 04:28:51.643019 | orchestrator | | project_id | 3ee3aae67c9c44e9a61b3acbf06b1805 | 2026-04-28 04:28:51.643026 | orchestrator | | properties | hostname='test' | 2026-04-28 04:28:51.643050 | orchestrator | | security_groups | name='icmp' | 2026-04-28 04:28:51.643063 | orchestrator | | | name='ssh' | 2026-04-28 04:28:51.643076 | orchestrator | | server_groups | None | 2026-04-28 04:28:51.643088 | orchestrator | | status | ACTIVE | 2026-04-28 04:28:51.643098 | orchestrator | | tags | test | 2026-04-28 04:28:51.643105 | orchestrator | | trusted_image_certificates | None | 2026-04-28 04:28:51.643121 | orchestrator | | updated | 2026-04-28T04:27:33Z | 2026-04-28 04:28:51.643130 | orchestrator | | user_id | 01939d95acb94c56b03f62633390a42e | 2026-04-28 04:28:51.643140 | orchestrator | | volumes_attached | delete_on_termination='True', id='d97fef32-5bbe-437f-8dd7-3fa7e29ddcfa' | 2026-04-28 04:28:51.643158 | orchestrator | | | delete_on_termination='False', id='948e6705-2939-4d11-9772-e264b005fee2' | 2026-04-28 04:28:51.646428 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 04:28:52.003774 | orchestrator | + openstack --os-cloud test server show test-1 2026-04-28 04:28:55.194954 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 04:28:55.195057 | orchestrator | | Field | Value | 2026-04-28 04:28:55.195072 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 04:28:55.195085 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-28 04:28:55.195101 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-28 04:28:55.195121 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-28 04:28:55.195133 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-1 | 2026-04-28 04:28:55.195163 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-28 04:28:55.195174 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-28 04:28:55.195235 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-28 04:28:55.195249 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-28 04:28:55.195261 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-28 04:28:55.195273 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-28 04:28:55.195285 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-28 04:28:55.195296 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-28 04:28:55.195308 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-28 04:28:55.195328 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-28 04:28:55.195337 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-28 04:28:55.195344 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-28T04:27:09.000000 | 2026-04-28 04:28:55.195357 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-28 04:28:55.195364 | orchestrator | | accessIPv4 | | 2026-04-28 04:28:55.195370 | orchestrator | | accessIPv6 | | 2026-04-28 04:28:55.195376 | orchestrator | | addresses | test-1=192.168.112.186, 192.168.200.143 | 2026-04-28 04:28:55.195390 | orchestrator | | config_drive | | 2026-04-28 04:28:55.195399 | orchestrator | | created | 2026-04-28T04:26:44Z | 2026-04-28 04:28:55.195406 | orchestrator | | description | None | 2026-04-28 04:28:55.195416 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-28 04:28:55.195424 | orchestrator | | hostId | 76db464fef8bcf34a95a14fa14980f46148158759396db2434bda2ec | 2026-04-28 04:28:55.195430 | orchestrator | | host_status | None | 2026-04-28 04:28:55.195443 | orchestrator | | id | 425cac63-54d5-4b17-b7c7-322093929ccd | 2026-04-28 04:28:55.195449 | orchestrator | | image | N/A (booted from volume) | 2026-04-28 04:28:55.195456 | orchestrator | | key_name | test | 2026-04-28 04:28:55.195462 | orchestrator | | locked | False | 2026-04-28 04:28:55.195468 | orchestrator | | locked_reason | None | 2026-04-28 04:28:55.195478 | orchestrator | | name | test-1 | 2026-04-28 04:28:55.195489 | orchestrator | | pinned_availability_zone | None | 2026-04-28 04:28:55.195495 | orchestrator | | progress | 0 | 2026-04-28 04:28:55.195505 | orchestrator | | project_id | 3ee3aae67c9c44e9a61b3acbf06b1805 | 2026-04-28 04:28:55.195517 | orchestrator | | properties | hostname='test-1' | 2026-04-28 04:28:55.195540 | orchestrator | | security_groups | name='icmp' | 2026-04-28 04:28:55.195556 | orchestrator | | | name='ssh' | 2026-04-28 04:28:55.195566 | orchestrator | | server_groups | None | 2026-04-28 04:28:55.195576 | orchestrator | | status | ACTIVE | 2026-04-28 04:28:55.195585 | orchestrator | | tags | test | 2026-04-28 04:28:55.195605 | orchestrator | | trusted_image_certificates | None | 2026-04-28 04:28:55.195615 | orchestrator | | updated | 2026-04-28T04:27:33Z | 2026-04-28 04:28:55.195625 | orchestrator | | user_id | 01939d95acb94c56b03f62633390a42e | 2026-04-28 04:28:55.195634 | orchestrator | | volumes_attached | delete_on_termination='True', id='9d1a692b-af24-4ab6-bf18-86747834d1bd' | 2026-04-28 04:28:55.200383 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 04:28:55.544586 | orchestrator | + openstack --os-cloud test server show test-2 2026-04-28 04:28:58.740175 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 04:28:58.740324 | orchestrator | | Field | Value | 2026-04-28 04:28:58.740351 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 04:28:58.740371 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-28 04:28:58.740421 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-28 04:28:58.740461 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-28 04:28:58.740481 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-2 | 2026-04-28 04:28:58.740500 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-28 04:28:58.740512 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-28 04:28:58.740542 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-28 04:28:58.740554 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-28 04:28:58.740566 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-28 04:28:58.740577 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-28 04:28:58.740588 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-28 04:28:58.740609 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-28 04:28:58.740626 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-28 04:28:58.740638 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-28 04:28:58.740649 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-28 04:28:58.740661 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-28T04:27:12.000000 | 2026-04-28 04:28:58.740679 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-28 04:28:58.740710 | orchestrator | | accessIPv4 | | 2026-04-28 04:28:58.740735 | orchestrator | | accessIPv6 | | 2026-04-28 04:28:58.740748 | orchestrator | | addresses | test-2=192.168.112.153, 192.168.201.246 | 2026-04-28 04:28:58.740768 | orchestrator | | config_drive | | 2026-04-28 04:28:58.740782 | orchestrator | | created | 2026-04-28T04:26:44Z | 2026-04-28 04:28:58.740799 | orchestrator | | description | None | 2026-04-28 04:28:58.740812 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-28 04:28:58.740825 | orchestrator | | hostId | 4ada80ef42e3be16388b3a29f82c13bab85a7010f9aa0d0b984a7304 | 2026-04-28 04:28:58.740838 | orchestrator | | host_status | None | 2026-04-28 04:28:58.740860 | orchestrator | | id | b718a576-bf72-4733-a15e-81732ad456a9 | 2026-04-28 04:28:58.740874 | orchestrator | | image | N/A (booted from volume) | 2026-04-28 04:28:58.740887 | orchestrator | | key_name | test | 2026-04-28 04:28:58.740906 | orchestrator | | locked | False | 2026-04-28 04:28:58.740919 | orchestrator | | locked_reason | None | 2026-04-28 04:28:58.740932 | orchestrator | | name | test-2 | 2026-04-28 04:28:58.740946 | orchestrator | | pinned_availability_zone | None | 2026-04-28 04:28:58.740959 | orchestrator | | progress | 0 | 2026-04-28 04:28:58.740972 | orchestrator | | project_id | 3ee3aae67c9c44e9a61b3acbf06b1805 | 2026-04-28 04:28:58.740985 | orchestrator | | properties | hostname='test-2' | 2026-04-28 04:28:58.741005 | orchestrator | | security_groups | name='icmp' | 2026-04-28 04:28:58.741018 | orchestrator | | | name='ssh' | 2026-04-28 04:28:58.741541 | orchestrator | | server_groups | None | 2026-04-28 04:28:58.741575 | orchestrator | | status | ACTIVE | 2026-04-28 04:28:58.741587 | orchestrator | | tags | test | 2026-04-28 04:28:58.741599 | orchestrator | | trusted_image_certificates | None | 2026-04-28 04:28:58.741610 | orchestrator | | updated | 2026-04-28T04:27:34Z | 2026-04-28 04:28:58.741621 | orchestrator | | user_id | 01939d95acb94c56b03f62633390a42e | 2026-04-28 04:28:58.741633 | orchestrator | | volumes_attached | delete_on_termination='True', id='70745b11-68b2-434a-85d8-b838b55a6f78' | 2026-04-28 04:28:58.743856 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 04:28:59.082944 | orchestrator | + openstack --os-cloud test server show test-3 2026-04-28 04:29:02.228482 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 04:29:02.228607 | orchestrator | | Field | Value | 2026-04-28 04:29:02.228640 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 04:29:02.228657 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-28 04:29:02.228667 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-28 04:29:02.228676 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-28 04:29:02.228687 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-3 | 2026-04-28 04:29:02.228701 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-28 04:29:02.228718 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-28 04:29:02.228762 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-28 04:29:02.228778 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-28 04:29:02.228804 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-28 04:29:02.228827 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-28 04:29:02.228843 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-28 04:29:02.228858 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-28 04:29:02.228873 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-28 04:29:02.228887 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-28 04:29:02.228902 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-28 04:29:02.228916 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-28T04:27:11.000000 | 2026-04-28 04:29:02.228934 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-28 04:29:02.228950 | orchestrator | | accessIPv4 | | 2026-04-28 04:29:02.228960 | orchestrator | | accessIPv6 | | 2026-04-28 04:29:02.228973 | orchestrator | | addresses | test-2=192.168.112.100, 192.168.201.65 | 2026-04-28 04:29:02.228983 | orchestrator | | config_drive | | 2026-04-28 04:29:02.228992 | orchestrator | | created | 2026-04-28T04:26:45Z | 2026-04-28 04:29:02.229001 | orchestrator | | description | None | 2026-04-28 04:29:02.229010 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-28 04:29:02.229019 | orchestrator | | hostId | 4ada80ef42e3be16388b3a29f82c13bab85a7010f9aa0d0b984a7304 | 2026-04-28 04:29:02.229028 | orchestrator | | host_status | None | 2026-04-28 04:29:02.229048 | orchestrator | | id | 4015d761-0309-45a6-b607-f3f64c2b76aa | 2026-04-28 04:29:02.229058 | orchestrator | | image | N/A (booted from volume) | 2026-04-28 04:29:02.229067 | orchestrator | | key_name | test | 2026-04-28 04:29:02.229080 | orchestrator | | locked | False | 2026-04-28 04:29:02.229089 | orchestrator | | locked_reason | None | 2026-04-28 04:29:02.229098 | orchestrator | | name | test-3 | 2026-04-28 04:29:02.229107 | orchestrator | | pinned_availability_zone | None | 2026-04-28 04:29:02.229116 | orchestrator | | progress | 0 | 2026-04-28 04:29:02.229125 | orchestrator | | project_id | 3ee3aae67c9c44e9a61b3acbf06b1805 | 2026-04-28 04:29:02.229139 | orchestrator | | properties | hostname='test-3' | 2026-04-28 04:29:02.229155 | orchestrator | | security_groups | name='icmp' | 2026-04-28 04:29:02.229164 | orchestrator | | | name='ssh' | 2026-04-28 04:29:02.229173 | orchestrator | | server_groups | None | 2026-04-28 04:29:02.229187 | orchestrator | | status | ACTIVE | 2026-04-28 04:29:02.229220 | orchestrator | | tags | test | 2026-04-28 04:29:02.229231 | orchestrator | | trusted_image_certificates | None | 2026-04-28 04:29:02.229240 | orchestrator | | updated | 2026-04-28T04:27:35Z | 2026-04-28 04:29:02.229249 | orchestrator | | user_id | 01939d95acb94c56b03f62633390a42e | 2026-04-28 04:29:02.229258 | orchestrator | | volumes_attached | delete_on_termination='True', id='8c2ed2ce-3797-4892-b980-9cba2da022d9' | 2026-04-28 04:29:02.233891 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 04:29:02.584253 | orchestrator | + openstack --os-cloud test server show test-4 2026-04-28 04:29:05.733612 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 04:29:05.733734 | orchestrator | | Field | Value | 2026-04-28 04:29:05.733764 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 04:29:05.733797 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-28 04:29:05.733818 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-28 04:29:05.733839 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-28 04:29:05.733861 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-4 | 2026-04-28 04:29:05.733876 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-28 04:29:05.733906 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-28 04:29:05.733936 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-28 04:29:05.733948 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-28 04:29:05.733960 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-28 04:29:05.733971 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-28 04:29:05.733983 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-28 04:29:05.733994 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-28 04:29:05.734006 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-28 04:29:05.734120 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-28 04:29:05.734158 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-28 04:29:05.734179 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-28T04:27:11.000000 | 2026-04-28 04:29:05.734307 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-28 04:29:05.734339 | orchestrator | | accessIPv4 | | 2026-04-28 04:29:05.734353 | orchestrator | | accessIPv6 | | 2026-04-28 04:29:05.734367 | orchestrator | | addresses | test-3=192.168.112.145, 192.168.202.9 | 2026-04-28 04:29:05.734384 | orchestrator | | config_drive | | 2026-04-28 04:29:05.734397 | orchestrator | | created | 2026-04-28T04:26:46Z | 2026-04-28 04:29:05.734411 | orchestrator | | description | None | 2026-04-28 04:29:05.734433 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-28 04:29:05.734446 | orchestrator | | hostId | 531b8e71fa9c5a69c7d8d609cf7fe45b1eca13e44aa7c59fe4723c86 | 2026-04-28 04:29:05.734459 | orchestrator | | host_status | None | 2026-04-28 04:29:05.734481 | orchestrator | | id | 3b98f333-de2a-4f24-b675-7df3094a053a | 2026-04-28 04:29:05.734495 | orchestrator | | image | N/A (booted from volume) | 2026-04-28 04:29:05.734508 | orchestrator | | key_name | test | 2026-04-28 04:29:05.734520 | orchestrator | | locked | False | 2026-04-28 04:29:05.734535 | orchestrator | | locked_reason | None | 2026-04-28 04:29:05.734547 | orchestrator | | name | test-4 | 2026-04-28 04:29:05.734564 | orchestrator | | pinned_availability_zone | None | 2026-04-28 04:29:05.734576 | orchestrator | | progress | 0 | 2026-04-28 04:29:05.734587 | orchestrator | | project_id | 3ee3aae67c9c44e9a61b3acbf06b1805 | 2026-04-28 04:29:05.734598 | orchestrator | | properties | hostname='test-4' | 2026-04-28 04:29:05.734618 | orchestrator | | security_groups | name='icmp' | 2026-04-28 04:29:05.734638 | orchestrator | | | name='ssh' | 2026-04-28 04:29:05.734666 | orchestrator | | server_groups | None | 2026-04-28 04:29:05.734695 | orchestrator | | status | ACTIVE | 2026-04-28 04:29:05.734714 | orchestrator | | tags | test | 2026-04-28 04:29:05.734731 | orchestrator | | trusted_image_certificates | None | 2026-04-28 04:29:05.734760 | orchestrator | | updated | 2026-04-28T04:27:35Z | 2026-04-28 04:29:05.734778 | orchestrator | | user_id | 01939d95acb94c56b03f62633390a42e | 2026-04-28 04:29:05.734796 | orchestrator | | volumes_attached | delete_on_termination='True', id='bc06f08a-b2b0-4766-9278-85a30dad4a98' | 2026-04-28 04:29:05.736146 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 04:29:05.933120 | orchestrator | + server_ping 2026-04-28 04:29:05.933787 | orchestrator | ++ openstack --os-cloud test floating ip list --status ACTIVE -f value -c 'Floating IP Address' 2026-04-28 04:29:05.933829 | orchestrator | ++ tr -d '\r' 2026-04-28 04:29:08.895576 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-28 04:29:08.896174 | orchestrator | + ping -c3 192.168.112.192 2026-04-28 04:29:08.911634 | orchestrator | PING 192.168.112.192 (192.168.112.192) 56(84) bytes of data. 2026-04-28 04:29:08.911734 | orchestrator | 64 bytes from 192.168.112.192: icmp_seq=1 ttl=63 time=6.57 ms 2026-04-28 04:29:09.909906 | orchestrator | 64 bytes from 192.168.112.192: icmp_seq=2 ttl=63 time=2.74 ms 2026-04-28 04:29:10.910804 | orchestrator | 64 bytes from 192.168.112.192: icmp_seq=3 ttl=63 time=1.93 ms 2026-04-28 04:29:10.910893 | orchestrator | 2026-04-28 04:29:10.910905 | orchestrator | --- 192.168.112.192 ping statistics --- 2026-04-28 04:29:10.910914 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2004ms 2026-04-28 04:29:10.910922 | orchestrator | rtt min/avg/max/mdev = 1.927/3.746/6.568/2.022 ms 2026-04-28 04:29:10.911431 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-28 04:29:10.911448 | orchestrator | + ping -c3 192.168.112.145 2026-04-28 04:29:10.924886 | orchestrator | PING 192.168.112.145 (192.168.112.145) 56(84) bytes of data. 2026-04-28 04:29:10.924976 | orchestrator | 64 bytes from 192.168.112.145: icmp_seq=1 ttl=63 time=7.50 ms 2026-04-28 04:29:11.921173 | orchestrator | 64 bytes from 192.168.112.145: icmp_seq=2 ttl=63 time=2.63 ms 2026-04-28 04:29:12.923414 | orchestrator | 64 bytes from 192.168.112.145: icmp_seq=3 ttl=63 time=1.90 ms 2026-04-28 04:29:12.923509 | orchestrator | 2026-04-28 04:29:12.923523 | orchestrator | --- 192.168.112.145 ping statistics --- 2026-04-28 04:29:12.923535 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2003ms 2026-04-28 04:29:12.923544 | orchestrator | rtt min/avg/max/mdev = 1.902/4.010/7.503/2.487 ms 2026-04-28 04:29:12.923554 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-28 04:29:12.923589 | orchestrator | + ping -c3 192.168.112.153 2026-04-28 04:29:12.936373 | orchestrator | PING 192.168.112.153 (192.168.112.153) 56(84) bytes of data. 2026-04-28 04:29:12.936468 | orchestrator | 64 bytes from 192.168.112.153: icmp_seq=1 ttl=63 time=7.42 ms 2026-04-28 04:29:13.933276 | orchestrator | 64 bytes from 192.168.112.153: icmp_seq=2 ttl=63 time=2.90 ms 2026-04-28 04:29:14.933948 | orchestrator | 64 bytes from 192.168.112.153: icmp_seq=3 ttl=63 time=1.91 ms 2026-04-28 04:29:14.934108 | orchestrator | 2026-04-28 04:29:14.934131 | orchestrator | --- 192.168.112.153 ping statistics --- 2026-04-28 04:29:14.934176 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2003ms 2026-04-28 04:29:14.934191 | orchestrator | rtt min/avg/max/mdev = 1.907/4.076/7.422/2.400 ms 2026-04-28 04:29:14.934287 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-28 04:29:14.934305 | orchestrator | + ping -c3 192.168.112.186 2026-04-28 04:29:14.943552 | orchestrator | PING 192.168.112.186 (192.168.112.186) 56(84) bytes of data. 2026-04-28 04:29:14.943637 | orchestrator | 64 bytes from 192.168.112.186: icmp_seq=1 ttl=63 time=6.11 ms 2026-04-28 04:29:15.941470 | orchestrator | 64 bytes from 192.168.112.186: icmp_seq=2 ttl=63 time=2.43 ms 2026-04-28 04:29:16.942765 | orchestrator | 64 bytes from 192.168.112.186: icmp_seq=3 ttl=63 time=1.97 ms 2026-04-28 04:29:16.943054 | orchestrator | 2026-04-28 04:29:16.943098 | orchestrator | --- 192.168.112.186 ping statistics --- 2026-04-28 04:29:16.943117 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2003ms 2026-04-28 04:29:16.943129 | orchestrator | rtt min/avg/max/mdev = 1.965/3.500/6.108/1.853 ms 2026-04-28 04:29:16.943154 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-28 04:29:16.943167 | orchestrator | + ping -c3 192.168.112.100 2026-04-28 04:29:16.956039 | orchestrator | PING 192.168.112.100 (192.168.112.100) 56(84) bytes of data. 2026-04-28 04:29:16.956120 | orchestrator | 64 bytes from 192.168.112.100: icmp_seq=1 ttl=63 time=8.58 ms 2026-04-28 04:29:17.952456 | orchestrator | 64 bytes from 192.168.112.100: icmp_seq=2 ttl=63 time=2.74 ms 2026-04-28 04:29:18.953696 | orchestrator | 64 bytes from 192.168.112.100: icmp_seq=3 ttl=63 time=2.06 ms 2026-04-28 04:29:18.953795 | orchestrator | 2026-04-28 04:29:18.953828 | orchestrator | --- 192.168.112.100 ping statistics --- 2026-04-28 04:29:18.953842 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2003ms 2026-04-28 04:29:18.953854 | orchestrator | rtt min/avg/max/mdev = 2.061/4.459/8.580/2.926 ms 2026-04-28 04:29:18.953866 | orchestrator | + [[ 9.5.0 == \l\a\t\e\s\t ]] 2026-04-28 04:29:19.065059 | orchestrator | ok: Runtime: 0:12:52.661154 2026-04-28 04:29:19.132011 | 2026-04-28 04:29:19.132207 | TASK [Run tempest] 2026-04-28 04:29:19.667954 | orchestrator | skipping: Conditional result was False 2026-04-28 04:29:19.685624 | 2026-04-28 04:29:19.685781 | TASK [Check prometheus alert status] 2026-04-28 04:29:20.221657 | orchestrator | skipping: Conditional result was False 2026-04-28 04:29:20.232841 | 2026-04-28 04:29:20.232993 | PLAY [Upgrade testbed] 2026-04-28 04:29:20.242600 | 2026-04-28 04:29:20.242709 | TASK [Print next ceph version] 2026-04-28 04:29:20.319455 | orchestrator | ok 2026-04-28 04:29:20.330859 | 2026-04-28 04:29:20.331022 | TASK [Print next openstack version] 2026-04-28 04:29:20.420471 | orchestrator | ok 2026-04-28 04:29:20.432798 | 2026-04-28 04:29:20.433011 | TASK [Print next manager version] 2026-04-28 04:29:20.510290 | orchestrator | ok 2026-04-28 04:29:20.519682 | 2026-04-28 04:29:20.519808 | TASK [Set cloud fact (Zuul deployment)] 2026-04-28 04:29:20.577220 | orchestrator | ok 2026-04-28 04:29:20.588937 | 2026-04-28 04:29:20.589063 | TASK [Set cloud fact (local deployment)] 2026-04-28 04:29:20.614692 | orchestrator | skipping: Conditional result was False 2026-04-28 04:29:20.626738 | 2026-04-28 04:29:20.626888 | TASK [Fetch manager address] 2026-04-28 04:29:20.900841 | orchestrator | ok 2026-04-28 04:29:20.910650 | 2026-04-28 04:29:20.910773 | TASK [Set manager_host address] 2026-04-28 04:29:20.989729 | orchestrator | ok 2026-04-28 04:29:21.000360 | 2026-04-28 04:29:21.000476 | TASK [Run upgrade] 2026-04-28 04:29:21.717070 | orchestrator | + set -e 2026-04-28 04:29:21.717199 | orchestrator | + export MANAGER_VERSION=10.0.0 2026-04-28 04:29:21.717228 | orchestrator | + MANAGER_VERSION=10.0.0 2026-04-28 04:29:21.717236 | orchestrator | + CEPH_VERSION=reef 2026-04-28 04:29:21.717242 | orchestrator | + OPENSTACK_VERSION=2024.2 2026-04-28 04:29:21.717247 | orchestrator | + KOLLA_NAMESPACE=kolla/release 2026-04-28 04:29:21.717254 | orchestrator | + sh -c '/opt/configuration/scripts/upgrade-manager.sh 10.0.0 reef 2024.2 kolla/release' 2026-04-28 04:29:21.727302 | orchestrator | + set -e 2026-04-28 04:29:21.727399 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-28 04:29:21.727416 | orchestrator | ++ export INTERACTIVE=false 2026-04-28 04:29:21.727434 | orchestrator | ++ INTERACTIVE=false 2026-04-28 04:29:21.727443 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-28 04:29:21.727455 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-28 04:29:21.728807 | orchestrator | ++ docker inspect --format '{{ index .Config.Labels "org.opencontainers.image.version"}}' osism-ansible 2026-04-28 04:29:21.772122 | orchestrator | + OLD_MANAGER_VERSION=v0.20251130.0 2026-04-28 04:29:21.773103 | orchestrator | ++ docker inspect --format '{{ index .Config.Labels "de.osism.release.openstack"}}' kolla-ansible 2026-04-28 04:29:21.813974 | orchestrator | 2026-04-28 04:29:21.814090 | orchestrator | # UPGRADE MANAGER 2026-04-28 04:29:21.814100 | orchestrator | 2026-04-28 04:29:21.814104 | orchestrator | + OLD_OPENSTACK_VERSION=2024.2 2026-04-28 04:29:21.814109 | orchestrator | + echo 2026-04-28 04:29:21.814116 | orchestrator | + echo '# UPGRADE MANAGER' 2026-04-28 04:29:21.814120 | orchestrator | + echo 2026-04-28 04:29:21.814124 | orchestrator | + export MANAGER_VERSION=10.0.0 2026-04-28 04:29:21.814128 | orchestrator | + MANAGER_VERSION=10.0.0 2026-04-28 04:29:21.814132 | orchestrator | + CEPH_VERSION=reef 2026-04-28 04:29:21.814136 | orchestrator | + OPENSTACK_VERSION=2024.2 2026-04-28 04:29:21.814140 | orchestrator | + KOLLA_NAMESPACE=kolla/release 2026-04-28 04:29:21.814144 | orchestrator | + /opt/configuration/scripts/set-manager-version.sh 10.0.0 2026-04-28 04:29:21.822342 | orchestrator | + set -e 2026-04-28 04:29:21.822490 | orchestrator | + VERSION=10.0.0 2026-04-28 04:29:21.822516 | orchestrator | + sed -i 's/manager_version: .*/manager_version: 10.0.0/g' /opt/configuration/environments/manager/configuration.yml 2026-04-28 04:29:21.828064 | orchestrator | + [[ 10.0.0 != \l\a\t\e\s\t ]] 2026-04-28 04:29:21.828133 | orchestrator | + sed -i /ceph_version:/d /opt/configuration/environments/manager/configuration.yml 2026-04-28 04:29:21.831422 | orchestrator | + sed -i /openstack_version:/d /opt/configuration/environments/manager/configuration.yml 2026-04-28 04:29:21.837673 | orchestrator | + sh -c /opt/configuration/scripts/sync-configuration-repository.sh 2026-04-28 04:29:21.849131 | orchestrator | /opt/configuration ~ 2026-04-28 04:29:21.849416 | orchestrator | + set -e 2026-04-28 04:29:21.849455 | orchestrator | + pushd /opt/configuration 2026-04-28 04:29:21.849473 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-28 04:29:21.849493 | orchestrator | + source /opt/venv/bin/activate 2026-04-28 04:29:21.850780 | orchestrator | ++ deactivate nondestructive 2026-04-28 04:29:21.850808 | orchestrator | ++ '[' -n '' ']' 2026-04-28 04:29:21.850818 | orchestrator | ++ '[' -n '' ']' 2026-04-28 04:29:21.850828 | orchestrator | ++ hash -r 2026-04-28 04:29:21.850838 | orchestrator | ++ '[' -n '' ']' 2026-04-28 04:29:21.850848 | orchestrator | ++ unset VIRTUAL_ENV 2026-04-28 04:29:21.850857 | orchestrator | ++ unset VIRTUAL_ENV_PROMPT 2026-04-28 04:29:21.850867 | orchestrator | ++ '[' '!' nondestructive = nondestructive ']' 2026-04-28 04:29:21.850879 | orchestrator | ++ '[' linux-gnu = cygwin ']' 2026-04-28 04:29:21.850889 | orchestrator | ++ '[' linux-gnu = msys ']' 2026-04-28 04:29:21.850899 | orchestrator | ++ export VIRTUAL_ENV=/opt/venv 2026-04-28 04:29:21.850908 | orchestrator | ++ VIRTUAL_ENV=/opt/venv 2026-04-28 04:29:21.850919 | orchestrator | ++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-28 04:29:21.850930 | orchestrator | ++ PATH=/opt/venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-28 04:29:21.850939 | orchestrator | ++ export PATH 2026-04-28 04:29:21.851047 | orchestrator | ++ '[' -n '' ']' 2026-04-28 04:29:21.851061 | orchestrator | ++ '[' -z '' ']' 2026-04-28 04:29:21.851071 | orchestrator | ++ _OLD_VIRTUAL_PS1= 2026-04-28 04:29:21.851081 | orchestrator | ++ PS1='(venv) ' 2026-04-28 04:29:21.851091 | orchestrator | ++ export PS1 2026-04-28 04:29:21.851101 | orchestrator | ++ VIRTUAL_ENV_PROMPT='(venv) ' 2026-04-28 04:29:21.851110 | orchestrator | ++ export VIRTUAL_ENV_PROMPT 2026-04-28 04:29:21.851120 | orchestrator | ++ hash -r 2026-04-28 04:29:21.851135 | orchestrator | + pip3 install --no-cache-dir python-gilt==1.2.3 requests Jinja2 PyYAML packaging 2026-04-28 04:29:23.314544 | orchestrator | Requirement already satisfied: python-gilt==1.2.3 in /opt/venv/lib/python3.12/site-packages (1.2.3) 2026-04-28 04:29:23.315285 | orchestrator | Requirement already satisfied: requests in /opt/venv/lib/python3.12/site-packages (2.33.1) 2026-04-28 04:29:23.317325 | orchestrator | Requirement already satisfied: Jinja2 in /opt/venv/lib/python3.12/site-packages (3.1.6) 2026-04-28 04:29:23.319025 | orchestrator | Requirement already satisfied: PyYAML in /opt/venv/lib/python3.12/site-packages (6.0.3) 2026-04-28 04:29:23.320629 | orchestrator | Requirement already satisfied: packaging in /opt/venv/lib/python3.12/site-packages (26.2) 2026-04-28 04:29:23.334700 | orchestrator | Requirement already satisfied: click in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (8.3.3) 2026-04-28 04:29:23.337110 | orchestrator | Requirement already satisfied: colorama in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (0.4.6) 2026-04-28 04:29:23.338376 | orchestrator | Requirement already satisfied: fasteners in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (0.20) 2026-04-28 04:29:23.340288 | orchestrator | Requirement already satisfied: sh in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (2.2.2) 2026-04-28 04:29:23.407050 | orchestrator | Requirement already satisfied: charset_normalizer<4,>=2 in /opt/venv/lib/python3.12/site-packages (from requests) (3.4.7) 2026-04-28 04:29:23.410566 | orchestrator | Requirement already satisfied: idna<4,>=2.5 in /opt/venv/lib/python3.12/site-packages (from requests) (3.13) 2026-04-28 04:29:23.414492 | orchestrator | Requirement already satisfied: urllib3<3,>=1.26 in /opt/venv/lib/python3.12/site-packages (from requests) (2.6.3) 2026-04-28 04:29:23.417510 | orchestrator | Requirement already satisfied: certifi>=2023.5.7 in /opt/venv/lib/python3.12/site-packages (from requests) (2026.4.22) 2026-04-28 04:29:23.424825 | orchestrator | Requirement already satisfied: MarkupSafe>=2.0 in /opt/venv/lib/python3.12/site-packages (from Jinja2) (3.0.3) 2026-04-28 04:29:23.771067 | orchestrator | ++ which gilt 2026-04-28 04:29:23.772675 | orchestrator | + GILT=/opt/venv/bin/gilt 2026-04-28 04:29:23.772745 | orchestrator | + /opt/venv/bin/gilt overlay 2026-04-28 04:29:24.075661 | orchestrator | osism.generics: 2026-04-28 04:29:24.191799 | orchestrator | - copied (v0.20251130.0) /home/dragon/.gilt/clone/github.com/osism.generics/environments/manager/images.yml to /opt/configuration/environments/manager/ 2026-04-28 04:29:24.192467 | orchestrator | - copied (v0.20251130.0) /home/dragon/.gilt/clone/github.com/osism.generics/src/render-images.py to /opt/configuration/environments/manager/ 2026-04-28 04:29:24.193654 | orchestrator | - copied (v0.20251130.0) /home/dragon/.gilt/clone/github.com/osism.generics/src/set-versions.py to /opt/configuration/environments/ 2026-04-28 04:29:24.193690 | orchestrator | - running `/opt/configuration/scripts/wrapper-gilt.sh render-images` in /opt/configuration/environments/manager/ 2026-04-28 04:29:25.514535 | orchestrator | - running `rm render-images.py` in /opt/configuration/environments/manager/ 2026-04-28 04:29:25.523803 | orchestrator | - running `/opt/configuration/scripts/wrapper-gilt.sh set-versions` in /opt/configuration/environments/ 2026-04-28 04:29:25.888735 | orchestrator | - running `rm set-versions.py` in /opt/configuration/environments/ 2026-04-28 04:29:25.951793 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-28 04:29:25.955735 | orchestrator | + deactivate 2026-04-28 04:29:25.955775 | orchestrator | + '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin ']' 2026-04-28 04:29:25.955782 | orchestrator | + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-28 04:29:25.955786 | orchestrator | + export PATH 2026-04-28 04:29:25.955790 | orchestrator | + unset _OLD_VIRTUAL_PATH 2026-04-28 04:29:25.955795 | orchestrator | + '[' -n '' ']' 2026-04-28 04:29:25.955799 | orchestrator | + hash -r 2026-04-28 04:29:25.955803 | orchestrator | + '[' -n '' ']' 2026-04-28 04:29:25.955807 | orchestrator | + unset VIRTUAL_ENV 2026-04-28 04:29:25.955811 | orchestrator | + unset VIRTUAL_ENV_PROMPT 2026-04-28 04:29:25.955815 | orchestrator | + '[' '!' '' = nondestructive ']' 2026-04-28 04:29:25.955819 | orchestrator | + unset -f deactivate 2026-04-28 04:29:25.955835 | orchestrator | ~ 2026-04-28 04:29:25.955839 | orchestrator | + popd 2026-04-28 04:29:25.955844 | orchestrator | + [[ 10.0.0 == \l\a\t\e\s\t ]] 2026-04-28 04:29:25.955869 | orchestrator | + /opt/configuration/scripts/set-kolla-namespace.sh kolla/release 2026-04-28 04:29:25.962996 | orchestrator | + set -e 2026-04-28 04:29:25.963011 | orchestrator | + NAMESPACE=kolla/release 2026-04-28 04:29:25.963016 | orchestrator | + sed -i 's#docker_namespace: .*#docker_namespace: kolla/release#g' /opt/configuration/inventory/group_vars/all/kolla.yml 2026-04-28 04:29:25.972617 | orchestrator | + sh -c /opt/configuration/scripts/sync-configuration-repository.sh 2026-04-28 04:29:25.982324 | orchestrator | /opt/configuration ~ 2026-04-28 04:29:25.982437 | orchestrator | + set -e 2026-04-28 04:29:25.982449 | orchestrator | + pushd /opt/configuration 2026-04-28 04:29:25.982457 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-28 04:29:25.982465 | orchestrator | + source /opt/venv/bin/activate 2026-04-28 04:29:25.982562 | orchestrator | ++ deactivate nondestructive 2026-04-28 04:29:25.982580 | orchestrator | ++ '[' -n '' ']' 2026-04-28 04:29:25.982588 | orchestrator | ++ '[' -n '' ']' 2026-04-28 04:29:25.982595 | orchestrator | ++ hash -r 2026-04-28 04:29:25.982602 | orchestrator | ++ '[' -n '' ']' 2026-04-28 04:29:25.982609 | orchestrator | ++ unset VIRTUAL_ENV 2026-04-28 04:29:25.982764 | orchestrator | ++ unset VIRTUAL_ENV_PROMPT 2026-04-28 04:29:25.982778 | orchestrator | ++ '[' '!' nondestructive = nondestructive ']' 2026-04-28 04:29:25.982786 | orchestrator | ++ '[' linux-gnu = cygwin ']' 2026-04-28 04:29:25.982793 | orchestrator | ++ '[' linux-gnu = msys ']' 2026-04-28 04:29:25.982825 | orchestrator | ++ export VIRTUAL_ENV=/opt/venv 2026-04-28 04:29:25.982837 | orchestrator | ++ VIRTUAL_ENV=/opt/venv 2026-04-28 04:29:25.982848 | orchestrator | ++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-28 04:29:25.983091 | orchestrator | ++ PATH=/opt/venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-28 04:29:25.983109 | orchestrator | ++ export PATH 2026-04-28 04:29:25.983116 | orchestrator | ++ '[' -n '' ']' 2026-04-28 04:29:25.983123 | orchestrator | ++ '[' -z '' ']' 2026-04-28 04:29:25.983131 | orchestrator | ++ _OLD_VIRTUAL_PS1= 2026-04-28 04:29:25.983138 | orchestrator | ++ PS1='(venv) ' 2026-04-28 04:29:25.983145 | orchestrator | ++ export PS1 2026-04-28 04:29:25.983152 | orchestrator | ++ VIRTUAL_ENV_PROMPT='(venv) ' 2026-04-28 04:29:25.983159 | orchestrator | ++ export VIRTUAL_ENV_PROMPT 2026-04-28 04:29:25.983166 | orchestrator | ++ hash -r 2026-04-28 04:29:25.983255 | orchestrator | + pip3 install --no-cache-dir python-gilt==1.2.3 requests Jinja2 PyYAML packaging 2026-04-28 04:29:26.587145 | orchestrator | Requirement already satisfied: python-gilt==1.2.3 in /opt/venv/lib/python3.12/site-packages (1.2.3) 2026-04-28 04:29:26.587918 | orchestrator | Requirement already satisfied: requests in /opt/venv/lib/python3.12/site-packages (2.33.1) 2026-04-28 04:29:26.589539 | orchestrator | Requirement already satisfied: Jinja2 in /opt/venv/lib/python3.12/site-packages (3.1.6) 2026-04-28 04:29:26.590659 | orchestrator | Requirement already satisfied: PyYAML in /opt/venv/lib/python3.12/site-packages (6.0.3) 2026-04-28 04:29:26.592138 | orchestrator | Requirement already satisfied: packaging in /opt/venv/lib/python3.12/site-packages (26.2) 2026-04-28 04:29:26.602499 | orchestrator | Requirement already satisfied: click in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (8.3.3) 2026-04-28 04:29:26.603805 | orchestrator | Requirement already satisfied: colorama in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (0.4.6) 2026-04-28 04:29:26.604977 | orchestrator | Requirement already satisfied: fasteners in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (0.20) 2026-04-28 04:29:26.606302 | orchestrator | Requirement already satisfied: sh in /opt/venv/lib/python3.12/site-packages (from python-gilt==1.2.3) (2.2.2) 2026-04-28 04:29:26.644910 | orchestrator | Requirement already satisfied: charset_normalizer<4,>=2 in /opt/venv/lib/python3.12/site-packages (from requests) (3.4.7) 2026-04-28 04:29:26.646451 | orchestrator | Requirement already satisfied: idna<4,>=2.5 in /opt/venv/lib/python3.12/site-packages (from requests) (3.13) 2026-04-28 04:29:26.648230 | orchestrator | Requirement already satisfied: urllib3<3,>=1.26 in /opt/venv/lib/python3.12/site-packages (from requests) (2.6.3) 2026-04-28 04:29:26.649617 | orchestrator | Requirement already satisfied: certifi>=2023.5.7 in /opt/venv/lib/python3.12/site-packages (from requests) (2026.4.22) 2026-04-28 04:29:26.653672 | orchestrator | Requirement already satisfied: MarkupSafe>=2.0 in /opt/venv/lib/python3.12/site-packages (from Jinja2) (3.0.3) 2026-04-28 04:29:26.883185 | orchestrator | ++ which gilt 2026-04-28 04:29:26.887271 | orchestrator | + GILT=/opt/venv/bin/gilt 2026-04-28 04:29:26.887328 | orchestrator | + /opt/venv/bin/gilt overlay 2026-04-28 04:29:27.081598 | orchestrator | osism.generics: 2026-04-28 04:29:27.169078 | orchestrator | - copied (v0.20260319.0) /home/dragon/.gilt/clone/github.com/osism.generics/environments/manager/images.yml to /opt/configuration/environments/manager/ 2026-04-28 04:29:27.170857 | orchestrator | - copied (v0.20260319.0) /home/dragon/.gilt/clone/github.com/osism.generics/src/render-images.py to /opt/configuration/environments/manager/ 2026-04-28 04:29:27.170921 | orchestrator | - copied (v0.20260319.0) /home/dragon/.gilt/clone/github.com/osism.generics/src/set-versions.py to /opt/configuration/environments/ 2026-04-28 04:29:27.170931 | orchestrator | - running `/opt/configuration/scripts/wrapper-gilt.sh render-images` in /opt/configuration/environments/manager/ 2026-04-28 04:29:27.745797 | orchestrator | - running `rm render-images.py` in /opt/configuration/environments/manager/ 2026-04-28 04:29:27.756581 | orchestrator | - running `/opt/configuration/scripts/wrapper-gilt.sh set-versions` in /opt/configuration/environments/ 2026-04-28 04:29:28.184773 | orchestrator | - running `rm set-versions.py` in /opt/configuration/environments/ 2026-04-28 04:29:28.253926 | orchestrator | ~ 2026-04-28 04:29:28.254084 | orchestrator | + [[ -e /opt/venv/bin/activate ]] 2026-04-28 04:29:28.254097 | orchestrator | + deactivate 2026-04-28 04:29:28.254104 | orchestrator | + '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin ']' 2026-04-28 04:29:28.254112 | orchestrator | + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2026-04-28 04:29:28.254117 | orchestrator | + export PATH 2026-04-28 04:29:28.254126 | orchestrator | + unset _OLD_VIRTUAL_PATH 2026-04-28 04:29:28.254134 | orchestrator | + '[' -n '' ']' 2026-04-28 04:29:28.254143 | orchestrator | + hash -r 2026-04-28 04:29:28.254152 | orchestrator | + '[' -n '' ']' 2026-04-28 04:29:28.254161 | orchestrator | + unset VIRTUAL_ENV 2026-04-28 04:29:28.254170 | orchestrator | + unset VIRTUAL_ENV_PROMPT 2026-04-28 04:29:28.254177 | orchestrator | + '[' '!' '' = nondestructive ']' 2026-04-28 04:29:28.254184 | orchestrator | + unset -f deactivate 2026-04-28 04:29:28.254193 | orchestrator | + popd 2026-04-28 04:29:28.255402 | orchestrator | ++ semver v0.20251130.0 6.0.0 2026-04-28 04:29:28.313198 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-28 04:29:28.313349 | orchestrator | + [[ 10.0.0 == \l\a\t\e\s\t ]] 2026-04-28 04:29:28.313370 | orchestrator | ++ semver 10.0.0 10.0.0-0 2026-04-28 04:29:28.396323 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-28 04:29:28.396425 | orchestrator | + sed -i '/^om_enable_rabbitmq_high_availability:/d' /opt/configuration/environments/kolla/configuration.yml 2026-04-28 04:29:28.399315 | orchestrator | + sed -i '/^om_enable_rabbitmq_quorum_queues:/d' /opt/configuration/environments/kolla/configuration.yml 2026-04-28 04:29:28.404267 | orchestrator | ++ semver v0.20251130.0 9.5.0 2026-04-28 04:29:28.463504 | orchestrator | + [[ -1 -le 0 ]] 2026-04-28 04:29:28.463607 | orchestrator | + [[ 10.0.0 == \l\a\t\e\s\t ]] 2026-04-28 04:29:28.464147 | orchestrator | ++ semver 10.0.0 10.0.0-0 2026-04-28 04:29:28.560079 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-28 04:29:28.560193 | orchestrator | + MANAGER_UPGRADE_CROSSES_10=true 2026-04-28 04:29:28.560949 | orchestrator | +++ semver 2024.2 2024.2 2026-04-28 04:29:28.651548 | orchestrator | ++ '[' 0 -le 0 ']' 2026-04-28 04:29:28.652016 | orchestrator | +++ semver 2024.2 2025.1 2026-04-28 04:29:28.710307 | orchestrator | ++ '[' -1 -ge 0 ']' 2026-04-28 04:29:28.710439 | orchestrator | ++ echo false 2026-04-28 04:29:28.710731 | orchestrator | + OPENSTACK_UPGRADE_CROSSES_2025=false 2026-04-28 04:29:28.710771 | orchestrator | + [[ true == \t\r\u\e ]] 2026-04-28 04:29:28.710791 | orchestrator | + echo 'om_rpc_vhost: openstack' 2026-04-28 04:29:28.710807 | orchestrator | + echo 'om_notify_vhost: openstack' 2026-04-28 04:29:28.710825 | orchestrator | + sed -i 's#manager_listener_broker_vhost: .*#manager_listener_broker_vhost: /openstack#g' /opt/configuration/environments/manager/configuration.yml 2026-04-28 04:29:28.718128 | orchestrator | + echo 'export RABBITMQ3TO4=true' 2026-04-28 04:29:28.718199 | orchestrator | + sudo tee -a /opt/manager-vars.sh 2026-04-28 04:29:28.736053 | orchestrator | export RABBITMQ3TO4=true 2026-04-28 04:29:28.750800 | orchestrator | + osism update manager 2026-04-28 04:29:35.023282 | orchestrator | Collecting uv 2026-04-28 04:29:35.128931 | orchestrator | Downloading uv-0.11.8-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB) 2026-04-28 04:29:35.147061 | orchestrator | Downloading uv-0.11.8-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (24.8 MB) 2026-04-28 04:29:36.138964 | orchestrator | ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24.8/24.8 MB 27.5 MB/s eta 0:00:00 2026-04-28 04:29:36.199786 | orchestrator | Installing collected packages: uv 2026-04-28 04:29:36.683778 | orchestrator | Successfully installed uv-0.11.8 2026-04-28 04:29:37.529069 | orchestrator | Resolved 11 packages in 392ms 2026-04-28 04:29:37.555619 | orchestrator | Downloading cryptography (4.5MiB) 2026-04-28 04:29:37.570451 | orchestrator | Downloading netaddr (2.2MiB) 2026-04-28 04:29:37.570692 | orchestrator | Downloading ansible (54.5MiB) 2026-04-28 04:29:37.570938 | orchestrator | Downloading ansible-core (2.1MiB) 2026-04-28 04:29:37.987004 | orchestrator | Downloaded netaddr 2026-04-28 04:29:38.110297 | orchestrator | Downloaded cryptography 2026-04-28 04:29:38.181702 | orchestrator | Downloaded ansible-core 2026-04-28 04:29:45.953189 | orchestrator | Downloaded ansible 2026-04-28 04:29:45.962648 | orchestrator | Prepared 11 packages in 8.42s 2026-04-28 04:29:46.572557 | orchestrator | Installed 11 packages in 612ms 2026-04-28 04:29:46.572641 | orchestrator | + ansible==11.11.0 2026-04-28 04:29:46.572652 | orchestrator | + ansible-core==2.18.16 2026-04-28 04:29:46.572662 | orchestrator | + cffi==2.0.0 2026-04-28 04:29:46.572670 | orchestrator | + cryptography==47.0.0 2026-04-28 04:29:46.572679 | orchestrator | + jinja2==3.1.6 2026-04-28 04:29:46.572687 | orchestrator | + markupsafe==3.0.3 2026-04-28 04:29:46.572695 | orchestrator | + netaddr==1.3.0 2026-04-28 04:29:46.572702 | orchestrator | + packaging==26.2 2026-04-28 04:29:46.572713 | orchestrator | + pycparser==3.0 2026-04-28 04:29:46.572721 | orchestrator | + pyyaml==6.0.3 2026-04-28 04:29:46.572729 | orchestrator | + resolvelib==1.0.1 2026-04-28 04:29:47.889749 | orchestrator | Cloning into '/home/dragon/.ansible/tmp/ansible-local-2086169toecu83/tmpq_mzmhw0/ansible-collection-services2xey8vhy'... 2026-04-28 04:29:49.493126 | orchestrator | Your branch is up to date with 'origin/main'. 2026-04-28 04:29:49.493218 | orchestrator | Already on 'main' 2026-04-28 04:29:50.011438 | orchestrator | Starting galaxy collection install process 2026-04-28 04:29:50.011542 | orchestrator | Process install dependency map 2026-04-28 04:29:50.011556 | orchestrator | Starting collection install process 2026-04-28 04:29:50.011566 | orchestrator | Installing 'osism.services:999.0.0' to '/home/dragon/.ansible/collections/ansible_collections/osism/services' 2026-04-28 04:29:50.011577 | orchestrator | Created collection for osism.services:999.0.0 at /home/dragon/.ansible/collections/ansible_collections/osism/services 2026-04-28 04:29:50.011585 | orchestrator | osism.services:999.0.0 was installed successfully 2026-04-28 04:29:50.685984 | orchestrator | Cloning into '/home/dragon/.ansible/tmp/ansible-local-208634cge2vhbi/tmp90c00cxo/ansible-playbooks-managerxyleb4jb'... 2026-04-28 04:29:51.304734 | orchestrator | Already on 'main' 2026-04-28 04:29:51.304964 | orchestrator | Your branch is up to date with 'origin/main'. 2026-04-28 04:29:51.619995 | orchestrator | Starting galaxy collection install process 2026-04-28 04:29:51.620080 | orchestrator | Process install dependency map 2026-04-28 04:29:51.620092 | orchestrator | Starting collection install process 2026-04-28 04:29:51.620101 | orchestrator | Installing 'osism.manager:999.0.0' to '/home/dragon/.ansible/collections/ansible_collections/osism/manager' 2026-04-28 04:29:51.620110 | orchestrator | Created collection for osism.manager:999.0.0 at /home/dragon/.ansible/collections/ansible_collections/osism/manager 2026-04-28 04:29:51.620118 | orchestrator | osism.manager:999.0.0 was installed successfully 2026-04-28 04:29:52.417577 | orchestrator | [WARNING]: Invalid characters were found in group names but not replaced, use 2026-04-28 04:29:52.417709 | orchestrator | -vvvv to see details 2026-04-28 04:29:52.954434 | orchestrator | 2026-04-28 04:29:52.954535 | orchestrator | PLAY [Apply role manager] ****************************************************** 2026-04-28 04:29:52.954559 | orchestrator | 2026-04-28 04:29:52.954602 | orchestrator | TASK [Gathering Facts] ********************************************************* 2026-04-28 04:29:57.322521 | orchestrator | ok: [testbed-manager] 2026-04-28 04:29:57.322606 | orchestrator | 2026-04-28 04:29:57.322616 | orchestrator | TASK [osism.services.manager : Include install tasks] ************************** 2026-04-28 04:29:57.390606 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/install-Debian-family.yml for testbed-manager 2026-04-28 04:29:57.390713 | orchestrator | 2026-04-28 04:29:57.390748 | orchestrator | TASK [osism.services.manager : Install required packages] ********************** 2026-04-28 04:29:59.466302 | orchestrator | ok: [testbed-manager] 2026-04-28 04:29:59.466406 | orchestrator | 2026-04-28 04:29:59.466423 | orchestrator | TASK [osism.services.manager : Gather variables for each operating system] ***** 2026-04-28 04:29:59.527658 | orchestrator | ok: [testbed-manager] 2026-04-28 04:29:59.527757 | orchestrator | 2026-04-28 04:29:59.527772 | orchestrator | TASK [osism.services.manager : Include config tasks] *************************** 2026-04-28 04:29:59.618911 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config.yml for testbed-manager 2026-04-28 04:29:59.619019 | orchestrator | 2026-04-28 04:29:59.619045 | orchestrator | TASK [osism.services.manager : Create required directories] ******************** 2026-04-28 04:30:04.145346 | orchestrator | ok: [testbed-manager] => (item=/opt/ansible) 2026-04-28 04:30:04.145454 | orchestrator | ok: [testbed-manager] => (item=/opt/archive) 2026-04-28 04:30:04.145470 | orchestrator | ok: [testbed-manager] => (item=/opt/manager/configuration) 2026-04-28 04:30:04.145492 | orchestrator | ok: [testbed-manager] => (item=/opt/manager/data) 2026-04-28 04:30:04.145502 | orchestrator | ok: [testbed-manager] => (item=/opt/manager) 2026-04-28 04:30:04.145512 | orchestrator | ok: [testbed-manager] => (item=/opt/manager/secrets) 2026-04-28 04:30:04.145522 | orchestrator | ok: [testbed-manager] => (item=/opt/ansible/secrets) 2026-04-28 04:30:04.145533 | orchestrator | ok: [testbed-manager] => (item=/opt/state) 2026-04-28 04:30:04.145543 | orchestrator | 2026-04-28 04:30:04.145555 | orchestrator | TASK [osism.services.manager : Copy all environment file] ********************** 2026-04-28 04:30:05.328541 | orchestrator | ok: [testbed-manager] 2026-04-28 04:30:05.328622 | orchestrator | 2026-04-28 04:30:05.328631 | orchestrator | TASK [osism.services.manager : Copy client environment file] ******************* 2026-04-28 04:30:06.413562 | orchestrator | ok: [testbed-manager] 2026-04-28 04:30:06.413663 | orchestrator | 2026-04-28 04:30:06.413679 | orchestrator | TASK [osism.services.manager : Include ara config tasks] *********************** 2026-04-28 04:30:06.509921 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-ara.yml for testbed-manager 2026-04-28 04:30:06.510083 | orchestrator | 2026-04-28 04:30:06.510103 | orchestrator | TASK [osism.services.manager : Copy ARA environment files] ********************* 2026-04-28 04:30:08.647750 | orchestrator | ok: [testbed-manager] => (item=ara) 2026-04-28 04:30:08.647884 | orchestrator | ok: [testbed-manager] => (item=ara-server) 2026-04-28 04:30:08.647910 | orchestrator | 2026-04-28 04:30:08.647930 | orchestrator | TASK [osism.services.manager : Copy MariaDB environment file] ****************** 2026-04-28 04:30:09.741372 | orchestrator | ok: [testbed-manager] 2026-04-28 04:30:09.741510 | orchestrator | 2026-04-28 04:30:09.741538 | orchestrator | TASK [osism.services.manager : Include vault config tasks] ********************* 2026-04-28 04:30:09.798761 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:30:09.798857 | orchestrator | 2026-04-28 04:30:09.798871 | orchestrator | TASK [osism.services.manager : Include frontend config tasks] ****************** 2026-04-28 04:30:09.882987 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-frontend.yml for testbed-manager 2026-04-28 04:30:09.883075 | orchestrator | 2026-04-28 04:30:09.883087 | orchestrator | TASK [osism.services.manager : Copy frontend environment file] ***************** 2026-04-28 04:30:10.904017 | orchestrator | ok: [testbed-manager] 2026-04-28 04:30:10.904111 | orchestrator | 2026-04-28 04:30:10.904124 | orchestrator | TASK [osism.services.manager : Include ansible config tasks] ******************* 2026-04-28 04:30:10.990530 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-ansible.yml for testbed-manager 2026-04-28 04:30:10.990614 | orchestrator | 2026-04-28 04:30:10.990625 | orchestrator | TASK [osism.services.manager : Copy private ssh keys] ************************** 2026-04-28 04:30:13.036842 | orchestrator | ok: [testbed-manager] => (item=None) 2026-04-28 04:30:13.036923 | orchestrator | ok: [testbed-manager] => (item=None) 2026-04-28 04:30:13.036931 | orchestrator | ok: [testbed-manager] 2026-04-28 04:30:13.036939 | orchestrator | 2026-04-28 04:30:13.036949 | orchestrator | TASK [osism.services.manager : Copy ansible environment file] ****************** 2026-04-28 04:30:14.031620 | orchestrator | ok: [testbed-manager] 2026-04-28 04:30:14.031733 | orchestrator | 2026-04-28 04:30:14.031753 | orchestrator | TASK [osism.services.manager : Include netbox config tasks] ******************** 2026-04-28 04:30:14.091294 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:30:14.091421 | orchestrator | 2026-04-28 04:30:14.091444 | orchestrator | TASK [osism.services.manager : Include celery config tasks] ******************** 2026-04-28 04:30:14.204662 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-celery.yml for testbed-manager 2026-04-28 04:30:14.204736 | orchestrator | 2026-04-28 04:30:14.204743 | orchestrator | TASK [osism.services.manager : Set fs.inotify.max_user_watches] **************** 2026-04-28 04:30:15.015315 | orchestrator | ok: [testbed-manager] 2026-04-28 04:30:15.015395 | orchestrator | 2026-04-28 04:30:15.015402 | orchestrator | TASK [osism.services.manager : Set fs.inotify.max_user_instances] ************** 2026-04-28 04:30:15.596306 | orchestrator | ok: [testbed-manager] 2026-04-28 04:30:15.596393 | orchestrator | 2026-04-28 04:30:15.596427 | orchestrator | TASK [osism.services.manager : Copy celery environment files] ****************** 2026-04-28 04:30:17.674690 | orchestrator | ok: [testbed-manager] => (item=conductor) 2026-04-28 04:30:17.674772 | orchestrator | ok: [testbed-manager] => (item=openstack) 2026-04-28 04:30:17.674783 | orchestrator | 2026-04-28 04:30:17.674792 | orchestrator | TASK [osism.services.manager : Copy listener environment file] ***************** 2026-04-28 04:30:18.997527 | orchestrator | changed: [testbed-manager] 2026-04-28 04:30:18.997604 | orchestrator | 2026-04-28 04:30:18.997612 | orchestrator | TASK [osism.services.manager : Check for conductor.yml] ************************ 2026-04-28 04:30:19.595586 | orchestrator | ok: [testbed-manager] 2026-04-28 04:30:19.595665 | orchestrator | 2026-04-28 04:30:19.595675 | orchestrator | TASK [osism.services.manager : Copy conductor configuration file] ************** 2026-04-28 04:30:20.214118 | orchestrator | ok: [testbed-manager] 2026-04-28 04:30:20.214228 | orchestrator | 2026-04-28 04:30:20.214316 | orchestrator | TASK [osism.services.manager : Copy empty conductor configuration file] ******** 2026-04-28 04:30:20.278707 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:30:20.278788 | orchestrator | 2026-04-28 04:30:20.278798 | orchestrator | TASK [osism.services.manager : Include wrapper config tasks] ******************* 2026-04-28 04:30:20.368403 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-wrapper.yml for testbed-manager 2026-04-28 04:30:20.368480 | orchestrator | 2026-04-28 04:30:20.368491 | orchestrator | TASK [osism.services.manager : Include wrapper vars file] ********************** 2026-04-28 04:30:20.431299 | orchestrator | ok: [testbed-manager] 2026-04-28 04:30:20.431393 | orchestrator | 2026-04-28 04:30:20.431404 | orchestrator | TASK [osism.services.manager : Copy wrapper scripts] *************************** 2026-04-28 04:30:23.459681 | orchestrator | ok: [testbed-manager] => (item=osism) 2026-04-28 04:30:23.460680 | orchestrator | ok: [testbed-manager] => (item=osism-update-docker) 2026-04-28 04:30:23.460747 | orchestrator | ok: [testbed-manager] => (item=osism-update-manager) 2026-04-28 04:30:23.460763 | orchestrator | 2026-04-28 04:30:23.460776 | orchestrator | TASK [osism.services.manager : Copy cilium wrapper script] ********************* 2026-04-28 04:30:24.442847 | orchestrator | ok: [testbed-manager] 2026-04-28 04:30:24.442923 | orchestrator | 2026-04-28 04:30:24.442932 | orchestrator | TASK [osism.services.manager : Copy hubble wrapper script] ********************* 2026-04-28 04:30:25.490603 | orchestrator | ok: [testbed-manager] 2026-04-28 04:30:25.490715 | orchestrator | 2026-04-28 04:30:25.490736 | orchestrator | TASK [osism.services.manager : Copy flux wrapper script] *********************** 2026-04-28 04:30:26.586432 | orchestrator | ok: [testbed-manager] 2026-04-28 04:30:26.586512 | orchestrator | 2026-04-28 04:30:26.586521 | orchestrator | TASK [osism.services.manager : Include scripts config tasks] ******************* 2026-04-28 04:30:26.676921 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/config-scripts.yml for testbed-manager 2026-04-28 04:30:26.676991 | orchestrator | 2026-04-28 04:30:26.676999 | orchestrator | TASK [osism.services.manager : Include scripts vars file] ********************** 2026-04-28 04:30:26.727931 | orchestrator | ok: [testbed-manager] 2026-04-28 04:30:26.728017 | orchestrator | 2026-04-28 04:30:26.728029 | orchestrator | TASK [osism.services.manager : Copy scripts] *********************************** 2026-04-28 04:30:27.748805 | orchestrator | ok: [testbed-manager] => (item=osism-include) 2026-04-28 04:30:27.748887 | orchestrator | 2026-04-28 04:30:27.748900 | orchestrator | TASK [osism.services.manager : Include service tasks] ************************** 2026-04-28 04:30:27.858047 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/service.yml for testbed-manager 2026-04-28 04:30:27.858118 | orchestrator | 2026-04-28 04:30:27.858128 | orchestrator | TASK [osism.services.manager : Copy manager systemd unit file] ***************** 2026-04-28 04:30:28.889519 | orchestrator | ok: [testbed-manager] 2026-04-28 04:30:28.889603 | orchestrator | 2026-04-28 04:30:28.889617 | orchestrator | TASK [osism.services.manager : Create traefik external network] **************** 2026-04-28 04:30:30.105729 | orchestrator | ok: [testbed-manager] 2026-04-28 04:30:30.105798 | orchestrator | 2026-04-28 04:30:30.105805 | orchestrator | TASK [osism.services.manager : Set mariadb healthcheck for mariadb < 11.0.0] *** 2026-04-28 04:30:30.178976 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:30:30.179050 | orchestrator | 2026-04-28 04:30:30.179060 | orchestrator | TASK [osism.services.manager : Set mariadb healthcheck for mariadb >= 11.0.0] *** 2026-04-28 04:30:30.258367 | orchestrator | ok: [testbed-manager] 2026-04-28 04:30:30.258441 | orchestrator | 2026-04-28 04:30:30.258448 | orchestrator | TASK [osism.services.manager : Copy docker-compose.yml file] ******************* 2026-04-28 04:30:31.677184 | orchestrator | changed: [testbed-manager] 2026-04-28 04:30:31.677293 | orchestrator | 2026-04-28 04:30:31.677304 | orchestrator | TASK [osism.services.manager : Pull container images] ************************** 2026-04-28 04:31:46.320746 | orchestrator | changed: [testbed-manager] 2026-04-28 04:31:46.320863 | orchestrator | 2026-04-28 04:31:46.320882 | orchestrator | TASK [osism.services.manager : Stop and disable old service docker-compose@manager] *** 2026-04-28 04:31:48.567548 | orchestrator | ok: [testbed-manager] 2026-04-28 04:31:48.567657 | orchestrator | 2026-04-28 04:31:48.567675 | orchestrator | TASK [osism.services.manager : Do a manual start of the manager service] ******* 2026-04-28 04:31:48.625830 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:31:48.625919 | orchestrator | 2026-04-28 04:31:48.625932 | orchestrator | TASK [osism.services.manager : Manage manager service] ************************* 2026-04-28 04:31:49.499192 | orchestrator | ok: [testbed-manager] 2026-04-28 04:31:49.499281 | orchestrator | 2026-04-28 04:31:49.499343 | orchestrator | TASK [osism.services.manager : Register that manager service was started] ****** 2026-04-28 04:31:49.579613 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:31:49.579709 | orchestrator | 2026-04-28 04:31:49.579723 | orchestrator | TASK [osism.services.manager : Flush handlers] ********************************* 2026-04-28 04:31:49.579735 | orchestrator | 2026-04-28 04:31:49.579747 | orchestrator | RUNNING HANDLER [osism.services.manager : Restart manager service] ************* 2026-04-28 04:32:08.730995 | orchestrator | changed: [testbed-manager] 2026-04-28 04:32:08.731135 | orchestrator | 2026-04-28 04:32:08.731165 | orchestrator | RUNNING HANDLER [osism.services.manager : Wait for manager service to start] *** 2026-04-28 04:33:08.795900 | orchestrator | Pausing for 60 seconds 2026-04-28 04:33:08.796040 | orchestrator | changed: [testbed-manager] 2026-04-28 04:33:08.796063 | orchestrator | 2026-04-28 04:33:08.796082 | orchestrator | RUNNING HANDLER [osism.services.manager : Register that manager service was restarted] *** 2026-04-28 04:33:08.848774 | orchestrator | ok: [testbed-manager] 2026-04-28 04:33:08.848868 | orchestrator | 2026-04-28 04:33:08.848882 | orchestrator | RUNNING HANDLER [osism.services.manager : Ensure that all containers are up] *** 2026-04-28 04:33:13.083603 | orchestrator | changed: [testbed-manager] 2026-04-28 04:33:13.083728 | orchestrator | 2026-04-28 04:33:13.083752 | orchestrator | RUNNING HANDLER [osism.services.manager : Wait for an healthy manager service] *** 2026-04-28 04:34:15.778898 | orchestrator | FAILED - RETRYING: [testbed-manager]: Wait for an healthy manager service (50 retries left). 2026-04-28 04:34:15.778985 | orchestrator | FAILED - RETRYING: [testbed-manager]: Wait for an healthy manager service (49 retries left). 2026-04-28 04:34:15.778993 | orchestrator | FAILED - RETRYING: [testbed-manager]: Wait for an healthy manager service (48 retries left). 2026-04-28 04:34:15.779000 | orchestrator | changed: [testbed-manager] 2026-04-28 04:34:15.779007 | orchestrator | 2026-04-28 04:34:15.779014 | orchestrator | RUNNING HANDLER [osism.services.manager : Copy osismclient bash completion script] *** 2026-04-28 04:34:22.391879 | orchestrator | changed: [testbed-manager] 2026-04-28 04:34:22.391985 | orchestrator | 2026-04-28 04:34:22.392002 | orchestrator | TASK [osism.services.manager : Include initialize tasks] *********************** 2026-04-28 04:34:22.493351 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/initialize.yml for testbed-manager 2026-04-28 04:34:22.493518 | orchestrator | 2026-04-28 04:34:22.493534 | orchestrator | TASK [osism.services.manager : Flush handlers] ********************************* 2026-04-28 04:34:22.493546 | orchestrator | 2026-04-28 04:34:22.493558 | orchestrator | TASK [osism.services.manager : Include vault initialize tasks] ***************** 2026-04-28 04:34:22.574500 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:34:22.574567 | orchestrator | 2026-04-28 04:34:22.574574 | orchestrator | TASK [osism.services.manager : Include version verification tasks] ************* 2026-04-28 04:34:22.648990 | orchestrator | included: /home/dragon/.ansible/collections/ansible_collections/osism/services/roles/manager/tasks/verify-versions.yml for testbed-manager 2026-04-28 04:34:22.649078 | orchestrator | 2026-04-28 04:34:22.649092 | orchestrator | TASK [osism.services.manager : Deploy service manager version check script] **** 2026-04-28 04:34:23.861579 | orchestrator | changed: [testbed-manager] 2026-04-28 04:34:23.861678 | orchestrator | 2026-04-28 04:34:23.861694 | orchestrator | TASK [osism.services.manager : Execute service manager version check] ********** 2026-04-28 04:34:27.634275 | orchestrator | ok: [testbed-manager] 2026-04-28 04:34:27.634498 | orchestrator | 2026-04-28 04:34:27.634521 | orchestrator | TASK [osism.services.manager : Display version check results] ****************** 2026-04-28 04:34:27.719340 | orchestrator | ok: [testbed-manager] => { 2026-04-28 04:34:27.719481 | orchestrator | "version_check_result.stdout_lines": [ 2026-04-28 04:34:27.719498 | orchestrator | "=== OSISM Container Version Check ===", 2026-04-28 04:34:27.719510 | orchestrator | "Checking running containers against expected versions...", 2026-04-28 04:34:27.719523 | orchestrator | "", 2026-04-28 04:34:27.719535 | orchestrator | "Checking service: inventory_reconciler (Inventory Reconciler Service)", 2026-04-28 04:34:27.719547 | orchestrator | " Expected: registry.osism.tech/osism/inventory-reconciler:0.20260322.0", 2026-04-28 04:34:27.719558 | orchestrator | " Enabled: true", 2026-04-28 04:34:27.719569 | orchestrator | " Running: registry.osism.tech/osism/inventory-reconciler:0.20260322.0", 2026-04-28 04:34:27.719580 | orchestrator | " Status: ✅ MATCH", 2026-04-28 04:34:27.719591 | orchestrator | "", 2026-04-28 04:34:27.719601 | orchestrator | "Checking service: osism-ansible (OSISM Ansible Service)", 2026-04-28 04:34:27.719613 | orchestrator | " Expected: registry.osism.tech/osism/osism-ansible:0.20260322.0", 2026-04-28 04:34:27.719623 | orchestrator | " Enabled: true", 2026-04-28 04:34:27.719634 | orchestrator | " Running: registry.osism.tech/osism/osism-ansible:0.20260322.0", 2026-04-28 04:34:27.719644 | orchestrator | " Status: ✅ MATCH", 2026-04-28 04:34:27.719655 | orchestrator | "", 2026-04-28 04:34:27.719666 | orchestrator | "Checking service: osism-kubernetes (Osism-Kubernetes Service)", 2026-04-28 04:34:27.719677 | orchestrator | " Expected: registry.osism.tech/osism/osism-kubernetes:0.20260322.0", 2026-04-28 04:34:27.719687 | orchestrator | " Enabled: true", 2026-04-28 04:34:27.719698 | orchestrator | " Running: registry.osism.tech/osism/osism-kubernetes:0.20260322.0", 2026-04-28 04:34:27.719709 | orchestrator | " Status: ✅ MATCH", 2026-04-28 04:34:27.719719 | orchestrator | "", 2026-04-28 04:34:27.719730 | orchestrator | "Checking service: ceph-ansible (Ceph-Ansible Service)", 2026-04-28 04:34:27.719740 | orchestrator | " Expected: registry.osism.tech/osism/ceph-ansible:0.20260322.0", 2026-04-28 04:34:27.719751 | orchestrator | " Enabled: true", 2026-04-28 04:34:27.719761 | orchestrator | " Running: registry.osism.tech/osism/ceph-ansible:0.20260322.0", 2026-04-28 04:34:27.719772 | orchestrator | " Status: ✅ MATCH", 2026-04-28 04:34:27.719783 | orchestrator | "", 2026-04-28 04:34:27.719794 | orchestrator | "Checking service: kolla-ansible (Kolla-Ansible Service)", 2026-04-28 04:34:27.719805 | orchestrator | " Expected: registry.osism.tech/osism/kolla-ansible:0.20260328.0", 2026-04-28 04:34:27.719815 | orchestrator | " Enabled: true", 2026-04-28 04:34:27.719826 | orchestrator | " Running: registry.osism.tech/osism/kolla-ansible:0.20260328.0", 2026-04-28 04:34:27.719836 | orchestrator | " Status: ✅ MATCH", 2026-04-28 04:34:27.719847 | orchestrator | "", 2026-04-28 04:34:27.719857 | orchestrator | "Checking service: osismclient (OSISM Client)", 2026-04-28 04:34:27.719870 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-28 04:34:27.719919 | orchestrator | " Enabled: true", 2026-04-28 04:34:27.719933 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-28 04:34:27.719945 | orchestrator | " Status: ✅ MATCH", 2026-04-28 04:34:27.719957 | orchestrator | "", 2026-04-28 04:34:27.719969 | orchestrator | "Checking service: ara-server (ARA Server)", 2026-04-28 04:34:27.719982 | orchestrator | " Expected: registry.osism.tech/osism/ara-server:1.7.3", 2026-04-28 04:34:27.719994 | orchestrator | " Enabled: true", 2026-04-28 04:34:27.720006 | orchestrator | " Running: registry.osism.tech/osism/ara-server:1.7.3", 2026-04-28 04:34:27.720018 | orchestrator | " Status: ✅ MATCH", 2026-04-28 04:34:27.720030 | orchestrator | "", 2026-04-28 04:34:27.720042 | orchestrator | "Checking service: mariadb (MariaDB for ARA)", 2026-04-28 04:34:27.720054 | orchestrator | " Expected: registry.osism.tech/dockerhub/library/mariadb:11.8.4", 2026-04-28 04:34:27.720066 | orchestrator | " Enabled: true", 2026-04-28 04:34:27.720079 | orchestrator | " Running: registry.osism.tech/dockerhub/library/mariadb:11.8.4", 2026-04-28 04:34:27.720091 | orchestrator | " Status: ✅ MATCH", 2026-04-28 04:34:27.720103 | orchestrator | "", 2026-04-28 04:34:27.720114 | orchestrator | "Checking service: frontend (OSISM Frontend)", 2026-04-28 04:34:27.720126 | orchestrator | " Expected: registry.osism.tech/osism/osism-frontend:0.20260320.0", 2026-04-28 04:34:27.720138 | orchestrator | " Enabled: true", 2026-04-28 04:34:27.720151 | orchestrator | " Running: registry.osism.tech/osism/osism-frontend:0.20260320.0", 2026-04-28 04:34:27.720163 | orchestrator | " Status: ✅ MATCH", 2026-04-28 04:34:27.720180 | orchestrator | "", 2026-04-28 04:34:27.720192 | orchestrator | "Checking service: redis (Redis Cache)", 2026-04-28 04:34:27.720206 | orchestrator | " Expected: registry.osism.tech/dockerhub/library/redis:7.4.7-alpine", 2026-04-28 04:34:27.720219 | orchestrator | " Enabled: true", 2026-04-28 04:34:27.720230 | orchestrator | " Running: registry.osism.tech/dockerhub/library/redis:7.4.7-alpine", 2026-04-28 04:34:27.720241 | orchestrator | " Status: ✅ MATCH", 2026-04-28 04:34:27.720252 | orchestrator | "", 2026-04-28 04:34:27.720263 | orchestrator | "Checking service: api (OSISM API Service)", 2026-04-28 04:34:27.720273 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-28 04:34:27.720284 | orchestrator | " Enabled: true", 2026-04-28 04:34:27.720295 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-28 04:34:27.720305 | orchestrator | " Status: ✅ MATCH", 2026-04-28 04:34:27.720316 | orchestrator | "", 2026-04-28 04:34:27.720326 | orchestrator | "Checking service: listener (OpenStack Event Listener)", 2026-04-28 04:34:27.720337 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-28 04:34:27.720347 | orchestrator | " Enabled: true", 2026-04-28 04:34:27.720358 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-28 04:34:27.720387 | orchestrator | " Status: ✅ MATCH", 2026-04-28 04:34:27.720398 | orchestrator | "", 2026-04-28 04:34:27.720409 | orchestrator | "Checking service: openstack (OpenStack Integration)", 2026-04-28 04:34:27.720419 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-28 04:34:27.720430 | orchestrator | " Enabled: true", 2026-04-28 04:34:27.720441 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-28 04:34:27.720451 | orchestrator | " Status: ✅ MATCH", 2026-04-28 04:34:27.720462 | orchestrator | "", 2026-04-28 04:34:27.720473 | orchestrator | "Checking service: beat (Celery Beat Scheduler)", 2026-04-28 04:34:27.720483 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-28 04:34:27.720494 | orchestrator | " Enabled: true", 2026-04-28 04:34:27.720505 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-28 04:34:27.720535 | orchestrator | " Status: ✅ MATCH", 2026-04-28 04:34:27.720547 | orchestrator | "", 2026-04-28 04:34:27.720557 | orchestrator | "Checking service: flower (Celery Flower Monitor)", 2026-04-28 04:34:27.720568 | orchestrator | " Expected: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-28 04:34:27.720579 | orchestrator | " Enabled: true", 2026-04-28 04:34:27.720598 | orchestrator | " Running: registry.osism.tech/osism/osism:0.20260320.0", 2026-04-28 04:34:27.720609 | orchestrator | " Status: ✅ MATCH", 2026-04-28 04:34:27.720620 | orchestrator | "", 2026-04-28 04:34:27.720630 | orchestrator | "=== Summary ===", 2026-04-28 04:34:27.720641 | orchestrator | "Errors (version mismatches): 0", 2026-04-28 04:34:27.720652 | orchestrator | "Warnings (expected containers not running): 0", 2026-04-28 04:34:27.720663 | orchestrator | "", 2026-04-28 04:34:27.720674 | orchestrator | "✅ All running containers match expected versions!" 2026-04-28 04:34:27.720685 | orchestrator | ] 2026-04-28 04:34:27.720696 | orchestrator | } 2026-04-28 04:34:27.720707 | orchestrator | 2026-04-28 04:34:27.720718 | orchestrator | TASK [osism.services.manager : Skip version check due to service configuration] *** 2026-04-28 04:34:27.801286 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:34:27.801423 | orchestrator | 2026-04-28 04:34:27.801439 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:34:27.801451 | orchestrator | testbed-manager : ok=51 changed=9 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-04-28 04:34:27.801462 | orchestrator | 2026-04-28 04:34:40.894012 | orchestrator | 2026-04-28 04:34:40 | INFO  | Task 50453756-9fa7-4486-84e6-0f26323a0d97 (sync inventory) is running in background. Output coming soon. 2026-04-28 04:35:15.009128 | orchestrator | 2026-04-28 04:34:42 | INFO  | Starting group_vars file reorganization 2026-04-28 04:35:15.009272 | orchestrator | 2026-04-28 04:34:42 | INFO  | Moved 0 file(s) to their respective directories 2026-04-28 04:35:15.009299 | orchestrator | 2026-04-28 04:34:42 | INFO  | Group_vars file reorganization completed 2026-04-28 04:35:15.009319 | orchestrator | 2026-04-28 04:34:45 | INFO  | Starting variable preparation from inventory 2026-04-28 04:35:15.009338 | orchestrator | 2026-04-28 04:34:48 | INFO  | Writing 050-kolla-ceph-rgw-hosts.yml with ceph_rgw_hosts 2026-04-28 04:35:15.009356 | orchestrator | 2026-04-28 04:34:48 | INFO  | Writing 050-infrastructure-cephclient-mons.yml with cephclient_mons 2026-04-28 04:35:15.009375 | orchestrator | 2026-04-28 04:34:48 | INFO  | Writing 050-ceph-cluster-fsid.yml with ceph_cluster_fsid 2026-04-28 04:35:15.009464 | orchestrator | 2026-04-28 04:34:48 | INFO  | 3 file(s) written, 6 host(s) processed 2026-04-28 04:35:15.009486 | orchestrator | 2026-04-28 04:34:48 | INFO  | Variable preparation completed 2026-04-28 04:35:15.009506 | orchestrator | 2026-04-28 04:34:50 | INFO  | Starting inventory overwrite handling 2026-04-28 04:35:15.009525 | orchestrator | 2026-04-28 04:34:50 | INFO  | Handling group overwrites in 99-overwrite 2026-04-28 04:35:15.009544 | orchestrator | 2026-04-28 04:34:50 | INFO  | Removing group frr:children from 60-generic 2026-04-28 04:35:15.009562 | orchestrator | 2026-04-28 04:34:50 | INFO  | Removing group netbird:children from 50-infrastructure 2026-04-28 04:35:15.009581 | orchestrator | 2026-04-28 04:34:50 | INFO  | Removing group ceph-mds from 50-ceph 2026-04-28 04:35:15.009600 | orchestrator | 2026-04-28 04:34:50 | INFO  | Removing group ceph-rgw from 50-ceph 2026-04-28 04:35:15.009618 | orchestrator | 2026-04-28 04:34:50 | INFO  | Handling group overwrites in 20-roles 2026-04-28 04:35:15.009638 | orchestrator | 2026-04-28 04:34:50 | INFO  | Removing group k3s_node from 50-infrastructure 2026-04-28 04:35:15.009658 | orchestrator | 2026-04-28 04:34:50 | INFO  | Removed 5 group(s) in total 2026-04-28 04:35:15.009677 | orchestrator | 2026-04-28 04:34:50 | INFO  | Inventory overwrite handling completed 2026-04-28 04:35:15.009697 | orchestrator | 2026-04-28 04:34:52 | INFO  | Starting merge of inventory files 2026-04-28 04:35:15.009719 | orchestrator | 2026-04-28 04:34:52 | INFO  | Inventory files merged successfully 2026-04-28 04:35:15.009775 | orchestrator | 2026-04-28 04:34:57 | INFO  | Generating minified hosts file 2026-04-28 04:35:15.009796 | orchestrator | 2026-04-28 04:34:59 | INFO  | Successfully wrote minified hosts file to /inventory.merge/hosts-minified.yml 2026-04-28 04:35:15.009817 | orchestrator | 2026-04-28 04:34:59 | INFO  | Successfully wrote fast inventory to /inventory.merge/fast/hosts.json 2026-04-28 04:35:15.009855 | orchestrator | 2026-04-28 04:35:00 | INFO  | Generating ClusterShell configuration from Ansible inventory 2026-04-28 04:35:15.009891 | orchestrator | 2026-04-28 04:35:13 | INFO  | Successfully wrote ClusterShell configuration 2026-04-28 04:35:15.267586 | orchestrator | + [[ '' == \c\e\p\h\-\a\n\s\i\b\l\e ]] 2026-04-28 04:35:15.267681 | orchestrator | + wait_for_container_healthy 60 kolla-ansible 2026-04-28 04:35:15.267695 | orchestrator | + local max_attempts=60 2026-04-28 04:35:15.267705 | orchestrator | + local name=kolla-ansible 2026-04-28 04:35:15.267714 | orchestrator | + local attempt_num=1 2026-04-28 04:35:15.267804 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' kolla-ansible 2026-04-28 04:35:15.305481 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-28 04:35:15.305558 | orchestrator | + wait_for_container_healthy 60 osism-ansible 2026-04-28 04:35:15.305569 | orchestrator | + local max_attempts=60 2026-04-28 04:35:15.305576 | orchestrator | + local name=osism-ansible 2026-04-28 04:35:15.305582 | orchestrator | + local attempt_num=1 2026-04-28 04:35:15.306667 | orchestrator | ++ /usr/bin/docker inspect -f '{{.State.Health.Status}}' osism-ansible 2026-04-28 04:35:15.341289 | orchestrator | + [[ healthy == \h\e\a\l\t\h\y ]] 2026-04-28 04:35:15.341371 | orchestrator | + docker compose --project-directory /opt/manager ps 2026-04-28 04:35:15.569047 | orchestrator | NAME IMAGE COMMAND SERVICE CREATED STATUS PORTS 2026-04-28 04:35:15.569163 | orchestrator | ceph-ansible registry.osism.tech/osism/ceph-ansible:0.20260322.0 "/entrypoint.sh osis…" ceph-ansible 3 minutes ago Up 2 minutes (healthy) 2026-04-28 04:35:15.569180 | orchestrator | kolla-ansible registry.osism.tech/osism/kolla-ansible:0.20260328.0 "/entrypoint.sh osis…" kolla-ansible 3 minutes ago Up 2 minutes (healthy) 2026-04-28 04:35:15.569192 | orchestrator | manager-api-1 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" api 3 minutes ago Up 3 minutes (healthy) 192.168.16.5:8000->8000/tcp 2026-04-28 04:35:15.569225 | orchestrator | manager-ara-server-1 registry.osism.tech/osism/ara-server:1.7.3 "sh -c '/wait && /ru…" ara-server 3 hours ago Up 2 minutes (healthy) 8000/tcp 2026-04-28 04:35:15.569236 | orchestrator | manager-beat-1 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" beat 3 minutes ago Up 3 minutes (healthy) 2026-04-28 04:35:15.569247 | orchestrator | manager-flower-1 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" flower 3 minutes ago Up 3 minutes (healthy) 2026-04-28 04:35:15.569258 | orchestrator | manager-inventory_reconciler-1 registry.osism.tech/osism/inventory-reconciler:0.20260322.0 "/sbin/tini -- /entr…" inventory_reconciler 3 minutes ago Up 2 minutes (healthy) 2026-04-28 04:35:15.569268 | orchestrator | manager-listener-1 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" listener 3 minutes ago Restarting (0) 42 seconds ago 2026-04-28 04:35:15.569279 | orchestrator | manager-mariadb-1 registry.osism.tech/dockerhub/library/mariadb:11.8.4 "docker-entrypoint.s…" mariadb 3 hours ago Up 3 minutes (healthy) 3306/tcp 2026-04-28 04:35:15.569290 | orchestrator | manager-openstack-1 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" openstack 3 minutes ago Up 3 minutes (healthy) 2026-04-28 04:35:15.569324 | orchestrator | manager-redis-1 registry.osism.tech/dockerhub/library/redis:7.4.7-alpine "docker-entrypoint.s…" redis 3 hours ago Up 3 minutes (healthy) 6379/tcp 2026-04-28 04:35:15.569336 | orchestrator | osism-ansible registry.osism.tech/osism/osism-ansible:0.20260322.0 "/entrypoint.sh osis…" osism-ansible 3 minutes ago Up 2 minutes (healthy) 2026-04-28 04:35:15.569346 | orchestrator | osism-frontend registry.osism.tech/osism/osism-frontend:0.20260320.0 "docker-entrypoint.s…" frontend 3 minutes ago Up 3 minutes 192.168.16.5:3000->3000/tcp 2026-04-28 04:35:15.569358 | orchestrator | osism-kubernetes registry.osism.tech/osism/osism-kubernetes:0.20260322.0 "/entrypoint.sh osis…" osism-kubernetes 3 minutes ago Up 2 minutes (healthy) 2026-04-28 04:35:15.569369 | orchestrator | osismclient registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- sleep…" osismclient 3 minutes ago Up 3 minutes (healthy) 2026-04-28 04:35:15.580969 | orchestrator | + [[ '' == \t\r\u\e ]] 2026-04-28 04:35:15.581035 | orchestrator | + [[ '' == \f\a\l\s\e ]] 2026-04-28 04:35:15.581041 | orchestrator | + osism apply facts 2026-04-28 04:35:27.054554 | orchestrator | 2026-04-28 04:35:27 | INFO  | Prepare task for execution of facts. 2026-04-28 04:35:27.150584 | orchestrator | 2026-04-28 04:35:27 | INFO  | Task 9f96f828-fabb-48ba-a04d-f073a21157e5 (facts) was prepared for execution. 2026-04-28 04:35:27.150672 | orchestrator | 2026-04-28 04:35:27 | INFO  | It takes a moment until task 9f96f828-fabb-48ba-a04d-f073a21157e5 (facts) has been started and output is visible here. 2026-04-28 04:35:51.780275 | orchestrator | 2026-04-28 04:35:51.780385 | orchestrator | PLAY [Apply role facts] ******************************************************** 2026-04-28 04:35:51.780450 | orchestrator | 2026-04-28 04:35:51.780463 | orchestrator | TASK [osism.commons.facts : Create custom facts directory] ********************* 2026-04-28 04:35:51.780472 | orchestrator | Tuesday 28 April 2026 04:35:32 +0000 (0:00:02.253) 0:00:02.253 ********* 2026-04-28 04:35:51.780481 | orchestrator | ok: [testbed-manager] 2026-04-28 04:35:51.780492 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:35:51.780501 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:35:51.780510 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:35:51.780519 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:35:51.780528 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:35:51.780537 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:35:51.780547 | orchestrator | 2026-04-28 04:35:51.780556 | orchestrator | TASK [osism.commons.facts : Copy fact files] *********************************** 2026-04-28 04:35:51.780565 | orchestrator | Tuesday 28 April 2026 04:35:37 +0000 (0:00:04.085) 0:00:06.339 ********* 2026-04-28 04:35:51.780575 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:35:51.780585 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:35:51.780595 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:35:51.780605 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:35:51.780614 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:35:51.780625 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:35:51.780635 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:35:51.780645 | orchestrator | 2026-04-28 04:35:51.780655 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-28 04:35:51.780665 | orchestrator | 2026-04-28 04:35:51.780676 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-28 04:35:51.780686 | orchestrator | Tuesday 28 April 2026 04:35:40 +0000 (0:00:03.227) 0:00:09.566 ********* 2026-04-28 04:35:51.780696 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:35:51.780705 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:35:51.780714 | orchestrator | ok: [testbed-manager] 2026-04-28 04:35:51.780724 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:35:51.780733 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:35:51.780767 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:35:51.780778 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:35:51.780788 | orchestrator | 2026-04-28 04:35:51.780798 | orchestrator | PLAY [Gather facts for all hosts if using --limit] ***************************** 2026-04-28 04:35:51.780805 | orchestrator | 2026-04-28 04:35:51.780811 | orchestrator | TASK [Gather facts for all hosts] ********************************************** 2026-04-28 04:35:51.780817 | orchestrator | Tuesday 28 April 2026 04:35:47 +0000 (0:00:07.649) 0:00:17.215 ********* 2026-04-28 04:35:51.780824 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:35:51.780831 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:35:51.780837 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:35:51.780843 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:35:51.780850 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:35:51.780856 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:35:51.780862 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:35:51.780868 | orchestrator | 2026-04-28 04:35:51.780874 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:35:51.780881 | orchestrator | testbed-manager : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 04:35:51.780889 | orchestrator | testbed-node-0 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 04:35:51.780896 | orchestrator | testbed-node-1 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 04:35:51.780902 | orchestrator | testbed-node-2 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 04:35:51.780908 | orchestrator | testbed-node-3 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 04:35:51.780914 | orchestrator | testbed-node-4 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 04:35:51.780920 | orchestrator | testbed-node-5 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 04:35:51.780926 | orchestrator | 2026-04-28 04:35:51.780933 | orchestrator | 2026-04-28 04:35:51.780940 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 04:35:51.780946 | orchestrator | Tuesday 28 April 2026 04:35:51 +0000 (0:00:03.410) 0:00:20.626 ********* 2026-04-28 04:35:51.780953 | orchestrator | =============================================================================== 2026-04-28 04:35:51.780959 | orchestrator | Gathers facts about hosts ----------------------------------------------- 7.65s 2026-04-28 04:35:51.780965 | orchestrator | osism.commons.facts : Create custom facts directory --------------------- 4.09s 2026-04-28 04:35:51.780970 | orchestrator | Gather facts for all hosts ---------------------------------------------- 3.41s 2026-04-28 04:35:51.780976 | orchestrator | osism.commons.facts : Copy fact files ----------------------------------- 3.23s 2026-04-28 04:35:52.008380 | orchestrator | + [[ 10.0.0 != \l\a\t\e\s\t ]] 2026-04-28 04:35:52.008561 | orchestrator | ++ semver 10.0.0 10.0.0-0 2026-04-28 04:35:52.079160 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-28 04:35:52.079244 | orchestrator | ++ docker inspect --format '{{ index .Config.Labels "de.osism.release.openstack"}}' kolla-ansible 2026-04-28 04:35:52.118066 | orchestrator | + OPENSTACK_VERSION=2025.1 2026-04-28 04:35:52.118151 | orchestrator | + /opt/configuration/scripts/set-kolla-namespace.sh kolla/release/2025.1 2026-04-28 04:35:52.127179 | orchestrator | + set -e 2026-04-28 04:35:52.127255 | orchestrator | + NAMESPACE=kolla/release/2025.1 2026-04-28 04:35:52.127303 | orchestrator | + sed -i 's#docker_namespace: .*#docker_namespace: kolla/release/2025.1#g' /opt/configuration/inventory/group_vars/all/kolla.yml 2026-04-28 04:35:52.135622 | orchestrator | + sh -c /opt/configuration/scripts/upgrade-services.sh 2026-04-28 04:35:52.144987 | orchestrator | 2026-04-28 04:35:52.145063 | orchestrator | # UPGRADE SERVICES 2026-04-28 04:35:52.145072 | orchestrator | 2026-04-28 04:35:52.145106 | orchestrator | + set -e 2026-04-28 04:35:52.145114 | orchestrator | + echo 2026-04-28 04:35:52.145121 | orchestrator | + echo '# UPGRADE SERVICES' 2026-04-28 04:35:52.145128 | orchestrator | + echo 2026-04-28 04:35:52.145135 | orchestrator | + source /opt/manager-vars.sh 2026-04-28 04:35:52.146182 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-28 04:35:52.146218 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-28 04:35:52.146226 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-28 04:35:52.146234 | orchestrator | ++ CEPH_VERSION=reef 2026-04-28 04:35:52.146241 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-28 04:35:52.146250 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-28 04:35:52.146257 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-28 04:35:52.146265 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-28 04:35:52.146272 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-28 04:35:52.146279 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-28 04:35:52.146286 | orchestrator | ++ export ARA=false 2026-04-28 04:35:52.146294 | orchestrator | ++ ARA=false 2026-04-28 04:35:52.146301 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-28 04:35:52.146309 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-28 04:35:52.146316 | orchestrator | ++ export TEMPEST=false 2026-04-28 04:35:52.146323 | orchestrator | ++ TEMPEST=false 2026-04-28 04:35:52.146330 | orchestrator | ++ export IS_ZUUL=true 2026-04-28 04:35:52.146337 | orchestrator | ++ IS_ZUUL=true 2026-04-28 04:35:52.146345 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 04:35:52.146352 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 04:35:52.146359 | orchestrator | ++ export EXTERNAL_API=false 2026-04-28 04:35:52.146367 | orchestrator | ++ EXTERNAL_API=false 2026-04-28 04:35:52.146374 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-28 04:35:52.146381 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-28 04:35:52.146388 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-28 04:35:52.146395 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-28 04:35:52.146443 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-28 04:35:52.146451 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-28 04:35:52.146458 | orchestrator | ++ export RABBITMQ3TO4=true 2026-04-28 04:35:52.146465 | orchestrator | ++ RABBITMQ3TO4=true 2026-04-28 04:35:52.146472 | orchestrator | + SKIP_OPENSTACK_UPGRADE=false 2026-04-28 04:35:52.146479 | orchestrator | + SKIP_CEPH_UPGRADE=false 2026-04-28 04:35:52.146485 | orchestrator | + sh -c /opt/configuration/scripts/pull-images.sh 2026-04-28 04:35:52.157241 | orchestrator | + set -e 2026-04-28 04:35:52.157317 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-28 04:35:52.158438 | orchestrator | ++ export INTERACTIVE=false 2026-04-28 04:35:52.158483 | orchestrator | ++ INTERACTIVE=false 2026-04-28 04:35:52.158490 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-28 04:35:52.158496 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-28 04:35:52.158502 | orchestrator | + source /opt/manager-vars.sh 2026-04-28 04:35:52.158508 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-28 04:35:52.158514 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-28 04:35:52.158520 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-28 04:35:52.158526 | orchestrator | ++ CEPH_VERSION=reef 2026-04-28 04:35:52.158533 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-28 04:35:52.158540 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-28 04:35:52.158552 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-28 04:35:52.158559 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-28 04:35:52.158642 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-28 04:35:52.158650 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-28 04:35:52.158657 | orchestrator | ++ export ARA=false 2026-04-28 04:35:52.158664 | orchestrator | ++ ARA=false 2026-04-28 04:35:52.158670 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-28 04:35:52.158676 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-28 04:35:52.158683 | orchestrator | ++ export TEMPEST=false 2026-04-28 04:35:52.158689 | orchestrator | ++ TEMPEST=false 2026-04-28 04:35:52.158695 | orchestrator | ++ export IS_ZUUL=true 2026-04-28 04:35:52.158701 | orchestrator | ++ IS_ZUUL=true 2026-04-28 04:35:52.158709 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 04:35:52.158716 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 04:35:52.158723 | orchestrator | ++ export EXTERNAL_API=false 2026-04-28 04:35:52.158729 | orchestrator | ++ EXTERNAL_API=false 2026-04-28 04:35:52.158736 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-28 04:35:52.158743 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-28 04:35:52.158749 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-28 04:35:52.158756 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-28 04:35:52.158763 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-28 04:35:52.158769 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-28 04:35:52.158951 | orchestrator | 2026-04-28 04:35:52.158987 | orchestrator | # PULL IMAGES 2026-04-28 04:35:52.158994 | orchestrator | ++ export RABBITMQ3TO4=true 2026-04-28 04:35:52.159001 | orchestrator | ++ RABBITMQ3TO4=true 2026-04-28 04:35:52.159007 | orchestrator | + echo 2026-04-28 04:35:52.159014 | orchestrator | + echo '# PULL IMAGES' 2026-04-28 04:35:52.159020 | orchestrator | 2026-04-28 04:35:52.159026 | orchestrator | + echo 2026-04-28 04:35:52.160726 | orchestrator | ++ semver 9.5.0 7.0.0 2026-04-28 04:35:52.231763 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-28 04:35:52.231836 | orchestrator | + osism apply --no-wait -r 2 -e custom pull-images 2026-04-28 04:35:53.581718 | orchestrator | 2026-04-28 04:35:53 | INFO  | Trying to run play pull-images in environment custom 2026-04-28 04:36:03.645693 | orchestrator | 2026-04-28 04:36:03 | INFO  | Prepare task for execution of pull-images. 2026-04-28 04:36:03.735083 | orchestrator | 2026-04-28 04:36:03 | INFO  | Task 18f536ba-1738-45ed-8d01-eee7c03f4772 (pull-images) was prepared for execution. 2026-04-28 04:36:03.735179 | orchestrator | 2026-04-28 04:36:03 | INFO  | Task 18f536ba-1738-45ed-8d01-eee7c03f4772 is running in background. No more output. Check ARA for logs. 2026-04-28 04:36:03.961327 | orchestrator | + sh -c /opt/configuration/scripts/upgrade/500-kubernetes.sh 2026-04-28 04:36:03.967165 | orchestrator | + set -e 2026-04-28 04:36:03.967266 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-28 04:36:03.967295 | orchestrator | ++ export INTERACTIVE=false 2026-04-28 04:36:03.967397 | orchestrator | ++ INTERACTIVE=false 2026-04-28 04:36:03.967445 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-28 04:36:03.967456 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-28 04:36:03.967466 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-28 04:36:03.968951 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-28 04:36:03.980307 | orchestrator | ++ export MANAGER_VERSION=10.0.0 2026-04-28 04:36:03.980388 | orchestrator | ++ MANAGER_VERSION=10.0.0 2026-04-28 04:36:03.980401 | orchestrator | ++ semver 10.0.0 8.0.3 2026-04-28 04:36:04.030336 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-28 04:36:04.030477 | orchestrator | + osism apply frr 2026-04-28 04:36:15.522206 | orchestrator | 2026-04-28 04:36:15 | INFO  | Prepare task for execution of frr. 2026-04-28 04:36:15.605076 | orchestrator | 2026-04-28 04:36:15 | INFO  | Task 1fa30875-f98f-4d9a-9873-afbb5dadaa76 (frr) was prepared for execution. 2026-04-28 04:36:15.605189 | orchestrator | 2026-04-28 04:36:15 | INFO  | It takes a moment until task 1fa30875-f98f-4d9a-9873-afbb5dadaa76 (frr) has been started and output is visible here. 2026-04-28 04:36:53.233956 | orchestrator | 2026-04-28 04:36:53.234145 | orchestrator | PLAY [Apply role frr] ********************************************************** 2026-04-28 04:36:53.234163 | orchestrator | 2026-04-28 04:36:53.234173 | orchestrator | TASK [osism.services.frr : Include distribution specific install tasks] ******** 2026-04-28 04:36:53.234182 | orchestrator | Tuesday 28 April 2026 04:36:23 +0000 (0:00:03.520) 0:00:03.521 ********* 2026-04-28 04:36:53.234192 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/frr/tasks/install-Debian-family.yml for testbed-manager 2026-04-28 04:36:53.234202 | orchestrator | 2026-04-28 04:36:53.234211 | orchestrator | TASK [osism.services.frr : Pin frr package version] **************************** 2026-04-28 04:36:53.234220 | orchestrator | Tuesday 28 April 2026 04:36:25 +0000 (0:00:02.407) 0:00:05.928 ********* 2026-04-28 04:36:53.234229 | orchestrator | ok: [testbed-manager] 2026-04-28 04:36:53.234239 | orchestrator | 2026-04-28 04:36:53.234248 | orchestrator | TASK [osism.services.frr : Install frr package] ******************************** 2026-04-28 04:36:53.234267 | orchestrator | Tuesday 28 April 2026 04:36:27 +0000 (0:00:02.514) 0:00:08.442 ********* 2026-04-28 04:36:53.234276 | orchestrator | ok: [testbed-manager] 2026-04-28 04:36:53.234285 | orchestrator | 2026-04-28 04:36:53.234293 | orchestrator | TASK [osism.services.frr : Copy file: /etc/frr/vtysh.conf] ********************* 2026-04-28 04:36:53.234302 | orchestrator | Tuesday 28 April 2026 04:36:30 +0000 (0:00:02.991) 0:00:11.433 ********* 2026-04-28 04:36:53.234311 | orchestrator | ok: [testbed-manager] 2026-04-28 04:36:53.234320 | orchestrator | 2026-04-28 04:36:53.234328 | orchestrator | TASK [osism.services.frr : Copy file: /etc/frr/daemons] ************************ 2026-04-28 04:36:53.234356 | orchestrator | Tuesday 28 April 2026 04:36:32 +0000 (0:00:02.032) 0:00:13.466 ********* 2026-04-28 04:36:53.234365 | orchestrator | ok: [testbed-manager] 2026-04-28 04:36:53.234374 | orchestrator | 2026-04-28 04:36:53.234382 | orchestrator | TASK [osism.services.frr : Set _frr_uplinks fact] ****************************** 2026-04-28 04:36:53.234391 | orchestrator | Tuesday 28 April 2026 04:36:35 +0000 (0:00:02.048) 0:00:15.515 ********* 2026-04-28 04:36:53.234399 | orchestrator | ok: [testbed-manager] 2026-04-28 04:36:53.234408 | orchestrator | 2026-04-28 04:36:53.234420 | orchestrator | TASK [osism.services.frr : Write frr_config_template to temporary file] ******** 2026-04-28 04:36:53.234429 | orchestrator | Tuesday 28 April 2026 04:36:37 +0000 (0:00:02.689) 0:00:18.205 ********* 2026-04-28 04:36:53.234463 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:36:53.234475 | orchestrator | 2026-04-28 04:36:53.234486 | orchestrator | TASK [osism.services.frr : Render frr.conf from frr_config_template variable] *** 2026-04-28 04:36:53.234495 | orchestrator | Tuesday 28 April 2026 04:36:38 +0000 (0:00:01.187) 0:00:19.392 ********* 2026-04-28 04:36:53.234505 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:36:53.234515 | orchestrator | 2026-04-28 04:36:53.234525 | orchestrator | TASK [osism.services.frr : Remove temporary frr_config_template file] ********** 2026-04-28 04:36:53.234534 | orchestrator | Tuesday 28 April 2026 04:36:40 +0000 (0:00:01.158) 0:00:20.550 ********* 2026-04-28 04:36:53.234544 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:36:53.234554 | orchestrator | 2026-04-28 04:36:53.234564 | orchestrator | TASK [osism.services.frr : Check for frr.conf file in the configuration repository] *** 2026-04-28 04:36:53.234574 | orchestrator | Tuesday 28 April 2026 04:36:41 +0000 (0:00:01.193) 0:00:21.744 ********* 2026-04-28 04:36:53.234584 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:36:53.234594 | orchestrator | 2026-04-28 04:36:53.234604 | orchestrator | TASK [osism.services.frr : Copy frr.conf file from the configuration repository] *** 2026-04-28 04:36:53.234615 | orchestrator | Tuesday 28 April 2026 04:36:42 +0000 (0:00:01.150) 0:00:22.895 ********* 2026-04-28 04:36:53.234624 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:36:53.234634 | orchestrator | 2026-04-28 04:36:53.234644 | orchestrator | TASK [osism.services.frr : Copy default frr.conf file of type k3s_cilium] ****** 2026-04-28 04:36:53.234654 | orchestrator | Tuesday 28 April 2026 04:36:43 +0000 (0:00:01.223) 0:00:24.118 ********* 2026-04-28 04:36:53.234663 | orchestrator | ok: [testbed-manager] 2026-04-28 04:36:53.234671 | orchestrator | 2026-04-28 04:36:53.234680 | orchestrator | TASK [osism.services.frr : Set sysctl parameters] ****************************** 2026-04-28 04:36:53.234688 | orchestrator | Tuesday 28 April 2026 04:36:45 +0000 (0:00:02.080) 0:00:26.198 ********* 2026-04-28 04:36:53.234697 | orchestrator | ok: [testbed-manager] => (item={'name': 'net.ipv4.ip_forward', 'value': 1}) 2026-04-28 04:36:53.234705 | orchestrator | ok: [testbed-manager] => (item={'name': 'net.ipv4.conf.all.send_redirects', 'value': 0}) 2026-04-28 04:36:53.234715 | orchestrator | ok: [testbed-manager] => (item={'name': 'net.ipv4.conf.all.accept_redirects', 'value': 0}) 2026-04-28 04:36:53.234724 | orchestrator | ok: [testbed-manager] => (item={'name': 'net.ipv4.fib_multipath_hash_policy', 'value': 1}) 2026-04-28 04:36:53.234733 | orchestrator | ok: [testbed-manager] => (item={'name': 'net.ipv4.conf.default.ignore_routes_with_linkdown', 'value': 1}) 2026-04-28 04:36:53.234741 | orchestrator | ok: [testbed-manager] => (item={'name': 'net.ipv4.conf.all.rp_filter', 'value': 2}) 2026-04-28 04:36:53.234750 | orchestrator | 2026-04-28 04:36:53.234759 | orchestrator | TASK [osism.services.frr : Manage frr service] ********************************* 2026-04-28 04:36:53.234767 | orchestrator | Tuesday 28 April 2026 04:36:50 +0000 (0:00:04.629) 0:00:30.828 ********* 2026-04-28 04:36:53.234775 | orchestrator | ok: [testbed-manager] 2026-04-28 04:36:53.234784 | orchestrator | 2026-04-28 04:36:53.234792 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:36:53.234801 | orchestrator | testbed-manager : ok=9  changed=0 unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 04:36:53.234817 | orchestrator | 2026-04-28 04:36:53.234826 | orchestrator | 2026-04-28 04:36:53.234835 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 04:36:53.234843 | orchestrator | Tuesday 28 April 2026 04:36:52 +0000 (0:00:02.540) 0:00:33.369 ********* 2026-04-28 04:36:53.234852 | orchestrator | =============================================================================== 2026-04-28 04:36:53.234877 | orchestrator | osism.services.frr : Set sysctl parameters ------------------------------ 4.63s 2026-04-28 04:36:53.234886 | orchestrator | osism.services.frr : Install frr package -------------------------------- 2.99s 2026-04-28 04:36:53.234895 | orchestrator | osism.services.frr : Set _frr_uplinks fact ------------------------------ 2.69s 2026-04-28 04:36:53.234903 | orchestrator | osism.services.frr : Manage frr service --------------------------------- 2.54s 2026-04-28 04:36:53.234912 | orchestrator | osism.services.frr : Pin frr package version ---------------------------- 2.51s 2026-04-28 04:36:53.234920 | orchestrator | osism.services.frr : Include distribution specific install tasks -------- 2.41s 2026-04-28 04:36:53.234929 | orchestrator | osism.services.frr : Copy default frr.conf file of type k3s_cilium ------ 2.08s 2026-04-28 04:36:53.234937 | orchestrator | osism.services.frr : Copy file: /etc/frr/daemons ------------------------ 2.05s 2026-04-28 04:36:53.234946 | orchestrator | osism.services.frr : Copy file: /etc/frr/vtysh.conf --------------------- 2.03s 2026-04-28 04:36:53.234954 | orchestrator | osism.services.frr : Copy frr.conf file from the configuration repository --- 1.22s 2026-04-28 04:36:53.234963 | orchestrator | osism.services.frr : Remove temporary frr_config_template file ---------- 1.19s 2026-04-28 04:36:53.234971 | orchestrator | osism.services.frr : Write frr_config_template to temporary file -------- 1.19s 2026-04-28 04:36:53.234980 | orchestrator | osism.services.frr : Render frr.conf from frr_config_template variable --- 1.16s 2026-04-28 04:36:53.234988 | orchestrator | osism.services.frr : Check for frr.conf file in the configuration repository --- 1.15s 2026-04-28 04:36:53.446423 | orchestrator | + osism apply kubernetes 2026-04-28 04:36:54.767941 | orchestrator | 2026-04-28 04:36:54 | INFO  | Prepare task for execution of kubernetes. 2026-04-28 04:36:54.833103 | orchestrator | 2026-04-28 04:36:54 | INFO  | Task d973a21d-bfe9-48ed-862f-f7c55d0b11e2 (kubernetes) was prepared for execution. 2026-04-28 04:36:54.833173 | orchestrator | 2026-04-28 04:36:54 | INFO  | It takes a moment until task d973a21d-bfe9-48ed-862f-f7c55d0b11e2 (kubernetes) has been started and output is visible here. 2026-04-28 04:37:40.276846 | orchestrator | 2026-04-28 04:37:40.276964 | orchestrator | PLAY [Prepare all k3s nodes] *************************************************** 2026-04-28 04:37:40.276980 | orchestrator | 2026-04-28 04:37:40.276993 | orchestrator | TASK [k3s_prereq : Validating arguments against arg spec 'main' - Prerequisites] *** 2026-04-28 04:37:40.277005 | orchestrator | Tuesday 28 April 2026 04:37:01 +0000 (0:00:02.384) 0:00:02.384 ********* 2026-04-28 04:37:40.277016 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:37:40.277029 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:37:40.277050 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:37:40.277062 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:37:40.277073 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:37:40.277083 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:37:40.277094 | orchestrator | 2026-04-28 04:37:40.277105 | orchestrator | TASK [k3s_prereq : Set same timezone on every Server] ************************** 2026-04-28 04:37:40.277116 | orchestrator | Tuesday 28 April 2026 04:37:04 +0000 (0:00:03.815) 0:00:06.199 ********* 2026-04-28 04:37:40.277127 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:37:40.277139 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:37:40.277150 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:37:40.277161 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:37:40.277171 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:37:40.277182 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:37:40.277193 | orchestrator | 2026-04-28 04:37:40.277204 | orchestrator | TASK [k3s_prereq : Set SELinux to disabled state] ****************************** 2026-04-28 04:37:40.277215 | orchestrator | Tuesday 28 April 2026 04:37:06 +0000 (0:00:02.027) 0:00:08.227 ********* 2026-04-28 04:37:40.277248 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:37:40.277260 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:37:40.277270 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:37:40.277281 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:37:40.277291 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:37:40.277302 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:37:40.277312 | orchestrator | 2026-04-28 04:37:40.277323 | orchestrator | TASK [k3s_prereq : Enable IPv4 forwarding] ************************************* 2026-04-28 04:37:40.277336 | orchestrator | Tuesday 28 April 2026 04:37:08 +0000 (0:00:02.003) 0:00:10.230 ********* 2026-04-28 04:37:40.277349 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:37:40.277362 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:37:40.277373 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:37:40.277386 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:37:40.277398 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:37:40.277411 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:37:40.277423 | orchestrator | 2026-04-28 04:37:40.277436 | orchestrator | TASK [k3s_prereq : Enable IPv6 forwarding] ************************************* 2026-04-28 04:37:40.277448 | orchestrator | Tuesday 28 April 2026 04:37:12 +0000 (0:00:03.480) 0:00:13.711 ********* 2026-04-28 04:37:40.277484 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:37:40.277497 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:37:40.277509 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:37:40.277522 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:37:40.277533 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:37:40.277546 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:37:40.277558 | orchestrator | 2026-04-28 04:37:40.277570 | orchestrator | TASK [k3s_prereq : Enable IPv6 router advertisements] ************************** 2026-04-28 04:37:40.277583 | orchestrator | Tuesday 28 April 2026 04:37:14 +0000 (0:00:02.271) 0:00:15.983 ********* 2026-04-28 04:37:40.277595 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:37:40.277608 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:37:40.277620 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:37:40.277633 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:37:40.277645 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:37:40.277658 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:37:40.277670 | orchestrator | 2026-04-28 04:37:40.277682 | orchestrator | TASK [k3s_prereq : Add br_netfilter to /etc/modules-load.d/] ******************* 2026-04-28 04:37:40.277694 | orchestrator | Tuesday 28 April 2026 04:37:18 +0000 (0:00:03.583) 0:00:19.566 ********* 2026-04-28 04:37:40.277705 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:37:40.277716 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:37:40.277726 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:37:40.277737 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:37:40.277750 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:37:40.277779 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:37:40.277799 | orchestrator | 2026-04-28 04:37:40.277817 | orchestrator | TASK [k3s_prereq : Load br_netfilter] ****************************************** 2026-04-28 04:37:40.277836 | orchestrator | Tuesday 28 April 2026 04:37:20 +0000 (0:00:02.417) 0:00:21.984 ********* 2026-04-28 04:37:40.277854 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:37:40.277873 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:37:40.277892 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:37:40.277909 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:37:40.277920 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:37:40.277935 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:37:40.277950 | orchestrator | 2026-04-28 04:37:40.277960 | orchestrator | TASK [k3s_prereq : Set bridge-nf-call-iptables (just to be sure)] ************** 2026-04-28 04:37:40.277971 | orchestrator | Tuesday 28 April 2026 04:37:22 +0000 (0:00:02.049) 0:00:24.034 ********* 2026-04-28 04:37:40.277982 | orchestrator | skipping: [testbed-node-3] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-28 04:37:40.277993 | orchestrator | skipping: [testbed-node-3] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-28 04:37:40.278013 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:37:40.278097 | orchestrator | skipping: [testbed-node-4] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-28 04:37:40.278108 | orchestrator | skipping: [testbed-node-4] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-28 04:37:40.278119 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:37:40.278130 | orchestrator | skipping: [testbed-node-5] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-28 04:37:40.278140 | orchestrator | skipping: [testbed-node-5] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-28 04:37:40.278151 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:37:40.278162 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-28 04:37:40.278172 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-28 04:37:40.278183 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:37:40.278216 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-28 04:37:40.278228 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-28 04:37:40.278238 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:37:40.278249 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-28 04:37:40.278260 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-28 04:37:40.278271 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:37:40.278281 | orchestrator | 2026-04-28 04:37:40.278292 | orchestrator | TASK [k3s_prereq : Add /usr/local/bin to sudo secure_path] ********************* 2026-04-28 04:37:40.278303 | orchestrator | Tuesday 28 April 2026 04:37:24 +0000 (0:00:01.919) 0:00:25.954 ********* 2026-04-28 04:37:40.278313 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:37:40.278324 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:37:40.278335 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:37:40.278345 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:37:40.278356 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:37:40.278366 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:37:40.278377 | orchestrator | 2026-04-28 04:37:40.278388 | orchestrator | TASK [k3s_download : Validating arguments against arg spec 'main' - Manage the downloading of K3S binaries] *** 2026-04-28 04:37:40.278400 | orchestrator | Tuesday 28 April 2026 04:37:26 +0000 (0:00:02.270) 0:00:28.224 ********* 2026-04-28 04:37:40.278411 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:37:40.278422 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:37:40.278432 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:37:40.278443 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:37:40.278453 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:37:40.278492 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:37:40.278503 | orchestrator | 2026-04-28 04:37:40.278514 | orchestrator | TASK [k3s_download : Download k3s binary x64] ********************************** 2026-04-28 04:37:40.278525 | orchestrator | Tuesday 28 April 2026 04:37:28 +0000 (0:00:01.892) 0:00:30.116 ********* 2026-04-28 04:37:40.278535 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:37:40.278546 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:37:40.278556 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:37:40.278567 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:37:40.278578 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:37:40.278588 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:37:40.278599 | orchestrator | 2026-04-28 04:37:40.278610 | orchestrator | TASK [k3s_download : Download k3s binary arm64] ******************************** 2026-04-28 04:37:40.278620 | orchestrator | Tuesday 28 April 2026 04:37:31 +0000 (0:00:02.745) 0:00:32.862 ********* 2026-04-28 04:37:40.278631 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:37:40.278646 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:37:40.278657 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:37:40.278668 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:37:40.278679 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:37:40.278689 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:37:40.278708 | orchestrator | 2026-04-28 04:37:40.278720 | orchestrator | TASK [k3s_download : Download k3s binary armhf] ******************************** 2026-04-28 04:37:40.278731 | orchestrator | Tuesday 28 April 2026 04:37:33 +0000 (0:00:01.836) 0:00:34.698 ********* 2026-04-28 04:37:40.278749 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:37:40.278760 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:37:40.278770 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:37:40.278781 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:37:40.278792 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:37:40.278802 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:37:40.278813 | orchestrator | 2026-04-28 04:37:40.278824 | orchestrator | TASK [k3s_custom_registries : Validating arguments against arg spec 'main' - Configure the use of a custom container registry] *** 2026-04-28 04:37:40.278836 | orchestrator | Tuesday 28 April 2026 04:37:35 +0000 (0:00:02.249) 0:00:36.948 ********* 2026-04-28 04:37:40.278846 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:37:40.278857 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:37:40.278868 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:37:40.278878 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:37:40.278889 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:37:40.278899 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:37:40.278910 | orchestrator | 2026-04-28 04:37:40.278920 | orchestrator | TASK [k3s_custom_registries : Create directory /etc/rancher/k3s] *************** 2026-04-28 04:37:40.278931 | orchestrator | Tuesday 28 April 2026 04:37:37 +0000 (0:00:02.016) 0:00:38.964 ********* 2026-04-28 04:37:40.278999 | orchestrator | skipping: [testbed-node-3] => (item=rancher)  2026-04-28 04:37:40.279011 | orchestrator | skipping: [testbed-node-3] => (item=rancher/k3s)  2026-04-28 04:37:40.279021 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:37:40.279032 | orchestrator | skipping: [testbed-node-4] => (item=rancher)  2026-04-28 04:37:40.279043 | orchestrator | skipping: [testbed-node-4] => (item=rancher/k3s)  2026-04-28 04:37:40.279053 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:37:40.279064 | orchestrator | skipping: [testbed-node-5] => (item=rancher)  2026-04-28 04:37:40.279074 | orchestrator | skipping: [testbed-node-5] => (item=rancher/k3s)  2026-04-28 04:37:40.279088 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:37:40.279107 | orchestrator | skipping: [testbed-node-0] => (item=rancher)  2026-04-28 04:37:40.279118 | orchestrator | skipping: [testbed-node-0] => (item=rancher/k3s)  2026-04-28 04:37:40.279128 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:37:40.279139 | orchestrator | skipping: [testbed-node-1] => (item=rancher)  2026-04-28 04:37:40.279149 | orchestrator | skipping: [testbed-node-1] => (item=rancher/k3s)  2026-04-28 04:37:40.279160 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:37:40.279170 | orchestrator | skipping: [testbed-node-2] => (item=rancher)  2026-04-28 04:37:40.279181 | orchestrator | skipping: [testbed-node-2] => (item=rancher/k3s)  2026-04-28 04:37:40.279191 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:37:40.279202 | orchestrator | 2026-04-28 04:37:40.279213 | orchestrator | TASK [k3s_custom_registries : Insert registries into /etc/rancher/k3s/registries.yaml] *** 2026-04-28 04:37:40.279229 | orchestrator | Tuesday 28 April 2026 04:37:39 +0000 (0:00:02.039) 0:00:41.004 ********* 2026-04-28 04:37:40.279241 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:37:40.279252 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:37:40.279270 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:39:47.196514 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:39:47.196637 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:39:47.196646 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:39:47.196653 | orchestrator | 2026-04-28 04:39:47.196662 | orchestrator | TASK [k3s_custom_registries : Remove /etc/rancher/k3s/registries.yaml when no registries configured] *** 2026-04-28 04:39:47.196670 | orchestrator | Tuesday 28 April 2026 04:37:41 +0000 (0:00:02.192) 0:00:43.197 ********* 2026-04-28 04:39:47.196677 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:39:47.196700 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:39:47.196704 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:39:47.196708 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:39:47.196712 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:39:47.196715 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:39:47.196719 | orchestrator | 2026-04-28 04:39:47.196723 | orchestrator | PLAY [Deploy k3s master nodes] ************************************************* 2026-04-28 04:39:47.196727 | orchestrator | 2026-04-28 04:39:47.196731 | orchestrator | TASK [k3s_server : Validating arguments against arg spec 'main' - Setup k3s servers] *** 2026-04-28 04:39:47.196736 | orchestrator | Tuesday 28 April 2026 04:37:45 +0000 (0:00:03.230) 0:00:46.427 ********* 2026-04-28 04:39:47.196740 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:39:47.196745 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:39:47.196748 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:39:47.196752 | orchestrator | 2026-04-28 04:39:47.196756 | orchestrator | TASK [k3s_server : Stop k3s-init] ********************************************** 2026-04-28 04:39:47.196760 | orchestrator | Tuesday 28 April 2026 04:37:48 +0000 (0:00:03.281) 0:00:49.708 ********* 2026-04-28 04:39:47.196763 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:39:47.196767 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:39:47.196771 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:39:47.196774 | orchestrator | 2026-04-28 04:39:47.196779 | orchestrator | TASK [k3s_server : Stop k3s] *************************************************** 2026-04-28 04:39:47.196785 | orchestrator | Tuesday 28 April 2026 04:37:51 +0000 (0:00:03.077) 0:00:52.785 ********* 2026-04-28 04:39:47.196792 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:39:47.196798 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:39:47.196804 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:39:47.196809 | orchestrator | 2026-04-28 04:39:47.196815 | orchestrator | TASK [k3s_server : Clean previous runs of k3s-init] **************************** 2026-04-28 04:39:47.196821 | orchestrator | Tuesday 28 April 2026 04:37:53 +0000 (0:00:02.262) 0:00:55.048 ********* 2026-04-28 04:39:47.196827 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:39:47.196832 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:39:47.196838 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:39:47.196844 | orchestrator | 2026-04-28 04:39:47.196849 | orchestrator | TASK [k3s_server : Deploy K3s http_proxy conf] ********************************* 2026-04-28 04:39:47.196856 | orchestrator | Tuesday 28 April 2026 04:37:55 +0000 (0:00:01.766) 0:00:56.814 ********* 2026-04-28 04:39:47.196862 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:39:47.196869 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:39:47.196875 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:39:47.196881 | orchestrator | 2026-04-28 04:39:47.196889 | orchestrator | TASK [k3s_server : Create /etc/rancher/k3s directory] ************************** 2026-04-28 04:39:47.196893 | orchestrator | Tuesday 28 April 2026 04:37:56 +0000 (0:00:01.494) 0:00:58.309 ********* 2026-04-28 04:39:47.196896 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:39:47.196900 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:39:47.196904 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:39:47.196907 | orchestrator | 2026-04-28 04:39:47.196911 | orchestrator | TASK [k3s_server : Create custom resolv.conf for k3s] ************************** 2026-04-28 04:39:47.196915 | orchestrator | Tuesday 28 April 2026 04:37:59 +0000 (0:00:02.084) 0:01:00.394 ********* 2026-04-28 04:39:47.196918 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:39:47.196922 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:39:47.196926 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:39:47.196929 | orchestrator | 2026-04-28 04:39:47.196933 | orchestrator | TASK [k3s_server : Deploy vip manifest] **************************************** 2026-04-28 04:39:47.196937 | orchestrator | Tuesday 28 April 2026 04:38:01 +0000 (0:00:02.479) 0:01:02.873 ********* 2026-04-28 04:39:47.196940 | orchestrator | included: /ansible/roles/k3s_server/tasks/vip.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:39:47.196944 | orchestrator | 2026-04-28 04:39:47.196948 | orchestrator | TASK [k3s_server : Set _kube_vip_bgp_peers fact] ******************************* 2026-04-28 04:39:47.196951 | orchestrator | Tuesday 28 April 2026 04:38:03 +0000 (0:00:01.821) 0:01:04.694 ********* 2026-04-28 04:39:47.196960 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:39:47.196963 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:39:47.196967 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:39:47.196971 | orchestrator | 2026-04-28 04:39:47.196974 | orchestrator | TASK [k3s_server : Create manifests directory on first master] ***************** 2026-04-28 04:39:47.196978 | orchestrator | Tuesday 28 April 2026 04:38:06 +0000 (0:00:02.777) 0:01:07.472 ********* 2026-04-28 04:39:47.196982 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:39:47.196986 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:39:47.196989 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:39:47.196993 | orchestrator | 2026-04-28 04:39:47.196997 | orchestrator | TASK [k3s_server : Download vip rbac manifest to first master] ***************** 2026-04-28 04:39:47.197000 | orchestrator | Tuesday 28 April 2026 04:38:07 +0000 (0:00:01.713) 0:01:09.186 ********* 2026-04-28 04:39:47.197004 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:39:47.197008 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:39:47.197011 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:39:47.197015 | orchestrator | 2026-04-28 04:39:47.197019 | orchestrator | TASK [k3s_server : Copy vip manifest to first master] ************************** 2026-04-28 04:39:47.197023 | orchestrator | Tuesday 28 April 2026 04:38:09 +0000 (0:00:01.853) 0:01:11.040 ********* 2026-04-28 04:39:47.197027 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:39:47.197030 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:39:47.197034 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:39:47.197038 | orchestrator | 2026-04-28 04:39:47.197041 | orchestrator | TASK [k3s_server : Deploy metallb manifest] ************************************ 2026-04-28 04:39:47.197045 | orchestrator | Tuesday 28 April 2026 04:38:12 +0000 (0:00:02.663) 0:01:13.704 ********* 2026-04-28 04:39:47.197049 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:39:47.197053 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:39:47.197068 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:39:47.197072 | orchestrator | 2026-04-28 04:39:47.197076 | orchestrator | TASK [k3s_server : Deploy kube-vip manifest] *********************************** 2026-04-28 04:39:47.197080 | orchestrator | Tuesday 28 April 2026 04:38:13 +0000 (0:00:01.592) 0:01:15.296 ********* 2026-04-28 04:39:47.197084 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:39:47.197088 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:39:47.197093 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:39:47.197097 | orchestrator | 2026-04-28 04:39:47.197101 | orchestrator | TASK [k3s_server : Init cluster inside the transient k3s-init service] ********* 2026-04-28 04:39:47.197106 | orchestrator | Tuesday 28 April 2026 04:38:15 +0000 (0:00:01.624) 0:01:16.921 ********* 2026-04-28 04:39:47.197122 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:39:47.197126 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:39:47.197131 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:39:47.197135 | orchestrator | 2026-04-28 04:39:47.197139 | orchestrator | TASK [k3s_server : Detect Kubernetes version for label compatibility] ********** 2026-04-28 04:39:47.197144 | orchestrator | Tuesday 28 April 2026 04:38:17 +0000 (0:00:02.201) 0:01:19.122 ********* 2026-04-28 04:39:47.197148 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:39:47.197152 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:39:47.197156 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:39:47.197160 | orchestrator | 2026-04-28 04:39:47.197164 | orchestrator | TASK [k3s_server : Set node role label selector based on Kubernetes version] *** 2026-04-28 04:39:47.197168 | orchestrator | Tuesday 28 April 2026 04:38:19 +0000 (0:00:02.105) 0:01:21.228 ********* 2026-04-28 04:39:47.197172 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:39:47.197176 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:39:47.197181 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:39:47.197185 | orchestrator | 2026-04-28 04:39:47.197189 | orchestrator | TASK [k3s_server : Verify that all nodes actually joined (check k3s-init.service if this fails)] *** 2026-04-28 04:39:47.197194 | orchestrator | Tuesday 28 April 2026 04:38:21 +0000 (0:00:01.457) 0:01:22.686 ********* 2026-04-28 04:39:47.197202 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (20 retries left). 2026-04-28 04:39:47.197208 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (20 retries left). 2026-04-28 04:39:47.197212 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (20 retries left). 2026-04-28 04:39:47.197217 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (19 retries left). 2026-04-28 04:39:47.197221 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (19 retries left). 2026-04-28 04:39:47.197225 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (19 retries left). 2026-04-28 04:39:47.197230 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Verify that all nodes actually joined (check k3s-init.service if this fails) (18 retries left). 2026-04-28 04:39:47.197234 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Verify that all nodes actually joined (check k3s-init.service if this fails) (18 retries left). 2026-04-28 04:39:47.197238 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Verify that all nodes actually joined (check k3s-init.service if this fails) (18 retries left). 2026-04-28 04:39:47.197252 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:39:47.197261 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:39:47.197266 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:39:47.197270 | orchestrator | 2026-04-28 04:39:47.197274 | orchestrator | TASK [k3s_server : Save logs of k3s-init.service] ****************************** 2026-04-28 04:39:47.197278 | orchestrator | Tuesday 28 April 2026 04:38:55 +0000 (0:00:33.841) 0:01:56.527 ********* 2026-04-28 04:39:47.197282 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:39:47.197287 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:39:47.197291 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:39:47.197295 | orchestrator | 2026-04-28 04:39:47.197299 | orchestrator | TASK [k3s_server : Kill the temporary service used for initialization] ********* 2026-04-28 04:39:47.197303 | orchestrator | Tuesday 28 April 2026 04:38:56 +0000 (0:00:01.440) 0:01:57.968 ********* 2026-04-28 04:39:47.197308 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:39:47.197312 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:39:47.197316 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:39:47.197320 | orchestrator | 2026-04-28 04:39:47.197325 | orchestrator | TASK [k3s_server : Copy K3s service file] ************************************** 2026-04-28 04:39:47.197329 | orchestrator | Tuesday 28 April 2026 04:38:59 +0000 (0:00:02.462) 0:02:00.431 ********* 2026-04-28 04:39:47.197333 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:39:47.197337 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:39:47.197342 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:39:47.197346 | orchestrator | 2026-04-28 04:39:47.197350 | orchestrator | TASK [k3s_server : Enable and check K3s service] ******************************* 2026-04-28 04:39:47.197355 | orchestrator | Tuesday 28 April 2026 04:39:01 +0000 (0:00:02.447) 0:02:02.879 ********* 2026-04-28 04:39:47.197359 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:39:47.197363 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:39:47.197367 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:39:47.197372 | orchestrator | 2026-04-28 04:39:47.197375 | orchestrator | TASK [k3s_server : Wait for node-token] **************************************** 2026-04-28 04:39:47.197379 | orchestrator | Tuesday 28 April 2026 04:39:45 +0000 (0:00:43.760) 0:02:46.640 ********* 2026-04-28 04:39:47.197383 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:39:47.197387 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:39:47.197390 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:39:47.197394 | orchestrator | 2026-04-28 04:39:47.197398 | orchestrator | TASK [k3s_server : Register node-token file access mode] *********************** 2026-04-28 04:39:47.197408 | orchestrator | Tuesday 28 April 2026 04:39:47 +0000 (0:00:01.871) 0:02:48.511 ********* 2026-04-28 04:40:36.110142 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:40:36.110257 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:40:36.110274 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:40:36.110287 | orchestrator | 2026-04-28 04:40:36.110299 | orchestrator | TASK [k3s_server : Change file access node-token] ****************************** 2026-04-28 04:40:36.110311 | orchestrator | Tuesday 28 April 2026 04:39:48 +0000 (0:00:01.711) 0:02:50.223 ********* 2026-04-28 04:40:36.110323 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:40:36.110335 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:40:36.110346 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:40:36.110357 | orchestrator | 2026-04-28 04:40:36.110368 | orchestrator | TASK [k3s_server : Read node-token from master] ******************************** 2026-04-28 04:40:36.110379 | orchestrator | Tuesday 28 April 2026 04:39:50 +0000 (0:00:01.765) 0:02:51.988 ********* 2026-04-28 04:40:36.110390 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:40:36.110401 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:40:36.110412 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:40:36.110422 | orchestrator | 2026-04-28 04:40:36.110433 | orchestrator | TASK [k3s_server : Store Master node-token] ************************************ 2026-04-28 04:40:36.110450 | orchestrator | Tuesday 28 April 2026 04:39:52 +0000 (0:00:01.738) 0:02:53.726 ********* 2026-04-28 04:40:36.110469 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:40:36.110483 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:40:36.110493 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:40:36.110504 | orchestrator | 2026-04-28 04:40:36.110515 | orchestrator | TASK [k3s_server : Restore node-token file access] ***************************** 2026-04-28 04:40:36.110526 | orchestrator | Tuesday 28 April 2026 04:39:53 +0000 (0:00:01.573) 0:02:55.299 ********* 2026-04-28 04:40:36.110537 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:40:36.110579 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:40:36.110590 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:40:36.110601 | orchestrator | 2026-04-28 04:40:36.110612 | orchestrator | TASK [k3s_server : Create directory .kube] ************************************* 2026-04-28 04:40:36.110622 | orchestrator | Tuesday 28 April 2026 04:39:55 +0000 (0:00:01.824) 0:02:57.124 ********* 2026-04-28 04:40:36.110633 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:40:36.110644 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:40:36.110655 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:40:36.110665 | orchestrator | 2026-04-28 04:40:36.110676 | orchestrator | TASK [k3s_server : Copy config file to user home directory] ******************** 2026-04-28 04:40:36.110688 | orchestrator | Tuesday 28 April 2026 04:39:57 +0000 (0:00:01.708) 0:02:58.832 ********* 2026-04-28 04:40:36.110699 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:40:36.110709 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:40:36.110721 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:40:36.110731 | orchestrator | 2026-04-28 04:40:36.110742 | orchestrator | TASK [k3s_server : Configure kubectl cluster to https://192.168.16.8:6443] ***** 2026-04-28 04:40:36.110753 | orchestrator | Tuesday 28 April 2026 04:39:59 +0000 (0:00:01.866) 0:03:00.699 ********* 2026-04-28 04:40:36.110764 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:40:36.110775 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:40:36.110786 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:40:36.110796 | orchestrator | 2026-04-28 04:40:36.110807 | orchestrator | TASK [k3s_server : Create kubectl symlink] ************************************* 2026-04-28 04:40:36.110818 | orchestrator | Tuesday 28 April 2026 04:40:01 +0000 (0:00:02.242) 0:03:02.942 ********* 2026-04-28 04:40:36.110829 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:40:36.110840 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:40:36.110850 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:40:36.110861 | orchestrator | 2026-04-28 04:40:36.110872 | orchestrator | TASK [k3s_server : Create crictl symlink] ************************************** 2026-04-28 04:40:36.110883 | orchestrator | Tuesday 28 April 2026 04:40:03 +0000 (0:00:01.452) 0:03:04.394 ********* 2026-04-28 04:40:36.110914 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:40:36.110925 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:40:36.110936 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:40:36.110946 | orchestrator | 2026-04-28 04:40:36.110957 | orchestrator | TASK [k3s_server : Get contents of manifests folder] *************************** 2026-04-28 04:40:36.110968 | orchestrator | Tuesday 28 April 2026 04:40:04 +0000 (0:00:01.421) 0:03:05.816 ********* 2026-04-28 04:40:36.110979 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:40:36.110989 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:40:36.111000 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:40:36.111011 | orchestrator | 2026-04-28 04:40:36.111021 | orchestrator | TASK [k3s_server : Get sub dirs of manifests folder] *************************** 2026-04-28 04:40:36.111032 | orchestrator | Tuesday 28 April 2026 04:40:06 +0000 (0:00:01.702) 0:03:07.518 ********* 2026-04-28 04:40:36.111043 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:40:36.111053 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:40:36.111064 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:40:36.111075 | orchestrator | 2026-04-28 04:40:36.111087 | orchestrator | TASK [k3s_server : Remove manifests and folders that are only needed for bootstrapping cluster so k3s doesn't auto apply on start] *** 2026-04-28 04:40:36.111099 | orchestrator | Tuesday 28 April 2026 04:40:07 +0000 (0:00:01.704) 0:03:09.222 ********* 2026-04-28 04:40:36.111110 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/rolebindings.yaml) 2026-04-28 04:40:36.111121 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/rolebindings.yaml) 2026-04-28 04:40:36.111132 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/rolebindings.yaml) 2026-04-28 04:40:36.111143 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/local-storage.yaml) 2026-04-28 04:40:36.111163 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/local-storage.yaml) 2026-04-28 04:40:36.111175 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/local-storage.yaml) 2026-04-28 04:40:36.111189 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/coredns.yaml) 2026-04-28 04:40:36.111201 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/coredns.yaml) 2026-04-28 04:40:36.111230 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/coredns.yaml) 2026-04-28 04:40:36.111242 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/vip.yaml) 2026-04-28 04:40:36.111252 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/runtimes.yaml) 2026-04-28 04:40:36.111263 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/runtimes.yaml) 2026-04-28 04:40:36.111274 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/vip-rbac.yaml) 2026-04-28 04:40:36.111285 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/ccm.yaml) 2026-04-28 04:40:36.111296 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/ccm.yaml) 2026-04-28 04:40:36.111307 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/runtimes.yaml) 2026-04-28 04:40:36.111318 | orchestrator | changed: [testbed-node-1] => (item=/var/lib/rancher/k3s/server/manifests/metrics-server) 2026-04-28 04:40:36.111328 | orchestrator | changed: [testbed-node-2] => (item=/var/lib/rancher/k3s/server/manifests/metrics-server) 2026-04-28 04:40:36.111339 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/ccm.yaml) 2026-04-28 04:40:36.111350 | orchestrator | changed: [testbed-node-0] => (item=/var/lib/rancher/k3s/server/manifests/metrics-server) 2026-04-28 04:40:36.111361 | orchestrator | 2026-04-28 04:40:36.111372 | orchestrator | PLAY [Deploy k3s worker nodes] ************************************************* 2026-04-28 04:40:36.111383 | orchestrator | 2026-04-28 04:40:36.111402 | orchestrator | TASK [k3s_agent : Validating arguments against arg spec 'main' - Setup k3s agents] *** 2026-04-28 04:40:36.111413 | orchestrator | Tuesday 28 April 2026 04:40:12 +0000 (0:00:04.306) 0:03:13.529 ********* 2026-04-28 04:40:36.111423 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:40:36.111434 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:40:36.111445 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:40:36.111456 | orchestrator | 2026-04-28 04:40:36.111467 | orchestrator | TASK [k3s_agent : Check if system is PXE-booted] ******************************* 2026-04-28 04:40:36.111477 | orchestrator | Tuesday 28 April 2026 04:40:13 +0000 (0:00:01.697) 0:03:15.227 ********* 2026-04-28 04:40:36.111488 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:40:36.111499 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:40:36.111509 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:40:36.111520 | orchestrator | 2026-04-28 04:40:36.111531 | orchestrator | TASK [k3s_agent : Set fact for PXE-booted system] ****************************** 2026-04-28 04:40:36.111591 | orchestrator | Tuesday 28 April 2026 04:40:15 +0000 (0:00:01.848) 0:03:17.075 ********* 2026-04-28 04:40:36.111604 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:40:36.111614 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:40:36.111625 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:40:36.111636 | orchestrator | 2026-04-28 04:40:36.111646 | orchestrator | TASK [k3s_agent : Include http_proxy configuration tasks] ********************** 2026-04-28 04:40:36.111657 | orchestrator | Tuesday 28 April 2026 04:40:17 +0000 (0:00:01.556) 0:03:18.631 ********* 2026-04-28 04:40:36.111668 | orchestrator | included: /ansible/roles/k3s_agent/tasks/http_proxy.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 04:40:36.111679 | orchestrator | 2026-04-28 04:40:36.111690 | orchestrator | TASK [k3s_agent : Create k3s-node.service.d directory] ************************* 2026-04-28 04:40:36.111700 | orchestrator | Tuesday 28 April 2026 04:40:19 +0000 (0:00:01.999) 0:03:20.631 ********* 2026-04-28 04:40:36.111714 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:40:36.111733 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:40:36.111754 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:40:36.111774 | orchestrator | 2026-04-28 04:40:36.111794 | orchestrator | TASK [k3s_agent : Copy K3s http_proxy conf file] ******************************* 2026-04-28 04:40:36.111812 | orchestrator | Tuesday 28 April 2026 04:40:20 +0000 (0:00:01.460) 0:03:22.091 ********* 2026-04-28 04:40:36.111823 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:40:36.111834 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:40:36.111845 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:40:36.111856 | orchestrator | 2026-04-28 04:40:36.111867 | orchestrator | TASK [k3s_agent : Deploy K3s http_proxy conf] ********************************** 2026-04-28 04:40:36.111877 | orchestrator | Tuesday 28 April 2026 04:40:22 +0000 (0:00:01.410) 0:03:23.502 ********* 2026-04-28 04:40:36.111888 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:40:36.111899 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:40:36.111910 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:40:36.111920 | orchestrator | 2026-04-28 04:40:36.111931 | orchestrator | TASK [k3s_agent : Create /etc/rancher/k3s directory] *************************** 2026-04-28 04:40:36.111942 | orchestrator | Tuesday 28 April 2026 04:40:23 +0000 (0:00:01.472) 0:03:24.975 ********* 2026-04-28 04:40:36.111952 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:40:36.111963 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:40:36.111974 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:40:36.111985 | orchestrator | 2026-04-28 04:40:36.111995 | orchestrator | TASK [k3s_agent : Create custom resolv.conf for k3s] *************************** 2026-04-28 04:40:36.112006 | orchestrator | Tuesday 28 April 2026 04:40:25 +0000 (0:00:01.805) 0:03:26.781 ********* 2026-04-28 04:40:36.112017 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:40:36.112028 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:40:36.112038 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:40:36.112049 | orchestrator | 2026-04-28 04:40:36.112060 | orchestrator | TASK [k3s_agent : Configure the k3s service] *********************************** 2026-04-28 04:40:36.112071 | orchestrator | Tuesday 28 April 2026 04:40:27 +0000 (0:00:02.190) 0:03:28.972 ********* 2026-04-28 04:40:36.112091 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:40:36.112101 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:40:36.112112 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:40:36.112123 | orchestrator | 2026-04-28 04:40:36.112134 | orchestrator | TASK [k3s_agent : Manage k3s service] ****************************************** 2026-04-28 04:40:36.112145 | orchestrator | Tuesday 28 April 2026 04:40:30 +0000 (0:00:02.390) 0:03:31.362 ********* 2026-04-28 04:40:36.112163 | orchestrator | changed: [testbed-node-3] 2026-04-28 04:41:49.262504 | orchestrator | changed: [testbed-node-4] 2026-04-28 04:41:49.262649 | orchestrator | changed: [testbed-node-5] 2026-04-28 04:41:49.262662 | orchestrator | 2026-04-28 04:41:49.262671 | orchestrator | PLAY [Prepare kubeconfig file] ************************************************* 2026-04-28 04:41:49.262679 | orchestrator | 2026-04-28 04:41:49.262687 | orchestrator | TASK [Get home directory of operator user] ************************************* 2026-04-28 04:41:49.262694 | orchestrator | Tuesday 28 April 2026 04:40:38 +0000 (0:00:08.289) 0:03:39.652 ********* 2026-04-28 04:41:49.262701 | orchestrator | ok: [testbed-manager] 2026-04-28 04:41:49.262710 | orchestrator | 2026-04-28 04:41:49.262717 | orchestrator | TASK [Create .kube directory] ************************************************** 2026-04-28 04:41:49.262724 | orchestrator | Tuesday 28 April 2026 04:40:40 +0000 (0:00:02.263) 0:03:41.915 ********* 2026-04-28 04:41:49.262730 | orchestrator | ok: [testbed-manager] 2026-04-28 04:41:49.262737 | orchestrator | 2026-04-28 04:41:49.262744 | orchestrator | TASK [Get kubeconfig file] ***************************************************** 2026-04-28 04:41:49.262750 | orchestrator | Tuesday 28 April 2026 04:40:42 +0000 (0:00:01.454) 0:03:43.369 ********* 2026-04-28 04:41:49.262757 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] 2026-04-28 04:41:49.262764 | orchestrator | 2026-04-28 04:41:49.262771 | orchestrator | TASK [Write kubeconfig file] *************************************************** 2026-04-28 04:41:49.262777 | orchestrator | Tuesday 28 April 2026 04:40:43 +0000 (0:00:01.644) 0:03:45.014 ********* 2026-04-28 04:41:49.262784 | orchestrator | changed: [testbed-manager] 2026-04-28 04:41:49.262791 | orchestrator | 2026-04-28 04:41:49.262798 | orchestrator | TASK [Change server address in the kubeconfig] ********************************* 2026-04-28 04:41:49.262804 | orchestrator | Tuesday 28 April 2026 04:40:45 +0000 (0:00:01.990) 0:03:47.004 ********* 2026-04-28 04:41:49.262811 | orchestrator | changed: [testbed-manager] 2026-04-28 04:41:49.262818 | orchestrator | 2026-04-28 04:41:49.262824 | orchestrator | TASK [Make kubeconfig available for use inside the manager service] ************ 2026-04-28 04:41:49.262831 | orchestrator | Tuesday 28 April 2026 04:40:47 +0000 (0:00:01.933) 0:03:48.938 ********* 2026-04-28 04:41:49.262838 | orchestrator | changed: [testbed-manager -> localhost] 2026-04-28 04:41:49.262844 | orchestrator | 2026-04-28 04:41:49.262851 | orchestrator | TASK [Change server address in the kubeconfig inside the manager service] ****** 2026-04-28 04:41:49.262858 | orchestrator | Tuesday 28 April 2026 04:40:50 +0000 (0:00:03.276) 0:03:52.214 ********* 2026-04-28 04:41:49.262864 | orchestrator | changed: [testbed-manager -> localhost] 2026-04-28 04:41:49.262871 | orchestrator | 2026-04-28 04:41:49.262877 | orchestrator | TASK [Set KUBECONFIG environment variable] ************************************* 2026-04-28 04:41:49.262884 | orchestrator | Tuesday 28 April 2026 04:40:52 +0000 (0:00:02.067) 0:03:54.281 ********* 2026-04-28 04:41:49.262891 | orchestrator | ok: [testbed-manager] 2026-04-28 04:41:49.262897 | orchestrator | 2026-04-28 04:41:49.262904 | orchestrator | TASK [Enable kubectl command line completion] ********************************** 2026-04-28 04:41:49.262910 | orchestrator | Tuesday 28 April 2026 04:40:54 +0000 (0:00:01.631) 0:03:55.913 ********* 2026-04-28 04:41:49.262917 | orchestrator | ok: [testbed-manager] 2026-04-28 04:41:49.262926 | orchestrator | 2026-04-28 04:41:49.262938 | orchestrator | PLAY [Apply role kubectl] ****************************************************** 2026-04-28 04:41:49.262953 | orchestrator | 2026-04-28 04:41:49.262970 | orchestrator | TASK [kubectl : Gather variables for each operating system] ******************** 2026-04-28 04:41:49.262981 | orchestrator | Tuesday 28 April 2026 04:40:56 +0000 (0:00:01.899) 0:03:57.812 ********* 2026-04-28 04:41:49.263016 | orchestrator | ok: [testbed-manager] 2026-04-28 04:41:49.263027 | orchestrator | 2026-04-28 04:41:49.263039 | orchestrator | TASK [kubectl : Include distribution specific install tasks] ******************* 2026-04-28 04:41:49.263050 | orchestrator | Tuesday 28 April 2026 04:40:57 +0000 (0:00:01.220) 0:03:59.033 ********* 2026-04-28 04:41:49.263062 | orchestrator | included: /ansible/roles/kubectl/tasks/install-Debian-family.yml for testbed-manager 2026-04-28 04:41:49.263075 | orchestrator | 2026-04-28 04:41:49.263088 | orchestrator | TASK [kubectl : Remove old architecture-dependent repository] ****************** 2026-04-28 04:41:49.263099 | orchestrator | Tuesday 28 April 2026 04:40:59 +0000 (0:00:01.591) 0:04:00.625 ********* 2026-04-28 04:41:49.263111 | orchestrator | ok: [testbed-manager] 2026-04-28 04:41:49.263124 | orchestrator | 2026-04-28 04:41:49.263136 | orchestrator | TASK [kubectl : Install apt-transport-https package] *************************** 2026-04-28 04:41:49.263148 | orchestrator | Tuesday 28 April 2026 04:41:01 +0000 (0:00:01.900) 0:04:02.526 ********* 2026-04-28 04:41:49.263161 | orchestrator | ok: [testbed-manager] 2026-04-28 04:41:49.263173 | orchestrator | 2026-04-28 04:41:49.263185 | orchestrator | TASK [kubectl : Add repository gpg key] **************************************** 2026-04-28 04:41:49.263197 | orchestrator | Tuesday 28 April 2026 04:41:03 +0000 (0:00:02.742) 0:04:05.268 ********* 2026-04-28 04:41:49.263210 | orchestrator | ok: [testbed-manager] 2026-04-28 04:41:49.263223 | orchestrator | 2026-04-28 04:41:49.263236 | orchestrator | TASK [kubectl : Set permissions of gpg key] ************************************ 2026-04-28 04:41:49.263248 | orchestrator | Tuesday 28 April 2026 04:41:05 +0000 (0:00:01.495) 0:04:06.764 ********* 2026-04-28 04:41:49.263260 | orchestrator | ok: [testbed-manager] 2026-04-28 04:41:49.263268 | orchestrator | 2026-04-28 04:41:49.263276 | orchestrator | TASK [kubectl : Add repository Debian] ***************************************** 2026-04-28 04:41:49.263284 | orchestrator | Tuesday 28 April 2026 04:41:06 +0000 (0:00:01.441) 0:04:08.205 ********* 2026-04-28 04:41:49.263292 | orchestrator | ok: [testbed-manager] 2026-04-28 04:41:49.263300 | orchestrator | 2026-04-28 04:41:49.263307 | orchestrator | TASK [kubectl : Install required packages] ************************************* 2026-04-28 04:41:49.263315 | orchestrator | Tuesday 28 April 2026 04:41:08 +0000 (0:00:01.719) 0:04:09.925 ********* 2026-04-28 04:41:49.263323 | orchestrator | ok: [testbed-manager] 2026-04-28 04:41:49.263330 | orchestrator | 2026-04-28 04:41:49.263338 | orchestrator | TASK [kubectl : Remove kubectl symlink] **************************************** 2026-04-28 04:41:49.263345 | orchestrator | Tuesday 28 April 2026 04:41:11 +0000 (0:00:02.783) 0:04:12.709 ********* 2026-04-28 04:41:49.263368 | orchestrator | ok: [testbed-manager] 2026-04-28 04:41:49.263376 | orchestrator | 2026-04-28 04:41:49.263387 | orchestrator | PLAY [Run post actions on master nodes] **************************************** 2026-04-28 04:41:49.263395 | orchestrator | 2026-04-28 04:41:49.263403 | orchestrator | TASK [k3s_server_post : Validating arguments against arg spec 'main' - Configure k3s cluster] *** 2026-04-28 04:41:49.263425 | orchestrator | Tuesday 28 April 2026 04:41:13 +0000 (0:00:02.157) 0:04:14.867 ********* 2026-04-28 04:41:49.263432 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:41:49.263439 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:41:49.263446 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:41:49.263457 | orchestrator | 2026-04-28 04:41:49.263472 | orchestrator | TASK [k3s_server_post : Deploy calico] ***************************************** 2026-04-28 04:41:49.263486 | orchestrator | Tuesday 28 April 2026 04:41:15 +0000 (0:00:01.521) 0:04:16.388 ********* 2026-04-28 04:41:49.263498 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:41:49.263509 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:41:49.263519 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:41:49.263531 | orchestrator | 2026-04-28 04:41:49.263541 | orchestrator | TASK [k3s_server_post : Deploy cilium] ***************************************** 2026-04-28 04:41:49.263553 | orchestrator | Tuesday 28 April 2026 04:41:16 +0000 (0:00:01.469) 0:04:17.858 ********* 2026-04-28 04:41:49.263565 | orchestrator | included: /ansible/roles/k3s_server_post/tasks/cilium.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:41:49.263606 | orchestrator | 2026-04-28 04:41:49.263632 | orchestrator | TASK [k3s_server_post : Create tmp directory on first master] ****************** 2026-04-28 04:41:49.263644 | orchestrator | Tuesday 28 April 2026 04:41:18 +0000 (0:00:01.997) 0:04:19.856 ********* 2026-04-28 04:41:49.263655 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-28 04:41:49.263667 | orchestrator | 2026-04-28 04:41:49.263678 | orchestrator | TASK [k3s_server_post : Wait for connectivity to kube VIP] ********************* 2026-04-28 04:41:49.263688 | orchestrator | Tuesday 28 April 2026 04:41:20 +0000 (0:00:01.973) 0:04:21.829 ********* 2026-04-28 04:41:49.263700 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 04:41:49.263713 | orchestrator | 2026-04-28 04:41:49.263726 | orchestrator | TASK [k3s_server_post : Fail if kube VIP not reachable] ************************ 2026-04-28 04:41:49.263737 | orchestrator | Tuesday 28 April 2026 04:41:22 +0000 (0:00:01.964) 0:04:23.794 ********* 2026-04-28 04:41:49.263750 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:41:49.263759 | orchestrator | 2026-04-28 04:41:49.263766 | orchestrator | TASK [k3s_server_post : Test for existing Cilium install] ********************** 2026-04-28 04:41:49.263773 | orchestrator | Tuesday 28 April 2026 04:41:23 +0000 (0:00:01.179) 0:04:24.973 ********* 2026-04-28 04:41:49.263780 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 04:41:49.263788 | orchestrator | 2026-04-28 04:41:49.263795 | orchestrator | TASK [k3s_server_post : Check Cilium version] ********************************** 2026-04-28 04:41:49.263802 | orchestrator | Tuesday 28 April 2026 04:41:25 +0000 (0:00:02.196) 0:04:27.169 ********* 2026-04-28 04:41:49.263809 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 04:41:49.263816 | orchestrator | 2026-04-28 04:41:49.263823 | orchestrator | TASK [k3s_server_post : Parse installed Cilium version] ************************ 2026-04-28 04:41:49.263830 | orchestrator | Tuesday 28 April 2026 04:41:28 +0000 (0:00:02.458) 0:04:29.627 ********* 2026-04-28 04:41:49.263837 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 04:41:49.263844 | orchestrator | 2026-04-28 04:41:49.263852 | orchestrator | TASK [k3s_server_post : Determine if Cilium needs update] ********************** 2026-04-28 04:41:49.263859 | orchestrator | Tuesday 28 April 2026 04:41:29 +0000 (0:00:01.207) 0:04:30.835 ********* 2026-04-28 04:41:49.263866 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 04:41:49.263873 | orchestrator | 2026-04-28 04:41:49.263880 | orchestrator | TASK [k3s_server_post : Log result] ******************************************** 2026-04-28 04:41:49.263887 | orchestrator | Tuesday 28 April 2026 04:41:30 +0000 (0:00:01.212) 0:04:32.048 ********* 2026-04-28 04:41:49.263894 | orchestrator | ok: [testbed-node-0 -> localhost] => { 2026-04-28 04:41:49.263902 | orchestrator |  "msg": "Installed Cilium version: 1.18.2, Target Cilium version: v1.18.2, Update needed: False\n" 2026-04-28 04:41:49.263910 | orchestrator | } 2026-04-28 04:41:49.263918 | orchestrator | 2026-04-28 04:41:49.263925 | orchestrator | TASK [k3s_server_post : Install Cilium] **************************************** 2026-04-28 04:41:49.263932 | orchestrator | Tuesday 28 April 2026 04:41:31 +0000 (0:00:01.245) 0:04:33.293 ********* 2026-04-28 04:41:49.263939 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:41:49.263947 | orchestrator | 2026-04-28 04:41:49.263954 | orchestrator | TASK [k3s_server_post : Wait for Cilium resources] ***************************** 2026-04-28 04:41:49.263961 | orchestrator | Tuesday 28 April 2026 04:41:33 +0000 (0:00:01.293) 0:04:34.587 ********* 2026-04-28 04:41:49.263968 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=deployment/cilium-operator) 2026-04-28 04:41:49.263975 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=daemonset/cilium) 2026-04-28 04:41:49.263982 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=deployment/hubble-relay) 2026-04-28 04:41:49.263989 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=deployment/hubble-ui) 2026-04-28 04:41:49.263996 | orchestrator | 2026-04-28 04:41:49.264004 | orchestrator | TASK [k3s_server_post : Set _cilium_bgp_neighbors fact] ************************ 2026-04-28 04:41:49.264011 | orchestrator | Tuesday 28 April 2026 04:41:39 +0000 (0:00:06.261) 0:04:40.848 ********* 2026-04-28 04:41:49.264018 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 04:41:49.264025 | orchestrator | 2026-04-28 04:41:49.264039 | orchestrator | TASK [k3s_server_post : Copy BGP manifests to first master] ******************** 2026-04-28 04:41:49.264046 | orchestrator | Tuesday 28 April 2026 04:41:41 +0000 (0:00:02.474) 0:04:43.322 ********* 2026-04-28 04:41:49.264053 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-28 04:41:49.264060 | orchestrator | 2026-04-28 04:41:49.264067 | orchestrator | TASK [k3s_server_post : Apply BGP manifests] *********************************** 2026-04-28 04:41:49.264074 | orchestrator | Tuesday 28 April 2026 04:41:44 +0000 (0:00:02.899) 0:04:46.221 ********* 2026-04-28 04:41:49.264087 | orchestrator | changed: [testbed-node-0 -> localhost] 2026-04-28 04:41:49.264099 | orchestrator | 2026-04-28 04:41:49.264118 | orchestrator | TASK [k3s_server_post : Print error message if BGP manifests application fails] *** 2026-04-28 04:41:49.264129 | orchestrator | Tuesday 28 April 2026 04:41:49 +0000 (0:00:04.186) 0:04:50.408 ********* 2026-04-28 04:41:49.264140 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:41:49.264153 | orchestrator | 2026-04-28 04:41:49.264177 | orchestrator | TASK [k3s_server_post : Test for BGP config resources] ************************* 2026-04-28 04:42:24.014215 | orchestrator | Tuesday 28 April 2026 04:41:50 +0000 (0:00:01.224) 0:04:51.632 ********* 2026-04-28 04:42:24.014324 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=kubectl get CiliumBGPPeeringPolicy.cilium.io) 2026-04-28 04:42:24.014336 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=kubectl get CiliumLoadBalancerIPPool.cilium.io) 2026-04-28 04:42:24.014344 | orchestrator | 2026-04-28 04:42:24.014353 | orchestrator | TASK [k3s_server_post : Deploy metallb pool] *********************************** 2026-04-28 04:42:24.014361 | orchestrator | Tuesday 28 April 2026 04:41:53 +0000 (0:00:03.148) 0:04:54.781 ********* 2026-04-28 04:42:24.014368 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:42:24.014376 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:42:24.014384 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:42:24.014390 | orchestrator | 2026-04-28 04:42:24.014398 | orchestrator | TASK [k3s_server_post : Remove tmp directory used for manifests] *************** 2026-04-28 04:42:24.014405 | orchestrator | Tuesday 28 April 2026 04:41:55 +0000 (0:00:01.585) 0:04:56.367 ********* 2026-04-28 04:42:24.014413 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:42:24.014422 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:42:24.014429 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:42:24.014436 | orchestrator | 2026-04-28 04:42:24.014444 | orchestrator | PLAY [Apply role k9s] ********************************************************** 2026-04-28 04:42:24.014451 | orchestrator | 2026-04-28 04:42:24.014458 | orchestrator | TASK [k9s : Gather variables for each operating system] ************************ 2026-04-28 04:42:24.014466 | orchestrator | Tuesday 28 April 2026 04:41:57 +0000 (0:00:02.382) 0:04:58.750 ********* 2026-04-28 04:42:24.014473 | orchestrator | ok: [testbed-manager] 2026-04-28 04:42:24.014480 | orchestrator | 2026-04-28 04:42:24.014488 | orchestrator | TASK [k9s : Include distribution specific install tasks] *********************** 2026-04-28 04:42:24.014495 | orchestrator | Tuesday 28 April 2026 04:41:58 +0000 (0:00:01.186) 0:04:59.937 ********* 2026-04-28 04:42:24.014503 | orchestrator | included: /ansible/roles/k9s/tasks/install-Debian-family.yml for testbed-manager 2026-04-28 04:42:24.014512 | orchestrator | 2026-04-28 04:42:24.014519 | orchestrator | TASK [k9s : Install k9s packages] ********************************************** 2026-04-28 04:42:24.014526 | orchestrator | Tuesday 28 April 2026 04:42:00 +0000 (0:00:01.566) 0:05:01.503 ********* 2026-04-28 04:42:24.014533 | orchestrator | ok: [testbed-manager] 2026-04-28 04:42:24.014541 | orchestrator | 2026-04-28 04:42:24.014548 | orchestrator | PLAY [Manage labels, annotations, and taints on all k3s nodes] ***************** 2026-04-28 04:42:24.014555 | orchestrator | 2026-04-28 04:42:24.014562 | orchestrator | TASK [Merge labels, annotations, and taints] *********************************** 2026-04-28 04:42:24.014569 | orchestrator | Tuesday 28 April 2026 04:42:05 +0000 (0:00:05.403) 0:05:06.907 ********* 2026-04-28 04:42:24.014576 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:42:24.014584 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:42:24.014674 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:42:24.014704 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:42:24.014726 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:42:24.014731 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:42:24.014735 | orchestrator | 2026-04-28 04:42:24.014740 | orchestrator | TASK [Manage labels] *********************************************************** 2026-04-28 04:42:24.014745 | orchestrator | Tuesday 28 April 2026 04:42:07 +0000 (0:00:02.050) 0:05:08.957 ********* 2026-04-28 04:42:24.014749 | orchestrator | ok: [testbed-node-4 -> localhost] => (item=node-role.osism.tech/compute-plane=true) 2026-04-28 04:42:24.014754 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/control-plane=true) 2026-04-28 04:42:24.014758 | orchestrator | ok: [testbed-node-3 -> localhost] => (item=node-role.osism.tech/compute-plane=true) 2026-04-28 04:42:24.014762 | orchestrator | ok: [testbed-node-5 -> localhost] => (item=node-role.osism.tech/compute-plane=true) 2026-04-28 04:42:24.014767 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/control-plane=true) 2026-04-28 04:42:24.014771 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/control-plane=true) 2026-04-28 04:42:24.014776 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=openstack-control-plane=enabled) 2026-04-28 04:42:24.014781 | orchestrator | ok: [testbed-node-3 -> localhost] => (item=node-role.kubernetes.io/worker=worker) 2026-04-28 04:42:24.014786 | orchestrator | ok: [testbed-node-4 -> localhost] => (item=node-role.kubernetes.io/worker=worker) 2026-04-28 04:42:24.014791 | orchestrator | ok: [testbed-node-5 -> localhost] => (item=node-role.kubernetes.io/worker=worker) 2026-04-28 04:42:24.014796 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=openstack-control-plane=enabled) 2026-04-28 04:42:24.014801 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/network-plane=true) 2026-04-28 04:42:24.014806 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=openstack-control-plane=enabled) 2026-04-28 04:42:24.014812 | orchestrator | ok: [testbed-node-3 -> localhost] => (item=node-role.osism.tech/rook-osd=true) 2026-04-28 04:42:24.014817 | orchestrator | ok: [testbed-node-4 -> localhost] => (item=node-role.osism.tech/rook-osd=true) 2026-04-28 04:42:24.014823 | orchestrator | ok: [testbed-node-5 -> localhost] => (item=node-role.osism.tech/rook-osd=true) 2026-04-28 04:42:24.014828 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/network-plane=true) 2026-04-28 04:42:24.014833 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/network-plane=true) 2026-04-28 04:42:24.014838 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-mds=true) 2026-04-28 04:42:24.014843 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-mds=true) 2026-04-28 04:42:24.014847 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-mgr=true) 2026-04-28 04:42:24.014866 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-mds=true) 2026-04-28 04:42:24.014871 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-mgr=true) 2026-04-28 04:42:24.014875 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-mon=true) 2026-04-28 04:42:24.014879 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-mgr=true) 2026-04-28 04:42:24.014884 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-mon=true) 2026-04-28 04:42:24.014888 | orchestrator | ok: [testbed-node-0 -> localhost] => (item=node-role.osism.tech/rook-rgw=true) 2026-04-28 04:42:24.014892 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-mon=true) 2026-04-28 04:42:24.014896 | orchestrator | ok: [testbed-node-2 -> localhost] => (item=node-role.osism.tech/rook-rgw=true) 2026-04-28 04:42:24.014901 | orchestrator | ok: [testbed-node-1 -> localhost] => (item=node-role.osism.tech/rook-rgw=true) 2026-04-28 04:42:24.014905 | orchestrator | 2026-04-28 04:42:24.014909 | orchestrator | TASK [Manage annotations] ****************************************************** 2026-04-28 04:42:24.014930 | orchestrator | Tuesday 28 April 2026 04:42:19 +0000 (0:00:11.741) 0:05:20.699 ********* 2026-04-28 04:42:24.014935 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:42:24.014939 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:42:24.014944 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:42:24.014948 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:42:24.014952 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:42:24.014956 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:42:24.014961 | orchestrator | 2026-04-28 04:42:24.014965 | orchestrator | TASK [Manage taints] *********************************************************** 2026-04-28 04:42:24.014970 | orchestrator | Tuesday 28 April 2026 04:42:21 +0000 (0:00:01.780) 0:05:22.480 ********* 2026-04-28 04:42:24.014974 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:42:24.014978 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:42:24.014982 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:42:24.014986 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:42:24.014991 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:42:24.014995 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:42:24.014999 | orchestrator | 2026-04-28 04:42:24.015003 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:42:24.015008 | orchestrator | testbed-manager : ok=21  changed=4  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 04:42:24.015015 | orchestrator | testbed-node-0 : ok=53  changed=14  unreachable=0 failed=0 skipped=25  rescued=0 ignored=0 2026-04-28 04:42:24.015020 | orchestrator | testbed-node-1 : ok=38  changed=9  unreachable=0 failed=0 skipped=25  rescued=0 ignored=0 2026-04-28 04:42:24.015024 | orchestrator | testbed-node-2 : ok=38  changed=9  unreachable=0 failed=0 skipped=25  rescued=0 ignored=0 2026-04-28 04:42:24.015029 | orchestrator | testbed-node-3 : ok=16  changed=1  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-28 04:42:24.015033 | orchestrator | testbed-node-4 : ok=16  changed=1  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-28 04:42:24.015037 | orchestrator | testbed-node-5 : ok=16  changed=1  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-28 04:42:24.015041 | orchestrator | 2026-04-28 04:42:24.015046 | orchestrator | 2026-04-28 04:42:24.015050 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 04:42:24.015054 | orchestrator | Tuesday 28 April 2026 04:42:23 +0000 (0:00:02.836) 0:05:25.317 ********* 2026-04-28 04:42:24.015059 | orchestrator | =============================================================================== 2026-04-28 04:42:24.015063 | orchestrator | k3s_server : Enable and check K3s service ------------------------------ 43.76s 2026-04-28 04:42:24.015067 | orchestrator | k3s_server : Verify that all nodes actually joined (check k3s-init.service if this fails) -- 33.84s 2026-04-28 04:42:24.015072 | orchestrator | Manage labels ---------------------------------------------------------- 11.74s 2026-04-28 04:42:24.015076 | orchestrator | k3s_agent : Manage k3s service ------------------------------------------ 8.29s 2026-04-28 04:42:24.015080 | orchestrator | k3s_server_post : Wait for Cilium resources ----------------------------- 6.26s 2026-04-28 04:42:24.015085 | orchestrator | k9s : Install k9s packages ---------------------------------------------- 5.40s 2026-04-28 04:42:24.015089 | orchestrator | k3s_server : Remove manifests and folders that are only needed for bootstrapping cluster so k3s doesn't auto apply on start --- 4.31s 2026-04-28 04:42:24.015093 | orchestrator | k3s_server_post : Apply BGP manifests ----------------------------------- 4.19s 2026-04-28 04:42:24.015098 | orchestrator | k3s_prereq : Validating arguments against arg spec 'main' - Prerequisites --- 3.82s 2026-04-28 04:42:24.015109 | orchestrator | k3s_prereq : Enable IPv6 router advertisements -------------------------- 3.58s 2026-04-28 04:42:24.015113 | orchestrator | k3s_prereq : Enable IPv4 forwarding ------------------------------------- 3.48s 2026-04-28 04:42:24.015118 | orchestrator | k3s_server : Validating arguments against arg spec 'main' - Setup k3s servers --- 3.28s 2026-04-28 04:42:24.015125 | orchestrator | Make kubeconfig available for use inside the manager service ------------ 3.28s 2026-04-28 04:42:24.405199 | orchestrator | k3s_custom_registries : Remove /etc/rancher/k3s/registries.yaml when no registries configured --- 3.23s 2026-04-28 04:42:24.405300 | orchestrator | k3s_server_post : Test for BGP config resources ------------------------- 3.15s 2026-04-28 04:42:24.405316 | orchestrator | k3s_server : Stop k3s-init ---------------------------------------------- 3.08s 2026-04-28 04:42:24.405327 | orchestrator | k3s_server_post : Copy BGP manifests to first master -------------------- 2.90s 2026-04-28 04:42:24.405339 | orchestrator | Manage taints ----------------------------------------------------------- 2.84s 2026-04-28 04:42:24.405350 | orchestrator | kubectl : Install required packages ------------------------------------- 2.79s 2026-04-28 04:42:24.405361 | orchestrator | k3s_server : Set _kube_vip_bgp_peers fact ------------------------------- 2.78s 2026-04-28 04:42:24.647480 | orchestrator | + [[ false == \f\a\l\s\e ]] 2026-04-28 04:42:24.647563 | orchestrator | + sh -c /opt/configuration/scripts/upgrade/200-infrastructure.sh 2026-04-28 04:42:24.654749 | orchestrator | + set -e 2026-04-28 04:42:24.654822 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-28 04:42:24.654839 | orchestrator | ++ export INTERACTIVE=false 2026-04-28 04:42:24.654853 | orchestrator | ++ INTERACTIVE=false 2026-04-28 04:42:24.654867 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-28 04:42:24.654882 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-28 04:42:24.654896 | orchestrator | + osism apply openstackclient 2026-04-28 04:42:36.168871 | orchestrator | 2026-04-28 04:42:36 | INFO  | Prepare task for execution of openstackclient. 2026-04-28 04:42:36.249096 | orchestrator | 2026-04-28 04:42:36 | INFO  | Task ad8909dc-3f42-4fc2-b952-28a8ff2ee8ca (openstackclient) was prepared for execution. 2026-04-28 04:42:36.249185 | orchestrator | 2026-04-28 04:42:36 | INFO  | It takes a moment until task ad8909dc-3f42-4fc2-b952-28a8ff2ee8ca (openstackclient) has been started and output is visible here. 2026-04-28 04:43:02.631475 | orchestrator | 2026-04-28 04:43:02.631588 | orchestrator | PLAY [Apply role openstackclient] ********************************************** 2026-04-28 04:43:02.631602 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-28 04:43:02.631681 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-28 04:43:02.631714 | orchestrator | 2026-04-28 04:43:02.631730 | orchestrator | TASK [osism.services.openstackclient : Include tasks] ************************** 2026-04-28 04:43:02.631744 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-28 04:43:02.631760 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-28 04:43:02.631778 | orchestrator | Tuesday 28 April 2026 04:42:42 +0000 (0:00:02.199) 0:00:02.199 ********* 2026-04-28 04:43:02.631788 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/openstackclient/tasks/container-Debian-family.yml for testbed-manager 2026-04-28 04:43:02.631798 | orchestrator | 2026-04-28 04:43:02.631807 | orchestrator | TASK [osism.services.openstackclient : Create required directories] ************ 2026-04-28 04:43:02.631815 | orchestrator | Tuesday 28 April 2026 04:42:43 +0000 (0:00:01.001) 0:00:03.200 ********* 2026-04-28 04:43:02.631824 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/openstack) 2026-04-28 04:43:02.631832 | orchestrator | ok: [testbed-manager] => (item=/opt/openstackclient/data) 2026-04-28 04:43:02.631841 | orchestrator | ok: [testbed-manager] => (item=/opt/openstackclient) 2026-04-28 04:43:02.631873 | orchestrator | 2026-04-28 04:43:02.631882 | orchestrator | TASK [osism.services.openstackclient : Copy docker-compose.yml file] *********** 2026-04-28 04:43:02.631891 | orchestrator | Tuesday 28 April 2026 04:42:44 +0000 (0:00:01.668) 0:00:04.869 ********* 2026-04-28 04:43:02.631899 | orchestrator | changed: [testbed-manager] 2026-04-28 04:43:02.631908 | orchestrator | 2026-04-28 04:43:02.631917 | orchestrator | TASK [osism.services.openstackclient : Manage openstackclient service] ********* 2026-04-28 04:43:02.631926 | orchestrator | Tuesday 28 April 2026 04:42:46 +0000 (0:00:01.377) 0:00:06.247 ********* 2026-04-28 04:43:02.631934 | orchestrator | ok: [testbed-manager] 2026-04-28 04:43:02.631944 | orchestrator | 2026-04-28 04:43:02.631952 | orchestrator | TASK [osism.services.openstackclient : Copy openstack wrapper script] ********** 2026-04-28 04:43:02.631961 | orchestrator | Tuesday 28 April 2026 04:42:47 +0000 (0:00:01.101) 0:00:07.348 ********* 2026-04-28 04:43:02.631969 | orchestrator | ok: [testbed-manager] 2026-04-28 04:43:02.631978 | orchestrator | 2026-04-28 04:43:02.631986 | orchestrator | TASK [osism.services.openstackclient : Remove ospurge wrapper script] ********** 2026-04-28 04:43:02.631995 | orchestrator | Tuesday 28 April 2026 04:42:48 +0000 (0:00:00.947) 0:00:08.296 ********* 2026-04-28 04:43:02.632003 | orchestrator | ok: [testbed-manager] 2026-04-28 04:43:02.632012 | orchestrator | 2026-04-28 04:43:02.632021 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Restart openstackclient service] *** 2026-04-28 04:43:02.632031 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-28 04:43:02.632041 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-28 04:43:02.632061 | orchestrator | Tuesday 28 April 2026 04:42:49 +0000 (0:00:00.875) 0:00:09.171 ********* 2026-04-28 04:43:02.632071 | orchestrator | changed: [testbed-manager] 2026-04-28 04:43:02.632081 | orchestrator | 2026-04-28 04:43:02.632092 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Ensure that all containers are up] *** 2026-04-28 04:43:02.632102 | orchestrator | Tuesday 28 April 2026 04:42:59 +0000 (0:00:10.411) 0:00:19.583 ********* 2026-04-28 04:43:02.632113 | orchestrator | changed: [testbed-manager] 2026-04-28 04:43:02.632122 | orchestrator | 2026-04-28 04:43:02.632130 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Wait for an healthy service] *** 2026-04-28 04:43:02.632142 | orchestrator | Tuesday 28 April 2026 04:43:00 +0000 (0:00:00.917) 0:00:20.500 ********* 2026-04-28 04:43:02.632157 | orchestrator | changed: [testbed-manager] 2026-04-28 04:43:02.632175 | orchestrator | 2026-04-28 04:43:02.632196 | orchestrator | RUNNING HANDLER [osism.services.openstackclient : Copy bash completion script] *** 2026-04-28 04:43:02.632213 | orchestrator | Tuesday 28 April 2026 04:43:01 +0000 (0:00:00.636) 0:00:21.137 ********* 2026-04-28 04:43:02.632230 | orchestrator | ok: [testbed-manager] 2026-04-28 04:43:02.632248 | orchestrator | 2026-04-28 04:43:02.632264 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:43:02.632283 | orchestrator | testbed-manager : ok=10  changed=4  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 04:43:02.632302 | orchestrator | 2026-04-28 04:43:02.632320 | orchestrator | 2026-04-28 04:43:02.632339 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 04:43:02.632358 | orchestrator | Tuesday 28 April 2026 04:43:02 +0000 (0:00:01.175) 0:00:22.313 ********* 2026-04-28 04:43:02.632376 | orchestrator | =============================================================================== 2026-04-28 04:43:02.632394 | orchestrator | osism.services.openstackclient : Restart openstackclient service ------- 10.41s 2026-04-28 04:43:02.632405 | orchestrator | osism.services.openstackclient : Create required directories ------------ 1.67s 2026-04-28 04:43:02.632416 | orchestrator | osism.services.openstackclient : Copy docker-compose.yml file ----------- 1.38s 2026-04-28 04:43:02.632426 | orchestrator | osism.services.openstackclient : Copy bash completion script ------------ 1.18s 2026-04-28 04:43:02.632437 | orchestrator | osism.services.openstackclient : Manage openstackclient service --------- 1.10s 2026-04-28 04:43:02.632461 | orchestrator | osism.services.openstackclient : Include tasks -------------------------- 1.00s 2026-04-28 04:43:02.632492 | orchestrator | osism.services.openstackclient : Copy openstack wrapper script ---------- 0.95s 2026-04-28 04:43:02.632504 | orchestrator | osism.services.openstackclient : Ensure that all containers are up ------ 0.92s 2026-04-28 04:43:02.632515 | orchestrator | osism.services.openstackclient : Remove ospurge wrapper script ---------- 0.88s 2026-04-28 04:43:02.632526 | orchestrator | osism.services.openstackclient : Wait for an healthy service ------------ 0.64s 2026-04-28 04:43:02.867582 | orchestrator | + osism apply -a upgrade common 2026-04-28 04:43:04.209708 | orchestrator | 2026-04-28 04:43:04 | INFO  | Prepare task for execution of common. 2026-04-28 04:43:04.282469 | orchestrator | 2026-04-28 04:43:04 | INFO  | Task 842976c6-f044-4f81-b542-a3852c40f6cb (common) was prepared for execution. 2026-04-28 04:43:04.282566 | orchestrator | 2026-04-28 04:43:04 | INFO  | It takes a moment until task 842976c6-f044-4f81-b542-a3852c40f6cb (common) has been started and output is visible here. 2026-04-28 04:43:24.411689 | orchestrator | 2026-04-28 04:43:24.411804 | orchestrator | PLAY [Apply role common] ******************************************************* 2026-04-28 04:43:24.411823 | orchestrator | 2026-04-28 04:43:24.411835 | orchestrator | TASK [common : include_tasks] ************************************************** 2026-04-28 04:43:24.411846 | orchestrator | Tuesday 28 April 2026 04:43:09 +0000 (0:00:02.042) 0:00:02.042 ********* 2026-04-28 04:43:24.411858 | orchestrator | included: /ansible/roles/common/tasks/upgrade.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 04:43:24.411870 | orchestrator | 2026-04-28 04:43:24.411881 | orchestrator | TASK [common : Ensuring config directories exist] ****************************** 2026-04-28 04:43:24.411892 | orchestrator | Tuesday 28 April 2026 04:43:13 +0000 (0:00:03.670) 0:00:05.712 ********* 2026-04-28 04:43:24.411903 | orchestrator | ok: [testbed-node-0] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-28 04:43:24.411914 | orchestrator | ok: [testbed-manager] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-28 04:43:24.411925 | orchestrator | ok: [testbed-node-1] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-28 04:43:24.411936 | orchestrator | ok: [testbed-node-2] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-28 04:43:24.411947 | orchestrator | ok: [testbed-node-0] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-28 04:43:24.411959 | orchestrator | ok: [testbed-node-3] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-28 04:43:24.411969 | orchestrator | ok: [testbed-node-1] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-28 04:43:24.411999 | orchestrator | ok: [testbed-manager] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-28 04:43:24.412011 | orchestrator | ok: [testbed-node-2] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-28 04:43:24.412023 | orchestrator | ok: [testbed-node-0] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-28 04:43:24.412033 | orchestrator | ok: [testbed-node-1] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-28 04:43:24.412044 | orchestrator | ok: [testbed-node-3] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-28 04:43:24.412055 | orchestrator | ok: [testbed-manager] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-28 04:43:24.412066 | orchestrator | ok: [testbed-node-2] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-28 04:43:24.412081 | orchestrator | ok: [testbed-node-3] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-28 04:43:24.412093 | orchestrator | ok: [testbed-node-4] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-28 04:43:24.412104 | orchestrator | ok: [testbed-node-5] => (item=[{'service_name': 'cron'}, 'cron']) 2026-04-28 04:43:24.412115 | orchestrator | ok: [testbed-node-4] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-28 04:43:24.412126 | orchestrator | ok: [testbed-node-5] => (item=[{'service_name': 'fluentd'}, 'fluentd']) 2026-04-28 04:43:24.412161 | orchestrator | ok: [testbed-node-4] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-28 04:43:24.412173 | orchestrator | ok: [testbed-node-5] => (item=[{'service_name': 'kolla-toolbox'}, 'kolla-toolbox']) 2026-04-28 04:43:24.412186 | orchestrator | 2026-04-28 04:43:24.412198 | orchestrator | TASK [common : include_tasks] ************************************************** 2026-04-28 04:43:24.412211 | orchestrator | Tuesday 28 April 2026 04:43:19 +0000 (0:00:05.524) 0:00:11.237 ********* 2026-04-28 04:43:24.412225 | orchestrator | included: /ansible/roles/common/tasks/copy-certs.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 04:43:24.412239 | orchestrator | 2026-04-28 04:43:24.412252 | orchestrator | TASK [service-cert-copy : common | Copying over extra CA certificates] ********* 2026-04-28 04:43:24.412264 | orchestrator | Tuesday 28 April 2026 04:43:22 +0000 (0:00:03.063) 0:00:14.301 ********* 2026-04-28 04:43:24.412280 | orchestrator | ok: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:43:24.412304 | orchestrator | ok: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:43:24.412339 | orchestrator | ok: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:43:24.412353 | orchestrator | ok: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:43:24.412367 | orchestrator | ok: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:43:24.412386 | orchestrator | ok: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:24.412409 | orchestrator | ok: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:24.412423 | orchestrator | ok: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:24.412436 | orchestrator | ok: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:24.412459 | orchestrator | ok: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:29.401175 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:29.401254 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:29.401261 | orchestrator | ok: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:29.401282 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:29.401287 | orchestrator | ok: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:29.401293 | orchestrator | ok: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:43:29.401298 | orchestrator | ok: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:43:29.401303 | orchestrator | ok: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:29.401462 | orchestrator | ok: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:29.401478 | orchestrator | ok: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:29.401500 | orchestrator | ok: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:29.401508 | orchestrator | 2026-04-28 04:43:29.401516 | orchestrator | TASK [service-cert-copy : common | Copying over backend internal TLS certificate] *** 2026-04-28 04:43:29.401525 | orchestrator | Tuesday 28 April 2026 04:43:28 +0000 (0:00:06.724) 0:00:21.026 ********* 2026-04-28 04:43:29.401533 | orchestrator | skipping: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 04:43:29.401543 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 04:43:29.401551 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:29.401558 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:29.401576 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 04:43:30.784722 | orchestrator | skipping: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:30.784845 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:30.784858 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:30.784869 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:43:30.784878 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:43:30.784886 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:30.784894 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 04:43:30.784902 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:43:30.784909 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:30.784917 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:30.784924 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:43:30.784951 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 04:43:30.784971 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 04:43:30.784979 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 04:43:30.784987 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:30.784994 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:30.785002 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:30.785009 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:43:30.785017 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:30.785030 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:33.213191 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:43:33.213296 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:33.213314 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:43:33.213326 | orchestrator | 2026-04-28 04:43:33.213339 | orchestrator | TASK [service-cert-copy : common | Copying over backend internal TLS key] ****** 2026-04-28 04:43:33.213351 | orchestrator | Tuesday 28 April 2026 04:43:31 +0000 (0:00:03.109) 0:00:24.135 ********* 2026-04-28 04:43:33.213415 | orchestrator | skipping: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 04:43:33.213431 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:33.213443 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 04:43:33.213455 | orchestrator | skipping: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:33.213468 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 04:43:33.213479 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:33.213513 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:43:33.213551 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:33.213564 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:33.213576 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:33.213587 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 04:43:33.213599 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:43:33.213610 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:33.213622 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 04:43:33.213668 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:33.213681 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:43:33.213692 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:43:33.213721 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:46.550294 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 04:43:46.550393 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:46.550405 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:43:46.550414 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 04:43:46.550422 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:46.550429 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:46.550453 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:46.550460 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:43:46.550467 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:43:46.550473 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:43:46.550480 | orchestrator | 2026-04-28 04:43:46.550486 | orchestrator | TASK [common : Ensure /var/log/journal exists on EL10 systems] ***************** 2026-04-28 04:43:46.550494 | orchestrator | Tuesday 28 April 2026 04:43:35 +0000 (0:00:03.292) 0:00:27.428 ********* 2026-04-28 04:43:46.550501 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:43:46.550507 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:43:46.550514 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:43:46.550532 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:43:46.550539 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:43:46.550545 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:43:46.550551 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:43:46.550557 | orchestrator | 2026-04-28 04:43:46.550564 | orchestrator | TASK [common : Copying over /run subdirectories conf] ************************** 2026-04-28 04:43:46.550570 | orchestrator | Tuesday 28 April 2026 04:43:37 +0000 (0:00:01.970) 0:00:29.398 ********* 2026-04-28 04:43:46.550577 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:43:46.550583 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:43:46.550589 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:43:46.550596 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:43:46.550602 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:43:46.550609 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:43:46.550615 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:43:46.550621 | orchestrator | 2026-04-28 04:43:46.550628 | orchestrator | TASK [common : Restart systemd-tmpfiles] *************************************** 2026-04-28 04:43:46.550634 | orchestrator | Tuesday 28 April 2026 04:43:39 +0000 (0:00:02.277) 0:00:31.676 ********* 2026-04-28 04:43:46.550640 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:43:46.550721 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:43:46.550729 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:43:46.550736 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:43:46.550742 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:43:46.550749 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:43:46.550755 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:43:46.550761 | orchestrator | 2026-04-28 04:43:46.550767 | orchestrator | TASK [common : Copying over kolla.target] ************************************** 2026-04-28 04:43:46.550773 | orchestrator | Tuesday 28 April 2026 04:43:41 +0000 (0:00:02.132) 0:00:33.808 ********* 2026-04-28 04:43:46.550779 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:43:46.550786 | orchestrator | changed: [testbed-manager] 2026-04-28 04:43:46.550792 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:43:46.550798 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:43:46.550805 | orchestrator | changed: [testbed-node-3] 2026-04-28 04:43:46.550817 | orchestrator | changed: [testbed-node-4] 2026-04-28 04:43:46.550823 | orchestrator | changed: [testbed-node-5] 2026-04-28 04:43:46.550830 | orchestrator | 2026-04-28 04:43:46.550836 | orchestrator | TASK [common : Copying over config.json files for services] ******************** 2026-04-28 04:43:46.550843 | orchestrator | Tuesday 28 April 2026 04:43:44 +0000 (0:00:03.272) 0:00:37.081 ********* 2026-04-28 04:43:46.550850 | orchestrator | changed: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:43:46.550858 | orchestrator | changed: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:43:46.550866 | orchestrator | changed: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:43:46.550880 | orchestrator | changed: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:43:46.550894 | orchestrator | changed: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:43:50.741789 | orchestrator | changed: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:50.741898 | orchestrator | changed: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:50.741935 | orchestrator | changed: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:50.741946 | orchestrator | changed: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:50.741956 | orchestrator | changed: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:50.741968 | orchestrator | changed: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:50.741980 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:50.742074 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:50.742089 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:50.742107 | orchestrator | changed: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:50.742150 | orchestrator | changed: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:43:50.742163 | orchestrator | changed: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:43:50.742174 | orchestrator | changed: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:50.742185 | orchestrator | changed: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:50.742195 | orchestrator | changed: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:43:50.742222 | orchestrator | changed: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:14.175644 | orchestrator | 2026-04-28 04:44:14.175887 | orchestrator | TASK [common : Find custom fluentd input config files] ************************* 2026-04-28 04:44:14.175908 | orchestrator | Tuesday 28 April 2026 04:43:51 +0000 (0:00:07.021) 0:00:44.103 ********* 2026-04-28 04:44:14.175919 | orchestrator | [WARNING]: Skipped 2026-04-28 04:44:14.175930 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/input' path due 2026-04-28 04:44:14.175941 | orchestrator | to this access issue: 2026-04-28 04:44:14.175951 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/input' is not a 2026-04-28 04:44:14.175961 | orchestrator | directory 2026-04-28 04:44:14.175971 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-28 04:44:14.175981 | orchestrator | 2026-04-28 04:44:14.175991 | orchestrator | TASK [common : Find custom fluentd filter config files] ************************ 2026-04-28 04:44:14.176001 | orchestrator | Tuesday 28 April 2026 04:43:54 +0000 (0:00:02.580) 0:00:46.684 ********* 2026-04-28 04:44:14.176010 | orchestrator | [WARNING]: Skipped 2026-04-28 04:44:14.176020 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/filter' path due 2026-04-28 04:44:14.176029 | orchestrator | to this access issue: 2026-04-28 04:44:14.176039 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/filter' is not a 2026-04-28 04:44:14.176049 | orchestrator | directory 2026-04-28 04:44:14.176058 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-28 04:44:14.176068 | orchestrator | 2026-04-28 04:44:14.176077 | orchestrator | TASK [common : Find custom fluentd format config files] ************************ 2026-04-28 04:44:14.176087 | orchestrator | Tuesday 28 April 2026 04:43:56 +0000 (0:00:02.132) 0:00:48.816 ********* 2026-04-28 04:44:14.176096 | orchestrator | [WARNING]: Skipped 2026-04-28 04:44:14.176106 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/format' path due 2026-04-28 04:44:14.176115 | orchestrator | to this access issue: 2026-04-28 04:44:14.176125 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/format' is not a 2026-04-28 04:44:14.176134 | orchestrator | directory 2026-04-28 04:44:14.176144 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-28 04:44:14.176153 | orchestrator | 2026-04-28 04:44:14.176163 | orchestrator | TASK [common : Find custom fluentd output config files] ************************ 2026-04-28 04:44:14.176172 | orchestrator | Tuesday 28 April 2026 04:43:58 +0000 (0:00:02.269) 0:00:51.086 ********* 2026-04-28 04:44:14.176182 | orchestrator | [WARNING]: Skipped 2026-04-28 04:44:14.176193 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/output' path due 2026-04-28 04:44:14.176205 | orchestrator | to this access issue: 2026-04-28 04:44:14.176217 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/fluentd/output' is not a 2026-04-28 04:44:14.176227 | orchestrator | directory 2026-04-28 04:44:14.176238 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-28 04:44:14.176249 | orchestrator | 2026-04-28 04:44:14.176260 | orchestrator | TASK [common : Copying over fluentd.conf] ************************************** 2026-04-28 04:44:14.176271 | orchestrator | Tuesday 28 April 2026 04:44:00 +0000 (0:00:02.052) 0:00:53.138 ********* 2026-04-28 04:44:14.176282 | orchestrator | changed: [testbed-manager] 2026-04-28 04:44:14.176294 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:44:14.176305 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:44:14.176316 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:44:14.176328 | orchestrator | changed: [testbed-node-3] 2026-04-28 04:44:14.176339 | orchestrator | changed: [testbed-node-4] 2026-04-28 04:44:14.176350 | orchestrator | changed: [testbed-node-5] 2026-04-28 04:44:14.176361 | orchestrator | 2026-04-28 04:44:14.176372 | orchestrator | TASK [common : Copying over cron logrotate config file] ************************ 2026-04-28 04:44:14.176384 | orchestrator | Tuesday 28 April 2026 04:44:06 +0000 (0:00:05.121) 0:00:58.260 ********* 2026-04-28 04:44:14.176396 | orchestrator | ok: [testbed-manager] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-28 04:44:14.176408 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-28 04:44:14.176444 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-28 04:44:14.176456 | orchestrator | ok: [testbed-node-3] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-28 04:44:14.176467 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-28 04:44:14.176477 | orchestrator | ok: [testbed-node-4] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-28 04:44:14.176487 | orchestrator | ok: [testbed-node-5] => (item=/ansible/roles/common/templates/cron-logrotate-global.conf.j2) 2026-04-28 04:44:14.176496 | orchestrator | 2026-04-28 04:44:14.176506 | orchestrator | TASK [common : Ensure RabbitMQ Erlang cookie exists] *************************** 2026-04-28 04:44:14.176515 | orchestrator | Tuesday 28 April 2026 04:44:09 +0000 (0:00:03.781) 0:01:02.041 ********* 2026-04-28 04:44:14.176525 | orchestrator | ok: [testbed-manager] 2026-04-28 04:44:14.176535 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:44:14.176544 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:44:14.176554 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:44:14.176563 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:44:14.176572 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:44:14.176582 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:44:14.176591 | orchestrator | 2026-04-28 04:44:14.176601 | orchestrator | TASK [common : Ensuring config directories have correct owner and permission] *** 2026-04-28 04:44:14.176610 | orchestrator | Tuesday 28 April 2026 04:44:13 +0000 (0:00:03.404) 0:01:05.446 ********* 2026-04-28 04:44:14.176642 | orchestrator | ok: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:44:14.176657 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:44:14.176698 | orchestrator | ok: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:44:14.176717 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:44:14.176736 | orchestrator | ok: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:44:14.176747 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:44:14.176776 | orchestrator | ok: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:44:14.176803 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:44:22.544930 | orchestrator | ok: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:22.545021 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:22.545032 | orchestrator | ok: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:44:22.545041 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:44:22.545066 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:22.545073 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:22.545079 | orchestrator | ok: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:22.545096 | orchestrator | ok: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:44:22.545116 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:44:22.545122 | orchestrator | ok: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:44:22.545128 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:44:22.545139 | orchestrator | ok: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:22.545145 | orchestrator | ok: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:22.545152 | orchestrator | 2026-04-28 04:44:22.545159 | orchestrator | TASK [common : Copy rabbitmq-env.conf to kolla toolbox] ************************ 2026-04-28 04:44:22.545166 | orchestrator | Tuesday 28 April 2026 04:44:16 +0000 (0:00:03.412) 0:01:08.859 ********* 2026-04-28 04:44:22.545172 | orchestrator | ok: [testbed-manager] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-28 04:44:22.545178 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-28 04:44:22.545184 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-28 04:44:22.545190 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-28 04:44:22.545195 | orchestrator | ok: [testbed-node-3] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-28 04:44:22.545201 | orchestrator | ok: [testbed-node-4] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-28 04:44:22.545207 | orchestrator | ok: [testbed-node-5] => (item=/ansible/roles/common/templates/rabbitmq-env.conf.j2) 2026-04-28 04:44:22.545215 | orchestrator | 2026-04-28 04:44:22.545221 | orchestrator | TASK [common : Copy rabbitmq erl_inetrc to kolla toolbox] ********************** 2026-04-28 04:44:22.545230 | orchestrator | Tuesday 28 April 2026 04:44:20 +0000 (0:00:03.558) 0:01:12.418 ********* 2026-04-28 04:44:22.545236 | orchestrator | ok: [testbed-manager] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-28 04:44:22.545242 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-28 04:44:22.545247 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-28 04:44:22.545253 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-28 04:44:22.545259 | orchestrator | ok: [testbed-node-3] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-28 04:44:22.545264 | orchestrator | ok: [testbed-node-4] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-28 04:44:22.545270 | orchestrator | ok: [testbed-node-5] => (item=/ansible/roles/common/templates/erl_inetrc.j2) 2026-04-28 04:44:22.545276 | orchestrator | 2026-04-28 04:44:22.545286 | orchestrator | TASK [service-check-containers : common | Check containers] ******************** 2026-04-28 04:44:27.015926 | orchestrator | Tuesday 28 April 2026 04:44:23 +0000 (0:00:03.644) 0:01:16.063 ********* 2026-04-28 04:44:27.016023 | orchestrator | changed: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:44:27.016063 | orchestrator | changed: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:44:27.016074 | orchestrator | changed: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:44:27.016084 | orchestrator | changed: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:44:27.016094 | orchestrator | changed: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:44:27.016118 | orchestrator | changed: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:27.016129 | orchestrator | changed: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:27.016157 | orchestrator | changed: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:27.016174 | orchestrator | changed: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:27.016183 | orchestrator | changed: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:27.016193 | orchestrator | changed: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:27.016204 | orchestrator | changed: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:27.016214 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:27.016223 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:27.016231 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:27.016246 | orchestrator | changed: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:44:32.242171 | orchestrator | changed: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}}) 2026-04-28 04:44:32.242317 | orchestrator | changed: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:32.242357 | orchestrator | changed: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:32.242372 | orchestrator | changed: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:32.242387 | orchestrator | changed: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 04:44:32.242400 | orchestrator | 2026-04-28 04:44:32.242413 | orchestrator | TASK [service-check-containers : common | Notify handlers to restart containers] *** 2026-04-28 04:44:32.242431 | orchestrator | Tuesday 28 April 2026 04:44:29 +0000 (0:00:05.610) 0:01:21.673 ********* 2026-04-28 04:44:32.242444 | orchestrator | changed: [testbed-manager] => { 2026-04-28 04:44:32.242456 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 04:44:32.242467 | orchestrator | } 2026-04-28 04:44:32.242478 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 04:44:32.242489 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 04:44:32.242504 | orchestrator | } 2026-04-28 04:44:32.242524 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 04:44:32.242543 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 04:44:32.242595 | orchestrator | } 2026-04-28 04:44:32.242617 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 04:44:32.242632 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 04:44:32.242644 | orchestrator | } 2026-04-28 04:44:32.242656 | orchestrator | changed: [testbed-node-3] => { 2026-04-28 04:44:32.242668 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 04:44:32.242707 | orchestrator | } 2026-04-28 04:44:32.242722 | orchestrator | changed: [testbed-node-4] => { 2026-04-28 04:44:32.242735 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 04:44:32.242747 | orchestrator | } 2026-04-28 04:44:32.242758 | orchestrator | changed: [testbed-node-5] => { 2026-04-28 04:44:32.242771 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 04:44:32.242783 | orchestrator | } 2026-04-28 04:44:32.242796 | orchestrator | 2026-04-28 04:44:32.242809 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 04:44:32.242822 | orchestrator | Tuesday 28 April 2026 04:44:31 +0000 (0:00:02.049) 0:01:23.723 ********* 2026-04-28 04:44:32.242859 | orchestrator | skipping: [testbed-manager] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 04:44:32.242873 | orchestrator | skipping: [testbed-manager] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:44:32.242887 | orchestrator | skipping: [testbed-manager] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:44:32.242900 | orchestrator | skipping: [testbed-manager] 2026-04-28 04:44:32.242914 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 04:44:32.242927 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:44:32.242956 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:44:32.242969 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 04:44:32.242980 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:44:32.242999 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:45:18.527822 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 04:45:18.527928 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:45:18.527942 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:45:18.527953 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:45:18.527964 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:45:18.527972 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 04:45:18.528015 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:45:18.528024 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:45:18.528032 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:45:18.528040 | orchestrator | skipping: [testbed-node-3] 2026-04-28 04:45:18.528048 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 04:45:18.528072 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:45:18.528081 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:45:18.528089 | orchestrator | skipping: [testbed-node-4] 2026-04-28 04:45:18.528097 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'fluentd', 'value': {'container_name': 'fluentd', 'group': 'fluentd', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS'}, 'volumes': ['/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'fluentd_data:/var/lib/fluentd/data/', '/var/log/journal:/var/log/journal:ro'], 'dimensions': {}}})  2026-04-28 04:45:18.528112 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'kolla-toolbox', 'value': {'container_name': 'kolla_toolbox', 'group': 'kolla-toolbox', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'environment': {'ANSIBLE_NOCOLOR': '1', 'ANSIBLE_LIBRARY': '/usr/share/ansible', 'REQUESTS_CA_BUNDLE': '/etc/ssl/certs/ca-certificates.crt'}, 'privileged': True, 'volumes': ['/etc/kolla/kolla-toolbox/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run/:/run/:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:45:18.528125 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'cron', 'value': {'container_name': 'cron', 'group': 'cron', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'environment': {'KOLLA_LOGROTATE_SCHEDULE': 'daily'}, 'volumes': ['/etc/kolla/cron/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:45:18.528133 | orchestrator | skipping: [testbed-node-5] 2026-04-28 04:45:18.528141 | orchestrator | 2026-04-28 04:45:18.528150 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-28 04:45:18.528160 | orchestrator | Tuesday 28 April 2026 04:44:34 +0000 (0:00:03.269) 0:01:26.993 ********* 2026-04-28 04:45:18.528167 | orchestrator | 2026-04-28 04:45:18.528176 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-28 04:45:18.528184 | orchestrator | Tuesday 28 April 2026 04:44:35 +0000 (0:00:00.537) 0:01:27.531 ********* 2026-04-28 04:45:18.528191 | orchestrator | 2026-04-28 04:45:18.528199 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-28 04:45:18.528207 | orchestrator | Tuesday 28 April 2026 04:44:35 +0000 (0:00:00.447) 0:01:27.978 ********* 2026-04-28 04:45:18.528215 | orchestrator | 2026-04-28 04:45:18.528222 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-28 04:45:18.528230 | orchestrator | Tuesday 28 April 2026 04:44:36 +0000 (0:00:00.434) 0:01:28.412 ********* 2026-04-28 04:45:18.528238 | orchestrator | 2026-04-28 04:45:18.528246 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-28 04:45:18.528253 | orchestrator | Tuesday 28 April 2026 04:44:36 +0000 (0:00:00.461) 0:01:28.874 ********* 2026-04-28 04:45:18.528261 | orchestrator | 2026-04-28 04:45:18.528269 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-28 04:45:18.528276 | orchestrator | Tuesday 28 April 2026 04:44:37 +0000 (0:00:00.503) 0:01:29.377 ********* 2026-04-28 04:45:18.528284 | orchestrator | 2026-04-28 04:45:18.528292 | orchestrator | TASK [common : Flush handlers] ************************************************* 2026-04-28 04:45:18.528300 | orchestrator | Tuesday 28 April 2026 04:44:37 +0000 (0:00:00.432) 0:01:29.809 ********* 2026-04-28 04:45:18.528307 | orchestrator | 2026-04-28 04:45:18.528315 | orchestrator | RUNNING HANDLER [common : Restart fluentd container] *************************** 2026-04-28 04:45:18.528324 | orchestrator | Tuesday 28 April 2026 04:44:38 +0000 (0:00:00.822) 0:01:30.632 ********* 2026-04-28 04:45:18.528333 | orchestrator | changed: [testbed-manager] 2026-04-28 04:45:18.528343 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:45:18.528352 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:45:18.528361 | orchestrator | changed: [testbed-node-3] 2026-04-28 04:45:18.528376 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:47:23.443676 | orchestrator | changed: [testbed-node-4] 2026-04-28 04:47:23.443912 | orchestrator | changed: [testbed-node-5] 2026-04-28 04:47:23.443943 | orchestrator | 2026-04-28 04:47:23.443965 | orchestrator | RUNNING HANDLER [common : Restart kolla-toolbox container] ********************* 2026-04-28 04:47:23.443987 | orchestrator | Tuesday 28 April 2026 04:45:52 +0000 (0:01:13.989) 0:02:44.621 ********* 2026-04-28 04:47:23.444006 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:47:23.444025 | orchestrator | changed: [testbed-node-3] 2026-04-28 04:47:23.444079 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:47:23.444100 | orchestrator | changed: [testbed-manager] 2026-04-28 04:47:23.444119 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:47:23.444137 | orchestrator | changed: [testbed-node-4] 2026-04-28 04:47:23.444156 | orchestrator | changed: [testbed-node-5] 2026-04-28 04:47:23.444174 | orchestrator | 2026-04-28 04:47:23.444193 | orchestrator | RUNNING HANDLER [common : Initializing toolbox container using normal user] **** 2026-04-28 04:47:23.444212 | orchestrator | Tuesday 28 April 2026 04:46:59 +0000 (0:01:07.337) 0:03:51.958 ********* 2026-04-28 04:47:23.444232 | orchestrator | ok: [testbed-manager] 2026-04-28 04:47:23.444252 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:47:23.444271 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:47:23.444290 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:47:23.444309 | orchestrator | ok: [testbed-node-3] 2026-04-28 04:47:23.444328 | orchestrator | ok: [testbed-node-4] 2026-04-28 04:47:23.444347 | orchestrator | ok: [testbed-node-5] 2026-04-28 04:47:23.444365 | orchestrator | 2026-04-28 04:47:23.444385 | orchestrator | RUNNING HANDLER [common : Restart cron container] ****************************** 2026-04-28 04:47:23.444405 | orchestrator | Tuesday 28 April 2026 04:47:03 +0000 (0:00:03.626) 0:03:55.585 ********* 2026-04-28 04:47:23.444424 | orchestrator | changed: [testbed-manager] 2026-04-28 04:47:23.444442 | orchestrator | changed: [testbed-node-3] 2026-04-28 04:47:23.444461 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:47:23.444479 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:47:23.444498 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:47:23.444518 | orchestrator | changed: [testbed-node-4] 2026-04-28 04:47:23.444539 | orchestrator | changed: [testbed-node-5] 2026-04-28 04:47:23.444557 | orchestrator | 2026-04-28 04:47:23.444575 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:47:23.444595 | orchestrator | testbed-manager : ok=22  changed=8  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 04:47:23.444615 | orchestrator | testbed-node-0 : ok=18  changed=8  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 04:47:23.444631 | orchestrator | testbed-node-1 : ok=18  changed=8  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 04:47:23.444649 | orchestrator | testbed-node-2 : ok=18  changed=8  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 04:47:23.444667 | orchestrator | testbed-node-3 : ok=18  changed=8  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 04:47:23.444685 | orchestrator | testbed-node-4 : ok=18  changed=8  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 04:47:23.444704 | orchestrator | testbed-node-5 : ok=18  changed=8  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 04:47:23.444724 | orchestrator | 2026-04-28 04:47:23.444740 | orchestrator | 2026-04-28 04:47:23.444756 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 04:47:23.444775 | orchestrator | Tuesday 28 April 2026 04:47:22 +0000 (0:00:19.474) 0:04:15.059 ********* 2026-04-28 04:47:23.444793 | orchestrator | =============================================================================== 2026-04-28 04:47:23.444838 | orchestrator | common : Restart fluentd container ------------------------------------- 73.99s 2026-04-28 04:47:23.444857 | orchestrator | common : Restart kolla-toolbox container ------------------------------- 67.34s 2026-04-28 04:47:23.444873 | orchestrator | common : Restart cron container ---------------------------------------- 19.47s 2026-04-28 04:47:23.444890 | orchestrator | common : Copying over config.json files for services -------------------- 7.02s 2026-04-28 04:47:23.444908 | orchestrator | service-cert-copy : common | Copying over extra CA certificates --------- 6.73s 2026-04-28 04:47:23.444941 | orchestrator | service-check-containers : common | Check containers -------------------- 5.61s 2026-04-28 04:47:23.444959 | orchestrator | common : Ensuring config directories exist ------------------------------ 5.52s 2026-04-28 04:47:23.444977 | orchestrator | common : Copying over fluentd.conf -------------------------------------- 5.12s 2026-04-28 04:47:23.444995 | orchestrator | common : Copying over cron logrotate config file ------------------------ 3.78s 2026-04-28 04:47:23.445013 | orchestrator | common : include_tasks -------------------------------------------------- 3.67s 2026-04-28 04:47:23.445031 | orchestrator | common : Copy rabbitmq erl_inetrc to kolla toolbox ---------------------- 3.65s 2026-04-28 04:47:23.445048 | orchestrator | common : Flush handlers ------------------------------------------------- 3.64s 2026-04-28 04:47:23.445066 | orchestrator | common : Initializing toolbox container using normal user --------------- 3.63s 2026-04-28 04:47:23.445084 | orchestrator | common : Copy rabbitmq-env.conf to kolla toolbox ------------------------ 3.56s 2026-04-28 04:47:23.445102 | orchestrator | common : Ensuring config directories have correct owner and permission --- 3.41s 2026-04-28 04:47:23.445120 | orchestrator | common : Ensure RabbitMQ Erlang cookie exists --------------------------- 3.40s 2026-04-28 04:47:23.445165 | orchestrator | service-cert-copy : common | Copying over backend internal TLS key ------ 3.29s 2026-04-28 04:47:23.445184 | orchestrator | common : Copying over kolla.target -------------------------------------- 3.27s 2026-04-28 04:47:23.445202 | orchestrator | service-check-containers : Include tasks -------------------------------- 3.27s 2026-04-28 04:47:23.445218 | orchestrator | service-cert-copy : common | Copying over backend internal TLS certificate --- 3.11s 2026-04-28 04:47:23.649883 | orchestrator | + osism apply -a upgrade loadbalancer 2026-04-28 04:47:24.994316 | orchestrator | 2026-04-28 04:47:24 | INFO  | Prepare task for execution of loadbalancer. 2026-04-28 04:47:25.072186 | orchestrator | 2026-04-28 04:47:25 | INFO  | Task 809c4de0-f298-4e3f-ae0b-03e7c25f9e46 (loadbalancer) was prepared for execution. 2026-04-28 04:47:25.072273 | orchestrator | 2026-04-28 04:47:25 | INFO  | It takes a moment until task 809c4de0-f298-4e3f-ae0b-03e7c25f9e46 (loadbalancer) has been started and output is visible here. 2026-04-28 04:47:46.368767 | orchestrator | 2026-04-28 04:47:46.368935 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 04:47:46.368954 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-28 04:47:46.368968 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-28 04:47:46.368991 | orchestrator | 2026-04-28 04:47:46.369002 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 04:47:46.369013 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-28 04:47:46.369024 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-28 04:47:46.369046 | orchestrator | Tuesday 28 April 2026 04:47:30 +0000 (0:00:01.513) 0:00:01.513 ********* 2026-04-28 04:47:46.369058 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:47:46.369071 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:47:46.369082 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:47:46.369093 | orchestrator | 2026-04-28 04:47:46.369104 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 04:47:46.369114 | orchestrator | Tuesday 28 April 2026 04:47:31 +0000 (0:00:00.899) 0:00:02.413 ********* 2026-04-28 04:47:46.369125 | orchestrator | ok: [testbed-node-0] => (item=enable_loadbalancer_True) 2026-04-28 04:47:46.369136 | orchestrator | ok: [testbed-node-1] => (item=enable_loadbalancer_True) 2026-04-28 04:47:46.369147 | orchestrator | ok: [testbed-node-2] => (item=enable_loadbalancer_True) 2026-04-28 04:47:46.369158 | orchestrator | 2026-04-28 04:47:46.369168 | orchestrator | PLAY [Apply role loadbalancer] ************************************************* 2026-04-28 04:47:46.369204 | orchestrator | 2026-04-28 04:47:46.369216 | orchestrator | TASK [loadbalancer : include_tasks] ******************************************** 2026-04-28 04:47:46.369227 | orchestrator | Tuesday 28 April 2026 04:47:32 +0000 (0:00:00.920) 0:00:03.334 ********* 2026-04-28 04:47:46.369238 | orchestrator | included: /ansible/roles/loadbalancer/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:47:46.369249 | orchestrator | 2026-04-28 04:47:46.369278 | orchestrator | TASK [loadbalancer : Stop and remove containers for haproxy exporter containers] *** 2026-04-28 04:47:46.369295 | orchestrator | Tuesday 28 April 2026 04:47:33 +0000 (0:00:01.161) 0:00:04.496 ********* 2026-04-28 04:47:46.369309 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:47:46.369321 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:47:46.369333 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:47:46.369347 | orchestrator | 2026-04-28 04:47:46.369359 | orchestrator | TASK [loadbalancer : Removing config for haproxy exporter] ********************* 2026-04-28 04:47:46.369372 | orchestrator | Tuesday 28 April 2026 04:47:34 +0000 (0:00:01.325) 0:00:05.821 ********* 2026-04-28 04:47:46.369385 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:47:46.369397 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:47:46.369408 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:47:46.369419 | orchestrator | 2026-04-28 04:47:46.369430 | orchestrator | TASK [loadbalancer : Check IPv6 support] *************************************** 2026-04-28 04:47:46.369440 | orchestrator | Tuesday 28 April 2026 04:47:35 +0000 (0:00:01.359) 0:00:07.180 ********* 2026-04-28 04:47:46.369451 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:47:46.369462 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:47:46.369477 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:47:46.369500 | orchestrator | 2026-04-28 04:47:46.369519 | orchestrator | TASK [Setting sysctl values] *************************************************** 2026-04-28 04:47:46.369538 | orchestrator | Tuesday 28 April 2026 04:47:36 +0000 (0:00:00.875) 0:00:08.056 ********* 2026-04-28 04:47:46.369557 | orchestrator | included: sysctl for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:47:46.369577 | orchestrator | 2026-04-28 04:47:46.369596 | orchestrator | TASK [sysctl : Check IPv6 support] ********************************************* 2026-04-28 04:47:46.369615 | orchestrator | Tuesday 28 April 2026 04:47:37 +0000 (0:00:01.054) 0:00:09.111 ********* 2026-04-28 04:47:46.369636 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:47:46.369655 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:47:46.369676 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:47:46.369696 | orchestrator | 2026-04-28 04:47:46.369715 | orchestrator | TASK [sysctl : Setting sysctl values] ****************************************** 2026-04-28 04:47:46.369735 | orchestrator | Tuesday 28 April 2026 04:47:38 +0000 (0:00:00.669) 0:00:09.781 ********* 2026-04-28 04:47:46.369754 | orchestrator | ok: [testbed-node-0] => (item={'name': 'net.ipv6.ip_nonlocal_bind', 'value': 1}) 2026-04-28 04:47:46.369775 | orchestrator | ok: [testbed-node-1] => (item={'name': 'net.ipv6.ip_nonlocal_bind', 'value': 1}) 2026-04-28 04:47:46.369794 | orchestrator | ok: [testbed-node-2] => (item={'name': 'net.ipv6.ip_nonlocal_bind', 'value': 1}) 2026-04-28 04:47:46.369813 | orchestrator | ok: [testbed-node-0] => (item={'name': 'net.ipv4.ip_nonlocal_bind', 'value': 1}) 2026-04-28 04:47:46.369854 | orchestrator | ok: [testbed-node-0] => (item={'name': 'net.ipv4.tcp_retries2', 'value': 'KOLLA_UNSET'}) 2026-04-28 04:47:46.369873 | orchestrator | ok: [testbed-node-2] => (item={'name': 'net.ipv4.ip_nonlocal_bind', 'value': 1}) 2026-04-28 04:47:46.369889 | orchestrator | ok: [testbed-node-0] => (item={'name': 'net.unix.max_dgram_qlen', 'value': 128}) 2026-04-28 04:47:46.369906 | orchestrator | ok: [testbed-node-2] => (item={'name': 'net.ipv4.tcp_retries2', 'value': 'KOLLA_UNSET'}) 2026-04-28 04:47:46.369923 | orchestrator | ok: [testbed-node-1] => (item={'name': 'net.ipv4.ip_nonlocal_bind', 'value': 1}) 2026-04-28 04:47:46.369942 | orchestrator | ok: [testbed-node-2] => (item={'name': 'net.unix.max_dgram_qlen', 'value': 128}) 2026-04-28 04:47:46.369961 | orchestrator | ok: [testbed-node-1] => (item={'name': 'net.ipv4.tcp_retries2', 'value': 'KOLLA_UNSET'}) 2026-04-28 04:47:46.370110 | orchestrator | ok: [testbed-node-1] => (item={'name': 'net.unix.max_dgram_qlen', 'value': 128}) 2026-04-28 04:47:46.370142 | orchestrator | 2026-04-28 04:47:46.370159 | orchestrator | TASK [module-load : Load modules] ********************************************** 2026-04-28 04:47:46.370176 | orchestrator | Tuesday 28 April 2026 04:47:41 +0000 (0:00:03.343) 0:00:13.125 ********* 2026-04-28 04:47:46.370192 | orchestrator | ok: [testbed-node-0] => (item=ip_vs) 2026-04-28 04:47:46.370209 | orchestrator | ok: [testbed-node-1] => (item=ip_vs) 2026-04-28 04:47:46.370226 | orchestrator | ok: [testbed-node-2] => (item=ip_vs) 2026-04-28 04:47:46.370245 | orchestrator | 2026-04-28 04:47:46.370265 | orchestrator | TASK [module-load : Persist modules via modules-load.d] ************************ 2026-04-28 04:47:46.370285 | orchestrator | Tuesday 28 April 2026 04:47:42 +0000 (0:00:00.720) 0:00:13.846 ********* 2026-04-28 04:47:46.370304 | orchestrator | ok: [testbed-node-1] => (item=ip_vs) 2026-04-28 04:47:46.370322 | orchestrator | ok: [testbed-node-0] => (item=ip_vs) 2026-04-28 04:47:46.370341 | orchestrator | ok: [testbed-node-2] => (item=ip_vs) 2026-04-28 04:47:46.370361 | orchestrator | 2026-04-28 04:47:46.370380 | orchestrator | TASK [module-load : Drop module persistence] *********************************** 2026-04-28 04:47:46.370401 | orchestrator | Tuesday 28 April 2026 04:47:43 +0000 (0:00:01.223) 0:00:15.069 ********* 2026-04-28 04:47:46.370420 | orchestrator | skipping: [testbed-node-0] => (item=ip_vs)  2026-04-28 04:47:46.370436 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:47:46.370448 | orchestrator | skipping: [testbed-node-1] => (item=ip_vs)  2026-04-28 04:47:46.370458 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:47:46.370469 | orchestrator | skipping: [testbed-node-2] => (item=ip_vs)  2026-04-28 04:47:46.370480 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:47:46.370490 | orchestrator | 2026-04-28 04:47:46.370501 | orchestrator | TASK [loadbalancer : Ensuring config directories exist] ************************ 2026-04-28 04:47:46.370512 | orchestrator | Tuesday 28 April 2026 04:47:45 +0000 (0:00:01.284) 0:00:16.354 ********* 2026-04-28 04:47:46.370536 | orchestrator | ok: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-28 04:47:46.370556 | orchestrator | ok: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-28 04:47:46.370568 | orchestrator | ok: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-28 04:47:46.370591 | orchestrator | ok: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 04:47:46.370619 | orchestrator | ok: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 04:47:53.527912 | orchestrator | ok: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 04:47:53.528055 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 04:47:53.528105 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 04:47:53.528124 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 04:47:53.528140 | orchestrator | 2026-04-28 04:47:53.528157 | orchestrator | TASK [loadbalancer : Ensuring haproxy service config subdir exists] ************ 2026-04-28 04:47:53.528173 | orchestrator | Tuesday 28 April 2026 04:47:46 +0000 (0:00:01.829) 0:00:18.183 ********* 2026-04-28 04:47:53.528188 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:47:53.528204 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:47:53.528283 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:47:53.528300 | orchestrator | 2026-04-28 04:47:53.528315 | orchestrator | TASK [loadbalancer : Ensuring proxysql service config subdirectories exist] **** 2026-04-28 04:47:53.528329 | orchestrator | Tuesday 28 April 2026 04:47:48 +0000 (0:00:01.645) 0:00:19.828 ********* 2026-04-28 04:47:53.528345 | orchestrator | ok: [testbed-node-0] => (item=users) 2026-04-28 04:47:53.528361 | orchestrator | ok: [testbed-node-1] => (item=users) 2026-04-28 04:47:53.528376 | orchestrator | ok: [testbed-node-2] => (item=users) 2026-04-28 04:47:53.528392 | orchestrator | ok: [testbed-node-0] => (item=rules) 2026-04-28 04:47:53.528407 | orchestrator | ok: [testbed-node-1] => (item=rules) 2026-04-28 04:47:53.528422 | orchestrator | ok: [testbed-node-2] => (item=rules) 2026-04-28 04:47:53.528437 | orchestrator | 2026-04-28 04:47:53.528452 | orchestrator | TASK [loadbalancer : Ensuring keepalived checks subdir exists] ***************** 2026-04-28 04:47:53.528463 | orchestrator | Tuesday 28 April 2026 04:47:50 +0000 (0:00:01.746) 0:00:21.575 ********* 2026-04-28 04:47:53.528473 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:47:53.528483 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:47:53.528493 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:47:53.528503 | orchestrator | 2026-04-28 04:47:53.528512 | orchestrator | TASK [loadbalancer : Remove mariadb.cfg if proxysql enabled] ******************* 2026-04-28 04:47:53.528522 | orchestrator | Tuesday 28 April 2026 04:47:51 +0000 (0:00:01.042) 0:00:22.617 ********* 2026-04-28 04:47:53.528532 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:47:53.528541 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:47:53.528552 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:47:53.528562 | orchestrator | 2026-04-28 04:47:53.528572 | orchestrator | TASK [loadbalancer : Removing checks for services which are disabled] ********** 2026-04-28 04:47:53.528584 | orchestrator | Tuesday 28 April 2026 04:47:52 +0000 (0:00:01.516) 0:00:24.135 ********* 2026-04-28 04:47:53.528628 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-28 04:47:53.528647 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 04:47:53.528672 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 04:47:53.528690 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy-ssh:9.6.20260328', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__c5a37e801c074df7185ffde0e03a2081aed9e2dd', '__omit_place_holder__c5a37e801c074df7185ffde0e03a2081aed9e2dd'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-28 04:47:53.528717 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:47:53.528734 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-28 04:47:53.528751 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 04:47:53.528767 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 04:47:53.528794 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy-ssh:9.6.20260328', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__c5a37e801c074df7185ffde0e03a2081aed9e2dd', '__omit_place_holder__c5a37e801c074df7185ffde0e03a2081aed9e2dd'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-28 04:47:56.590721 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:47:56.590969 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-28 04:47:56.591004 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 04:47:56.591111 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 04:47:56.591134 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy-ssh:9.6.20260328', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__c5a37e801c074df7185ffde0e03a2081aed9e2dd', '__omit_place_holder__c5a37e801c074df7185ffde0e03a2081aed9e2dd'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-28 04:47:56.591153 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:47:56.591171 | orchestrator | 2026-04-28 04:47:56.591190 | orchestrator | TASK [loadbalancer : Copying checks for services which are enabled] ************ 2026-04-28 04:47:56.591209 | orchestrator | Tuesday 28 April 2026 04:47:53 +0000 (0:00:01.045) 0:00:25.180 ********* 2026-04-28 04:47:56.591226 | orchestrator | ok: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-28 04:47:56.591262 | orchestrator | ok: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-28 04:47:56.591273 | orchestrator | ok: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-28 04:47:56.591293 | orchestrator | ok: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 04:47:56.591303 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 04:47:56.591313 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy-ssh:9.6.20260328', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__c5a37e801c074df7185ffde0e03a2081aed9e2dd', '__omit_place_holder__c5a37e801c074df7185ffde0e03a2081aed9e2dd'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-28 04:47:56.591323 | orchestrator | ok: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 04:47:56.591333 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 04:47:56.591370 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy-ssh:9.6.20260328', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__c5a37e801c074df7185ffde0e03a2081aed9e2dd', '__omit_place_holder__c5a37e801c074df7185ffde0e03a2081aed9e2dd'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-28 04:48:02.294563 | orchestrator | ok: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 04:48:02.294753 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 04:48:02.294783 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy-ssh', 'value': {'container_name': 'haproxy_ssh', 'group': 'loadbalancer', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy-ssh:9.6.20260328', 'volumes': ['/etc/kolla/haproxy-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', '__omit_place_holder__c5a37e801c074df7185ffde0e03a2081aed9e2dd', '__omit_place_holder__c5a37e801c074df7185ffde0e03a2081aed9e2dd'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 2985'], 'timeout': '30'}}})  2026-04-28 04:48:02.294807 | orchestrator | 2026-04-28 04:48:02.294867 | orchestrator | TASK [loadbalancer : Copying over config.json files for services] ************** 2026-04-28 04:48:02.294890 | orchestrator | Tuesday 28 April 2026 04:47:56 +0000 (0:00:02.951) 0:00:28.132 ********* 2026-04-28 04:48:02.294911 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-28 04:48:02.294932 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-28 04:48:02.294952 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-28 04:48:02.295066 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 04:48:02.295084 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 04:48:02.295099 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 04:48:02.295112 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 04:48:02.295126 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 04:48:02.295139 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 04:48:02.295152 | orchestrator | 2026-04-28 04:48:02.295166 | orchestrator | TASK [loadbalancer : Copying over haproxy.cfg] ********************************* 2026-04-28 04:48:02.295188 | orchestrator | Tuesday 28 April 2026 04:48:00 +0000 (0:00:03.521) 0:00:31.653 ********* 2026-04-28 04:48:02.295202 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_main.cfg.j2) 2026-04-28 04:48:02.295216 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_main.cfg.j2) 2026-04-28 04:48:02.295229 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_main.cfg.j2) 2026-04-28 04:48:02.295243 | orchestrator | 2026-04-28 04:48:02.295255 | orchestrator | TASK [loadbalancer : Copying over proxysql config] ***************************** 2026-04-28 04:48:02.295276 | orchestrator | Tuesday 28 April 2026 04:48:02 +0000 (0:00:01.963) 0:00:33.617 ********* 2026-04-28 04:48:19.541967 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql.yaml.j2) 2026-04-28 04:48:19.542173 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql.yaml.j2) 2026-04-28 04:48:19.542210 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql.yaml.j2) 2026-04-28 04:48:19.542222 | orchestrator | 2026-04-28 04:48:19.542235 | orchestrator | TASK [loadbalancer : Copying over haproxy single external frontend config] ***** 2026-04-28 04:48:19.542246 | orchestrator | Tuesday 28 April 2026 04:48:05 +0000 (0:00:03.386) 0:00:37.004 ********* 2026-04-28 04:48:19.542258 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:48:19.542270 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:48:19.542281 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:48:19.542292 | orchestrator | 2026-04-28 04:48:19.542303 | orchestrator | TASK [loadbalancer : Copying over custom haproxy services configuration] ******* 2026-04-28 04:48:19.542314 | orchestrator | Tuesday 28 April 2026 04:48:06 +0000 (0:00:00.628) 0:00:37.632 ********* 2026-04-28 04:48:19.542326 | orchestrator | ok: [testbed-node-0] => (item=/opt/configuration/environments/kolla/files/overlays/haproxy/services.d/haproxy.cfg) 2026-04-28 04:48:19.542337 | orchestrator | ok: [testbed-node-1] => (item=/opt/configuration/environments/kolla/files/overlays/haproxy/services.d/haproxy.cfg) 2026-04-28 04:48:19.542348 | orchestrator | ok: [testbed-node-2] => (item=/opt/configuration/environments/kolla/files/overlays/haproxy/services.d/haproxy.cfg) 2026-04-28 04:48:19.542359 | orchestrator | 2026-04-28 04:48:19.542369 | orchestrator | TASK [loadbalancer : Copying over keepalived.conf] ***************************** 2026-04-28 04:48:19.542380 | orchestrator | Tuesday 28 April 2026 04:48:08 +0000 (0:00:02.332) 0:00:39.965 ********* 2026-04-28 04:48:19.542391 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/keepalived/keepalived.conf.j2) 2026-04-28 04:48:19.542402 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/keepalived/keepalived.conf.j2) 2026-04-28 04:48:19.542413 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/keepalived/keepalived.conf.j2) 2026-04-28 04:48:19.542424 | orchestrator | 2026-04-28 04:48:19.542437 | orchestrator | TASK [loadbalancer : include_tasks] ******************************************** 2026-04-28 04:48:19.542450 | orchestrator | Tuesday 28 April 2026 04:48:10 +0000 (0:00:02.330) 0:00:42.296 ********* 2026-04-28 04:48:19.542462 | orchestrator | included: /ansible/roles/loadbalancer/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:48:19.542475 | orchestrator | 2026-04-28 04:48:19.542487 | orchestrator | TASK [loadbalancer : Copying over haproxy.pem] ********************************* 2026-04-28 04:48:19.542500 | orchestrator | Tuesday 28 April 2026 04:48:12 +0000 (0:00:01.036) 0:00:43.332 ********* 2026-04-28 04:48:19.542513 | orchestrator | ok: [testbed-node-0] => (item=haproxy.pem) 2026-04-28 04:48:19.542527 | orchestrator | ok: [testbed-node-1] => (item=haproxy.pem) 2026-04-28 04:48:19.542540 | orchestrator | ok: [testbed-node-2] => (item=haproxy.pem) 2026-04-28 04:48:19.542552 | orchestrator | 2026-04-28 04:48:19.542564 | orchestrator | TASK [loadbalancer : Copying over haproxy-internal.pem] ************************ 2026-04-28 04:48:19.542576 | orchestrator | Tuesday 28 April 2026 04:48:13 +0000 (0:00:01.614) 0:00:44.946 ********* 2026-04-28 04:48:19.542610 | orchestrator | ok: [testbed-node-0] => (item=haproxy-internal.pem) 2026-04-28 04:48:19.542623 | orchestrator | ok: [testbed-node-1] => (item=haproxy-internal.pem) 2026-04-28 04:48:19.542636 | orchestrator | ok: [testbed-node-2] => (item=haproxy-internal.pem) 2026-04-28 04:48:19.542647 | orchestrator | 2026-04-28 04:48:19.542658 | orchestrator | TASK [loadbalancer : Copying over proxysql-cert.pem] *************************** 2026-04-28 04:48:19.542669 | orchestrator | Tuesday 28 April 2026 04:48:15 +0000 (0:00:02.025) 0:00:46.972 ********* 2026-04-28 04:48:19.542679 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:48:19.542690 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:48:19.542701 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:48:19.542712 | orchestrator | 2026-04-28 04:48:19.542723 | orchestrator | TASK [loadbalancer : Copying over proxysql-key.pem] **************************** 2026-04-28 04:48:19.542734 | orchestrator | Tuesday 28 April 2026 04:48:16 +0000 (0:00:00.381) 0:00:47.354 ********* 2026-04-28 04:48:19.542744 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:48:19.542755 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:48:19.542766 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:48:19.542777 | orchestrator | 2026-04-28 04:48:19.542788 | orchestrator | TASK [service-cert-copy : mariadb | Copying over extra CA certificates] ******** 2026-04-28 04:48:19.542798 | orchestrator | Tuesday 28 April 2026 04:48:16 +0000 (0:00:00.698) 0:00:48.052 ********* 2026-04-28 04:48:19.542813 | orchestrator | ok: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-28 04:48:19.542873 | orchestrator | ok: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-28 04:48:19.542888 | orchestrator | ok: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-28 04:48:19.542900 | orchestrator | ok: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 04:48:19.542920 | orchestrator | ok: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 04:48:19.542931 | orchestrator | ok: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 04:48:19.542943 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 04:48:19.542964 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 04:48:21.266799 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 04:48:21.266978 | orchestrator | 2026-04-28 04:48:21.266997 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS certificate] *** 2026-04-28 04:48:21.267010 | orchestrator | Tuesday 28 April 2026 04:48:19 +0000 (0:00:03.160) 0:00:51.213 ********* 2026-04-28 04:48:21.267023 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-28 04:48:21.267061 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 04:48:21.267073 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 04:48:21.267085 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:48:21.267097 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-28 04:48:21.267121 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 04:48:21.267161 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 04:48:21.267174 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:48:21.267186 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-28 04:48:21.267197 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 04:48:21.267217 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 04:48:21.267228 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:48:21.267239 | orchestrator | 2026-04-28 04:48:21.267250 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS key] ***** 2026-04-28 04:48:21.267261 | orchestrator | Tuesday 28 April 2026 04:48:20 +0000 (0:00:01.022) 0:00:52.235 ********* 2026-04-28 04:48:21.267273 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-28 04:48:21.267285 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 04:48:21.267308 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 04:48:28.792004 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:48:28.792126 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-28 04:48:28.792193 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 04:48:28.792218 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 04:48:28.792237 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:48:28.792746 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-28 04:48:28.792784 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 04:48:28.792805 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 04:48:28.792819 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:48:28.792839 | orchestrator | 2026-04-28 04:48:28.792946 | orchestrator | TASK [loadbalancer : Copying over haproxy start script] ************************ 2026-04-28 04:48:28.792969 | orchestrator | Tuesday 28 April 2026 04:48:21 +0000 (0:00:00.917) 0:00:53.153 ********* 2026-04-28 04:48:28.792988 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_run.sh.j2) 2026-04-28 04:48:28.793035 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_run.sh.j2) 2026-04-28 04:48:28.793056 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/haproxy/haproxy_run.sh.j2) 2026-04-28 04:48:28.793067 | orchestrator | 2026-04-28 04:48:28.793092 | orchestrator | TASK [loadbalancer : Copying over proxysql start script] *********************** 2026-04-28 04:48:28.793103 | orchestrator | Tuesday 28 April 2026 04:48:23 +0000 (0:00:01.754) 0:00:54.907 ********* 2026-04-28 04:48:28.793114 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql_run.sh.j2) 2026-04-28 04:48:28.793125 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql_run.sh.j2) 2026-04-28 04:48:28.793136 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/loadbalancer/templates/proxysql/proxysql_run.sh.j2) 2026-04-28 04:48:28.793146 | orchestrator | 2026-04-28 04:48:28.793157 | orchestrator | TASK [loadbalancer : Copying files for haproxy-ssh] **************************** 2026-04-28 04:48:28.793168 | orchestrator | Tuesday 28 April 2026 04:48:25 +0000 (0:00:01.925) 0:00:56.833 ********* 2026-04-28 04:48:28.793178 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'haproxy-ssh/sshd_config.j2', 'dest': 'sshd_config'})  2026-04-28 04:48:28.793189 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'haproxy-ssh/sshd_config.j2', 'dest': 'sshd_config'})  2026-04-28 04:48:28.793201 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'haproxy-ssh/sshd_config.j2', 'dest': 'sshd_config'})  2026-04-28 04:48:28.793220 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'haproxy-ssh/id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-28 04:48:28.793238 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:48:28.793257 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'haproxy-ssh/id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-28 04:48:28.793275 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:48:28.793293 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'haproxy-ssh/id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-28 04:48:28.793312 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:48:28.793333 | orchestrator | 2026-04-28 04:48:28.793351 | orchestrator | TASK [service-check-containers : loadbalancer | Check containers] ************** 2026-04-28 04:48:28.793370 | orchestrator | Tuesday 28 April 2026 04:48:26 +0000 (0:00:01.397) 0:00:58.230 ********* 2026-04-28 04:48:28.793390 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-28 04:48:28.793411 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-28 04:48:28.793439 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-28 04:48:28.793496 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 04:48:31.169663 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 04:48:31.169774 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 04:48:31.169790 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 04:48:31.169802 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 04:48:31.169812 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 04:48:31.169823 | orchestrator | 2026-04-28 04:48:31.169834 | orchestrator | TASK [service-check-containers : loadbalancer | Notify handlers to restart containers] *** 2026-04-28 04:48:31.169892 | orchestrator | Tuesday 28 April 2026 04:48:29 +0000 (0:00:02.990) 0:01:01.221 ********* 2026-04-28 04:48:31.169930 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 04:48:31.169941 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 04:48:31.169952 | orchestrator | } 2026-04-28 04:48:31.169962 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 04:48:31.169971 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 04:48:31.169981 | orchestrator | } 2026-04-28 04:48:31.169990 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 04:48:31.170000 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 04:48:31.170009 | orchestrator | } 2026-04-28 04:48:31.170083 | orchestrator | 2026-04-28 04:48:31.170094 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 04:48:31.170104 | orchestrator | Tuesday 28 April 2026 04:48:30 +0000 (0:00:00.658) 0:01:01.880 ********* 2026-04-28 04:48:31.170133 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-28 04:48:31.170145 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 04:48:31.170155 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 04:48:31.170166 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:48:31.170178 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-28 04:48:31.170191 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 04:48:31.170216 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 04:48:31.170228 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:48:31.170240 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-28 04:48:31.170259 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 04:48:36.737980 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 04:48:36.738205 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:48:36.738273 | orchestrator | 2026-04-28 04:48:36.738297 | orchestrator | TASK [include_role : aodh] ***************************************************** 2026-04-28 04:48:36.738316 | orchestrator | Tuesday 28 April 2026 04:48:31 +0000 (0:00:01.204) 0:01:03.085 ********* 2026-04-28 04:48:36.738333 | orchestrator | included: aodh for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:48:36.738350 | orchestrator | 2026-04-28 04:48:36.738366 | orchestrator | TASK [haproxy-config : Copying over aodh haproxy config] *********************** 2026-04-28 04:48:36.738383 | orchestrator | Tuesday 28 April 2026 04:48:33 +0000 (0:00:01.281) 0:01:04.366 ********* 2026-04-28 04:48:36.738404 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:48:36.738473 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:48:36.738490 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 04:48:36.738531 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 04:48:36.738549 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 04:48:36.738568 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 04:48:36.738584 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 04:48:36.738614 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 04:48:36.738640 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:48:36.738661 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 04:48:37.714685 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 04:48:37.714782 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 04:48:37.714798 | orchestrator | 2026-04-28 04:48:37.714812 | orchestrator | TASK [haproxy-config : Add configuration for aodh when using single external frontend] *** 2026-04-28 04:48:37.714849 | orchestrator | Tuesday 28 April 2026 04:48:36 +0000 (0:00:03.855) 0:01:08.221 ********* 2026-04-28 04:48:37.714940 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:48:37.714971 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 04:48:37.714983 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 04:48:37.715013 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 04:48:37.715025 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:48:37.715039 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:48:37.715059 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 04:48:37.715071 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 04:48:37.715082 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 04:48:37.715093 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:48:37.715193 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:48:37.715224 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 04:48:47.575745 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 04:48:47.575930 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 04:48:47.575990 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:48:47.576006 | orchestrator | 2026-04-28 04:48:47.576019 | orchestrator | TASK [haproxy-config : Configuring firewall for aodh] ************************** 2026-04-28 04:48:47.576031 | orchestrator | Tuesday 28 April 2026 04:48:38 +0000 (0:00:01.146) 0:01:09.368 ********* 2026-04-28 04:48:47.576043 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:48:47.576057 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:48:47.576070 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:48:47.576096 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:48:47.576108 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:48:47.576119 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:48:47.576131 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:48:47.576142 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:48:47.576153 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:48:47.576164 | orchestrator | 2026-04-28 04:48:47.576175 | orchestrator | TASK [proxysql-config : Copying over aodh ProxySQL users config] *************** 2026-04-28 04:48:47.576186 | orchestrator | Tuesday 28 April 2026 04:48:39 +0000 (0:00:01.382) 0:01:10.751 ********* 2026-04-28 04:48:47.576197 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:48:47.576209 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:48:47.576220 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:48:47.576230 | orchestrator | 2026-04-28 04:48:47.576241 | orchestrator | TASK [proxysql-config : Copying over aodh ProxySQL rules config] *************** 2026-04-28 04:48:47.576252 | orchestrator | Tuesday 28 April 2026 04:48:40 +0000 (0:00:01.297) 0:01:12.048 ********* 2026-04-28 04:48:47.576263 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:48:47.576274 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:48:47.576286 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:48:47.576298 | orchestrator | 2026-04-28 04:48:47.576311 | orchestrator | TASK [include_role : barbican] ************************************************* 2026-04-28 04:48:47.576323 | orchestrator | Tuesday 28 April 2026 04:48:42 +0000 (0:00:02.156) 0:01:14.205 ********* 2026-04-28 04:48:47.576343 | orchestrator | included: barbican for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:48:47.576356 | orchestrator | 2026-04-28 04:48:47.576369 | orchestrator | TASK [haproxy-config : Copying over barbican haproxy config] ******************* 2026-04-28 04:48:47.576381 | orchestrator | Tuesday 28 April 2026 04:48:43 +0000 (0:00:00.988) 0:01:15.194 ********* 2026-04-28 04:48:47.576418 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:48:47.576434 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 04:48:47.576454 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 04:48:47.576468 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:48:47.576482 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 04:48:47.576524 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 04:48:48.525939 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:48:48.526152 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 04:48:48.526180 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 04:48:48.526200 | orchestrator | 2026-04-28 04:48:48.526220 | orchestrator | TASK [haproxy-config : Add configuration for barbican when using single external frontend] *** 2026-04-28 04:48:48.526239 | orchestrator | Tuesday 28 April 2026 04:48:47 +0000 (0:00:03.874) 0:01:19.069 ********* 2026-04-28 04:48:48.526262 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:48:48.526325 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 04:48:48.526337 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 04:48:48.526348 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:48:48.526366 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:48:48.526377 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 04:48:48.526396 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 04:48:48.526408 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:48:48.526427 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:48:59.316220 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 04:48:59.316341 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 04:48:59.316358 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:48:59.316372 | orchestrator | 2026-04-28 04:48:59.316401 | orchestrator | TASK [haproxy-config : Configuring firewall for barbican] ********************** 2026-04-28 04:48:59.316414 | orchestrator | Tuesday 28 April 2026 04:48:48 +0000 (0:00:01.134) 0:01:20.203 ********* 2026-04-28 04:48:59.316427 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:48:59.316441 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:48:59.316475 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:48:59.316487 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:48:59.316498 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:48:59.316510 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:48:59.316521 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:48:59.316532 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:48:59.316543 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:48:59.316554 | orchestrator | 2026-04-28 04:48:59.316566 | orchestrator | TASK [proxysql-config : Copying over barbican ProxySQL users config] *********** 2026-04-28 04:48:59.316576 | orchestrator | Tuesday 28 April 2026 04:48:49 +0000 (0:00:00.926) 0:01:21.130 ********* 2026-04-28 04:48:59.316587 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:48:59.316599 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:48:59.316610 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:48:59.316621 | orchestrator | 2026-04-28 04:48:59.316632 | orchestrator | TASK [proxysql-config : Copying over barbican ProxySQL rules config] *********** 2026-04-28 04:48:59.316642 | orchestrator | Tuesday 28 April 2026 04:48:51 +0000 (0:00:01.242) 0:01:22.372 ********* 2026-04-28 04:48:59.316653 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:48:59.316664 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:48:59.316675 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:48:59.316685 | orchestrator | 2026-04-28 04:48:59.316696 | orchestrator | TASK [include_role : blazar] *************************************************** 2026-04-28 04:48:59.316707 | orchestrator | Tuesday 28 April 2026 04:48:53 +0000 (0:00:02.234) 0:01:24.607 ********* 2026-04-28 04:48:59.316720 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:48:59.316732 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:48:59.316745 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:48:59.316757 | orchestrator | 2026-04-28 04:48:59.316770 | orchestrator | TASK [include_role : ceph-rgw] ************************************************* 2026-04-28 04:48:59.316800 | orchestrator | Tuesday 28 April 2026 04:48:53 +0000 (0:00:00.563) 0:01:25.171 ********* 2026-04-28 04:48:59.316813 | orchestrator | included: ceph-rgw for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:48:59.316825 | orchestrator | 2026-04-28 04:48:59.316899 | orchestrator | TASK [haproxy-config : Copying over ceph-rgw haproxy config] ******************* 2026-04-28 04:48:59.316912 | orchestrator | Tuesday 28 April 2026 04:48:54 +0000 (0:00:00.794) 0:01:25.965 ********* 2026-04-28 04:48:59.316928 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}}}}) 2026-04-28 04:48:59.316960 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}}}}) 2026-04-28 04:48:59.316986 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}}}}) 2026-04-28 04:48:59.317009 | orchestrator | 2026-04-28 04:48:59.317021 | orchestrator | TASK [haproxy-config : Add configuration for ceph-rgw when using single external frontend] *** 2026-04-28 04:48:59.317032 | orchestrator | Tuesday 28 April 2026 04:48:57 +0000 (0:00:03.285) 0:01:29.251 ********* 2026-04-28 04:48:59.317043 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}}}})  2026-04-28 04:48:59.317055 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:48:59.317088 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}}}})  2026-04-28 04:49:07.977762 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:49:07.977964 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceph-rgw', 'value': {'group': 'all', 'enabled': True, 'haproxy': {'radosgw': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}, 'radosgw_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}}}})  2026-04-28 04:49:07.978012 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:49:07.978083 | orchestrator | 2026-04-28 04:49:07.978096 | orchestrator | TASK [haproxy-config : Configuring firewall for ceph-rgw] ********************** 2026-04-28 04:49:07.978108 | orchestrator | Tuesday 28 April 2026 04:48:59 +0000 (0:00:01.557) 0:01:30.809 ********* 2026-04-28 04:49:07.978121 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'radosgw', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}})  2026-04-28 04:49:07.978163 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'radosgw_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}})  2026-04-28 04:49:07.978178 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:49:07.978190 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'radosgw', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}})  2026-04-28 04:49:07.978201 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'radosgw_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}})  2026-04-28 04:49:07.978212 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:49:07.978224 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'radosgw', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}})  2026-04-28 04:49:07.978235 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'radosgw_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6780', 'custom_member_list': ['server testbed-node-3 192.168.16.13:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-4 192.168.16.14:7480 check inter 2000 rise 2 fall 5', 'server testbed-node-5 192.168.16.15:7480 check inter 2000 rise 2 fall 5']}})  2026-04-28 04:49:07.978246 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:49:07.978258 | orchestrator | 2026-04-28 04:49:07.978277 | orchestrator | TASK [proxysql-config : Copying over ceph-rgw ProxySQL users config] *********** 2026-04-28 04:49:07.978308 | orchestrator | Tuesday 28 April 2026 04:49:01 +0000 (0:00:01.844) 0:01:32.653 ********* 2026-04-28 04:49:07.978329 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:49:07.978349 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:49:07.978366 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:49:07.978379 | orchestrator | 2026-04-28 04:49:07.978392 | orchestrator | TASK [proxysql-config : Copying over ceph-rgw ProxySQL rules config] *********** 2026-04-28 04:49:07.978423 | orchestrator | Tuesday 28 April 2026 04:49:02 +0000 (0:00:00.759) 0:01:33.413 ********* 2026-04-28 04:49:07.978436 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:49:07.978450 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:49:07.978462 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:49:07.978475 | orchestrator | 2026-04-28 04:49:07.978488 | orchestrator | TASK [include_role : cinder] *************************************************** 2026-04-28 04:49:07.978501 | orchestrator | Tuesday 28 April 2026 04:49:03 +0000 (0:00:01.339) 0:01:34.753 ********* 2026-04-28 04:49:07.978513 | orchestrator | included: cinder for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:49:07.978526 | orchestrator | 2026-04-28 04:49:07.978538 | orchestrator | TASK [haproxy-config : Copying over cinder haproxy config] ********************* 2026-04-28 04:49:07.978551 | orchestrator | Tuesday 28 April 2026 04:49:04 +0000 (0:00:00.801) 0:01:35.554 ********* 2026-04-28 04:49:07.978567 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:49:07.978584 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 04:49:07.978600 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 04:49:07.978615 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 04:49:07.978677 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:49:09.654771 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 04:49:09.654927 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 04:49:09.654956 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 04:49:09.654978 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:49:09.655018 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 04:49:09.655059 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 04:49:09.655072 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 04:49:09.655084 | orchestrator | 2026-04-28 04:49:09.655098 | orchestrator | TASK [haproxy-config : Add configuration for cinder when using single external frontend] *** 2026-04-28 04:49:09.655110 | orchestrator | Tuesday 28 April 2026 04:49:09 +0000 (0:00:04.899) 0:01:40.454 ********* 2026-04-28 04:49:09.655123 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:49:09.655144 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 04:49:09.655156 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 04:49:09.655180 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 04:49:10.696984 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:49:10.697108 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:49:10.697141 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 04:49:10.697195 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 04:49:10.697215 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 04:49:10.697235 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:49:10.697297 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:49:10.697321 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 04:49:10.697338 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 04:49:10.697366 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 04:49:10.697388 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:49:10.697405 | orchestrator | 2026-04-28 04:49:10.697424 | orchestrator | TASK [haproxy-config : Configuring firewall for cinder] ************************ 2026-04-28 04:49:10.697442 | orchestrator | Tuesday 28 April 2026 04:49:09 +0000 (0:00:00.846) 0:01:41.300 ********* 2026-04-28 04:49:10.697461 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:49:10.697484 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:49:10.697503 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:49:10.697521 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:49:10.697540 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:49:10.697559 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:49:10.697579 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:49:10.697627 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:49:20.415656 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:49:20.415808 | orchestrator | 2026-04-28 04:49:20.415823 | orchestrator | TASK [proxysql-config : Copying over cinder ProxySQL users config] ************* 2026-04-28 04:49:20.415836 | orchestrator | Tuesday 28 April 2026 04:49:11 +0000 (0:00:01.103) 0:01:42.404 ********* 2026-04-28 04:49:20.415845 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:49:20.415855 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:49:20.415864 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:49:20.415873 | orchestrator | 2026-04-28 04:49:20.415942 | orchestrator | TASK [proxysql-config : Copying over cinder ProxySQL rules config] ************* 2026-04-28 04:49:20.415952 | orchestrator | Tuesday 28 April 2026 04:49:12 +0000 (0:00:01.535) 0:01:43.940 ********* 2026-04-28 04:49:20.415961 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:49:20.415969 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:49:20.415978 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:49:20.415987 | orchestrator | 2026-04-28 04:49:20.415996 | orchestrator | TASK [include_role : cloudkitty] *********************************************** 2026-04-28 04:49:20.416031 | orchestrator | Tuesday 28 April 2026 04:49:14 +0000 (0:00:02.285) 0:01:46.225 ********* 2026-04-28 04:49:20.416040 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:49:20.416049 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:49:20.416057 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:49:20.416066 | orchestrator | 2026-04-28 04:49:20.416075 | orchestrator | TASK [include_role : cyborg] *************************************************** 2026-04-28 04:49:20.416083 | orchestrator | Tuesday 28 April 2026 04:49:15 +0000 (0:00:00.384) 0:01:46.610 ********* 2026-04-28 04:49:20.416092 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:49:20.416100 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:49:20.416109 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:49:20.416117 | orchestrator | 2026-04-28 04:49:20.416126 | orchestrator | TASK [include_role : designate] ************************************************ 2026-04-28 04:49:20.416134 | orchestrator | Tuesday 28 April 2026 04:49:15 +0000 (0:00:00.328) 0:01:46.938 ********* 2026-04-28 04:49:20.416143 | orchestrator | included: designate for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:49:20.416151 | orchestrator | 2026-04-28 04:49:20.416160 | orchestrator | TASK [haproxy-config : Copying over designate haproxy config] ****************** 2026-04-28 04:49:20.416168 | orchestrator | Tuesday 28 April 2026 04:49:16 +0000 (0:00:01.114) 0:01:48.052 ********* 2026-04-28 04:49:20.416184 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:49:20.416198 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:49:20.416249 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 04:49:20.416269 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 04:49:20.416279 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 04:49:20.416291 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 04:49:20.416300 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 04:49:20.416310 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 04:49:20.416323 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 04:49:20.416348 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 04:49:21.266582 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 04:49:21.266724 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 04:49:21.266742 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-sink:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-28 04:49:21.266756 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-sink:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-28 04:49:21.266796 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:49:21.266871 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 04:49:21.266930 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 04:49:21.266951 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 04:49:21.266970 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 04:49:21.266988 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 04:49:21.267007 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-sink:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-28 04:49:21.267040 | orchestrator | 2026-04-28 04:49:21.267073 | orchestrator | TASK [haproxy-config : Add configuration for designate when using single external frontend] *** 2026-04-28 04:49:21.267095 | orchestrator | Tuesday 28 April 2026 04:49:20 +0000 (0:00:04.005) 0:01:52.057 ********* 2026-04-28 04:49:21.267129 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:49:21.434936 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 04:49:21.435060 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 04:49:21.435084 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 04:49:21.435102 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 04:49:21.435148 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 04:49:21.435188 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:49:21.435208 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-sink:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-28 04:49:21.435226 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:49:21.435287 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 04:49:21.435307 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 04:49:21.435323 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 04:49:21.435360 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 04:49:21.435378 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 04:49:21.435405 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-sink:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-28 04:49:32.818445 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:49:32.818567 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:49:32.818591 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 04:49:32.818627 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 04:49:32.818648 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 04:49:32.818660 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 04:49:32.818690 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 04:49:32.818702 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-sink', 'value': {'container_name': 'designate_sink', 'group': 'designate-sink', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-sink:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-sink/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-sink 5672'], 'timeout': '30'}}})  2026-04-28 04:49:32.818714 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:49:32.818726 | orchestrator | 2026-04-28 04:49:32.818738 | orchestrator | TASK [haproxy-config : Configuring firewall for designate] ********************* 2026-04-28 04:49:32.818751 | orchestrator | Tuesday 28 April 2026 04:49:21 +0000 (0:00:01.215) 0:01:53.273 ********* 2026-04-28 04:49:32.818763 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:49:32.818778 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:49:32.818799 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:49:32.818811 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:49:32.818822 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:49:32.818833 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:49:32.818844 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:49:32.818860 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:49:32.818872 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:49:32.818882 | orchestrator | 2026-04-28 04:49:32.818919 | orchestrator | TASK [proxysql-config : Copying over designate ProxySQL users config] ********** 2026-04-28 04:49:32.818930 | orchestrator | Tuesday 28 April 2026 04:49:23 +0000 (0:00:01.462) 0:01:54.736 ********* 2026-04-28 04:49:32.818941 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:49:32.818953 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:49:32.818964 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:49:32.818974 | orchestrator | 2026-04-28 04:49:32.818985 | orchestrator | TASK [proxysql-config : Copying over designate ProxySQL rules config] ********** 2026-04-28 04:49:32.818996 | orchestrator | Tuesday 28 April 2026 04:49:24 +0000 (0:00:01.174) 0:01:55.910 ********* 2026-04-28 04:49:32.819007 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:49:32.819017 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:49:32.819028 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:49:32.819038 | orchestrator | 2026-04-28 04:49:32.819049 | orchestrator | TASK [include_role : etcd] ***************************************************** 2026-04-28 04:49:32.819060 | orchestrator | Tuesday 28 April 2026 04:49:26 +0000 (0:00:02.187) 0:01:58.097 ********* 2026-04-28 04:49:32.819071 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:49:32.819082 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:49:32.819092 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:49:32.819103 | orchestrator | 2026-04-28 04:49:32.819114 | orchestrator | TASK [include_role : glance] *************************************************** 2026-04-28 04:49:32.819125 | orchestrator | Tuesday 28 April 2026 04:49:27 +0000 (0:00:00.628) 0:01:58.725 ********* 2026-04-28 04:49:32.819135 | orchestrator | included: glance for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:49:32.819146 | orchestrator | 2026-04-28 04:49:32.819157 | orchestrator | TASK [haproxy-config : Copying over glance haproxy config] ********************* 2026-04-28 04:49:32.819168 | orchestrator | Tuesday 28 April 2026 04:49:28 +0000 (0:00:00.896) 0:01:59.622 ********* 2026-04-28 04:49:32.819190 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 04:49:33.038567 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/glance-tls-proxy:30.1.1.20260328', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-28 04:49:33.038667 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 04:49:33.038712 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/glance-tls-proxy:30.1.1.20260328', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-28 04:49:33.038721 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 04:49:33.038741 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/glance-tls-proxy:30.1.1.20260328', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-28 04:49:37.160949 | orchestrator | 2026-04-28 04:49:37.161014 | orchestrator | TASK [haproxy-config : Add configuration for glance when using single external frontend] *** 2026-04-28 04:49:37.161021 | orchestrator | Tuesday 28 April 2026 04:49:33 +0000 (0:00:04.853) 0:02:04.476 ********* 2026-04-28 04:49:37.161028 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-28 04:49:37.161049 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/glance-tls-proxy:30.1.1.20260328', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-28 04:49:37.161058 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:49:37.161073 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-28 04:49:37.161082 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/glance-tls-proxy:30.1.1.20260328', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-28 04:49:37.161086 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:49:37.161096 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-28 04:49:49.707671 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-tls-proxy', 'value': {'container_name': 'glance_tls_proxy', 'group': 'glance-api', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/glance-tls-proxy:30.1.1.20260328', 'volumes': ['/etc/kolla/glance-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9293'], 'timeout': '30'}, 'haproxy': {'glance_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}, 'glance_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5 ssl verify required ca-file ca-certificates.crt', ''], 'tls_backend': 'yes'}}}})  2026-04-28 04:49:49.707820 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:49:49.707842 | orchestrator | 2026-04-28 04:49:49.707856 | orchestrator | TASK [haproxy-config : Configuring firewall for glance] ************************ 2026-04-28 04:49:49.707871 | orchestrator | Tuesday 28 April 2026 04:49:37 +0000 (0:00:04.121) 0:02:08.597 ********* 2026-04-28 04:49:49.708003 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-28 04:49:49.708026 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-28 04:49:49.708040 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:49:49.708053 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-28 04:49:49.708088 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-28 04:49:49.708113 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:49:49.708125 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-28 04:49:49.708139 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}})  2026-04-28 04:49:49.708151 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:49:49.708164 | orchestrator | 2026-04-28 04:49:49.708178 | orchestrator | TASK [proxysql-config : Copying over glance ProxySQL users config] ************* 2026-04-28 04:49:49.708191 | orchestrator | Tuesday 28 April 2026 04:49:41 +0000 (0:00:03.836) 0:02:12.434 ********* 2026-04-28 04:49:49.708207 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:49:49.708220 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:49:49.708233 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:49:49.708246 | orchestrator | 2026-04-28 04:49:49.708259 | orchestrator | TASK [proxysql-config : Copying over glance ProxySQL rules config] ************* 2026-04-28 04:49:49.708272 | orchestrator | Tuesday 28 April 2026 04:49:42 +0000 (0:00:01.478) 0:02:13.913 ********* 2026-04-28 04:49:49.708285 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:49:49.708299 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:49:49.708314 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:49:49.708326 | orchestrator | 2026-04-28 04:49:49.708340 | orchestrator | TASK [include_role : gnocchi] ************************************************** 2026-04-28 04:49:49.708352 | orchestrator | Tuesday 28 April 2026 04:49:44 +0000 (0:00:02.296) 0:02:16.209 ********* 2026-04-28 04:49:49.708366 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:49:49.708380 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:49:49.708394 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:49:49.708408 | orchestrator | 2026-04-28 04:49:49.708421 | orchestrator | TASK [include_role : grafana] ************************************************** 2026-04-28 04:49:49.708435 | orchestrator | Tuesday 28 April 2026 04:49:45 +0000 (0:00:00.418) 0:02:16.628 ********* 2026-04-28 04:49:49.708448 | orchestrator | included: grafana for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:49:49.708462 | orchestrator | 2026-04-28 04:49:49.708475 | orchestrator | TASK [haproxy-config : Copying over grafana haproxy config] ******************** 2026-04-28 04:49:49.708489 | orchestrator | Tuesday 28 April 2026 04:49:46 +0000 (0:00:01.231) 0:02:17.859 ********* 2026-04-28 04:49:49.708512 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:49:49.708544 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:50:00.360999 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:50:00.361095 | orchestrator | 2026-04-28 04:50:00.361105 | orchestrator | TASK [haproxy-config : Add configuration for grafana when using single external frontend] *** 2026-04-28 04:50:00.361111 | orchestrator | Tuesday 28 April 2026 04:49:50 +0000 (0:00:03.637) 0:02:21.497 ********* 2026-04-28 04:50:00.361118 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:50:00.361123 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:50:00.361129 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:50:00.361136 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:50:00.361145 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:50:00.361172 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:50:00.361178 | orchestrator | 2026-04-28 04:50:00.361183 | orchestrator | TASK [haproxy-config : Configuring firewall for grafana] *********************** 2026-04-28 04:50:00.361188 | orchestrator | Tuesday 28 April 2026 04:49:50 +0000 (0:00:00.423) 0:02:21.920 ********* 2026-04-28 04:50:00.361194 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana_server', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:50:00.361235 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:50:00.361247 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:50:00.361269 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana_server', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:50:00.361274 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:50:00.361279 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:50:00.361284 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana_server', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:50:00.361290 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:50:00.361295 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:50:00.361300 | orchestrator | 2026-04-28 04:50:00.361305 | orchestrator | TASK [proxysql-config : Copying over grafana ProxySQL users config] ************ 2026-04-28 04:50:00.361309 | orchestrator | Tuesday 28 April 2026 04:49:51 +0000 (0:00:01.001) 0:02:22.922 ********* 2026-04-28 04:50:00.361314 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:50:00.361320 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:50:00.361325 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:50:00.361330 | orchestrator | 2026-04-28 04:50:00.361335 | orchestrator | TASK [proxysql-config : Copying over grafana ProxySQL rules config] ************ 2026-04-28 04:50:00.361339 | orchestrator | Tuesday 28 April 2026 04:49:52 +0000 (0:00:01.246) 0:02:24.169 ********* 2026-04-28 04:50:00.361344 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:50:00.361349 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:50:00.361354 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:50:00.361358 | orchestrator | 2026-04-28 04:50:00.361363 | orchestrator | TASK [include_role : heat] ***************************************************** 2026-04-28 04:50:00.361368 | orchestrator | Tuesday 28 April 2026 04:49:55 +0000 (0:00:02.351) 0:02:26.520 ********* 2026-04-28 04:50:00.361373 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:50:00.361378 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:50:00.361383 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:50:00.361392 | orchestrator | 2026-04-28 04:50:00.361397 | orchestrator | TASK [include_role : horizon] ************************************************** 2026-04-28 04:50:00.361402 | orchestrator | Tuesday 28 April 2026 04:49:55 +0000 (0:00:00.411) 0:02:26.931 ********* 2026-04-28 04:50:00.361407 | orchestrator | included: horizon for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:50:00.361412 | orchestrator | 2026-04-28 04:50:00.361417 | orchestrator | TASK [haproxy-config : Copying over horizon haproxy config] ******************** 2026-04-28 04:50:00.361422 | orchestrator | Tuesday 28 April 2026 04:49:56 +0000 (0:00:01.225) 0:02:28.157 ********* 2026-04-28 04:50:00.361438 | orchestrator | changed: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 04:50:01.688153 | orchestrator | changed: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 04:50:01.688298 | orchestrator | changed: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 04:50:01.688318 | orchestrator | 2026-04-28 04:50:01.688333 | orchestrator | TASK [haproxy-config : Add configuration for horizon when using single external frontend] *** 2026-04-28 04:50:01.688346 | orchestrator | Tuesday 28 April 2026 04:50:01 +0000 (0:00:04.352) 0:02:32.510 ********* 2026-04-28 04:50:01.688366 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-28 04:50:01.688387 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:50:01.688411 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-28 04:50:08.044012 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:50:08.044133 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-28 04:50:08.044153 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:50:08.044164 | orchestrator | 2026-04-28 04:50:08.044174 | orchestrator | TASK [haproxy-config : Configuring firewall for horizon] *********************** 2026-04-28 04:50:08.044185 | orchestrator | Tuesday 28 April 2026 04:50:02 +0000 (0:00:01.026) 0:02:33.537 ********* 2026-04-28 04:50:08.044196 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}})  2026-04-28 04:50:08.044210 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-28 04:50:08.044222 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}})  2026-04-28 04:50:08.044234 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon_external_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-28 04:50:08.044264 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'acme_client', 'value': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}})  2026-04-28 04:50:08.044276 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:50:08.044303 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}})  2026-04-28 04:50:08.044314 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-28 04:50:08.044324 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}})  2026-04-28 04:50:08.044340 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon_external_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-28 04:50:08.044350 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'acme_client', 'value': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}})  2026-04-28 04:50:08.044360 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:50:08.044370 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}})  2026-04-28 04:50:08.044380 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-28 04:50:08.044391 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}})  2026-04-28 04:50:08.044401 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon_external_redirect', 'value': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}})  2026-04-28 04:50:08.044411 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'acme_client', 'value': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}})  2026-04-28 04:50:08.044421 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:50:08.044430 | orchestrator | 2026-04-28 04:50:08.044440 | orchestrator | TASK [proxysql-config : Copying over horizon ProxySQL users config] ************ 2026-04-28 04:50:08.044450 | orchestrator | Tuesday 28 April 2026 04:50:03 +0000 (0:00:01.402) 0:02:34.939 ********* 2026-04-28 04:50:08.044460 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:50:08.044478 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:50:08.044513 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:50:08.044526 | orchestrator | 2026-04-28 04:50:08.044538 | orchestrator | TASK [proxysql-config : Copying over horizon ProxySQL rules config] ************ 2026-04-28 04:50:08.044549 | orchestrator | Tuesday 28 April 2026 04:50:04 +0000 (0:00:01.237) 0:02:36.177 ********* 2026-04-28 04:50:08.044561 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:50:08.044572 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:50:08.044583 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:50:08.044595 | orchestrator | 2026-04-28 04:50:08.044606 | orchestrator | TASK [include_role : influxdb] ************************************************* 2026-04-28 04:50:08.044617 | orchestrator | Tuesday 28 April 2026 04:50:07 +0000 (0:00:02.278) 0:02:38.456 ********* 2026-04-28 04:50:08.044629 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:50:08.044640 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:50:08.044651 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:50:08.044666 | orchestrator | 2026-04-28 04:50:08.044683 | orchestrator | TASK [include_role : ironic] *************************************************** 2026-04-28 04:50:08.044700 | orchestrator | Tuesday 28 April 2026 04:50:07 +0000 (0:00:00.716) 0:02:39.172 ********* 2026-04-28 04:50:08.044726 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:50:14.121754 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:50:14.121838 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:50:14.121862 | orchestrator | 2026-04-28 04:50:14.121881 | orchestrator | TASK [include_role : keystone] ************************************************* 2026-04-28 04:50:14.121894 | orchestrator | Tuesday 28 April 2026 04:50:08 +0000 (0:00:00.534) 0:02:39.707 ********* 2026-04-28 04:50:14.121905 | orchestrator | included: keystone for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:50:14.121948 | orchestrator | 2026-04-28 04:50:14.121961 | orchestrator | TASK [haproxy-config : Copying over keystone haproxy config] ******************* 2026-04-28 04:50:14.121972 | orchestrator | Tuesday 28 April 2026 04:50:09 +0000 (0:00:01.053) 0:02:40.760 ********* 2026-04-28 04:50:14.122006 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-28 04:50:14.122090 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 04:50:14.122105 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 04:50:14.122143 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-28 04:50:14.122175 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 04:50:14.122198 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 04:50:14.122230 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-28 04:50:14.122253 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 04:50:14.122286 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 04:50:14.122308 | orchestrator | 2026-04-28 04:50:14.122328 | orchestrator | TASK [haproxy-config : Add configuration for keystone when using single external frontend] *** 2026-04-28 04:50:14.122345 | orchestrator | Tuesday 28 April 2026 04:50:13 +0000 (0:00:04.312) 0:02:45.073 ********* 2026-04-28 04:50:14.122368 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-28 04:50:15.858431 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 04:50:15.858525 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 04:50:15.858554 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:50:15.858566 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-28 04:50:15.858602 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 04:50:15.858631 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-28 04:50:15.858649 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 04:50:15.858660 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:50:15.858671 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 04:50:15.858689 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 04:50:15.858697 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:50:15.858716 | orchestrator | 2026-04-28 04:50:15.858728 | orchestrator | TASK [haproxy-config : Configuring firewall for keystone] ********************** 2026-04-28 04:50:15.858740 | orchestrator | Tuesday 28 April 2026 04:50:14 +0000 (0:00:00.789) 0:02:45.863 ********* 2026-04-28 04:50:15.858752 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone_internal', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}})  2026-04-28 04:50:15.858766 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}})  2026-04-28 04:50:15.858779 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:50:15.858789 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone_internal', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}})  2026-04-28 04:50:15.858800 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}})  2026-04-28 04:50:15.858811 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:50:15.858821 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone_internal', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}})  2026-04-28 04:50:15.858832 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}})  2026-04-28 04:50:15.858840 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:50:15.858846 | orchestrator | 2026-04-28 04:50:15.858852 | orchestrator | TASK [proxysql-config : Copying over keystone ProxySQL users config] *********** 2026-04-28 04:50:15.858865 | orchestrator | Tuesday 28 April 2026 04:50:15 +0000 (0:00:01.318) 0:02:47.181 ********* 2026-04-28 04:50:25.831237 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:50:25.831365 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:50:25.831374 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:50:25.831383 | orchestrator | 2026-04-28 04:50:25.831392 | orchestrator | TASK [proxysql-config : Copying over keystone ProxySQL rules config] *********** 2026-04-28 04:50:25.831401 | orchestrator | Tuesday 28 April 2026 04:50:17 +0000 (0:00:01.374) 0:02:48.555 ********* 2026-04-28 04:50:25.831408 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:50:25.831416 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:50:25.831423 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:50:25.831430 | orchestrator | 2026-04-28 04:50:25.831470 | orchestrator | TASK [include_role : letsencrypt] ********************************************** 2026-04-28 04:50:25.831496 | orchestrator | Tuesday 28 April 2026 04:50:19 +0000 (0:00:02.405) 0:02:50.961 ********* 2026-04-28 04:50:25.831503 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:50:25.831512 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:50:25.831519 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:50:25.831526 | orchestrator | 2026-04-28 04:50:25.831533 | orchestrator | TASK [include_role : magnum] *************************************************** 2026-04-28 04:50:25.831540 | orchestrator | Tuesday 28 April 2026 04:50:20 +0000 (0:00:00.379) 0:02:51.341 ********* 2026-04-28 04:50:25.831547 | orchestrator | included: magnum for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:50:25.831554 | orchestrator | 2026-04-28 04:50:25.831561 | orchestrator | TASK [haproxy-config : Copying over magnum haproxy config] ********************* 2026-04-28 04:50:25.831568 | orchestrator | Tuesday 28 April 2026 04:50:21 +0000 (0:00:01.530) 0:02:52.871 ********* 2026-04-28 04:50:25.831582 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:50:25.831594 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 04:50:25.831603 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:50:25.831636 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 04:50:25.831652 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:50:25.831660 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 04:50:25.831668 | orchestrator | 2026-04-28 04:50:25.831675 | orchestrator | TASK [haproxy-config : Add configuration for magnum when using single external frontend] *** 2026-04-28 04:50:25.831683 | orchestrator | Tuesday 28 April 2026 04:50:25 +0000 (0:00:03.900) 0:02:56.771 ********* 2026-04-28 04:50:25.831690 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:50:25.831704 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 04:50:35.849076 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:50:35.849180 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:50:35.849197 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 04:50:35.849207 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:50:35.849267 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:50:35.849284 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 04:50:35.849322 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:50:35.849337 | orchestrator | 2026-04-28 04:50:35.849354 | orchestrator | TASK [haproxy-config : Configuring firewall for magnum] ************************ 2026-04-28 04:50:35.849364 | orchestrator | Tuesday 28 April 2026 04:50:26 +0000 (0:00:00.733) 0:02:57.505 ********* 2026-04-28 04:50:35.849391 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:50:35.849403 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:50:35.849419 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:50:35.849427 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:50:35.849435 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:50:35.849443 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:50:35.849451 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:50:35.849459 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:50:35.849467 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:50:35.849475 | orchestrator | 2026-04-28 04:50:35.849483 | orchestrator | TASK [proxysql-config : Copying over magnum ProxySQL users config] ************* 2026-04-28 04:50:35.849491 | orchestrator | Tuesday 28 April 2026 04:50:27 +0000 (0:00:01.657) 0:02:59.162 ********* 2026-04-28 04:50:35.849499 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:50:35.849508 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:50:35.849515 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:50:35.849523 | orchestrator | 2026-04-28 04:50:35.849531 | orchestrator | TASK [proxysql-config : Copying over magnum ProxySQL rules config] ************* 2026-04-28 04:50:35.849539 | orchestrator | Tuesday 28 April 2026 04:50:29 +0000 (0:00:01.201) 0:03:00.364 ********* 2026-04-28 04:50:35.849546 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:50:35.849554 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:50:35.849562 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:50:35.849571 | orchestrator | 2026-04-28 04:50:35.849580 | orchestrator | TASK [include_role : manila] *************************************************** 2026-04-28 04:50:35.849589 | orchestrator | Tuesday 28 April 2026 04:50:31 +0000 (0:00:02.115) 0:03:02.480 ********* 2026-04-28 04:50:35.849598 | orchestrator | included: manila for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:50:35.849607 | orchestrator | 2026-04-28 04:50:35.849615 | orchestrator | TASK [haproxy-config : Copying over manila haproxy config] ********************* 2026-04-28 04:50:35.849624 | orchestrator | Tuesday 28 April 2026 04:50:32 +0000 (0:00:01.327) 0:03:03.807 ********* 2026-04-28 04:50:35.849635 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:50:35.849653 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 04:50:35.849676 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 04:50:36.781498 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 04:50:36.781596 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:50:36.781611 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 04:50:36.781647 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 04:50:36.781659 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 04:50:36.781703 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:50:36.781716 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 04:50:36.781727 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 04:50:36.781746 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 04:50:36.781758 | orchestrator | 2026-04-28 04:50:36.781771 | orchestrator | TASK [haproxy-config : Add configuration for manila when using single external frontend] *** 2026-04-28 04:50:36.781783 | orchestrator | Tuesday 28 April 2026 04:50:36 +0000 (0:00:03.952) 0:03:07.760 ********* 2026-04-28 04:50:36.781796 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:50:36.781820 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 04:50:37.926350 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 04:50:37.926451 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 04:50:37.926473 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:50:37.926526 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:50:37.926546 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 04:50:37.926564 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 04:50:37.926619 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 04:50:37.926639 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:50:37.926656 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:50:37.926685 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 04:50:37.926701 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 04:50:37.926719 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 04:50:37.926734 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:50:37.926749 | orchestrator | 2026-04-28 04:50:37.926766 | orchestrator | TASK [haproxy-config : Configuring firewall for manila] ************************ 2026-04-28 04:50:37.926784 | orchestrator | Tuesday 28 April 2026 04:50:37 +0000 (0:00:00.719) 0:03:08.479 ********* 2026-04-28 04:50:37.926802 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:50:37.926823 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:50:37.926841 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:50:37.926867 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:50:37.926899 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:50:49.447233 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:50:49.447340 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:50:49.447358 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:50:49.447392 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:50:49.447403 | orchestrator | 2026-04-28 04:50:49.447413 | orchestrator | TASK [proxysql-config : Copying over manila ProxySQL users config] ************* 2026-04-28 04:50:49.447424 | orchestrator | Tuesday 28 April 2026 04:50:38 +0000 (0:00:01.300) 0:03:09.780 ********* 2026-04-28 04:50:49.447434 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:50:49.447444 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:50:49.447454 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:50:49.447463 | orchestrator | 2026-04-28 04:50:49.447473 | orchestrator | TASK [proxysql-config : Copying over manila ProxySQL rules config] ************* 2026-04-28 04:50:49.447483 | orchestrator | Tuesday 28 April 2026 04:50:39 +0000 (0:00:01.274) 0:03:11.055 ********* 2026-04-28 04:50:49.447493 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:50:49.447502 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:50:49.447512 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:50:49.447521 | orchestrator | 2026-04-28 04:50:49.447531 | orchestrator | TASK [include_role : mariadb] ************************************************** 2026-04-28 04:50:49.447541 | orchestrator | Tuesday 28 April 2026 04:50:41 +0000 (0:00:02.263) 0:03:13.318 ********* 2026-04-28 04:50:49.447550 | orchestrator | included: mariadb for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:50:49.447560 | orchestrator | 2026-04-28 04:50:49.447570 | orchestrator | TASK [mariadb : Ensure mysql monitor user exist] ******************************* 2026-04-28 04:50:49.447579 | orchestrator | Tuesday 28 April 2026 04:50:43 +0000 (0:00:01.755) 0:03:15.074 ********* 2026-04-28 04:50:49.447589 | orchestrator | changed: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 04:50:49.447599 | orchestrator | 2026-04-28 04:50:49.447609 | orchestrator | TASK [haproxy-config : Copying over mariadb haproxy config] ******************** 2026-04-28 04:50:49.447618 | orchestrator | Tuesday 28 April 2026 04:50:46 +0000 (0:00:03.224) 0:03:18.299 ********* 2026-04-28 04:50:49.447633 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 04:50:49.447677 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-clustercheck:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-28 04:50:49.447697 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:50:49.447708 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 04:50:49.447719 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-clustercheck:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-28 04:50:49.447730 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:50:49.447752 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 04:50:52.306612 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-clustercheck:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-28 04:50:52.306732 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:50:52.306750 | orchestrator | 2026-04-28 04:50:52.306762 | orchestrator | TASK [haproxy-config : Add configuration for mariadb when using single external frontend] *** 2026-04-28 04:50:52.306773 | orchestrator | Tuesday 28 April 2026 04:50:49 +0000 (0:00:02.569) 0:03:20.869 ********* 2026-04-28 04:50:52.306787 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 04:50:52.306815 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-clustercheck:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-28 04:50:52.306847 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:50:52.306878 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 04:50:52.306891 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-clustercheck:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-28 04:50:52.306901 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:50:52.306916 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 04:50:52.306978 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb-clustercheck', 'value': {'container_name': 'mariadb_clustercheck', 'group': 'mariadb_shard_0', 'enabled': False, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-clustercheck:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb-clustercheck/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}}})  2026-04-28 04:51:03.198885 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:51:03.199059 | orchestrator | 2026-04-28 04:51:03.199079 | orchestrator | TASK [haproxy-config : Configuring firewall for mariadb] *********************** 2026-04-28 04:51:03.199092 | orchestrator | Tuesday 28 April 2026 04:50:52 +0000 (0:00:03.161) 0:03:24.030 ********* 2026-04-28 04:51:03.199107 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-28 04:51:03.199124 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb_external_lb', 'value': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-28 04:51:03.199136 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:51:03.199148 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-28 04:51:03.199160 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb_external_lb', 'value': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-28 04:51:03.199196 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:51:03.199223 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-28 04:51:03.199235 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb_external_lb', 'value': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}})  2026-04-28 04:51:03.199246 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:51:03.199257 | orchestrator | 2026-04-28 04:51:03.199268 | orchestrator | TASK [proxysql-config : Copying over mariadb ProxySQL users config] ************ 2026-04-28 04:51:03.199279 | orchestrator | Tuesday 28 April 2026 04:50:55 +0000 (0:00:02.995) 0:03:27.026 ********* 2026-04-28 04:51:03.199290 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:51:03.199320 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:51:03.199333 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:51:03.199343 | orchestrator | 2026-04-28 04:51:03.199354 | orchestrator | TASK [proxysql-config : Copying over mariadb ProxySQL rules config] ************ 2026-04-28 04:51:03.199365 | orchestrator | Tuesday 28 April 2026 04:50:57 +0000 (0:00:02.066) 0:03:29.093 ********* 2026-04-28 04:51:03.199377 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:51:03.199388 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:51:03.199399 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:51:03.199410 | orchestrator | 2026-04-28 04:51:03.199423 | orchestrator | TASK [include_role : masakari] ************************************************* 2026-04-28 04:51:03.199436 | orchestrator | Tuesday 28 April 2026 04:50:59 +0000 (0:00:01.637) 0:03:30.730 ********* 2026-04-28 04:51:03.199449 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:51:03.199462 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:51:03.199474 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:51:03.199486 | orchestrator | 2026-04-28 04:51:03.199498 | orchestrator | TASK [include_role : memcached] ************************************************ 2026-04-28 04:51:03.199511 | orchestrator | Tuesday 28 April 2026 04:51:00 +0000 (0:00:00.608) 0:03:31.338 ********* 2026-04-28 04:51:03.199523 | orchestrator | included: memcached for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:51:03.199536 | orchestrator | 2026-04-28 04:51:03.199549 | orchestrator | TASK [haproxy-config : Copying over memcached haproxy config] ****************** 2026-04-28 04:51:03.199562 | orchestrator | Tuesday 28 April 2026 04:51:01 +0000 (0:00:01.189) 0:03:32.527 ********* 2026-04-28 04:51:03.199576 | orchestrator | ok: [testbed-node-0] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-28 04:51:03.199600 | orchestrator | ok: [testbed-node-1] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-28 04:51:03.199620 | orchestrator | ok: [testbed-node-2] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-28 04:51:03.199634 | orchestrator | 2026-04-28 04:51:03.199647 | orchestrator | TASK [haproxy-config : Add configuration for memcached when using single external frontend] *** 2026-04-28 04:51:03.199660 | orchestrator | Tuesday 28 April 2026 04:51:03 +0000 (0:00:01.855) 0:03:34.383 ********* 2026-04-28 04:51:03.199682 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-28 04:51:12.090199 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-28 04:51:12.090294 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:51:12.090306 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:51:12.090314 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-28 04:51:12.090341 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:51:12.090350 | orchestrator | 2026-04-28 04:51:12.090358 | orchestrator | TASK [haproxy-config : Configuring firewall for memcached] ********************* 2026-04-28 04:51:12.090366 | orchestrator | Tuesday 28 April 2026 04:51:03 +0000 (0:00:00.427) 0:03:34.810 ********* 2026-04-28 04:51:12.090375 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'memcached', 'value': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}})  2026-04-28 04:51:12.090383 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:51:12.090391 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'memcached', 'value': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}})  2026-04-28 04:51:12.090398 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:51:12.090405 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'memcached', 'value': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}})  2026-04-28 04:51:12.090411 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:51:12.090417 | orchestrator | 2026-04-28 04:51:12.090424 | orchestrator | TASK [proxysql-config : Copying over memcached ProxySQL users config] ********** 2026-04-28 04:51:12.090442 | orchestrator | Tuesday 28 April 2026 04:51:04 +0000 (0:00:00.689) 0:03:35.500 ********* 2026-04-28 04:51:12.090449 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:51:12.090455 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:51:12.090461 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:51:12.090467 | orchestrator | 2026-04-28 04:51:12.090473 | orchestrator | TASK [proxysql-config : Copying over memcached ProxySQL rules config] ********** 2026-04-28 04:51:12.090480 | orchestrator | Tuesday 28 April 2026 04:51:04 +0000 (0:00:00.796) 0:03:36.296 ********* 2026-04-28 04:51:12.090486 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:51:12.090493 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:51:12.090500 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:51:12.090506 | orchestrator | 2026-04-28 04:51:12.090512 | orchestrator | TASK [include_role : mistral] ************************************************** 2026-04-28 04:51:12.090518 | orchestrator | Tuesday 28 April 2026 04:51:06 +0000 (0:00:01.374) 0:03:37.671 ********* 2026-04-28 04:51:12.090525 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:51:12.090531 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:51:12.090537 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:51:12.090543 | orchestrator | 2026-04-28 04:51:12.090549 | orchestrator | TASK [include_role : neutron] ************************************************** 2026-04-28 04:51:12.090555 | orchestrator | Tuesday 28 April 2026 04:51:06 +0000 (0:00:00.348) 0:03:38.020 ********* 2026-04-28 04:51:12.090561 | orchestrator | included: neutron for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:51:12.090567 | orchestrator | 2026-04-28 04:51:12.090573 | orchestrator | TASK [haproxy-config : Copying over neutron haproxy config] ******************** 2026-04-28 04:51:12.090579 | orchestrator | Tuesday 28 April 2026 04:51:08 +0000 (0:00:01.419) 0:03:39.439 ********* 2026-04-28 04:51:12.090603 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:51:12.090619 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-openvswitch-agent:26.0.3.20260328', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:12.090627 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-dhcp-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}, 'pid_mode': '', 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'KOLLA_NAME': 'neutron_dhcp_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}}})  2026-04-28 04:51:12.090636 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-l3-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'KOLLA_LEGACY_IPTABLES': 'false', 'KOLLA_NAME': 'neutron_l3_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}, 'pid_mode': ''}})  2026-04-28 04:51:12.090675 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-sriov-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:12.329877 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-mlnx-agent:26.0.3.20260328', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-28 04:51:12.329969 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-eswitchd:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-28 04:51:12.329978 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 04:51:12.329986 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 04:51:12.330005 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-bgp-dragent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:12.330011 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-infoblox-ipam-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}}})  2026-04-28 04:51:12.330082 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metering-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-28 04:51:12.330089 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/ironic-neutron-agent:26.0.3.20260328', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:12.330095 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-tls-proxy:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-28 04:51:12.330105 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/2025.1/neutron-ovn-agent:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-28 04:51:12.330110 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:51:12.330123 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-openvswitch-agent:26.0.3.20260328', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:12.524317 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-dhcp-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}, 'pid_mode': '', 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'KOLLA_NAME': 'neutron_dhcp_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}}})  2026-04-28 04:51:12.524444 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-l3-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'KOLLA_LEGACY_IPTABLES': 'false', 'KOLLA_NAME': 'neutron_l3_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}, 'pid_mode': ''}})  2026-04-28 04:51:12.524493 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-sriov-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:12.524515 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-mlnx-agent:26.0.3.20260328', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-28 04:51:12.524560 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-eswitchd:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-28 04:51:12.524604 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 04:51:12.524624 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 04:51:12.524643 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-bgp-dragent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:12.524709 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:51:12.524730 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-infoblox-ipam-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}}})  2026-04-28 04:51:12.524760 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metering-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-28 04:51:12.524792 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-openvswitch-agent:26.0.3.20260328', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:12.672879 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/ironic-neutron-agent:26.0.3.20260328', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:12.673046 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-dhcp-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}, 'pid_mode': '', 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'KOLLA_NAME': 'neutron_dhcp_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}}})  2026-04-28 04:51:12.673068 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-tls-proxy:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-28 04:51:12.673110 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-l3-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'KOLLA_LEGACY_IPTABLES': 'false', 'KOLLA_NAME': 'neutron_l3_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}, 'pid_mode': ''}})  2026-04-28 04:51:12.673142 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/2025.1/neutron-ovn-agent:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-28 04:51:12.673156 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-sriov-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:12.673169 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-mlnx-agent:26.0.3.20260328', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-28 04:51:12.673187 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-eswitchd:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-28 04:51:12.673207 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 04:51:12.673220 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 04:51:12.673240 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-bgp-dragent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:13.944932 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-infoblox-ipam-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}}})  2026-04-28 04:51:13.945093 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metering-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-28 04:51:13.945125 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/ironic-neutron-agent:26.0.3.20260328', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:13.945160 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-tls-proxy:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-28 04:51:13.945175 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/2025.1/neutron-ovn-agent:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-28 04:51:13.945188 | orchestrator | 2026-04-28 04:51:13.945201 | orchestrator | TASK [haproxy-config : Add configuration for neutron when using single external frontend] *** 2026-04-28 04:51:13.945214 | orchestrator | Tuesday 28 April 2026 04:51:12 +0000 (0:00:04.763) 0:03:44.203 ********* 2026-04-28 04:51:13.945245 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:51:13.945260 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-openvswitch-agent:26.0.3.20260328', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:13.945277 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-dhcp-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}, 'pid_mode': '', 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'KOLLA_NAME': 'neutron_dhcp_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}}})  2026-04-28 04:51:13.945297 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-l3-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'KOLLA_LEGACY_IPTABLES': 'false', 'KOLLA_NAME': 'neutron_l3_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}, 'pid_mode': ''}})  2026-04-28 04:51:13.945316 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-sriov-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:14.282154 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-mlnx-agent:26.0.3.20260328', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-28 04:51:14.282238 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-eswitchd:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-28 04:51:14.282270 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 04:51:14.282296 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 04:51:14.282305 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-bgp-dragent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:14.282313 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-infoblox-ipam-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}}})  2026-04-28 04:51:14.282337 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metering-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-28 04:51:14.282347 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/ironic-neutron-agent:26.0.3.20260328', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:14.282359 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-tls-proxy:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.10:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-28 04:51:14.282373 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/2025.1/neutron-ovn-agent:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-28 04:51:14.282381 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:51:14.282389 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:51:14.282402 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-openvswitch-agent:26.0.3.20260328', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:14.478694 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-dhcp-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}, 'pid_mode': '', 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'KOLLA_NAME': 'neutron_dhcp_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}}})  2026-04-28 04:51:14.478842 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-l3-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'KOLLA_LEGACY_IPTABLES': 'false', 'KOLLA_NAME': 'neutron_l3_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}, 'pid_mode': ''}})  2026-04-28 04:51:14.478862 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-sriov-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:14.478878 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-mlnx-agent:26.0.3.20260328', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-28 04:51:14.478891 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-eswitchd:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-28 04:51:14.478924 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 04:51:14.478937 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 04:51:14.479025 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-bgp-dragent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:14.479039 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-infoblox-ipam-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}}})  2026-04-28 04:51:14.479051 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metering-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-28 04:51:14.479062 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/ironic-neutron-agent:26.0.3.20260328', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:14.479084 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:51:14.629795 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-tls-proxy:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.11:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-28 04:51:14.629918 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-openvswitch-agent', 'value': {'container_name': 'neutron_openvswitch_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-openvswitch-agent:26.0.3.20260328', 'enabled': False, 'privileged': True, 'environment': {'KOLLA_LEGACY_IPTABLES': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-openvswitch-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-openvswitch-agent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:14.630007 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/2025.1/neutron-ovn-agent:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-28 04:51:14.630107 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:51:14.630128 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-dhcp-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_dhcp_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-dhcp-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-dhcp-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-dhcp-agent 5672'], 'timeout': '30'}, 'pid_mode': '', 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-dhcp-agent:26.0.3.20260328', 'KOLLA_NAME': 'neutron_dhcp_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}}})  2026-04-28 04:51:14.630161 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-l3-agent', 'value': {'cgroupns_mode': 'private', 'container_name': 'neutron_l3_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'environment': {'KOLLA_IMAGE': 'registry.osism.tech/kolla/release/2025.1/neutron-l3-agent:26.0.3.20260328', 'KOLLA_LEGACY_IPTABLES': 'false', 'KOLLA_NAME': 'neutron_l3_agent', 'KOLLA_NEUTRON_WRAPPERS': 'false'}, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-l3-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', '', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', "healthcheck_port 'neutron-l3-agent ' 5672"], 'timeout': '30'}, 'pid_mode': ''}})  2026-04-28 04:51:14.630208 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-sriov-agent', 'value': {'container_name': 'neutron_sriov_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-sriov-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-sriov-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-sriov-nic-agent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:14.630221 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-mlnx-agent', 'value': {'container_name': 'neutron_mlnx_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-mlnx-agent:26.0.3.20260328', 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-mlnx-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-28 04:51:14.630235 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-eswitchd', 'value': {'container_name': 'neutron_eswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-eswitchd:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-eswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/run/libvirt:/run/libvirt:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-28 04:51:14.630246 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metadata-agent', 'value': {'container_name': 'neutron_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 04:51:14.630259 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': False, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 04:51:14.630287 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-bgp-dragent', 'value': {'container_name': 'neutron_bgp_dragent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-bgp-dragent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-bgp-dragent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-bgp-dragent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-bgp-dragent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:25.270692 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-infoblox-ipam-agent', 'value': {'container_name': 'neutron_infoblox_ipam_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-infoblox-ipam-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-infoblox-ipam-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-infoblox-ipam-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}}})  2026-04-28 04:51:25.270813 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-metering-agent', 'value': {'container_name': 'neutron_metering_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metering-agent:26.0.3.20260328', 'privileged': True, 'enabled': False, 'group': 'neutron-metering-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-metering-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}}})  2026-04-28 04:51:25.270912 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ironic-neutron-agent', 'value': {'container_name': 'ironic_neutron_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/ironic-neutron-agent:26.0.3.20260328', 'privileged': False, 'enabled': False, 'group': 'ironic-neutron-agent', 'host_in_groups': True, 'volumes': ['/etc/kolla/ironic-neutron-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ironic-neutron-agent 5672'], 'timeout': '30'}}})  2026-04-28 04:51:25.270931 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-tls-proxy', 'value': {'container_name': 'neutron_tls_proxy', 'group': 'neutron-server', 'host_in_groups': True, 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-tls-proxy:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-tls-proxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl -u openstack:password 192.168.16.12:9697'], 'timeout': '30'}, 'haproxy': {'neutron_tls_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}, 'neutron_tls_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'tls_backend': 'yes'}}}})  2026-04-28 04:51:25.271102 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-ovn-agent', 'value': {'container_name': 'neutron_ovn_agent', 'group': 'neutron-ovn-agent', 'host_in_groups': False, 'enabled': False, 'image': 'registry.osism.tech/dockerhub/kolla/release/2025.1/neutron-ovn-agent:26.0.3.20260328', 'volumes': ['/etc/kolla/neutron-ovn-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-agent 6640'], 'timeout': '30'}}})  2026-04-28 04:51:25.271151 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:51:25.271165 | orchestrator | 2026-04-28 04:51:25.271177 | orchestrator | TASK [haproxy-config : Configuring firewall for neutron] *********************** 2026-04-28 04:51:25.271190 | orchestrator | Tuesday 28 April 2026 04:51:14 +0000 (0:00:01.928) 0:03:46.131 ********* 2026-04-28 04:51:25.271247 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:51:25.271284 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:51:25.271298 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:51:25.271312 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:51:25.271330 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:51:25.271344 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:51:25.271357 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:51:25.271371 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron_server_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:51:25.271383 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:51:25.271396 | orchestrator | 2026-04-28 04:51:25.271408 | orchestrator | TASK [proxysql-config : Copying over neutron ProxySQL users config] ************ 2026-04-28 04:51:25.271421 | orchestrator | Tuesday 28 April 2026 04:51:17 +0000 (0:00:02.201) 0:03:48.333 ********* 2026-04-28 04:51:25.271433 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:51:25.271446 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:51:25.271458 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:51:25.271470 | orchestrator | 2026-04-28 04:51:25.271482 | orchestrator | TASK [proxysql-config : Copying over neutron ProxySQL rules config] ************ 2026-04-28 04:51:25.271495 | orchestrator | Tuesday 28 April 2026 04:51:18 +0000 (0:00:01.246) 0:03:49.579 ********* 2026-04-28 04:51:25.271507 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:51:25.271520 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:51:25.271531 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:51:25.271543 | orchestrator | 2026-04-28 04:51:25.271587 | orchestrator | TASK [include_role : placement] ************************************************ 2026-04-28 04:51:25.271600 | orchestrator | Tuesday 28 April 2026 04:51:20 +0000 (0:00:02.126) 0:03:51.706 ********* 2026-04-28 04:51:25.271613 | orchestrator | included: placement for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:51:25.271624 | orchestrator | 2026-04-28 04:51:25.271634 | orchestrator | TASK [haproxy-config : Copying over placement haproxy config] ****************** 2026-04-28 04:51:25.271645 | orchestrator | Tuesday 28 April 2026 04:51:21 +0000 (0:00:01.525) 0:03:53.231 ********* 2026-04-28 04:51:25.271657 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 04:51:25.271691 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 04:51:35.637458 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 04:51:35.637574 | orchestrator | 2026-04-28 04:51:35.637593 | orchestrator | TASK [haproxy-config : Add configuration for placement when using single external frontend] *** 2026-04-28 04:51:35.637606 | orchestrator | Tuesday 28 April 2026 04:51:25 +0000 (0:00:03.585) 0:03:56.816 ********* 2026-04-28 04:51:35.637619 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 04:51:35.637654 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:51:35.637669 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 04:51:35.637681 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:51:35.637718 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 04:51:35.637732 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:51:35.637742 | orchestrator | 2026-04-28 04:51:35.637753 | orchestrator | TASK [haproxy-config : Configuring firewall for placement] ********************* 2026-04-28 04:51:35.637764 | orchestrator | Tuesday 28 April 2026 04:51:26 +0000 (0:00:00.616) 0:03:57.433 ********* 2026-04-28 04:51:35.637777 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-28 04:51:35.637791 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-28 04:51:35.637803 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:51:35.637814 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-28 04:51:35.637825 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-28 04:51:35.637844 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:51:35.637855 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-28 04:51:35.637866 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-28 04:51:35.637877 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:51:35.637887 | orchestrator | 2026-04-28 04:51:35.637898 | orchestrator | TASK [proxysql-config : Copying over placement ProxySQL users config] ********** 2026-04-28 04:51:35.637909 | orchestrator | Tuesday 28 April 2026 04:51:27 +0000 (0:00:01.181) 0:03:58.614 ********* 2026-04-28 04:51:35.637920 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:51:35.637931 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:51:35.637942 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:51:35.637952 | orchestrator | 2026-04-28 04:51:35.638005 | orchestrator | TASK [proxysql-config : Copying over placement ProxySQL rules config] ********** 2026-04-28 04:51:35.638074 | orchestrator | Tuesday 28 April 2026 04:51:28 +0000 (0:00:01.190) 0:03:59.805 ********* 2026-04-28 04:51:35.638086 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:51:35.638099 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:51:35.638112 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:51:35.638124 | orchestrator | 2026-04-28 04:51:35.638136 | orchestrator | TASK [include_role : nova] ***************************************************** 2026-04-28 04:51:35.638148 | orchestrator | Tuesday 28 April 2026 04:51:30 +0000 (0:00:02.113) 0:04:01.918 ********* 2026-04-28 04:51:35.638160 | orchestrator | included: nova for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:51:35.638173 | orchestrator | 2026-04-28 04:51:35.638184 | orchestrator | TASK [haproxy-config : Copying over nova haproxy config] *********************** 2026-04-28 04:51:35.638206 | orchestrator | Tuesday 28 April 2026 04:51:32 +0000 (0:00:01.584) 0:04:03.503 ********* 2026-04-28 04:51:35.638236 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:51:37.860125 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:51:37.860253 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:51:37.860271 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:51:37.860285 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 04:51:37.860332 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-super-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 04:51:37.860354 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:51:37.860367 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:51:37.860380 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 04:51:37.860392 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 04:51:37.860417 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-super-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 04:51:38.968624 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-super-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 04:51:38.968716 | orchestrator | 2026-04-28 04:51:38.968732 | orchestrator | TASK [haproxy-config : Add configuration for nova when using single external frontend] *** 2026-04-28 04:51:38.968743 | orchestrator | Tuesday 28 April 2026 04:51:37 +0000 (0:00:05.803) 0:04:09.306 ********* 2026-04-28 04:51:38.968756 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:51:38.968769 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:51:38.968779 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 04:51:38.968820 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-super-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 04:51:38.968852 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:51:38.968864 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:51:38.968875 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:51:38.968884 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 04:51:38.968914 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-super-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 04:51:38.968923 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:51:38.968951 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:51:51.502337 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:51:51.502444 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 04:51:51.502458 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-super-conductor', 'value': {'container_name': 'nova_super_conductor', 'group': 'nova-super-conductor', 'enabled': 'no', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-super-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-super-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 04:51:51.502468 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:51:51.502480 | orchestrator | 2026-04-28 04:51:51.502490 | orchestrator | TASK [haproxy-config : Configuring firewall for nova] ************************** 2026-04-28 04:51:51.502500 | orchestrator | Tuesday 28 April 2026 04:51:39 +0000 (0:00:01.378) 0:04:10.685 ********* 2026-04-28 04:51:51.502509 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:51:51.502544 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:51:51.502569 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_metadata', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:51:51.502579 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_metadata_external', 'value': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:51:51.502588 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:51:51.502597 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:51:51.502621 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:51:51.502631 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_metadata', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:51:51.502640 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_metadata_external', 'value': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:51:51.502649 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:51:51.502658 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_api', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:51:51.502666 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_api_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:51:51.502676 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_metadata', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:51:51.502685 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_metadata_external', 'value': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:51:51.502694 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:51:51.502702 | orchestrator | 2026-04-28 04:51:51.502711 | orchestrator | TASK [proxysql-config : Copying over nova ProxySQL users config] *************** 2026-04-28 04:51:51.502720 | orchestrator | Tuesday 28 April 2026 04:51:40 +0000 (0:00:01.071) 0:04:11.756 ********* 2026-04-28 04:51:51.502729 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:51:51.502739 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:51:51.502747 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:51:51.502756 | orchestrator | 2026-04-28 04:51:51.502765 | orchestrator | TASK [proxysql-config : Copying over nova ProxySQL rules config] *************** 2026-04-28 04:51:51.502774 | orchestrator | Tuesday 28 April 2026 04:51:41 +0000 (0:00:01.284) 0:04:13.041 ********* 2026-04-28 04:51:51.502789 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:51:51.502798 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:51:51.502807 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:51:51.502815 | orchestrator | 2026-04-28 04:51:51.502824 | orchestrator | TASK [include_role : nova-cell] ************************************************ 2026-04-28 04:51:51.502833 | orchestrator | Tuesday 28 April 2026 04:51:44 +0000 (0:00:02.290) 0:04:15.332 ********* 2026-04-28 04:51:51.502842 | orchestrator | included: nova-cell for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:51:51.502850 | orchestrator | 2026-04-28 04:51:51.502859 | orchestrator | TASK [nova-cell : Configure loadbalancer for nova-novncproxy] ****************** 2026-04-28 04:51:51.502868 | orchestrator | Tuesday 28 April 2026 04:51:46 +0000 (0:00:02.055) 0:04:17.388 ********* 2026-04-28 04:51:51.502876 | orchestrator | included: /ansible/roles/nova-cell/tasks/cell_proxy_loadbalancer.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item=nova-novncproxy) 2026-04-28 04:51:51.502887 | orchestrator | 2026-04-28 04:51:51.502897 | orchestrator | TASK [haproxy-config : Copying over nova-cell:nova-novncproxy haproxy config] *** 2026-04-28 04:51:51.502908 | orchestrator | Tuesday 28 April 2026 04:51:47 +0000 (0:00:01.521) 0:04:18.910 ********* 2026-04-28 04:51:51.502924 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}}) 2026-04-28 04:51:51.502937 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}}) 2026-04-28 04:51:51.502956 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}}) 2026-04-28 04:52:04.392379 | orchestrator | 2026-04-28 04:52:04.392514 | orchestrator | TASK [haproxy-config : Add configuration for nova-cell:nova-novncproxy when using single external frontend] *** 2026-04-28 04:52:04.392532 | orchestrator | Tuesday 28 April 2026 04:51:51 +0000 (0:00:04.005) 0:04:22.915 ********* 2026-04-28 04:52:04.392548 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-28 04:52:04.392563 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:52:04.392575 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-28 04:52:04.392612 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:52:04.392624 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'group': 'nova-novncproxy', 'enabled': True, 'haproxy': {'nova_novncproxy': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_novncproxy_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-28 04:52:04.392636 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:52:04.392647 | orchestrator | 2026-04-28 04:52:04.392658 | orchestrator | TASK [haproxy-config : Configuring firewall for nova-cell:nova-novncproxy] ***** 2026-04-28 04:52:04.392669 | orchestrator | Tuesday 28 April 2026 04:51:53 +0000 (0:00:01.416) 0:04:24.332 ********* 2026-04-28 04:52:04.392681 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_novncproxy', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-28 04:52:04.392695 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova_novncproxy_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-28 04:52:04.392708 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:52:04.392719 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_novncproxy', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-28 04:52:04.392745 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova_novncproxy_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-28 04:52:04.392757 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:52:04.392780 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_novncproxy', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-28 04:52:04.392792 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova_novncproxy_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6080', 'listen_port': '6080', 'backend_http_extra': ['timeout tunnel 1h']}})  2026-04-28 04:52:04.392803 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:52:04.392814 | orchestrator | 2026-04-28 04:52:04.392825 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL users config] ********** 2026-04-28 04:52:04.392836 | orchestrator | Tuesday 28 April 2026 04:51:55 +0000 (0:00:02.046) 0:04:26.379 ********* 2026-04-28 04:52:04.392847 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:52:04.392858 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:52:04.392869 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:52:04.392879 | orchestrator | 2026-04-28 04:52:04.392890 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL rules config] ********** 2026-04-28 04:52:04.392901 | orchestrator | Tuesday 28 April 2026 04:51:57 +0000 (0:00:02.513) 0:04:28.892 ********* 2026-04-28 04:52:04.392913 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:52:04.392926 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:52:04.392957 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:52:04.393022 | orchestrator | 2026-04-28 04:52:04.393037 | orchestrator | TASK [nova-cell : Configure loadbalancer for nova-spicehtml5proxy] ************* 2026-04-28 04:52:04.393050 | orchestrator | Tuesday 28 April 2026 04:52:00 +0000 (0:00:03.155) 0:04:32.047 ********* 2026-04-28 04:52:04.393074 | orchestrator | included: /ansible/roles/nova-cell/tasks/cell_proxy_loadbalancer.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item=nova-spicehtml5proxy) 2026-04-28 04:52:04.393088 | orchestrator | 2026-04-28 04:52:04.393101 | orchestrator | TASK [haproxy-config : Copying over nova-cell:nova-spicehtml5proxy haproxy config] *** 2026-04-28 04:52:04.393112 | orchestrator | Tuesday 28 April 2026 04:52:01 +0000 (0:00:00.928) 0:04:32.976 ********* 2026-04-28 04:52:04.393124 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-28 04:52:04.393136 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:52:04.393148 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-28 04:52:04.393159 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:52:04.393170 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-28 04:52:04.393182 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:52:04.393193 | orchestrator | 2026-04-28 04:52:04.393203 | orchestrator | TASK [haproxy-config : Add configuration for nova-cell:nova-spicehtml5proxy when using single external frontend] *** 2026-04-28 04:52:04.393215 | orchestrator | Tuesday 28 April 2026 04:52:03 +0000 (0:00:01.448) 0:04:34.425 ********* 2026-04-28 04:52:04.393232 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-28 04:52:04.393243 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:52:04.393255 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-28 04:52:04.393266 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:52:04.393297 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-spicehtml5proxy', 'value': {'group': 'nova-spicehtml5proxy', 'enabled': False, 'haproxy': {'nova_spicehtml5proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}, 'nova_spicehtml5proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6082', 'listen_port': '6082', 'backend_http_extra': ['timeout tunnel 1h']}}}})  2026-04-28 04:52:28.726510 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:52:28.726628 | orchestrator | 2026-04-28 04:52:28.726644 | orchestrator | TASK [haproxy-config : Configuring firewall for nova-cell:nova-spicehtml5proxy] *** 2026-04-28 04:52:28.726656 | orchestrator | Tuesday 28 April 2026 04:52:04 +0000 (0:00:01.388) 0:04:35.813 ********* 2026-04-28 04:52:28.726668 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:52:28.726679 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:52:28.726690 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:52:28.726700 | orchestrator | 2026-04-28 04:52:28.726711 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL users config] ********** 2026-04-28 04:52:28.726722 | orchestrator | Tuesday 28 April 2026 04:52:06 +0000 (0:00:01.645) 0:04:37.459 ********* 2026-04-28 04:52:28.726733 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:52:28.726745 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:52:28.726756 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:52:28.726767 | orchestrator | 2026-04-28 04:52:28.726778 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL rules config] ********** 2026-04-28 04:52:28.726789 | orchestrator | Tuesday 28 April 2026 04:52:08 +0000 (0:00:02.714) 0:04:40.174 ********* 2026-04-28 04:52:28.726799 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:52:28.726810 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:52:28.726820 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:52:28.726831 | orchestrator | 2026-04-28 04:52:28.726842 | orchestrator | TASK [nova-cell : Configure loadbalancer for nova-serialproxy] ***************** 2026-04-28 04:52:28.726853 | orchestrator | Tuesday 28 April 2026 04:52:12 +0000 (0:00:03.202) 0:04:43.376 ********* 2026-04-28 04:52:28.726864 | orchestrator | included: /ansible/roles/nova-cell/tasks/cell_proxy_loadbalancer.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item=nova-serialproxy) 2026-04-28 04:52:28.726876 | orchestrator | 2026-04-28 04:52:28.726887 | orchestrator | TASK [haproxy-config : Copying over nova-cell:nova-serialproxy haproxy config] *** 2026-04-28 04:52:28.726897 | orchestrator | Tuesday 28 April 2026 04:52:12 +0000 (0:00:00.911) 0:04:44.288 ********* 2026-04-28 04:52:28.726910 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-28 04:52:28.726924 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:52:28.726937 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-28 04:52:28.726948 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:52:28.726977 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-28 04:52:28.727037 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:52:28.727052 | orchestrator | 2026-04-28 04:52:28.727064 | orchestrator | TASK [haproxy-config : Add configuration for nova-cell:nova-serialproxy when using single external frontend] *** 2026-04-28 04:52:28.727092 | orchestrator | Tuesday 28 April 2026 04:52:14 +0000 (0:00:01.580) 0:04:45.869 ********* 2026-04-28 04:52:28.727105 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-28 04:52:28.727118 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:52:28.727149 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-28 04:52:28.727163 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:52:28.727176 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-serialproxy', 'value': {'group': 'nova-serialproxy', 'enabled': False, 'haproxy': {'nova_serialconsole_proxy': {'enabled': False, 'mode': 'http', 'external': False, 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}, 'nova_serialconsole_proxy_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '6083', 'listen_port': '6083', 'backend_http_extra': ['timeout tunnel 10m']}}}})  2026-04-28 04:52:28.727189 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:52:28.727201 | orchestrator | 2026-04-28 04:52:28.727214 | orchestrator | TASK [haproxy-config : Configuring firewall for nova-cell:nova-serialproxy] **** 2026-04-28 04:52:28.727226 | orchestrator | Tuesday 28 April 2026 04:52:16 +0000 (0:00:01.516) 0:04:47.385 ********* 2026-04-28 04:52:28.727239 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:52:28.727251 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:52:28.727263 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:52:28.727275 | orchestrator | 2026-04-28 04:52:28.727287 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL users config] ********** 2026-04-28 04:52:28.727300 | orchestrator | Tuesday 28 April 2026 04:52:17 +0000 (0:00:01.678) 0:04:49.064 ********* 2026-04-28 04:52:28.727312 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:52:28.727324 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:52:28.727336 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:52:28.727348 | orchestrator | 2026-04-28 04:52:28.727360 | orchestrator | TASK [proxysql-config : Copying over nova-cell ProxySQL rules config] ********** 2026-04-28 04:52:28.727373 | orchestrator | Tuesday 28 April 2026 04:52:20 +0000 (0:00:02.460) 0:04:51.524 ********* 2026-04-28 04:52:28.727385 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:52:28.727396 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:52:28.727407 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:52:28.727417 | orchestrator | 2026-04-28 04:52:28.727428 | orchestrator | TASK [include_role : octavia] ************************************************** 2026-04-28 04:52:28.727439 | orchestrator | Tuesday 28 April 2026 04:52:23 +0000 (0:00:03.709) 0:04:55.233 ********* 2026-04-28 04:52:28.727450 | orchestrator | included: octavia for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:52:28.727460 | orchestrator | 2026-04-28 04:52:28.727479 | orchestrator | TASK [haproxy-config : Copying over octavia haproxy config] ******************** 2026-04-28 04:52:28.727490 | orchestrator | Tuesday 28 April 2026 04:52:25 +0000 (0:00:01.384) 0:04:56.618 ********* 2026-04-28 04:52:28.727508 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 04:52:28.727522 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 04:52:28.727542 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 04:52:29.231606 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 04:52:29.231708 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 04:52:29.231725 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 04:52:29.231778 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 04:52:29.231793 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 04:52:29.231823 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 04:52:29.231836 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 04:52:29.231848 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 04:52:29.231867 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 04:52:29.231883 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 04:52:29.231895 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 04:52:29.231906 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 04:52:29.231918 | orchestrator | 2026-04-28 04:52:29.231938 | orchestrator | TASK [haproxy-config : Add configuration for octavia when using single external frontend] *** 2026-04-28 04:52:30.216479 | orchestrator | Tuesday 28 April 2026 04:52:29 +0000 (0:00:03.937) 0:05:00.555 ********* 2026-04-28 04:52:30.216582 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 04:52:30.216606 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 04:52:30.216642 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 04:52:30.216656 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 04:52:30.216668 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 04:52:30.216679 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:52:30.216711 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 04:52:30.216725 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 04:52:30.216744 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 04:52:30.216756 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 04:52:30.216809 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 04:52:30.216821 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:52:30.216833 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 04:52:30.216853 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 04:52:42.337854 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 04:52:42.337970 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 04:52:42.337985 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 04:52:42.338130 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:52:42.338145 | orchestrator | 2026-04-28 04:52:42.338156 | orchestrator | TASK [haproxy-config : Configuring firewall for octavia] *********************** 2026-04-28 04:52:42.338166 | orchestrator | Tuesday 28 April 2026 04:52:30 +0000 (0:00:01.128) 0:05:01.684 ********* 2026-04-28 04:52:42.338188 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-28 04:52:42.338199 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-28 04:52:42.338210 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:52:42.338220 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-28 04:52:42.338230 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-28 04:52:42.338240 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:52:42.338249 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia_api', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-28 04:52:42.338260 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia_api_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}})  2026-04-28 04:52:42.338270 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:52:42.338279 | orchestrator | 2026-04-28 04:52:42.338289 | orchestrator | TASK [proxysql-config : Copying over octavia ProxySQL users config] ************ 2026-04-28 04:52:42.338298 | orchestrator | Tuesday 28 April 2026 04:52:31 +0000 (0:00:00.991) 0:05:02.675 ********* 2026-04-28 04:52:42.338308 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:52:42.338318 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:52:42.338336 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:52:42.338346 | orchestrator | 2026-04-28 04:52:42.338356 | orchestrator | TASK [proxysql-config : Copying over octavia ProxySQL rules config] ************ 2026-04-28 04:52:42.338365 | orchestrator | Tuesday 28 April 2026 04:52:32 +0000 (0:00:01.502) 0:05:04.178 ********* 2026-04-28 04:52:42.338374 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:52:42.338384 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:52:42.338409 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:52:42.338420 | orchestrator | 2026-04-28 04:52:42.338429 | orchestrator | TASK [include_role : opensearch] *********************************************** 2026-04-28 04:52:42.338439 | orchestrator | Tuesday 28 April 2026 04:52:35 +0000 (0:00:02.183) 0:05:06.361 ********* 2026-04-28 04:52:42.338448 | orchestrator | included: opensearch for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:52:42.338458 | orchestrator | 2026-04-28 04:52:42.338468 | orchestrator | TASK [haproxy-config : Copying over opensearch haproxy config] ***************** 2026-04-28 04:52:42.338477 | orchestrator | Tuesday 28 April 2026 04:52:36 +0000 (0:00:01.514) 0:05:07.875 ********* 2026-04-28 04:52:42.338490 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:52:42.338501 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:52:42.338515 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:52:42.338535 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-28 04:52:43.440915 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-28 04:52:43.441082 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-28 04:52:43.441103 | orchestrator | 2026-04-28 04:52:43.441116 | orchestrator | TASK [haproxy-config : Add configuration for opensearch when using single external frontend] *** 2026-04-28 04:52:43.441129 | orchestrator | Tuesday 28 April 2026 04:52:42 +0000 (0:00:06.319) 0:05:14.194 ********* 2026-04-28 04:52:43.441140 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:52:43.441190 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-28 04:52:43.441205 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:52:43.441218 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:52:43.441236 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-28 04:52:43.441248 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:52:43.441266 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:52:43.441287 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-28 04:52:50.537460 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:52:50.537567 | orchestrator | 2026-04-28 04:52:50.537584 | orchestrator | TASK [haproxy-config : Configuring firewall for opensearch] ******************** 2026-04-28 04:52:50.537597 | orchestrator | Tuesday 28 April 2026 04:52:43 +0000 (0:00:00.657) 0:05:14.852 ********* 2026-04-28 04:52:50.537609 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:52:50.537624 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}})  2026-04-28 04:52:50.537638 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch_dashboards_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}})  2026-04-28 04:52:50.537650 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:52:50.537679 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:52:50.537691 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:52:50.537703 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}})  2026-04-28 04:52:50.537737 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}})  2026-04-28 04:52:50.537750 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch_dashboards_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}})  2026-04-28 04:52:50.537760 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:52:50.537771 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch_dashboards_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}})  2026-04-28 04:52:50.537782 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:52:50.537793 | orchestrator | 2026-04-28 04:52:50.537804 | orchestrator | TASK [proxysql-config : Copying over opensearch ProxySQL users config] ********* 2026-04-28 04:52:50.537815 | orchestrator | Tuesday 28 April 2026 04:52:44 +0000 (0:00:00.807) 0:05:15.660 ********* 2026-04-28 04:52:50.537826 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:52:50.537837 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:52:50.537848 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:52:50.537858 | orchestrator | 2026-04-28 04:52:50.537869 | orchestrator | TASK [proxysql-config : Copying over opensearch ProxySQL rules config] ********* 2026-04-28 04:52:50.537880 | orchestrator | Tuesday 28 April 2026 04:52:45 +0000 (0:00:00.746) 0:05:16.407 ********* 2026-04-28 04:52:50.537891 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:52:50.537901 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:52:50.537912 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:52:50.537923 | orchestrator | 2026-04-28 04:52:50.537934 | orchestrator | TASK [include_role : prometheus] *********************************************** 2026-04-28 04:52:50.537944 | orchestrator | Tuesday 28 April 2026 04:52:46 +0000 (0:00:01.454) 0:05:17.861 ********* 2026-04-28 04:52:50.537955 | orchestrator | included: prometheus for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:52:50.537967 | orchestrator | 2026-04-28 04:52:50.537978 | orchestrator | TASK [haproxy-config : Copying over prometheus haproxy config] ***************** 2026-04-28 04:52:50.537988 | orchestrator | Tuesday 28 April 2026 04:52:48 +0000 (0:00:01.493) 0:05:19.355 ********* 2026-04-28 04:52:50.538148 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}}) 2026-04-28 04:52:50.538187 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 04:52:50.538203 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:50.538216 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:50.538231 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 04:52:50.538253 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}}) 2026-04-28 04:52:52.416366 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}}) 2026-04-28 04:52:52.416517 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 04:52:52.416538 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 04:52:52.416551 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:52.416563 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:52.416576 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:52.416608 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:52.416621 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 04:52:52.416647 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 04:52:52.416660 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:52:52.416673 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-openstack-exporter:1.7.0.20260328', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}}}})  2026-04-28 04:52:52.416686 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:52.416706 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:53.403463 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 04:52:53.403590 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:52:53.403611 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-openstack-exporter:1.7.0.20260328', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}}}})  2026-04-28 04:52:53.403624 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:53.403636 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:53.403666 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:52:53.403711 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 04:52:53.403724 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-openstack-exporter:1.7.0.20260328', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}}}})  2026-04-28 04:52:53.403736 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:53.403747 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:53.403759 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 04:52:53.403770 | orchestrator | 2026-04-28 04:52:53.403783 | orchestrator | TASK [haproxy-config : Add configuration for prometheus when using single external frontend] *** 2026-04-28 04:52:53.403804 | orchestrator | Tuesday 28 April 2026 04:52:52 +0000 (0:00:04.888) 0:05:24.244 ********* 2026-04-28 04:52:53.403826 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}})  2026-04-28 04:52:53.536314 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 04:52:53.536407 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:53.536422 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:53.536434 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 04:52:53.536446 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:52:53.536500 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-openstack-exporter:1.7.0.20260328', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}}}})  2026-04-28 04:52:53.536515 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}})  2026-04-28 04:52:53.536526 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:53.536536 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 04:52:53.536547 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:53.536565 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:53.536575 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 04:52:53.536586 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:52:53.536609 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:53.705843 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 04:52:53.705944 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:52:53.705962 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-openstack-exporter:1.7.0.20260328', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}}}})  2026-04-28 04:52:53.706219 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:53.706258 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:53.706310 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}})  2026-04-28 04:52:53.706325 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 04:52:53.706337 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:52:53.706351 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 04:52:53.706377 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:53.706392 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:52:53.706406 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 04:52:53.706432 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:53:00.731763 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-openstack-exporter', 'value': {'container_name': 'prometheus_openstack_exporter', 'group': 'prometheus-openstack-exporter', 'enabled': False, 'environment': {'OS_COMPUTE_API_VERSION': 'latest'}, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-openstack-exporter:1.7.0.20260328', 'volumes': ['/etc/kolla/prometheus-openstack-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_openstack_exporter': {'enabled': False, 'mode': 'http', 'external': False, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}, 'prometheus_openstack_exporter_external': {'enabled': False, 'mode': 'http', 'external': True, 'port': '9198', 'backend_http_extra': ['option httpchk', 'timeout server 45s']}}}})  2026-04-28 04:53:00.731862 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:53:00.731897 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 04:53:00.731907 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 04:53:00.731917 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:53:00.731927 | orchestrator | 2026-04-28 04:53:00.731937 | orchestrator | TASK [haproxy-config : Configuring firewall for prometheus] ******************** 2026-04-28 04:53:00.731947 | orchestrator | Tuesday 28 April 2026 04:52:53 +0000 (0:00:00.960) 0:05:25.204 ********* 2026-04-28 04:53:00.731956 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}})  2026-04-28 04:53:00.731980 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_server_external', 'value': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}})  2026-04-28 04:53:00.731992 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_alertmanager', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:53:00.732062 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus_alertmanager_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:53:00.732074 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:53:00.732082 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}})  2026-04-28 04:53:00.732091 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_server_external', 'value': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}})  2026-04-28 04:53:00.732106 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_alertmanager', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:53:00.732114 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus_alertmanager_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:53:00.732123 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:53:00.732131 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_server', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}})  2026-04-28 04:53:00.732139 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_server_external', 'value': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}})  2026-04-28 04:53:00.732147 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_alertmanager', 'value': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:53:00.732155 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus_alertmanager_external', 'value': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}})  2026-04-28 04:53:00.732163 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:53:00.732171 | orchestrator | 2026-04-28 04:53:00.732180 | orchestrator | TASK [proxysql-config : Copying over prometheus ProxySQL users config] ********* 2026-04-28 04:53:00.732188 | orchestrator | Tuesday 28 April 2026 04:52:55 +0000 (0:00:01.455) 0:05:26.659 ********* 2026-04-28 04:53:00.732196 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:53:00.732204 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:53:00.732212 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:53:00.732220 | orchestrator | 2026-04-28 04:53:00.732232 | orchestrator | TASK [proxysql-config : Copying over prometheus ProxySQL rules config] ********* 2026-04-28 04:53:00.732240 | orchestrator | Tuesday 28 April 2026 04:52:55 +0000 (0:00:00.516) 0:05:27.176 ********* 2026-04-28 04:53:00.732248 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:53:00.732256 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:53:00.732264 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:53:00.732272 | orchestrator | 2026-04-28 04:53:00.732280 | orchestrator | TASK [include_role : rabbitmq] ************************************************* 2026-04-28 04:53:00.732287 | orchestrator | Tuesday 28 April 2026 04:52:57 +0000 (0:00:01.284) 0:05:28.461 ********* 2026-04-28 04:53:00.732295 | orchestrator | included: rabbitmq for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:53:00.732303 | orchestrator | 2026-04-28 04:53:00.732313 | orchestrator | TASK [haproxy-config : Copying over rabbitmq haproxy config] ******************* 2026-04-28 04:53:00.732322 | orchestrator | Tuesday 28 April 2026 04:52:58 +0000 (0:00:01.562) 0:05:30.024 ********* 2026-04-28 04:53:00.732339 | orchestrator | ok: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 04:53:10.195542 | orchestrator | ok: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 04:53:10.195648 | orchestrator | ok: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 04:53:10.195661 | orchestrator | 2026-04-28 04:53:10.195673 | orchestrator | TASK [haproxy-config : Add configuration for rabbitmq when using single external frontend] *** 2026-04-28 04:53:10.195683 | orchestrator | Tuesday 28 April 2026 04:53:01 +0000 (0:00:02.456) 0:05:32.481 ********* 2026-04-28 04:53:10.195708 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-28 04:53:10.195740 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:53:10.195766 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-28 04:53:10.195778 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:53:10.195787 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': None, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': None, 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-28 04:53:10.195796 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:53:10.195805 | orchestrator | 2026-04-28 04:53:10.195814 | orchestrator | TASK [haproxy-config : Configuring firewall for rabbitmq] ********************** 2026-04-28 04:53:10.195823 | orchestrator | Tuesday 28 April 2026 04:53:01 +0000 (0:00:00.452) 0:05:32.933 ********* 2026-04-28 04:53:10.195832 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'rabbitmq_management', 'value': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}})  2026-04-28 04:53:10.195842 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:53:10.195851 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'rabbitmq_management', 'value': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}})  2026-04-28 04:53:10.195860 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:53:10.195868 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'rabbitmq_management', 'value': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}})  2026-04-28 04:53:10.195877 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:53:10.195885 | orchestrator | 2026-04-28 04:53:10.195894 | orchestrator | TASK [proxysql-config : Copying over rabbitmq ProxySQL users config] *********** 2026-04-28 04:53:10.195903 | orchestrator | Tuesday 28 April 2026 04:53:02 +0000 (0:00:01.018) 0:05:33.951 ********* 2026-04-28 04:53:10.195912 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:53:10.195921 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:53:10.195929 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:53:10.195938 | orchestrator | 2026-04-28 04:53:10.195946 | orchestrator | TASK [proxysql-config : Copying over rabbitmq ProxySQL rules config] *********** 2026-04-28 04:53:10.195955 | orchestrator | Tuesday 28 April 2026 04:53:03 +0000 (0:00:00.488) 0:05:34.440 ********* 2026-04-28 04:53:10.195970 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:53:10.195980 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:53:10.195988 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:53:10.195997 | orchestrator | 2026-04-28 04:53:10.196030 | orchestrator | TASK [include_role : skyline] ************************************************** 2026-04-28 04:53:10.196040 | orchestrator | Tuesday 28 April 2026 04:53:04 +0000 (0:00:01.476) 0:05:35.916 ********* 2026-04-28 04:53:10.196048 | orchestrator | included: skyline for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:53:10.196057 | orchestrator | 2026-04-28 04:53:10.196065 | orchestrator | TASK [haproxy-config : Copying over skyline haproxy config] ******************** 2026-04-28 04:53:10.196074 | orchestrator | Tuesday 28 April 2026 04:53:06 +0000 (0:00:01.843) 0:05:37.759 ********* 2026-04-28 04:53:10.196084 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-28 04:53:10.196130 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-28 04:53:13.805430 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-28 04:53:13.805587 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 04:53:13.805606 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 04:53:13.805637 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 04:53:13.805651 | orchestrator | 2026-04-28 04:53:13.805665 | orchestrator | TASK [haproxy-config : Add configuration for skyline when using single external frontend] *** 2026-04-28 04:53:13.805677 | orchestrator | Tuesday 28 April 2026 04:53:13 +0000 (0:00:06.886) 0:05:44.646 ********* 2026-04-28 04:53:13.805689 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-28 04:53:13.805715 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 04:53:13.805728 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:53:13.805740 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-28 04:53:13.805760 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 04:53:24.722444 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:53:24.722531 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-28 04:53:24.722566 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 04:53:24.722572 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:53:24.722576 | orchestrator | 2026-04-28 04:53:24.722581 | orchestrator | TASK [haproxy-config : Configuring firewall for skyline] *********************** 2026-04-28 04:53:24.722586 | orchestrator | Tuesday 28 April 2026 04:53:14 +0000 (0:00:00.700) 0:05:45.347 ********* 2026-04-28 04:53:24.722592 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_apiserver', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}})  2026-04-28 04:53:24.722598 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_apiserver_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}})  2026-04-28 04:53:24.722604 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_console', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-28 04:53:24.722609 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline_console_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-28 04:53:24.722614 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:53:24.722618 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_apiserver', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}})  2026-04-28 04:53:24.722622 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_apiserver_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}})  2026-04-28 04:53:24.722641 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_console', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-28 04:53:24.722646 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline_console_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-28 04:53:24.722650 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:53:24.722654 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_apiserver', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}})  2026-04-28 04:53:24.722658 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_apiserver_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}})  2026-04-28 04:53:24.722665 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_console', 'value': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-28 04:53:24.722669 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline_console_external', 'value': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}})  2026-04-28 04:53:24.722673 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:53:24.722678 | orchestrator | 2026-04-28 04:53:24.722682 | orchestrator | TASK [proxysql-config : Copying over skyline ProxySQL users config] ************ 2026-04-28 04:53:24.722687 | orchestrator | Tuesday 28 April 2026 04:53:16 +0000 (0:00:02.009) 0:05:47.356 ********* 2026-04-28 04:53:24.722691 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:53:24.722695 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:53:24.722699 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:53:24.722703 | orchestrator | 2026-04-28 04:53:24.722707 | orchestrator | TASK [proxysql-config : Copying over skyline ProxySQL rules config] ************ 2026-04-28 04:53:24.722711 | orchestrator | Tuesday 28 April 2026 04:53:17 +0000 (0:00:01.243) 0:05:48.600 ********* 2026-04-28 04:53:24.722715 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:53:24.722719 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:53:24.722723 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:53:24.722727 | orchestrator | 2026-04-28 04:53:24.722731 | orchestrator | TASK [include_role : tacker] *************************************************** 2026-04-28 04:53:24.722735 | orchestrator | Tuesday 28 April 2026 04:53:19 +0000 (0:00:02.242) 0:05:50.842 ********* 2026-04-28 04:53:24.722739 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:53:24.722743 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:53:24.722747 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:53:24.722751 | orchestrator | 2026-04-28 04:53:24.722755 | orchestrator | TASK [include_role : trove] **************************************************** 2026-04-28 04:53:24.722759 | orchestrator | Tuesday 28 April 2026 04:53:19 +0000 (0:00:00.348) 0:05:51.191 ********* 2026-04-28 04:53:24.722763 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:53:24.722768 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:53:24.722772 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:53:24.722776 | orchestrator | 2026-04-28 04:53:24.722780 | orchestrator | TASK [include_role : venus] **************************************************** 2026-04-28 04:53:24.722784 | orchestrator | Tuesday 28 April 2026 04:53:20 +0000 (0:00:00.705) 0:05:51.896 ********* 2026-04-28 04:53:24.722788 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:53:24.722792 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:53:24.722800 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:53:24.722805 | orchestrator | 2026-04-28 04:53:24.722809 | orchestrator | TASK [include_role : watcher] ************************************************** 2026-04-28 04:53:24.722813 | orchestrator | Tuesday 28 April 2026 04:53:20 +0000 (0:00:00.365) 0:05:52.261 ********* 2026-04-28 04:53:24.722817 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:53:24.722821 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:53:24.722825 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:53:24.722829 | orchestrator | 2026-04-28 04:53:24.722833 | orchestrator | TASK [include_role : zun] ****************************************************** 2026-04-28 04:53:24.722837 | orchestrator | Tuesday 28 April 2026 04:53:21 +0000 (0:00:00.382) 0:05:52.644 ********* 2026-04-28 04:53:24.722841 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:53:24.722845 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:53:24.722849 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:53:24.722853 | orchestrator | 2026-04-28 04:53:24.722857 | orchestrator | TASK [include_role : loadbalancer] ********************************************* 2026-04-28 04:53:24.722861 | orchestrator | Tuesday 28 April 2026 04:53:21 +0000 (0:00:00.376) 0:05:53.021 ********* 2026-04-28 04:53:24.722865 | orchestrator | included: loadbalancer for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:53:24.722870 | orchestrator | 2026-04-28 04:53:24.722874 | orchestrator | TASK [service-check-containers : loadbalancer | Check containers] ************** 2026-04-28 04:53:24.722878 | orchestrator | Tuesday 28 April 2026 04:53:23 +0000 (0:00:01.968) 0:05:54.989 ********* 2026-04-28 04:53:24.722886 | orchestrator | changed: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}}) 2026-04-28 04:53:28.303928 | orchestrator | changed: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}}) 2026-04-28 04:53:28.304095 | orchestrator | changed: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}}) 2026-04-28 04:53:28.304114 | orchestrator | changed: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 04:53:28.304150 | orchestrator | changed: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 04:53:28.304162 | orchestrator | changed: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}}) 2026-04-28 04:53:28.304175 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 04:53:28.304207 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 04:53:28.304226 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}}) 2026-04-28 04:53:28.304239 | orchestrator | 2026-04-28 04:53:28.304252 | orchestrator | TASK [service-check-containers : loadbalancer | Notify handlers to restart containers] *** 2026-04-28 04:53:28.304264 | orchestrator | Tuesday 28 April 2026 04:53:27 +0000 (0:00:03.384) 0:05:58.373 ********* 2026-04-28 04:53:28.304276 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 04:53:28.304288 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 04:53:28.304299 | orchestrator | } 2026-04-28 04:53:28.304310 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 04:53:28.304321 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 04:53:28.304332 | orchestrator | } 2026-04-28 04:53:28.304343 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 04:53:28.304354 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 04:53:28.304373 | orchestrator | } 2026-04-28 04:53:28.304384 | orchestrator | 2026-04-28 04:53:28.304396 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 04:53:28.304407 | orchestrator | Tuesday 28 April 2026 04:53:27 +0000 (0:00:00.789) 0:05:59.163 ********* 2026-04-28 04:53:28.304418 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:61313'], 'timeout': '30'}}})  2026-04-28 04:53:28.304431 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 04:53:28.304445 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 04:53:28.304459 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:53:28.304473 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:61313'], 'timeout': '30'}}})  2026-04-28 04:53:28.304494 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 04:55:11.481149 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 04:55:11.481315 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:55:11.481348 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'haproxy', 'value': {'container_name': 'haproxy', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328', 'privileged': True, 'volumes': ['/etc/kolla/haproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'letsencrypt_certificates:/etc/haproxy/certificates'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:61313'], 'timeout': '30'}}})  2026-04-28 04:55:11.481368 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'proxysql', 'value': {'container_name': 'proxysql', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328', 'privileged': False, 'volumes': ['/etc/kolla/proxysql/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'proxysql:/var/lib/proxysql/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen proxysql 6032'], 'timeout': '30'}}})  2026-04-28 04:55:11.481392 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keepalived', 'value': {'container_name': 'keepalived', 'group': 'loadbalancer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328', 'privileged': True, 'volumes': ['/etc/kolla/keepalived/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'haproxy_socket:/var/lib/kolla/haproxy/', 'proxysql_socket:/var/lib/kolla/proxysql/'], 'dimensions': {}}})  2026-04-28 04:55:11.481410 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:55:11.481428 | orchestrator | 2026-04-28 04:55:11.481447 | orchestrator | RUNNING HANDLER [loadbalancer : Check IP addresses on the API interface] ******* 2026-04-28 04:55:11.481465 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-28 04:55:11.481476 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-28 04:55:11.481495 | orchestrator | Tuesday 28 April 2026 04:53:29 +0000 (0:00:01.758) 0:06:00.922 ********* 2026-04-28 04:55:11.481505 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:55:11.481515 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:55:11.481525 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:55:11.481534 | orchestrator | 2026-04-28 04:55:11.481544 | orchestrator | RUNNING HANDLER [loadbalancer : Group HA nodes by status] ********************** 2026-04-28 04:55:11.481554 | orchestrator | Tuesday 28 April 2026 04:53:30 +0000 (0:00:00.721) 0:06:01.643 ********* 2026-04-28 04:55:11.481563 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:55:11.481573 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:55:11.481582 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:55:11.481591 | orchestrator | 2026-04-28 04:55:11.481604 | orchestrator | RUNNING HANDLER [loadbalancer : Stop backup keepalived container] ************** 2026-04-28 04:55:11.481617 | orchestrator | Tuesday 28 April 2026 04:53:30 +0000 (0:00:00.359) 0:06:02.003 ********* 2026-04-28 04:55:11.481630 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:55:11.481642 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:55:11.481655 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:55:11.481667 | orchestrator | 2026-04-28 04:55:11.481680 | orchestrator | RUNNING HANDLER [loadbalancer : Stop backup haproxy container] ***************** 2026-04-28 04:55:11.481692 | orchestrator | Tuesday 28 April 2026 04:53:37 +0000 (0:00:06.420) 0:06:08.423 ********* 2026-04-28 04:55:11.481716 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:55:11.481728 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:55:11.481741 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:55:11.481759 | orchestrator | 2026-04-28 04:55:11.481777 | orchestrator | RUNNING HANDLER [loadbalancer : Stop backup proxysql container] **************** 2026-04-28 04:55:11.481796 | orchestrator | Tuesday 28 April 2026 04:53:43 +0000 (0:00:06.046) 0:06:14.469 ********* 2026-04-28 04:55:11.481814 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:55:11.481832 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:55:11.481851 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:55:11.481871 | orchestrator | 2026-04-28 04:55:11.481912 | orchestrator | RUNNING HANDLER [loadbalancer : Start backup haproxy container] **************** 2026-04-28 04:55:11.481934 | orchestrator | Tuesday 28 April 2026 04:53:49 +0000 (0:00:06.065) 0:06:20.534 ********* 2026-04-28 04:55:11.481945 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:55:11.481956 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:55:11.481966 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:55:11.481977 | orchestrator | 2026-04-28 04:55:11.481987 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for backup haproxy to start] ************** 2026-04-28 04:55:11.481998 | orchestrator | Tuesday 28 April 2026 04:53:56 +0000 (0:00:06.917) 0:06:27.453 ********* 2026-04-28 04:55:11.482009 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:55:11.482131 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:55:11.482146 | orchestrator | 2026-04-28 04:55:11.482166 | orchestrator | RUNNING HANDLER [loadbalancer : Start backup proxysql container] *************** 2026-04-28 04:55:11.482183 | orchestrator | Tuesday 28 April 2026 04:53:59 +0000 (0:00:03.281) 0:06:30.734 ********* 2026-04-28 04:55:11.482200 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:55:11.482220 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:55:11.482238 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:55:11.482256 | orchestrator | 2026-04-28 04:55:11.482268 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for backup proxysql to start] ************* 2026-04-28 04:55:11.482279 | orchestrator | Tuesday 28 April 2026 04:54:11 +0000 (0:00:11.659) 0:06:42.394 ********* 2026-04-28 04:55:11.482290 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:55:11.482302 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:55:11.482320 | orchestrator | 2026-04-28 04:55:11.482338 | orchestrator | RUNNING HANDLER [loadbalancer : Start backup keepalived container] ************* 2026-04-28 04:55:11.482356 | orchestrator | Tuesday 28 April 2026 04:54:15 +0000 (0:00:04.542) 0:06:46.936 ********* 2026-04-28 04:55:11.482367 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:55:11.482378 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:55:11.482388 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:55:11.482399 | orchestrator | 2026-04-28 04:55:11.482409 | orchestrator | RUNNING HANDLER [loadbalancer : Stop master haproxy container] ***************** 2026-04-28 04:55:11.482421 | orchestrator | Tuesday 28 April 2026 04:54:22 +0000 (0:00:06.483) 0:06:53.420 ********* 2026-04-28 04:55:11.482440 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:55:11.482458 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:55:11.482475 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:55:11.482493 | orchestrator | 2026-04-28 04:55:11.482510 | orchestrator | RUNNING HANDLER [loadbalancer : Stop master proxysql container] **************** 2026-04-28 04:55:11.482528 | orchestrator | Tuesday 28 April 2026 04:54:27 +0000 (0:00:05.816) 0:06:59.237 ********* 2026-04-28 04:55:11.482547 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:55:11.482566 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:55:11.482586 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:55:11.482605 | orchestrator | 2026-04-28 04:55:11.482624 | orchestrator | RUNNING HANDLER [loadbalancer : Stop master keepalived container] ************** 2026-04-28 04:55:11.482642 | orchestrator | Tuesday 28 April 2026 04:54:33 +0000 (0:00:05.785) 0:07:05.023 ********* 2026-04-28 04:55:11.482659 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:55:11.482678 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:55:11.482697 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:55:11.482731 | orchestrator | 2026-04-28 04:55:11.482744 | orchestrator | RUNNING HANDLER [loadbalancer : Start master haproxy container] **************** 2026-04-28 04:55:11.482755 | orchestrator | Tuesday 28 April 2026 04:54:39 +0000 (0:00:05.834) 0:07:10.858 ********* 2026-04-28 04:55:11.482766 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:55:11.482777 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:55:11.482788 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:55:11.482798 | orchestrator | 2026-04-28 04:55:11.482809 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for master haproxy to start] ************** 2026-04-28 04:55:11.482820 | orchestrator | Tuesday 28 April 2026 04:54:45 +0000 (0:00:06.100) 0:07:16.958 ********* 2026-04-28 04:55:11.482831 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:55:11.482842 | orchestrator | 2026-04-28 04:55:11.482852 | orchestrator | RUNNING HANDLER [loadbalancer : Start master proxysql container] *************** 2026-04-28 04:55:11.482863 | orchestrator | Tuesday 28 April 2026 04:54:49 +0000 (0:00:03.445) 0:07:20.403 ********* 2026-04-28 04:55:11.482874 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:55:11.482884 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:55:11.482895 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:55:11.482906 | orchestrator | 2026-04-28 04:55:11.482916 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for master proxysql to start] ************* 2026-04-28 04:55:11.482927 | orchestrator | Tuesday 28 April 2026 04:55:00 +0000 (0:00:11.181) 0:07:31.585 ********* 2026-04-28 04:55:11.482938 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:55:11.482949 | orchestrator | 2026-04-28 04:55:11.483013 | orchestrator | RUNNING HANDLER [loadbalancer : Start master keepalived container] ************* 2026-04-28 04:55:11.483027 | orchestrator | Tuesday 28 April 2026 04:55:03 +0000 (0:00:03.557) 0:07:35.142 ********* 2026-04-28 04:55:11.483038 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:55:11.483049 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:55:11.483059 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:55:11.483107 | orchestrator | 2026-04-28 04:55:11.483121 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for haproxy to listen on VIP] ************* 2026-04-28 04:55:11.483131 | orchestrator | Tuesday 28 April 2026 04:55:09 +0000 (0:00:05.404) 0:07:40.547 ********* 2026-04-28 04:55:11.483142 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:55:11.483153 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:55:11.483167 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:55:11.483184 | orchestrator | 2026-04-28 04:55:11.483195 | orchestrator | RUNNING HANDLER [loadbalancer : Wait for proxysql to listen on VIP] ************ 2026-04-28 04:55:11.483206 | orchestrator | Tuesday 28 April 2026 04:55:10 +0000 (0:00:00.929) 0:07:41.476 ********* 2026-04-28 04:55:11.483217 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:55:11.483228 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:55:11.483239 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:55:11.483250 | orchestrator | 2026-04-28 04:55:11.483261 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:55:11.483273 | orchestrator | testbed-node-0 : ok=129  changed=30  unreachable=0 failed=0 skipped=94  rescued=0 ignored=0 2026-04-28 04:55:11.483307 | orchestrator | testbed-node-1 : ok=128  changed=29  unreachable=0 failed=0 skipped=94  rescued=0 ignored=0 2026-04-28 04:55:12.991377 | orchestrator | testbed-node-2 : ok=128  changed=29  unreachable=0 failed=0 skipped=94  rescued=0 ignored=0 2026-04-28 04:55:12.991475 | orchestrator | 2026-04-28 04:55:12.991491 | orchestrator | 2026-04-28 04:55:12.991503 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 04:55:12.991516 | orchestrator | Tuesday 28 April 2026 04:55:12 +0000 (0:00:02.092) 0:07:43.569 ********* 2026-04-28 04:55:12.991526 | orchestrator | =============================================================================== 2026-04-28 04:55:12.991537 | orchestrator | loadbalancer : Start backup proxysql container ------------------------- 11.66s 2026-04-28 04:55:12.991548 | orchestrator | loadbalancer : Start master proxysql container ------------------------- 11.18s 2026-04-28 04:55:12.991585 | orchestrator | loadbalancer : Start backup haproxy container --------------------------- 6.92s 2026-04-28 04:55:12.991596 | orchestrator | haproxy-config : Copying over skyline haproxy config -------------------- 6.89s 2026-04-28 04:55:12.991607 | orchestrator | loadbalancer : Start backup keepalived container ------------------------ 6.48s 2026-04-28 04:55:12.991618 | orchestrator | loadbalancer : Stop backup keepalived container ------------------------- 6.42s 2026-04-28 04:55:12.991629 | orchestrator | haproxy-config : Copying over opensearch haproxy config ----------------- 6.32s 2026-04-28 04:55:12.991639 | orchestrator | loadbalancer : Start master haproxy container --------------------------- 6.10s 2026-04-28 04:55:12.991650 | orchestrator | loadbalancer : Stop backup proxysql container --------------------------- 6.07s 2026-04-28 04:55:12.991661 | orchestrator | loadbalancer : Stop backup haproxy container ---------------------------- 6.05s 2026-04-28 04:55:12.991671 | orchestrator | loadbalancer : Stop master keepalived container ------------------------- 5.83s 2026-04-28 04:55:12.991682 | orchestrator | loadbalancer : Stop master haproxy container ---------------------------- 5.82s 2026-04-28 04:55:12.991693 | orchestrator | haproxy-config : Copying over nova haproxy config ----------------------- 5.80s 2026-04-28 04:55:12.991703 | orchestrator | loadbalancer : Stop master proxysql container --------------------------- 5.79s 2026-04-28 04:55:12.991714 | orchestrator | loadbalancer : Start master keepalived container ------------------------ 5.40s 2026-04-28 04:55:12.991725 | orchestrator | haproxy-config : Copying over cinder haproxy config --------------------- 4.90s 2026-04-28 04:55:12.991735 | orchestrator | haproxy-config : Copying over prometheus haproxy config ----------------- 4.89s 2026-04-28 04:55:12.991746 | orchestrator | haproxy-config : Copying over glance haproxy config --------------------- 4.85s 2026-04-28 04:55:12.991757 | orchestrator | haproxy-config : Copying over neutron haproxy config -------------------- 4.76s 2026-04-28 04:55:12.991767 | orchestrator | loadbalancer : Wait for backup proxysql to start ------------------------ 4.54s 2026-04-28 04:55:13.187815 | orchestrator | + osism apply -a upgrade opensearch 2026-04-28 04:55:14.561700 | orchestrator | 2026-04-28 04:55:14 | INFO  | Prepare task for execution of opensearch. 2026-04-28 04:55:14.628021 | orchestrator | 2026-04-28 04:55:14 | INFO  | Task 588a013f-8ef3-4c9e-9042-dce97687cb69 (opensearch) was prepared for execution. 2026-04-28 04:55:14.628153 | orchestrator | 2026-04-28 04:55:14 | INFO  | It takes a moment until task 588a013f-8ef3-4c9e-9042-dce97687cb69 (opensearch) has been started and output is visible here. 2026-04-28 04:55:31.609424 | orchestrator | 2026-04-28 04:55:31.609541 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 04:55:31.609557 | orchestrator | 2026-04-28 04:55:31.609569 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 04:55:31.609582 | orchestrator | Tuesday 28 April 2026 04:55:19 +0000 (0:00:01.503) 0:00:01.503 ********* 2026-04-28 04:55:31.609593 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:55:31.609606 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:55:31.609618 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:55:31.609629 | orchestrator | 2026-04-28 04:55:31.609641 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 04:55:31.609652 | orchestrator | Tuesday 28 April 2026 04:55:21 +0000 (0:00:01.755) 0:00:03.258 ********* 2026-04-28 04:55:31.609664 | orchestrator | ok: [testbed-node-0] => (item=enable_opensearch_True) 2026-04-28 04:55:31.609676 | orchestrator | ok: [testbed-node-1] => (item=enable_opensearch_True) 2026-04-28 04:55:31.609687 | orchestrator | ok: [testbed-node-2] => (item=enable_opensearch_True) 2026-04-28 04:55:31.609698 | orchestrator | 2026-04-28 04:55:31.609709 | orchestrator | PLAY [Apply role opensearch] *************************************************** 2026-04-28 04:55:31.609721 | orchestrator | 2026-04-28 04:55:31.609733 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-28 04:55:31.609744 | orchestrator | Tuesday 28 April 2026 04:55:22 +0000 (0:00:01.552) 0:00:04.811 ********* 2026-04-28 04:55:31.609785 | orchestrator | included: /ansible/roles/opensearch/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:55:31.609806 | orchestrator | 2026-04-28 04:55:31.609825 | orchestrator | TASK [opensearch : Setting sysctl values] ************************************** 2026-04-28 04:55:31.609844 | orchestrator | Tuesday 28 April 2026 04:55:24 +0000 (0:00:02.283) 0:00:07.094 ********* 2026-04-28 04:55:31.609863 | orchestrator | ok: [testbed-node-0] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-28 04:55:31.609882 | orchestrator | ok: [testbed-node-1] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-28 04:55:31.609902 | orchestrator | ok: [testbed-node-2] => (item={'name': 'vm.max_map_count', 'value': 262144}) 2026-04-28 04:55:31.609921 | orchestrator | 2026-04-28 04:55:31.609940 | orchestrator | TASK [opensearch : Ensuring config directories exist] ************************** 2026-04-28 04:55:31.609977 | orchestrator | Tuesday 28 April 2026 04:55:28 +0000 (0:00:03.354) 0:00:10.448 ********* 2026-04-28 04:55:31.610004 | orchestrator | ok: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:55:31.610130 | orchestrator | ok: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:55:31.610167 | orchestrator | ok: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:55:31.610184 | orchestrator | ok: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-28 04:55:31.610217 | orchestrator | ok: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-28 04:55:31.610231 | orchestrator | ok: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-28 04:55:31.610243 | orchestrator | 2026-04-28 04:55:31.610254 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-28 04:55:31.610265 | orchestrator | Tuesday 28 April 2026 04:55:30 +0000 (0:00:02.525) 0:00:12.974 ********* 2026-04-28 04:55:31.610276 | orchestrator | included: /ansible/roles/opensearch/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:55:31.610293 | orchestrator | 2026-04-28 04:55:31.610323 | orchestrator | TASK [service-cert-copy : opensearch | Copying over extra CA certificates] ***** 2026-04-28 04:55:36.640955 | orchestrator | Tuesday 28 April 2026 04:55:32 +0000 (0:00:01.911) 0:00:14.885 ********* 2026-04-28 04:55:36.641064 | orchestrator | ok: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:55:36.641183 | orchestrator | ok: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:55:36.641208 | orchestrator | ok: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:55:36.641233 | orchestrator | ok: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-28 04:55:36.641282 | orchestrator | ok: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-28 04:55:36.641328 | orchestrator | ok: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-28 04:55:36.641351 | orchestrator | 2026-04-28 04:55:36.641369 | orchestrator | TASK [service-cert-copy : opensearch | Copying over backend internal TLS certificate] *** 2026-04-28 04:55:36.641382 | orchestrator | Tuesday 28 April 2026 04:55:36 +0000 (0:00:03.379) 0:00:18.265 ********* 2026-04-28 04:55:36.641394 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:55:36.641418 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-28 04:55:38.921272 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:55:38.921381 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:55:38.921420 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-28 04:55:38.921435 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:55:38.921447 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:55:38.921479 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-28 04:55:38.921512 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:55:38.921524 | orchestrator | 2026-04-28 04:55:38.921536 | orchestrator | TASK [service-cert-copy : opensearch | Copying over backend internal TLS key] *** 2026-04-28 04:55:38.921548 | orchestrator | Tuesday 28 April 2026 04:55:38 +0000 (0:00:01.952) 0:00:20.217 ********* 2026-04-28 04:55:38.921564 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:55:38.921577 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-28 04:55:38.921589 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:55:38.921601 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:55:38.921632 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-28 04:55:42.924997 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:55:42.925165 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:55:42.925185 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-28 04:55:42.925194 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:55:42.925201 | orchestrator | 2026-04-28 04:55:42.925208 | orchestrator | TASK [opensearch : Copying over config.json files for services] **************** 2026-04-28 04:55:42.925216 | orchestrator | Tuesday 28 April 2026 04:55:40 +0000 (0:00:02.447) 0:00:22.665 ********* 2026-04-28 04:55:42.925223 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:55:42.925260 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:55:42.925270 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:55:42.925277 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-28 04:55:42.925284 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-28 04:55:42.925301 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-28 04:55:56.136421 | orchestrator | 2026-04-28 04:55:56.136532 | orchestrator | TASK [opensearch : Copying over opensearch service config file] **************** 2026-04-28 04:55:56.136550 | orchestrator | Tuesday 28 April 2026 04:55:44 +0000 (0:00:03.464) 0:00:26.129 ********* 2026-04-28 04:55:56.136562 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:55:56.136591 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:55:56.136603 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:55:56.136614 | orchestrator | 2026-04-28 04:55:56.136625 | orchestrator | TASK [opensearch : Copying over opensearch-dashboards config file] ************* 2026-04-28 04:55:56.136636 | orchestrator | Tuesday 28 April 2026 04:55:47 +0000 (0:00:03.667) 0:00:29.796 ********* 2026-04-28 04:55:56.136647 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:55:56.136658 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:55:56.136669 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:55:56.136679 | orchestrator | 2026-04-28 04:55:56.136690 | orchestrator | TASK [service-check-containers : opensearch | Check containers] **************** 2026-04-28 04:55:56.136701 | orchestrator | Tuesday 28 April 2026 04:55:50 +0000 (0:00:03.234) 0:00:33.031 ********* 2026-04-28 04:55:56.136715 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:55:56.136754 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:55:56.136767 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 04:55:56.136806 | orchestrator | changed: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-28 04:55:56.136822 | orchestrator | changed: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-28 04:55:56.136845 | orchestrator | changed: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}}) 2026-04-28 04:55:56.136858 | orchestrator | 2026-04-28 04:55:56.136869 | orchestrator | TASK [service-check-containers : opensearch | Notify handlers to restart containers] *** 2026-04-28 04:55:56.136881 | orchestrator | Tuesday 28 April 2026 04:55:54 +0000 (0:00:03.345) 0:00:36.376 ********* 2026-04-28 04:55:56.136892 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 04:55:56.136904 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 04:55:56.136915 | orchestrator | } 2026-04-28 04:55:56.136926 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 04:55:56.136937 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 04:55:56.136947 | orchestrator | } 2026-04-28 04:55:56.136960 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 04:55:56.136972 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 04:55:56.136984 | orchestrator | } 2026-04-28 04:55:56.136997 | orchestrator | 2026-04-28 04:55:56.137009 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 04:55:56.137021 | orchestrator | Tuesday 28 April 2026 04:55:55 +0000 (0:00:01.452) 0:00:37.829 ********* 2026-04-28 04:55:56.137048 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:59:01.297680 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-28 04:59:01.297834 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:59:01.297854 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:59:01.297869 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-28 04:59:01.297881 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:59:01.297929 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch', 'value': {'container_name': 'opensearch', 'group': 'opensearch', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328', 'environment': {'OPENSEARCH_JAVA_OPTS': '-Xms1g -Xmx1g -Dlog4j2.formatMsgNoLookups=true'}, 'volumes': ['/etc/kolla/opensearch/:/var/lib/kolla/config_files/', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'opensearch:/var/lib/opensearch/data', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9200'], 'timeout': '30'}, 'haproxy': {'opensearch': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9200', 'frontend_http_extra': ['option dontlog-normal'], 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 04:59:01.297943 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'opensearch-dashboards', 'value': {'container_name': 'opensearch_dashboards', 'group': 'opensearch-dashboards', 'enabled': True, 'environment': {'OPENSEARCH_DASHBOARDS_SECURITY_PLUGIN': 'False'}, 'image': 'registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328', 'volumes': ['/etc/kolla/opensearch-dashboards/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5601'], 'timeout': '30'}, 'haproxy': {'opensearch-dashboards': {'enabled': True, 'mode': 'http', 'external': False, 'port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}, 'opensearch_dashboards_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '5601', 'listen_port': '5601', 'auth_user': 'opensearch', 'auth_pass': 'password', 'backend_http_extra': ['option httpchk GET /api/status']}}}})  2026-04-28 04:59:01.297964 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:59:01.297975 | orchestrator | 2026-04-28 04:59:01.297987 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-28 04:59:01.297999 | orchestrator | Tuesday 28 April 2026 04:55:58 +0000 (0:00:02.358) 0:00:40.188 ********* 2026-04-28 04:59:01.298010 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:59:01.298146 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:59:01.298167 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:59:01.298187 | orchestrator | 2026-04-28 04:59:01.298199 | orchestrator | TASK [opensearch : Flush handlers] ********************************************* 2026-04-28 04:59:01.298210 | orchestrator | Tuesday 28 April 2026 04:55:59 +0000 (0:00:01.359) 0:00:41.547 ********* 2026-04-28 04:59:01.298221 | orchestrator | 2026-04-28 04:59:01.298232 | orchestrator | TASK [opensearch : Flush handlers] ********************************************* 2026-04-28 04:59:01.298243 | orchestrator | Tuesday 28 April 2026 04:55:59 +0000 (0:00:00.459) 0:00:42.007 ********* 2026-04-28 04:59:01.298254 | orchestrator | 2026-04-28 04:59:01.298264 | orchestrator | TASK [opensearch : Flush handlers] ********************************************* 2026-04-28 04:59:01.298275 | orchestrator | Tuesday 28 April 2026 04:56:00 +0000 (0:00:00.529) 0:00:42.536 ********* 2026-04-28 04:59:01.298286 | orchestrator | 2026-04-28 04:59:01.298297 | orchestrator | RUNNING HANDLER [opensearch : Disable shard allocation] ************************ 2026-04-28 04:59:01.298307 | orchestrator | Tuesday 28 April 2026 04:56:01 +0000 (0:00:00.816) 0:00:43.353 ********* 2026-04-28 04:59:01.298318 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:59:01.298330 | orchestrator | 2026-04-28 04:59:01.298341 | orchestrator | RUNNING HANDLER [opensearch : Perform a flush] ********************************* 2026-04-28 04:59:01.298352 | orchestrator | Tuesday 28 April 2026 04:56:04 +0000 (0:00:03.501) 0:00:46.855 ********* 2026-04-28 04:59:01.298362 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:59:01.298373 | orchestrator | 2026-04-28 04:59:01.298384 | orchestrator | RUNNING HANDLER [opensearch : Restart opensearch container] ******************** 2026-04-28 04:59:01.298394 | orchestrator | Tuesday 28 April 2026 04:56:09 +0000 (0:00:04.808) 0:00:51.663 ********* 2026-04-28 04:59:01.298405 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:59:01.298416 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:59:01.298426 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:59:01.298437 | orchestrator | 2026-04-28 04:59:01.298448 | orchestrator | RUNNING HANDLER [opensearch : Restart opensearch-dashboards container] ********* 2026-04-28 04:59:01.298458 | orchestrator | Tuesday 28 April 2026 04:57:19 +0000 (0:01:09.534) 0:02:01.198 ********* 2026-04-28 04:59:01.298469 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:59:01.298480 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:59:01.298490 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:59:01.298501 | orchestrator | 2026-04-28 04:59:01.298512 | orchestrator | TASK [opensearch : include_tasks] ********************************************** 2026-04-28 04:59:01.298522 | orchestrator | Tuesday 28 April 2026 04:58:49 +0000 (0:01:30.613) 0:03:31.812 ********* 2026-04-28 04:59:01.298543 | orchestrator | included: /ansible/roles/opensearch/tasks/post-config.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:59:01.298554 | orchestrator | 2026-04-28 04:59:01.298565 | orchestrator | TASK [opensearch : Wait for OpenSearch to become ready] ************************ 2026-04-28 04:59:01.298575 | orchestrator | Tuesday 28 April 2026 04:58:51 +0000 (0:00:01.881) 0:03:33.693 ********* 2026-04-28 04:59:01.298586 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:59:01.298597 | orchestrator | 2026-04-28 04:59:01.298608 | orchestrator | TASK [opensearch : Wait for OpenSearch cluster to become healthy] ************** 2026-04-28 04:59:01.298618 | orchestrator | Tuesday 28 April 2026 04:58:54 +0000 (0:00:03.177) 0:03:36.870 ********* 2026-04-28 04:59:01.298629 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:59:01.298639 | orchestrator | 2026-04-28 04:59:01.298650 | orchestrator | TASK [opensearch : Check if a log retention policy exists] ********************* 2026-04-28 04:59:01.298661 | orchestrator | Tuesday 28 April 2026 04:58:57 +0000 (0:00:03.091) 0:03:39.962 ********* 2026-04-28 04:59:01.298671 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:59:01.298682 | orchestrator | 2026-04-28 04:59:01.298693 | orchestrator | TASK [opensearch : Create new log retention policy] **************************** 2026-04-28 04:59:01.298714 | orchestrator | Tuesday 28 April 2026 04:59:01 +0000 (0:00:03.427) 0:03:43.389 ********* 2026-04-28 04:59:04.574427 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:59:04.574498 | orchestrator | 2026-04-28 04:59:04.574505 | orchestrator | TASK [opensearch : Apply retention policy to existing indices] ***************** 2026-04-28 04:59:04.574510 | orchestrator | Tuesday 28 April 2026 04:59:02 +0000 (0:00:01.215) 0:03:44.605 ********* 2026-04-28 04:59:04.574515 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:59:04.574520 | orchestrator | 2026-04-28 04:59:04.574524 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:59:04.574530 | orchestrator | testbed-node-0 : ok=20  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 04:59:04.574536 | orchestrator | testbed-node-1 : ok=15  changed=5  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-28 04:59:04.574541 | orchestrator | testbed-node-2 : ok=15  changed=5  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-28 04:59:04.574545 | orchestrator | 2026-04-28 04:59:04.574549 | orchestrator | 2026-04-28 04:59:04.574553 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 04:59:04.574557 | orchestrator | Tuesday 28 April 2026 04:59:04 +0000 (0:00:01.680) 0:03:46.286 ********* 2026-04-28 04:59:04.574561 | orchestrator | =============================================================================== 2026-04-28 04:59:04.574565 | orchestrator | opensearch : Restart opensearch-dashboards container ------------------- 90.61s 2026-04-28 04:59:04.574569 | orchestrator | opensearch : Restart opensearch container ------------------------------ 69.53s 2026-04-28 04:59:04.574573 | orchestrator | opensearch : Perform a flush -------------------------------------------- 4.81s 2026-04-28 04:59:04.574577 | orchestrator | opensearch : Copying over opensearch service config file ---------------- 3.67s 2026-04-28 04:59:04.574581 | orchestrator | opensearch : Disable shard allocation ----------------------------------- 3.50s 2026-04-28 04:59:04.574585 | orchestrator | opensearch : Copying over config.json files for services ---------------- 3.46s 2026-04-28 04:59:04.574589 | orchestrator | opensearch : Check if a log retention policy exists --------------------- 3.43s 2026-04-28 04:59:04.574594 | orchestrator | service-cert-copy : opensearch | Copying over extra CA certificates ----- 3.38s 2026-04-28 04:59:04.574629 | orchestrator | opensearch : Setting sysctl values -------------------------------------- 3.35s 2026-04-28 04:59:04.574634 | orchestrator | service-check-containers : opensearch | Check containers ---------------- 3.35s 2026-04-28 04:59:04.574638 | orchestrator | opensearch : Copying over opensearch-dashboards config file ------------- 3.23s 2026-04-28 04:59:04.574642 | orchestrator | opensearch : Wait for OpenSearch to become ready ------------------------ 3.18s 2026-04-28 04:59:04.574663 | orchestrator | opensearch : Wait for OpenSearch cluster to become healthy -------------- 3.09s 2026-04-28 04:59:04.574668 | orchestrator | opensearch : Ensuring config directories exist -------------------------- 2.53s 2026-04-28 04:59:04.574672 | orchestrator | service-cert-copy : opensearch | Copying over backend internal TLS key --- 2.45s 2026-04-28 04:59:04.574676 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.36s 2026-04-28 04:59:04.574680 | orchestrator | opensearch : include_tasks ---------------------------------------------- 2.28s 2026-04-28 04:59:04.574684 | orchestrator | service-cert-copy : opensearch | Copying over backend internal TLS certificate --- 1.95s 2026-04-28 04:59:04.574689 | orchestrator | opensearch : include_tasks ---------------------------------------------- 1.91s 2026-04-28 04:59:04.574693 | orchestrator | opensearch : include_tasks ---------------------------------------------- 1.88s 2026-04-28 04:59:04.765544 | orchestrator | + osism apply -a upgrade memcached 2026-04-28 04:59:06.127887 | orchestrator | 2026-04-28 04:59:06 | INFO  | Prepare task for execution of memcached. 2026-04-28 04:59:06.193475 | orchestrator | 2026-04-28 04:59:06 | INFO  | Task 2e1fa311-42a9-414f-a1ff-87470e2d5e9f (memcached) was prepared for execution. 2026-04-28 04:59:06.193557 | orchestrator | 2026-04-28 04:59:06 | INFO  | It takes a moment until task 2e1fa311-42a9-414f-a1ff-87470e2d5e9f (memcached) has been started and output is visible here. 2026-04-28 04:59:38.746058 | orchestrator | 2026-04-28 04:59:38.746226 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 04:59:38.746241 | orchestrator | 2026-04-28 04:59:38.746252 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 04:59:38.746262 | orchestrator | Tuesday 28 April 2026 04:59:10 +0000 (0:00:01.485) 0:00:01.485 ********* 2026-04-28 04:59:38.746272 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:59:38.746283 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:59:38.746293 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:59:38.746303 | orchestrator | 2026-04-28 04:59:38.746312 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 04:59:38.746322 | orchestrator | Tuesday 28 April 2026 04:59:12 +0000 (0:00:01.965) 0:00:03.450 ********* 2026-04-28 04:59:38.746332 | orchestrator | ok: [testbed-node-0] => (item=enable_memcached_True) 2026-04-28 04:59:38.746342 | orchestrator | ok: [testbed-node-1] => (item=enable_memcached_True) 2026-04-28 04:59:38.746352 | orchestrator | ok: [testbed-node-2] => (item=enable_memcached_True) 2026-04-28 04:59:38.746361 | orchestrator | 2026-04-28 04:59:38.746371 | orchestrator | PLAY [Apply role memcached] **************************************************** 2026-04-28 04:59:38.746380 | orchestrator | 2026-04-28 04:59:38.746405 | orchestrator | TASK [memcached : include_tasks] *********************************************** 2026-04-28 04:59:38.746415 | orchestrator | Tuesday 28 April 2026 04:59:15 +0000 (0:00:02.675) 0:00:06.126 ********* 2026-04-28 04:59:38.746425 | orchestrator | included: /ansible/roles/memcached/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:59:38.746435 | orchestrator | 2026-04-28 04:59:38.746445 | orchestrator | TASK [memcached : Ensuring config directories exist] *************************** 2026-04-28 04:59:38.746454 | orchestrator | Tuesday 28 April 2026 04:59:18 +0000 (0:00:02.455) 0:00:08.581 ********* 2026-04-28 04:59:38.746464 | orchestrator | ok: [testbed-node-0] => (item=memcached) 2026-04-28 04:59:38.746474 | orchestrator | ok: [testbed-node-1] => (item=memcached) 2026-04-28 04:59:38.746483 | orchestrator | ok: [testbed-node-2] => (item=memcached) 2026-04-28 04:59:38.746493 | orchestrator | 2026-04-28 04:59:38.746502 | orchestrator | TASK [memcached : Copying over config.json files for services] ***************** 2026-04-28 04:59:38.746512 | orchestrator | Tuesday 28 April 2026 04:59:20 +0000 (0:00:02.174) 0:00:10.756 ********* 2026-04-28 04:59:38.746521 | orchestrator | ok: [testbed-node-0] => (item=memcached) 2026-04-28 04:59:38.746531 | orchestrator | ok: [testbed-node-1] => (item=memcached) 2026-04-28 04:59:38.746541 | orchestrator | ok: [testbed-node-2] => (item=memcached) 2026-04-28 04:59:38.746571 | orchestrator | 2026-04-28 04:59:38.746583 | orchestrator | TASK [service-check-containers : memcached | Check containers] ***************** 2026-04-28 04:59:38.746593 | orchestrator | Tuesday 28 April 2026 04:59:22 +0000 (0:00:02.651) 0:00:13.408 ********* 2026-04-28 04:59:38.746609 | orchestrator | changed: [testbed-node-1] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-28 04:59:38.746624 | orchestrator | changed: [testbed-node-0] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-28 04:59:38.746655 | orchestrator | changed: [testbed-node-2] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}}) 2026-04-28 04:59:38.746667 | orchestrator | 2026-04-28 04:59:38.746678 | orchestrator | TASK [service-check-containers : memcached | Notify handlers to restart containers] *** 2026-04-28 04:59:38.746689 | orchestrator | Tuesday 28 April 2026 04:59:24 +0000 (0:00:02.149) 0:00:15.557 ********* 2026-04-28 04:59:38.746700 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 04:59:38.746712 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 04:59:38.746723 | orchestrator | } 2026-04-28 04:59:38.746734 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 04:59:38.746745 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 04:59:38.746756 | orchestrator | } 2026-04-28 04:59:38.746766 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 04:59:38.746777 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 04:59:38.746789 | orchestrator | } 2026-04-28 04:59:38.746800 | orchestrator | 2026-04-28 04:59:38.746811 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 04:59:38.746822 | orchestrator | Tuesday 28 April 2026 04:59:26 +0000 (0:00:01.437) 0:00:16.994 ********* 2026-04-28 04:59:38.746839 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-28 04:59:38.746858 | orchestrator | skipping: [testbed-node-0] 2026-04-28 04:59:38.746870 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-28 04:59:38.746882 | orchestrator | skipping: [testbed-node-1] 2026-04-28 04:59:38.746894 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'memcached', 'value': {'container_name': 'memcached', 'image': 'registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328', 'enabled': True, 'group': 'memcached', 'volumes': ['/etc/kolla/memcached/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen memcached 11211'], 'timeout': '30'}, 'haproxy': {'memcached': {'enabled': False, 'mode': 'tcp', 'port': '11211', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'active_passive': True}}}})  2026-04-28 04:59:38.746905 | orchestrator | skipping: [testbed-node-2] 2026-04-28 04:59:38.746916 | orchestrator | 2026-04-28 04:59:38.746926 | orchestrator | RUNNING HANDLER [memcached : Restart memcached container] ********************** 2026-04-28 04:59:38.746935 | orchestrator | Tuesday 28 April 2026 04:59:28 +0000 (0:00:01.988) 0:00:18.984 ********* 2026-04-28 04:59:38.746945 | orchestrator | changed: [testbed-node-0] 2026-04-28 04:59:38.746955 | orchestrator | changed: [testbed-node-1] 2026-04-28 04:59:38.746964 | orchestrator | changed: [testbed-node-2] 2026-04-28 04:59:38.746974 | orchestrator | 2026-04-28 04:59:38.746983 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 04:59:38.746994 | orchestrator | testbed-node-0 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 04:59:38.747005 | orchestrator | testbed-node-1 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 04:59:38.747014 | orchestrator | testbed-node-2 : ok=8  changed=3  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 04:59:38.747024 | orchestrator | 2026-04-28 04:59:38.747033 | orchestrator | 2026-04-28 04:59:38.747043 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 04:59:38.747059 | orchestrator | Tuesday 28 April 2026 04:59:38 +0000 (0:00:10.327) 0:00:29.311 ********* 2026-04-28 04:59:39.079934 | orchestrator | =============================================================================== 2026-04-28 04:59:39.080025 | orchestrator | memcached : Restart memcached container -------------------------------- 10.33s 2026-04-28 04:59:39.080037 | orchestrator | Group hosts based on enabled services ----------------------------------- 2.68s 2026-04-28 04:59:39.080046 | orchestrator | memcached : Copying over config.json files for services ----------------- 2.65s 2026-04-28 04:59:39.080123 | orchestrator | memcached : include_tasks ----------------------------------------------- 2.46s 2026-04-28 04:59:39.080134 | orchestrator | memcached : Ensuring config directories exist --------------------------- 2.17s 2026-04-28 04:59:39.080143 | orchestrator | service-check-containers : memcached | Check containers ----------------- 2.15s 2026-04-28 04:59:39.080152 | orchestrator | service-check-containers : Include tasks -------------------------------- 1.99s 2026-04-28 04:59:39.080161 | orchestrator | Group hosts based on Kolla action --------------------------------------- 1.97s 2026-04-28 04:59:39.080183 | orchestrator | service-check-containers : memcached | Notify handlers to restart containers --- 1.44s 2026-04-28 04:59:39.277150 | orchestrator | + osism apply -a upgrade redis 2026-04-28 04:59:40.549815 | orchestrator | 2026-04-28 04:59:40 | INFO  | Prepare task for execution of redis. 2026-04-28 04:59:40.616427 | orchestrator | 2026-04-28 04:59:40 | INFO  | Task 799085cf-c232-4bca-a490-50c43edc836c (redis) was prepared for execution. 2026-04-28 04:59:40.616521 | orchestrator | 2026-04-28 04:59:40 | INFO  | It takes a moment until task 799085cf-c232-4bca-a490-50c43edc836c (redis) has been started and output is visible here. 2026-04-28 04:59:56.593354 | orchestrator | 2026-04-28 04:59:56.593461 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 04:59:56.593486 | orchestrator | 2026-04-28 04:59:56.593506 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 04:59:56.593527 | orchestrator | Tuesday 28 April 2026 04:59:45 +0000 (0:00:01.634) 0:00:01.634 ********* 2026-04-28 04:59:56.593548 | orchestrator | ok: [testbed-node-0] 2026-04-28 04:59:56.593564 | orchestrator | ok: [testbed-node-1] 2026-04-28 04:59:56.593574 | orchestrator | ok: [testbed-node-2] 2026-04-28 04:59:56.593585 | orchestrator | 2026-04-28 04:59:56.593596 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 04:59:56.593607 | orchestrator | Tuesday 28 April 2026 04:59:47 +0000 (0:00:02.071) 0:00:03.706 ********* 2026-04-28 04:59:56.593618 | orchestrator | ok: [testbed-node-0] => (item=enable_redis_True) 2026-04-28 04:59:56.593630 | orchestrator | ok: [testbed-node-1] => (item=enable_redis_True) 2026-04-28 04:59:56.593641 | orchestrator | ok: [testbed-node-2] => (item=enable_redis_True) 2026-04-28 04:59:56.593651 | orchestrator | 2026-04-28 04:59:56.593662 | orchestrator | PLAY [Apply role redis] ******************************************************** 2026-04-28 04:59:56.593673 | orchestrator | 2026-04-28 04:59:56.593684 | orchestrator | TASK [redis : include_tasks] *************************************************** 2026-04-28 04:59:56.593695 | orchestrator | Tuesday 28 April 2026 04:59:49 +0000 (0:00:01.500) 0:00:05.206 ********* 2026-04-28 04:59:56.593706 | orchestrator | included: /ansible/roles/redis/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 04:59:56.593717 | orchestrator | 2026-04-28 04:59:56.593728 | orchestrator | TASK [redis : Ensuring config directories exist] ******************************* 2026-04-28 04:59:56.593739 | orchestrator | Tuesday 28 April 2026 04:59:51 +0000 (0:00:02.934) 0:00:08.141 ********* 2026-04-28 04:59:56.593753 | orchestrator | ok: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 04:59:56.593770 | orchestrator | ok: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 04:59:56.593801 | orchestrator | ok: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 04:59:56.593814 | orchestrator | ok: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 04:59:56.593858 | orchestrator | ok: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 04:59:56.593871 | orchestrator | ok: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 04:59:56.593883 | orchestrator | 2026-04-28 04:59:56.593895 | orchestrator | TASK [redis : Copying over default config.json files] ************************** 2026-04-28 04:59:56.593909 | orchestrator | Tuesday 28 April 2026 04:59:54 +0000 (0:00:02.673) 0:00:10.815 ********* 2026-04-28 04:59:56.593922 | orchestrator | ok: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 04:59:56.593935 | orchestrator | ok: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 04:59:56.593956 | orchestrator | ok: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 04:59:56.593969 | orchestrator | ok: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 04:59:56.593994 | orchestrator | ok: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 05:00:03.691579 | orchestrator | ok: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 05:00:03.691688 | orchestrator | 2026-04-28 05:00:03.691705 | orchestrator | TASK [redis : Copying over redis config files] ********************************* 2026-04-28 05:00:03.691717 | orchestrator | Tuesday 28 April 2026 04:59:57 +0000 (0:00:03.082) 0:00:13.897 ********* 2026-04-28 05:00:03.691729 | orchestrator | ok: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 05:00:03.691741 | orchestrator | ok: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 05:00:03.691776 | orchestrator | ok: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 05:00:03.691787 | orchestrator | ok: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 05:00:03.691813 | orchestrator | ok: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 05:00:03.691841 | orchestrator | ok: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 05:00:03.691855 | orchestrator | 2026-04-28 05:00:03.691873 | orchestrator | TASK [service-check-containers : redis | Check containers] ********************* 2026-04-28 05:00:03.691889 | orchestrator | Tuesday 28 April 2026 05:00:01 +0000 (0:00:04.011) 0:00:17.909 ********* 2026-04-28 05:00:03.691906 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 05:00:03.691935 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 05:00:03.691954 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}}) 2026-04-28 05:00:03.691972 | orchestrator | changed: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 05:00:03.692001 | orchestrator | changed: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 05:00:03.692023 | orchestrator | changed: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}}) 2026-04-28 05:00:32.234431 | orchestrator | 2026-04-28 05:00:32.234570 | orchestrator | TASK [service-check-containers : redis | Notify handlers to restart containers] *** 2026-04-28 05:00:32.234590 | orchestrator | Tuesday 28 April 2026 05:00:04 +0000 (0:00:03.060) 0:00:20.970 ********* 2026-04-28 05:00:32.234603 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 05:00:32.234616 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:00:32.234627 | orchestrator | } 2026-04-28 05:00:32.234638 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 05:00:32.234682 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:00:32.234695 | orchestrator | } 2026-04-28 05:00:32.234706 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 05:00:32.234718 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:00:32.234729 | orchestrator | } 2026-04-28 05:00:32.234740 | orchestrator | 2026-04-28 05:00:32.234751 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 05:00:32.234762 | orchestrator | Tuesday 28 April 2026 05:00:06 +0000 (0:00:01.419) 0:00:22.389 ********* 2026-04-28 05:00:32.234776 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}})  2026-04-28 05:00:32.234791 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}})  2026-04-28 05:00:32.234803 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:00:32.234815 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}})  2026-04-28 05:00:32.234842 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}})  2026-04-28 05:00:32.234854 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:00:32.234866 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'redis', 'value': {'container_name': 'redis', 'group': 'redis', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328', 'volumes': ['/etc/kolla/redis/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'redis:/var/lib/redis/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-server 6379'], 'timeout': '30'}}})  2026-04-28 05:00:32.234897 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'redis-sentinel', 'value': {'container_name': 'redis_sentinel', 'group': 'redis', 'environment': {'REDIS_CONF': '/etc/redis/redis.conf', 'REDIS_GEN_CONF': '/etc/redis/redis-regenerated-by-config-rewrite.conf'}, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328', 'volumes': ['/etc/kolla/redis-sentinel/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen redis-sentinel 26379'], 'timeout': '30'}}})  2026-04-28 05:00:32.234919 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:00:32.234930 | orchestrator | 2026-04-28 05:00:32.234942 | orchestrator | TASK [redis : Flush handlers] ************************************************** 2026-04-28 05:00:32.234952 | orchestrator | Tuesday 28 April 2026 05:00:08 +0000 (0:00:01.798) 0:00:24.188 ********* 2026-04-28 05:00:32.234965 | orchestrator | 2026-04-28 05:00:32.234978 | orchestrator | TASK [redis : Flush handlers] ************************************************** 2026-04-28 05:00:32.234991 | orchestrator | Tuesday 28 April 2026 05:00:08 +0000 (0:00:00.450) 0:00:24.638 ********* 2026-04-28 05:00:32.235003 | orchestrator | 2026-04-28 05:00:32.235019 | orchestrator | TASK [redis : Flush handlers] ************************************************** 2026-04-28 05:00:32.235040 | orchestrator | Tuesday 28 April 2026 05:00:08 +0000 (0:00:00.447) 0:00:25.086 ********* 2026-04-28 05:00:32.235058 | orchestrator | 2026-04-28 05:00:32.235109 | orchestrator | RUNNING HANDLER [redis : Restart redis container] ****************************** 2026-04-28 05:00:32.235129 | orchestrator | Tuesday 28 April 2026 05:00:09 +0000 (0:00:00.769) 0:00:25.855 ********* 2026-04-28 05:00:32.235145 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:00:32.235162 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:00:32.235178 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:00:32.235195 | orchestrator | 2026-04-28 05:00:32.235210 | orchestrator | RUNNING HANDLER [redis : Restart redis-sentinel container] ********************* 2026-04-28 05:00:32.235226 | orchestrator | Tuesday 28 April 2026 05:00:20 +0000 (0:00:10.825) 0:00:36.681 ********* 2026-04-28 05:00:32.235247 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:00:32.235262 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:00:32.235278 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:00:32.235299 | orchestrator | 2026-04-28 05:00:32.235315 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 05:00:32.235333 | orchestrator | testbed-node-0 : ok=10  changed=4  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 05:00:32.235352 | orchestrator | testbed-node-1 : ok=10  changed=4  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 05:00:32.235370 | orchestrator | testbed-node-2 : ok=10  changed=4  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 05:00:32.235385 | orchestrator | 2026-04-28 05:00:32.235401 | orchestrator | 2026-04-28 05:00:32.235418 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 05:00:32.235437 | orchestrator | Tuesday 28 April 2026 05:00:31 +0000 (0:00:11.400) 0:00:48.081 ********* 2026-04-28 05:00:32.235455 | orchestrator | =============================================================================== 2026-04-28 05:00:32.235473 | orchestrator | redis : Restart redis-sentinel container ------------------------------- 11.40s 2026-04-28 05:00:32.235491 | orchestrator | redis : Restart redis container ---------------------------------------- 10.83s 2026-04-28 05:00:32.235510 | orchestrator | redis : Copying over redis config files --------------------------------- 4.01s 2026-04-28 05:00:32.235527 | orchestrator | redis : Copying over default config.json files -------------------------- 3.08s 2026-04-28 05:00:32.235556 | orchestrator | service-check-containers : redis | Check containers --------------------- 3.06s 2026-04-28 05:00:32.235573 | orchestrator | redis : include_tasks --------------------------------------------------- 2.93s 2026-04-28 05:00:32.235605 | orchestrator | redis : Ensuring config directories exist ------------------------------- 2.67s 2026-04-28 05:00:32.235632 | orchestrator | Group hosts based on Kolla action --------------------------------------- 2.07s 2026-04-28 05:00:32.235651 | orchestrator | service-check-containers : Include tasks -------------------------------- 1.80s 2026-04-28 05:00:32.235669 | orchestrator | redis : Flush handlers -------------------------------------------------- 1.67s 2026-04-28 05:00:32.235687 | orchestrator | Group hosts based on enabled services ----------------------------------- 1.50s 2026-04-28 05:00:32.235704 | orchestrator | service-check-containers : redis | Notify handlers to restart containers --- 1.42s 2026-04-28 05:00:32.426528 | orchestrator | + osism apply -a upgrade mariadb 2026-04-28 05:00:33.703009 | orchestrator | 2026-04-28 05:00:33 | INFO  | Prepare task for execution of mariadb. 2026-04-28 05:00:33.769064 | orchestrator | 2026-04-28 05:00:33 | INFO  | Task 84dbcfcd-28f3-4b18-9e81-6109cc578508 (mariadb) was prepared for execution. 2026-04-28 05:00:33.769210 | orchestrator | 2026-04-28 05:00:33 | INFO  | It takes a moment until task 84dbcfcd-28f3-4b18-9e81-6109cc578508 (mariadb) has been started and output is visible here. 2026-04-28 05:01:05.369213 | orchestrator | 2026-04-28 05:01:05.369313 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 05:01:05.369326 | orchestrator | 2026-04-28 05:01:05.369335 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 05:01:05.369343 | orchestrator | Tuesday 28 April 2026 05:00:39 +0000 (0:00:02.425) 0:00:02.425 ********* 2026-04-28 05:01:05.369351 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:01:05.369361 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:01:05.369369 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:01:05.369377 | orchestrator | 2026-04-28 05:01:05.369385 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 05:01:05.369393 | orchestrator | Tuesday 28 April 2026 05:00:41 +0000 (0:00:01.751) 0:00:04.177 ********* 2026-04-28 05:01:05.369401 | orchestrator | ok: [testbed-node-0] => (item=enable_mariadb_True) 2026-04-28 05:01:05.369410 | orchestrator | ok: [testbed-node-1] => (item=enable_mariadb_True) 2026-04-28 05:01:05.369418 | orchestrator | ok: [testbed-node-2] => (item=enable_mariadb_True) 2026-04-28 05:01:05.369426 | orchestrator | 2026-04-28 05:01:05.369434 | orchestrator | PLAY [Apply role mariadb] ****************************************************** 2026-04-28 05:01:05.369443 | orchestrator | 2026-04-28 05:01:05.369456 | orchestrator | TASK [mariadb : Group MariaDB hosts based on shards] *************************** 2026-04-28 05:01:05.369469 | orchestrator | Tuesday 28 April 2026 05:00:48 +0000 (0:00:07.255) 0:00:11.432 ********* 2026-04-28 05:01:05.369481 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:01:05.369493 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-28 05:01:05.369505 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-28 05:01:05.369516 | orchestrator | 2026-04-28 05:01:05.369527 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-28 05:01:05.369539 | orchestrator | Tuesday 28 April 2026 05:00:49 +0000 (0:00:01.371) 0:00:12.804 ********* 2026-04-28 05:01:05.369552 | orchestrator | included: /ansible/roles/mariadb/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 05:01:05.369566 | orchestrator | 2026-04-28 05:01:05.369579 | orchestrator | TASK [mariadb : Remove mariadb-clustercheck] *********************************** 2026-04-28 05:01:05.369592 | orchestrator | Tuesday 28 April 2026 05:00:51 +0000 (0:00:01.994) 0:00:14.799 ********* 2026-04-28 05:01:05.369604 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:01:05.369617 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:01:05.369630 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:01:05.369643 | orchestrator | 2026-04-28 05:01:05.369657 | orchestrator | TASK [mariadb : Ensuring config directories exist] ***************************** 2026-04-28 05:01:05.369671 | orchestrator | Tuesday 28 April 2026 05:00:54 +0000 (0:00:02.752) 0:00:17.551 ********* 2026-04-28 05:01:05.369710 | orchestrator | ok: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-28 05:01:05.369789 | orchestrator | ok: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-28 05:01:05.369810 | orchestrator | ok: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-28 05:01:05.369835 | orchestrator | 2026-04-28 05:01:05.369851 | orchestrator | TASK [mariadb : Ensuring database backup config directory exists] ************** 2026-04-28 05:01:05.369861 | orchestrator | Tuesday 28 April 2026 05:00:58 +0000 (0:00:03.884) 0:00:21.436 ********* 2026-04-28 05:01:05.369871 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:01:05.369881 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:01:05.369890 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:01:05.369900 | orchestrator | 2026-04-28 05:01:05.369909 | orchestrator | TASK [mariadb : Copying over my.cnf for mariabackup] *************************** 2026-04-28 05:01:05.369919 | orchestrator | Tuesday 28 April 2026 05:01:00 +0000 (0:00:01.623) 0:00:23.059 ********* 2026-04-28 05:01:05.369929 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:01:05.369938 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:01:05.369948 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:01:05.369958 | orchestrator | 2026-04-28 05:01:05.369967 | orchestrator | TASK [mariadb : Copying over config.json files for services] ******************* 2026-04-28 05:01:05.369976 | orchestrator | Tuesday 28 April 2026 05:01:02 +0000 (0:00:02.127) 0:00:25.187 ********* 2026-04-28 05:01:05.369995 | orchestrator | changed: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-28 05:01:17.857972 | orchestrator | changed: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-28 05:01:17.858275 | orchestrator | changed: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-28 05:01:17.858321 | orchestrator | 2026-04-28 05:01:17.858336 | orchestrator | TASK [mariadb : Copying over config.json files for mariabackup] **************** 2026-04-28 05:01:17.858350 | orchestrator | Tuesday 28 April 2026 05:01:06 +0000 (0:00:04.325) 0:00:29.512 ********* 2026-04-28 05:01:17.858361 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:01:17.858373 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:01:17.858384 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:01:17.858395 | orchestrator | 2026-04-28 05:01:17.858406 | orchestrator | TASK [mariadb : Copying over galera.cnf] *************************************** 2026-04-28 05:01:17.858439 | orchestrator | Tuesday 28 April 2026 05:01:08 +0000 (0:00:01.964) 0:00:31.477 ********* 2026-04-28 05:01:17.858453 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:01:17.858466 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:01:17.858478 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:01:17.858491 | orchestrator | 2026-04-28 05:01:17.858504 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-28 05:01:17.858517 | orchestrator | Tuesday 28 April 2026 05:01:13 +0000 (0:00:04.977) 0:00:36.454 ********* 2026-04-28 05:01:17.858530 | orchestrator | included: /ansible/roles/mariadb/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 05:01:17.858543 | orchestrator | 2026-04-28 05:01:17.858555 | orchestrator | TASK [service-cert-copy : mariadb | Copying over extra CA certificates] ******** 2026-04-28 05:01:17.858568 | orchestrator | Tuesday 28 April 2026 05:01:15 +0000 (0:00:01.784) 0:00:38.238 ********* 2026-04-28 05:01:17.858592 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 05:01:17.858615 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:01:17.858648 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 05:01:25.101812 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:01:25.101957 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 05:01:25.101971 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:01:25.101978 | orchestrator | 2026-04-28 05:01:25.101985 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS certificate] *** 2026-04-28 05:01:25.101994 | orchestrator | Tuesday 28 April 2026 05:01:19 +0000 (0:00:04.046) 0:00:42.285 ********* 2026-04-28 05:01:25.102002 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 05:01:25.102082 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:01:25.102154 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 05:01:25.102165 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:01:25.102172 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 05:01:25.102187 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:01:25.102194 | orchestrator | 2026-04-28 05:01:25.102201 | orchestrator | TASK [service-cert-copy : mariadb | Copying over backend internal TLS key] ***** 2026-04-28 05:01:25.102208 | orchestrator | Tuesday 28 April 2026 05:01:22 +0000 (0:00:03.601) 0:00:45.886 ********* 2026-04-28 05:01:25.102227 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 05:01:30.410773 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:01:30.410913 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 05:01:30.410960 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:01:30.410973 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 05:01:30.410985 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:01:30.410996 | orchestrator | 2026-04-28 05:01:30.411008 | orchestrator | TASK [service-check-containers : mariadb | Check containers] ******************* 2026-04-28 05:01:30.411021 | orchestrator | Tuesday 28 April 2026 05:01:27 +0000 (0:00:04.167) 0:00:50.054 ********* 2026-04-28 05:01:30.411073 | orchestrator | changed: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-28 05:01:30.411097 | orchestrator | changed: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-28 05:01:30.411154 | orchestrator | changed: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}}) 2026-04-28 05:01:46.410366 | orchestrator | 2026-04-28 05:01:46.410484 | orchestrator | TASK [service-check-containers : mariadb | Notify handlers to restart containers] *** 2026-04-28 05:01:46.410501 | orchestrator | Tuesday 28 April 2026 05:01:31 +0000 (0:00:04.350) 0:00:54.405 ********* 2026-04-28 05:01:46.410514 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 05:01:46.410526 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:01:46.410537 | orchestrator | } 2026-04-28 05:01:46.410549 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 05:01:46.410560 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:01:46.410571 | orchestrator | } 2026-04-28 05:01:46.410581 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 05:01:46.410592 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:01:46.410603 | orchestrator | } 2026-04-28 05:01:46.410614 | orchestrator | 2026-04-28 05:01:46.410626 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 05:01:46.410637 | orchestrator | Tuesday 28 April 2026 05:01:32 +0000 (0:00:01.441) 0:00:55.846 ********* 2026-04-28 05:01:46.410652 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 05:01:46.410668 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:01:46.410718 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 05:01:46.410757 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 05:01:46.410770 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:01:46.410782 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:01:46.410792 | orchestrator | 2026-04-28 05:01:46.410803 | orchestrator | TASK [mariadb : Checking for mariadb cluster] ********************************** 2026-04-28 05:01:46.410814 | orchestrator | Tuesday 28 April 2026 05:01:37 +0000 (0:00:04.252) 0:01:00.099 ********* 2026-04-28 05:01:46.410825 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:01:46.410835 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:01:46.410846 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:01:46.410857 | orchestrator | 2026-04-28 05:01:46.410867 | orchestrator | TASK [mariadb : Cleaning up temp file on localhost] **************************** 2026-04-28 05:01:46.410886 | orchestrator | Tuesday 28 April 2026 05:01:39 +0000 (0:00:01.852) 0:01:01.951 ********* 2026-04-28 05:01:46.410899 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:01:46.410911 | orchestrator | 2026-04-28 05:01:46.410930 | orchestrator | TASK [mariadb : Stop MariaDB containers] *************************************** 2026-04-28 05:01:46.410943 | orchestrator | Tuesday 28 April 2026 05:01:40 +0000 (0:00:01.129) 0:01:03.081 ********* 2026-04-28 05:01:46.410956 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:01:46.410968 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:01:46.410980 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:01:46.410993 | orchestrator | 2026-04-28 05:01:46.411006 | orchestrator | TASK [mariadb : Run MariaDB wsrep recovery] ************************************ 2026-04-28 05:01:46.411019 | orchestrator | Tuesday 28 April 2026 05:01:41 +0000 (0:00:01.471) 0:01:04.552 ********* 2026-04-28 05:01:46.411032 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:01:46.411044 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:01:46.411057 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:01:46.411069 | orchestrator | 2026-04-28 05:01:46.411081 | orchestrator | TASK [mariadb : Copying MariaDB log file to /tmp] ****************************** 2026-04-28 05:01:46.411094 | orchestrator | Tuesday 28 April 2026 05:01:42 +0000 (0:00:01.338) 0:01:05.891 ********* 2026-04-28 05:01:46.411107 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:01:46.411119 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:01:46.411132 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:01:46.411144 | orchestrator | 2026-04-28 05:01:46.411214 | orchestrator | TASK [mariadb : Get MariaDB wsrep recovery seqno] ****************************** 2026-04-28 05:01:46.411233 | orchestrator | Tuesday 28 April 2026 05:01:44 +0000 (0:00:01.600) 0:01:07.492 ********* 2026-04-28 05:01:46.411250 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:01:46.411267 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:01:46.411286 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:01:46.411305 | orchestrator | 2026-04-28 05:01:46.411323 | orchestrator | TASK [mariadb : Removing MariaDB log file from /tmp] *************************** 2026-04-28 05:01:46.411335 | orchestrator | Tuesday 28 April 2026 05:01:46 +0000 (0:00:01.422) 0:01:08.915 ********* 2026-04-28 05:01:46.411346 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:01:46.411357 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:01:46.411367 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:01:46.411378 | orchestrator | 2026-04-28 05:01:46.411400 | orchestrator | TASK [mariadb : Registering MariaDB seqno variable] **************************** 2026-04-28 05:02:04.528490 | orchestrator | Tuesday 28 April 2026 05:01:47 +0000 (0:00:01.456) 0:01:10.371 ********* 2026-04-28 05:02:04.528606 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:02:04.528623 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:02:04.528635 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:02:04.528646 | orchestrator | 2026-04-28 05:02:04.528658 | orchestrator | TASK [mariadb : Comparing seqno value on all mariadb hosts] ******************** 2026-04-28 05:02:04.528669 | orchestrator | Tuesday 28 April 2026 05:01:48 +0000 (0:00:01.385) 0:01:11.757 ********* 2026-04-28 05:02:04.528680 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-28 05:02:04.528691 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-28 05:02:04.528718 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-28 05:02:04.528729 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:02:04.528740 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-28 05:02:04.528751 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-28 05:02:04.528761 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-28 05:02:04.528772 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:02:04.528783 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-28 05:02:04.528793 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-28 05:02:04.528804 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-28 05:02:04.528841 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:02:04.528853 | orchestrator | 2026-04-28 05:02:04.528864 | orchestrator | TASK [mariadb : Writing hostname of host with the largest seqno to temp file] *** 2026-04-28 05:02:04.528875 | orchestrator | Tuesday 28 April 2026 05:01:50 +0000 (0:00:01.633) 0:01:13.390 ********* 2026-04-28 05:02:04.528885 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:02:04.528896 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:02:04.528907 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:02:04.528917 | orchestrator | 2026-04-28 05:02:04.528928 | orchestrator | TASK [mariadb : Registering mariadb_recover_inventory_name from temp file] ***** 2026-04-28 05:02:04.528939 | orchestrator | Tuesday 28 April 2026 05:01:51 +0000 (0:00:01.426) 0:01:14.817 ********* 2026-04-28 05:02:04.528950 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:02:04.528960 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:02:04.528971 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:02:04.528981 | orchestrator | 2026-04-28 05:02:04.528992 | orchestrator | TASK [mariadb : Store bootstrap and master hostnames into facts] *************** 2026-04-28 05:02:04.529003 | orchestrator | Tuesday 28 April 2026 05:01:53 +0000 (0:00:01.452) 0:01:16.269 ********* 2026-04-28 05:02:04.529015 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:02:04.529025 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:02:04.529036 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:02:04.529047 | orchestrator | 2026-04-28 05:02:04.529058 | orchestrator | TASK [mariadb : Set grastate.dat file from MariaDB container in bootstrap host] *** 2026-04-28 05:02:04.529069 | orchestrator | Tuesday 28 April 2026 05:01:54 +0000 (0:00:01.342) 0:01:17.612 ********* 2026-04-28 05:02:04.529080 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:02:04.529095 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:02:04.529114 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:02:04.529133 | orchestrator | 2026-04-28 05:02:04.529152 | orchestrator | TASK [mariadb : Starting first MariaDB container] ****************************** 2026-04-28 05:02:04.529170 | orchestrator | Tuesday 28 April 2026 05:01:56 +0000 (0:00:01.516) 0:01:19.128 ********* 2026-04-28 05:02:04.529212 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:02:04.529230 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:02:04.529247 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:02:04.529264 | orchestrator | 2026-04-28 05:02:04.529281 | orchestrator | TASK [mariadb : Wait for first MariaDB container] ****************************** 2026-04-28 05:02:04.529298 | orchestrator | Tuesday 28 April 2026 05:01:57 +0000 (0:00:01.434) 0:01:20.563 ********* 2026-04-28 05:02:04.529318 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:02:04.529356 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:02:04.529375 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:02:04.529386 | orchestrator | 2026-04-28 05:02:04.529397 | orchestrator | TASK [mariadb : Set first MariaDB container as primary] ************************ 2026-04-28 05:02:04.529408 | orchestrator | Tuesday 28 April 2026 05:01:59 +0000 (0:00:01.381) 0:01:21.944 ********* 2026-04-28 05:02:04.529419 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:02:04.529429 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:02:04.529440 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:02:04.529451 | orchestrator | 2026-04-28 05:02:04.529462 | orchestrator | TASK [mariadb : Wait for MariaDB to become operational] ************************ 2026-04-28 05:02:04.529473 | orchestrator | Tuesday 28 April 2026 05:02:00 +0000 (0:00:01.595) 0:01:23.540 ********* 2026-04-28 05:02:04.529483 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:02:04.529494 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:02:04.529505 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:02:04.529515 | orchestrator | 2026-04-28 05:02:04.529526 | orchestrator | TASK [mariadb : Restart slave MariaDB container(s)] **************************** 2026-04-28 05:02:04.529537 | orchestrator | Tuesday 28 April 2026 05:02:02 +0000 (0:00:01.382) 0:01:24.922 ********* 2026-04-28 05:02:04.529578 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 05:02:04.529606 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:02:04.529624 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 05:02:04.529637 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:02:04.529659 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 05:02:22.589697 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:02:22.589811 | orchestrator | 2026-04-28 05:02:22.589835 | orchestrator | TASK [mariadb : Wait for slave MariaDB] **************************************** 2026-04-28 05:02:22.589857 | orchestrator | Tuesday 28 April 2026 05:02:05 +0000 (0:00:03.588) 0:01:28.511 ********* 2026-04-28 05:02:22.589876 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:02:22.589897 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:02:22.589917 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:02:22.589933 | orchestrator | 2026-04-28 05:02:22.589945 | orchestrator | TASK [mariadb : Restart master MariaDB container(s)] *************************** 2026-04-28 05:02:22.589956 | orchestrator | Tuesday 28 April 2026 05:02:07 +0000 (0:00:01.445) 0:01:29.956 ********* 2026-04-28 05:02:22.589989 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.10', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 05:02:22.590088 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:02:22.590125 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.11', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 05:02:22.590138 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:02:22.590157 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'mariadb', 'value': {'container_name': 'mariadb', 'group': 'mariadb_shard_0', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328', 'volumes': ['/etc/kolla/mariadb/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/hosts:/etc/hosts:ro', '/etc/timezone:/etc/timezone:ro', 'mariadb:/var/lib/mysql', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/clustercheck'], 'timeout': '30'}, 'environment': {'MYSQL_USERNAME': 'monitor', 'MYSQL_PASSWORD': 'iek7ooth9miesodoh2ongohcaachah0I', 'MYSQL_HOST': '192.168.16.12', 'AVAILABLE_WHEN_DONOR': '1'}, 'haproxy': {'mariadb': {'enabled': True, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s', ''], 'custom_member_list': [' server testbed-node-0 192.168.16.10:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 192.168.16.11:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 192.168.16.12:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}, 'mariadb_external_lb': {'enabled': False, 'mode': 'tcp', 'port': '3306', 'listen_port': '3306', 'frontend_tcp_extra': ['option clitcpka', 'timeout client 3600s'], 'backend_tcp_extra': ['option srvtcpka', 'timeout server 3600s'], 'custom_member_list': [' server testbed-node-0 testbed-node-0:3306 check port 3306 inter 2000 rise 2 fall 5', ' server testbed-node-1 testbed-node-1:3306 check port 3306 inter 2000 rise 2 fall 5 backup', ' server testbed-node-2 testbed-node-2:3306 check port 3306 inter 2000 rise 2 fall 5 backup', '']}}}})  2026-04-28 05:02:22.590169 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:02:22.590180 | orchestrator | 2026-04-28 05:02:22.590191 | orchestrator | TASK [mariadb : Wait for master mariadb] *************************************** 2026-04-28 05:02:22.590209 | orchestrator | Tuesday 28 April 2026 05:02:10 +0000 (0:00:03.672) 0:01:33.629 ********* 2026-04-28 05:02:22.590258 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:02:22.590279 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:02:22.590300 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:02:22.590319 | orchestrator | 2026-04-28 05:02:22.590340 | orchestrator | TASK [service-check : mariadb | Get container facts] *************************** 2026-04-28 05:02:22.590354 | orchestrator | Tuesday 28 April 2026 05:02:12 +0000 (0:00:01.804) 0:01:35.434 ********* 2026-04-28 05:02:22.590367 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:02:22.590379 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:02:22.590391 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:02:22.590404 | orchestrator | 2026-04-28 05:02:22.590417 | orchestrator | TASK [service-check : mariadb | Fail if containers are missing or not running] *** 2026-04-28 05:02:22.590430 | orchestrator | Tuesday 28 April 2026 05:02:13 +0000 (0:00:01.390) 0:01:36.824 ********* 2026-04-28 05:02:22.590443 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:02:22.590455 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:02:22.590467 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:02:22.590479 | orchestrator | 2026-04-28 05:02:22.590491 | orchestrator | TASK [service-check : mariadb | Fail if containers are unhealthy] ************** 2026-04-28 05:02:22.590504 | orchestrator | Tuesday 28 April 2026 05:02:15 +0000 (0:00:01.520) 0:01:38.344 ********* 2026-04-28 05:02:22.590517 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:02:22.590529 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:02:22.590542 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:02:22.590554 | orchestrator | 2026-04-28 05:02:22.590567 | orchestrator | TASK [mariadb : Wait for MariaDB service to be ready through VIP] ************** 2026-04-28 05:02:22.590579 | orchestrator | Tuesday 28 April 2026 05:02:17 +0000 (0:00:01.830) 0:01:40.175 ********* 2026-04-28 05:02:22.590593 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:02:22.590605 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:02:22.590617 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:02:22.590628 | orchestrator | 2026-04-28 05:02:22.590639 | orchestrator | TASK [mariadb : Create MariaDB volume] ***************************************** 2026-04-28 05:02:22.590650 | orchestrator | Tuesday 28 April 2026 05:02:19 +0000 (0:00:01.723) 0:01:41.899 ********* 2026-04-28 05:02:22.590661 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:02:22.590673 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:02:22.590683 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:02:22.590694 | orchestrator | 2026-04-28 05:02:22.590705 | orchestrator | TASK [mariadb : Divide hosts by their MariaDB volume availability] ************* 2026-04-28 05:02:22.590716 | orchestrator | Tuesday 28 April 2026 05:02:21 +0000 (0:00:02.091) 0:01:43.990 ********* 2026-04-28 05:02:22.590726 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:02:22.590737 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:02:22.590748 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:02:22.590759 | orchestrator | 2026-04-28 05:02:22.590770 | orchestrator | TASK [mariadb : Establish whether the cluster has already existed] ************* 2026-04-28 05:02:22.590781 | orchestrator | Tuesday 28 April 2026 05:02:22 +0000 (0:00:01.360) 0:01:45.350 ********* 2026-04-28 05:02:22.590799 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:05:00.742602 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:05:00.742722 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:05:00.742738 | orchestrator | 2026-04-28 05:05:00.742752 | orchestrator | TASK [mariadb : Check MariaDB service port liveness] *************************** 2026-04-28 05:05:00.742764 | orchestrator | Tuesday 28 April 2026 05:02:23 +0000 (0:00:01.354) 0:01:46.705 ********* 2026-04-28 05:05:00.742776 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:05:00.742787 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:05:00.742797 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:05:00.742808 | orchestrator | 2026-04-28 05:05:00.742819 | orchestrator | TASK [mariadb : Divide hosts by their MariaDB service port liveness] *********** 2026-04-28 05:05:00.742830 | orchestrator | Tuesday 28 April 2026 05:02:25 +0000 (0:00:01.865) 0:01:48.571 ********* 2026-04-28 05:05:00.742871 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:05:00.742883 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:05:00.742894 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:05:00.742904 | orchestrator | 2026-04-28 05:05:00.742915 | orchestrator | TASK [mariadb : Fail on existing but stopped cluster] ************************** 2026-04-28 05:05:00.742925 | orchestrator | Tuesday 28 April 2026 05:02:27 +0000 (0:00:01.593) 0:01:50.164 ********* 2026-04-28 05:05:00.742936 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:05:00.742948 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:05:00.742959 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:05:00.742969 | orchestrator | 2026-04-28 05:05:00.742980 | orchestrator | TASK [mariadb : Check MariaDB service WSREP sync status] *********************** 2026-04-28 05:05:00.742991 | orchestrator | Tuesday 28 April 2026 05:02:28 +0000 (0:00:01.381) 0:01:51.546 ********* 2026-04-28 05:05:00.743002 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:05:00.743012 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:05:00.743023 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:05:00.743034 | orchestrator | 2026-04-28 05:05:00.743044 | orchestrator | TASK [mariadb : Extract MariaDB service WSREP sync status] ********************* 2026-04-28 05:05:00.743055 | orchestrator | Tuesday 28 April 2026 05:02:32 +0000 (0:00:03.414) 0:01:54.961 ********* 2026-04-28 05:05:00.743065 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:05:00.743076 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:05:00.743086 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:05:00.743097 | orchestrator | 2026-04-28 05:05:00.743108 | orchestrator | TASK [mariadb : Divide hosts by their MariaDB service WSREP sync status] ******* 2026-04-28 05:05:00.743122 | orchestrator | Tuesday 28 April 2026 05:02:33 +0000 (0:00:01.358) 0:01:56.320 ********* 2026-04-28 05:05:00.743134 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:05:00.743148 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:05:00.743160 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:05:00.743173 | orchestrator | 2026-04-28 05:05:00.743186 | orchestrator | TASK [mariadb : Fail when MariaDB services are not synced across the whole cluster] *** 2026-04-28 05:05:00.743200 | orchestrator | Tuesday 28 April 2026 05:02:35 +0000 (0:00:01.626) 0:01:57.947 ********* 2026-04-28 05:05:00.743212 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:05:00.743225 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:05:00.743276 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:05:00.743290 | orchestrator | 2026-04-28 05:05:00.743303 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-28 05:05:00.743317 | orchestrator | Tuesday 28 April 2026 05:02:36 +0000 (0:00:01.803) 0:01:59.751 ********* 2026-04-28 05:05:00.743329 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:05:00.743342 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:05:00.743355 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:05:00.743408 | orchestrator | 2026-04-28 05:05:00.743422 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-28 05:05:00.743434 | orchestrator | Tuesday 28 April 2026 05:02:38 +0000 (0:00:01.432) 0:02:01.183 ********* 2026-04-28 05:05:00.743445 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:05:00.743455 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:05:00.743466 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:05:00.743477 | orchestrator | 2026-04-28 05:05:00.743487 | orchestrator | RUNNING HANDLER [mariadb : Restart MariaDB on existing cluster members] ******** 2026-04-28 05:05:00.743498 | orchestrator | Tuesday 28 April 2026 05:02:40 +0000 (0:00:01.764) 0:02:02.948 ********* 2026-04-28 05:05:00.743509 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:05:00.743519 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:05:00.743530 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:05:00.743541 | orchestrator | 2026-04-28 05:05:00.743551 | orchestrator | RUNNING HANDLER [mariadb : Start MariaDB on new nodes] ************************* 2026-04-28 05:05:00.743562 | orchestrator | Tuesday 28 April 2026 05:02:41 +0000 (0:00:01.399) 0:02:04.347 ********* 2026-04-28 05:05:00.743573 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:05:00.743593 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:05:00.743604 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:05:00.743615 | orchestrator | 2026-04-28 05:05:00.743625 | orchestrator | PLAY [Restart mariadb services] ************************************************ 2026-04-28 05:05:00.743636 | orchestrator | 2026-04-28 05:05:00.743647 | orchestrator | TASK [mariadb : Restart MariaDB container] ************************************* 2026-04-28 05:05:00.743657 | orchestrator | Tuesday 28 April 2026 05:02:43 +0000 (0:00:02.360) 0:02:06.708 ********* 2026-04-28 05:05:00.743668 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:05:00.743679 | orchestrator | 2026-04-28 05:05:00.743689 | orchestrator | TASK [mariadb : Wait for MariaDB service port liveness] ************************ 2026-04-28 05:05:00.743700 | orchestrator | Tuesday 28 April 2026 05:03:08 +0000 (0:00:24.280) 0:02:30.989 ********* 2026-04-28 05:05:00.743710 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:05:00.743721 | orchestrator | 2026-04-28 05:05:00.743732 | orchestrator | TASK [mariadb : Wait for MariaDB service to sync WSREP] ************************ 2026-04-28 05:05:00.743742 | orchestrator | Tuesday 28 April 2026 05:03:13 +0000 (0:00:05.623) 0:02:36.613 ********* 2026-04-28 05:05:00.743753 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:05:00.743764 | orchestrator | 2026-04-28 05:05:00.743774 | orchestrator | PLAY [Restart mariadb services] ************************************************ 2026-04-28 05:05:00.743785 | orchestrator | 2026-04-28 05:05:00.743795 | orchestrator | TASK [mariadb : Restart MariaDB container] ************************************* 2026-04-28 05:05:00.743806 | orchestrator | Tuesday 28 April 2026 05:03:16 +0000 (0:00:02.928) 0:02:39.541 ********* 2026-04-28 05:05:00.743817 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:05:00.743827 | orchestrator | 2026-04-28 05:05:00.743838 | orchestrator | TASK [mariadb : Wait for MariaDB service port liveness] ************************ 2026-04-28 05:05:00.743866 | orchestrator | Tuesday 28 April 2026 05:03:42 +0000 (0:00:25.647) 0:03:05.189 ********* 2026-04-28 05:05:00.743878 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Wait for MariaDB service port liveness (10 retries left). 2026-04-28 05:05:00.743891 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:05:00.743901 | orchestrator | 2026-04-28 05:05:00.743912 | orchestrator | TASK [mariadb : Wait for MariaDB service to sync WSREP] ************************ 2026-04-28 05:05:00.743923 | orchestrator | Tuesday 28 April 2026 05:03:50 +0000 (0:00:07.907) 0:03:13.097 ********* 2026-04-28 05:05:00.743933 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:05:00.743944 | orchestrator | 2026-04-28 05:05:00.743954 | orchestrator | PLAY [Restart mariadb services] ************************************************ 2026-04-28 05:05:00.743965 | orchestrator | 2026-04-28 05:05:00.743976 | orchestrator | TASK [mariadb : Restart MariaDB container] ************************************* 2026-04-28 05:05:00.743986 | orchestrator | Tuesday 28 April 2026 05:03:53 +0000 (0:00:02.989) 0:03:16.087 ********* 2026-04-28 05:05:00.743997 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:05:00.744007 | orchestrator | 2026-04-28 05:05:00.744018 | orchestrator | TASK [mariadb : Wait for MariaDB service port liveness] ************************ 2026-04-28 05:05:00.744029 | orchestrator | Tuesday 28 April 2026 05:04:19 +0000 (0:00:26.714) 0:03:42.801 ********* 2026-04-28 05:05:00.744039 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Wait for MariaDB service port liveness (10 retries left). 2026-04-28 05:05:00.744050 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:05:00.744060 | orchestrator | 2026-04-28 05:05:00.744071 | orchestrator | TASK [mariadb : Wait for MariaDB service to sync WSREP] ************************ 2026-04-28 05:05:00.744081 | orchestrator | Tuesday 28 April 2026 05:04:27 +0000 (0:00:08.017) 0:03:50.819 ********* 2026-04-28 05:05:00.744092 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:05:00.744103 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: mariadb_start 2026-04-28 05:05:00.744113 | orchestrator | 2026-04-28 05:05:00.744124 | orchestrator | PLAY [Start mariadb services] ************************************************** 2026-04-28 05:05:00.744134 | orchestrator | skipping: no hosts matched 2026-04-28 05:05:00.744145 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: 2026-04-28 05:05:00.744163 | orchestrator | mariadb_bootstrap_restart 2026-04-28 05:05:00.744173 | orchestrator | 2026-04-28 05:05:00.744184 | orchestrator | PLAY [Restart bootstrap mariadb service] *************************************** 2026-04-28 05:05:00.744195 | orchestrator | skipping: no hosts matched 2026-04-28 05:05:00.744205 | orchestrator | 2026-04-28 05:05:00.744216 | orchestrator | PLAY [Apply mariadb post-configuration] **************************************** 2026-04-28 05:05:00.744226 | orchestrator | 2026-04-28 05:05:00.744237 | orchestrator | TASK [Include mariadb post-deploy.yml] ***************************************** 2026-04-28 05:05:00.744253 | orchestrator | Tuesday 28 April 2026 05:04:31 +0000 (0:00:03.992) 0:03:54.812 ********* 2026-04-28 05:05:00.744264 | orchestrator | included: mariadb for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 05:05:00.744275 | orchestrator | 2026-04-28 05:05:00.744286 | orchestrator | TASK [mariadb : Creating shard root mysql user] ******************************** 2026-04-28 05:05:00.744297 | orchestrator | Tuesday 28 April 2026 05:04:33 +0000 (0:00:01.663) 0:03:56.476 ********* 2026-04-28 05:05:00.744307 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:05:00.744318 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:05:00.744328 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:05:00.744339 | orchestrator | 2026-04-28 05:05:00.744350 | orchestrator | TASK [mariadb : Creating mysql monitor user] *********************************** 2026-04-28 05:05:00.744377 | orchestrator | Tuesday 28 April 2026 05:04:36 +0000 (0:00:03.063) 0:03:59.540 ********* 2026-04-28 05:05:00.744388 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:05:00.744399 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:05:00.744410 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:05:00.744420 | orchestrator | 2026-04-28 05:05:00.744431 | orchestrator | TASK [mariadb : Creating database backup user and setting permissions] ********* 2026-04-28 05:05:00.744442 | orchestrator | Tuesday 28 April 2026 05:04:39 +0000 (0:00:03.156) 0:04:02.697 ********* 2026-04-28 05:05:00.744453 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:05:00.744463 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:05:00.744474 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:05:00.744485 | orchestrator | 2026-04-28 05:05:00.744496 | orchestrator | TASK [mariadb : Granting permissions on Mariabackup database to backup user] *** 2026-04-28 05:05:00.744506 | orchestrator | Tuesday 28 April 2026 05:04:42 +0000 (0:00:03.152) 0:04:05.849 ********* 2026-04-28 05:05:00.744517 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:05:00.744528 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:05:00.744539 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:05:00.744550 | orchestrator | 2026-04-28 05:05:00.744561 | orchestrator | TASK [service-check : mariadb | Get container facts] *************************** 2026-04-28 05:05:00.744572 | orchestrator | Tuesday 28 April 2026 05:04:46 +0000 (0:00:03.227) 0:04:09.076 ********* 2026-04-28 05:05:00.744582 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:05:00.744593 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:05:00.744604 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:05:00.744615 | orchestrator | 2026-04-28 05:05:00.744626 | orchestrator | TASK [service-check : mariadb | Fail if containers are missing or not running] *** 2026-04-28 05:05:00.744636 | orchestrator | Tuesday 28 April 2026 05:04:52 +0000 (0:00:06.744) 0:04:15.821 ********* 2026-04-28 05:05:00.744647 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:05:00.744658 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:05:00.744669 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:05:00.744680 | orchestrator | 2026-04-28 05:05:00.744690 | orchestrator | TASK [service-check : mariadb | Fail if containers are unhealthy] ************** 2026-04-28 05:05:00.744701 | orchestrator | Tuesday 28 April 2026 05:04:56 +0000 (0:00:03.492) 0:04:19.314 ********* 2026-04-28 05:05:00.744712 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:05:00.744722 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:05:00.744733 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:05:00.744744 | orchestrator | 2026-04-28 05:05:00.744754 | orchestrator | TASK [mariadb : Wait for MariaDB service to be ready through VIP] ************** 2026-04-28 05:05:00.744765 | orchestrator | Tuesday 28 April 2026 05:04:57 +0000 (0:00:01.430) 0:04:20.744 ********* 2026-04-28 05:05:00.744783 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:05:00.744794 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:05:00.744805 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:05:00.744815 | orchestrator | 2026-04-28 05:05:00.744833 | orchestrator | TASK [Include mariadb post-upgrade.yml] **************************************** 2026-04-28 05:05:20.708870 | orchestrator | Tuesday 28 April 2026 05:05:01 +0000 (0:00:03.658) 0:04:24.403 ********* 2026-04-28 05:05:20.708986 | orchestrator | included: mariadb for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 05:05:20.709001 | orchestrator | 2026-04-28 05:05:20.709013 | orchestrator | TASK [mariadb : Run upgrade in MariaDB container] ****************************** 2026-04-28 05:05:20.709024 | orchestrator | Tuesday 28 April 2026 05:05:03 +0000 (0:00:01.915) 0:04:26.319 ********* 2026-04-28 05:05:20.709035 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:05:20.709048 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:05:20.709058 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:05:20.709069 | orchestrator | 2026-04-28 05:05:20.709081 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 05:05:20.709093 | orchestrator | testbed-node-0 : ok=35  changed=8  unreachable=0 failed=0 skipped=36  rescued=0 ignored=0 2026-04-28 05:05:20.709105 | orchestrator | testbed-node-1 : ok=27  changed=6  unreachable=0 failed=0 skipped=42  rescued=0 ignored=0 2026-04-28 05:05:20.709116 | orchestrator | testbed-node-2 : ok=27  changed=6  unreachable=0 failed=0 skipped=42  rescued=0 ignored=0 2026-04-28 05:05:20.709127 | orchestrator | 2026-04-28 05:05:20.709138 | orchestrator | 2026-04-28 05:05:20.709149 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 05:05:20.709160 | orchestrator | Tuesday 28 April 2026 05:05:20 +0000 (0:00:16.925) 0:04:43.244 ********* 2026-04-28 05:05:20.709171 | orchestrator | =============================================================================== 2026-04-28 05:05:20.709182 | orchestrator | mariadb : Restart MariaDB container ------------------------------------ 76.64s 2026-04-28 05:05:20.709192 | orchestrator | mariadb : Wait for MariaDB service port liveness ----------------------- 21.55s 2026-04-28 05:05:20.709203 | orchestrator | mariadb : Run upgrade in MariaDB container ----------------------------- 16.93s 2026-04-28 05:05:20.709214 | orchestrator | mariadb : Wait for MariaDB service to sync WSREP ------------------------ 9.91s 2026-04-28 05:05:20.709224 | orchestrator | Group hosts based on enabled services ----------------------------------- 7.26s 2026-04-28 05:05:20.709252 | orchestrator | service-check : mariadb | Get container facts --------------------------- 6.74s 2026-04-28 05:05:20.709264 | orchestrator | mariadb : Copying over galera.cnf --------------------------------------- 4.98s 2026-04-28 05:05:20.709275 | orchestrator | service-check-containers : mariadb | Check containers ------------------- 4.35s 2026-04-28 05:05:20.709285 | orchestrator | mariadb : Copying over config.json files for services ------------------- 4.33s 2026-04-28 05:05:20.709296 | orchestrator | service-check-containers : Include tasks -------------------------------- 4.25s 2026-04-28 05:05:20.709307 | orchestrator | service-cert-copy : mariadb | Copying over backend internal TLS key ----- 4.17s 2026-04-28 05:05:20.709317 | orchestrator | service-cert-copy : mariadb | Copying over extra CA certificates -------- 4.05s 2026-04-28 05:05:20.709328 | orchestrator | mariadb : Ensuring config directories exist ----------------------------- 3.89s 2026-04-28 05:05:20.709339 | orchestrator | mariadb : Restart master MariaDB container(s) --------------------------- 3.67s 2026-04-28 05:05:20.709349 | orchestrator | mariadb : Wait for MariaDB service to be ready through VIP -------------- 3.66s 2026-04-28 05:05:20.709360 | orchestrator | service-cert-copy : mariadb | Copying over backend internal TLS certificate --- 3.60s 2026-04-28 05:05:20.709371 | orchestrator | mariadb : Restart slave MariaDB container(s) ---------------------------- 3.59s 2026-04-28 05:05:20.709415 | orchestrator | service-check : mariadb | Fail if containers are missing or not running --- 3.49s 2026-04-28 05:05:20.709466 | orchestrator | mariadb : Check MariaDB service WSREP sync status ----------------------- 3.41s 2026-04-28 05:05:20.709486 | orchestrator | mariadb : Granting permissions on Mariabackup database to backup user --- 3.23s 2026-04-28 05:05:20.902357 | orchestrator | + osism apply -a upgrade rabbitmq 2026-04-28 05:05:22.205679 | orchestrator | 2026-04-28 05:05:22 | INFO  | Prepare task for execution of rabbitmq. 2026-04-28 05:05:22.272803 | orchestrator | 2026-04-28 05:05:22 | INFO  | Task fe364934-ca5b-46a2-b950-47ef4b71df14 (rabbitmq) was prepared for execution. 2026-04-28 05:05:22.272886 | orchestrator | 2026-04-28 05:05:22 | INFO  | It takes a moment until task fe364934-ca5b-46a2-b950-47ef4b71df14 (rabbitmq) has been started and output is visible here. 2026-04-28 05:05:50.140607 | orchestrator | 2026-04-28 05:05:50.140726 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 05:05:50.140743 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-28 05:05:50.140757 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-28 05:05:50.140780 | orchestrator | 2026-04-28 05:05:50.140791 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 05:05:50.140802 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-28 05:05:50.140813 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-28 05:05:50.140835 | orchestrator | Tuesday 28 April 2026 05:05:26 +0000 (0:00:01.434) 0:00:01.434 ********* 2026-04-28 05:05:50.140846 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:05:50.140859 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:05:50.140870 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:05:50.140882 | orchestrator | 2026-04-28 05:05:50.140894 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 05:05:50.140905 | orchestrator | Tuesday 28 April 2026 05:05:27 +0000 (0:00:00.906) 0:00:02.340 ********* 2026-04-28 05:05:50.140916 | orchestrator | ok: [testbed-node-0] => (item=enable_rabbitmq_True) 2026-04-28 05:05:50.140928 | orchestrator | ok: [testbed-node-1] => (item=enable_rabbitmq_True) 2026-04-28 05:05:50.140939 | orchestrator | ok: [testbed-node-2] => (item=enable_rabbitmq_True) 2026-04-28 05:05:50.140950 | orchestrator | 2026-04-28 05:05:50.140961 | orchestrator | PLAY [Apply role rabbitmq] ***************************************************** 2026-04-28 05:05:50.140972 | orchestrator | 2026-04-28 05:05:50.140983 | orchestrator | TASK [rabbitmq : include_tasks] ************************************************ 2026-04-28 05:05:50.140994 | orchestrator | Tuesday 28 April 2026 05:05:28 +0000 (0:00:01.066) 0:00:03.407 ********* 2026-04-28 05:05:50.141005 | orchestrator | included: /ansible/roles/rabbitmq/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 05:05:50.141016 | orchestrator | 2026-04-28 05:05:50.141027 | orchestrator | TASK [rabbitmq : Get container facts] ****************************************** 2026-04-28 05:05:50.141038 | orchestrator | Tuesday 28 April 2026 05:05:30 +0000 (0:00:01.183) 0:00:04.590 ********* 2026-04-28 05:05:50.141049 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:05:50.141060 | orchestrator | 2026-04-28 05:05:50.141071 | orchestrator | TASK [rabbitmq : Get current RabbitMQ version] ********************************* 2026-04-28 05:05:50.141082 | orchestrator | Tuesday 28 April 2026 05:05:31 +0000 (0:00:01.634) 0:00:06.225 ********* 2026-04-28 05:05:50.141093 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:05:50.141104 | orchestrator | 2026-04-28 05:05:50.141115 | orchestrator | TASK [rabbitmq : Get new RabbitMQ version] ************************************* 2026-04-28 05:05:50.141126 | orchestrator | Tuesday 28 April 2026 05:05:33 +0000 (0:00:01.891) 0:00:08.117 ********* 2026-04-28 05:05:50.141137 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:05:50.141148 | orchestrator | 2026-04-28 05:05:50.141159 | orchestrator | TASK [rabbitmq : Check if running RabbitMQ is at most one version behind] ****** 2026-04-28 05:05:50.141194 | orchestrator | Tuesday 28 April 2026 05:05:41 +0000 (0:00:08.009) 0:00:16.126 ********* 2026-04-28 05:05:50.141205 | orchestrator | ok: [testbed-node-0] => { 2026-04-28 05:05:50.141216 | orchestrator |  "changed": false, 2026-04-28 05:05:50.141228 | orchestrator |  "msg": "All assertions passed" 2026-04-28 05:05:50.141239 | orchestrator | } 2026-04-28 05:05:50.141250 | orchestrator | 2026-04-28 05:05:50.141262 | orchestrator | TASK [rabbitmq : Catch when RabbitMQ is being downgraded] ********************** 2026-04-28 05:05:50.141287 | orchestrator | Tuesday 28 April 2026 05:05:42 +0000 (0:00:00.353) 0:00:16.480 ********* 2026-04-28 05:05:50.141323 | orchestrator | ok: [testbed-node-0] => { 2026-04-28 05:05:50.141335 | orchestrator |  "changed": false, 2026-04-28 05:05:50.141346 | orchestrator |  "msg": "All assertions passed" 2026-04-28 05:05:50.141357 | orchestrator | } 2026-04-28 05:05:50.141367 | orchestrator | 2026-04-28 05:05:50.141378 | orchestrator | TASK [rabbitmq : include_tasks] ************************************************ 2026-04-28 05:05:50.141389 | orchestrator | Tuesday 28 April 2026 05:05:42 +0000 (0:00:00.714) 0:00:17.194 ********* 2026-04-28 05:05:50.141400 | orchestrator | included: /ansible/roles/rabbitmq/tasks/remove-ha-all-policy.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 05:05:50.141439 | orchestrator | 2026-04-28 05:05:50.141451 | orchestrator | TASK [rabbitmq : Get container facts] ****************************************** 2026-04-28 05:05:50.141462 | orchestrator | Tuesday 28 April 2026 05:05:43 +0000 (0:00:01.115) 0:00:18.309 ********* 2026-04-28 05:05:50.141472 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:05:50.141483 | orchestrator | 2026-04-28 05:05:50.141494 | orchestrator | TASK [rabbitmq : List RabbitMQ policies] *************************************** 2026-04-28 05:05:50.141504 | orchestrator | Tuesday 28 April 2026 05:05:45 +0000 (0:00:01.274) 0:00:19.584 ********* 2026-04-28 05:05:50.141515 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:05:50.141526 | orchestrator | 2026-04-28 05:05:50.141537 | orchestrator | TASK [rabbitmq : Remove ha-all policy from RabbitMQ] *************************** 2026-04-28 05:05:50.141548 | orchestrator | Tuesday 28 April 2026 05:05:47 +0000 (0:00:01.927) 0:00:21.511 ********* 2026-04-28 05:05:50.141559 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:05:50.141570 | orchestrator | 2026-04-28 05:05:50.141580 | orchestrator | TASK [rabbitmq : Ensuring config directories exist] **************************** 2026-04-28 05:05:50.141591 | orchestrator | Tuesday 28 April 2026 05:05:47 +0000 (0:00:00.654) 0:00:22.165 ********* 2026-04-28 05:05:50.141628 | orchestrator | ok: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 05:05:50.141646 | orchestrator | ok: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 05:05:50.141675 | orchestrator | ok: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 05:05:50.141687 | orchestrator | 2026-04-28 05:05:50.141698 | orchestrator | TASK [rabbitmq : Copying over config.json files for services] ****************** 2026-04-28 05:05:50.141709 | orchestrator | Tuesday 28 April 2026 05:05:48 +0000 (0:00:01.159) 0:00:23.325 ********* 2026-04-28 05:05:50.141729 | orchestrator | changed: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 05:06:01.313242 | orchestrator | changed: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 05:06:01.313380 | orchestrator | changed: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 05:06:01.313397 | orchestrator | 2026-04-28 05:06:01.313410 | orchestrator | TASK [rabbitmq : Copying over rabbitmq-env.conf] ******************************* 2026-04-28 05:06:01.313466 | orchestrator | Tuesday 28 April 2026 05:05:50 +0000 (0:00:01.545) 0:00:24.871 ********* 2026-04-28 05:06:01.313476 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/rabbitmq-env.conf.j2) 2026-04-28 05:06:01.313502 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/rabbitmq-env.conf.j2) 2026-04-28 05:06:01.313512 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/rabbitmq-env.conf.j2) 2026-04-28 05:06:01.313521 | orchestrator | 2026-04-28 05:06:01.313531 | orchestrator | TASK [rabbitmq : Copying over rabbitmq.conf] *********************************** 2026-04-28 05:06:01.313541 | orchestrator | Tuesday 28 April 2026 05:05:51 +0000 (0:00:01.405) 0:00:26.276 ********* 2026-04-28 05:06:01.313550 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/rabbitmq.conf.j2) 2026-04-28 05:06:01.313559 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/rabbitmq.conf.j2) 2026-04-28 05:06:01.313569 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/rabbitmq.conf.j2) 2026-04-28 05:06:01.313578 | orchestrator | 2026-04-28 05:06:01.313588 | orchestrator | TASK [rabbitmq : Copying over erl_inetrc] ************************************** 2026-04-28 05:06:01.313597 | orchestrator | Tuesday 28 April 2026 05:05:53 +0000 (0:00:01.669) 0:00:27.946 ********* 2026-04-28 05:06:01.313607 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/erl_inetrc.j2) 2026-04-28 05:06:01.313616 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/erl_inetrc.j2) 2026-04-28 05:06:01.313626 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/erl_inetrc.j2) 2026-04-28 05:06:01.313636 | orchestrator | 2026-04-28 05:06:01.313645 | orchestrator | TASK [rabbitmq : Copying over advanced.config] ********************************* 2026-04-28 05:06:01.313655 | orchestrator | Tuesday 28 April 2026 05:05:54 +0000 (0:00:01.360) 0:00:29.306 ********* 2026-04-28 05:06:01.313665 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/advanced.config.j2) 2026-04-28 05:06:01.313674 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/advanced.config.j2) 2026-04-28 05:06:01.313683 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/advanced.config.j2) 2026-04-28 05:06:01.313693 | orchestrator | 2026-04-28 05:06:01.313702 | orchestrator | TASK [rabbitmq : Copying over definitions.json] ******************************** 2026-04-28 05:06:01.313729 | orchestrator | Tuesday 28 April 2026 05:05:56 +0000 (0:00:01.590) 0:00:30.897 ********* 2026-04-28 05:06:01.313739 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/definitions.json.j2) 2026-04-28 05:06:01.313749 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/definitions.json.j2) 2026-04-28 05:06:01.313766 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/definitions.json.j2) 2026-04-28 05:06:01.313778 | orchestrator | 2026-04-28 05:06:01.313789 | orchestrator | TASK [rabbitmq : Copying over enabled_plugins] ********************************* 2026-04-28 05:06:01.313800 | orchestrator | Tuesday 28 April 2026 05:05:57 +0000 (0:00:01.268) 0:00:32.166 ********* 2026-04-28 05:06:01.313812 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/rabbitmq/templates/enabled_plugins.j2) 2026-04-28 05:06:01.313823 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/rabbitmq/templates/enabled_plugins.j2) 2026-04-28 05:06:01.313834 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/rabbitmq/templates/enabled_plugins.j2) 2026-04-28 05:06:01.313845 | orchestrator | 2026-04-28 05:06:01.313856 | orchestrator | TASK [rabbitmq : include_tasks] ************************************************ 2026-04-28 05:06:01.313868 | orchestrator | Tuesday 28 April 2026 05:05:59 +0000 (0:00:01.305) 0:00:33.471 ********* 2026-04-28 05:06:01.313880 | orchestrator | included: /ansible/roles/rabbitmq/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 05:06:01.313892 | orchestrator | 2026-04-28 05:06:01.313903 | orchestrator | TASK [service-cert-copy : rabbitmq | Copying over extra CA certificates] ******* 2026-04-28 05:06:01.313914 | orchestrator | Tuesday 28 April 2026 05:06:00 +0000 (0:00:01.129) 0:00:34.600 ********* 2026-04-28 05:06:01.313927 | orchestrator | changed: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 05:06:01.313946 | orchestrator | changed: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 05:06:01.313968 | orchestrator | changed: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 05:06:06.607939 | orchestrator | 2026-04-28 05:06:06.608074 | orchestrator | TASK [service-cert-copy : rabbitmq | Copying over backend internal TLS certificate] *** 2026-04-28 05:06:06.608093 | orchestrator | Tuesday 28 April 2026 05:06:01 +0000 (0:00:01.238) 0:00:35.838 ********* 2026-04-28 05:06:06.608110 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-28 05:06:06.608126 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:06:06.608156 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-28 05:06:06.608169 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:06:06.608180 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-28 05:06:06.608213 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:06:06.608225 | orchestrator | 2026-04-28 05:06:06.608236 | orchestrator | TASK [service-cert-copy : rabbitmq | Copying over backend internal TLS key] **** 2026-04-28 05:06:06.608247 | orchestrator | Tuesday 28 April 2026 05:06:01 +0000 (0:00:00.441) 0:00:36.280 ********* 2026-04-28 05:06:06.608282 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-28 05:06:06.608296 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-28 05:06:06.608309 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:06:06.608320 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:06:06.608337 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-28 05:06:06.608357 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:06:06.608368 | orchestrator | 2026-04-28 05:06:06.608379 | orchestrator | TASK [rabbitmq : Enable all stable feature flags] ****************************** 2026-04-28 05:06:06.608390 | orchestrator | Tuesday 28 April 2026 05:06:03 +0000 (0:00:01.189) 0:00:37.470 ********* 2026-04-28 05:06:06.608401 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:06:06.608413 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:06:06.608457 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:06:06.608472 | orchestrator | 2026-04-28 05:06:06.608486 | orchestrator | TASK [service-check-containers : rabbitmq | Check containers] ****************** 2026-04-28 05:06:06.608499 | orchestrator | Tuesday 28 April 2026 05:06:05 +0000 (0:00:02.685) 0:00:40.156 ********* 2026-04-28 05:06:06.608523 | orchestrator | changed: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 05:06:56.387899 | orchestrator | changed: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 05:06:56.388075 | orchestrator | changed: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}}) 2026-04-28 05:06:56.388093 | orchestrator | 2026-04-28 05:06:56.388133 | orchestrator | TASK [service-check-containers : rabbitmq | Notify handlers to restart containers] *** 2026-04-28 05:06:56.388146 | orchestrator | Tuesday 28 April 2026 05:06:06 +0000 (0:00:01.203) 0:00:41.359 ********* 2026-04-28 05:06:56.388158 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 05:06:56.388170 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:06:56.388182 | orchestrator | } 2026-04-28 05:06:56.388192 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 05:06:56.388203 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:06:56.388213 | orchestrator | } 2026-04-28 05:06:56.388224 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 05:06:56.388235 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:06:56.388245 | orchestrator | } 2026-04-28 05:06:56.388256 | orchestrator | 2026-04-28 05:06:56.388267 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 05:06:56.388278 | orchestrator | Tuesday 28 April 2026 05:06:07 +0000 (0:00:00.548) 0:00:41.908 ********* 2026-04-28 05:06:56.388290 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-28 05:06:56.388302 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:06:56.388336 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-28 05:06:56.388349 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:06:56.388366 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'zdd6geSBXefcI7IoHnP1U1fxtRWS3u5QtnPCvQTT', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}}}})  2026-04-28 05:06:56.388387 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:06:56.388401 | orchestrator | 2026-04-28 05:06:56.388414 | orchestrator | RUNNING HANDLER [rabbitmq : Restart rabbitmq container] ************************ 2026-04-28 05:06:56.388426 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-28 05:06:56.388440 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-28 05:06:56.388494 | orchestrator | Tuesday 28 April 2026 05:06:08 +0000 (0:00:01.218) 0:00:43.127 ********* 2026-04-28 05:06:56.388507 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:06:56.388519 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:06:56.388532 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:06:56.388544 | orchestrator | 2026-04-28 05:06:56.388557 | orchestrator | PLAY [Restart rabbitmq services] *********************************************** 2026-04-28 05:06:56.388569 | orchestrator | 2026-04-28 05:06:56.388581 | orchestrator | TASK [rabbitmq : Get info on RabbitMQ container] ******************************* 2026-04-28 05:06:56.388593 | orchestrator | Tuesday 28 April 2026 05:06:09 +0000 (0:00:00.702) 0:00:43.830 ********* 2026-04-28 05:06:56.388606 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:06:56.388619 | orchestrator | 2026-04-28 05:06:56.388631 | orchestrator | TASK [rabbitmq : Put RabbitMQ node into maintenance mode] ********************** 2026-04-28 05:06:56.388644 | orchestrator | Tuesday 28 April 2026 05:06:10 +0000 (0:00:01.075) 0:00:44.906 ********* 2026-04-28 05:06:56.388657 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:06:56.388669 | orchestrator | 2026-04-28 05:06:56.388682 | orchestrator | TASK [rabbitmq : Restart rabbitmq container] *********************************** 2026-04-28 05:06:56.388695 | orchestrator | Tuesday 28 April 2026 05:06:18 +0000 (0:00:07.542) 0:00:52.449 ********* 2026-04-28 05:06:56.388707 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:06:56.388720 | orchestrator | 2026-04-28 05:06:56.388732 | orchestrator | TASK [rabbitmq : Waiting for rabbitmq to start] ******************************** 2026-04-28 05:06:56.388744 | orchestrator | Tuesday 28 April 2026 05:06:26 +0000 (0:00:07.988) 0:01:00.437 ********* 2026-04-28 05:06:56.388754 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:06:56.388765 | orchestrator | 2026-04-28 05:06:56.388776 | orchestrator | PLAY [Restart rabbitmq services] *********************************************** 2026-04-28 05:06:56.388787 | orchestrator | 2026-04-28 05:06:56.388798 | orchestrator | TASK [rabbitmq : Get info on RabbitMQ container] ******************************* 2026-04-28 05:06:56.388808 | orchestrator | Tuesday 28 April 2026 05:06:35 +0000 (0:00:09.056) 0:01:09.494 ********* 2026-04-28 05:06:56.388819 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:06:56.388830 | orchestrator | 2026-04-28 05:06:56.388841 | orchestrator | TASK [rabbitmq : Put RabbitMQ node into maintenance mode] ********************** 2026-04-28 05:06:56.388851 | orchestrator | Tuesday 28 April 2026 05:06:36 +0000 (0:00:01.059) 0:01:10.553 ********* 2026-04-28 05:06:56.388862 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:06:56.388873 | orchestrator | 2026-04-28 05:06:56.388884 | orchestrator | TASK [rabbitmq : Restart rabbitmq container] *********************************** 2026-04-28 05:06:56.388895 | orchestrator | Tuesday 28 April 2026 05:06:43 +0000 (0:00:07.232) 0:01:17.786 ********* 2026-04-28 05:06:56.388912 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:07:43.266440 | orchestrator | 2026-04-28 05:07:43.266755 | orchestrator | TASK [rabbitmq : Waiting for rabbitmq to start] ******************************** 2026-04-28 05:07:43.266774 | orchestrator | Tuesday 28 April 2026 05:06:56 +0000 (0:00:13.124) 0:01:30.910 ********* 2026-04-28 05:07:43.266787 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:07:43.266799 | orchestrator | 2026-04-28 05:07:43.266811 | orchestrator | PLAY [Restart rabbitmq services] *********************************************** 2026-04-28 05:07:43.266853 | orchestrator | 2026-04-28 05:07:43.266865 | orchestrator | TASK [rabbitmq : Get info on RabbitMQ container] ******************************* 2026-04-28 05:07:43.266876 | orchestrator | Tuesday 28 April 2026 05:07:05 +0000 (0:00:09.004) 0:01:39.915 ********* 2026-04-28 05:07:43.266887 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:07:43.266899 | orchestrator | 2026-04-28 05:07:43.266910 | orchestrator | TASK [rabbitmq : Put RabbitMQ node into maintenance mode] ********************** 2026-04-28 05:07:43.266921 | orchestrator | Tuesday 28 April 2026 05:07:06 +0000 (0:00:01.068) 0:01:40.983 ********* 2026-04-28 05:07:43.266932 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:07:43.266942 | orchestrator | 2026-04-28 05:07:43.266954 | orchestrator | TASK [rabbitmq : Restart rabbitmq container] *********************************** 2026-04-28 05:07:43.266968 | orchestrator | Tuesday 28 April 2026 05:07:14 +0000 (0:00:08.350) 0:01:49.333 ********* 2026-04-28 05:07:43.266981 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:07:43.266993 | orchestrator | 2026-04-28 05:07:43.267005 | orchestrator | TASK [rabbitmq : Waiting for rabbitmq to start] ******************************** 2026-04-28 05:07:43.267018 | orchestrator | Tuesday 28 April 2026 05:07:28 +0000 (0:00:13.606) 0:02:02.940 ********* 2026-04-28 05:07:43.267030 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:07:43.267043 | orchestrator | 2026-04-28 05:07:43.267055 | orchestrator | PLAY [Apply rabbitmq post-configuration] *************************************** 2026-04-28 05:07:43.267067 | orchestrator | 2026-04-28 05:07:43.267080 | orchestrator | TASK [Include rabbitmq post-deploy.yml] **************************************** 2026-04-28 05:07:43.267093 | orchestrator | Tuesday 28 April 2026 05:07:38 +0000 (0:00:10.101) 0:02:13.041 ********* 2026-04-28 05:07:43.267105 | orchestrator | included: rabbitmq for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 05:07:43.267117 | orchestrator | 2026-04-28 05:07:43.267130 | orchestrator | TASK [rabbitmq : Enable all stable feature flags] ****************************** 2026-04-28 05:07:43.267142 | orchestrator | Tuesday 28 April 2026 05:07:39 +0000 (0:00:00.715) 0:02:13.757 ********* 2026-04-28 05:07:43.267155 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:07:43.267167 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:07:43.267181 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:07:43.267193 | orchestrator | 2026-04-28 05:07:43.267205 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 05:07:43.267239 | orchestrator | testbed-node-0 : ok=31  changed=11  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-28 05:07:43.267253 | orchestrator | testbed-node-1 : ok=24  changed=10  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-28 05:07:43.267263 | orchestrator | testbed-node-2 : ok=24  changed=10  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-28 05:07:43.267274 | orchestrator | 2026-04-28 05:07:43.267285 | orchestrator | 2026-04-28 05:07:43.267295 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 05:07:43.267306 | orchestrator | Tuesday 28 April 2026 05:07:42 +0000 (0:00:03.528) 0:02:17.285 ********* 2026-04-28 05:07:43.267316 | orchestrator | =============================================================================== 2026-04-28 05:07:43.267327 | orchestrator | rabbitmq : Restart rabbitmq container ---------------------------------- 34.72s 2026-04-28 05:07:43.267338 | orchestrator | rabbitmq : Waiting for rabbitmq to start ------------------------------- 28.16s 2026-04-28 05:07:43.267348 | orchestrator | rabbitmq : Put RabbitMQ node into maintenance mode --------------------- 23.13s 2026-04-28 05:07:43.267359 | orchestrator | rabbitmq : Get new RabbitMQ version ------------------------------------- 8.01s 2026-04-28 05:07:43.267370 | orchestrator | rabbitmq : Enable all stable feature flags ------------------------------ 3.53s 2026-04-28 05:07:43.267381 | orchestrator | rabbitmq : Get info on RabbitMQ container ------------------------------- 3.20s 2026-04-28 05:07:43.267391 | orchestrator | rabbitmq : Enable all stable feature flags ------------------------------ 2.69s 2026-04-28 05:07:43.267411 | orchestrator | rabbitmq : List RabbitMQ policies --------------------------------------- 1.93s 2026-04-28 05:07:43.267421 | orchestrator | rabbitmq : Get current RabbitMQ version --------------------------------- 1.89s 2026-04-28 05:07:43.267432 | orchestrator | rabbitmq : Copying over rabbitmq.conf ----------------------------------- 1.67s 2026-04-28 05:07:43.267442 | orchestrator | rabbitmq : Get container facts ------------------------------------------ 1.64s 2026-04-28 05:07:43.267453 | orchestrator | rabbitmq : Copying over advanced.config --------------------------------- 1.59s 2026-04-28 05:07:43.267463 | orchestrator | rabbitmq : Copying over config.json files for services ------------------ 1.55s 2026-04-28 05:07:43.267474 | orchestrator | rabbitmq : Copying over rabbitmq-env.conf ------------------------------- 1.41s 2026-04-28 05:07:43.267484 | orchestrator | rabbitmq : Copying over erl_inetrc -------------------------------------- 1.36s 2026-04-28 05:07:43.267517 | orchestrator | rabbitmq : Copying over enabled_plugins --------------------------------- 1.31s 2026-04-28 05:07:43.267528 | orchestrator | rabbitmq : Get container facts ------------------------------------------ 1.27s 2026-04-28 05:07:43.267538 | orchestrator | rabbitmq : Copying over definitions.json -------------------------------- 1.27s 2026-04-28 05:07:43.267549 | orchestrator | service-cert-copy : rabbitmq | Copying over extra CA certificates ------- 1.24s 2026-04-28 05:07:43.267560 | orchestrator | service-check-containers : Include tasks -------------------------------- 1.22s 2026-04-28 05:07:43.452292 | orchestrator | + osism apply -a upgrade openvswitch 2026-04-28 05:07:44.732079 | orchestrator | 2026-04-28 05:07:44 | INFO  | Prepare task for execution of openvswitch. 2026-04-28 05:07:44.794869 | orchestrator | 2026-04-28 05:07:44 | INFO  | Task a3b60a2e-70eb-4aac-90a0-0c74c2439402 (openvswitch) was prepared for execution. 2026-04-28 05:07:44.794978 | orchestrator | 2026-04-28 05:07:44 | INFO  | It takes a moment until task a3b60a2e-70eb-4aac-90a0-0c74c2439402 (openvswitch) has been started and output is visible here. 2026-04-28 05:08:10.869833 | orchestrator | 2026-04-28 05:08:10.869953 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 05:08:10.869969 | orchestrator | 2026-04-28 05:08:10.869981 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 05:08:10.869993 | orchestrator | Tuesday 28 April 2026 05:07:49 +0000 (0:00:01.771) 0:00:01.771 ********* 2026-04-28 05:08:10.870004 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:08:10.870071 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:08:10.870085 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:08:10.870095 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:08:10.870107 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:08:10.870118 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:08:10.870129 | orchestrator | 2026-04-28 05:08:10.870140 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 05:08:10.870151 | orchestrator | Tuesday 28 April 2026 05:07:52 +0000 (0:00:02.467) 0:00:04.238 ********* 2026-04-28 05:08:10.870162 | orchestrator | ok: [testbed-node-0] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-28 05:08:10.870174 | orchestrator | ok: [testbed-node-1] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-28 05:08:10.870185 | orchestrator | ok: [testbed-node-2] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-28 05:08:10.870197 | orchestrator | ok: [testbed-node-3] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-28 05:08:10.870207 | orchestrator | ok: [testbed-node-4] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-28 05:08:10.870218 | orchestrator | ok: [testbed-node-5] => (item=enable_openvswitch_True_enable_ovs_dpdk_False) 2026-04-28 05:08:10.870229 | orchestrator | 2026-04-28 05:08:10.870240 | orchestrator | PLAY [Apply role openvswitch] ************************************************** 2026-04-28 05:08:10.870251 | orchestrator | 2026-04-28 05:08:10.870262 | orchestrator | TASK [openvswitch : include_tasks] ********************************************* 2026-04-28 05:08:10.870289 | orchestrator | Tuesday 28 April 2026 05:07:56 +0000 (0:00:03.785) 0:00:08.024 ********* 2026-04-28 05:08:10.870326 | orchestrator | included: /ansible/roles/openvswitch/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 05:08:10.870338 | orchestrator | 2026-04-28 05:08:10.870350 | orchestrator | TASK [module-load : Load modules] ********************************************** 2026-04-28 05:08:10.870361 | orchestrator | Tuesday 28 April 2026 05:07:59 +0000 (0:00:03.864) 0:00:11.888 ********* 2026-04-28 05:08:10.870372 | orchestrator | ok: [testbed-node-0] => (item=openvswitch) 2026-04-28 05:08:10.870383 | orchestrator | ok: [testbed-node-2] => (item=openvswitch) 2026-04-28 05:08:10.870395 | orchestrator | ok: [testbed-node-1] => (item=openvswitch) 2026-04-28 05:08:10.870406 | orchestrator | ok: [testbed-node-3] => (item=openvswitch) 2026-04-28 05:08:10.870417 | orchestrator | ok: [testbed-node-4] => (item=openvswitch) 2026-04-28 05:08:10.870428 | orchestrator | ok: [testbed-node-5] => (item=openvswitch) 2026-04-28 05:08:10.870439 | orchestrator | 2026-04-28 05:08:10.870450 | orchestrator | TASK [module-load : Persist modules via modules-load.d] ************************ 2026-04-28 05:08:10.870461 | orchestrator | Tuesday 28 April 2026 05:08:02 +0000 (0:00:02.600) 0:00:14.489 ********* 2026-04-28 05:08:10.870472 | orchestrator | ok: [testbed-node-0] => (item=openvswitch) 2026-04-28 05:08:10.870483 | orchestrator | ok: [testbed-node-1] => (item=openvswitch) 2026-04-28 05:08:10.870494 | orchestrator | ok: [testbed-node-2] => (item=openvswitch) 2026-04-28 05:08:10.870505 | orchestrator | ok: [testbed-node-4] => (item=openvswitch) 2026-04-28 05:08:10.870539 | orchestrator | ok: [testbed-node-3] => (item=openvswitch) 2026-04-28 05:08:10.870550 | orchestrator | ok: [testbed-node-5] => (item=openvswitch) 2026-04-28 05:08:10.870561 | orchestrator | 2026-04-28 05:08:10.870572 | orchestrator | TASK [module-load : Drop module persistence] *********************************** 2026-04-28 05:08:10.870583 | orchestrator | Tuesday 28 April 2026 05:08:05 +0000 (0:00:02.620) 0:00:17.109 ********* 2026-04-28 05:08:10.870594 | orchestrator | skipping: [testbed-node-0] => (item=openvswitch)  2026-04-28 05:08:10.870605 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:08:10.870617 | orchestrator | skipping: [testbed-node-1] => (item=openvswitch)  2026-04-28 05:08:10.870628 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:08:10.870639 | orchestrator | skipping: [testbed-node-2] => (item=openvswitch)  2026-04-28 05:08:10.870649 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:08:10.870660 | orchestrator | skipping: [testbed-node-3] => (item=openvswitch)  2026-04-28 05:08:10.870671 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:08:10.870682 | orchestrator | skipping: [testbed-node-4] => (item=openvswitch)  2026-04-28 05:08:10.870693 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:08:10.870703 | orchestrator | skipping: [testbed-node-5] => (item=openvswitch)  2026-04-28 05:08:10.870714 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:08:10.870725 | orchestrator | 2026-04-28 05:08:10.870736 | orchestrator | TASK [openvswitch : Create /run/openvswitch directory on host] ***************** 2026-04-28 05:08:10.870747 | orchestrator | Tuesday 28 April 2026 05:08:07 +0000 (0:00:02.436) 0:00:19.545 ********* 2026-04-28 05:08:10.870758 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:08:10.870769 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:08:10.870780 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:08:10.870791 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:08:10.870802 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:08:10.870812 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:08:10.870823 | orchestrator | 2026-04-28 05:08:10.870834 | orchestrator | TASK [openvswitch : Ensuring config directories exist] ************************* 2026-04-28 05:08:10.870845 | orchestrator | Tuesday 28 April 2026 05:08:09 +0000 (0:00:02.232) 0:00:21.778 ********* 2026-04-28 05:08:10.870878 | orchestrator | ok: [testbed-node-0] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 05:08:10.870905 | orchestrator | ok: [testbed-node-1] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 05:08:10.870923 | orchestrator | ok: [testbed-node-2] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 05:08:10.870936 | orchestrator | ok: [testbed-node-0] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 05:08:10.870947 | orchestrator | ok: [testbed-node-3] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 05:08:10.870959 | orchestrator | ok: [testbed-node-4] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 05:08:10.870985 | orchestrator | ok: [testbed-node-1] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 05:08:14.184640 | orchestrator | ok: [testbed-node-2] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 05:08:14.184742 | orchestrator | ok: [testbed-node-5] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 05:08:14.184759 | orchestrator | ok: [testbed-node-3] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 05:08:14.184771 | orchestrator | ok: [testbed-node-4] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 05:08:14.184782 | orchestrator | ok: [testbed-node-5] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 05:08:14.184815 | orchestrator | 2026-04-28 05:08:14.184829 | orchestrator | TASK [openvswitch : Copying over config.json files for services] *************** 2026-04-28 05:08:14.184841 | orchestrator | Tuesday 28 April 2026 05:08:12 +0000 (0:00:02.539) 0:00:24.317 ********* 2026-04-28 05:08:14.184870 | orchestrator | ok: [testbed-node-0] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 05:08:14.184890 | orchestrator | ok: [testbed-node-1] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 05:08:14.184901 | orchestrator | ok: [testbed-node-2] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 05:08:14.184913 | orchestrator | ok: [testbed-node-3] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 05:08:14.184924 | orchestrator | ok: [testbed-node-4] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 05:08:14.184943 | orchestrator | ok: [testbed-node-5] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 05:08:14.184964 | orchestrator | ok: [testbed-node-0] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 05:08:19.725134 | orchestrator | ok: [testbed-node-1] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 05:08:19.725233 | orchestrator | ok: [testbed-node-2] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 05:08:19.725245 | orchestrator | ok: [testbed-node-3] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 05:08:19.725271 | orchestrator | ok: [testbed-node-4] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 05:08:19.725281 | orchestrator | ok: [testbed-node-5] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 05:08:19.725290 | orchestrator | 2026-04-28 05:08:19.725301 | orchestrator | TASK [openvswitch : Copying over ovs-vsctl wrapper] **************************** 2026-04-28 05:08:19.725311 | orchestrator | Tuesday 28 April 2026 05:08:15 +0000 (0:00:03.516) 0:00:27.834 ********* 2026-04-28 05:08:19.725320 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:08:19.725330 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:08:19.725339 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:08:19.725347 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:08:19.725356 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:08:19.725365 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:08:19.725373 | orchestrator | 2026-04-28 05:08:19.725382 | orchestrator | TASK [service-check-containers : openvswitch | Check containers] *************** 2026-04-28 05:08:19.725405 | orchestrator | Tuesday 28 April 2026 05:08:18 +0000 (0:00:02.256) 0:00:30.091 ********* 2026-04-28 05:08:19.725421 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 05:08:19.725432 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 05:08:19.725441 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 05:08:19.725457 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 05:08:19.725466 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 05:08:19.725487 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}}) 2026-04-28 05:08:23.839781 | orchestrator | changed: [testbed-node-3] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 05:08:23.839893 | orchestrator | changed: [testbed-node-0] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 05:08:23.839963 | orchestrator | changed: [testbed-node-1] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 05:08:23.839985 | orchestrator | changed: [testbed-node-2] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 05:08:23.840005 | orchestrator | changed: [testbed-node-4] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 05:08:23.840065 | orchestrator | changed: [testbed-node-5] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}}) 2026-04-28 05:08:23.840092 | orchestrator | 2026-04-28 05:08:23.840107 | orchestrator | TASK [service-check-containers : openvswitch | Notify handlers to restart containers] *** 2026-04-28 05:08:23.840120 | orchestrator | Tuesday 28 April 2026 05:08:21 +0000 (0:00:03.340) 0:00:33.432 ********* 2026-04-28 05:08:23.840132 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 05:08:23.840144 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:08:23.840155 | orchestrator | } 2026-04-28 05:08:23.840166 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 05:08:23.840177 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:08:23.840188 | orchestrator | } 2026-04-28 05:08:23.840199 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 05:08:23.840210 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:08:23.840231 | orchestrator | } 2026-04-28 05:08:23.840242 | orchestrator | changed: [testbed-node-3] => { 2026-04-28 05:08:23.840253 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:08:23.840264 | orchestrator | } 2026-04-28 05:08:23.840274 | orchestrator | changed: [testbed-node-4] => { 2026-04-28 05:08:23.840285 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:08:23.840296 | orchestrator | } 2026-04-28 05:08:23.840306 | orchestrator | changed: [testbed-node-5] => { 2026-04-28 05:08:23.840320 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:08:23.840332 | orchestrator | } 2026-04-28 05:08:23.840345 | orchestrator | 2026-04-28 05:08:23.840359 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 05:08:23.840372 | orchestrator | Tuesday 28 April 2026 05:08:23 +0000 (0:00:01.776) 0:00:35.208 ********* 2026-04-28 05:08:23.840385 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}})  2026-04-28 05:08:23.840401 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}})  2026-04-28 05:08:23.840415 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:08:23.840429 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}})  2026-04-28 05:08:23.840448 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}})  2026-04-28 05:08:23.840471 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}})  2026-04-28 05:08:58.510590 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}})  2026-04-28 05:08:58.510703 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:08:58.510717 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:08:58.510728 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}})  2026-04-28 05:08:58.510739 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}})  2026-04-28 05:08:58.510749 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:08:58.510760 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}})  2026-04-28 05:08:58.510787 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}})  2026-04-28 05:08:58.510819 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:08:58.510846 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'openvswitch-db-server', 'value': {'container_name': 'openvswitch_db', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'volumes': ['/etc/kolla/openvswitch-db-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/', 'openvswitch_db:/var/lib/openvswitch/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovsdb-client list-dbs'], 'timeout': '30'}}})  2026-04-28 05:08:58.510857 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'openvswitch-vswitchd', 'value': {'container_name': 'openvswitch_vswitchd', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'enabled': True, 'group': 'openvswitch', 'host_in_groups': True, 'privileged': True, 'volumes': ['/etc/kolla/openvswitch-vswitchd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch:shared', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'ovs-appctl version'], 'timeout': '30'}}})  2026-04-28 05:08:58.510866 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:08:58.510876 | orchestrator | 2026-04-28 05:08:58.510886 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-28 05:08:58.510898 | orchestrator | Tuesday 28 April 2026 05:08:25 +0000 (0:00:02.634) 0:00:37.843 ********* 2026-04-28 05:08:58.510907 | orchestrator | 2026-04-28 05:08:58.510917 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-28 05:08:58.510928 | orchestrator | Tuesday 28 April 2026 05:08:26 +0000 (0:00:00.779) 0:00:38.622 ********* 2026-04-28 05:08:58.510937 | orchestrator | 2026-04-28 05:08:58.510946 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-28 05:08:58.510955 | orchestrator | Tuesday 28 April 2026 05:08:27 +0000 (0:00:00.560) 0:00:39.183 ********* 2026-04-28 05:08:58.510965 | orchestrator | 2026-04-28 05:08:58.510974 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-28 05:08:58.510984 | orchestrator | Tuesday 28 April 2026 05:08:27 +0000 (0:00:00.531) 0:00:39.714 ********* 2026-04-28 05:08:58.510994 | orchestrator | 2026-04-28 05:08:58.511005 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-28 05:08:58.511015 | orchestrator | Tuesday 28 April 2026 05:08:28 +0000 (0:00:00.511) 0:00:40.226 ********* 2026-04-28 05:08:58.511025 | orchestrator | 2026-04-28 05:08:58.511034 | orchestrator | TASK [openvswitch : Flush Handlers] ******************************************** 2026-04-28 05:08:58.511044 | orchestrator | Tuesday 28 April 2026 05:08:28 +0000 (0:00:00.501) 0:00:40.727 ********* 2026-04-28 05:08:58.511054 | orchestrator | 2026-04-28 05:08:58.511064 | orchestrator | RUNNING HANDLER [openvswitch : Restart openvswitch-db-server container] ******** 2026-04-28 05:08:58.511073 | orchestrator | Tuesday 28 April 2026 05:08:29 +0000 (0:00:00.850) 0:00:41.578 ********* 2026-04-28 05:08:58.511081 | orchestrator | changed: [testbed-node-5] 2026-04-28 05:08:58.511090 | orchestrator | changed: [testbed-node-4] 2026-04-28 05:08:58.511100 | orchestrator | changed: [testbed-node-3] 2026-04-28 05:08:58.511118 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:08:58.511129 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:08:58.511139 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:08:58.511149 | orchestrator | 2026-04-28 05:08:58.511159 | orchestrator | RUNNING HANDLER [openvswitch : Waiting for openvswitch_db service to be ready] *** 2026-04-28 05:08:58.511170 | orchestrator | Tuesday 28 April 2026 05:08:41 +0000 (0:00:12.104) 0:00:53.683 ********* 2026-04-28 05:08:58.511180 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:08:58.511192 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:08:58.511203 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:08:58.511214 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:08:58.511224 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:08:58.511235 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:08:58.511245 | orchestrator | 2026-04-28 05:08:58.511255 | orchestrator | RUNNING HANDLER [openvswitch : Restart openvswitch-vswitchd container] ********* 2026-04-28 05:08:58.511265 | orchestrator | Tuesday 28 April 2026 05:08:44 +0000 (0:00:02.353) 0:00:56.037 ********* 2026-04-28 05:08:58.511275 | orchestrator | changed: [testbed-node-4] 2026-04-28 05:08:58.511291 | orchestrator | changed: [testbed-node-5] 2026-04-28 05:08:58.511303 | orchestrator | changed: [testbed-node-3] 2026-04-28 05:08:58.511313 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:08:58.511323 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:08:58.511333 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:08:58.511343 | orchestrator | 2026-04-28 05:08:58.511353 | orchestrator | TASK [openvswitch : Set system-id, hostname and hw-offload] ******************** 2026-04-28 05:08:58.511363 | orchestrator | Tuesday 28 April 2026 05:08:55 +0000 (0:00:11.372) 0:01:07.410 ********* 2026-04-28 05:08:58.511374 | orchestrator | ok: [testbed-node-0] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-0'}) 2026-04-28 05:08:58.511386 | orchestrator | ok: [testbed-node-1] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-1'}) 2026-04-28 05:08:58.511397 | orchestrator | ok: [testbed-node-3] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-3'}) 2026-04-28 05:08:58.511407 | orchestrator | ok: [testbed-node-2] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-2'}) 2026-04-28 05:08:58.511417 | orchestrator | ok: [testbed-node-4] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-4'}) 2026-04-28 05:08:58.511433 | orchestrator | ok: [testbed-node-5] => (item={'col': 'external_ids', 'name': 'system-id', 'value': 'testbed-node-5'}) 2026-04-28 05:09:11.109413 | orchestrator | ok: [testbed-node-0] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-0'}) 2026-04-28 05:09:11.109542 | orchestrator | ok: [testbed-node-3] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-3'}) 2026-04-28 05:09:11.109631 | orchestrator | ok: [testbed-node-1] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-1'}) 2026-04-28 05:09:11.109664 | orchestrator | ok: [testbed-node-5] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-5'}) 2026-04-28 05:09:11.109680 | orchestrator | ok: [testbed-node-4] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-4'}) 2026-04-28 05:09:11.109696 | orchestrator | ok: [testbed-node-2] => (item={'col': 'external_ids', 'name': 'hostname', 'value': 'testbed-node-2'}) 2026-04-28 05:09:11.109712 | orchestrator | ok: [testbed-node-0] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-28 05:09:11.109727 | orchestrator | ok: [testbed-node-3] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-28 05:09:11.109742 | orchestrator | ok: [testbed-node-1] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-28 05:09:11.109756 | orchestrator | ok: [testbed-node-5] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-28 05:09:11.109771 | orchestrator | ok: [testbed-node-4] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-28 05:09:11.109815 | orchestrator | ok: [testbed-node-2] => (item={'col': 'other_config', 'name': 'hw-offload', 'value': True, 'state': 'absent'}) 2026-04-28 05:09:11.109832 | orchestrator | 2026-04-28 05:09:11.109848 | orchestrator | TASK [openvswitch : Ensuring OVS bridge is properly setup] ********************* 2026-04-28 05:09:11.109865 | orchestrator | Tuesday 28 April 2026 05:09:03 +0000 (0:00:07.877) 0:01:15.287 ********* 2026-04-28 05:09:11.109881 | orchestrator | skipping: [testbed-node-3] => (item=br-ex)  2026-04-28 05:09:11.109896 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:09:11.109912 | orchestrator | skipping: [testbed-node-4] => (item=br-ex)  2026-04-28 05:09:11.109928 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:09:11.109943 | orchestrator | skipping: [testbed-node-5] => (item=br-ex)  2026-04-28 05:09:11.109957 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:09:11.109972 | orchestrator | ok: [testbed-node-0] => (item=br-ex) 2026-04-28 05:09:11.109987 | orchestrator | ok: [testbed-node-1] => (item=br-ex) 2026-04-28 05:09:11.110001 | orchestrator | ok: [testbed-node-2] => (item=br-ex) 2026-04-28 05:09:11.110080 | orchestrator | 2026-04-28 05:09:11.110098 | orchestrator | TASK [openvswitch : Ensuring OVS ports are properly setup] ********************* 2026-04-28 05:09:11.110114 | orchestrator | Tuesday 28 April 2026 05:09:06 +0000 (0:00:03.219) 0:01:18.507 ********* 2026-04-28 05:09:11.110130 | orchestrator | skipping: [testbed-node-3] => (item=['br-ex', 'vxlan0'])  2026-04-28 05:09:11.110146 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:09:11.110161 | orchestrator | skipping: [testbed-node-4] => (item=['br-ex', 'vxlan0'])  2026-04-28 05:09:11.110175 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:09:11.110191 | orchestrator | skipping: [testbed-node-5] => (item=['br-ex', 'vxlan0'])  2026-04-28 05:09:11.110206 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:09:11.110221 | orchestrator | ok: [testbed-node-0] => (item=['br-ex', 'vxlan0']) 2026-04-28 05:09:11.110237 | orchestrator | ok: [testbed-node-1] => (item=['br-ex', 'vxlan0']) 2026-04-28 05:09:11.110252 | orchestrator | ok: [testbed-node-2] => (item=['br-ex', 'vxlan0']) 2026-04-28 05:09:11.110267 | orchestrator | 2026-04-28 05:09:11.110282 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 05:09:11.110298 | orchestrator | testbed-node-0 : ok=15  changed=4  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-28 05:09:11.110315 | orchestrator | testbed-node-1 : ok=15  changed=4  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-28 05:09:11.110347 | orchestrator | testbed-node-2 : ok=15  changed=4  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-28 05:09:11.110363 | orchestrator | testbed-node-3 : ok=13  changed=4  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 05:09:11.110378 | orchestrator | testbed-node-4 : ok=13  changed=4  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 05:09:11.110392 | orchestrator | testbed-node-5 : ok=13  changed=4  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 05:09:11.110407 | orchestrator | 2026-04-28 05:09:11.110420 | orchestrator | 2026-04-28 05:09:11.110435 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 05:09:11.110450 | orchestrator | Tuesday 28 April 2026 05:09:10 +0000 (0:00:04.076) 0:01:22.583 ********* 2026-04-28 05:09:11.110466 | orchestrator | =============================================================================== 2026-04-28 05:09:11.110482 | orchestrator | openvswitch : Restart openvswitch-db-server container ------------------ 12.11s 2026-04-28 05:09:11.110517 | orchestrator | openvswitch : Restart openvswitch-vswitchd container ------------------- 11.37s 2026-04-28 05:09:11.110533 | orchestrator | openvswitch : Set system-id, hostname and hw-offload -------------------- 7.88s 2026-04-28 05:09:11.110581 | orchestrator | openvswitch : Ensuring OVS ports are properly setup --------------------- 4.08s 2026-04-28 05:09:11.110598 | orchestrator | openvswitch : include_tasks --------------------------------------------- 3.86s 2026-04-28 05:09:11.110612 | orchestrator | Group hosts based on enabled services ----------------------------------- 3.79s 2026-04-28 05:09:11.110627 | orchestrator | openvswitch : Flush Handlers -------------------------------------------- 3.74s 2026-04-28 05:09:11.110641 | orchestrator | openvswitch : Copying over config.json files for services --------------- 3.52s 2026-04-28 05:09:11.110656 | orchestrator | service-check-containers : openvswitch | Check containers --------------- 3.34s 2026-04-28 05:09:11.110672 | orchestrator | openvswitch : Ensuring OVS bridge is properly setup --------------------- 3.22s 2026-04-28 05:09:11.110686 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.63s 2026-04-28 05:09:11.110701 | orchestrator | module-load : Persist modules via modules-load.d ------------------------ 2.62s 2026-04-28 05:09:11.110715 | orchestrator | module-load : Load modules ---------------------------------------------- 2.60s 2026-04-28 05:09:11.110729 | orchestrator | openvswitch : Ensuring config directories exist ------------------------- 2.54s 2026-04-28 05:09:11.110743 | orchestrator | Group hosts based on Kolla action --------------------------------------- 2.47s 2026-04-28 05:09:11.110758 | orchestrator | module-load : Drop module persistence ----------------------------------- 2.44s 2026-04-28 05:09:11.110772 | orchestrator | openvswitch : Waiting for openvswitch_db service to be ready ------------ 2.35s 2026-04-28 05:09:11.110781 | orchestrator | openvswitch : Copying over ovs-vsctl wrapper ---------------------------- 2.26s 2026-04-28 05:09:11.110790 | orchestrator | openvswitch : Create /run/openvswitch directory on host ----------------- 2.23s 2026-04-28 05:09:11.110798 | orchestrator | service-check-containers : openvswitch | Notify handlers to restart containers --- 1.78s 2026-04-28 05:09:11.283278 | orchestrator | + osism apply -a upgrade ovn 2026-04-28 05:09:12.588649 | orchestrator | 2026-04-28 05:09:12 | INFO  | Prepare task for execution of ovn. 2026-04-28 05:09:12.655073 | orchestrator | 2026-04-28 05:09:12 | INFO  | Task e9b6d9e6-5728-4422-ba3b-cfd63077e6a4 (ovn) was prepared for execution. 2026-04-28 05:09:12.655167 | orchestrator | 2026-04-28 05:09:12 | INFO  | It takes a moment until task e9b6d9e6-5728-4422-ba3b-cfd63077e6a4 (ovn) has been started and output is visible here. 2026-04-28 05:09:32.030705 | orchestrator | 2026-04-28 05:09:32.030818 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 05:09:32.030833 | orchestrator | 2026-04-28 05:09:32.030843 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 05:09:32.030853 | orchestrator | Tuesday 28 April 2026 05:09:17 +0000 (0:00:01.427) 0:00:01.427 ********* 2026-04-28 05:09:32.030863 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:09:32.030874 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:09:32.030883 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:09:32.030899 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:09:32.030915 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:09:32.030931 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:09:32.030945 | orchestrator | 2026-04-28 05:09:32.030961 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 05:09:32.030976 | orchestrator | Tuesday 28 April 2026 05:09:20 +0000 (0:00:03.332) 0:00:04.760 ********* 2026-04-28 05:09:32.030991 | orchestrator | ok: [testbed-node-0] => (item=enable_ovn_True) 2026-04-28 05:09:32.031006 | orchestrator | ok: [testbed-node-1] => (item=enable_ovn_True) 2026-04-28 05:09:32.031022 | orchestrator | ok: [testbed-node-2] => (item=enable_ovn_True) 2026-04-28 05:09:32.031039 | orchestrator | ok: [testbed-node-3] => (item=enable_ovn_True) 2026-04-28 05:09:32.031055 | orchestrator | ok: [testbed-node-4] => (item=enable_ovn_True) 2026-04-28 05:09:32.031072 | orchestrator | ok: [testbed-node-5] => (item=enable_ovn_True) 2026-04-28 05:09:32.031089 | orchestrator | 2026-04-28 05:09:32.031100 | orchestrator | PLAY [Apply role ovn-controller] *********************************************** 2026-04-28 05:09:32.031131 | orchestrator | 2026-04-28 05:09:32.031141 | orchestrator | TASK [ovn-controller : include_tasks] ****************************************** 2026-04-28 05:09:32.031165 | orchestrator | Tuesday 28 April 2026 05:09:23 +0000 (0:00:02.368) 0:00:07.128 ********* 2026-04-28 05:09:32.031177 | orchestrator | included: /ansible/roles/ovn-controller/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 05:09:32.031189 | orchestrator | 2026-04-28 05:09:32.031198 | orchestrator | TASK [ovn-controller : Ensuring config directories exist] ********************** 2026-04-28 05:09:32.031208 | orchestrator | Tuesday 28 April 2026 05:09:25 +0000 (0:00:02.630) 0:00:09.759 ********* 2026-04-28 05:09:32.031220 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:32.031232 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:32.031243 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:32.031252 | orchestrator | ok: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:32.031262 | orchestrator | ok: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:32.031291 | orchestrator | ok: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:32.031301 | orchestrator | 2026-04-28 05:09:32.031311 | orchestrator | TASK [ovn-controller : Copying over config.json files for services] ************ 2026-04-28 05:09:32.031321 | orchestrator | Tuesday 28 April 2026 05:09:28 +0000 (0:00:02.907) 0:00:12.666 ********* 2026-04-28 05:09:32.031331 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:32.031349 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:32.031364 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:32.031374 | orchestrator | ok: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:32.031385 | orchestrator | ok: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:32.031394 | orchestrator | ok: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:32.031404 | orchestrator | 2026-04-28 05:09:32.031414 | orchestrator | TASK [ovn-controller : Ensuring systemd override directory exists] ************* 2026-04-28 05:09:32.031423 | orchestrator | Tuesday 28 April 2026 05:09:31 +0000 (0:00:02.801) 0:00:15.467 ********* 2026-04-28 05:09:32.031433 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:32.031443 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:32.031459 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:41.240693 | orchestrator | ok: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:41.240819 | orchestrator | ok: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:41.240835 | orchestrator | ok: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:41.240847 | orchestrator | 2026-04-28 05:09:41.240860 | orchestrator | TASK [ovn-controller : Copying over systemd override] ************************** 2026-04-28 05:09:41.240873 | orchestrator | Tuesday 28 April 2026 05:09:33 +0000 (0:00:02.315) 0:00:17.783 ********* 2026-04-28 05:09:41.240884 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:41.240895 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:41.240906 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:41.240918 | orchestrator | ok: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:41.240928 | orchestrator | ok: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:41.240975 | orchestrator | ok: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:41.240987 | orchestrator | 2026-04-28 05:09:41.240997 | orchestrator | TASK [service-check-containers : ovn_controller | Check containers] ************ 2026-04-28 05:09:41.241008 | orchestrator | Tuesday 28 April 2026 05:09:36 +0000 (0:00:03.119) 0:00:20.903 ********* 2026-04-28 05:09:41.241020 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:41.241035 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:41.241047 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:41.241059 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:41.241070 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:41.241081 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:09:41.241092 | orchestrator | 2026-04-28 05:09:41.241103 | orchestrator | TASK [service-check-containers : ovn_controller | Notify handlers to restart containers] *** 2026-04-28 05:09:41.241115 | orchestrator | Tuesday 28 April 2026 05:09:39 +0000 (0:00:02.512) 0:00:23.415 ********* 2026-04-28 05:09:41.241126 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 05:09:41.241144 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:09:41.241155 | orchestrator | } 2026-04-28 05:09:41.241165 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 05:09:41.241176 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:09:41.241187 | orchestrator | } 2026-04-28 05:09:41.241199 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 05:09:41.241210 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:09:41.241221 | orchestrator | } 2026-04-28 05:09:41.241232 | orchestrator | changed: [testbed-node-3] => { 2026-04-28 05:09:41.241243 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:09:41.241254 | orchestrator | } 2026-04-28 05:09:41.241293 | orchestrator | changed: [testbed-node-4] => { 2026-04-28 05:09:41.241304 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:09:41.241316 | orchestrator | } 2026-04-28 05:09:41.241328 | orchestrator | changed: [testbed-node-5] => { 2026-04-28 05:09:41.241340 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:09:41.241351 | orchestrator | } 2026-04-28 05:09:41.241362 | orchestrator | 2026-04-28 05:09:41.241374 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 05:09:41.241387 | orchestrator | Tuesday 28 April 2026 05:09:41 +0000 (0:00:01.832) 0:00:25.248 ********* 2026-04-28 05:09:41.241407 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:10:04.213963 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:10:04.214171 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:10:04.214194 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:10:04.214222 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:10:04.214235 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:10:04.214246 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:10:04.214258 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:10:04.214269 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:10:04.214280 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:10:04.214291 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ovn-controller', 'value': {'container_name': 'ovn_controller', 'group': 'ovn-controller', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-controller/:/var/lib/kolla/config_files/:ro', '/run/openvswitch:/run/openvswitch:shared', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:10:04.214326 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:10:04.214338 | orchestrator | 2026-04-28 05:10:04.214350 | orchestrator | TASK [ovn-controller : Create br-int bridge on OpenvSwitch] ******************** 2026-04-28 05:10:04.214363 | orchestrator | Tuesday 28 April 2026 05:09:43 +0000 (0:00:02.521) 0:00:27.769 ********* 2026-04-28 05:10:04.214374 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:10:04.214385 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:10:04.214396 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:10:04.214407 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:10:04.214417 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:10:04.214428 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:10:04.214438 | orchestrator | 2026-04-28 05:10:04.214449 | orchestrator | TASK [ovn-controller : Configure OVN in OVSDB] ********************************* 2026-04-28 05:10:04.214462 | orchestrator | Tuesday 28 April 2026 05:09:47 +0000 (0:00:03.793) 0:00:31.563 ********* 2026-04-28 05:10:04.214476 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.11'}) 2026-04-28 05:10:04.214490 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.10'}) 2026-04-28 05:10:04.214503 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.12'}) 2026-04-28 05:10:04.214516 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.14'}) 2026-04-28 05:10:04.214528 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.13'}) 2026-04-28 05:10:04.214542 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-encap-ip', 'value': '192.168.16.15'}) 2026-04-28 05:10:04.214554 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-28 05:10:04.214566 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-28 05:10:04.214579 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-28 05:10:04.214592 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-28 05:10:04.214630 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-28 05:10:04.214661 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-encap-type', 'value': 'geneve'}) 2026-04-28 05:10:04.214675 | orchestrator | changed: [testbed-node-1] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:16641,tcp:192.168.16.11:16641,tcp:192.168.16.12:16641'}) 2026-04-28 05:10:04.214689 | orchestrator | changed: [testbed-node-0] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:16641,tcp:192.168.16.11:16641,tcp:192.168.16.12:16641'}) 2026-04-28 05:10:04.214702 | orchestrator | changed: [testbed-node-4] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:16641,tcp:192.168.16.11:16641,tcp:192.168.16.12:16641'}) 2026-04-28 05:10:04.214720 | orchestrator | changed: [testbed-node-2] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:16641,tcp:192.168.16.11:16641,tcp:192.168.16.12:16641'}) 2026-04-28 05:10:04.214734 | orchestrator | changed: [testbed-node-3] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:16641,tcp:192.168.16.11:16641,tcp:192.168.16.12:16641'}) 2026-04-28 05:10:04.214747 | orchestrator | changed: [testbed-node-5] => (item={'name': 'ovn-remote', 'value': 'tcp:192.168.16.10:16641,tcp:192.168.16.11:16641,tcp:192.168.16.12:16641'}) 2026-04-28 05:10:04.214760 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-28 05:10:04.214773 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-28 05:10:04.214793 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-28 05:10:04.214806 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-28 05:10:04.214818 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-28 05:10:04.214829 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-remote-probe-interval', 'value': '60000'}) 2026-04-28 05:10:04.214840 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-28 05:10:04.214851 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-28 05:10:04.214861 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-28 05:10:04.214872 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-28 05:10:04.214882 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-28 05:10:04.214893 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-openflow-probe-interval', 'value': '60'}) 2026-04-28 05:10:04.214903 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-28 05:10:04.214914 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-28 05:10:04.214925 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-28 05:10:04.214935 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-28 05:10:04.214946 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-28 05:10:04.214956 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-monitor-all', 'value': False}) 2026-04-28 05:10:04.214967 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'present'}) 2026-04-28 05:10:04.214978 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'present'}) 2026-04-28 05:10:04.214989 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'absent'}) 2026-04-28 05:10:04.215000 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'absent'}) 2026-04-28 05:10:04.215011 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'present'}) 2026-04-28 05:10:04.215022 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-bridge-mappings', 'value': 'physnet1:br-ex', 'state': 'absent'}) 2026-04-28 05:10:04.215034 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:52:c1:40', 'state': 'absent'}) 2026-04-28 05:10:04.215046 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:33:12:50', 'state': 'absent'}) 2026-04-28 05:10:04.215057 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:89:18:56', 'state': 'present'}) 2026-04-28 05:10:04.215068 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:2f:fa:44', 'state': 'present'}) 2026-04-28 05:10:04.215079 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:29:4a:9b', 'state': 'absent'}) 2026-04-28 05:10:04.215096 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-chassis-mac-mappings', 'value': 'physnet1:52:54:00:71:3a:c3', 'state': 'present'}) 2026-04-28 05:12:58.116332 | orchestrator | ok: [testbed-node-0] => (item={'name': 'ovn-cms-options', 'value': 'enable-chassis-as-gw,availability-zones=nova', 'state': 'present'}) 2026-04-28 05:12:58.116449 | orchestrator | ok: [testbed-node-3] => (item={'name': 'ovn-cms-options', 'value': '', 'state': 'absent'}) 2026-04-28 05:12:58.116489 | orchestrator | ok: [testbed-node-1] => (item={'name': 'ovn-cms-options', 'value': 'enable-chassis-as-gw,availability-zones=nova', 'state': 'present'}) 2026-04-28 05:12:58.116510 | orchestrator | ok: [testbed-node-4] => (item={'name': 'ovn-cms-options', 'value': '', 'state': 'absent'}) 2026-04-28 05:12:58.116568 | orchestrator | ok: [testbed-node-5] => (item={'name': 'ovn-cms-options', 'value': '', 'state': 'absent'}) 2026-04-28 05:12:58.116597 | orchestrator | ok: [testbed-node-2] => (item={'name': 'ovn-cms-options', 'value': 'enable-chassis-as-gw,availability-zones=nova', 'state': 'present'}) 2026-04-28 05:12:58.116616 | orchestrator | 2026-04-28 05:12:58.116635 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-28 05:12:58.116653 | orchestrator | Tuesday 28 April 2026 05:10:07 +0000 (0:00:20.105) 0:00:51.668 ********* 2026-04-28 05:12:58.116668 | orchestrator | 2026-04-28 05:12:58.116685 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-28 05:12:58.116704 | orchestrator | Tuesday 28 April 2026 05:10:08 +0000 (0:00:00.504) 0:00:52.172 ********* 2026-04-28 05:12:58.116721 | orchestrator | 2026-04-28 05:12:58.116775 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-28 05:12:58.116793 | orchestrator | Tuesday 28 April 2026 05:10:08 +0000 (0:00:00.488) 0:00:52.661 ********* 2026-04-28 05:12:58.116810 | orchestrator | 2026-04-28 05:12:58.116827 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-28 05:12:58.116844 | orchestrator | Tuesday 28 April 2026 05:10:09 +0000 (0:00:00.552) 0:00:53.214 ********* 2026-04-28 05:12:58.116863 | orchestrator | 2026-04-28 05:12:58.116883 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-28 05:12:58.116903 | orchestrator | Tuesday 28 April 2026 05:10:09 +0000 (0:00:00.455) 0:00:53.670 ********* 2026-04-28 05:12:58.116922 | orchestrator | 2026-04-28 05:12:58.116940 | orchestrator | TASK [ovn-controller : Flush handlers] ***************************************** 2026-04-28 05:12:58.116954 | orchestrator | Tuesday 28 April 2026 05:10:10 +0000 (0:00:00.482) 0:00:54.153 ********* 2026-04-28 05:12:58.116965 | orchestrator | 2026-04-28 05:12:58.116975 | orchestrator | RUNNING HANDLER [ovn-controller : Restart ovn-controller container] ************ 2026-04-28 05:12:58.116987 | orchestrator | Tuesday 28 April 2026 05:10:10 +0000 (0:00:00.786) 0:00:54.939 ********* 2026-04-28 05:12:58.116998 | orchestrator | 2026-04-28 05:12:58.117009 | orchestrator | STILL ALIVE [task 'ovn-controller : Restart ovn-controller container' is running] *** 2026-04-28 05:12:58.117020 | orchestrator | changed: [testbed-node-4] 2026-04-28 05:12:58.117032 | orchestrator | changed: [testbed-node-5] 2026-04-28 05:12:58.117043 | orchestrator | changed: [testbed-node-3] 2026-04-28 05:12:58.117053 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:12:58.117064 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:12:58.117075 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:12:58.117085 | orchestrator | 2026-04-28 05:12:58.117096 | orchestrator | PLAY [Apply role ovn-db] ******************************************************* 2026-04-28 05:12:58.117107 | orchestrator | 2026-04-28 05:12:58.117118 | orchestrator | TASK [ovn-db : include_tasks] ************************************************** 2026-04-28 05:12:58.117129 | orchestrator | Tuesday 28 April 2026 05:12:22 +0000 (0:02:11.990) 0:03:06.929 ********* 2026-04-28 05:12:58.117140 | orchestrator | included: /ansible/roles/ovn-db/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 05:12:58.117150 | orchestrator | 2026-04-28 05:12:58.117161 | orchestrator | TASK [ovn-db : include_tasks] ************************************************** 2026-04-28 05:12:58.117172 | orchestrator | Tuesday 28 April 2026 05:12:24 +0000 (0:00:01.655) 0:03:08.585 ********* 2026-04-28 05:12:58.117183 | orchestrator | included: /ansible/roles/ovn-db/tasks/lookup_cluster.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 05:12:58.117194 | orchestrator | 2026-04-28 05:12:58.117204 | orchestrator | TASK [ovn-db : Checking for any existing OVN DB container volumes] ************* 2026-04-28 05:12:58.117215 | orchestrator | Tuesday 28 April 2026 05:12:26 +0000 (0:00:01.892) 0:03:10.477 ********* 2026-04-28 05:12:58.117238 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:12:58.117251 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:12:58.117261 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:12:58.117272 | orchestrator | 2026-04-28 05:12:58.117283 | orchestrator | TASK [ovn-db : Divide hosts by their OVN NB volume availability] *************** 2026-04-28 05:12:58.117294 | orchestrator | Tuesday 28 April 2026 05:12:28 +0000 (0:00:01.898) 0:03:12.375 ********* 2026-04-28 05:12:58.117306 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:12:58.117325 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:12:58.117342 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:12:58.117360 | orchestrator | 2026-04-28 05:12:58.117380 | orchestrator | TASK [ovn-db : Divide hosts by their OVN SB volume availability] *************** 2026-04-28 05:12:58.117398 | orchestrator | Tuesday 28 April 2026 05:12:29 +0000 (0:00:01.475) 0:03:13.851 ********* 2026-04-28 05:12:58.117418 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:12:58.117437 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:12:58.117453 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:12:58.117465 | orchestrator | 2026-04-28 05:12:58.117475 | orchestrator | TASK [ovn-db : Establish whether the OVN NB cluster has already existed] ******* 2026-04-28 05:12:58.117486 | orchestrator | Tuesday 28 April 2026 05:12:31 +0000 (0:00:01.763) 0:03:15.615 ********* 2026-04-28 05:12:58.117497 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:12:58.117508 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:12:58.117518 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:12:58.117529 | orchestrator | 2026-04-28 05:12:58.117540 | orchestrator | TASK [ovn-db : Establish whether the OVN SB cluster has already existed] ******* 2026-04-28 05:12:58.117551 | orchestrator | Tuesday 28 April 2026 05:12:32 +0000 (0:00:01.422) 0:03:17.038 ********* 2026-04-28 05:12:58.117562 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:12:58.117593 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:12:58.117605 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:12:58.117615 | orchestrator | 2026-04-28 05:12:58.117626 | orchestrator | TASK [ovn-db : Check if running on all OVN NB DB hosts] ************************ 2026-04-28 05:12:58.117637 | orchestrator | Tuesday 28 April 2026 05:12:34 +0000 (0:00:01.438) 0:03:18.476 ********* 2026-04-28 05:12:58.117648 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:12:58.117659 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:12:58.117670 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:12:58.117680 | orchestrator | 2026-04-28 05:12:58.117691 | orchestrator | TASK [ovn-db : Check OVN NB service port liveness] ***************************** 2026-04-28 05:12:58.117702 | orchestrator | Tuesday 28 April 2026 05:12:35 +0000 (0:00:01.600) 0:03:20.077 ********* 2026-04-28 05:12:58.117712 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:12:58.117731 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:12:58.117773 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:12:58.117784 | orchestrator | 2026-04-28 05:12:58.117795 | orchestrator | TASK [ovn-db : Divide hosts by their OVN NB service port liveness] ************* 2026-04-28 05:12:58.117806 | orchestrator | Tuesday 28 April 2026 05:12:37 +0000 (0:00:01.862) 0:03:21.939 ********* 2026-04-28 05:12:58.117816 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:12:58.117827 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:12:58.117838 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:12:58.117848 | orchestrator | 2026-04-28 05:12:58.117859 | orchestrator | TASK [ovn-db : Get OVN NB database information] ******************************** 2026-04-28 05:12:58.117870 | orchestrator | Tuesday 28 April 2026 05:12:39 +0000 (0:00:01.471) 0:03:23.411 ********* 2026-04-28 05:12:58.117880 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:12:58.117891 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:12:58.117901 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:12:58.117912 | orchestrator | 2026-04-28 05:12:58.117923 | orchestrator | TASK [ovn-db : Divide hosts by their OVN NB leader/follower role] ************** 2026-04-28 05:12:58.117934 | orchestrator | Tuesday 28 April 2026 05:12:41 +0000 (0:00:01.869) 0:03:25.281 ********* 2026-04-28 05:12:58.117944 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:12:58.117955 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:12:58.117975 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:12:58.117986 | orchestrator | 2026-04-28 05:12:58.117996 | orchestrator | TASK [ovn-db : Fail on existing OVN NB cluster with no leader] ***************** 2026-04-28 05:12:58.118007 | orchestrator | Tuesday 28 April 2026 05:12:43 +0000 (0:00:01.842) 0:03:27.123 ********* 2026-04-28 05:12:58.118084 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:12:58.118100 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:12:58.118120 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:12:58.118147 | orchestrator | 2026-04-28 05:12:58.118169 | orchestrator | TASK [ovn-db : Check if running on all OVN SB DB hosts] ************************ 2026-04-28 05:12:58.118201 | orchestrator | Tuesday 28 April 2026 05:12:44 +0000 (0:00:01.453) 0:03:28.577 ********* 2026-04-28 05:12:58.118219 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:12:58.118235 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:12:58.118253 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:12:58.118271 | orchestrator | 2026-04-28 05:12:58.118375 | orchestrator | TASK [ovn-db : Check OVN SB service port liveness] ***************************** 2026-04-28 05:12:58.118398 | orchestrator | Tuesday 28 April 2026 05:12:45 +0000 (0:00:01.427) 0:03:30.005 ********* 2026-04-28 05:12:58.118418 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:12:58.118438 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:12:58.118455 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:12:58.118474 | orchestrator | 2026-04-28 05:12:58.118488 | orchestrator | TASK [ovn-db : Divide hosts by their OVN SB service port liveness] ************* 2026-04-28 05:12:58.118498 | orchestrator | Tuesday 28 April 2026 05:12:48 +0000 (0:00:02.150) 0:03:32.155 ********* 2026-04-28 05:12:58.118509 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:12:58.118520 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:12:58.118530 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:12:58.118541 | orchestrator | 2026-04-28 05:12:58.118551 | orchestrator | TASK [ovn-db : Get OVN SB database information] ******************************** 2026-04-28 05:12:58.118562 | orchestrator | Tuesday 28 April 2026 05:12:49 +0000 (0:00:01.464) 0:03:33.619 ********* 2026-04-28 05:12:58.118573 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:12:58.118583 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:12:58.118594 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:12:58.118605 | orchestrator | 2026-04-28 05:12:58.118615 | orchestrator | TASK [ovn-db : Divide hosts by their OVN SB leader/follower role] ************** 2026-04-28 05:12:58.118626 | orchestrator | Tuesday 28 April 2026 05:12:51 +0000 (0:00:01.931) 0:03:35.551 ********* 2026-04-28 05:12:58.118636 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:12:58.118647 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:12:58.118658 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:12:58.118668 | orchestrator | 2026-04-28 05:12:58.118679 | orchestrator | TASK [ovn-db : Fail on existing OVN SB cluster with no leader] ***************** 2026-04-28 05:12:58.118690 | orchestrator | Tuesday 28 April 2026 05:12:52 +0000 (0:00:01.399) 0:03:36.950 ********* 2026-04-28 05:12:58.118700 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:12:58.118711 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:12:58.118721 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:12:58.118732 | orchestrator | 2026-04-28 05:12:58.118821 | orchestrator | TASK [ovn-db : include_tasks] ************************************************** 2026-04-28 05:12:58.118832 | orchestrator | Tuesday 28 April 2026 05:12:54 +0000 (0:00:01.679) 0:03:38.629 ********* 2026-04-28 05:12:58.118843 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:12:58.118854 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:12:58.118864 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:12:58.118875 | orchestrator | 2026-04-28 05:12:58.118886 | orchestrator | TASK [ovn-db : Ensuring config directories exist] ****************************** 2026-04-28 05:12:58.118896 | orchestrator | Tuesday 28 April 2026 05:12:56 +0000 (0:00:01.861) 0:03:40.491 ********* 2026-04-28 05:12:58.118926 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:04.615505 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:04.615617 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:04.615633 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:04.615645 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:04.615657 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:04.615669 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:13:04.615681 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:04.615733 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:04.615818 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:13:04.615831 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:04.615842 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:13:04.615854 | orchestrator | 2026-04-28 05:13:04.615867 | orchestrator | TASK [ovn-db : Copying over config.json files for services] ******************** 2026-04-28 05:13:04.615880 | orchestrator | Tuesday 28 April 2026 05:13:00 +0000 (0:00:04.030) 0:03:44.522 ********* 2026-04-28 05:13:04.615891 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:04.615903 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:04.615914 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:04.615934 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:04.615958 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:20.365091 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:20.365195 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:20.365207 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:13:20.365218 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:20.365226 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:13:20.365256 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:20.365265 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:13:20.365274 | orchestrator | 2026-04-28 05:13:20.365283 | orchestrator | TASK [ovn-db : Ensure configuration for relays exists] ************************* 2026-04-28 05:13:20.365293 | orchestrator | Tuesday 28 April 2026 05:13:06 +0000 (0:00:06.463) 0:03:50.986 ********* 2026-04-28 05:13:20.365301 | orchestrator | included: /ansible/roles/ovn-db/tasks/config-relay.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item=1) 2026-04-28 05:13:20.365310 | orchestrator | 2026-04-28 05:13:20.365318 | orchestrator | TASK [ovn-db : Ensuring config directories exist for OVN relay containers] ***** 2026-04-28 05:13:20.365338 | orchestrator | Tuesday 28 April 2026 05:13:08 +0000 (0:00:01.960) 0:03:52.946 ********* 2026-04-28 05:13:20.365347 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:13:20.365355 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:13:20.365375 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:13:20.365383 | orchestrator | 2026-04-28 05:13:20.365392 | orchestrator | TASK [ovn-db : Copying over config.json files for OVN relay services] ********** 2026-04-28 05:13:20.365400 | orchestrator | Tuesday 28 April 2026 05:13:10 +0000 (0:00:01.813) 0:03:54.760 ********* 2026-04-28 05:13:20.365408 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:13:20.365416 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:13:20.365423 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:13:20.365431 | orchestrator | 2026-04-28 05:13:20.365439 | orchestrator | TASK [ovn-db : Generate config files for OVN relay services] ******************* 2026-04-28 05:13:20.365446 | orchestrator | Tuesday 28 April 2026 05:13:13 +0000 (0:00:03.121) 0:03:57.881 ********* 2026-04-28 05:13:20.365454 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:13:20.365462 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:13:20.365469 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:13:20.365477 | orchestrator | 2026-04-28 05:13:20.365485 | orchestrator | TASK [service-check-containers : ovn_db | Check containers] ******************** 2026-04-28 05:13:20.365493 | orchestrator | Tuesday 28 April 2026 05:13:16 +0000 (0:00:02.773) 0:04:00.655 ********* 2026-04-28 05:13:20.365501 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:20.365511 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:20.365526 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:20.365535 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:20.365543 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:20.365555 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:20.365570 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:25.377467 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:13:25.377577 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:25.377619 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:13:25.377632 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:13:25.377644 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:13:25.377656 | orchestrator | 2026-04-28 05:13:25.377669 | orchestrator | TASK [service-check-containers : ovn_db | Notify handlers to restart containers] *** 2026-04-28 05:13:25.377681 | orchestrator | Tuesday 28 April 2026 05:13:21 +0000 (0:00:05.204) 0:04:05.860 ********* 2026-04-28 05:13:25.377693 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 05:13:25.377705 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:13:25.377716 | orchestrator | } 2026-04-28 05:13:25.377726 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 05:13:25.377737 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:13:25.377748 | orchestrator | } 2026-04-28 05:13:25.377796 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 05:13:25.377810 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:13:25.377820 | orchestrator | } 2026-04-28 05:13:25.377832 | orchestrator | 2026-04-28 05:13:25.377843 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 05:13:25.377854 | orchestrator | Tuesday 28 April 2026 05:13:23 +0000 (0:00:01.431) 0:04:07.292 ********* 2026-04-28 05:13:25.377880 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:13:25.377914 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:13:25.377927 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:13:25.377947 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:13:25.377959 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:13:25.377970 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:13:25.377982 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ovn-northd', 'value': {'container_name': 'ovn_northd', 'group': 'ovn-northd', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641', 'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-northd/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:13:25.377993 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ovn-nb-db', 'value': {'container_name': 'ovn_nb_db', 'group': 'ovn-nb-db', 'enabled': True, 'environment': {'OVN_NB_DB': 'tcp:192.168.16.10:6641,tcp:192.168.16.11:6641,tcp:192.168.16.12:6641'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-nb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_nb_db:/var/lib/openvswitch/ovn-nb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:13:25.378012 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ovn-sb-db', 'value': {'container_name': 'ovn_sb_db', 'group': 'ovn-sb-db', 'enabled': True, 'environment': {'OVN_SB_DB': 'tcp:192.168.16.10:6642,tcp:192.168.16.11:6642,tcp:192.168.16.12:6642'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328', 'volumes': ['/etc/kolla/ovn-sb-db/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'ovn_sb_db:/var/lib/openvswitch/ovn-sb/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 05:13:25.378096 | orchestrator | included: /ansible/roles/service-check-containers/tasks/iterated.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'key': 'ovn-sb-db-relay', 'value': {'container_name': 'ovn_sb_db_relay', 'group': 'ovn-sb-db-relay', 'enabled': True, 'environment': {'RELAY_ID': '1'}, 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328', 'iterate': True, 'iterate_var': '1', 'volumes': ['/etc/kolla/ovn-sb-db-relay/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 05:15:18.369556 | orchestrator | 2026-04-28 05:15:18.369671 | orchestrator | TASK [service-check-containers : ovn_db | Check containers with iteration] ***** 2026-04-28 05:15:18.369688 | orchestrator | Tuesday 28 April 2026 05:13:26 +0000 (0:00:03.441) 0:04:10.734 ********* 2026-04-28 05:15:18.369700 | orchestrator | changed: [testbed-node-0] => (item=1) 2026-04-28 05:15:18.369712 | orchestrator | changed: [testbed-node-1] => (item=1) 2026-04-28 05:15:18.369723 | orchestrator | changed: [testbed-node-2] => (item=1) 2026-04-28 05:15:18.369734 | orchestrator | 2026-04-28 05:15:18.369744 | orchestrator | TASK [service-check-containers : ovn_db | Notify handlers to restart containers] *** 2026-04-28 05:15:18.369756 | orchestrator | Tuesday 28 April 2026 05:13:48 +0000 (0:00:21.708) 0:04:32.442 ********* 2026-04-28 05:15:18.369767 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 05:15:18.369778 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:15:18.369789 | orchestrator | } 2026-04-28 05:15:18.369800 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 05:15:18.369810 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:15:18.369821 | orchestrator | } 2026-04-28 05:15:18.369832 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 05:15:18.369842 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 05:15:18.369902 | orchestrator | } 2026-04-28 05:15:18.369914 | orchestrator | 2026-04-28 05:15:18.369925 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-28 05:15:18.369936 | orchestrator | Tuesday 28 April 2026 05:13:49 +0000 (0:00:01.511) 0:04:33.953 ********* 2026-04-28 05:15:18.369947 | orchestrator | 2026-04-28 05:15:18.369958 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-28 05:15:18.369968 | orchestrator | Tuesday 28 April 2026 05:13:50 +0000 (0:00:00.450) 0:04:34.403 ********* 2026-04-28 05:15:18.369979 | orchestrator | 2026-04-28 05:15:18.369990 | orchestrator | TASK [ovn-db : Flush handlers] ************************************************* 2026-04-28 05:15:18.370000 | orchestrator | Tuesday 28 April 2026 05:13:50 +0000 (0:00:00.443) 0:04:34.847 ********* 2026-04-28 05:15:18.370011 | orchestrator | 2026-04-28 05:15:18.370144 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-nb-db container] ************************* 2026-04-28 05:15:18.370157 | orchestrator | Tuesday 28 April 2026 05:13:51 +0000 (0:00:00.847) 0:04:35.695 ********* 2026-04-28 05:15:18.370170 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:15:18.370182 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:15:18.370195 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:15:18.370208 | orchestrator | 2026-04-28 05:15:18.370220 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-sb-db container] ************************* 2026-04-28 05:15:18.370233 | orchestrator | Tuesday 28 April 2026 05:14:08 +0000 (0:00:16.843) 0:04:52.538 ********* 2026-04-28 05:15:18.370245 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:15:18.370257 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:15:18.370269 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:15:18.370282 | orchestrator | 2026-04-28 05:15:18.370294 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-sb-db-relay container] ******************* 2026-04-28 05:15:18.370307 | orchestrator | Tuesday 28 April 2026 05:14:25 +0000 (0:00:17.211) 0:05:09.750 ********* 2026-04-28 05:15:18.370320 | orchestrator | changed: [testbed-node-1] => (item=1) 2026-04-28 05:15:18.370332 | orchestrator | changed: [testbed-node-0] => (item=1) 2026-04-28 05:15:18.370344 | orchestrator | changed: [testbed-node-2] => (item=1) 2026-04-28 05:15:18.370356 | orchestrator | 2026-04-28 05:15:18.370368 | orchestrator | RUNNING HANDLER [ovn-db : Restart ovn-northd container] ************************ 2026-04-28 05:15:18.370380 | orchestrator | Tuesday 28 April 2026 05:14:41 +0000 (0:00:15.646) 0:05:25.396 ********* 2026-04-28 05:15:18.370393 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:15:18.370405 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:15:18.370444 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:15:18.370457 | orchestrator | 2026-04-28 05:15:18.370469 | orchestrator | TASK [ovn-db : Wait for leader election] *************************************** 2026-04-28 05:15:18.370480 | orchestrator | Tuesday 28 April 2026 05:14:57 +0000 (0:00:16.646) 0:05:42.043 ********* 2026-04-28 05:15:18.370491 | orchestrator | Pausing for 5 seconds 2026-04-28 05:15:18.370502 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:15:18.370513 | orchestrator | 2026-04-28 05:15:18.370523 | orchestrator | TASK [ovn-db : Get OVN_Northbound cluster leader] ****************************** 2026-04-28 05:15:18.370534 | orchestrator | Tuesday 28 April 2026 05:15:04 +0000 (0:00:06.145) 0:05:48.189 ********* 2026-04-28 05:15:18.370544 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:15:18.370555 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:15:18.370565 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:15:18.370576 | orchestrator | 2026-04-28 05:15:18.370586 | orchestrator | TASK [ovn-db : Configure OVN NB connection settings] *************************** 2026-04-28 05:15:18.370611 | orchestrator | Tuesday 28 April 2026 05:15:05 +0000 (0:00:01.778) 0:05:49.967 ********* 2026-04-28 05:15:18.370622 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:15:18.370633 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:15:18.370643 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:15:18.370654 | orchestrator | 2026-04-28 05:15:18.370664 | orchestrator | TASK [ovn-db : Get OVN_Southbound cluster leader] ****************************** 2026-04-28 05:15:18.370675 | orchestrator | Tuesday 28 April 2026 05:15:07 +0000 (0:00:01.631) 0:05:51.598 ********* 2026-04-28 05:15:18.370685 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:15:18.370696 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:15:18.370706 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:15:18.370717 | orchestrator | 2026-04-28 05:15:18.370727 | orchestrator | TASK [ovn-db : Configure OVN SB connection settings] *************************** 2026-04-28 05:15:18.370738 | orchestrator | Tuesday 28 April 2026 05:15:09 +0000 (0:00:01.876) 0:05:53.474 ********* 2026-04-28 05:15:18.370748 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:15:18.370759 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:15:18.370769 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:15:18.370780 | orchestrator | 2026-04-28 05:15:18.370790 | orchestrator | TASK [ovn-db : Wait for ovn-nb-db] ********************************************* 2026-04-28 05:15:18.370801 | orchestrator | Tuesday 28 April 2026 05:15:11 +0000 (0:00:01.911) 0:05:55.386 ********* 2026-04-28 05:15:18.370811 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:15:18.370822 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:15:18.370832 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:15:18.370843 | orchestrator | 2026-04-28 05:15:18.370886 | orchestrator | TASK [ovn-db : Wait for ovn-sb-db] ********************************************* 2026-04-28 05:15:18.370917 | orchestrator | Tuesday 28 April 2026 05:15:13 +0000 (0:00:01.861) 0:05:57.248 ********* 2026-04-28 05:15:18.370929 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:15:18.370939 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:15:18.370950 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:15:18.370960 | orchestrator | 2026-04-28 05:15:18.370970 | orchestrator | TASK [ovn-db : Wait for ovn-sb-db-relay] *************************************** 2026-04-28 05:15:18.370981 | orchestrator | Tuesday 28 April 2026 05:15:15 +0000 (0:00:02.166) 0:05:59.414 ********* 2026-04-28 05:15:18.370992 | orchestrator | ok: [testbed-node-0] => (item=1) 2026-04-28 05:15:18.371002 | orchestrator | ok: [testbed-node-1] => (item=1) 2026-04-28 05:15:18.371013 | orchestrator | ok: [testbed-node-2] => (item=1) 2026-04-28 05:15:18.371023 | orchestrator | 2026-04-28 05:15:18.371034 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 05:15:18.371045 | orchestrator | testbed-node-0 : ok=49  changed=16  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-28 05:15:18.371057 | orchestrator | testbed-node-1 : ok=47  changed=15  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2026-04-28 05:15:18.371068 | orchestrator | testbed-node-2 : ok=48  changed=16  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-28 05:15:18.371088 | orchestrator | testbed-node-3 : ok=12  changed=4  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 05:15:18.371099 | orchestrator | testbed-node-4 : ok=12  changed=4  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 05:15:18.371109 | orchestrator | testbed-node-5 : ok=12  changed=4  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 05:15:18.371120 | orchestrator | 2026-04-28 05:15:18.371130 | orchestrator | 2026-04-28 05:15:18.371141 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 05:15:18.371152 | orchestrator | Tuesday 28 April 2026 05:15:17 +0000 (0:00:02.617) 0:06:02.031 ********* 2026-04-28 05:15:18.371162 | orchestrator | =============================================================================== 2026-04-28 05:15:18.371173 | orchestrator | ovn-controller : Restart ovn-controller container --------------------- 131.99s 2026-04-28 05:15:18.371183 | orchestrator | service-check-containers : ovn_db | Check containers with iteration ---- 21.71s 2026-04-28 05:15:18.371194 | orchestrator | ovn-controller : Configure OVN in OVSDB -------------------------------- 20.11s 2026-04-28 05:15:18.371204 | orchestrator | ovn-db : Restart ovn-sb-db container ----------------------------------- 17.21s 2026-04-28 05:15:18.371214 | orchestrator | ovn-db : Restart ovn-nb-db container ----------------------------------- 16.84s 2026-04-28 05:15:18.371225 | orchestrator | ovn-db : Restart ovn-northd container ---------------------------------- 16.65s 2026-04-28 05:15:18.371236 | orchestrator | ovn-db : Restart ovn-sb-db-relay container ----------------------------- 15.65s 2026-04-28 05:15:18.371246 | orchestrator | ovn-db : Copying over config.json files for services -------------------- 6.47s 2026-04-28 05:15:18.371257 | orchestrator | ovn-db : Wait for leader election --------------------------------------- 6.15s 2026-04-28 05:15:18.371267 | orchestrator | service-check-containers : ovn_db | Check containers -------------------- 5.20s 2026-04-28 05:15:18.371278 | orchestrator | ovn-db : Ensuring config directories exist ------------------------------ 4.03s 2026-04-28 05:15:18.371288 | orchestrator | ovn-controller : Create br-int bridge on OpenvSwitch -------------------- 3.79s 2026-04-28 05:15:18.371299 | orchestrator | service-check-containers : Include tasks -------------------------------- 3.44s 2026-04-28 05:15:18.371309 | orchestrator | Group hosts based on Kolla action --------------------------------------- 3.33s 2026-04-28 05:15:18.371320 | orchestrator | ovn-controller : Flush handlers ----------------------------------------- 3.27s 2026-04-28 05:15:18.371331 | orchestrator | ovn-db : Copying over config.json files for OVN relay services ---------- 3.12s 2026-04-28 05:15:18.371347 | orchestrator | ovn-controller : Copying over systemd override -------------------------- 3.12s 2026-04-28 05:15:18.371358 | orchestrator | ovn-controller : Ensuring config directories exist ---------------------- 2.91s 2026-04-28 05:15:18.371368 | orchestrator | ovn-controller : Copying over config.json files for services ------------ 2.80s 2026-04-28 05:15:18.371379 | orchestrator | ovn-db : Generate config files for OVN relay services ------------------- 2.77s 2026-04-28 05:15:18.586284 | orchestrator | + [[ false == \f\a\l\s\e ]] 2026-04-28 05:15:18.586368 | orchestrator | + [[ ceph-ansible == \c\e\p\h\-\a\n\s\i\b\l\e ]] 2026-04-28 05:15:18.586378 | orchestrator | + sh -c /opt/configuration/scripts/upgrade/100-ceph-with-ansible.sh 2026-04-28 05:15:18.595788 | orchestrator | + set -e 2026-04-28 05:15:18.595897 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-28 05:15:18.595913 | orchestrator | ++ export INTERACTIVE=false 2026-04-28 05:15:18.595925 | orchestrator | ++ INTERACTIVE=false 2026-04-28 05:15:18.595933 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-28 05:15:18.595942 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-28 05:15:18.595951 | orchestrator | + osism apply ceph-rolling_update -e ireallymeanit=yes 2026-04-28 05:15:19.861845 | orchestrator | 2026-04-28 05:15:19 | INFO  | Prepare task for execution of ceph-rolling_update. 2026-04-28 05:15:19.926415 | orchestrator | 2026-04-28 05:15:19 | INFO  | Task 0e72fa89-5b69-4dd6-b3e5-02064f402dad (ceph-rolling_update) was prepared for execution. 2026-04-28 05:15:19.926510 | orchestrator | 2026-04-28 05:15:19 | INFO  | It takes a moment until task 0e72fa89-5b69-4dd6-b3e5-02064f402dad (ceph-rolling_update) has been started and output is visible here. 2026-04-28 05:16:42.236193 | orchestrator | [WARNING]: Collection community.general does not support Ansible version 2026-04-28 05:16:42.236339 | orchestrator | 2.16.14 2026-04-28 05:16:42.236356 | orchestrator | 2026-04-28 05:16:42.236368 | orchestrator | PLAY [Confirm whether user really meant to upgrade the cluster] **************** 2026-04-28 05:16:42.236380 | orchestrator | 2026-04-28 05:16:42.236391 | orchestrator | TASK [Exit playbook, if user did not mean to upgrade cluster] ****************** 2026-04-28 05:16:42.236402 | orchestrator | Tuesday 28 April 2026 05:15:28 +0000 (0:00:01.639) 0:00:01.639 ********* 2026-04-28 05:16:42.236413 | orchestrator | skipping: [localhost] 2026-04-28 05:16:42.236425 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: rbdmirrors 2026-04-28 05:16:42.236436 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: nfss 2026-04-28 05:16:42.236447 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: clients 2026-04-28 05:16:42.236457 | orchestrator | 2026-04-28 05:16:42.236468 | orchestrator | PLAY [Gather facts and check the init system] ********************************** 2026-04-28 05:16:42.236479 | orchestrator | 2026-04-28 05:16:42.236490 | orchestrator | TASK [Gather facts on all Ceph hosts for following reference] ****************** 2026-04-28 05:16:42.236501 | orchestrator | Tuesday 28 April 2026 05:15:30 +0000 (0:00:02.426) 0:00:04.065 ********* 2026-04-28 05:16:42.236511 | orchestrator | ok: [testbed-node-0] => { 2026-04-28 05:16:42.236522 | orchestrator |  "msg": "gather facts on all Ceph hosts for following reference" 2026-04-28 05:16:42.236533 | orchestrator | } 2026-04-28 05:16:42.236544 | orchestrator | ok: [testbed-node-1] => { 2026-04-28 05:16:42.236554 | orchestrator |  "msg": "gather facts on all Ceph hosts for following reference" 2026-04-28 05:16:42.236565 | orchestrator | } 2026-04-28 05:16:42.236576 | orchestrator | ok: [testbed-node-2] => { 2026-04-28 05:16:42.236587 | orchestrator |  "msg": "gather facts on all Ceph hosts for following reference" 2026-04-28 05:16:42.236597 | orchestrator | } 2026-04-28 05:16:42.236608 | orchestrator | ok: [testbed-node-3] => { 2026-04-28 05:16:42.236619 | orchestrator |  "msg": "gather facts on all Ceph hosts for following reference" 2026-04-28 05:16:42.236630 | orchestrator | } 2026-04-28 05:16:42.236640 | orchestrator | ok: [testbed-node-4] => { 2026-04-28 05:16:42.236651 | orchestrator |  "msg": "gather facts on all Ceph hosts for following reference" 2026-04-28 05:16:42.236662 | orchestrator | } 2026-04-28 05:16:42.236672 | orchestrator | ok: [testbed-node-5] => { 2026-04-28 05:16:42.236683 | orchestrator |  "msg": "gather facts on all Ceph hosts for following reference" 2026-04-28 05:16:42.236693 | orchestrator | } 2026-04-28 05:16:42.236704 | orchestrator | ok: [testbed-manager] => { 2026-04-28 05:16:42.236715 | orchestrator |  "msg": "gather facts on all Ceph hosts for following reference" 2026-04-28 05:16:42.236733 | orchestrator | } 2026-04-28 05:16:42.236753 | orchestrator | 2026-04-28 05:16:42.236773 | orchestrator | TASK [Gather facts] ************************************************************ 2026-04-28 05:16:42.236792 | orchestrator | Tuesday 28 April 2026 05:15:35 +0000 (0:00:04.790) 0:00:08.855 ********* 2026-04-28 05:16:42.236813 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:16:42.236833 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:16:42.236862 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:16:42.236875 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:16:42.236888 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:16:42.236900 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:16:42.236913 | orchestrator | ok: [testbed-manager] 2026-04-28 05:16:42.236947 | orchestrator | 2026-04-28 05:16:42.236960 | orchestrator | TASK [Gather and delegate facts] *********************************************** 2026-04-28 05:16:42.237000 | orchestrator | Tuesday 28 April 2026 05:15:41 +0000 (0:00:05.754) 0:00:14.610 ********* 2026-04-28 05:16:42.237013 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:16:42.237026 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 05:16:42.237038 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:16:42.237051 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:16:42.237064 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 05:16:42.237076 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 05:16:42.237088 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 05:16:42.237100 | orchestrator | 2026-04-28 05:16:42.237125 | orchestrator | TASK [Set_fact rolling_update] ************************************************* 2026-04-28 05:16:42.237136 | orchestrator | Tuesday 28 April 2026 05:16:12 +0000 (0:00:31.053) 0:00:45.664 ********* 2026-04-28 05:16:42.237147 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:16:42.237158 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:16:42.237168 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:16:42.237179 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:16:42.237189 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:16:42.237200 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:16:42.237210 | orchestrator | ok: [testbed-manager] 2026-04-28 05:16:42.237221 | orchestrator | 2026-04-28 05:16:42.237232 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 05:16:42.237242 | orchestrator | Tuesday 28 April 2026 05:16:14 +0000 (0:00:02.113) 0:00:47.778 ********* 2026-04-28 05:16:42.237253 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5, testbed-manager 2026-04-28 05:16:42.237266 | orchestrator | 2026-04-28 05:16:42.237276 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-28 05:16:42.237287 | orchestrator | Tuesday 28 April 2026 05:16:17 +0000 (0:00:02.689) 0:00:50.467 ********* 2026-04-28 05:16:42.237298 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:16:42.237308 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:16:42.237319 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:16:42.237329 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:16:42.237339 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:16:42.237350 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:16:42.237361 | orchestrator | ok: [testbed-manager] 2026-04-28 05:16:42.237371 | orchestrator | 2026-04-28 05:16:42.237400 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-28 05:16:42.237412 | orchestrator | Tuesday 28 April 2026 05:16:19 +0000 (0:00:02.622) 0:00:53.090 ********* 2026-04-28 05:16:42.237423 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:16:42.237433 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:16:42.237444 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:16:42.237454 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:16:42.237464 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:16:42.237475 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:16:42.237485 | orchestrator | ok: [testbed-manager] 2026-04-28 05:16:42.237496 | orchestrator | 2026-04-28 05:16:42.237507 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 05:16:42.237517 | orchestrator | Tuesday 28 April 2026 05:16:21 +0000 (0:00:02.011) 0:00:55.101 ********* 2026-04-28 05:16:42.237528 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:16:42.237538 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:16:42.237549 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:16:42.237559 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:16:42.237570 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:16:42.237580 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:16:42.237591 | orchestrator | ok: [testbed-manager] 2026-04-28 05:16:42.237601 | orchestrator | 2026-04-28 05:16:42.237619 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 05:16:42.237630 | orchestrator | Tuesday 28 April 2026 05:16:24 +0000 (0:00:02.667) 0:00:57.768 ********* 2026-04-28 05:16:42.237641 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:16:42.237651 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:16:42.237662 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:16:42.237672 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:16:42.237683 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:16:42.237693 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:16:42.237704 | orchestrator | ok: [testbed-manager] 2026-04-28 05:16:42.237714 | orchestrator | 2026-04-28 05:16:42.237725 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-28 05:16:42.237735 | orchestrator | Tuesday 28 April 2026 05:16:26 +0000 (0:00:01.962) 0:00:59.731 ********* 2026-04-28 05:16:42.237746 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:16:42.237756 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:16:42.237766 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:16:42.237777 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:16:42.237787 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:16:42.237798 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:16:42.237808 | orchestrator | ok: [testbed-manager] 2026-04-28 05:16:42.237818 | orchestrator | 2026-04-28 05:16:42.237829 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-28 05:16:42.237840 | orchestrator | Tuesday 28 April 2026 05:16:28 +0000 (0:00:02.103) 0:01:01.834 ********* 2026-04-28 05:16:42.237850 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:16:42.237860 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:16:42.237871 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:16:42.237881 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:16:42.237892 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:16:42.237902 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:16:42.237913 | orchestrator | ok: [testbed-manager] 2026-04-28 05:16:42.237952 | orchestrator | 2026-04-28 05:16:42.237964 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-28 05:16:42.237975 | orchestrator | Tuesday 28 April 2026 05:16:30 +0000 (0:00:01.970) 0:01:03.805 ********* 2026-04-28 05:16:42.237986 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:16:42.237996 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:16:42.238007 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:16:42.238080 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:16:42.238094 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:16:42.238105 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:16:42.238115 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:16:42.238126 | orchestrator | 2026-04-28 05:16:42.238137 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-28 05:16:42.238148 | orchestrator | Tuesday 28 April 2026 05:16:32 +0000 (0:00:02.118) 0:01:05.923 ********* 2026-04-28 05:16:42.238159 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:16:42.238169 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:16:42.238180 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:16:42.238190 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:16:42.238201 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:16:42.238211 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:16:42.238222 | orchestrator | ok: [testbed-manager] 2026-04-28 05:16:42.238232 | orchestrator | 2026-04-28 05:16:42.238243 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-28 05:16:42.238254 | orchestrator | Tuesday 28 April 2026 05:16:34 +0000 (0:00:01.863) 0:01:07.786 ********* 2026-04-28 05:16:42.238265 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:16:42.238281 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:16:42.238293 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:16:42.238303 | orchestrator | 2026-04-28 05:16:42.238314 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-28 05:16:42.238334 | orchestrator | Tuesday 28 April 2026 05:16:36 +0000 (0:00:02.217) 0:01:10.004 ********* 2026-04-28 05:16:42.238345 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:16:42.238356 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:16:42.238366 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:16:42.238377 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:16:42.238387 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:16:42.238397 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:16:42.238408 | orchestrator | ok: [testbed-manager] 2026-04-28 05:16:42.238419 | orchestrator | 2026-04-28 05:16:42.238429 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-28 05:16:42.238440 | orchestrator | Tuesday 28 April 2026 05:16:38 +0000 (0:00:02.100) 0:01:12.104 ********* 2026-04-28 05:16:42.238450 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:16:42.238461 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:16:42.238472 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:16:42.238482 | orchestrator | 2026-04-28 05:16:42.238493 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-28 05:16:42.238504 | orchestrator | Tuesday 28 April 2026 05:16:42 +0000 (0:00:03.338) 0:01:15.442 ********* 2026-04-28 05:16:42.238522 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-28 05:17:05.416576 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-28 05:17:05.416707 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-28 05:17:05.416724 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:17:05.416736 | orchestrator | 2026-04-28 05:17:05.416749 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-28 05:17:05.416761 | orchestrator | Tuesday 28 April 2026 05:16:43 +0000 (0:00:01.445) 0:01:16.888 ********* 2026-04-28 05:17:05.416774 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-28 05:17:05.416788 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-28 05:17:05.416799 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-28 05:17:05.416810 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:17:05.416821 | orchestrator | 2026-04-28 05:17:05.416833 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-28 05:17:05.416846 | orchestrator | Tuesday 28 April 2026 05:16:45 +0000 (0:00:01.943) 0:01:18.832 ********* 2026-04-28 05:17:05.416872 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:05.416902 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:05.416920 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:05.417049 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:17:05.417075 | orchestrator | 2026-04-28 05:17:05.417096 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-28 05:17:05.417115 | orchestrator | Tuesday 28 April 2026 05:16:46 +0000 (0:00:01.191) 0:01:20.023 ********* 2026-04-28 05:17:05.417147 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': '87fa47a77fbc', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-28 05:16:39.415506', 'end': '2026-04-28 05:16:39.461889', 'delta': '0:00:00.046383', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['87fa47a77fbc'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-28 05:17:05.417186 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': '90eb2d51595d', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-28 05:16:39.954053', 'end': '2026-04-28 05:16:40.008921', 'delta': '0:00:00.054868', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['90eb2d51595d'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-28 05:17:05.417200 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': 'ba47649d1789', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-28 05:16:40.806220', 'end': '2026-04-28 05:16:40.869074', 'delta': '0:00:00.062854', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['ba47649d1789'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-28 05:17:05.417213 | orchestrator | 2026-04-28 05:17:05.417226 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-28 05:17:05.417238 | orchestrator | Tuesday 28 April 2026 05:16:47 +0000 (0:00:01.228) 0:01:21.252 ********* 2026-04-28 05:17:05.417252 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:17:05.417266 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:17:05.417278 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:17:05.417290 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:17:05.417302 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:17:05.417314 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:17:05.417327 | orchestrator | ok: [testbed-manager] 2026-04-28 05:17:05.417340 | orchestrator | 2026-04-28 05:17:05.417352 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-28 05:17:05.417365 | orchestrator | Tuesday 28 April 2026 05:16:50 +0000 (0:00:02.447) 0:01:23.699 ********* 2026-04-28 05:17:05.417377 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:17:05.417390 | orchestrator | 2026-04-28 05:17:05.417407 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-28 05:17:05.417439 | orchestrator | Tuesday 28 April 2026 05:16:51 +0000 (0:00:01.295) 0:01:24.994 ********* 2026-04-28 05:17:05.417458 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:17:05.417476 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:17:05.417492 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:17:05.417510 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:17:05.417527 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:17:05.417544 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:17:05.417561 | orchestrator | ok: [testbed-manager] 2026-04-28 05:17:05.417578 | orchestrator | 2026-04-28 05:17:05.417597 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-28 05:17:05.417616 | orchestrator | Tuesday 28 April 2026 05:16:53 +0000 (0:00:02.125) 0:01:27.120 ********* 2026-04-28 05:17:05.417635 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:17:05.417647 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] 2026-04-28 05:17:05.417658 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-28 05:17:05.417669 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-28 05:17:05.417679 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-28 05:17:05.417690 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-28 05:17:05.417700 | orchestrator | ok: [testbed-manager -> testbed-node-0(192.168.16.10)] 2026-04-28 05:17:05.417711 | orchestrator | 2026-04-28 05:17:05.417722 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 05:17:05.417732 | orchestrator | Tuesday 28 April 2026 05:16:57 +0000 (0:00:04.112) 0:01:31.233 ********* 2026-04-28 05:17:05.417743 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:17:05.417753 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:17:05.417764 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:17:05.417774 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:17:05.417785 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:17:05.417795 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:17:05.417806 | orchestrator | ok: [testbed-manager] 2026-04-28 05:17:05.417816 | orchestrator | 2026-04-28 05:17:05.417827 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-28 05:17:05.417845 | orchestrator | Tuesday 28 April 2026 05:16:59 +0000 (0:00:02.079) 0:01:33.314 ********* 2026-04-28 05:17:05.417856 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:17:05.417867 | orchestrator | 2026-04-28 05:17:05.417894 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-28 05:17:05.417905 | orchestrator | Tuesday 28 April 2026 05:17:01 +0000 (0:00:01.140) 0:01:34.454 ********* 2026-04-28 05:17:05.417916 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:17:05.417927 | orchestrator | 2026-04-28 05:17:05.417937 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 05:17:05.417976 | orchestrator | Tuesday 28 April 2026 05:17:02 +0000 (0:00:01.240) 0:01:35.696 ********* 2026-04-28 05:17:05.417988 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:17:05.417998 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:17:05.418009 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:17:05.418085 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:17:05.418097 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:17:05.418108 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:17:05.418118 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:17:05.418129 | orchestrator | 2026-04-28 05:17:05.418139 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-28 05:17:05.418150 | orchestrator | Tuesday 28 April 2026 05:17:04 +0000 (0:00:02.321) 0:01:38.017 ********* 2026-04-28 05:17:05.418161 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:17:05.418171 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:17:05.418182 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:17:05.418193 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:17:05.418203 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:17:05.418223 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:17:05.418247 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:17:17.374801 | orchestrator | 2026-04-28 05:17:17.374918 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-28 05:17:17.374935 | orchestrator | Tuesday 28 April 2026 05:17:06 +0000 (0:00:01.977) 0:01:39.994 ********* 2026-04-28 05:17:17.374947 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:17:17.375016 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:17:17.375028 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:17:17.375040 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:17:17.375051 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:17:17.375061 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:17:17.375072 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:17:17.375083 | orchestrator | 2026-04-28 05:17:17.375094 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-28 05:17:17.375105 | orchestrator | Tuesday 28 April 2026 05:17:08 +0000 (0:00:02.089) 0:01:42.084 ********* 2026-04-28 05:17:17.375116 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:17:17.375126 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:17:17.375137 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:17:17.375148 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:17:17.375158 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:17:17.375169 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:17:17.375179 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:17:17.375190 | orchestrator | 2026-04-28 05:17:17.375200 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-28 05:17:17.375211 | orchestrator | Tuesday 28 April 2026 05:17:10 +0000 (0:00:01.922) 0:01:44.006 ********* 2026-04-28 05:17:17.375222 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:17:17.375232 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:17:17.375243 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:17:17.375253 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:17:17.375264 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:17:17.375274 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:17:17.375285 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:17:17.375296 | orchestrator | 2026-04-28 05:17:17.375306 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-28 05:17:17.375317 | orchestrator | Tuesday 28 April 2026 05:17:12 +0000 (0:00:02.175) 0:01:46.182 ********* 2026-04-28 05:17:17.375328 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:17:17.375340 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:17:17.375352 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:17:17.375365 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:17:17.375378 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:17:17.375390 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:17:17.375403 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:17:17.375415 | orchestrator | 2026-04-28 05:17:17.375427 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-28 05:17:17.375440 | orchestrator | Tuesday 28 April 2026 05:17:14 +0000 (0:00:02.086) 0:01:48.269 ********* 2026-04-28 05:17:17.375453 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:17:17.375465 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:17:17.375477 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:17:17.375488 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:17:17.375500 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:17:17.375512 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:17:17.375524 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:17:17.375536 | orchestrator | 2026-04-28 05:17:17.375549 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-28 05:17:17.375561 | orchestrator | Tuesday 28 April 2026 05:17:17 +0000 (0:00:02.251) 0:01:50.520 ********* 2026-04-28 05:17:17.375575 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.375630 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.375645 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.375675 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-19-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 05:17:17.375690 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.375702 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.375713 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.375734 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '12b9c610', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part16', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part14', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part15', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part1', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:17:17.375757 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.375777 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.676374 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.676468 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.676482 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.676494 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-12-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 05:17:17.676529 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.676540 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.676563 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.676596 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '16596406', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part16', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part14', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part15', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part1', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:17:17.676610 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.676620 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.676637 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:17:17.676648 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.676663 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.676674 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.676684 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-16-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 05:17:17.676694 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:17:17.676710 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.795401 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.795492 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.795526 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46c58400', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part16', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part14', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part15', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part1', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:17:17.795580 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.795592 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.795618 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.795630 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1', 'dm-uuid-LVM-SMcSbjI9wnD6SeY7SKKJ6dCSoT074g1SuE3hmfWZ3V1NoBQYcdXeMp0c5DwXf9Jz'], 'uuids': ['bb15ffa5-db58-4aaf-8e50-4b001450e00b'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f7edf0fa', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz']}})  2026-04-28 05:17:17.795642 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c', 'scsi-SQEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '0b1dfca7', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:17:17.795662 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-CCJsyU-Xs4y-bAwu-Sr1U-RU9B-U5cX-8dk8mo', 'scsi-0QEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202', 'scsi-SQEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46b7ee74', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f']}})  2026-04-28 05:17:17.795678 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.795689 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:17.795699 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-18-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 05:17:17.795718 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.002715 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu', 'dm-uuid-CRYPT-LUKS2-5da20da06cd949e5b229e06742b9ea2c-94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 05:17:18.002832 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.002881 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:17:18.002899 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f', 'dm-uuid-LVM-8dHS1FAptgldbJuN9Gw1hr0pl5XswJ3894zCAdztzvSylGKJfL2Zwu5Qsrm0jqWu'], 'uuids': ['5da20da0-6cd9-49e5-b229-e06742b9ea2c'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '46b7ee74', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu']}})  2026-04-28 05:17:18.002927 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-rTHLNA-XX65-cEa6-oPdR-i0kN-CrZ9-dGTohN', 'scsi-0QEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675', 'scsi-SQEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f7edf0fa', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1']}})  2026-04-28 05:17:18.002940 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.003008 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '3fe92a08', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:17:18.003045 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.003058 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.003075 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz', 'dm-uuid-CRYPT-LUKS2-bb15ffa5db584aaf8e504b001450e00b-uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 05:17:18.003087 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.003098 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a', 'dm-uuid-LVM-Ef9S4L9mnk6YjVYwTU4OmJ1Dk0yNJkcNEeYiJgmdqy5Dk4JMIq1jh9ZhEgnxusYs'], 'uuids': ['46d73a0b-76ab-4c42-90e0-cf88eb28d186'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f49158cb', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs']}})  2026-04-28 05:17:18.003110 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:17:18.003129 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80', 'scsi-SQEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '81043571', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:17:18.185614 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-l9OtEf-0x8l-OZFM-QMSY-xI5K-ifcY-q0IHfV', 'scsi-0QEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b', 'scsi-SQEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '6fed6807', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf']}})  2026-04-28 05:17:18.185768 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.185787 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.185816 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-13-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 05:17:18.185858 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.185870 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.185882 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg', 'dm-uuid-CRYPT-LUKS2-699d16b2a15647d8861ce74191aa2e29-p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 05:17:18.185911 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1', 'dm-uuid-LVM-L5YjMhWvYgnpoIfTj51PZeO1wrabnQEX7l2ME9eZWg9LEHQ0f9eDaf27dOm77xe0'], 'uuids': ['dfd6b477-c8eb-4a33-b64e-726cd73356df'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '953cbf01', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0']}})  2026-04-28 05:17:18.185932 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.185944 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de', 'scsi-SQEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'eca06b16', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:17:18.186015 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf', 'dm-uuid-LVM-jDSXafY010UkbP8ZmxeIQet2dAZt2ducp03EHOrl6D51efYCaF9MHllF0WrfMNUg'], 'uuids': ['699d16b2-a156-47d8-861c-e74191aa2e29'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '6fed6807', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg']}})  2026-04-28 05:17:18.186095 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-L2AQ1c-y7H3-F3Y3-6Qkf-SkKZ-Rdhw-Yd8PGb', 'scsi-0QEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79', 'scsi-SQEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '0d71173f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab']}})  2026-04-28 05:17:18.186109 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-NfMdHp-i6Wd-iXE4-bdeT-UQcT-dakb-CDL8cZ', 'scsi-0QEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba', 'scsi-SQEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f49158cb', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a']}})  2026-04-28 05:17:18.186129 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.373005 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.373108 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.373147 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46815659', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:17:18.373166 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-15-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 05:17:18.373179 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.373233 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.373247 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.373258 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.373269 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.373280 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.373297 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE', 'dm-uuid-CRYPT-LUKS2-49a0c8edea6a405ca40698859485fff3-xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 05:17:18.373309 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs', 'dm-uuid-CRYPT-LUKS2-46d73a0b76ab4c4290e0cf88eb28d186-EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 05:17:18.373322 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:17:18.373335 | orchestrator | skipping: [testbed-manager] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-47-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1060', 'sectorsize': '2048', 'size': '530.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 05:17:18.373365 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.422775 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.422854 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.422863 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.422872 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab', 'dm-uuid-LVM-wa3l676dWvdqPItJjhbbIPxjjJMNXrWDxgNEYRSdoBZ0EZLJPUa6Po9zcB3PjLSE'], 'uuids': ['49a0c8ed-ea6a-405c-a406-98859485fff3'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '0d71173f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE']}})  2026-04-28 05:17:18.422896 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-vGsvHj-S1i8-Sw7N-17Sv-GX9v-DQYR-rG2tdh', 'scsi-0QEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89', 'scsi-SQEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '953cbf01', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1']}})  2026-04-28 05:17:18.422921 | orchestrator | skipping: [testbed-manager] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_5ea701e6-1739-4314-8940-18827c834622', 'scsi-SQEMU_QEMU_HARDDISK_5ea701e6-1739-4314-8940-18827c834622'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '5ea701e6', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_5ea701e6-1739-4314-8940-18827c834622-part16', 'scsi-SQEMU_QEMU_HARDDISK_5ea701e6-1739-4314-8940-18827c834622-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_5ea701e6-1739-4314-8940-18827c834622-part14', 'scsi-SQEMU_QEMU_HARDDISK_5ea701e6-1739-4314-8940-18827c834622-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_5ea701e6-1739-4314-8940-18827c834622-part15', 'scsi-SQEMU_QEMU_HARDDISK_5ea701e6-1739-4314-8940-18827c834622-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_5ea701e6-1739-4314-8940-18827c834622-part1', 'scsi-SQEMU_QEMU_HARDDISK_5ea701e6-1739-4314-8940-18827c834622-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:17:18.422948 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.422987 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:18.422995 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '4c7fe216', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:17:18.423014 | orchestrator | skipping: [testbed-manager] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:19.987105 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:19.987207 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:17:19.987225 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:17:19.987337 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0', 'dm-uuid-CRYPT-LUKS2-dfd6b477c8eb4a33b64e726cd73356df-7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 05:17:19.987361 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:17:19.987373 | orchestrator | 2026-04-28 05:17:19.987385 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-28 05:17:19.987397 | orchestrator | Tuesday 28 April 2026 05:17:19 +0000 (0:00:02.440) 0:01:52.961 ********* 2026-04-28 05:17:19.987416 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:19.987429 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:19.987463 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:19.987495 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-19-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:19.987509 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:19.987520 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:19.987537 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:19.987560 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '12b9c610', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part16', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part14', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part15', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part1', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.147586 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.147681 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.147711 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.147724 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.147756 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.147769 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-12-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.147799 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.147812 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.147829 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.147843 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '16596406', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part16', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part14', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part15', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part1', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.147872 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.317140 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.317283 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:17:20.317323 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.317358 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.317370 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.317383 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-16-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.317395 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.317424 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.317436 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.317531 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46c58400', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part16', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part14', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part15', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part1', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.317549 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.317571 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.665393 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:17:20.665511 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.665561 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1', 'dm-uuid-LVM-SMcSbjI9wnD6SeY7SKKJ6dCSoT074g1SuE3hmfWZ3V1NoBQYcdXeMp0c5DwXf9Jz'], 'uuids': ['bb15ffa5-db58-4aaf-8e50-4b001450e00b'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f7edf0fa', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.665577 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c', 'scsi-SQEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '0b1dfca7', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.665590 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-CCJsyU-Xs4y-bAwu-Sr1U-RU9B-U5cX-8dk8mo', 'scsi-0QEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202', 'scsi-SQEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46b7ee74', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.665604 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.665635 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.665660 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-18-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.665672 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:17:20.665684 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.665696 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu', 'dm-uuid-CRYPT-LUKS2-5da20da06cd949e5b229e06742b9ea2c-94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.665707 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.665726 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f', 'dm-uuid-LVM-8dHS1FAptgldbJuN9Gw1hr0pl5XswJ3894zCAdztzvSylGKJfL2Zwu5Qsrm0jqWu'], 'uuids': ['5da20da0-6cd9-49e5-b229-e06742b9ea2c'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '46b7ee74', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.786474 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-rTHLNA-XX65-cEa6-oPdR-i0kN-CrZ9-dGTohN', 'scsi-0QEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675', 'scsi-SQEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f7edf0fa', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.786560 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.786572 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.786581 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a', 'dm-uuid-LVM-Ef9S4L9mnk6YjVYwTU4OmJ1Dk0yNJkcNEeYiJgmdqy5Dk4JMIq1jh9ZhEgnxusYs'], 'uuids': ['46d73a0b-76ab-4c42-90e0-cf88eb28d186'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f49158cb', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.786610 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '3fe92a08', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.786639 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80', 'scsi-SQEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '81043571', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.786648 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.786657 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-l9OtEf-0x8l-OZFM-QMSY-xI5K-ifcY-q0IHfV', 'scsi-0QEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b', 'scsi-SQEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '6fed6807', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:20.786677 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.005452 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.005537 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz', 'dm-uuid-CRYPT-LUKS2-bb15ffa5db584aaf8e504b001450e00b-uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.005550 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.005558 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-13-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.005566 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:17:21.005575 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.005616 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg', 'dm-uuid-CRYPT-LUKS2-699d16b2a15647d8861ce74191aa2e29-p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.005640 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.005649 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf', 'dm-uuid-LVM-jDSXafY010UkbP8ZmxeIQet2dAZt2ducp03EHOrl6D51efYCaF9MHllF0WrfMNUg'], 'uuids': ['699d16b2-a156-47d8-861c-e74191aa2e29'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '6fed6807', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.005658 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-NfMdHp-i6Wd-iXE4-bdeT-UQcT-dakb-CDL8cZ', 'scsi-0QEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba', 'scsi-SQEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f49158cb', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.005667 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.005691 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46815659', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.122580 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.122662 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.122676 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs', 'dm-uuid-CRYPT-LUKS2-46d73a0b76ab4c4290e0cf88eb28d186-EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.122712 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.122740 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1', 'dm-uuid-LVM-L5YjMhWvYgnpoIfTj51PZeO1wrabnQEX7l2ME9eZWg9LEHQ0f9eDaf27dOm77xe0'], 'uuids': ['dfd6b477-c8eb-4a33-b64e-726cd73356df'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '953cbf01', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.122768 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de', 'scsi-SQEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'eca06b16', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.122782 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-L2AQ1c-y7H3-F3Y3-6Qkf-SkKZ-Rdhw-Yd8PGb', 'scsi-0QEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79', 'scsi-SQEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '0d71173f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.122795 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.122821 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.122837 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-15-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.122849 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.122869 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE', 'dm-uuid-CRYPT-LUKS2-49a0c8edea6a405ca40698859485fff3-xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.220917 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.221089 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:17:21.221111 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab', 'dm-uuid-LVM-wa3l676dWvdqPItJjhbbIPxjjJMNXrWDxgNEYRSdoBZ0EZLJPUa6Po9zcB3PjLSE'], 'uuids': ['49a0c8ed-ea6a-405c-a406-98859485fff3'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '0d71173f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.221174 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-vGsvHj-S1i8-Sw7N-17Sv-GX9v-DQYR-rG2tdh', 'scsi-0QEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89', 'scsi-SQEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '953cbf01', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.221200 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.221241 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '4c7fe216', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.221263 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.221281 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.221293 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.221305 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:21.221324 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:28.072489 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0', 'dm-uuid-CRYPT-LUKS2-dfd6b477c8eb4a33b64e726cd73356df-7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:28.073425 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-47-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1060', 'sectorsize': '2048', 'size': '530.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:28.073459 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:17:28.073491 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:28.073504 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:28.073515 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:28.073553 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_5ea701e6-1739-4314-8940-18827c834622', 'scsi-SQEMU_QEMU_HARDDISK_5ea701e6-1739-4314-8940-18827c834622'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '5ea701e6', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_5ea701e6-1739-4314-8940-18827c834622-part16', 'scsi-SQEMU_QEMU_HARDDISK_5ea701e6-1739-4314-8940-18827c834622-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_5ea701e6-1739-4314-8940-18827c834622-part14', 'scsi-SQEMU_QEMU_HARDDISK_5ea701e6-1739-4314-8940-18827c834622-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_5ea701e6-1739-4314-8940-18827c834622-part15', 'scsi-SQEMU_QEMU_HARDDISK_5ea701e6-1739-4314-8940-18827c834622-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_5ea701e6-1739-4314-8940-18827c834622-part1', 'scsi-SQEMU_QEMU_HARDDISK_5ea701e6-1739-4314-8940-18827c834622-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:28.073582 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:28.073594 | orchestrator | skipping: [testbed-manager] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:17:28.073605 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:17:28.073616 | orchestrator | 2026-04-28 05:17:28.073628 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-28 05:17:28.073640 | orchestrator | Tuesday 28 April 2026 05:17:22 +0000 (0:00:02.828) 0:01:55.790 ********* 2026-04-28 05:17:28.073651 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:17:28.073663 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:17:28.073674 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:17:28.073685 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:17:28.073696 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:17:28.073706 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:17:28.073717 | orchestrator | ok: [testbed-manager] 2026-04-28 05:17:28.073727 | orchestrator | 2026-04-28 05:17:28.073738 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-28 05:17:28.073749 | orchestrator | Tuesday 28 April 2026 05:17:24 +0000 (0:00:02.503) 0:01:58.294 ********* 2026-04-28 05:17:28.073760 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:17:28.073770 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:17:28.073781 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:17:28.073798 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:17:28.073808 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:17:28.073819 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:17:28.073830 | orchestrator | ok: [testbed-manager] 2026-04-28 05:17:28.073840 | orchestrator | 2026-04-28 05:17:28.073851 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 05:17:28.073862 | orchestrator | Tuesday 28 April 2026 05:17:26 +0000 (0:00:01.961) 0:02:00.255 ********* 2026-04-28 05:17:28.073872 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:17:28.073883 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:17:28.073893 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:17:28.073904 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:17:28.073915 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:17:28.073926 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:17:28.073943 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:17:57.212191 | orchestrator | 2026-04-28 05:17:57.212330 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 05:17:57.212357 | orchestrator | Tuesday 28 April 2026 05:17:29 +0000 (0:00:02.431) 0:02:02.687 ********* 2026-04-28 05:17:57.212378 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:17:57.212398 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:17:57.212484 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:17:57.212504 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:17:57.212523 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:17:57.212541 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:17:57.212561 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:17:57.212581 | orchestrator | 2026-04-28 05:17:57.212600 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 05:17:57.212620 | orchestrator | Tuesday 28 April 2026 05:17:31 +0000 (0:00:01.941) 0:02:04.628 ********* 2026-04-28 05:17:57.212640 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:17:57.212661 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:17:57.212681 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:17:57.212702 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:17:57.212722 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:17:57.212742 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:17:57.212762 | orchestrator | ok: [testbed-manager -> testbed-node-2(192.168.16.12)] 2026-04-28 05:17:57.212781 | orchestrator | 2026-04-28 05:17:57.212801 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 05:17:57.212821 | orchestrator | Tuesday 28 April 2026 05:17:33 +0000 (0:00:02.669) 0:02:07.298 ********* 2026-04-28 05:17:57.212840 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:17:57.212859 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:17:57.212878 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:17:57.212899 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:17:57.212918 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:17:57.212935 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:17:57.212950 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:17:57.212962 | orchestrator | 2026-04-28 05:17:57.212975 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-28 05:17:57.213018 | orchestrator | Tuesday 28 April 2026 05:17:35 +0000 (0:00:01.917) 0:02:09.216 ********* 2026-04-28 05:17:57.213040 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:17:57.213059 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-0) 2026-04-28 05:17:57.213077 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-28 05:17:57.213096 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-0) 2026-04-28 05:17:57.213109 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-0) 2026-04-28 05:17:57.213119 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-28 05:17:57.213130 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-1) 2026-04-28 05:17:57.213141 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-1) 2026-04-28 05:17:57.213180 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-0) 2026-04-28 05:17:57.213191 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-28 05:17:57.213201 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-28 05:17:57.213227 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-2) 2026-04-28 05:17:57.213238 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-1) 2026-04-28 05:17:57.213249 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-2) 2026-04-28 05:17:57.213259 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-0) 2026-04-28 05:17:57.213269 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-2) 2026-04-28 05:17:57.213280 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-1) 2026-04-28 05:17:57.213290 | orchestrator | ok: [testbed-manager] => (item=testbed-node-0) 2026-04-28 05:17:57.213301 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-2) 2026-04-28 05:17:57.213311 | orchestrator | ok: [testbed-manager] => (item=testbed-node-1) 2026-04-28 05:17:57.213321 | orchestrator | ok: [testbed-manager] => (item=testbed-node-2) 2026-04-28 05:17:57.213332 | orchestrator | 2026-04-28 05:17:57.213343 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-28 05:17:57.213353 | orchestrator | Tuesday 28 April 2026 05:17:39 +0000 (0:00:03.247) 0:02:12.463 ********* 2026-04-28 05:17:57.213363 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-28 05:17:57.213375 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-28 05:17:57.213386 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-28 05:17:57.213396 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:17:57.213407 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-28 05:17:57.213417 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-28 05:17:57.213428 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-28 05:17:57.213438 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:17:57.213448 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-28 05:17:57.213459 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-28 05:17:57.213469 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-28 05:17:57.213480 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:17:57.213490 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-28 05:17:57.213500 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-28 05:17:57.213511 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-28 05:17:57.213522 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:17:57.213532 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-28 05:17:57.213543 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-28 05:17:57.213553 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-28 05:17:57.213564 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:17:57.213574 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-28 05:17:57.213605 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-28 05:17:57.213615 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-28 05:17:57.213624 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:17:57.213634 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-0)  2026-04-28 05:17:57.213643 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-1)  2026-04-28 05:17:57.213652 | orchestrator | skipping: [testbed-manager] => (item=testbed-node-2)  2026-04-28 05:17:57.213662 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:17:57.213671 | orchestrator | 2026-04-28 05:17:57.213680 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-28 05:17:57.213690 | orchestrator | Tuesday 28 April 2026 05:17:41 +0000 (0:00:01.983) 0:02:14.446 ********* 2026-04-28 05:17:57.213699 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:17:57.213716 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:17:57.213725 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:17:57.213735 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:17:57.213745 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 05:17:57.213755 | orchestrator | 2026-04-28 05:17:57.213765 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 05:17:57.213775 | orchestrator | Tuesday 28 April 2026 05:17:43 +0000 (0:00:01.968) 0:02:16.415 ********* 2026-04-28 05:17:57.213785 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:17:57.213794 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:17:57.213803 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:17:57.213813 | orchestrator | 2026-04-28 05:17:57.213822 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 05:17:57.213831 | orchestrator | Tuesday 28 April 2026 05:17:44 +0000 (0:00:01.422) 0:02:17.838 ********* 2026-04-28 05:17:57.213841 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:17:57.213850 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:17:57.213859 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:17:57.213868 | orchestrator | 2026-04-28 05:17:57.213878 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 05:17:57.213887 | orchestrator | Tuesday 28 April 2026 05:17:45 +0000 (0:00:01.426) 0:02:19.265 ********* 2026-04-28 05:17:57.213896 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:17:57.213906 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:17:57.213915 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:17:57.213924 | orchestrator | 2026-04-28 05:17:57.213934 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 05:17:57.213943 | orchestrator | Tuesday 28 April 2026 05:17:47 +0000 (0:00:01.420) 0:02:20.685 ********* 2026-04-28 05:17:57.213952 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:17:57.213962 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:17:57.213972 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:17:57.213981 | orchestrator | 2026-04-28 05:17:57.214011 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 05:17:57.214086 | orchestrator | Tuesday 28 April 2026 05:17:48 +0000 (0:00:01.396) 0:02:22.081 ********* 2026-04-28 05:17:57.214103 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 05:17:57.214112 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 05:17:57.214122 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 05:17:57.214131 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:17:57.214141 | orchestrator | 2026-04-28 05:17:57.214150 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 05:17:57.214160 | orchestrator | Tuesday 28 April 2026 05:17:50 +0000 (0:00:01.446) 0:02:23.528 ********* 2026-04-28 05:17:57.214169 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 05:17:57.214179 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 05:17:57.214188 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 05:17:57.214198 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:17:57.214207 | orchestrator | 2026-04-28 05:17:57.214216 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 05:17:57.214226 | orchestrator | Tuesday 28 April 2026 05:17:51 +0000 (0:00:01.750) 0:02:25.279 ********* 2026-04-28 05:17:57.214235 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 05:17:57.214245 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 05:17:57.214254 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 05:17:57.214264 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:17:57.214273 | orchestrator | 2026-04-28 05:17:57.214282 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 05:17:57.214299 | orchestrator | Tuesday 28 April 2026 05:17:53 +0000 (0:00:01.699) 0:02:26.978 ********* 2026-04-28 05:17:57.214309 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:17:57.214318 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:17:57.214328 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:17:57.214337 | orchestrator | 2026-04-28 05:17:57.214346 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 05:17:57.214356 | orchestrator | Tuesday 28 April 2026 05:17:55 +0000 (0:00:01.623) 0:02:28.602 ********* 2026-04-28 05:17:57.214365 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-28 05:17:57.214375 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-28 05:17:57.214384 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-28 05:17:57.214393 | orchestrator | 2026-04-28 05:17:57.214403 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-28 05:17:57.214412 | orchestrator | Tuesday 28 April 2026 05:17:56 +0000 (0:00:01.549) 0:02:30.152 ********* 2026-04-28 05:17:57.214422 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:17:57.214431 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:17:57.214442 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:17:57.214460 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 05:18:54.902395 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 05:18:54.902474 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 05:18:54.902480 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 05:18:54.902485 | orchestrator | 2026-04-28 05:18:54.902490 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-28 05:18:54.902495 | orchestrator | Tuesday 28 April 2026 05:17:58 +0000 (0:00:01.810) 0:02:31.963 ********* 2026-04-28 05:18:54.902500 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:18:54.902504 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:18:54.902508 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:18:54.902512 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 05:18:54.902515 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 05:18:54.902519 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 05:18:54.902523 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 05:18:54.902527 | orchestrator | 2026-04-28 05:18:54.902530 | orchestrator | TASK [ceph-infra : Update cache for Debian based OSs] ************************** 2026-04-28 05:18:54.902534 | orchestrator | Tuesday 28 April 2026 05:18:01 +0000 (0:00:02.924) 0:02:34.887 ********* 2026-04-28 05:18:54.902538 | orchestrator | changed: [testbed-node-4] 2026-04-28 05:18:54.902542 | orchestrator | changed: [testbed-node-3] 2026-04-28 05:18:54.902555 | orchestrator | changed: [testbed-manager] 2026-04-28 05:18:54.902559 | orchestrator | changed: [testbed-node-5] 2026-04-28 05:18:54.902562 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:18:54.902566 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:18:54.902570 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:18:54.902573 | orchestrator | 2026-04-28 05:18:54.902577 | orchestrator | TASK [ceph-infra : Include_tasks configure_firewall.yml] *********************** 2026-04-28 05:18:54.902581 | orchestrator | Tuesday 28 April 2026 05:18:20 +0000 (0:00:19.322) 0:02:54.210 ********* 2026-04-28 05:18:54.902585 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:18:54.902588 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:18:54.902592 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:18:54.902596 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:18:54.902616 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:18:54.902620 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:18:54.902623 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:18:54.902627 | orchestrator | 2026-04-28 05:18:54.902631 | orchestrator | TASK [ceph-infra : Include_tasks setup_ntp.yml] ******************************** 2026-04-28 05:18:54.902644 | orchestrator | Tuesday 28 April 2026 05:18:22 +0000 (0:00:02.121) 0:02:56.331 ********* 2026-04-28 05:18:54.902648 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:18:54.902651 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:18:54.902655 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:18:54.902659 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:18:54.902662 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:18:54.902666 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:18:54.902669 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:18:54.902673 | orchestrator | 2026-04-28 05:18:54.902677 | orchestrator | TASK [ceph-infra : Add logrotate configuration] ******************************** 2026-04-28 05:18:54.902686 | orchestrator | Tuesday 28 April 2026 05:18:24 +0000 (0:00:01.887) 0:02:58.219 ********* 2026-04-28 05:18:54.902690 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:18:54.902693 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:18:54.902697 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:18:54.902701 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:18:54.902704 | orchestrator | changed: [testbed-node-3] 2026-04-28 05:18:54.902708 | orchestrator | changed: [testbed-node-4] 2026-04-28 05:18:54.902711 | orchestrator | changed: [testbed-node-5] 2026-04-28 05:18:54.902715 | orchestrator | 2026-04-28 05:18:54.902719 | orchestrator | TASK [ceph-validate : Include check_system.yml] ******************************** 2026-04-28 05:18:54.902722 | orchestrator | Tuesday 28 April 2026 05:18:27 +0000 (0:00:03.068) 0:03:01.287 ********* 2026-04-28 05:18:54.902727 | orchestrator | included: /ansible/roles/ceph-validate/tasks/check_system.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5, testbed-manager 2026-04-28 05:18:54.902733 | orchestrator | 2026-04-28 05:18:54.902737 | orchestrator | TASK [ceph-validate : Fail on unsupported ansible version (1.X)] *************** 2026-04-28 05:18:54.902740 | orchestrator | Tuesday 28 April 2026 05:18:30 +0000 (0:00:02.911) 0:03:04.198 ********* 2026-04-28 05:18:54.902744 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:18:54.902747 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:18:54.902751 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:18:54.902755 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:18:54.902758 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:18:54.902762 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:18:54.902766 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:18:54.902769 | orchestrator | 2026-04-28 05:18:54.902773 | orchestrator | TASK [ceph-validate : Fail on unsupported system] ****************************** 2026-04-28 05:18:54.902777 | orchestrator | Tuesday 28 April 2026 05:18:32 +0000 (0:00:01.934) 0:03:06.133 ********* 2026-04-28 05:18:54.902781 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:18:54.902784 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:18:54.902788 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:18:54.902792 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:18:54.902795 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:18:54.902799 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:18:54.902802 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:18:54.902806 | orchestrator | 2026-04-28 05:18:54.902810 | orchestrator | TASK [ceph-validate : Fail on unsupported architecture] ************************ 2026-04-28 05:18:54.902822 | orchestrator | Tuesday 28 April 2026 05:18:35 +0000 (0:00:02.350) 0:03:08.484 ********* 2026-04-28 05:18:54.902826 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:18:54.902829 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:18:54.902833 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:18:54.902837 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:18:54.902844 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:18:54.902848 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:18:54.902851 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:18:54.902855 | orchestrator | 2026-04-28 05:18:54.902859 | orchestrator | TASK [ceph-validate : Fail on unsupported distribution] ************************ 2026-04-28 05:18:54.902862 | orchestrator | Tuesday 28 April 2026 05:18:37 +0000 (0:00:02.025) 0:03:10.510 ********* 2026-04-28 05:18:54.902866 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:18:54.902870 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:18:54.902873 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:18:54.902877 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:18:54.902881 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:18:54.902884 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:18:54.902888 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:18:54.902892 | orchestrator | 2026-04-28 05:18:54.902895 | orchestrator | TASK [ceph-validate : Fail on unsupported CentOS release] ********************** 2026-04-28 05:18:54.902899 | orchestrator | Tuesday 28 April 2026 05:18:39 +0000 (0:00:02.220) 0:03:12.730 ********* 2026-04-28 05:18:54.902903 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:18:54.902906 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:18:54.902910 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:18:54.902914 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:18:54.902918 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:18:54.902921 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:18:54.902925 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:18:54.902929 | orchestrator | 2026-04-28 05:18:54.902932 | orchestrator | TASK [ceph-validate : Fail on unsupported distribution for ubuntu cloud archive] *** 2026-04-28 05:18:54.902936 | orchestrator | Tuesday 28 April 2026 05:18:41 +0000 (0:00:01.988) 0:03:14.719 ********* 2026-04-28 05:18:54.902940 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:18:54.902944 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:18:54.902947 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:18:54.902951 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:18:54.902955 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:18:54.902958 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:18:54.902962 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:18:54.902966 | orchestrator | 2026-04-28 05:18:54.902970 | orchestrator | TASK [ceph-validate : Fail on unsupported SUSE/openSUSE distribution (only 15.x supported)] *** 2026-04-28 05:18:54.902974 | orchestrator | Tuesday 28 April 2026 05:18:43 +0000 (0:00:02.420) 0:03:17.139 ********* 2026-04-28 05:18:54.902979 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:18:54.902983 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:18:54.902987 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:18:54.902991 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:18:54.902995 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:18:54.903000 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:18:54.903004 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:18:54.903008 | orchestrator | 2026-04-28 05:18:54.903015 | orchestrator | TASK [ceph-validate : Fail if systemd is not present] ************************** 2026-04-28 05:18:54.903020 | orchestrator | Tuesday 28 April 2026 05:18:45 +0000 (0:00:02.159) 0:03:19.300 ********* 2026-04-28 05:18:54.903024 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:18:54.903028 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:18:54.903032 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:18:54.903050 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:18:54.903054 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:18:54.903059 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:18:54.903063 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:18:54.903067 | orchestrator | 2026-04-28 05:18:54.903071 | orchestrator | TASK [ceph-validate : Validate repository variables in non-containerized scenario] *** 2026-04-28 05:18:54.903076 | orchestrator | Tuesday 28 April 2026 05:18:48 +0000 (0:00:02.218) 0:03:21.519 ********* 2026-04-28 05:18:54.903083 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:18:54.903088 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:18:54.903092 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:18:54.903096 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:18:54.903101 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:18:54.903105 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:18:54.903109 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:18:54.903113 | orchestrator | 2026-04-28 05:18:54.903118 | orchestrator | TASK [ceph-validate : Validate osd_objectstore] ******************************** 2026-04-28 05:18:54.903122 | orchestrator | Tuesday 28 April 2026 05:18:50 +0000 (0:00:02.113) 0:03:23.632 ********* 2026-04-28 05:18:54.903126 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:18:54.903130 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:18:54.903135 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:18:54.903139 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:18:54.903143 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:18:54.903147 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:18:54.903152 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:18:54.903156 | orchestrator | 2026-04-28 05:18:54.903160 | orchestrator | TASK [ceph-validate : Validate radosgw network configuration] ****************** 2026-04-28 05:18:54.903164 | orchestrator | Tuesday 28 April 2026 05:18:52 +0000 (0:00:02.016) 0:03:25.649 ********* 2026-04-28 05:18:54.903169 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:18:54.903173 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:18:54.903177 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:18:54.903181 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:18:54.903185 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:18:54.903190 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:18:54.903194 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:18:54.903198 | orchestrator | 2026-04-28 05:18:54.903203 | orchestrator | TASK [ceph-validate : Validate lvm osd scenario] ******************************* 2026-04-28 05:18:54.903207 | orchestrator | Tuesday 28 April 2026 05:18:54 +0000 (0:00:02.061) 0:03:27.710 ********* 2026-04-28 05:18:54.903211 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:18:54.903216 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:18:54.903220 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:18:54.903224 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:18:54.903231 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:18.550206 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:18.550328 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:19:18.550350 | orchestrator | 2026-04-28 05:19:18.550369 | orchestrator | TASK [ceph-validate : Validate bluestore lvm osd scenario] ********************* 2026-04-28 05:19:18.550390 | orchestrator | Tuesday 28 April 2026 05:18:56 +0000 (0:00:02.242) 0:03:29.953 ********* 2026-04-28 05:19:18.550408 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:19:18.550426 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:19:18.550445 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:19:18.550464 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 05:19:18.550484 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 05:19:18.550502 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:18.550520 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 05:19:18.550539 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 05:19:18.550557 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:18.550575 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 05:19:18.550627 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 05:19:18.550646 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:18.550664 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:19:18.550682 | orchestrator | 2026-04-28 05:19:18.550701 | orchestrator | TASK [ceph-validate : Fail if local scenario is enabled on debian] ************* 2026-04-28 05:19:18.550720 | orchestrator | Tuesday 28 April 2026 05:18:58 +0000 (0:00:02.321) 0:03:32.275 ********* 2026-04-28 05:19:18.550737 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:19:18.550756 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:19:18.550774 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:19:18.550790 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:18.550808 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:18.550826 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:18.550844 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:19:18.550862 | orchestrator | 2026-04-28 05:19:18.550880 | orchestrator | TASK [ceph-validate : Fail if rhcs repository is enabled on debian] ************ 2026-04-28 05:19:18.550917 | orchestrator | Tuesday 28 April 2026 05:19:01 +0000 (0:00:02.413) 0:03:34.688 ********* 2026-04-28 05:19:18.550938 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:19:18.550959 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:19:18.550979 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:19:18.551000 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:18.551019 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:18.551039 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:18.551089 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:19:18.551111 | orchestrator | 2026-04-28 05:19:18.551131 | orchestrator | TASK [ceph-validate : Check ceph_origin definition on SUSE/openSUSE Leap] ****** 2026-04-28 05:19:18.551151 | orchestrator | Tuesday 28 April 2026 05:19:03 +0000 (0:00:02.297) 0:03:36.986 ********* 2026-04-28 05:19:18.551171 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:19:18.551190 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:19:18.551210 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:19:18.551230 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:18.551250 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:18.551271 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:18.551290 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:19:18.551310 | orchestrator | 2026-04-28 05:19:18.551330 | orchestrator | TASK [ceph-validate : Check ceph_repository definition on SUSE/openSUSE Leap] *** 2026-04-28 05:19:18.551350 | orchestrator | Tuesday 28 April 2026 05:19:05 +0000 (0:00:02.023) 0:03:39.010 ********* 2026-04-28 05:19:18.551370 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:19:18.551390 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:19:18.551409 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:19:18.551426 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:18.551445 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:18.551463 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:18.551481 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:19:18.551498 | orchestrator | 2026-04-28 05:19:18.551517 | orchestrator | TASK [ceph-validate : Validate ntp daemon type] ******************************** 2026-04-28 05:19:18.551534 | orchestrator | Tuesday 28 April 2026 05:19:07 +0000 (0:00:02.344) 0:03:41.355 ********* 2026-04-28 05:19:18.551553 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:19:18.551570 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:19:18.551589 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:19:18.551608 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:18.551625 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:18.551642 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:18.551659 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:19:18.551678 | orchestrator | 2026-04-28 05:19:18.551698 | orchestrator | TASK [ceph-validate : Abort if ntp_daemon_type is ntpd on Atomic] ************** 2026-04-28 05:19:18.551737 | orchestrator | Tuesday 28 April 2026 05:19:10 +0000 (0:00:02.413) 0:03:43.768 ********* 2026-04-28 05:19:18.551755 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:19:18.551773 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:19:18.551792 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:19:18.551811 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:18.551829 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:18.551846 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:18.551863 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:19:18.551875 | orchestrator | 2026-04-28 05:19:18.551911 | orchestrator | TASK [ceph-validate : Include check_devices.yml] ******************************* 2026-04-28 05:19:18.551923 | orchestrator | Tuesday 28 April 2026 05:19:12 +0000 (0:00:01.957) 0:03:45.726 ********* 2026-04-28 05:19:18.551934 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:19:18.551945 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:19:18.551955 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:19:18.551966 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:19:18.551977 | orchestrator | included: /ansible/roles/ceph-validate/tasks/check_devices.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 05:19:18.551988 | orchestrator | 2026-04-28 05:19:18.551999 | orchestrator | TASK [ceph-validate : Set_fact root_device] ************************************ 2026-04-28 05:19:18.552010 | orchestrator | Tuesday 28 April 2026 05:19:14 +0000 (0:00:02.611) 0:03:48.338 ********* 2026-04-28 05:19:18.552020 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:19:18.552031 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:19:18.552042 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:19:18.552052 | orchestrator | 2026-04-28 05:19:18.552100 | orchestrator | TASK [ceph-validate : Resolve devices in lvm_volumes] ************************** 2026-04-28 05:19:18.552120 | orchestrator | Tuesday 28 April 2026 05:19:16 +0000 (0:00:01.578) 0:03:49.917 ********* 2026-04-28 05:19:18.552140 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 05:19:18.552160 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 05:19:18.552171 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:18.552182 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 05:19:18.552193 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 05:19:18.552204 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:18.552215 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 05:19:18.552225 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 05:19:18.552236 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:18.552246 | orchestrator | 2026-04-28 05:19:18.552257 | orchestrator | TASK [ceph-validate : Set_fact lvm_volumes_data_devices] *********************** 2026-04-28 05:19:18.552279 | orchestrator | Tuesday 28 April 2026 05:19:18 +0000 (0:00:01.631) 0:03:51.548 ********* 2026-04-28 05:19:18.552292 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.data_vg is undefined', 'item': {'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:18.552306 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.data_vg is undefined', 'item': {'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:18.552327 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:18.552338 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.data_vg is undefined', 'item': {'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:18.552349 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.data_vg is undefined', 'item': {'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:18.552360 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:18.552371 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.data_vg is undefined', 'item': {'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:18.552391 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.data_vg is undefined', 'item': {'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:29.202608 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:29.202720 | orchestrator | 2026-04-28 05:19:29.202736 | orchestrator | TASK [ceph-validate : Fail if root_device is passed in lvm_volumes or devices] *** 2026-04-28 05:19:29.202749 | orchestrator | Tuesday 28 April 2026 05:19:20 +0000 (0:00:01.901) 0:03:53.450 ********* 2026-04-28 05:19:29.202761 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:29.202772 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:29.202782 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:29.202793 | orchestrator | 2026-04-28 05:19:29.202804 | orchestrator | TASK [ceph-validate : Get devices information] ********************************* 2026-04-28 05:19:29.202815 | orchestrator | Tuesday 28 April 2026 05:19:21 +0000 (0:00:01.680) 0:03:55.131 ********* 2026-04-28 05:19:29.202826 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:29.202837 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:29.202847 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:29.202858 | orchestrator | 2026-04-28 05:19:29.202868 | orchestrator | TASK [ceph-validate : Fail if one of the devices is not a device] ************** 2026-04-28 05:19:29.202879 | orchestrator | Tuesday 28 April 2026 05:19:23 +0000 (0:00:01.589) 0:03:56.721 ********* 2026-04-28 05:19:29.202890 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:29.202901 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:29.202911 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:29.202922 | orchestrator | 2026-04-28 05:19:29.202932 | orchestrator | TASK [ceph-validate : Fail when gpt header found on osd devices] *************** 2026-04-28 05:19:29.202943 | orchestrator | Tuesday 28 April 2026 05:19:24 +0000 (0:00:01.560) 0:03:58.282 ********* 2026-04-28 05:19:29.202953 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:29.202964 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:29.202975 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:29.202985 | orchestrator | 2026-04-28 05:19:29.202996 | orchestrator | TASK [ceph-validate : Check data logical volume] ******************************* 2026-04-28 05:19:29.203007 | orchestrator | Tuesday 28 April 2026 05:19:26 +0000 (0:00:01.574) 0:03:59.856 ********* 2026-04-28 05:19:29.203018 | orchestrator | ok: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'}) 2026-04-28 05:19:29.203053 | orchestrator | ok: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'}) 2026-04-28 05:19:29.203107 | orchestrator | ok: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'}) 2026-04-28 05:19:29.203120 | orchestrator | ok: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'}) 2026-04-28 05:19:29.203146 | orchestrator | ok: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'}) 2026-04-28 05:19:29.203159 | orchestrator | ok: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'}) 2026-04-28 05:19:29.203171 | orchestrator | 2026-04-28 05:19:29.203189 | orchestrator | TASK [ceph-validate : Fail if one of the data logical volume is not a device or doesn't exist] *** 2026-04-28 05:19:29.203209 | orchestrator | Tuesday 28 April 2026 05:19:28 +0000 (0:00:02.384) 0:04:02.241 ********* 2026-04-28 05:19:29.203235 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'stat': {'exists': True, 'path': '/dev/ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f/osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'mode': '0660', 'isdir': False, 'ischr': False, 'isblk': True, 'isreg': False, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 6, 'size': 0, 'inode': 957, 'dev': 6, 'nlink': 1, 'atime': 1777345660.363506, 'mtime': 1777345660.3565059, 'ctime': 1777345660.3565059, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': True, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 0, 'block_size': 512, 'device_type': 64512, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'disk', 'mimetype': 'inode/symlink', 'charset': 'binary', 'version': None, 'attributes': [], 'attr_flags': ''}, 'invocation': {'module_args': {'path': '/dev/ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f/osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'follow': True, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': {'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:29.203286 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'stat': {'exists': True, 'path': '/dev/ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1/osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'mode': '0660', 'isdir': False, 'ischr': False, 'isblk': True, 'isreg': False, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 6, 'size': 0, 'inode': 967, 'dev': 6, 'nlink': 1, 'atime': 1777345679.263818, 'mtime': 1777345679.2598178, 'ctime': 1777345679.2598178, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': True, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 0, 'block_size': 512, 'device_type': 64513, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'disk', 'mimetype': 'inode/symlink', 'charset': 'binary', 'version': None, 'attributes': [], 'attr_flags': ''}, 'invocation': {'module_args': {'path': '/dev/ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1/osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'follow': True, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': {'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:29.203309 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:29.203353 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'stat': {'exists': True, 'path': '/dev/ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf/osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'mode': '0660', 'isdir': False, 'ischr': False, 'isblk': True, 'isreg': False, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 6, 'size': 0, 'inode': 951, 'dev': 6, 'nlink': 1, 'atime': 1777345660.7340205, 'mtime': 1777345660.7290204, 'ctime': 1777345660.7290204, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': True, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 0, 'block_size': 512, 'device_type': 64512, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'disk', 'mimetype': 'inode/symlink', 'charset': 'binary', 'version': None, 'attributes': [], 'attr_flags': ''}, 'invocation': {'module_args': {'path': '/dev/ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf/osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'follow': True, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': {'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:29.203393 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'stat': {'exists': True, 'path': '/dev/ceph-b3b62482-c8be-5063-9ecc-120425980b0a/osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'mode': '0660', 'isdir': False, 'ischr': False, 'isblk': True, 'isreg': False, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 6, 'size': 0, 'inode': 961, 'dev': 6, 'nlink': 1, 'atime': 1777345682.2663696, 'mtime': 1777345682.2593694, 'ctime': 1777345682.2593694, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': True, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 0, 'block_size': 512, 'device_type': 64513, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'disk', 'mimetype': 'inode/symlink', 'charset': 'binary', 'version': None, 'attributes': [], 'attr_flags': ''}, 'invocation': {'module_args': {'path': '/dev/ceph-b3b62482-c8be-5063-9ecc-120425980b0a/osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'follow': True, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': {'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:29.203508 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:29.203540 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'stat': {'exists': True, 'path': '/dev/ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab/osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'mode': '0660', 'isdir': False, 'ischr': False, 'isblk': True, 'isreg': False, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 6, 'size': 0, 'inode': 955, 'dev': 6, 'nlink': 1, 'atime': 1777345662.9038234, 'mtime': 1777345662.8968232, 'ctime': 1777345662.8968232, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': True, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 0, 'block_size': 512, 'device_type': 64512, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'disk', 'mimetype': 'inode/symlink', 'charset': 'binary', 'version': None, 'attributes': [], 'attr_flags': ''}, 'invocation': {'module_args': {'path': '/dev/ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab/osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'follow': True, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': {'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:35.290362 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'stat': {'exists': True, 'path': '/dev/ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1/osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'mode': '0660', 'isdir': False, 'ischr': False, 'isblk': True, 'isreg': False, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 6, 'size': 0, 'inode': 965, 'dev': 6, 'nlink': 1, 'atime': 1777345681.6621253, 'mtime': 1777345681.6561253, 'ctime': 1777345681.6561253, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': True, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 0, 'block_size': 512, 'device_type': 64513, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'disk', 'mimetype': 'inode/symlink', 'charset': 'binary', 'version': None, 'attributes': [], 'attr_flags': ''}, 'invocation': {'module_args': {'path': '/dev/ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1/osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'follow': True, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': {'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:35.290489 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:35.290502 | orchestrator | 2026-04-28 05:19:35.290512 | orchestrator | TASK [ceph-validate : Check bluestore db logical volume] *********************** 2026-04-28 05:19:35.290521 | orchestrator | Tuesday 28 April 2026 05:19:30 +0000 (0:00:01.460) 0:04:03.701 ********* 2026-04-28 05:19:35.290530 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 05:19:35.290540 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 05:19:35.290547 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:35.290555 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 05:19:35.290563 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 05:19:35.290571 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:35.290579 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 05:19:35.290587 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 05:19:35.290594 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:35.290602 | orchestrator | 2026-04-28 05:19:35.290610 | orchestrator | TASK [ceph-validate : Fail if one of the bluestore db logical volume is not a device or doesn't exist] *** 2026-04-28 05:19:35.290619 | orchestrator | Tuesday 28 April 2026 05:19:31 +0000 (0:00:01.435) 0:04:05.137 ********* 2026-04-28 05:19:35.290639 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.db is defined', 'item': {'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:35.290649 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.db is defined', 'item': {'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:35.290657 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:35.290666 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.db is defined', 'item': {'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:35.290697 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.db is defined', 'item': {'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:35.290707 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:35.290715 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.db is defined', 'item': {'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:35.290723 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.db is defined', 'item': {'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:35.290731 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:35.290739 | orchestrator | 2026-04-28 05:19:35.290747 | orchestrator | TASK [ceph-validate : Check bluestore wal logical volume] ********************** 2026-04-28 05:19:35.290754 | orchestrator | Tuesday 28 April 2026 05:19:33 +0000 (0:00:01.432) 0:04:06.569 ********* 2026-04-28 05:19:35.290768 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'})  2026-04-28 05:19:35.290776 | orchestrator | skipping: [testbed-node-3] => (item={'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'})  2026-04-28 05:19:35.290784 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:35.290792 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'})  2026-04-28 05:19:35.290800 | orchestrator | skipping: [testbed-node-4] => (item={'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'})  2026-04-28 05:19:35.290807 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:35.290815 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'})  2026-04-28 05:19:35.290823 | orchestrator | skipping: [testbed-node-5] => (item={'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'})  2026-04-28 05:19:35.290831 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:35.290839 | orchestrator | 2026-04-28 05:19:35.290847 | orchestrator | TASK [ceph-validate : Fail if one of the bluestore wal logical volume is not a device or doesn't exist] *** 2026-04-28 05:19:35.290855 | orchestrator | Tuesday 28 April 2026 05:19:34 +0000 (0:00:01.761) 0:04:08.331 ********* 2026-04-28 05:19:35.290873 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.wal is defined', 'item': {'data': 'osd-block-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f', 'data_vg': 'ceph-b91f22db-c1ee-55b4-b9b8-1bae9cdca76f'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:35.290882 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.wal is defined', 'item': {'data': 'osd-block-be99929f-8eb5-5413-bbfd-d844b44bc4d1', 'data_vg': 'ceph-be99929f-8eb5-5413-bbfd-d844b44bc4d1'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:35.290891 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:35.290900 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.wal is defined', 'item': {'data': 'osd-block-1455ab40-e845-5ac6-aa29-4f0468cc06bf', 'data_vg': 'ceph-1455ab40-e845-5ac6-aa29-4f0468cc06bf'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:35.290915 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.wal is defined', 'item': {'data': 'osd-block-b3b62482-c8be-5063-9ecc-120425980b0a', 'data_vg': 'ceph-b3b62482-c8be-5063-9ecc-120425980b0a'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:35.290924 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:35.290934 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.wal is defined', 'item': {'data': 'osd-block-d7e38cf3-e59d-5932-97d5-5021af3eecab', 'data_vg': 'ceph-d7e38cf3-e59d-5932-97d5-5021af3eecab'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:35.290947 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'item.wal is defined', 'item': {'data': 'osd-block-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1', 'data_vg': 'ceph-bdda1e24-8b47-5b08-be8f-b7cb87fd92e1'}, 'ansible_loop_var': 'item'})  2026-04-28 05:19:46.000827 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:46.000940 | orchestrator | 2026-04-28 05:19:46.000957 | orchestrator | TASK [ceph-validate : Include check_eth_rgw.yml] ******************************* 2026-04-28 05:19:46.000970 | orchestrator | Tuesday 28 April 2026 05:19:36 +0000 (0:00:01.510) 0:04:09.841 ********* 2026-04-28 05:19:46.000982 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:19:46.000994 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:19:46.001005 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:19:46.001017 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:46.001028 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:46.001039 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:46.001050 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:19:46.001061 | orchestrator | 2026-04-28 05:19:46.001072 | orchestrator | TASK [ceph-validate : Include check_rgw_pools.yml] ***************************** 2026-04-28 05:19:46.001156 | orchestrator | Tuesday 28 April 2026 05:19:38 +0000 (0:00:01.881) 0:04:11.723 ********* 2026-04-28 05:19:46.001175 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:19:46.001210 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:19:46.001222 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:19:46.001233 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:19:46.001262 | orchestrator | included: /ansible/roles/ceph-validate/tasks/check_rgw_pools.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 05:19:46.001274 | orchestrator | 2026-04-28 05:19:46.001285 | orchestrator | TASK [ceph-validate : Fail if ec_profile is not set for ec pools] ************** 2026-04-28 05:19:46.001296 | orchestrator | Tuesday 28 April 2026 05:19:41 +0000 (0:00:02.779) 0:04:14.503 ********* 2026-04-28 05:19:46.001308 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001322 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001334 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001347 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001360 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001374 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001407 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001420 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001432 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001445 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001458 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:46.001471 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:46.001483 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001496 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001508 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001520 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001532 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001545 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:46.001557 | orchestrator | 2026-04-28 05:19:46.001570 | orchestrator | TASK [ceph-validate : Fail if ec_k is not set for ec pools] ******************** 2026-04-28 05:19:46.001583 | orchestrator | Tuesday 28 April 2026 05:19:42 +0000 (0:00:01.418) 0:04:15.922 ********* 2026-04-28 05:19:46.001596 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001609 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001621 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001633 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001663 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001675 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:46.001686 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001697 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001708 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001719 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001730 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001741 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:46.001757 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001768 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001787 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001798 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001809 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001819 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:46.001830 | orchestrator | 2026-04-28 05:19:46.001841 | orchestrator | TASK [ceph-validate : Fail if ec_m is not set for ec pools] ******************** 2026-04-28 05:19:46.001853 | orchestrator | Tuesday 28 April 2026 05:19:44 +0000 (0:00:01.651) 0:04:17.573 ********* 2026-04-28 05:19:46.001863 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001874 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001885 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001896 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001907 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001918 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:19:46.001929 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001939 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001950 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001961 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001972 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.001983 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:19:46.001993 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.002004 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.002120 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.002137 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.002149 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 05:19:46.002169 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:19:46.002181 | orchestrator | 2026-04-28 05:19:46.002234 | orchestrator | TASK [ceph-validate : Include check_nfs.yml] *********************************** 2026-04-28 05:19:46.002248 | orchestrator | Tuesday 28 April 2026 05:19:45 +0000 (0:00:01.486) 0:04:19.060 ********* 2026-04-28 05:19:46.002259 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:19:46.002271 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:19:46.002292 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:20:00.793512 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:20:00.793641 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:20:00.793656 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:20:00.793664 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:20:00.793674 | orchestrator | 2026-04-28 05:20:00.793684 | orchestrator | TASK [ceph-validate : Include check_rbdmirror.yml] ***************************** 2026-04-28 05:20:00.793694 | orchestrator | Tuesday 28 April 2026 05:19:47 +0000 (0:00:01.938) 0:04:20.998 ********* 2026-04-28 05:20:00.793702 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:20:00.793711 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:20:00.793719 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:20:00.793728 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:20:00.793737 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:20:00.793745 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:20:00.793754 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:20:00.793762 | orchestrator | 2026-04-28 05:20:00.793771 | orchestrator | TASK [ceph-validate : Fail if monitoring group doesn't exist] ****************** 2026-04-28 05:20:00.793780 | orchestrator | Tuesday 28 April 2026 05:19:49 +0000 (0:00:02.154) 0:04:23.153 ********* 2026-04-28 05:20:00.793788 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:20:00.793796 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:20:00.793805 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:20:00.793828 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:20:00.793837 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:20:00.793845 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:20:00.793854 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:20:00.793862 | orchestrator | 2026-04-28 05:20:00.793871 | orchestrator | TASK [ceph-validate : Fail when monitoring doesn't contain at least one node.] *** 2026-04-28 05:20:00.793881 | orchestrator | Tuesday 28 April 2026 05:19:51 +0000 (0:00:01.952) 0:04:25.105 ********* 2026-04-28 05:20:00.793889 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:20:00.793898 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:20:00.793906 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:20:00.793914 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:20:00.793923 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:20:00.793931 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:20:00.793939 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:20:00.793948 | orchestrator | 2026-04-28 05:20:00.793956 | orchestrator | TASK [ceph-validate : Fail when dashboard_admin_password and/or grafana_admin_password are not set] *** 2026-04-28 05:20:00.793966 | orchestrator | Tuesday 28 April 2026 05:19:53 +0000 (0:00:01.936) 0:04:27.042 ********* 2026-04-28 05:20:00.793974 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:20:00.793983 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:20:00.793991 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:20:00.793999 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:20:00.794008 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:20:00.794065 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:20:00.794076 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:20:00.794087 | orchestrator | 2026-04-28 05:20:00.794121 | orchestrator | TASK [ceph-validate : Validate container registry credentials] ***************** 2026-04-28 05:20:00.794132 | orchestrator | Tuesday 28 April 2026 05:19:55 +0000 (0:00:02.096) 0:04:29.139 ********* 2026-04-28 05:20:00.794143 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:20:00.794152 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:20:00.794162 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:20:00.794172 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:20:00.794182 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:20:00.794192 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:20:00.794202 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:20:00.794212 | orchestrator | 2026-04-28 05:20:00.794222 | orchestrator | TASK [ceph-validate : Validate container service and container package] ******** 2026-04-28 05:20:00.794232 | orchestrator | Tuesday 28 April 2026 05:19:57 +0000 (0:00:02.005) 0:04:31.144 ********* 2026-04-28 05:20:00.794242 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:20:00.794262 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:20:00.794272 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:20:00.794282 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:20:00.794292 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:20:00.794301 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:20:00.794311 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:20:00.794321 | orchestrator | 2026-04-28 05:20:00.794331 | orchestrator | TASK [ceph-validate : Validate openstack_keys key format] ********************** 2026-04-28 05:20:00.794340 | orchestrator | Tuesday 28 April 2026 05:19:59 +0000 (0:00:02.153) 0:04:33.298 ********* 2026-04-28 05:20:00.794352 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-28 05:20:00.794364 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-28 05:20:00.794375 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-28 05:20:00.794387 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-28 05:20:00.794399 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-28 05:20:00.794411 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-28 05:20:00.794437 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-28 05:20:00.794447 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-28 05:20:00.794455 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-28 05:20:00.794464 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-28 05:20:00.794478 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-28 05:20:00.794487 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-28 05:20:00.794496 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:20:00.794504 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-28 05:20:00.794513 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-28 05:20:00.794522 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-28 05:20:00.794530 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-28 05:20:00.794545 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-28 05:20:00.794554 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:20:00.794562 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-28 05:20:00.794571 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-28 05:20:00.794580 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:20:00.794588 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-28 05:20:00.794597 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-28 05:20:00.794605 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-28 05:20:00.794614 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-28 05:20:00.794623 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-28 05:20:00.794631 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-28 05:20:00.794640 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-28 05:20:00.794649 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-28 05:20:00.794662 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-28 05:20:05.233605 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-28 05:20:05.233719 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-28 05:20:05.233742 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-28 05:20:05.233756 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:20:05.233771 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-28 05:20:05.233786 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:20:05.233822 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-28 05:20:05.233840 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-28 05:20:05.233880 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-28 05:20:05.233896 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-28 05:20:05.233911 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-28 05:20:05.233925 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-28 05:20:05.233938 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-28 05:20:05.233951 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:20:05.233967 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-28 05:20:05.233982 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-28 05:20:05.233997 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-28 05:20:05.234011 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:20:05.234127 | orchestrator | 2026-04-28 05:20:05.234146 | orchestrator | TASK [ceph-validate : Validate clients keys key format] ************************ 2026-04-28 05:20:05.234161 | orchestrator | Tuesday 28 April 2026 05:20:02 +0000 (0:00:02.342) 0:04:35.641 ********* 2026-04-28 05:20:05.234176 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:20:05.234191 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:20:05.234207 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:20:05.234223 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:20:05.234237 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:20:05.234250 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:20:05.234263 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:20:05.234275 | orchestrator | 2026-04-28 05:20:05.234292 | orchestrator | TASK [ceph-validate : Validate openstack_keys caps] **************************** 2026-04-28 05:20:05.234307 | orchestrator | Tuesday 28 April 2026 05:20:04 +0000 (0:00:02.149) 0:04:37.790 ********* 2026-04-28 05:20:05.234322 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-28 05:20:05.234336 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-28 05:20:05.234351 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-28 05:20:05.234388 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-28 05:20:05.234403 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-28 05:20:05.234417 | orchestrator | skipping: [testbed-node-0] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-28 05:20:05.234445 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:20:05.234458 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-28 05:20:05.234472 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-28 05:20:05.234484 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-28 05:20:05.234497 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-28 05:20:05.234509 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-28 05:20:05.234520 | orchestrator | skipping: [testbed-node-1] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-28 05:20:05.234532 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:20:05.234542 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-28 05:20:05.234553 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-28 05:20:05.234565 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-28 05:20:05.234578 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-28 05:20:05.234588 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-28 05:20:05.234599 | orchestrator | skipping: [testbed-node-2] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-28 05:20:05.234610 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:20:05.234622 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-28 05:20:05.234633 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-28 05:20:05.234644 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-28 05:20:05.234655 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-28 05:20:05.234667 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-28 05:20:05.234678 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-28 05:20:05.234699 | orchestrator | skipping: [testbed-node-3] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-28 05:20:05.234722 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-28 05:20:33.418936 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-28 05:20:33.419211 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-28 05:20:33.419242 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-28 05:20:33.419256 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:20:33.419273 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-28 05:20:33.419286 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-28 05:20:33.419297 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.cinder-backup'})  2026-04-28 05:20:33.419308 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=vms, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.cinder'})  2026-04-28 05:20:33.419319 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=volumes, profile rbd pool=images'}, 'mode': '0600', 'name': 'client.glance'})  2026-04-28 05:20:33.419330 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-28 05:20:33.419341 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=metrics'}, 'mode': '0600', 'name': 'client.gnocchi'})  2026-04-28 05:20:33.419351 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-28 05:20:33.419365 | orchestrator | skipping: [testbed-manager] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-28 05:20:33.419376 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:20:33.419387 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-28 05:20:33.419398 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mon': 'profile rbd', 'osd': 'profile rbd pool=images, profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=backups'}, 'mode': '0600', 'name': 'client.nova'})  2026-04-28 05:20:33.419409 | orchestrator | skipping: [testbed-node-5] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-28 05:20:33.419420 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:20:33.419431 | orchestrator | skipping: [testbed-node-4] => (item={'caps': {'mgr': 'allow rw', 'mon': 'allow r', 'osd': 'allow rw pool=cephfs_data'}, 'mode': '0600', 'name': 'client.manila'})  2026-04-28 05:20:33.419464 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:20:33.419477 | orchestrator | 2026-04-28 05:20:33.419491 | orchestrator | TASK [ceph-validate : Validate clients keys caps] ****************************** 2026-04-28 05:20:33.419504 | orchestrator | Tuesday 28 April 2026 05:20:06 +0000 (0:00:02.259) 0:04:40.050 ********* 2026-04-28 05:20:33.419516 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:20:33.419529 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:20:33.419542 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:20:33.419555 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:20:33.419567 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:20:33.419579 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:20:33.419592 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:20:33.419605 | orchestrator | 2026-04-28 05:20:33.419617 | orchestrator | TASK [ceph-validate : Check virtual_ips is defined] **************************** 2026-04-28 05:20:33.419630 | orchestrator | Tuesday 28 April 2026 05:20:08 +0000 (0:00:02.157) 0:04:42.207 ********* 2026-04-28 05:20:33.419642 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:20:33.419654 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:20:33.419666 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:20:33.419679 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:20:33.419691 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:20:33.419703 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:20:33.419716 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:20:33.419733 | orchestrator | 2026-04-28 05:20:33.419752 | orchestrator | TASK [ceph-validate : Validate virtual_ips length] ***************************** 2026-04-28 05:20:33.419795 | orchestrator | Tuesday 28 April 2026 05:20:10 +0000 (0:00:01.922) 0:04:44.130 ********* 2026-04-28 05:20:33.419816 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:20:33.419833 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:20:33.419851 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:20:33.419869 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:20:33.419887 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:20:33.419905 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:20:33.419917 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:20:33.419928 | orchestrator | 2026-04-28 05:20:33.419938 | orchestrator | TASK [ceph-container-engine : Include pre_requisites/prerequisites.yml] ******** 2026-04-28 05:20:33.419949 | orchestrator | Tuesday 28 April 2026 05:20:13 +0000 (0:00:02.361) 0:04:46.491 ********* 2026-04-28 05:20:33.419960 | orchestrator | included: /ansible/roles/ceph-container-engine/tasks/pre_requisites/prerequisites.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5, testbed-manager 2026-04-28 05:20:33.419973 | orchestrator | 2026-04-28 05:20:33.419991 | orchestrator | TASK [ceph-container-engine : Include specific variables] ********************** 2026-04-28 05:20:33.420002 | orchestrator | Tuesday 28 April 2026 05:20:15 +0000 (0:00:02.763) 0:04:49.255 ********* 2026-04-28 05:20:33.420013 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/ceph-container-engine/vars/Debian.yml) 2026-04-28 05:20:33.420024 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/ceph-container-engine/vars/Debian.yml) 2026-04-28 05:20:33.420035 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/ceph-container-engine/vars/Debian.yml) 2026-04-28 05:20:33.420046 | orchestrator | ok: [testbed-node-3] => (item=/ansible/roles/ceph-container-engine/vars/Debian.yml) 2026-04-28 05:20:33.420063 | orchestrator | ok: [testbed-node-4] => (item=/ansible/roles/ceph-container-engine/vars/Debian.yml) 2026-04-28 05:20:33.420212 | orchestrator | ok: [testbed-node-5] => (item=/ansible/roles/ceph-container-engine/vars/Debian.yml) 2026-04-28 05:20:33.420238 | orchestrator | ok: [testbed-manager] => (item=/ansible/roles/ceph-container-engine/vars/Debian.yml) 2026-04-28 05:20:33.420256 | orchestrator | 2026-04-28 05:20:33.420275 | orchestrator | TASK [ceph-container-engine : Create the systemd docker override directory] **** 2026-04-28 05:20:33.420311 | orchestrator | Tuesday 28 April 2026 05:20:18 +0000 (0:00:02.159) 0:04:51.415 ********* 2026-04-28 05:20:33.420331 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:20:33.420342 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:20:33.420353 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:20:33.420364 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:20:33.420374 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:20:33.420385 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:20:33.420395 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:20:33.420406 | orchestrator | 2026-04-28 05:20:33.420416 | orchestrator | TASK [ceph-container-engine : Create the systemd docker override file] ********* 2026-04-28 05:20:33.420427 | orchestrator | Tuesday 28 April 2026 05:20:20 +0000 (0:00:02.294) 0:04:53.710 ********* 2026-04-28 05:20:33.420438 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:20:33.420448 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:20:33.420459 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:20:33.420469 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:20:33.420480 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:20:33.420490 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:20:33.420501 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:20:33.420511 | orchestrator | 2026-04-28 05:20:33.420522 | orchestrator | TASK [ceph-container-engine : Remove docker proxy configuration] *************** 2026-04-28 05:20:33.420533 | orchestrator | Tuesday 28 April 2026 05:20:22 +0000 (0:00:02.496) 0:04:56.206 ********* 2026-04-28 05:20:33.420543 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:20:33.420555 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:20:33.420565 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:20:33.420576 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:20:33.420586 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:20:33.420597 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:20:33.420607 | orchestrator | ok: [testbed-manager] 2026-04-28 05:20:33.420618 | orchestrator | 2026-04-28 05:20:33.420628 | orchestrator | TASK [ceph-container-engine : Restart docker] ********************************** 2026-04-28 05:20:33.420639 | orchestrator | Tuesday 28 April 2026 05:20:25 +0000 (0:00:02.814) 0:04:59.021 ********* 2026-04-28 05:20:33.420650 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:20:33.420660 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:20:33.420671 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:20:33.420681 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:20:33.420692 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:20:33.420702 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:20:33.420713 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:20:33.420723 | orchestrator | 2026-04-28 05:20:33.420734 | orchestrator | TASK [ceph-container-common : Container registry authentication] *************** 2026-04-28 05:20:33.420745 | orchestrator | Tuesday 28 April 2026 05:20:27 +0000 (0:00:02.362) 0:05:01.383 ********* 2026-04-28 05:20:33.420755 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:20:33.420766 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:20:33.420777 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:20:33.420787 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:20:33.420798 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:20:33.420808 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:20:33.420819 | orchestrator | skipping: [testbed-manager] 2026-04-28 05:20:33.420829 | orchestrator | 2026-04-28 05:20:33.420840 | orchestrator | TASK [Get the ceph release being deployed] ************************************* 2026-04-28 05:20:33.420851 | orchestrator | Tuesday 28 April 2026 05:20:30 +0000 (0:00:02.524) 0:05:03.907 ********* 2026-04-28 05:20:33.420861 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:20:33.420872 | orchestrator | 2026-04-28 05:20:33.420883 | orchestrator | TASK [Check ceph release being deployed] *************************************** 2026-04-28 05:20:33.420894 | orchestrator | Tuesday 28 April 2026 05:20:33 +0000 (0:00:02.699) 0:05:06.607 ********* 2026-04-28 05:20:33.420913 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:20:33.420937 | orchestrator | 2026-04-28 05:20:33.420977 | orchestrator | PLAY [Ensure cluster config is applied] **************************************** 2026-04-28 05:21:12.757509 | orchestrator | 2026-04-28 05:21:12.757615 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 05:21:12.757629 | orchestrator | Tuesday 28 April 2026 05:20:34 +0000 (0:00:01.413) 0:05:08.021 ********* 2026-04-28 05:21:12.757639 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:21:12.757649 | orchestrator | 2026-04-28 05:21:12.757658 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 05:21:12.757667 | orchestrator | Tuesday 28 April 2026 05:20:36 +0000 (0:00:01.564) 0:05:09.586 ********* 2026-04-28 05:21:12.757676 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:21:12.757685 | orchestrator | 2026-04-28 05:21:12.757694 | orchestrator | TASK [Set cluster configs] ***************************************************** 2026-04-28 05:21:12.757702 | orchestrator | Tuesday 28 April 2026 05:20:37 +0000 (0:00:01.116) 0:05:10.702 ********* 2026-04-28 05:21:12.757727 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'public_network', 'value': '192.168.16.0/20'}]) 2026-04-28 05:21:12.757739 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'cluster_network', 'value': '192.168.16.0/20'}]) 2026-04-28 05:21:12.757749 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'osd_pool_default_crush_rule', 'value': -1}]) 2026-04-28 05:21:12.757758 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'ms_bind_ipv6', 'value': 'False'}]) 2026-04-28 05:21:12.757768 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'ms_bind_ipv4', 'value': 'True'}]) 2026-04-28 05:21:12.757777 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'osd_crush_chooseleaf_type', 'value': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}])  2026-04-28 05:21:12.757788 | orchestrator | 2026-04-28 05:21:12.757796 | orchestrator | PLAY [Upgrade ceph mon cluster] ************************************************ 2026-04-28 05:21:12.757805 | orchestrator | 2026-04-28 05:21:12.757814 | orchestrator | TASK [Remove ceph aliases] ***************************************************** 2026-04-28 05:21:12.757823 | orchestrator | Tuesday 28 April 2026 05:20:47 +0000 (0:00:09.844) 0:05:20.547 ********* 2026-04-28 05:21:12.757832 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:21:12.757841 | orchestrator | 2026-04-28 05:21:12.757850 | orchestrator | TASK [Set mon_host_count] ****************************************************** 2026-04-28 05:21:12.757858 | orchestrator | Tuesday 28 April 2026 05:20:48 +0000 (0:00:01.462) 0:05:22.010 ********* 2026-04-28 05:21:12.757887 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:21:12.757896 | orchestrator | 2026-04-28 05:21:12.757905 | orchestrator | TASK [Fail when less than three monitors] ************************************** 2026-04-28 05:21:12.757913 | orchestrator | Tuesday 28 April 2026 05:20:49 +0000 (0:00:01.158) 0:05:23.168 ********* 2026-04-28 05:21:12.757922 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:12.757931 | orchestrator | 2026-04-28 05:21:12.757940 | orchestrator | TASK [Select a running monitor] ************************************************ 2026-04-28 05:21:12.757949 | orchestrator | Tuesday 28 April 2026 05:20:50 +0000 (0:00:01.110) 0:05:24.279 ********* 2026-04-28 05:21:12.757957 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:21:12.757966 | orchestrator | 2026-04-28 05:21:12.757974 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 05:21:12.757983 | orchestrator | Tuesday 28 April 2026 05:20:52 +0000 (0:00:01.162) 0:05:25.442 ********* 2026-04-28 05:21:12.757991 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-0 2026-04-28 05:21:12.758000 | orchestrator | 2026-04-28 05:21:12.758008 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-28 05:21:12.758075 | orchestrator | Tuesday 28 April 2026 05:20:53 +0000 (0:00:01.124) 0:05:26.567 ********* 2026-04-28 05:21:12.758088 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:21:12.758098 | orchestrator | 2026-04-28 05:21:12.758108 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-28 05:21:12.758117 | orchestrator | Tuesday 28 April 2026 05:20:54 +0000 (0:00:01.418) 0:05:27.985 ********* 2026-04-28 05:21:12.758190 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:21:12.758201 | orchestrator | 2026-04-28 05:21:12.758211 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 05:21:12.758220 | orchestrator | Tuesday 28 April 2026 05:20:55 +0000 (0:00:01.172) 0:05:29.158 ********* 2026-04-28 05:21:12.758230 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:21:12.758240 | orchestrator | 2026-04-28 05:21:12.758250 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 05:21:12.758260 | orchestrator | Tuesday 28 April 2026 05:20:57 +0000 (0:00:01.394) 0:05:30.552 ********* 2026-04-28 05:21:12.758270 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:21:12.758280 | orchestrator | 2026-04-28 05:21:12.758296 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-28 05:21:12.758306 | orchestrator | Tuesday 28 April 2026 05:20:58 +0000 (0:00:01.113) 0:05:31.666 ********* 2026-04-28 05:21:12.758315 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:21:12.758325 | orchestrator | 2026-04-28 05:21:12.758334 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-28 05:21:12.758345 | orchestrator | Tuesday 28 April 2026 05:20:59 +0000 (0:00:01.121) 0:05:32.788 ********* 2026-04-28 05:21:12.758355 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:21:12.758364 | orchestrator | 2026-04-28 05:21:12.758374 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-28 05:21:12.758384 | orchestrator | Tuesday 28 April 2026 05:21:00 +0000 (0:00:01.155) 0:05:33.944 ********* 2026-04-28 05:21:12.758394 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:12.758404 | orchestrator | 2026-04-28 05:21:12.758413 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-28 05:21:12.758424 | orchestrator | Tuesday 28 April 2026 05:21:01 +0000 (0:00:01.168) 0:05:35.113 ********* 2026-04-28 05:21:12.758433 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:21:12.758443 | orchestrator | 2026-04-28 05:21:12.758453 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-28 05:21:12.758462 | orchestrator | Tuesday 28 April 2026 05:21:02 +0000 (0:00:01.117) 0:05:36.230 ********* 2026-04-28 05:21:12.758470 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:21:12.758479 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:21:12.758487 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:21:12.758504 | orchestrator | 2026-04-28 05:21:12.758513 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-28 05:21:12.758521 | orchestrator | Tuesday 28 April 2026 05:21:04 +0000 (0:00:01.680) 0:05:37.910 ********* 2026-04-28 05:21:12.758530 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:21:12.758538 | orchestrator | 2026-04-28 05:21:12.758547 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-28 05:21:12.758555 | orchestrator | Tuesday 28 April 2026 05:21:05 +0000 (0:00:01.255) 0:05:39.166 ********* 2026-04-28 05:21:12.758564 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:21:12.758572 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:21:12.758581 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:21:12.758589 | orchestrator | 2026-04-28 05:21:12.758597 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-28 05:21:12.758606 | orchestrator | Tuesday 28 April 2026 05:21:08 +0000 (0:00:03.198) 0:05:42.364 ********* 2026-04-28 05:21:12.758614 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-28 05:21:12.758623 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-28 05:21:12.758631 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-28 05:21:12.758640 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:12.758648 | orchestrator | 2026-04-28 05:21:12.758657 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-28 05:21:12.758665 | orchestrator | Tuesday 28 April 2026 05:21:10 +0000 (0:00:01.402) 0:05:43.767 ********* 2026-04-28 05:21:12.758675 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-28 05:21:12.758687 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-28 05:21:12.758696 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-28 05:21:12.758704 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:12.758713 | orchestrator | 2026-04-28 05:21:12.758721 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-28 05:21:12.758730 | orchestrator | Tuesday 28 April 2026 05:21:12 +0000 (0:00:02.299) 0:05:46.066 ********* 2026-04-28 05:21:12.758746 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:21:33.270279 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:21:33.270411 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:21:33.270452 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:33.270466 | orchestrator | 2026-04-28 05:21:33.270478 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-28 05:21:33.270490 | orchestrator | Tuesday 28 April 2026 05:21:13 +0000 (0:00:01.141) 0:05:47.207 ********* 2026-04-28 05:21:33.270504 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': '87fa47a77fbc', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-28 05:21:06.320374', 'end': '2026-04-28 05:21:06.367205', 'delta': '0:00:00.046831', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['87fa47a77fbc'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-28 05:21:33.270519 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': '90eb2d51595d', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-28 05:21:06.907184', 'end': '2026-04-28 05:21:06.976997', 'delta': '0:00:00.069813', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['90eb2d51595d'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-28 05:21:33.270531 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': 'ba47649d1789', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-28 05:21:07.795576', 'end': '2026-04-28 05:21:07.848559', 'delta': '0:00:00.052983', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['ba47649d1789'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-28 05:21:33.270542 | orchestrator | 2026-04-28 05:21:33.270553 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-28 05:21:33.270564 | orchestrator | Tuesday 28 April 2026 05:21:15 +0000 (0:00:01.190) 0:05:48.397 ********* 2026-04-28 05:21:33.270575 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:21:33.270586 | orchestrator | 2026-04-28 05:21:33.270597 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-28 05:21:33.270607 | orchestrator | Tuesday 28 April 2026 05:21:16 +0000 (0:00:01.603) 0:05:50.001 ********* 2026-04-28 05:21:33.270618 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:33.270628 | orchestrator | 2026-04-28 05:21:33.270639 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-28 05:21:33.270650 | orchestrator | Tuesday 28 April 2026 05:21:17 +0000 (0:00:01.233) 0:05:51.235 ********* 2026-04-28 05:21:33.270660 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:21:33.270671 | orchestrator | 2026-04-28 05:21:33.270681 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-28 05:21:33.270692 | orchestrator | Tuesday 28 April 2026 05:21:18 +0000 (0:00:01.121) 0:05:52.356 ********* 2026-04-28 05:21:33.270727 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] 2026-04-28 05:21:33.270739 | orchestrator | 2026-04-28 05:21:33.270750 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 05:21:33.270761 | orchestrator | Tuesday 28 April 2026 05:21:21 +0000 (0:00:02.507) 0:05:54.864 ********* 2026-04-28 05:21:33.270771 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:21:33.270782 | orchestrator | 2026-04-28 05:21:33.270794 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-28 05:21:33.270807 | orchestrator | Tuesday 28 April 2026 05:21:22 +0000 (0:00:01.147) 0:05:56.012 ********* 2026-04-28 05:21:33.270824 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:33.270837 | orchestrator | 2026-04-28 05:21:33.270849 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-28 05:21:33.270861 | orchestrator | Tuesday 28 April 2026 05:21:23 +0000 (0:00:01.120) 0:05:57.132 ********* 2026-04-28 05:21:33.270873 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:33.270885 | orchestrator | 2026-04-28 05:21:33.270897 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 05:21:33.270909 | orchestrator | Tuesday 28 April 2026 05:21:24 +0000 (0:00:01.216) 0:05:58.349 ********* 2026-04-28 05:21:33.270919 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:33.270930 | orchestrator | 2026-04-28 05:21:33.270940 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-28 05:21:33.270951 | orchestrator | Tuesday 28 April 2026 05:21:26 +0000 (0:00:01.125) 0:05:59.475 ********* 2026-04-28 05:21:33.270961 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:33.270972 | orchestrator | 2026-04-28 05:21:33.270982 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-28 05:21:33.270993 | orchestrator | Tuesday 28 April 2026 05:21:27 +0000 (0:00:01.108) 0:06:00.584 ********* 2026-04-28 05:21:33.271003 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:33.271014 | orchestrator | 2026-04-28 05:21:33.271024 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-28 05:21:33.271035 | orchestrator | Tuesday 28 April 2026 05:21:28 +0000 (0:00:01.108) 0:06:01.693 ********* 2026-04-28 05:21:33.271045 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:33.271056 | orchestrator | 2026-04-28 05:21:33.271067 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-28 05:21:33.271078 | orchestrator | Tuesday 28 April 2026 05:21:29 +0000 (0:00:01.164) 0:06:02.858 ********* 2026-04-28 05:21:33.271088 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:33.271098 | orchestrator | 2026-04-28 05:21:33.271109 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-28 05:21:33.271119 | orchestrator | Tuesday 28 April 2026 05:21:30 +0000 (0:00:01.107) 0:06:03.965 ********* 2026-04-28 05:21:33.271206 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:33.271220 | orchestrator | 2026-04-28 05:21:33.271231 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-28 05:21:33.271242 | orchestrator | Tuesday 28 April 2026 05:21:31 +0000 (0:00:01.098) 0:06:05.064 ********* 2026-04-28 05:21:33.271253 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:33.271264 | orchestrator | 2026-04-28 05:21:33.271275 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-28 05:21:33.271285 | orchestrator | Tuesday 28 April 2026 05:21:32 +0000 (0:00:01.097) 0:06:06.162 ********* 2026-04-28 05:21:33.271296 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:21:33.271308 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:21:33.271327 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:21:33.271340 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-19-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 05:21:33.271362 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:21:34.872427 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:21:34.872531 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:21:34.872551 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '12b9c610', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part16', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part14', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part15', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part1', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:21:34.872592 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:21:34.872605 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:21:34.872617 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:34.872630 | orchestrator | 2026-04-28 05:21:34.872642 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-28 05:21:34.872654 | orchestrator | Tuesday 28 April 2026 05:21:34 +0000 (0:00:01.979) 0:06:08.141 ********* 2026-04-28 05:21:34.872691 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:21:34.872706 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:21:34.872718 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:21:34.872732 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-19-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:21:34.872753 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:21:34.872765 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:21:34.872790 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:21:59.760033 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '12b9c610', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part16', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part14', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part15', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part1', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:21:59.760216 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:21:59.760241 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:21:59.760255 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:59.760270 | orchestrator | 2026-04-28 05:21:59.760284 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-28 05:21:59.760298 | orchestrator | Tuesday 28 April 2026 05:21:36 +0000 (0:00:01.248) 0:06:09.389 ********* 2026-04-28 05:21:59.760312 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:21:59.760326 | orchestrator | 2026-04-28 05:21:59.760355 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-28 05:21:59.760368 | orchestrator | Tuesday 28 April 2026 05:21:37 +0000 (0:00:01.468) 0:06:10.858 ********* 2026-04-28 05:21:59.760381 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:21:59.760393 | orchestrator | 2026-04-28 05:21:59.760407 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 05:21:59.760441 | orchestrator | Tuesday 28 April 2026 05:21:38 +0000 (0:00:01.113) 0:06:11.971 ********* 2026-04-28 05:21:59.760456 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:21:59.760470 | orchestrator | 2026-04-28 05:21:59.760483 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 05:21:59.760497 | orchestrator | Tuesday 28 April 2026 05:21:40 +0000 (0:00:01.549) 0:06:13.520 ********* 2026-04-28 05:21:59.760511 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:59.760525 | orchestrator | 2026-04-28 05:21:59.760537 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 05:21:59.760549 | orchestrator | Tuesday 28 April 2026 05:21:41 +0000 (0:00:01.143) 0:06:14.664 ********* 2026-04-28 05:21:59.760561 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:59.760573 | orchestrator | 2026-04-28 05:21:59.760586 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 05:21:59.760599 | orchestrator | Tuesday 28 April 2026 05:21:42 +0000 (0:00:01.248) 0:06:15.913 ********* 2026-04-28 05:21:59.760612 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:59.760635 | orchestrator | 2026-04-28 05:21:59.760648 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-28 05:21:59.760660 | orchestrator | Tuesday 28 April 2026 05:21:43 +0000 (0:00:01.127) 0:06:17.040 ********* 2026-04-28 05:21:59.760673 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:21:59.760686 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-28 05:21:59.760700 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-28 05:21:59.760713 | orchestrator | 2026-04-28 05:21:59.760726 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-28 05:21:59.760738 | orchestrator | Tuesday 28 April 2026 05:21:45 +0000 (0:00:01.933) 0:06:18.973 ********* 2026-04-28 05:21:59.760751 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-28 05:21:59.760764 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-28 05:21:59.760776 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-28 05:21:59.760789 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:59.760802 | orchestrator | 2026-04-28 05:21:59.760815 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-28 05:21:59.760827 | orchestrator | Tuesday 28 April 2026 05:21:46 +0000 (0:00:01.179) 0:06:20.153 ********* 2026-04-28 05:21:59.760839 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:59.760851 | orchestrator | 2026-04-28 05:21:59.760864 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-28 05:21:59.760878 | orchestrator | Tuesday 28 April 2026 05:21:47 +0000 (0:00:01.126) 0:06:21.280 ********* 2026-04-28 05:21:59.760890 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:21:59.760902 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:21:59.760915 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:21:59.760927 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 05:21:59.760940 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 05:21:59.760954 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 05:21:59.760967 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 05:21:59.760980 | orchestrator | 2026-04-28 05:21:59.760993 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-28 05:21:59.761006 | orchestrator | Tuesday 28 April 2026 05:21:49 +0000 (0:00:02.058) 0:06:23.338 ********* 2026-04-28 05:21:59.761019 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:21:59.761031 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:21:59.761044 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:21:59.761057 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 05:21:59.761070 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 05:21:59.761083 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 05:21:59.761095 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 05:21:59.761107 | orchestrator | 2026-04-28 05:21:59.761119 | orchestrator | TASK [Get ceph cluster status] ************************************************* 2026-04-28 05:21:59.761171 | orchestrator | Tuesday 28 April 2026 05:21:52 +0000 (0:00:02.856) 0:06:26.195 ********* 2026-04-28 05:21:59.761185 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] 2026-04-28 05:21:59.761197 | orchestrator | 2026-04-28 05:21:59.761209 | orchestrator | TASK [Display ceph health detail] ********************************************** 2026-04-28 05:21:59.761223 | orchestrator | Tuesday 28 April 2026 05:21:55 +0000 (0:00:02.279) 0:06:28.475 ********* 2026-04-28 05:21:59.761263 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:59.761287 | orchestrator | 2026-04-28 05:21:59.761300 | orchestrator | TASK [Fail if cluster isn't in an acceptable state] **************************** 2026-04-28 05:21:59.761313 | orchestrator | Tuesday 28 April 2026 05:21:56 +0000 (0:00:01.238) 0:06:29.713 ********* 2026-04-28 05:21:59.761325 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:21:59.761339 | orchestrator | 2026-04-28 05:21:59.761361 | orchestrator | TASK [Get the ceph quorum status] ********************************************** 2026-04-28 05:21:59.761375 | orchestrator | Tuesday 28 April 2026 05:21:57 +0000 (0:00:01.149) 0:06:30.863 ********* 2026-04-28 05:21:59.761389 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] 2026-04-28 05:21:59.761401 | orchestrator | 2026-04-28 05:21:59.761413 | orchestrator | TASK [Fail if the cluster quorum isn't in an acceptable state] ***************** 2026-04-28 05:21:59.761440 | orchestrator | Tuesday 28 April 2026 05:21:59 +0000 (0:00:02.265) 0:06:33.128 ********* 2026-04-28 05:23:00.963097 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.963303 | orchestrator | 2026-04-28 05:23:00.963332 | orchestrator | TASK [Ensure /var/lib/ceph/bootstrap-rbd-mirror is present] ******************** 2026-04-28 05:23:00.963354 | orchestrator | Tuesday 28 April 2026 05:22:00 +0000 (0:00:01.117) 0:06:34.245 ********* 2026-04-28 05:23:00.963375 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:23:00.963395 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:23:00.963415 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:23:00.963435 | orchestrator | 2026-04-28 05:23:00.963454 | orchestrator | TASK [Create potentially missing keys (rbd and rbd-mirror)] ******************** 2026-04-28 05:23:00.963473 | orchestrator | Tuesday 28 April 2026 05:22:03 +0000 (0:00:02.602) 0:06:36.848 ********* 2026-04-28 05:23:00.963492 | orchestrator | ok: [testbed-node-0] => (item=['bootstrap-rbd', 'testbed-node-0']) 2026-04-28 05:23:00.963511 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=['bootstrap-rbd', 'testbed-node-1']) 2026-04-28 05:23:00.963551 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=['bootstrap-rbd', 'testbed-node-2']) 2026-04-28 05:23:00.963570 | orchestrator | ok: [testbed-node-0] => (item=['bootstrap-rbd-mirror', 'testbed-node-0']) 2026-04-28 05:23:00.963582 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=['bootstrap-rbd-mirror', 'testbed-node-1']) 2026-04-28 05:23:00.963593 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=['bootstrap-rbd-mirror', 'testbed-node-2']) 2026-04-28 05:23:00.963604 | orchestrator | 2026-04-28 05:23:00.963615 | orchestrator | TASK [Stop ceph mon] *********************************************************** 2026-04-28 05:23:00.963629 | orchestrator | Tuesday 28 April 2026 05:22:16 +0000 (0:00:13.364) 0:06:50.212 ********* 2026-04-28 05:23:00.963642 | orchestrator | changed: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:23:00.963656 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:23:00.963668 | orchestrator | 2026-04-28 05:23:00.963680 | orchestrator | TASK [Mask the mgr service] **************************************************** 2026-04-28 05:23:00.963693 | orchestrator | Tuesday 28 April 2026 05:22:20 +0000 (0:00:03.761) 0:06:53.973 ********* 2026-04-28 05:23:00.963705 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:23:00.963718 | orchestrator | 2026-04-28 05:23:00.963730 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 05:23:00.963743 | orchestrator | Tuesday 28 April 2026 05:22:23 +0000 (0:00:02.421) 0:06:56.395 ********* 2026-04-28 05:23:00.963755 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-0 2026-04-28 05:23:00.963768 | orchestrator | 2026-04-28 05:23:00.963780 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 05:23:00.963793 | orchestrator | Tuesday 28 April 2026 05:22:24 +0000 (0:00:01.491) 0:06:57.887 ********* 2026-04-28 05:23:00.963836 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-0 2026-04-28 05:23:00.963852 | orchestrator | 2026-04-28 05:23:00.963871 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 05:23:00.963889 | orchestrator | Tuesday 28 April 2026 05:22:26 +0000 (0:00:01.596) 0:06:59.483 ********* 2026-04-28 05:23:00.963907 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:23:00.963925 | orchestrator | 2026-04-28 05:23:00.963941 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 05:23:00.963960 | orchestrator | Tuesday 28 April 2026 05:22:27 +0000 (0:00:01.597) 0:07:01.081 ********* 2026-04-28 05:23:00.963977 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.963996 | orchestrator | 2026-04-28 05:23:00.964015 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 05:23:00.964034 | orchestrator | Tuesday 28 April 2026 05:22:28 +0000 (0:00:01.118) 0:07:02.199 ********* 2026-04-28 05:23:00.964053 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.964064 | orchestrator | 2026-04-28 05:23:00.964074 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 05:23:00.964085 | orchestrator | Tuesday 28 April 2026 05:22:29 +0000 (0:00:01.133) 0:07:03.333 ********* 2026-04-28 05:23:00.964096 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.964106 | orchestrator | 2026-04-28 05:23:00.964117 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 05:23:00.964168 | orchestrator | Tuesday 28 April 2026 05:22:31 +0000 (0:00:01.137) 0:07:04.470 ********* 2026-04-28 05:23:00.964180 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:23:00.964190 | orchestrator | 2026-04-28 05:23:00.964201 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 05:23:00.964212 | orchestrator | Tuesday 28 April 2026 05:22:32 +0000 (0:00:01.508) 0:07:05.979 ********* 2026-04-28 05:23:00.964222 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.964233 | orchestrator | 2026-04-28 05:23:00.964243 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 05:23:00.964254 | orchestrator | Tuesday 28 April 2026 05:22:33 +0000 (0:00:01.139) 0:07:07.118 ********* 2026-04-28 05:23:00.964264 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.964275 | orchestrator | 2026-04-28 05:23:00.964285 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 05:23:00.964312 | orchestrator | Tuesday 28 April 2026 05:22:34 +0000 (0:00:01.153) 0:07:08.272 ********* 2026-04-28 05:23:00.964323 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:23:00.964334 | orchestrator | 2026-04-28 05:23:00.964345 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 05:23:00.964355 | orchestrator | Tuesday 28 April 2026 05:22:36 +0000 (0:00:01.643) 0:07:09.915 ********* 2026-04-28 05:23:00.964366 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:23:00.964377 | orchestrator | 2026-04-28 05:23:00.964411 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 05:23:00.964423 | orchestrator | Tuesday 28 April 2026 05:22:38 +0000 (0:00:01.517) 0:07:11.433 ********* 2026-04-28 05:23:00.964434 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.964445 | orchestrator | 2026-04-28 05:23:00.964456 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 05:23:00.964466 | orchestrator | Tuesday 28 April 2026 05:22:39 +0000 (0:00:01.124) 0:07:12.558 ********* 2026-04-28 05:23:00.964477 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:23:00.964488 | orchestrator | 2026-04-28 05:23:00.964498 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 05:23:00.964510 | orchestrator | Tuesday 28 April 2026 05:22:40 +0000 (0:00:01.126) 0:07:13.684 ********* 2026-04-28 05:23:00.964521 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.964531 | orchestrator | 2026-04-28 05:23:00.964542 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 05:23:00.964553 | orchestrator | Tuesday 28 April 2026 05:22:41 +0000 (0:00:01.142) 0:07:14.827 ********* 2026-04-28 05:23:00.964579 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.964590 | orchestrator | 2026-04-28 05:23:00.964600 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 05:23:00.964611 | orchestrator | Tuesday 28 April 2026 05:22:42 +0000 (0:00:01.129) 0:07:15.956 ********* 2026-04-28 05:23:00.964622 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.964633 | orchestrator | 2026-04-28 05:23:00.964643 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 05:23:00.964654 | orchestrator | Tuesday 28 April 2026 05:22:43 +0000 (0:00:01.152) 0:07:17.108 ********* 2026-04-28 05:23:00.964665 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.964675 | orchestrator | 2026-04-28 05:23:00.964686 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 05:23:00.964696 | orchestrator | Tuesday 28 April 2026 05:22:44 +0000 (0:00:01.113) 0:07:18.222 ********* 2026-04-28 05:23:00.964707 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.964718 | orchestrator | 2026-04-28 05:23:00.964728 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 05:23:00.964739 | orchestrator | Tuesday 28 April 2026 05:22:45 +0000 (0:00:01.094) 0:07:19.316 ********* 2026-04-28 05:23:00.964750 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:23:00.964761 | orchestrator | 2026-04-28 05:23:00.964771 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 05:23:00.964782 | orchestrator | Tuesday 28 April 2026 05:22:47 +0000 (0:00:01.205) 0:07:20.522 ********* 2026-04-28 05:23:00.964793 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:23:00.964803 | orchestrator | 2026-04-28 05:23:00.964814 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 05:23:00.964825 | orchestrator | Tuesday 28 April 2026 05:22:48 +0000 (0:00:01.153) 0:07:21.676 ********* 2026-04-28 05:23:00.964835 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:23:00.964850 | orchestrator | 2026-04-28 05:23:00.964861 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-28 05:23:00.964872 | orchestrator | Tuesday 28 April 2026 05:22:49 +0000 (0:00:01.148) 0:07:22.824 ********* 2026-04-28 05:23:00.964883 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.964893 | orchestrator | 2026-04-28 05:23:00.964904 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-28 05:23:00.964915 | orchestrator | Tuesday 28 April 2026 05:22:50 +0000 (0:00:01.140) 0:07:23.965 ********* 2026-04-28 05:23:00.964926 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.964937 | orchestrator | 2026-04-28 05:23:00.964947 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-28 05:23:00.964958 | orchestrator | Tuesday 28 April 2026 05:22:51 +0000 (0:00:01.221) 0:07:25.187 ********* 2026-04-28 05:23:00.964969 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.964980 | orchestrator | 2026-04-28 05:23:00.964991 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-28 05:23:00.965002 | orchestrator | Tuesday 28 April 2026 05:22:52 +0000 (0:00:01.132) 0:07:26.319 ********* 2026-04-28 05:23:00.965018 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.965037 | orchestrator | 2026-04-28 05:23:00.965055 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-28 05:23:00.965074 | orchestrator | Tuesday 28 April 2026 05:22:54 +0000 (0:00:01.163) 0:07:27.483 ********* 2026-04-28 05:23:00.965092 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.965109 | orchestrator | 2026-04-28 05:23:00.965150 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-28 05:23:00.965169 | orchestrator | Tuesday 28 April 2026 05:22:55 +0000 (0:00:01.120) 0:07:28.603 ********* 2026-04-28 05:23:00.965186 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.965202 | orchestrator | 2026-04-28 05:23:00.965220 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-28 05:23:00.965239 | orchestrator | Tuesday 28 April 2026 05:22:56 +0000 (0:00:01.198) 0:07:29.801 ********* 2026-04-28 05:23:00.965272 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.965292 | orchestrator | 2026-04-28 05:23:00.965305 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-28 05:23:00.965316 | orchestrator | Tuesday 28 April 2026 05:22:57 +0000 (0:00:01.123) 0:07:30.925 ********* 2026-04-28 05:23:00.965327 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.965337 | orchestrator | 2026-04-28 05:23:00.965348 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-28 05:23:00.965358 | orchestrator | Tuesday 28 April 2026 05:22:58 +0000 (0:00:01.126) 0:07:32.051 ********* 2026-04-28 05:23:00.965382 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.965401 | orchestrator | 2026-04-28 05:23:00.965419 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-28 05:23:00.965437 | orchestrator | Tuesday 28 April 2026 05:22:59 +0000 (0:00:01.129) 0:07:33.181 ********* 2026-04-28 05:23:00.965456 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:00.965474 | orchestrator | 2026-04-28 05:23:00.965492 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-28 05:23:00.965510 | orchestrator | Tuesday 28 April 2026 05:23:00 +0000 (0:00:01.151) 0:07:34.332 ********* 2026-04-28 05:23:50.527618 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:50.527735 | orchestrator | 2026-04-28 05:23:50.527751 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-28 05:23:50.527764 | orchestrator | Tuesday 28 April 2026 05:23:02 +0000 (0:00:01.185) 0:07:35.518 ********* 2026-04-28 05:23:50.527775 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:50.527786 | orchestrator | 2026-04-28 05:23:50.527801 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-28 05:23:50.527820 | orchestrator | Tuesday 28 April 2026 05:23:03 +0000 (0:00:01.118) 0:07:36.636 ********* 2026-04-28 05:23:50.527838 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:23:50.527858 | orchestrator | 2026-04-28 05:23:50.527876 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-28 05:23:50.527895 | orchestrator | Tuesday 28 April 2026 05:23:05 +0000 (0:00:01.950) 0:07:38.587 ********* 2026-04-28 05:23:50.527914 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:23:50.527933 | orchestrator | 2026-04-28 05:23:50.527952 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-28 05:23:50.527971 | orchestrator | Tuesday 28 April 2026 05:23:07 +0000 (0:00:02.309) 0:07:40.897 ********* 2026-04-28 05:23:50.527989 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-0 2026-04-28 05:23:50.528004 | orchestrator | 2026-04-28 05:23:50.528015 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-28 05:23:50.528026 | orchestrator | Tuesday 28 April 2026 05:23:08 +0000 (0:00:01.455) 0:07:42.352 ********* 2026-04-28 05:23:50.528036 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:50.528047 | orchestrator | 2026-04-28 05:23:50.528058 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-28 05:23:50.528068 | orchestrator | Tuesday 28 April 2026 05:23:10 +0000 (0:00:01.124) 0:07:43.477 ********* 2026-04-28 05:23:50.528079 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:50.528089 | orchestrator | 2026-04-28 05:23:50.528100 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-28 05:23:50.528111 | orchestrator | Tuesday 28 April 2026 05:23:11 +0000 (0:00:01.136) 0:07:44.613 ********* 2026-04-28 05:23:50.528121 | orchestrator | ok: [testbed-node-0] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-28 05:23:50.528132 | orchestrator | ok: [testbed-node-0] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-28 05:23:50.528143 | orchestrator | 2026-04-28 05:23:50.528156 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-28 05:23:50.528200 | orchestrator | Tuesday 28 April 2026 05:23:13 +0000 (0:00:01.783) 0:07:46.397 ********* 2026-04-28 05:23:50.528241 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:23:50.528254 | orchestrator | 2026-04-28 05:23:50.528266 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-28 05:23:50.528279 | orchestrator | Tuesday 28 April 2026 05:23:14 +0000 (0:00:01.651) 0:07:48.049 ********* 2026-04-28 05:23:50.528290 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:50.528302 | orchestrator | 2026-04-28 05:23:50.528315 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-28 05:23:50.528327 | orchestrator | Tuesday 28 April 2026 05:23:15 +0000 (0:00:01.207) 0:07:49.256 ********* 2026-04-28 05:23:50.528340 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:50.528353 | orchestrator | 2026-04-28 05:23:50.528365 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-28 05:23:50.528378 | orchestrator | Tuesday 28 April 2026 05:23:17 +0000 (0:00:01.203) 0:07:50.460 ********* 2026-04-28 05:23:50.528390 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:50.528402 | orchestrator | 2026-04-28 05:23:50.528414 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-28 05:23:50.528426 | orchestrator | Tuesday 28 April 2026 05:23:18 +0000 (0:00:01.135) 0:07:51.597 ********* 2026-04-28 05:23:50.528438 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-0 2026-04-28 05:23:50.528451 | orchestrator | 2026-04-28 05:23:50.528463 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-28 05:23:50.528475 | orchestrator | Tuesday 28 April 2026 05:23:19 +0000 (0:00:01.469) 0:07:53.066 ********* 2026-04-28 05:23:50.528487 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:23:50.528499 | orchestrator | 2026-04-28 05:23:50.528511 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-28 05:23:50.528522 | orchestrator | Tuesday 28 April 2026 05:23:21 +0000 (0:00:01.651) 0:07:54.717 ********* 2026-04-28 05:23:50.528532 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-28 05:23:50.528543 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-28 05:23:50.528553 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-28 05:23:50.528564 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:50.528574 | orchestrator | 2026-04-28 05:23:50.528584 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-28 05:23:50.528595 | orchestrator | Tuesday 28 April 2026 05:23:22 +0000 (0:00:01.169) 0:07:55.886 ********* 2026-04-28 05:23:50.528605 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:50.528616 | orchestrator | 2026-04-28 05:23:50.528626 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-28 05:23:50.528637 | orchestrator | Tuesday 28 April 2026 05:23:23 +0000 (0:00:01.111) 0:07:56.998 ********* 2026-04-28 05:23:50.528662 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:50.528673 | orchestrator | 2026-04-28 05:23:50.528684 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-28 05:23:50.528694 | orchestrator | Tuesday 28 April 2026 05:23:24 +0000 (0:00:01.138) 0:07:58.137 ********* 2026-04-28 05:23:50.528704 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:50.528715 | orchestrator | 2026-04-28 05:23:50.528725 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-28 05:23:50.528754 | orchestrator | Tuesday 28 April 2026 05:23:25 +0000 (0:00:01.167) 0:07:59.305 ********* 2026-04-28 05:23:50.528766 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:50.528776 | orchestrator | 2026-04-28 05:23:50.528787 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-28 05:23:50.528797 | orchestrator | Tuesday 28 April 2026 05:23:27 +0000 (0:00:01.172) 0:08:00.477 ********* 2026-04-28 05:23:50.528808 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:50.528818 | orchestrator | 2026-04-28 05:23:50.528829 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-28 05:23:50.528847 | orchestrator | Tuesday 28 April 2026 05:23:28 +0000 (0:00:01.239) 0:08:01.717 ********* 2026-04-28 05:23:50.528858 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:23:50.528869 | orchestrator | 2026-04-28 05:23:50.528879 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-28 05:23:50.528890 | orchestrator | Tuesday 28 April 2026 05:23:30 +0000 (0:00:02.523) 0:08:04.241 ********* 2026-04-28 05:23:50.528900 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:23:50.528911 | orchestrator | 2026-04-28 05:23:50.528922 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-28 05:23:50.528932 | orchestrator | Tuesday 28 April 2026 05:23:31 +0000 (0:00:01.119) 0:08:05.361 ********* 2026-04-28 05:23:50.528943 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-0 2026-04-28 05:23:50.528953 | orchestrator | 2026-04-28 05:23:50.528964 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-28 05:23:50.528974 | orchestrator | Tuesday 28 April 2026 05:23:33 +0000 (0:00:01.502) 0:08:06.864 ********* 2026-04-28 05:23:50.528985 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:50.528995 | orchestrator | 2026-04-28 05:23:50.529006 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-28 05:23:50.529018 | orchestrator | Tuesday 28 April 2026 05:23:34 +0000 (0:00:01.171) 0:08:08.036 ********* 2026-04-28 05:23:50.529035 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:50.529054 | orchestrator | 2026-04-28 05:23:50.529080 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-28 05:23:50.529102 | orchestrator | Tuesday 28 April 2026 05:23:35 +0000 (0:00:01.126) 0:08:09.162 ********* 2026-04-28 05:23:50.529118 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:50.529134 | orchestrator | 2026-04-28 05:23:50.529150 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-28 05:23:50.529194 | orchestrator | Tuesday 28 April 2026 05:23:36 +0000 (0:00:01.125) 0:08:10.287 ********* 2026-04-28 05:23:50.529212 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:50.529228 | orchestrator | 2026-04-28 05:23:50.529246 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-28 05:23:50.529264 | orchestrator | Tuesday 28 April 2026 05:23:38 +0000 (0:00:01.124) 0:08:11.412 ********* 2026-04-28 05:23:50.529281 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:50.529298 | orchestrator | 2026-04-28 05:23:50.529318 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-28 05:23:50.529336 | orchestrator | Tuesday 28 April 2026 05:23:39 +0000 (0:00:01.126) 0:08:12.538 ********* 2026-04-28 05:23:50.529353 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:50.529364 | orchestrator | 2026-04-28 05:23:50.529374 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-28 05:23:50.529385 | orchestrator | Tuesday 28 April 2026 05:23:40 +0000 (0:00:01.104) 0:08:13.643 ********* 2026-04-28 05:23:50.529396 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:50.529406 | orchestrator | 2026-04-28 05:23:50.529417 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-28 05:23:50.529427 | orchestrator | Tuesday 28 April 2026 05:23:41 +0000 (0:00:01.164) 0:08:14.808 ********* 2026-04-28 05:23:50.529438 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:23:50.529448 | orchestrator | 2026-04-28 05:23:50.529458 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-28 05:23:50.529469 | orchestrator | Tuesday 28 April 2026 05:23:42 +0000 (0:00:01.136) 0:08:15.945 ********* 2026-04-28 05:23:50.529479 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:23:50.529490 | orchestrator | 2026-04-28 05:23:50.529500 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-28 05:23:50.529511 | orchestrator | Tuesday 28 April 2026 05:23:43 +0000 (0:00:01.216) 0:08:17.161 ********* 2026-04-28 05:23:50.529521 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-0 2026-04-28 05:23:50.529543 | orchestrator | 2026-04-28 05:23:50.529554 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-28 05:23:50.529564 | orchestrator | Tuesday 28 April 2026 05:23:45 +0000 (0:00:01.529) 0:08:18.691 ********* 2026-04-28 05:23:50.529575 | orchestrator | ok: [testbed-node-0] => (item=/etc/ceph) 2026-04-28 05:23:50.529594 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/) 2026-04-28 05:23:50.529621 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/mon) 2026-04-28 05:23:50.529642 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/osd) 2026-04-28 05:23:50.529660 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/mds) 2026-04-28 05:23:50.529677 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/tmp) 2026-04-28 05:23:50.529694 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/crash) 2026-04-28 05:23:50.529711 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/radosgw) 2026-04-28 05:23:50.529730 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-28 05:23:50.529759 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-28 05:23:50.529778 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-28 05:23:50.529794 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-28 05:23:50.529805 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-28 05:23:50.529816 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-28 05:23:50.529837 | orchestrator | ok: [testbed-node-0] => (item=/var/run/ceph) 2026-04-28 05:24:38.611331 | orchestrator | ok: [testbed-node-0] => (item=/var/log/ceph) 2026-04-28 05:24:38.611472 | orchestrator | 2026-04-28 05:24:38.611488 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-28 05:24:38.611500 | orchestrator | Tuesday 28 April 2026 05:23:51 +0000 (0:00:06.689) 0:08:25.380 ********* 2026-04-28 05:24:38.611511 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.611522 | orchestrator | 2026-04-28 05:24:38.611532 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-28 05:24:38.611542 | orchestrator | Tuesday 28 April 2026 05:23:53 +0000 (0:00:01.089) 0:08:26.470 ********* 2026-04-28 05:24:38.611551 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.611561 | orchestrator | 2026-04-28 05:24:38.611571 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-28 05:24:38.611580 | orchestrator | Tuesday 28 April 2026 05:23:54 +0000 (0:00:01.114) 0:08:27.584 ********* 2026-04-28 05:24:38.611590 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.611599 | orchestrator | 2026-04-28 05:24:38.611609 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-28 05:24:38.611618 | orchestrator | Tuesday 28 April 2026 05:23:55 +0000 (0:00:01.130) 0:08:28.715 ********* 2026-04-28 05:24:38.611628 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.611637 | orchestrator | 2026-04-28 05:24:38.611646 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-28 05:24:38.611656 | orchestrator | Tuesday 28 April 2026 05:23:56 +0000 (0:00:01.115) 0:08:29.831 ********* 2026-04-28 05:24:38.611665 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.611675 | orchestrator | 2026-04-28 05:24:38.611684 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-28 05:24:38.611694 | orchestrator | Tuesday 28 April 2026 05:23:57 +0000 (0:00:01.180) 0:08:31.011 ********* 2026-04-28 05:24:38.611703 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.611712 | orchestrator | 2026-04-28 05:24:38.611722 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-28 05:24:38.611733 | orchestrator | Tuesday 28 April 2026 05:23:58 +0000 (0:00:01.107) 0:08:32.118 ********* 2026-04-28 05:24:38.611743 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.611753 | orchestrator | 2026-04-28 05:24:38.611763 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-28 05:24:38.611813 | orchestrator | Tuesday 28 April 2026 05:23:59 +0000 (0:00:01.101) 0:08:33.220 ********* 2026-04-28 05:24:38.611831 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.611849 | orchestrator | 2026-04-28 05:24:38.611867 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-28 05:24:38.611886 | orchestrator | Tuesday 28 April 2026 05:24:01 +0000 (0:00:01.181) 0:08:34.401 ********* 2026-04-28 05:24:38.611903 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.611921 | orchestrator | 2026-04-28 05:24:38.611938 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-28 05:24:38.611956 | orchestrator | Tuesday 28 April 2026 05:24:02 +0000 (0:00:01.134) 0:08:35.536 ********* 2026-04-28 05:24:38.611975 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.612000 | orchestrator | 2026-04-28 05:24:38.612017 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-28 05:24:38.612036 | orchestrator | Tuesday 28 April 2026 05:24:03 +0000 (0:00:01.140) 0:08:36.676 ********* 2026-04-28 05:24:38.612053 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.612070 | orchestrator | 2026-04-28 05:24:38.612087 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-28 05:24:38.612106 | orchestrator | Tuesday 28 April 2026 05:24:04 +0000 (0:00:01.131) 0:08:37.807 ********* 2026-04-28 05:24:38.612122 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.612140 | orchestrator | 2026-04-28 05:24:38.612157 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-28 05:24:38.612174 | orchestrator | Tuesday 28 April 2026 05:24:05 +0000 (0:00:01.143) 0:08:38.950 ********* 2026-04-28 05:24:38.612191 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.612264 | orchestrator | 2026-04-28 05:24:38.612282 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-28 05:24:38.612299 | orchestrator | Tuesday 28 April 2026 05:24:06 +0000 (0:00:01.228) 0:08:40.179 ********* 2026-04-28 05:24:38.612316 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.612332 | orchestrator | 2026-04-28 05:24:38.612347 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-28 05:24:38.612357 | orchestrator | Tuesday 28 April 2026 05:24:07 +0000 (0:00:01.132) 0:08:41.311 ********* 2026-04-28 05:24:38.612366 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.612375 | orchestrator | 2026-04-28 05:24:38.612385 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-28 05:24:38.612394 | orchestrator | Tuesday 28 April 2026 05:24:09 +0000 (0:00:01.209) 0:08:42.521 ********* 2026-04-28 05:24:38.612404 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.612413 | orchestrator | 2026-04-28 05:24:38.612423 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-28 05:24:38.612432 | orchestrator | Tuesday 28 April 2026 05:24:10 +0000 (0:00:01.109) 0:08:43.630 ********* 2026-04-28 05:24:38.612441 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.612451 | orchestrator | 2026-04-28 05:24:38.612461 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 05:24:38.612490 | orchestrator | Tuesday 28 April 2026 05:24:11 +0000 (0:00:01.130) 0:08:44.761 ********* 2026-04-28 05:24:38.612500 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.612509 | orchestrator | 2026-04-28 05:24:38.612519 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 05:24:38.612528 | orchestrator | Tuesday 28 April 2026 05:24:12 +0000 (0:00:01.126) 0:08:45.887 ********* 2026-04-28 05:24:38.612538 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.612547 | orchestrator | 2026-04-28 05:24:38.612578 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 05:24:38.612588 | orchestrator | Tuesday 28 April 2026 05:24:13 +0000 (0:00:01.167) 0:08:47.055 ********* 2026-04-28 05:24:38.612598 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.612618 | orchestrator | 2026-04-28 05:24:38.612628 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 05:24:38.612638 | orchestrator | Tuesday 28 April 2026 05:24:14 +0000 (0:00:01.175) 0:08:48.230 ********* 2026-04-28 05:24:38.612647 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.612657 | orchestrator | 2026-04-28 05:24:38.612666 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 05:24:38.612676 | orchestrator | Tuesday 28 April 2026 05:24:16 +0000 (0:00:01.167) 0:08:49.398 ********* 2026-04-28 05:24:38.612686 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-28 05:24:38.612696 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-28 05:24:38.612705 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-28 05:24:38.612715 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.612724 | orchestrator | 2026-04-28 05:24:38.612734 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 05:24:38.612743 | orchestrator | Tuesday 28 April 2026 05:24:17 +0000 (0:00:01.761) 0:08:51.159 ********* 2026-04-28 05:24:38.612752 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-28 05:24:38.612762 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-28 05:24:38.612772 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-28 05:24:38.612781 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.612791 | orchestrator | 2026-04-28 05:24:38.612800 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 05:24:38.612809 | orchestrator | Tuesday 28 April 2026 05:24:19 +0000 (0:00:01.407) 0:08:52.567 ********* 2026-04-28 05:24:38.612819 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-28 05:24:38.612828 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-28 05:24:38.612838 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-28 05:24:38.612847 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.612857 | orchestrator | 2026-04-28 05:24:38.612866 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 05:24:38.612875 | orchestrator | Tuesday 28 April 2026 05:24:20 +0000 (0:00:01.383) 0:08:53.950 ********* 2026-04-28 05:24:38.612885 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.612894 | orchestrator | 2026-04-28 05:24:38.612904 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 05:24:38.612913 | orchestrator | Tuesday 28 April 2026 05:24:21 +0000 (0:00:01.127) 0:08:55.078 ********* 2026-04-28 05:24:38.612923 | orchestrator | skipping: [testbed-node-0] => (item=0)  2026-04-28 05:24:38.612933 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.612942 | orchestrator | 2026-04-28 05:24:38.612952 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-28 05:24:38.612961 | orchestrator | Tuesday 28 April 2026 05:24:23 +0000 (0:00:01.528) 0:08:56.607 ********* 2026-04-28 05:24:38.612971 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:24:38.612981 | orchestrator | 2026-04-28 05:24:38.612990 | orchestrator | TASK [ceph-mon : Set_fact container_exec_cmd] ********************************** 2026-04-28 05:24:38.613000 | orchestrator | Tuesday 28 April 2026 05:24:25 +0000 (0:00:01.884) 0:08:58.492 ********* 2026-04-28 05:24:38.613009 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:24:38.613018 | orchestrator | 2026-04-28 05:24:38.613028 | orchestrator | TASK [ceph-mon : Include deploy_monitors.yml] ********************************** 2026-04-28 05:24:38.613038 | orchestrator | Tuesday 28 April 2026 05:24:26 +0000 (0:00:01.177) 0:08:59.669 ********* 2026-04-28 05:24:38.613047 | orchestrator | included: /ansible/roles/ceph-mon/tasks/deploy_monitors.yml for testbed-node-0 2026-04-28 05:24:38.613058 | orchestrator | 2026-04-28 05:24:38.613067 | orchestrator | TASK [ceph-mon : Check if monitor initial keyring already exists] ************** 2026-04-28 05:24:38.613077 | orchestrator | Tuesday 28 April 2026 05:24:27 +0000 (0:00:01.515) 0:09:01.184 ********* 2026-04-28 05:24:38.613086 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] 2026-04-28 05:24:38.613103 | orchestrator | 2026-04-28 05:24:38.613112 | orchestrator | TASK [ceph-mon : Generate monitor initial keyring] ***************************** 2026-04-28 05:24:38.613122 | orchestrator | Tuesday 28 April 2026 05:24:30 +0000 (0:00:03.166) 0:09:04.350 ********* 2026-04-28 05:24:38.613131 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:24:38.613141 | orchestrator | 2026-04-28 05:24:38.613150 | orchestrator | TASK [ceph-mon : Set_fact _initial_mon_key_success] **************************** 2026-04-28 05:24:38.613160 | orchestrator | Tuesday 28 April 2026 05:24:32 +0000 (0:00:01.160) 0:09:05.511 ********* 2026-04-28 05:24:38.613169 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:24:38.613178 | orchestrator | 2026-04-28 05:24:38.613188 | orchestrator | TASK [ceph-mon : Get initial keyring when it already exists] ******************* 2026-04-28 05:24:38.613219 | orchestrator | Tuesday 28 April 2026 05:24:33 +0000 (0:00:01.187) 0:09:06.699 ********* 2026-04-28 05:24:38.613237 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:24:38.613252 | orchestrator | 2026-04-28 05:24:38.613269 | orchestrator | TASK [ceph-mon : Create monitor initial keyring] ******************************* 2026-04-28 05:24:38.613285 | orchestrator | Tuesday 28 April 2026 05:24:34 +0000 (0:00:01.174) 0:09:07.874 ********* 2026-04-28 05:24:38.613302 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:24:38.613314 | orchestrator | 2026-04-28 05:24:38.613324 | orchestrator | TASK [ceph-mon : Copy the initial key in /etc/ceph (for containers)] *********** 2026-04-28 05:24:38.613339 | orchestrator | Tuesday 28 April 2026 05:24:36 +0000 (0:00:02.031) 0:09:09.906 ********* 2026-04-28 05:24:38.613349 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:24:38.613359 | orchestrator | 2026-04-28 05:24:38.613368 | orchestrator | TASK [ceph-mon : Create monitor directory] ************************************* 2026-04-28 05:24:38.613378 | orchestrator | Tuesday 28 April 2026 05:24:38 +0000 (0:00:01.588) 0:09:11.494 ********* 2026-04-28 05:24:38.613387 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:24:38.613397 | orchestrator | 2026-04-28 05:24:38.613413 | orchestrator | TASK [ceph-mon : Recursively fix ownership of monitor directory] *************** 2026-04-28 05:25:36.091472 | orchestrator | Tuesday 28 April 2026 05:24:39 +0000 (0:00:01.444) 0:09:12.938 ********* 2026-04-28 05:25:36.091589 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:25:36.091605 | orchestrator | 2026-04-28 05:25:36.091617 | orchestrator | TASK [ceph-mon : Create admin keyring] ***************************************** 2026-04-28 05:25:36.091628 | orchestrator | Tuesday 28 April 2026 05:24:41 +0000 (0:00:01.486) 0:09:14.425 ********* 2026-04-28 05:25:36.091639 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:25:36.091649 | orchestrator | 2026-04-28 05:25:36.091661 | orchestrator | TASK [ceph-mon : Slurp admin keyring] ****************************************** 2026-04-28 05:25:36.091672 | orchestrator | Tuesday 28 April 2026 05:24:42 +0000 (0:00:01.720) 0:09:16.145 ********* 2026-04-28 05:25:36.091683 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:25:36.091693 | orchestrator | 2026-04-28 05:25:36.091704 | orchestrator | TASK [ceph-mon : Copy admin keyring over to mons] ****************************** 2026-04-28 05:25:36.091715 | orchestrator | Tuesday 28 April 2026 05:24:44 +0000 (0:00:01.671) 0:09:17.817 ********* 2026-04-28 05:25:36.091726 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-28 05:25:36.091738 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-28 05:25:36.091748 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-28 05:25:36.091759 | orchestrator | ok: [testbed-node-0 -> {{ item }}] 2026-04-28 05:25:36.091770 | orchestrator | 2026-04-28 05:25:36.091780 | orchestrator | TASK [ceph-mon : Import admin keyring into mon keyring] ************************ 2026-04-28 05:25:36.091791 | orchestrator | Tuesday 28 April 2026 05:24:48 +0000 (0:00:04.008) 0:09:21.826 ********* 2026-04-28 05:25:36.091801 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:25:36.091812 | orchestrator | 2026-04-28 05:25:36.091823 | orchestrator | TASK [ceph-mon : Set_fact ceph-mon container command] ************************** 2026-04-28 05:25:36.091833 | orchestrator | Tuesday 28 April 2026 05:24:50 +0000 (0:00:02.055) 0:09:23.881 ********* 2026-04-28 05:25:36.091844 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:25:36.091881 | orchestrator | 2026-04-28 05:25:36.091893 | orchestrator | TASK [ceph-mon : Set_fact monmaptool container command] ************************ 2026-04-28 05:25:36.091904 | orchestrator | Tuesday 28 April 2026 05:24:51 +0000 (0:00:01.135) 0:09:25.017 ********* 2026-04-28 05:25:36.091914 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:25:36.091925 | orchestrator | 2026-04-28 05:25:36.091936 | orchestrator | TASK [ceph-mon : Generate initial monmap] ************************************** 2026-04-28 05:25:36.091946 | orchestrator | Tuesday 28 April 2026 05:24:52 +0000 (0:00:01.172) 0:09:26.190 ********* 2026-04-28 05:25:36.091957 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:25:36.091967 | orchestrator | 2026-04-28 05:25:36.091978 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs with keyring] ******************************* 2026-04-28 05:25:36.091989 | orchestrator | Tuesday 28 April 2026 05:24:54 +0000 (0:00:02.101) 0:09:28.292 ********* 2026-04-28 05:25:36.092000 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:25:36.092012 | orchestrator | 2026-04-28 05:25:36.092025 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs without keyring] **************************** 2026-04-28 05:25:36.092038 | orchestrator | Tuesday 28 April 2026 05:24:56 +0000 (0:00:01.503) 0:09:29.795 ********* 2026-04-28 05:25:36.092050 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:25:36.092062 | orchestrator | 2026-04-28 05:25:36.092075 | orchestrator | TASK [ceph-mon : Include start_monitor.yml] ************************************ 2026-04-28 05:25:36.092087 | orchestrator | Tuesday 28 April 2026 05:24:57 +0000 (0:00:01.120) 0:09:30.916 ********* 2026-04-28 05:25:36.092100 | orchestrator | included: /ansible/roles/ceph-mon/tasks/start_monitor.yml for testbed-node-0 2026-04-28 05:25:36.092112 | orchestrator | 2026-04-28 05:25:36.092125 | orchestrator | TASK [ceph-mon : Ensure systemd service override directory exists] ************* 2026-04-28 05:25:36.092138 | orchestrator | Tuesday 28 April 2026 05:24:58 +0000 (0:00:01.445) 0:09:32.362 ********* 2026-04-28 05:25:36.092150 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:25:36.092162 | orchestrator | 2026-04-28 05:25:36.092174 | orchestrator | TASK [ceph-mon : Add ceph-mon systemd service overrides] *********************** 2026-04-28 05:25:36.092186 | orchestrator | Tuesday 28 April 2026 05:25:00 +0000 (0:00:01.154) 0:09:33.517 ********* 2026-04-28 05:25:36.092199 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:25:36.092211 | orchestrator | 2026-04-28 05:25:36.092224 | orchestrator | TASK [ceph-mon : Include_tasks systemd.yml] ************************************ 2026-04-28 05:25:36.092236 | orchestrator | Tuesday 28 April 2026 05:25:01 +0000 (0:00:01.120) 0:09:34.637 ********* 2026-04-28 05:25:36.092295 | orchestrator | included: /ansible/roles/ceph-mon/tasks/systemd.yml for testbed-node-0 2026-04-28 05:25:36.092308 | orchestrator | 2026-04-28 05:25:36.092320 | orchestrator | TASK [ceph-mon : Generate systemd unit file for mon container] ***************** 2026-04-28 05:25:36.092333 | orchestrator | Tuesday 28 April 2026 05:25:02 +0000 (0:00:01.509) 0:09:36.147 ********* 2026-04-28 05:25:36.092346 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:25:36.092358 | orchestrator | 2026-04-28 05:25:36.092370 | orchestrator | TASK [ceph-mon : Generate systemd ceph-mon target file] ************************ 2026-04-28 05:25:36.092381 | orchestrator | Tuesday 28 April 2026 05:25:05 +0000 (0:00:02.242) 0:09:38.389 ********* 2026-04-28 05:25:36.092391 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:25:36.092402 | orchestrator | 2026-04-28 05:25:36.092412 | orchestrator | TASK [ceph-mon : Enable ceph-mon.target] *************************************** 2026-04-28 05:25:36.092423 | orchestrator | Tuesday 28 April 2026 05:25:06 +0000 (0:00:01.915) 0:09:40.304 ********* 2026-04-28 05:25:36.092433 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:25:36.092444 | orchestrator | 2026-04-28 05:25:36.092455 | orchestrator | TASK [ceph-mon : Start the monitor service] ************************************ 2026-04-28 05:25:36.092481 | orchestrator | Tuesday 28 April 2026 05:25:09 +0000 (0:00:02.407) 0:09:42.711 ********* 2026-04-28 05:25:36.092491 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:25:36.092502 | orchestrator | 2026-04-28 05:25:36.092512 | orchestrator | TASK [ceph-mon : Include_tasks ceph_keys.yml] ********************************** 2026-04-28 05:25:36.092523 | orchestrator | Tuesday 28 April 2026 05:25:12 +0000 (0:00:03.153) 0:09:45.866 ********* 2026-04-28 05:25:36.092542 | orchestrator | included: /ansible/roles/ceph-mon/tasks/ceph_keys.yml for testbed-node-0 2026-04-28 05:25:36.092552 | orchestrator | 2026-04-28 05:25:36.092581 | orchestrator | TASK [ceph-mon : Waiting for the monitor(s) to form the quorum...] ************* 2026-04-28 05:25:36.092592 | orchestrator | Tuesday 28 April 2026 05:25:14 +0000 (0:00:01.545) 0:09:47.411 ********* 2026-04-28 05:25:36.092603 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:25:36.092614 | orchestrator | 2026-04-28 05:25:36.092624 | orchestrator | TASK [ceph-mon : Fetch ceph initial keys] ************************************** 2026-04-28 05:25:36.092635 | orchestrator | Tuesday 28 April 2026 05:25:16 +0000 (0:00:02.282) 0:09:49.693 ********* 2026-04-28 05:25:36.092645 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:25:36.092656 | orchestrator | 2026-04-28 05:25:36.092670 | orchestrator | TASK [ceph-mon : Include secure_cluster.yml] *********************************** 2026-04-28 05:25:36.092688 | orchestrator | Tuesday 28 April 2026 05:25:19 +0000 (0:00:02.880) 0:09:52.574 ********* 2026-04-28 05:25:36.092708 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:25:36.092726 | orchestrator | 2026-04-28 05:25:36.092740 | orchestrator | TASK [ceph-mon : Set cluster configs] ****************************************** 2026-04-28 05:25:36.092751 | orchestrator | Tuesday 28 April 2026 05:25:20 +0000 (0:00:01.130) 0:09:53.704 ********* 2026-04-28 05:25:36.092764 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'public_network', 'value': '192.168.16.0/20'}]) 2026-04-28 05:25:36.092778 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'cluster_network', 'value': '192.168.16.0/20'}]) 2026-04-28 05:25:36.092789 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'osd_pool_default_crush_rule', 'value': -1}]) 2026-04-28 05:25:36.092800 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'ms_bind_ipv6', 'value': 'False'}]) 2026-04-28 05:25:36.092812 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'ms_bind_ipv4', 'value': 'True'}]) 2026-04-28 05:25:36.092825 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'osd_crush_chooseleaf_type', 'value': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}])  2026-04-28 05:25:36.092837 | orchestrator | 2026-04-28 05:25:36.092848 | orchestrator | TASK [Start ceph mgr] ********************************************************** 2026-04-28 05:25:36.092859 | orchestrator | Tuesday 28 April 2026 05:25:30 +0000 (0:00:09.684) 0:10:03.389 ********* 2026-04-28 05:25:36.092885 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:25:36.092913 | orchestrator | 2026-04-28 05:25:36.092932 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-28 05:25:36.092950 | orchestrator | Tuesday 28 April 2026 05:25:32 +0000 (0:00:02.407) 0:10:05.797 ********* 2026-04-28 05:25:36.092969 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:25:36.092989 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-28 05:25:36.093007 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-28 05:25:36.093025 | orchestrator | 2026-04-28 05:25:36.093036 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-28 05:25:36.093047 | orchestrator | Tuesday 28 April 2026 05:25:34 +0000 (0:00:02.250) 0:10:08.048 ********* 2026-04-28 05:25:36.093065 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-28 05:25:36.093077 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-28 05:25:36.093088 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-28 05:25:36.093098 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:25:36.093109 | orchestrator | 2026-04-28 05:25:36.093120 | orchestrator | TASK [Non container | waiting for the monitor to join the quorum...] *********** 2026-04-28 05:25:36.093139 | orchestrator | Tuesday 28 April 2026 05:25:36 +0000 (0:00:01.412) 0:10:09.461 ********* 2026-04-28 05:26:03.908379 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:26:03.908478 | orchestrator | 2026-04-28 05:26:03.908491 | orchestrator | TASK [Container | waiting for the containerized monitor to join the quorum...] *** 2026-04-28 05:26:03.908501 | orchestrator | Tuesday 28 April 2026 05:25:37 +0000 (0:00:01.112) 0:10:10.574 ********* 2026-04-28 05:26:03.908510 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:26:03.908520 | orchestrator | 2026-04-28 05:26:03.908528 | orchestrator | PLAY [Upgrade ceph mon cluster] ************************************************ 2026-04-28 05:26:03.908537 | orchestrator | 2026-04-28 05:26:03.908545 | orchestrator | TASK [Remove ceph aliases] ***************************************************** 2026-04-28 05:26:03.908553 | orchestrator | Tuesday 28 April 2026 05:25:39 +0000 (0:00:01.996) 0:10:12.571 ********* 2026-04-28 05:26:03.908561 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:26:03.908569 | orchestrator | 2026-04-28 05:26:03.908577 | orchestrator | TASK [Set mon_host_count] ****************************************************** 2026-04-28 05:26:03.908585 | orchestrator | Tuesday 28 April 2026 05:25:40 +0000 (0:00:01.163) 0:10:13.734 ********* 2026-04-28 05:26:03.908592 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:26:03.908600 | orchestrator | 2026-04-28 05:26:03.908608 | orchestrator | TASK [Fail when less than three monitors] ************************************** 2026-04-28 05:26:03.908616 | orchestrator | Tuesday 28 April 2026 05:25:41 +0000 (0:00:00.775) 0:10:14.510 ********* 2026-04-28 05:26:03.908623 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:26:03.908631 | orchestrator | 2026-04-28 05:26:03.908639 | orchestrator | TASK [Select a running monitor] ************************************************ 2026-04-28 05:26:03.908647 | orchestrator | Tuesday 28 April 2026 05:25:41 +0000 (0:00:00.791) 0:10:15.302 ********* 2026-04-28 05:26:03.908655 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:26:03.908663 | orchestrator | 2026-04-28 05:26:03.908670 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 05:26:03.908678 | orchestrator | Tuesday 28 April 2026 05:25:42 +0000 (0:00:00.785) 0:10:16.087 ********* 2026-04-28 05:26:03.908686 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-1 2026-04-28 05:26:03.908694 | orchestrator | 2026-04-28 05:26:03.908702 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-28 05:26:03.908709 | orchestrator | Tuesday 28 April 2026 05:25:43 +0000 (0:00:01.083) 0:10:17.171 ********* 2026-04-28 05:26:03.908717 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:26:03.908725 | orchestrator | 2026-04-28 05:26:03.908733 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-28 05:26:03.908740 | orchestrator | Tuesday 28 April 2026 05:25:45 +0000 (0:00:01.516) 0:10:18.687 ********* 2026-04-28 05:26:03.908770 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:26:03.908779 | orchestrator | 2026-04-28 05:26:03.908786 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 05:26:03.908794 | orchestrator | Tuesday 28 April 2026 05:25:46 +0000 (0:00:01.137) 0:10:19.825 ********* 2026-04-28 05:26:03.908802 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:26:03.908809 | orchestrator | 2026-04-28 05:26:03.908817 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 05:26:03.908825 | orchestrator | Tuesday 28 April 2026 05:25:47 +0000 (0:00:01.449) 0:10:21.274 ********* 2026-04-28 05:26:03.908833 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:26:03.908840 | orchestrator | 2026-04-28 05:26:03.908848 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-28 05:26:03.908856 | orchestrator | Tuesday 28 April 2026 05:25:49 +0000 (0:00:01.163) 0:10:22.438 ********* 2026-04-28 05:26:03.908863 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:26:03.908873 | orchestrator | 2026-04-28 05:26:03.908882 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-28 05:26:03.908892 | orchestrator | Tuesday 28 April 2026 05:25:50 +0000 (0:00:01.132) 0:10:23.571 ********* 2026-04-28 05:26:03.908900 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:26:03.908909 | orchestrator | 2026-04-28 05:26:03.908919 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-28 05:26:03.908928 | orchestrator | Tuesday 28 April 2026 05:25:51 +0000 (0:00:01.191) 0:10:24.763 ********* 2026-04-28 05:26:03.908937 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:26:03.908946 | orchestrator | 2026-04-28 05:26:03.908955 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-28 05:26:03.908964 | orchestrator | Tuesday 28 April 2026 05:25:52 +0000 (0:00:01.146) 0:10:25.909 ********* 2026-04-28 05:26:03.908973 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:26:03.908983 | orchestrator | 2026-04-28 05:26:03.908992 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-28 05:26:03.909001 | orchestrator | Tuesday 28 April 2026 05:25:53 +0000 (0:00:01.183) 0:10:27.092 ********* 2026-04-28 05:26:03.909010 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:26:03.909020 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-28 05:26:03.909029 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:26:03.909038 | orchestrator | 2026-04-28 05:26:03.909047 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-28 05:26:03.909056 | orchestrator | Tuesday 28 April 2026 05:25:55 +0000 (0:00:01.704) 0:10:28.796 ********* 2026-04-28 05:26:03.909068 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:26:03.909083 | orchestrator | 2026-04-28 05:26:03.909097 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-28 05:26:03.909110 | orchestrator | Tuesday 28 April 2026 05:25:56 +0000 (0:00:01.219) 0:10:30.016 ********* 2026-04-28 05:26:03.909140 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:26:03.909156 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-28 05:26:03.909168 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:26:03.909182 | orchestrator | 2026-04-28 05:26:03.909195 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-28 05:26:03.909208 | orchestrator | Tuesday 28 April 2026 05:25:59 +0000 (0:00:02.978) 0:10:32.995 ********* 2026-04-28 05:26:03.909239 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-28 05:26:03.909253 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-28 05:26:03.909288 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-28 05:26:03.909303 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:26:03.909316 | orchestrator | 2026-04-28 05:26:03.909329 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-28 05:26:03.909355 | orchestrator | Tuesday 28 April 2026 05:26:01 +0000 (0:00:01.418) 0:10:34.414 ********* 2026-04-28 05:26:03.909370 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-28 05:26:03.909387 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-28 05:26:03.909400 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-28 05:26:03.909413 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:26:03.909426 | orchestrator | 2026-04-28 05:26:03.909439 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-28 05:26:03.909448 | orchestrator | Tuesday 28 April 2026 05:26:02 +0000 (0:00:01.605) 0:10:36.019 ********* 2026-04-28 05:26:03.909457 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:26:03.909469 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:26:03.909477 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:26:03.909485 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:26:03.909493 | orchestrator | 2026-04-28 05:26:03.909501 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-28 05:26:03.909509 | orchestrator | Tuesday 28 April 2026 05:26:03 +0000 (0:00:01.163) 0:10:37.182 ********* 2026-04-28 05:26:03.909518 | orchestrator | ok: [testbed-node-1] => (item={'changed': False, 'stdout': 'e79a9ee6c12b', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-28 05:25:57.181715', 'end': '2026-04-28 05:25:57.233050', 'delta': '0:00:00.051335', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e79a9ee6c12b'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-28 05:26:03.909545 | orchestrator | ok: [testbed-node-1] => (item={'changed': False, 'stdout': '90eb2d51595d', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-28 05:25:57.772154', 'end': '2026-04-28 05:25:57.830342', 'delta': '0:00:00.058188', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['90eb2d51595d'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-28 05:26:23.969114 | orchestrator | ok: [testbed-node-1] => (item={'changed': False, 'stdout': 'ba47649d1789', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-28 05:25:58.356338', 'end': '2026-04-28 05:25:58.411047', 'delta': '0:00:00.054709', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['ba47649d1789'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-28 05:26:23.969224 | orchestrator | 2026-04-28 05:26:23.969240 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-28 05:26:23.969251 | orchestrator | Tuesday 28 April 2026 05:26:05 +0000 (0:00:01.236) 0:10:38.418 ********* 2026-04-28 05:26:23.969260 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:26:23.969270 | orchestrator | 2026-04-28 05:26:23.969279 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-28 05:26:23.969347 | orchestrator | Tuesday 28 April 2026 05:26:06 +0000 (0:00:01.295) 0:10:39.713 ********* 2026-04-28 05:26:23.969358 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:26:23.969368 | orchestrator | 2026-04-28 05:26:23.969376 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-28 05:26:23.969385 | orchestrator | Tuesday 28 April 2026 05:26:07 +0000 (0:00:01.261) 0:10:40.975 ********* 2026-04-28 05:26:23.969394 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:26:23.969402 | orchestrator | 2026-04-28 05:26:23.969411 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-28 05:26:23.969420 | orchestrator | Tuesday 28 April 2026 05:26:08 +0000 (0:00:01.116) 0:10:42.092 ********* 2026-04-28 05:26:23.969429 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] 2026-04-28 05:26:23.969437 | orchestrator | 2026-04-28 05:26:23.969446 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 05:26:23.969454 | orchestrator | Tuesday 28 April 2026 05:26:11 +0000 (0:00:03.138) 0:10:45.231 ********* 2026-04-28 05:26:23.969463 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:26:23.969472 | orchestrator | 2026-04-28 05:26:23.969480 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-28 05:26:23.969489 | orchestrator | Tuesday 28 April 2026 05:26:12 +0000 (0:00:01.115) 0:10:46.347 ********* 2026-04-28 05:26:23.969497 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:26:23.969506 | orchestrator | 2026-04-28 05:26:23.969514 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-28 05:26:23.969523 | orchestrator | Tuesday 28 April 2026 05:26:14 +0000 (0:00:01.115) 0:10:47.462 ********* 2026-04-28 05:26:23.969532 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:26:23.969540 | orchestrator | 2026-04-28 05:26:23.969548 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 05:26:23.969557 | orchestrator | Tuesday 28 April 2026 05:26:15 +0000 (0:00:01.676) 0:10:49.139 ********* 2026-04-28 05:26:23.969565 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:26:23.969574 | orchestrator | 2026-04-28 05:26:23.969583 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-28 05:26:23.969591 | orchestrator | Tuesday 28 April 2026 05:26:16 +0000 (0:00:01.151) 0:10:50.290 ********* 2026-04-28 05:26:23.969600 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:26:23.969654 | orchestrator | 2026-04-28 05:26:23.969665 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-28 05:26:23.969675 | orchestrator | Tuesday 28 April 2026 05:26:18 +0000 (0:00:01.172) 0:10:51.463 ********* 2026-04-28 05:26:23.969686 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:26:23.969696 | orchestrator | 2026-04-28 05:26:23.969716 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-28 05:26:23.969726 | orchestrator | Tuesday 28 April 2026 05:26:19 +0000 (0:00:01.116) 0:10:52.580 ********* 2026-04-28 05:26:23.969736 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:26:23.969745 | orchestrator | 2026-04-28 05:26:23.969755 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-28 05:26:23.969765 | orchestrator | Tuesday 28 April 2026 05:26:20 +0000 (0:00:01.198) 0:10:53.779 ********* 2026-04-28 05:26:23.969774 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:26:23.969784 | orchestrator | 2026-04-28 05:26:23.969793 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-28 05:26:23.969803 | orchestrator | Tuesday 28 April 2026 05:26:21 +0000 (0:00:01.140) 0:10:54.920 ********* 2026-04-28 05:26:23.969812 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:26:23.969822 | orchestrator | 2026-04-28 05:26:23.969832 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-28 05:26:23.969856 | orchestrator | Tuesday 28 April 2026 05:26:22 +0000 (0:00:01.138) 0:10:56.058 ********* 2026-04-28 05:26:23.969866 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:26:23.969876 | orchestrator | 2026-04-28 05:26:23.969886 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-28 05:26:23.969896 | orchestrator | Tuesday 28 April 2026 05:26:23 +0000 (0:00:01.151) 0:10:57.210 ********* 2026-04-28 05:26:23.969924 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:26:23.969938 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:26:23.969949 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:26:23.969960 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-12-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 05:26:23.969971 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:26:23.969990 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:26:23.970000 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:26:23.970078 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '16596406', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part16', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part14', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part15', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part1', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:26:25.243257 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:26:25.243406 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:26:25.243449 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:26:25.243458 | orchestrator | 2026-04-28 05:26:25.243466 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-28 05:26:25.243474 | orchestrator | Tuesday 28 April 2026 05:26:25 +0000 (0:00:01.278) 0:10:58.488 ********* 2026-04-28 05:26:25.243482 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:26:25.243489 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:26:25.243510 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:26:25.243523 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-12-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:26:25.243552 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:26:25.243564 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:26:25.243582 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:26:25.243600 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '16596406', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part16', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part14', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part15', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part1', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:26:25.243620 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:27:00.237774 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:27:00.237922 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:00.237942 | orchestrator | 2026-04-28 05:27:00.237955 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-28 05:27:00.237966 | orchestrator | Tuesday 28 April 2026 05:26:26 +0000 (0:00:01.241) 0:10:59.729 ********* 2026-04-28 05:27:00.237976 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:27:00.237987 | orchestrator | 2026-04-28 05:27:00.237998 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-28 05:27:00.238007 | orchestrator | Tuesday 28 April 2026 05:26:27 +0000 (0:00:01.504) 0:11:01.234 ********* 2026-04-28 05:27:00.238080 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:27:00.238091 | orchestrator | 2026-04-28 05:27:00.238102 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 05:27:00.238112 | orchestrator | Tuesday 28 April 2026 05:26:28 +0000 (0:00:01.137) 0:11:02.372 ********* 2026-04-28 05:27:00.238123 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:27:00.238134 | orchestrator | 2026-04-28 05:27:00.238145 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 05:27:00.238156 | orchestrator | Tuesday 28 April 2026 05:26:30 +0000 (0:00:01.517) 0:11:03.889 ********* 2026-04-28 05:27:00.238168 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:00.238179 | orchestrator | 2026-04-28 05:27:00.238190 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 05:27:00.238201 | orchestrator | Tuesday 28 April 2026 05:26:31 +0000 (0:00:01.146) 0:11:05.035 ********* 2026-04-28 05:27:00.238212 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:00.238223 | orchestrator | 2026-04-28 05:27:00.238234 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 05:27:00.238246 | orchestrator | Tuesday 28 April 2026 05:26:32 +0000 (0:00:01.219) 0:11:06.255 ********* 2026-04-28 05:27:00.238257 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:00.238267 | orchestrator | 2026-04-28 05:27:00.238279 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-28 05:27:00.238289 | orchestrator | Tuesday 28 April 2026 05:26:34 +0000 (0:00:01.148) 0:11:07.404 ********* 2026-04-28 05:27:00.238300 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-0) 2026-04-28 05:27:00.238312 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-28 05:27:00.238346 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-2) 2026-04-28 05:27:00.238358 | orchestrator | 2026-04-28 05:27:00.238369 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-28 05:27:00.238380 | orchestrator | Tuesday 28 April 2026 05:26:35 +0000 (0:00:01.742) 0:11:09.147 ********* 2026-04-28 05:27:00.238392 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-28 05:27:00.238420 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-28 05:27:00.238430 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-28 05:27:00.238437 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:00.238444 | orchestrator | 2026-04-28 05:27:00.238450 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-28 05:27:00.238457 | orchestrator | Tuesday 28 April 2026 05:26:36 +0000 (0:00:01.168) 0:11:10.315 ********* 2026-04-28 05:27:00.238464 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:00.238470 | orchestrator | 2026-04-28 05:27:00.238477 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-28 05:27:00.238483 | orchestrator | Tuesday 28 April 2026 05:26:38 +0000 (0:00:01.113) 0:11:11.429 ********* 2026-04-28 05:27:00.238500 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:27:00.238507 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-28 05:27:00.238514 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:27:00.238520 | orchestrator | ok: [testbed-node-1 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 05:27:00.238527 | orchestrator | ok: [testbed-node-1 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 05:27:00.238533 | orchestrator | ok: [testbed-node-1 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 05:27:00.238540 | orchestrator | ok: [testbed-node-1 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 05:27:00.238546 | orchestrator | 2026-04-28 05:27:00.238553 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-28 05:27:00.238559 | orchestrator | Tuesday 28 April 2026 05:26:39 +0000 (0:00:01.837) 0:11:13.266 ********* 2026-04-28 05:27:00.238588 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:27:00.238595 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-28 05:27:00.238602 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:27:00.238616 | orchestrator | ok: [testbed-node-1 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 05:27:00.238647 | orchestrator | ok: [testbed-node-1 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 05:27:00.238663 | orchestrator | ok: [testbed-node-1 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 05:27:00.238670 | orchestrator | ok: [testbed-node-1 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 05:27:00.238676 | orchestrator | 2026-04-28 05:27:00.238682 | orchestrator | TASK [Get ceph cluster status] ************************************************* 2026-04-28 05:27:00.238689 | orchestrator | Tuesday 28 April 2026 05:26:42 +0000 (0:00:02.216) 0:11:15.483 ********* 2026-04-28 05:27:00.238696 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:00.238702 | orchestrator | 2026-04-28 05:27:00.238709 | orchestrator | TASK [Display ceph health detail] ********************************************** 2026-04-28 05:27:00.238715 | orchestrator | Tuesday 28 April 2026 05:26:42 +0000 (0:00:00.863) 0:11:16.347 ********* 2026-04-28 05:27:00.238722 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:00.238728 | orchestrator | 2026-04-28 05:27:00.238734 | orchestrator | TASK [Fail if cluster isn't in an acceptable state] **************************** 2026-04-28 05:27:00.238742 | orchestrator | Tuesday 28 April 2026 05:26:43 +0000 (0:00:00.921) 0:11:17.268 ********* 2026-04-28 05:27:00.238748 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:00.238755 | orchestrator | 2026-04-28 05:27:00.238761 | orchestrator | TASK [Get the ceph quorum status] ********************************************** 2026-04-28 05:27:00.238768 | orchestrator | Tuesday 28 April 2026 05:26:44 +0000 (0:00:00.796) 0:11:18.065 ********* 2026-04-28 05:27:00.238774 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:00.238781 | orchestrator | 2026-04-28 05:27:00.238787 | orchestrator | TASK [Fail if the cluster quorum isn't in an acceptable state] ***************** 2026-04-28 05:27:00.238793 | orchestrator | Tuesday 28 April 2026 05:26:45 +0000 (0:00:00.864) 0:11:18.929 ********* 2026-04-28 05:27:00.238800 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:00.238806 | orchestrator | 2026-04-28 05:27:00.238813 | orchestrator | TASK [Ensure /var/lib/ceph/bootstrap-rbd-mirror is present] ******************** 2026-04-28 05:27:00.238819 | orchestrator | Tuesday 28 April 2026 05:26:46 +0000 (0:00:00.787) 0:11:19.717 ********* 2026-04-28 05:27:00.238825 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-28 05:27:00.238831 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-28 05:27:00.238837 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-28 05:27:00.238843 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:00.238849 | orchestrator | 2026-04-28 05:27:00.238861 | orchestrator | TASK [Create potentially missing keys (rbd and rbd-mirror)] ******************** 2026-04-28 05:27:00.238867 | orchestrator | Tuesday 28 April 2026 05:26:47 +0000 (0:00:01.050) 0:11:20.768 ********* 2026-04-28 05:27:00.238873 | orchestrator | skipping: [testbed-node-1] => (item=['bootstrap-rbd', 'testbed-node-0'])  2026-04-28 05:27:00.238879 | orchestrator | skipping: [testbed-node-1] => (item=['bootstrap-rbd', 'testbed-node-1'])  2026-04-28 05:27:00.238885 | orchestrator | skipping: [testbed-node-1] => (item=['bootstrap-rbd', 'testbed-node-2'])  2026-04-28 05:27:00.238891 | orchestrator | skipping: [testbed-node-1] => (item=['bootstrap-rbd-mirror', 'testbed-node-0'])  2026-04-28 05:27:00.238897 | orchestrator | skipping: [testbed-node-1] => (item=['bootstrap-rbd-mirror', 'testbed-node-1'])  2026-04-28 05:27:00.238903 | orchestrator | skipping: [testbed-node-1] => (item=['bootstrap-rbd-mirror', 'testbed-node-2'])  2026-04-28 05:27:00.238909 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:00.238915 | orchestrator | 2026-04-28 05:27:00.238921 | orchestrator | TASK [Stop ceph mon] *********************************************************** 2026-04-28 05:27:00.238931 | orchestrator | Tuesday 28 April 2026 05:26:48 +0000 (0:00:01.316) 0:11:22.084 ********* 2026-04-28 05:27:00.238937 | orchestrator | changed: [testbed-node-1] => (item=testbed-node-1) 2026-04-28 05:27:00.238943 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-28 05:27:00.238949 | orchestrator | 2026-04-28 05:27:00.238955 | orchestrator | TASK [Mask the mgr service] **************************************************** 2026-04-28 05:27:00.238961 | orchestrator | Tuesday 28 April 2026 05:26:51 +0000 (0:00:03.266) 0:11:25.351 ********* 2026-04-28 05:27:00.238968 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:27:00.238974 | orchestrator | 2026-04-28 05:27:00.238980 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 05:27:00.238986 | orchestrator | Tuesday 28 April 2026 05:26:54 +0000 (0:00:02.139) 0:11:27.491 ********* 2026-04-28 05:27:00.238992 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-1 2026-04-28 05:27:00.238999 | orchestrator | 2026-04-28 05:27:00.239005 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 05:27:00.239011 | orchestrator | Tuesday 28 April 2026 05:26:55 +0000 (0:00:01.118) 0:11:28.610 ********* 2026-04-28 05:27:00.239017 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-1 2026-04-28 05:27:00.239023 | orchestrator | 2026-04-28 05:27:00.239029 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 05:27:00.239035 | orchestrator | Tuesday 28 April 2026 05:26:56 +0000 (0:00:01.152) 0:11:29.763 ********* 2026-04-28 05:27:00.239041 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:27:00.239047 | orchestrator | 2026-04-28 05:27:00.239053 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 05:27:00.239059 | orchestrator | Tuesday 28 April 2026 05:26:58 +0000 (0:00:01.628) 0:11:31.392 ********* 2026-04-28 05:27:00.239065 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:00.239071 | orchestrator | 2026-04-28 05:27:00.239077 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 05:27:00.239083 | orchestrator | Tuesday 28 April 2026 05:26:59 +0000 (0:00:01.109) 0:11:32.501 ********* 2026-04-28 05:27:00.239089 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:00.239095 | orchestrator | 2026-04-28 05:27:00.239101 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 05:27:00.239111 | orchestrator | Tuesday 28 April 2026 05:27:00 +0000 (0:00:01.107) 0:11:33.608 ********* 2026-04-28 05:27:42.009662 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.009754 | orchestrator | 2026-04-28 05:27:42.009763 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 05:27:42.009771 | orchestrator | Tuesday 28 April 2026 05:27:01 +0000 (0:00:01.130) 0:11:34.739 ********* 2026-04-28 05:27:42.009777 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:27:42.009801 | orchestrator | 2026-04-28 05:27:42.009808 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 05:27:42.009813 | orchestrator | Tuesday 28 April 2026 05:27:02 +0000 (0:00:01.500) 0:11:36.239 ********* 2026-04-28 05:27:42.009819 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.009828 | orchestrator | 2026-04-28 05:27:42.009838 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 05:27:42.009849 | orchestrator | Tuesday 28 April 2026 05:27:04 +0000 (0:00:01.154) 0:11:37.394 ********* 2026-04-28 05:27:42.009858 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.009872 | orchestrator | 2026-04-28 05:27:42.009885 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 05:27:42.009894 | orchestrator | Tuesday 28 April 2026 05:27:05 +0000 (0:00:01.210) 0:11:38.604 ********* 2026-04-28 05:27:42.009904 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:27:42.009914 | orchestrator | 2026-04-28 05:27:42.009923 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 05:27:42.009933 | orchestrator | Tuesday 28 April 2026 05:27:06 +0000 (0:00:01.543) 0:11:40.148 ********* 2026-04-28 05:27:42.009942 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:27:42.009952 | orchestrator | 2026-04-28 05:27:42.009962 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 05:27:42.009971 | orchestrator | Tuesday 28 April 2026 05:27:08 +0000 (0:00:01.535) 0:11:41.683 ********* 2026-04-28 05:27:42.009981 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.009992 | orchestrator | 2026-04-28 05:27:42.010002 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 05:27:42.010012 | orchestrator | Tuesday 28 April 2026 05:27:09 +0000 (0:00:00.764) 0:11:42.448 ********* 2026-04-28 05:27:42.010075 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:27:42.010082 | orchestrator | 2026-04-28 05:27:42.010088 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 05:27:42.010094 | orchestrator | Tuesday 28 April 2026 05:27:09 +0000 (0:00:00.779) 0:11:43.227 ********* 2026-04-28 05:27:42.010099 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010105 | orchestrator | 2026-04-28 05:27:42.010111 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 05:27:42.010117 | orchestrator | Tuesday 28 April 2026 05:27:10 +0000 (0:00:00.807) 0:11:44.035 ********* 2026-04-28 05:27:42.010123 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010128 | orchestrator | 2026-04-28 05:27:42.010134 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 05:27:42.010140 | orchestrator | Tuesday 28 April 2026 05:27:11 +0000 (0:00:00.775) 0:11:44.810 ********* 2026-04-28 05:27:42.010146 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010151 | orchestrator | 2026-04-28 05:27:42.010157 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 05:27:42.010163 | orchestrator | Tuesday 28 April 2026 05:27:12 +0000 (0:00:00.785) 0:11:45.596 ********* 2026-04-28 05:27:42.010169 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010174 | orchestrator | 2026-04-28 05:27:42.010180 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 05:27:42.010186 | orchestrator | Tuesday 28 April 2026 05:27:12 +0000 (0:00:00.765) 0:11:46.362 ********* 2026-04-28 05:27:42.010203 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010209 | orchestrator | 2026-04-28 05:27:42.010215 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 05:27:42.010221 | orchestrator | Tuesday 28 April 2026 05:27:13 +0000 (0:00:00.764) 0:11:47.127 ********* 2026-04-28 05:27:42.010227 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:27:42.010234 | orchestrator | 2026-04-28 05:27:42.010241 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 05:27:42.010247 | orchestrator | Tuesday 28 April 2026 05:27:14 +0000 (0:00:00.772) 0:11:47.899 ********* 2026-04-28 05:27:42.010254 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:27:42.010260 | orchestrator | 2026-04-28 05:27:42.010274 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 05:27:42.010281 | orchestrator | Tuesday 28 April 2026 05:27:15 +0000 (0:00:00.853) 0:11:48.752 ********* 2026-04-28 05:27:42.010287 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:27:42.010294 | orchestrator | 2026-04-28 05:27:42.010300 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-28 05:27:42.010307 | orchestrator | Tuesday 28 April 2026 05:27:16 +0000 (0:00:00.779) 0:11:49.532 ********* 2026-04-28 05:27:42.010314 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010320 | orchestrator | 2026-04-28 05:27:42.010326 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-28 05:27:42.010333 | orchestrator | Tuesday 28 April 2026 05:27:16 +0000 (0:00:00.763) 0:11:50.296 ********* 2026-04-28 05:27:42.010340 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010346 | orchestrator | 2026-04-28 05:27:42.010353 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-28 05:27:42.010381 | orchestrator | Tuesday 28 April 2026 05:27:17 +0000 (0:00:00.804) 0:11:51.100 ********* 2026-04-28 05:27:42.010388 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010394 | orchestrator | 2026-04-28 05:27:42.010400 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-28 05:27:42.010407 | orchestrator | Tuesday 28 April 2026 05:27:18 +0000 (0:00:00.781) 0:11:51.881 ********* 2026-04-28 05:27:42.010413 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010420 | orchestrator | 2026-04-28 05:27:42.010427 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-28 05:27:42.010433 | orchestrator | Tuesday 28 April 2026 05:27:19 +0000 (0:00:00.793) 0:11:52.675 ********* 2026-04-28 05:27:42.010440 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010446 | orchestrator | 2026-04-28 05:27:42.010467 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-28 05:27:42.010474 | orchestrator | Tuesday 28 April 2026 05:27:20 +0000 (0:00:00.772) 0:11:53.448 ********* 2026-04-28 05:27:42.010481 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010487 | orchestrator | 2026-04-28 05:27:42.010494 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-28 05:27:42.010500 | orchestrator | Tuesday 28 April 2026 05:27:20 +0000 (0:00:00.798) 0:11:54.246 ********* 2026-04-28 05:27:42.010507 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010513 | orchestrator | 2026-04-28 05:27:42.010520 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-28 05:27:42.010527 | orchestrator | Tuesday 28 April 2026 05:27:21 +0000 (0:00:00.818) 0:11:55.064 ********* 2026-04-28 05:27:42.010534 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010540 | orchestrator | 2026-04-28 05:27:42.010547 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-28 05:27:42.010553 | orchestrator | Tuesday 28 April 2026 05:27:22 +0000 (0:00:00.779) 0:11:55.844 ********* 2026-04-28 05:27:42.010560 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010566 | orchestrator | 2026-04-28 05:27:42.010573 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-28 05:27:42.010579 | orchestrator | Tuesday 28 April 2026 05:27:23 +0000 (0:00:00.781) 0:11:56.626 ********* 2026-04-28 05:27:42.010586 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010593 | orchestrator | 2026-04-28 05:27:42.010600 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-28 05:27:42.010606 | orchestrator | Tuesday 28 April 2026 05:27:24 +0000 (0:00:00.835) 0:11:57.461 ********* 2026-04-28 05:27:42.010613 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010618 | orchestrator | 2026-04-28 05:27:42.010624 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-28 05:27:42.010630 | orchestrator | Tuesday 28 April 2026 05:27:24 +0000 (0:00:00.798) 0:11:58.259 ********* 2026-04-28 05:27:42.010635 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010649 | orchestrator | 2026-04-28 05:27:42.010655 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-28 05:27:42.010661 | orchestrator | Tuesday 28 April 2026 05:27:25 +0000 (0:00:00.869) 0:11:59.128 ********* 2026-04-28 05:27:42.010666 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:27:42.010672 | orchestrator | 2026-04-28 05:27:42.010678 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-28 05:27:42.010684 | orchestrator | Tuesday 28 April 2026 05:27:27 +0000 (0:00:01.635) 0:12:00.764 ********* 2026-04-28 05:27:42.010689 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:27:42.010695 | orchestrator | 2026-04-28 05:27:42.010701 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-28 05:27:42.010706 | orchestrator | Tuesday 28 April 2026 05:27:29 +0000 (0:00:02.138) 0:12:02.902 ********* 2026-04-28 05:27:42.010712 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-1 2026-04-28 05:27:42.010719 | orchestrator | 2026-04-28 05:27:42.010725 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-28 05:27:42.010730 | orchestrator | Tuesday 28 April 2026 05:27:30 +0000 (0:00:01.121) 0:12:04.024 ********* 2026-04-28 05:27:42.010736 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010742 | orchestrator | 2026-04-28 05:27:42.010747 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-28 05:27:42.010753 | orchestrator | Tuesday 28 April 2026 05:27:31 +0000 (0:00:01.133) 0:12:05.158 ********* 2026-04-28 05:27:42.010759 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010764 | orchestrator | 2026-04-28 05:27:42.010774 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-28 05:27:42.010780 | orchestrator | Tuesday 28 April 2026 05:27:32 +0000 (0:00:01.139) 0:12:06.298 ********* 2026-04-28 05:27:42.010785 | orchestrator | ok: [testbed-node-1] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-28 05:27:42.010791 | orchestrator | ok: [testbed-node-1] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-28 05:27:42.010797 | orchestrator | 2026-04-28 05:27:42.010803 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-28 05:27:42.010808 | orchestrator | Tuesday 28 April 2026 05:27:34 +0000 (0:00:01.895) 0:12:08.193 ********* 2026-04-28 05:27:42.010814 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:27:42.010820 | orchestrator | 2026-04-28 05:27:42.010825 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-28 05:27:42.010831 | orchestrator | Tuesday 28 April 2026 05:27:36 +0000 (0:00:01.435) 0:12:09.628 ********* 2026-04-28 05:27:42.010837 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010842 | orchestrator | 2026-04-28 05:27:42.010848 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-28 05:27:42.010854 | orchestrator | Tuesday 28 April 2026 05:27:37 +0000 (0:00:01.183) 0:12:10.811 ********* 2026-04-28 05:27:42.010859 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010865 | orchestrator | 2026-04-28 05:27:42.010871 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-28 05:27:42.010877 | orchestrator | Tuesday 28 April 2026 05:27:38 +0000 (0:00:00.793) 0:12:11.605 ********* 2026-04-28 05:27:42.010882 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:27:42.010888 | orchestrator | 2026-04-28 05:27:42.010894 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-28 05:27:42.010899 | orchestrator | Tuesday 28 April 2026 05:27:38 +0000 (0:00:00.754) 0:12:12.360 ********* 2026-04-28 05:27:42.010905 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-1 2026-04-28 05:27:42.010911 | orchestrator | 2026-04-28 05:27:42.010916 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-28 05:27:42.010922 | orchestrator | Tuesday 28 April 2026 05:27:40 +0000 (0:00:01.273) 0:12:13.633 ********* 2026-04-28 05:27:42.010928 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:27:42.010938 | orchestrator | 2026-04-28 05:27:42.010944 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-28 05:27:42.010954 | orchestrator | Tuesday 28 April 2026 05:27:41 +0000 (0:00:01.747) 0:12:15.381 ********* 2026-04-28 05:28:21.877060 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-28 05:28:21.877173 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-28 05:28:21.877192 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-28 05:28:21.877204 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.877217 | orchestrator | 2026-04-28 05:28:21.877229 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-28 05:28:21.877241 | orchestrator | Tuesday 28 April 2026 05:27:43 +0000 (0:00:01.147) 0:12:16.528 ********* 2026-04-28 05:28:21.877252 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.877263 | orchestrator | 2026-04-28 05:28:21.877289 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-28 05:28:21.877310 | orchestrator | Tuesday 28 April 2026 05:27:44 +0000 (0:00:01.129) 0:12:17.658 ********* 2026-04-28 05:28:21.877322 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.877333 | orchestrator | 2026-04-28 05:28:21.877344 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-28 05:28:21.877355 | orchestrator | Tuesday 28 April 2026 05:27:45 +0000 (0:00:01.181) 0:12:18.840 ********* 2026-04-28 05:28:21.877366 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.877377 | orchestrator | 2026-04-28 05:28:21.877388 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-28 05:28:21.877454 | orchestrator | Tuesday 28 April 2026 05:27:46 +0000 (0:00:01.130) 0:12:19.971 ********* 2026-04-28 05:28:21.877466 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.877478 | orchestrator | 2026-04-28 05:28:21.877490 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-28 05:28:21.877502 | orchestrator | Tuesday 28 April 2026 05:27:47 +0000 (0:00:01.153) 0:12:21.124 ********* 2026-04-28 05:28:21.877514 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.877526 | orchestrator | 2026-04-28 05:28:21.877539 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-28 05:28:21.877551 | orchestrator | Tuesday 28 April 2026 05:27:48 +0000 (0:00:00.777) 0:12:21.902 ********* 2026-04-28 05:28:21.877563 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:28:21.877577 | orchestrator | 2026-04-28 05:28:21.877589 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-28 05:28:21.877602 | orchestrator | Tuesday 28 April 2026 05:27:50 +0000 (0:00:02.247) 0:12:24.150 ********* 2026-04-28 05:28:21.877614 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:28:21.877626 | orchestrator | 2026-04-28 05:28:21.877637 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-28 05:28:21.877649 | orchestrator | Tuesday 28 April 2026 05:27:51 +0000 (0:00:00.782) 0:12:24.932 ********* 2026-04-28 05:28:21.877661 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-1 2026-04-28 05:28:21.877673 | orchestrator | 2026-04-28 05:28:21.877685 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-28 05:28:21.877696 | orchestrator | Tuesday 28 April 2026 05:27:52 +0000 (0:00:01.121) 0:12:26.053 ********* 2026-04-28 05:28:21.877707 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.877718 | orchestrator | 2026-04-28 05:28:21.877730 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-28 05:28:21.877741 | orchestrator | Tuesday 28 April 2026 05:27:53 +0000 (0:00:01.122) 0:12:27.176 ********* 2026-04-28 05:28:21.877769 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.877781 | orchestrator | 2026-04-28 05:28:21.877792 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-28 05:28:21.877803 | orchestrator | Tuesday 28 April 2026 05:27:54 +0000 (0:00:01.133) 0:12:28.310 ********* 2026-04-28 05:28:21.877839 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.877851 | orchestrator | 2026-04-28 05:28:21.877863 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-28 05:28:21.877874 | orchestrator | Tuesday 28 April 2026 05:27:56 +0000 (0:00:01.138) 0:12:29.448 ********* 2026-04-28 05:28:21.877885 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.877897 | orchestrator | 2026-04-28 05:28:21.877908 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-28 05:28:21.877919 | orchestrator | Tuesday 28 April 2026 05:27:57 +0000 (0:00:01.214) 0:12:30.663 ********* 2026-04-28 05:28:21.877930 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.877942 | orchestrator | 2026-04-28 05:28:21.877953 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-28 05:28:21.877964 | orchestrator | Tuesday 28 April 2026 05:27:58 +0000 (0:00:01.156) 0:12:31.820 ********* 2026-04-28 05:28:21.877975 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.877986 | orchestrator | 2026-04-28 05:28:21.877997 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-28 05:28:21.878008 | orchestrator | Tuesday 28 April 2026 05:27:59 +0000 (0:00:01.131) 0:12:32.951 ********* 2026-04-28 05:28:21.878060 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.878074 | orchestrator | 2026-04-28 05:28:21.878085 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-28 05:28:21.878096 | orchestrator | Tuesday 28 April 2026 05:28:00 +0000 (0:00:01.161) 0:12:34.113 ********* 2026-04-28 05:28:21.878107 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.878118 | orchestrator | 2026-04-28 05:28:21.878156 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-28 05:28:21.878168 | orchestrator | Tuesday 28 April 2026 05:28:01 +0000 (0:00:01.137) 0:12:35.250 ********* 2026-04-28 05:28:21.878179 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:28:21.878190 | orchestrator | 2026-04-28 05:28:21.878202 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-28 05:28:21.878214 | orchestrator | Tuesday 28 April 2026 05:28:02 +0000 (0:00:00.799) 0:12:36.050 ********* 2026-04-28 05:28:21.878225 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-1 2026-04-28 05:28:21.878237 | orchestrator | 2026-04-28 05:28:21.878249 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-28 05:28:21.878278 | orchestrator | Tuesday 28 April 2026 05:28:03 +0000 (0:00:01.100) 0:12:37.150 ********* 2026-04-28 05:28:21.878291 | orchestrator | ok: [testbed-node-1] => (item=/etc/ceph) 2026-04-28 05:28:21.878303 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/) 2026-04-28 05:28:21.878314 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/mon) 2026-04-28 05:28:21.878325 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/osd) 2026-04-28 05:28:21.878336 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/mds) 2026-04-28 05:28:21.878348 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/tmp) 2026-04-28 05:28:21.878359 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/crash) 2026-04-28 05:28:21.878371 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/radosgw) 2026-04-28 05:28:21.878383 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-28 05:28:21.878411 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-28 05:28:21.878423 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-28 05:28:21.878434 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-28 05:28:21.878445 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-28 05:28:21.878457 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-28 05:28:21.878468 | orchestrator | ok: [testbed-node-1] => (item=/var/run/ceph) 2026-04-28 05:28:21.878478 | orchestrator | ok: [testbed-node-1] => (item=/var/log/ceph) 2026-04-28 05:28:21.878499 | orchestrator | 2026-04-28 05:28:21.878511 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-28 05:28:21.878523 | orchestrator | Tuesday 28 April 2026 05:28:10 +0000 (0:00:06.427) 0:12:43.578 ********* 2026-04-28 05:28:21.878534 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.878545 | orchestrator | 2026-04-28 05:28:21.878557 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-28 05:28:21.878568 | orchestrator | Tuesday 28 April 2026 05:28:10 +0000 (0:00:00.790) 0:12:44.368 ********* 2026-04-28 05:28:21.878579 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.878590 | orchestrator | 2026-04-28 05:28:21.878601 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-28 05:28:21.878612 | orchestrator | Tuesday 28 April 2026 05:28:11 +0000 (0:00:00.785) 0:12:45.154 ********* 2026-04-28 05:28:21.878624 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.878635 | orchestrator | 2026-04-28 05:28:21.878646 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-28 05:28:21.878657 | orchestrator | Tuesday 28 April 2026 05:28:12 +0000 (0:00:00.803) 0:12:45.958 ********* 2026-04-28 05:28:21.878668 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.878679 | orchestrator | 2026-04-28 05:28:21.878690 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-28 05:28:21.878701 | orchestrator | Tuesday 28 April 2026 05:28:13 +0000 (0:00:00.760) 0:12:46.718 ********* 2026-04-28 05:28:21.878712 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.878724 | orchestrator | 2026-04-28 05:28:21.878735 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-28 05:28:21.878746 | orchestrator | Tuesday 28 April 2026 05:28:14 +0000 (0:00:00.810) 0:12:47.529 ********* 2026-04-28 05:28:21.878757 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.878768 | orchestrator | 2026-04-28 05:28:21.878785 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-28 05:28:21.878797 | orchestrator | Tuesday 28 April 2026 05:28:14 +0000 (0:00:00.843) 0:12:48.372 ********* 2026-04-28 05:28:21.878808 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.878819 | orchestrator | 2026-04-28 05:28:21.878831 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-28 05:28:21.878842 | orchestrator | Tuesday 28 April 2026 05:28:15 +0000 (0:00:00.792) 0:12:49.165 ********* 2026-04-28 05:28:21.878854 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.878865 | orchestrator | 2026-04-28 05:28:21.878875 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-28 05:28:21.878886 | orchestrator | Tuesday 28 April 2026 05:28:16 +0000 (0:00:00.793) 0:12:49.958 ********* 2026-04-28 05:28:21.878897 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.878908 | orchestrator | 2026-04-28 05:28:21.878919 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-28 05:28:21.878931 | orchestrator | Tuesday 28 April 2026 05:28:17 +0000 (0:00:00.783) 0:12:50.742 ********* 2026-04-28 05:28:21.878942 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.878953 | orchestrator | 2026-04-28 05:28:21.878964 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-28 05:28:21.878975 | orchestrator | Tuesday 28 April 2026 05:28:18 +0000 (0:00:00.775) 0:12:51.517 ********* 2026-04-28 05:28:21.878986 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.878998 | orchestrator | 2026-04-28 05:28:21.879009 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-28 05:28:21.879020 | orchestrator | Tuesday 28 April 2026 05:28:18 +0000 (0:00:00.768) 0:12:52.286 ********* 2026-04-28 05:28:21.879031 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.879042 | orchestrator | 2026-04-28 05:28:21.879053 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-28 05:28:21.879065 | orchestrator | Tuesday 28 April 2026 05:28:19 +0000 (0:00:00.748) 0:12:53.035 ********* 2026-04-28 05:28:21.879083 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.879095 | orchestrator | 2026-04-28 05:28:21.879106 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-28 05:28:21.879118 | orchestrator | Tuesday 28 April 2026 05:28:21 +0000 (0:00:01.410) 0:12:54.446 ********* 2026-04-28 05:28:21.879129 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:28:21.879140 | orchestrator | 2026-04-28 05:28:21.879151 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-28 05:28:21.879170 | orchestrator | Tuesday 28 April 2026 05:28:21 +0000 (0:00:00.799) 0:12:55.245 ********* 2026-04-28 05:29:09.309712 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:29:09.309825 | orchestrator | 2026-04-28 05:29:09.309842 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-28 05:29:09.309856 | orchestrator | Tuesday 28 April 2026 05:28:22 +0000 (0:00:00.892) 0:12:56.138 ********* 2026-04-28 05:29:09.309867 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:29:09.309878 | orchestrator | 2026-04-28 05:29:09.309890 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-28 05:29:09.309900 | orchestrator | Tuesday 28 April 2026 05:28:23 +0000 (0:00:00.791) 0:12:56.930 ********* 2026-04-28 05:29:09.309911 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:29:09.309922 | orchestrator | 2026-04-28 05:29:09.309934 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 05:29:09.309946 | orchestrator | Tuesday 28 April 2026 05:28:24 +0000 (0:00:00.782) 0:12:57.712 ********* 2026-04-28 05:29:09.309957 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:29:09.309967 | orchestrator | 2026-04-28 05:29:09.309979 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 05:29:09.309989 | orchestrator | Tuesday 28 April 2026 05:28:25 +0000 (0:00:00.799) 0:12:58.512 ********* 2026-04-28 05:29:09.310000 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:29:09.310011 | orchestrator | 2026-04-28 05:29:09.310082 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 05:29:09.310094 | orchestrator | Tuesday 28 April 2026 05:28:25 +0000 (0:00:00.802) 0:12:59.314 ********* 2026-04-28 05:29:09.310105 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:29:09.310115 | orchestrator | 2026-04-28 05:29:09.310126 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 05:29:09.310136 | orchestrator | Tuesday 28 April 2026 05:28:26 +0000 (0:00:00.778) 0:13:00.092 ********* 2026-04-28 05:29:09.310147 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:29:09.310158 | orchestrator | 2026-04-28 05:29:09.310169 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 05:29:09.310179 | orchestrator | Tuesday 28 April 2026 05:28:27 +0000 (0:00:00.759) 0:13:00.852 ********* 2026-04-28 05:29:09.310190 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-28 05:29:09.310202 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-28 05:29:09.310213 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-28 05:29:09.310224 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:29:09.310234 | orchestrator | 2026-04-28 05:29:09.310245 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 05:29:09.310258 | orchestrator | Tuesday 28 April 2026 05:28:28 +0000 (0:00:01.055) 0:13:01.907 ********* 2026-04-28 05:29:09.310270 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-28 05:29:09.310282 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-28 05:29:09.310295 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-28 05:29:09.310307 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:29:09.310320 | orchestrator | 2026-04-28 05:29:09.310332 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 05:29:09.310344 | orchestrator | Tuesday 28 April 2026 05:28:29 +0000 (0:00:01.092) 0:13:02.999 ********* 2026-04-28 05:29:09.310395 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-28 05:29:09.310409 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-28 05:29:09.310421 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-28 05:29:09.310460 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:29:09.310474 | orchestrator | 2026-04-28 05:29:09.310486 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 05:29:09.310499 | orchestrator | Tuesday 28 April 2026 05:28:30 +0000 (0:00:01.096) 0:13:04.096 ********* 2026-04-28 05:29:09.310512 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:29:09.310524 | orchestrator | 2026-04-28 05:29:09.310536 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 05:29:09.310547 | orchestrator | Tuesday 28 April 2026 05:28:31 +0000 (0:00:00.801) 0:13:04.897 ********* 2026-04-28 05:29:09.310561 | orchestrator | skipping: [testbed-node-1] => (item=0)  2026-04-28 05:29:09.310574 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:29:09.310586 | orchestrator | 2026-04-28 05:29:09.310599 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-28 05:29:09.310611 | orchestrator | Tuesday 28 April 2026 05:28:32 +0000 (0:00:00.914) 0:13:05.811 ********* 2026-04-28 05:29:09.310621 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:29:09.310632 | orchestrator | 2026-04-28 05:29:09.310643 | orchestrator | TASK [ceph-mon : Set_fact container_exec_cmd] ********************************** 2026-04-28 05:29:09.310653 | orchestrator | Tuesday 28 April 2026 05:28:34 +0000 (0:00:01.934) 0:13:07.746 ********* 2026-04-28 05:29:09.310664 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:29:09.310674 | orchestrator | 2026-04-28 05:29:09.310685 | orchestrator | TASK [ceph-mon : Include deploy_monitors.yml] ********************************** 2026-04-28 05:29:09.310695 | orchestrator | Tuesday 28 April 2026 05:28:35 +0000 (0:00:00.810) 0:13:08.556 ********* 2026-04-28 05:29:09.310706 | orchestrator | included: /ansible/roles/ceph-mon/tasks/deploy_monitors.yml for testbed-node-1 2026-04-28 05:29:09.310717 | orchestrator | 2026-04-28 05:29:09.310728 | orchestrator | TASK [ceph-mon : Check if monitor initial keyring already exists] ************** 2026-04-28 05:29:09.310738 | orchestrator | Tuesday 28 April 2026 05:28:36 +0000 (0:00:01.166) 0:13:09.723 ********* 2026-04-28 05:29:09.310749 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] 2026-04-28 05:29:09.310760 | orchestrator | 2026-04-28 05:29:09.310770 | orchestrator | TASK [ceph-mon : Generate monitor initial keyring] ***************************** 2026-04-28 05:29:09.310781 | orchestrator | Tuesday 28 April 2026 05:28:39 +0000 (0:00:03.192) 0:13:12.916 ********* 2026-04-28 05:29:09.310791 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:29:09.310802 | orchestrator | 2026-04-28 05:29:09.310812 | orchestrator | TASK [ceph-mon : Set_fact _initial_mon_key_success] **************************** 2026-04-28 05:29:09.310840 | orchestrator | Tuesday 28 April 2026 05:28:40 +0000 (0:00:01.170) 0:13:14.087 ********* 2026-04-28 05:29:09.310852 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:29:09.310863 | orchestrator | 2026-04-28 05:29:09.310873 | orchestrator | TASK [ceph-mon : Get initial keyring when it already exists] ******************* 2026-04-28 05:29:09.310884 | orchestrator | Tuesday 28 April 2026 05:28:41 +0000 (0:00:01.128) 0:13:15.215 ********* 2026-04-28 05:29:09.310894 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:29:09.310905 | orchestrator | 2026-04-28 05:29:09.310915 | orchestrator | TASK [ceph-mon : Create monitor initial keyring] ******************************* 2026-04-28 05:29:09.310926 | orchestrator | Tuesday 28 April 2026 05:28:42 +0000 (0:00:01.142) 0:13:16.358 ********* 2026-04-28 05:29:09.310936 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:29:09.310947 | orchestrator | 2026-04-28 05:29:09.310957 | orchestrator | TASK [ceph-mon : Copy the initial key in /etc/ceph (for containers)] *********** 2026-04-28 05:29:09.310968 | orchestrator | Tuesday 28 April 2026 05:28:44 +0000 (0:00:02.018) 0:13:18.376 ********* 2026-04-28 05:29:09.310978 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:29:09.310989 | orchestrator | 2026-04-28 05:29:09.310999 | orchestrator | TASK [ceph-mon : Create monitor directory] ************************************* 2026-04-28 05:29:09.311019 | orchestrator | Tuesday 28 April 2026 05:28:46 +0000 (0:00:01.617) 0:13:19.994 ********* 2026-04-28 05:29:09.311029 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:29:09.311040 | orchestrator | 2026-04-28 05:29:09.311050 | orchestrator | TASK [ceph-mon : Recursively fix ownership of monitor directory] *************** 2026-04-28 05:29:09.311061 | orchestrator | Tuesday 28 April 2026 05:28:48 +0000 (0:00:01.488) 0:13:21.482 ********* 2026-04-28 05:29:09.311071 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:29:09.311082 | orchestrator | 2026-04-28 05:29:09.311092 | orchestrator | TASK [ceph-mon : Create admin keyring] ***************************************** 2026-04-28 05:29:09.311103 | orchestrator | Tuesday 28 April 2026 05:28:49 +0000 (0:00:01.463) 0:13:22.945 ********* 2026-04-28 05:29:09.311113 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] 2026-04-28 05:29:09.311124 | orchestrator | 2026-04-28 05:29:09.311134 | orchestrator | TASK [ceph-mon : Slurp admin keyring] ****************************************** 2026-04-28 05:29:09.311145 | orchestrator | Tuesday 28 April 2026 05:28:51 +0000 (0:00:01.947) 0:13:24.893 ********* 2026-04-28 05:29:09.311155 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] 2026-04-28 05:29:09.311166 | orchestrator | 2026-04-28 05:29:09.311176 | orchestrator | TASK [ceph-mon : Copy admin keyring over to mons] ****************************** 2026-04-28 05:29:09.311187 | orchestrator | Tuesday 28 April 2026 05:28:53 +0000 (0:00:01.548) 0:13:26.441 ********* 2026-04-28 05:29:09.311197 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 05:29:09.311208 | orchestrator | ok: [testbed-node-1] => (item=None) 2026-04-28 05:29:09.311218 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-28 05:29:09.311229 | orchestrator | ok: [testbed-node-1 -> {{ item }}] 2026-04-28 05:29:09.311239 | orchestrator | 2026-04-28 05:29:09.311250 | orchestrator | TASK [ceph-mon : Import admin keyring into mon keyring] ************************ 2026-04-28 05:29:09.311260 | orchestrator | Tuesday 28 April 2026 05:28:56 +0000 (0:00:03.816) 0:13:30.258 ********* 2026-04-28 05:29:09.311271 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:29:09.311281 | orchestrator | 2026-04-28 05:29:09.311292 | orchestrator | TASK [ceph-mon : Set_fact ceph-mon container command] ************************** 2026-04-28 05:29:09.311307 | orchestrator | Tuesday 28 April 2026 05:28:58 +0000 (0:00:02.014) 0:13:32.273 ********* 2026-04-28 05:29:09.311318 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:29:09.311329 | orchestrator | 2026-04-28 05:29:09.311339 | orchestrator | TASK [ceph-mon : Set_fact monmaptool container command] ************************ 2026-04-28 05:29:09.311350 | orchestrator | Tuesday 28 April 2026 05:29:00 +0000 (0:00:01.186) 0:13:33.459 ********* 2026-04-28 05:29:09.311360 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:29:09.311371 | orchestrator | 2026-04-28 05:29:09.311381 | orchestrator | TASK [ceph-mon : Generate initial monmap] ************************************** 2026-04-28 05:29:09.311391 | orchestrator | Tuesday 28 April 2026 05:29:01 +0000 (0:00:01.165) 0:13:34.625 ********* 2026-04-28 05:29:09.311402 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:29:09.311413 | orchestrator | 2026-04-28 05:29:09.311423 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs with keyring] ******************************* 2026-04-28 05:29:09.311451 | orchestrator | Tuesday 28 April 2026 05:29:03 +0000 (0:00:01.785) 0:13:36.410 ********* 2026-04-28 05:29:09.311462 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:29:09.311473 | orchestrator | 2026-04-28 05:29:09.311483 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs without keyring] **************************** 2026-04-28 05:29:09.311494 | orchestrator | Tuesday 28 April 2026 05:29:04 +0000 (0:00:01.504) 0:13:37.915 ********* 2026-04-28 05:29:09.311505 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:29:09.311515 | orchestrator | 2026-04-28 05:29:09.311526 | orchestrator | TASK [ceph-mon : Include start_monitor.yml] ************************************ 2026-04-28 05:29:09.311536 | orchestrator | Tuesday 28 April 2026 05:29:05 +0000 (0:00:00.794) 0:13:38.710 ********* 2026-04-28 05:29:09.311547 | orchestrator | included: /ansible/roles/ceph-mon/tasks/start_monitor.yml for testbed-node-1 2026-04-28 05:29:09.311564 | orchestrator | 2026-04-28 05:29:09.311574 | orchestrator | TASK [ceph-mon : Ensure systemd service override directory exists] ************* 2026-04-28 05:29:09.311585 | orchestrator | Tuesday 28 April 2026 05:29:06 +0000 (0:00:01.152) 0:13:39.863 ********* 2026-04-28 05:29:09.311595 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:29:09.311606 | orchestrator | 2026-04-28 05:29:09.311616 | orchestrator | TASK [ceph-mon : Add ceph-mon systemd service overrides] *********************** 2026-04-28 05:29:09.311627 | orchestrator | Tuesday 28 April 2026 05:29:07 +0000 (0:00:01.171) 0:13:41.034 ********* 2026-04-28 05:29:09.311637 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:29:09.311647 | orchestrator | 2026-04-28 05:29:09.311658 | orchestrator | TASK [ceph-mon : Include_tasks systemd.yml] ************************************ 2026-04-28 05:29:09.311668 | orchestrator | Tuesday 28 April 2026 05:29:08 +0000 (0:00:01.114) 0:13:42.148 ********* 2026-04-28 05:29:09.311679 | orchestrator | included: /ansible/roles/ceph-mon/tasks/systemd.yml for testbed-node-1 2026-04-28 05:29:09.311689 | orchestrator | 2026-04-28 05:29:09.311708 | orchestrator | TASK [ceph-mon : Generate systemd unit file for mon container] ***************** 2026-04-28 05:30:18.063970 | orchestrator | Tuesday 28 April 2026 05:29:10 +0000 (0:00:01.245) 0:13:43.394 ********* 2026-04-28 05:30:18.064083 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:30:18.064099 | orchestrator | 2026-04-28 05:30:18.064111 | orchestrator | TASK [ceph-mon : Generate systemd ceph-mon target file] ************************ 2026-04-28 05:30:18.064122 | orchestrator | Tuesday 28 April 2026 05:29:12 +0000 (0:00:02.342) 0:13:45.737 ********* 2026-04-28 05:30:18.064133 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:30:18.064144 | orchestrator | 2026-04-28 05:30:18.064155 | orchestrator | TASK [ceph-mon : Enable ceph-mon.target] *************************************** 2026-04-28 05:30:18.064166 | orchestrator | Tuesday 28 April 2026 05:29:14 +0000 (0:00:01.992) 0:13:47.729 ********* 2026-04-28 05:30:18.064176 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:30:18.064187 | orchestrator | 2026-04-28 05:30:18.064198 | orchestrator | TASK [ceph-mon : Start the monitor service] ************************************ 2026-04-28 05:30:18.064208 | orchestrator | Tuesday 28 April 2026 05:29:16 +0000 (0:00:02.437) 0:13:50.167 ********* 2026-04-28 05:30:18.064219 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:30:18.064230 | orchestrator | 2026-04-28 05:30:18.064241 | orchestrator | TASK [ceph-mon : Include_tasks ceph_keys.yml] ********************************** 2026-04-28 05:30:18.064252 | orchestrator | Tuesday 28 April 2026 05:29:19 +0000 (0:00:02.950) 0:13:53.118 ********* 2026-04-28 05:30:18.064262 | orchestrator | included: /ansible/roles/ceph-mon/tasks/ceph_keys.yml for testbed-node-1 2026-04-28 05:30:18.064274 | orchestrator | 2026-04-28 05:30:18.064285 | orchestrator | TASK [ceph-mon : Waiting for the monitor(s) to form the quorum...] ************* 2026-04-28 05:30:18.064295 | orchestrator | Tuesday 28 April 2026 05:29:20 +0000 (0:00:01.205) 0:13:54.324 ********* 2026-04-28 05:30:18.064306 | orchestrator | FAILED - RETRYING: [testbed-node-1]: Waiting for the monitor(s) to form the quorum... (10 retries left). 2026-04-28 05:30:18.064317 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:30:18.064328 | orchestrator | 2026-04-28 05:30:18.064338 | orchestrator | TASK [ceph-mon : Fetch ceph initial keys] ************************************** 2026-04-28 05:30:18.064349 | orchestrator | Tuesday 28 April 2026 05:29:43 +0000 (0:00:22.864) 0:14:17.189 ********* 2026-04-28 05:30:18.064360 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:30:18.064371 | orchestrator | 2026-04-28 05:30:18.064382 | orchestrator | TASK [ceph-mon : Include secure_cluster.yml] *********************************** 2026-04-28 05:30:18.064392 | orchestrator | Tuesday 28 April 2026 05:29:46 +0000 (0:00:02.680) 0:14:19.869 ********* 2026-04-28 05:30:18.064403 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:30:18.064414 | orchestrator | 2026-04-28 05:30:18.064424 | orchestrator | TASK [ceph-mon : Set cluster configs] ****************************************** 2026-04-28 05:30:18.064435 | orchestrator | Tuesday 28 April 2026 05:29:47 +0000 (0:00:00.771) 0:14:20.641 ********* 2026-04-28 05:30:18.064467 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'public_network', 'value': '192.168.16.0/20'}]) 2026-04-28 05:30:18.064521 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'cluster_network', 'value': '192.168.16.0/20'}]) 2026-04-28 05:30:18.064537 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'osd_pool_default_crush_rule', 'value': -1}]) 2026-04-28 05:30:18.064550 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'ms_bind_ipv6', 'value': 'False'}]) 2026-04-28 05:30:18.064564 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'ms_bind_ipv4', 'value': 'True'}]) 2026-04-28 05:30:18.064594 | orchestrator | skipping: [testbed-node-1] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'osd_crush_chooseleaf_type', 'value': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}])  2026-04-28 05:30:18.064608 | orchestrator | 2026-04-28 05:30:18.064621 | orchestrator | TASK [Start ceph mgr] ********************************************************** 2026-04-28 05:30:18.064633 | orchestrator | Tuesday 28 April 2026 05:29:56 +0000 (0:00:09.641) 0:14:30.282 ********* 2026-04-28 05:30:18.064646 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:30:18.064658 | orchestrator | 2026-04-28 05:30:18.064671 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-28 05:30:18.064683 | orchestrator | Tuesday 28 April 2026 05:29:59 +0000 (0:00:02.157) 0:14:32.440 ********* 2026-04-28 05:30:18.064696 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:30:18.064708 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-1) 2026-04-28 05:30:18.064720 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-2) 2026-04-28 05:30:18.064732 | orchestrator | 2026-04-28 05:30:18.064746 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-28 05:30:18.064758 | orchestrator | Tuesday 28 April 2026 05:30:00 +0000 (0:00:01.660) 0:14:34.100 ********* 2026-04-28 05:30:18.064771 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-28 05:30:18.064784 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-28 05:30:18.064797 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-28 05:30:18.064809 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:30:18.064822 | orchestrator | 2026-04-28 05:30:18.064836 | orchestrator | TASK [Non container | waiting for the monitor to join the quorum...] *********** 2026-04-28 05:30:18.064848 | orchestrator | Tuesday 28 April 2026 05:30:01 +0000 (0:00:01.043) 0:14:35.143 ********* 2026-04-28 05:30:18.064867 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:30:18.064878 | orchestrator | 2026-04-28 05:30:18.064888 | orchestrator | TASK [Container | waiting for the containerized monitor to join the quorum...] *** 2026-04-28 05:30:18.064899 | orchestrator | Tuesday 28 April 2026 05:30:02 +0000 (0:00:00.802) 0:14:35.946 ********* 2026-04-28 05:30:18.064909 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:30:18.064920 | orchestrator | 2026-04-28 05:30:18.064931 | orchestrator | PLAY [Upgrade ceph mon cluster] ************************************************ 2026-04-28 05:30:18.064941 | orchestrator | 2026-04-28 05:30:18.064952 | orchestrator | TASK [Remove ceph aliases] ***************************************************** 2026-04-28 05:30:18.064962 | orchestrator | Tuesday 28 April 2026 05:30:04 +0000 (0:00:02.204) 0:14:38.151 ********* 2026-04-28 05:30:18.064973 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:30:18.064984 | orchestrator | 2026-04-28 05:30:18.064994 | orchestrator | TASK [Set mon_host_count] ****************************************************** 2026-04-28 05:30:18.065005 | orchestrator | Tuesday 28 April 2026 05:30:05 +0000 (0:00:01.164) 0:14:39.315 ********* 2026-04-28 05:30:18.065015 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:30:18.065026 | orchestrator | 2026-04-28 05:30:18.065036 | orchestrator | TASK [Fail when less than three monitors] ************************************** 2026-04-28 05:30:18.065047 | orchestrator | Tuesday 28 April 2026 05:30:06 +0000 (0:00:00.808) 0:14:40.123 ********* 2026-04-28 05:30:18.065058 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:30:18.065068 | orchestrator | 2026-04-28 05:30:18.065079 | orchestrator | TASK [Select a running monitor] ************************************************ 2026-04-28 05:30:18.065094 | orchestrator | Tuesday 28 April 2026 05:30:07 +0000 (0:00:00.757) 0:14:40.881 ********* 2026-04-28 05:30:18.065105 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:30:18.065116 | orchestrator | 2026-04-28 05:30:18.065126 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 05:30:18.065137 | orchestrator | Tuesday 28 April 2026 05:30:08 +0000 (0:00:00.781) 0:14:41.662 ********* 2026-04-28 05:30:18.065148 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-2 2026-04-28 05:30:18.065158 | orchestrator | 2026-04-28 05:30:18.065169 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-28 05:30:18.065179 | orchestrator | Tuesday 28 April 2026 05:30:09 +0000 (0:00:01.123) 0:14:42.786 ********* 2026-04-28 05:30:18.065190 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:30:18.065200 | orchestrator | 2026-04-28 05:30:18.065211 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-28 05:30:18.065221 | orchestrator | Tuesday 28 April 2026 05:30:10 +0000 (0:00:01.426) 0:14:44.213 ********* 2026-04-28 05:30:18.065232 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:30:18.065242 | orchestrator | 2026-04-28 05:30:18.065253 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 05:30:18.065263 | orchestrator | Tuesday 28 April 2026 05:30:12 +0000 (0:00:01.172) 0:14:45.385 ********* 2026-04-28 05:30:18.065274 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:30:18.065285 | orchestrator | 2026-04-28 05:30:18.065295 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 05:30:18.065306 | orchestrator | Tuesday 28 April 2026 05:30:13 +0000 (0:00:01.425) 0:14:46.811 ********* 2026-04-28 05:30:18.065316 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:30:18.065327 | orchestrator | 2026-04-28 05:30:18.065342 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-28 05:30:18.065361 | orchestrator | Tuesday 28 April 2026 05:30:14 +0000 (0:00:01.172) 0:14:47.983 ********* 2026-04-28 05:30:18.065386 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:30:18.065411 | orchestrator | 2026-04-28 05:30:18.065430 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-28 05:30:18.065477 | orchestrator | Tuesday 28 April 2026 05:30:15 +0000 (0:00:01.159) 0:14:49.142 ********* 2026-04-28 05:30:18.065497 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:30:18.065516 | orchestrator | 2026-04-28 05:30:18.065536 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-28 05:30:18.065559 | orchestrator | Tuesday 28 April 2026 05:30:16 +0000 (0:00:01.139) 0:14:50.282 ********* 2026-04-28 05:30:18.065570 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:30:18.065580 | orchestrator | 2026-04-28 05:30:18.065591 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-28 05:30:18.065611 | orchestrator | Tuesday 28 April 2026 05:30:18 +0000 (0:00:01.153) 0:14:51.436 ********* 2026-04-28 05:30:43.675599 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:30:43.675719 | orchestrator | 2026-04-28 05:30:43.675735 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-28 05:30:43.675748 | orchestrator | Tuesday 28 April 2026 05:30:19 +0000 (0:00:01.117) 0:14:52.554 ********* 2026-04-28 05:30:43.675759 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:30:43.675771 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:30:43.675782 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-28 05:30:43.675792 | orchestrator | 2026-04-28 05:30:43.675803 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-28 05:30:43.675814 | orchestrator | Tuesday 28 April 2026 05:30:21 +0000 (0:00:02.128) 0:14:54.682 ********* 2026-04-28 05:30:43.675825 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:30:43.675835 | orchestrator | 2026-04-28 05:30:43.675846 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-28 05:30:43.675857 | orchestrator | Tuesday 28 April 2026 05:30:22 +0000 (0:00:01.264) 0:14:55.946 ********* 2026-04-28 05:30:43.675867 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:30:43.675878 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:30:43.675888 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-28 05:30:43.675899 | orchestrator | 2026-04-28 05:30:43.675910 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-28 05:30:43.675920 | orchestrator | Tuesday 28 April 2026 05:30:25 +0000 (0:00:03.284) 0:14:59.231 ********* 2026-04-28 05:30:43.675932 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-28 05:30:43.675943 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-28 05:30:43.675953 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-28 05:30:43.675964 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:30:43.675975 | orchestrator | 2026-04-28 05:30:43.675986 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-28 05:30:43.675997 | orchestrator | Tuesday 28 April 2026 05:30:27 +0000 (0:00:01.813) 0:15:01.044 ********* 2026-04-28 05:30:43.676009 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-28 05:30:43.676023 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-28 05:30:43.676052 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-28 05:30:43.676064 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:30:43.676075 | orchestrator | 2026-04-28 05:30:43.676086 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-28 05:30:43.676097 | orchestrator | Tuesday 28 April 2026 05:30:29 +0000 (0:00:02.126) 0:15:03.171 ********* 2026-04-28 05:30:43.676110 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:30:43.676150 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:30:43.676171 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:30:43.676190 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:30:43.676208 | orchestrator | 2026-04-28 05:30:43.676226 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-28 05:30:43.676246 | orchestrator | Tuesday 28 April 2026 05:30:31 +0000 (0:00:01.260) 0:15:04.432 ********* 2026-04-28 05:30:43.676286 | orchestrator | ok: [testbed-node-2] => (item={'changed': False, 'stdout': 'e79a9ee6c12b', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-28 05:30:23.091968', 'end': '2026-04-28 05:30:23.142577', 'delta': '0:00:00.050609', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e79a9ee6c12b'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-28 05:30:43.676304 | orchestrator | ok: [testbed-node-2] => (item={'changed': False, 'stdout': '00fb93644bb9', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-28 05:30:23.985968', 'end': '2026-04-28 05:30:24.078554', 'delta': '0:00:00.092586', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['00fb93644bb9'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-28 05:30:43.676317 | orchestrator | ok: [testbed-node-2] => (item={'changed': False, 'stdout': 'ba47649d1789', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-28 05:30:24.624886', 'end': '2026-04-28 05:30:24.671564', 'delta': '0:00:00.046678', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['ba47649d1789'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-28 05:30:43.676330 | orchestrator | 2026-04-28 05:30:43.676349 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-28 05:30:43.676362 | orchestrator | Tuesday 28 April 2026 05:30:32 +0000 (0:00:01.182) 0:15:05.614 ********* 2026-04-28 05:30:43.676443 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:30:43.676460 | orchestrator | 2026-04-28 05:30:43.676472 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-28 05:30:43.676485 | orchestrator | Tuesday 28 April 2026 05:30:33 +0000 (0:00:01.249) 0:15:06.863 ********* 2026-04-28 05:30:43.676495 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:30:43.676506 | orchestrator | 2026-04-28 05:30:43.676517 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-28 05:30:43.676528 | orchestrator | Tuesday 28 April 2026 05:30:34 +0000 (0:00:01.259) 0:15:08.123 ********* 2026-04-28 05:30:43.676538 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:30:43.676549 | orchestrator | 2026-04-28 05:30:43.676560 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-28 05:30:43.676570 | orchestrator | Tuesday 28 April 2026 05:30:35 +0000 (0:00:01.151) 0:15:09.274 ********* 2026-04-28 05:30:43.676581 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] 2026-04-28 05:30:43.676592 | orchestrator | 2026-04-28 05:30:43.676602 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 05:30:43.676613 | orchestrator | Tuesday 28 April 2026 05:30:37 +0000 (0:00:02.020) 0:15:11.295 ********* 2026-04-28 05:30:43.676624 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:30:43.676634 | orchestrator | 2026-04-28 05:30:43.676645 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-28 05:30:43.676655 | orchestrator | Tuesday 28 April 2026 05:30:39 +0000 (0:00:01.162) 0:15:12.458 ********* 2026-04-28 05:30:43.676666 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:30:43.676677 | orchestrator | 2026-04-28 05:30:43.676687 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-28 05:30:43.676698 | orchestrator | Tuesday 28 April 2026 05:30:40 +0000 (0:00:01.118) 0:15:13.576 ********* 2026-04-28 05:30:43.676709 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:30:43.676719 | orchestrator | 2026-04-28 05:30:43.676730 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 05:30:43.676740 | orchestrator | Tuesday 28 April 2026 05:30:41 +0000 (0:00:01.206) 0:15:14.783 ********* 2026-04-28 05:30:43.676751 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:30:43.676762 | orchestrator | 2026-04-28 05:30:43.676772 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-28 05:30:43.676783 | orchestrator | Tuesday 28 April 2026 05:30:42 +0000 (0:00:01.108) 0:15:15.892 ********* 2026-04-28 05:30:43.676793 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:30:43.676804 | orchestrator | 2026-04-28 05:30:43.676815 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-28 05:30:43.676834 | orchestrator | Tuesday 28 April 2026 05:30:43 +0000 (0:00:01.153) 0:15:17.045 ********* 2026-04-28 05:30:50.732626 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:30:50.732741 | orchestrator | 2026-04-28 05:30:50.732759 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-28 05:30:50.732774 | orchestrator | Tuesday 28 April 2026 05:30:44 +0000 (0:00:01.120) 0:15:18.166 ********* 2026-04-28 05:30:50.732787 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:30:50.732800 | orchestrator | 2026-04-28 05:30:50.732812 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-28 05:30:50.732825 | orchestrator | Tuesday 28 April 2026 05:30:45 +0000 (0:00:01.153) 0:15:19.320 ********* 2026-04-28 05:30:50.732837 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:30:50.732850 | orchestrator | 2026-04-28 05:30:50.732863 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-28 05:30:50.732876 | orchestrator | Tuesday 28 April 2026 05:30:47 +0000 (0:00:01.126) 0:15:20.446 ********* 2026-04-28 05:30:50.732889 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:30:50.732901 | orchestrator | 2026-04-28 05:30:50.732913 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-28 05:30:50.732979 | orchestrator | Tuesday 28 April 2026 05:30:48 +0000 (0:00:01.232) 0:15:21.679 ********* 2026-04-28 05:30:50.732995 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:30:50.733009 | orchestrator | 2026-04-28 05:30:50.733022 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-28 05:30:50.733035 | orchestrator | Tuesday 28 April 2026 05:30:49 +0000 (0:00:01.113) 0:15:22.793 ********* 2026-04-28 05:30:50.733051 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:30:50.733069 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:30:50.733101 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:30:50.733118 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-16-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 05:30:50.733134 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:30:50.733153 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:30:50.733299 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:30:50.733322 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46c58400', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part16', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part14', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part15', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part1', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:30:50.733361 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:30:50.733402 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:30:50.733416 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:30:50.733428 | orchestrator | 2026-04-28 05:30:50.733440 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-28 05:30:50.733453 | orchestrator | Tuesday 28 April 2026 05:30:50 +0000 (0:00:01.239) 0:15:24.033 ********* 2026-04-28 05:30:50.733508 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:30:50.733538 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:30:59.644874 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:30:59.644985 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-16-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:30:59.645000 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:30:59.645012 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:30:59.645106 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:30:59.645148 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46c58400', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part16', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part14', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part15', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part1', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:30:59.645185 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:30:59.645197 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:30:59.645207 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:30:59.645219 | orchestrator | 2026-04-28 05:30:59.645230 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-28 05:30:59.645241 | orchestrator | Tuesday 28 April 2026 05:30:51 +0000 (0:00:01.263) 0:15:25.296 ********* 2026-04-28 05:30:59.645251 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:30:59.645261 | orchestrator | 2026-04-28 05:30:59.645271 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-28 05:30:59.645280 | orchestrator | Tuesday 28 April 2026 05:30:53 +0000 (0:00:01.609) 0:15:26.906 ********* 2026-04-28 05:30:59.645290 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:30:59.645300 | orchestrator | 2026-04-28 05:30:59.645309 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 05:30:59.645319 | orchestrator | Tuesday 28 April 2026 05:30:54 +0000 (0:00:01.123) 0:15:28.030 ********* 2026-04-28 05:30:59.645337 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:30:59.645346 | orchestrator | 2026-04-28 05:30:59.645399 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 05:30:59.645411 | orchestrator | Tuesday 28 April 2026 05:30:56 +0000 (0:00:01.476) 0:15:29.506 ********* 2026-04-28 05:30:59.645422 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:30:59.645433 | orchestrator | 2026-04-28 05:30:59.645444 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 05:30:59.645455 | orchestrator | Tuesday 28 April 2026 05:30:57 +0000 (0:00:01.106) 0:15:30.612 ********* 2026-04-28 05:30:59.645466 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:30:59.645477 | orchestrator | 2026-04-28 05:30:59.645488 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 05:30:59.645499 | orchestrator | Tuesday 28 April 2026 05:30:58 +0000 (0:00:01.248) 0:15:31.861 ********* 2026-04-28 05:30:59.645510 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:30:59.645521 | orchestrator | 2026-04-28 05:30:59.645532 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-28 05:30:59.645550 | orchestrator | Tuesday 28 April 2026 05:30:59 +0000 (0:00:01.154) 0:15:33.016 ********* 2026-04-28 05:31:38.325069 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-0) 2026-04-28 05:31:38.325176 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-1) 2026-04-28 05:31:38.325190 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-28 05:31:38.325201 | orchestrator | 2026-04-28 05:31:38.325212 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-28 05:31:38.325224 | orchestrator | Tuesday 28 April 2026 05:31:01 +0000 (0:00:02.045) 0:15:35.062 ********* 2026-04-28 05:31:38.325235 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-28 05:31:38.325245 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-28 05:31:38.325255 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-28 05:31:38.325264 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:31:38.325309 | orchestrator | 2026-04-28 05:31:38.325321 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-28 05:31:38.325331 | orchestrator | Tuesday 28 April 2026 05:31:02 +0000 (0:00:01.176) 0:15:36.238 ********* 2026-04-28 05:31:38.325340 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:31:38.325350 | orchestrator | 2026-04-28 05:31:38.325359 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-28 05:31:38.325369 | orchestrator | Tuesday 28 April 2026 05:31:03 +0000 (0:00:01.099) 0:15:37.338 ********* 2026-04-28 05:31:38.325379 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:31:38.325389 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:31:38.325399 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-28 05:31:38.325409 | orchestrator | ok: [testbed-node-2 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 05:31:38.325419 | orchestrator | ok: [testbed-node-2 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 05:31:38.325428 | orchestrator | ok: [testbed-node-2 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 05:31:38.325438 | orchestrator | ok: [testbed-node-2 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 05:31:38.325447 | orchestrator | 2026-04-28 05:31:38.325457 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-28 05:31:38.325467 | orchestrator | Tuesday 28 April 2026 05:31:06 +0000 (0:00:02.287) 0:15:39.625 ********* 2026-04-28 05:31:38.325476 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:31:38.325501 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:31:38.325511 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-28 05:31:38.325541 | orchestrator | ok: [testbed-node-2 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 05:31:38.325551 | orchestrator | ok: [testbed-node-2 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 05:31:38.325560 | orchestrator | ok: [testbed-node-2 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 05:31:38.325570 | orchestrator | ok: [testbed-node-2 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 05:31:38.325580 | orchestrator | 2026-04-28 05:31:38.325589 | orchestrator | TASK [Get ceph cluster status] ************************************************* 2026-04-28 05:31:38.325598 | orchestrator | Tuesday 28 April 2026 05:31:08 +0000 (0:00:02.236) 0:15:41.862 ********* 2026-04-28 05:31:38.325611 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:31:38.325621 | orchestrator | 2026-04-28 05:31:38.325632 | orchestrator | TASK [Display ceph health detail] ********************************************** 2026-04-28 05:31:38.325644 | orchestrator | Tuesday 28 April 2026 05:31:09 +0000 (0:00:00.900) 0:15:42.763 ********* 2026-04-28 05:31:38.325655 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:31:38.325666 | orchestrator | 2026-04-28 05:31:38.325677 | orchestrator | TASK [Fail if cluster isn't in an acceptable state] **************************** 2026-04-28 05:31:38.325687 | orchestrator | Tuesday 28 April 2026 05:31:10 +0000 (0:00:00.881) 0:15:43.644 ********* 2026-04-28 05:31:38.325712 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:31:38.325733 | orchestrator | 2026-04-28 05:31:38.325745 | orchestrator | TASK [Get the ceph quorum status] ********************************************** 2026-04-28 05:31:38.325756 | orchestrator | Tuesday 28 April 2026 05:31:11 +0000 (0:00:00.770) 0:15:44.415 ********* 2026-04-28 05:31:38.325767 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:31:38.325778 | orchestrator | 2026-04-28 05:31:38.325789 | orchestrator | TASK [Fail if the cluster quorum isn't in an acceptable state] ***************** 2026-04-28 05:31:38.325799 | orchestrator | Tuesday 28 April 2026 05:31:11 +0000 (0:00:00.871) 0:15:45.286 ********* 2026-04-28 05:31:38.325810 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:31:38.325821 | orchestrator | 2026-04-28 05:31:38.325832 | orchestrator | TASK [Ensure /var/lib/ceph/bootstrap-rbd-mirror is present] ******************** 2026-04-28 05:31:38.325843 | orchestrator | Tuesday 28 April 2026 05:31:12 +0000 (0:00:00.786) 0:15:46.073 ********* 2026-04-28 05:31:38.325854 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-28 05:31:38.325865 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-28 05:31:38.325875 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-28 05:31:38.325886 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:31:38.325897 | orchestrator | 2026-04-28 05:31:38.325908 | orchestrator | TASK [Create potentially missing keys (rbd and rbd-mirror)] ******************** 2026-04-28 05:31:38.325919 | orchestrator | Tuesday 28 April 2026 05:31:13 +0000 (0:00:01.046) 0:15:47.119 ********* 2026-04-28 05:31:38.325930 | orchestrator | skipping: [testbed-node-2] => (item=['bootstrap-rbd', 'testbed-node-0'])  2026-04-28 05:31:38.325941 | orchestrator | skipping: [testbed-node-2] => (item=['bootstrap-rbd', 'testbed-node-1'])  2026-04-28 05:31:38.325968 | orchestrator | skipping: [testbed-node-2] => (item=['bootstrap-rbd', 'testbed-node-2'])  2026-04-28 05:31:38.325979 | orchestrator | skipping: [testbed-node-2] => (item=['bootstrap-rbd-mirror', 'testbed-node-0'])  2026-04-28 05:31:38.325990 | orchestrator | skipping: [testbed-node-2] => (item=['bootstrap-rbd-mirror', 'testbed-node-1'])  2026-04-28 05:31:38.326001 | orchestrator | skipping: [testbed-node-2] => (item=['bootstrap-rbd-mirror', 'testbed-node-2'])  2026-04-28 05:31:38.326010 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:31:38.326076 | orchestrator | 2026-04-28 05:31:38.326087 | orchestrator | TASK [Stop ceph mon] *********************************************************** 2026-04-28 05:31:38.326096 | orchestrator | Tuesday 28 April 2026 05:31:15 +0000 (0:00:01.712) 0:15:48.832 ********* 2026-04-28 05:31:38.326106 | orchestrator | changed: [testbed-node-2] => (item=testbed-node-2) 2026-04-28 05:31:38.326116 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-28 05:31:38.326134 | orchestrator | 2026-04-28 05:31:38.326143 | orchestrator | TASK [Mask the mgr service] **************************************************** 2026-04-28 05:31:38.326153 | orchestrator | Tuesday 28 April 2026 05:31:18 +0000 (0:00:03.288) 0:15:52.121 ********* 2026-04-28 05:31:38.326162 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:31:38.326172 | orchestrator | 2026-04-28 05:31:38.326181 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 05:31:38.326191 | orchestrator | Tuesday 28 April 2026 05:31:20 +0000 (0:00:02.187) 0:15:54.308 ********* 2026-04-28 05:31:38.326201 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-2 2026-04-28 05:31:38.326211 | orchestrator | 2026-04-28 05:31:38.326221 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 05:31:38.326230 | orchestrator | Tuesday 28 April 2026 05:31:22 +0000 (0:00:01.310) 0:15:55.618 ********* 2026-04-28 05:31:38.326240 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-2 2026-04-28 05:31:38.326250 | orchestrator | 2026-04-28 05:31:38.326259 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 05:31:38.326269 | orchestrator | Tuesday 28 April 2026 05:31:23 +0000 (0:00:01.116) 0:15:56.735 ********* 2026-04-28 05:31:38.326302 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:31:38.326312 | orchestrator | 2026-04-28 05:31:38.326322 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 05:31:38.326332 | orchestrator | Tuesday 28 April 2026 05:31:24 +0000 (0:00:01.563) 0:15:58.298 ********* 2026-04-28 05:31:38.326341 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:31:38.326351 | orchestrator | 2026-04-28 05:31:38.326366 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 05:31:38.326376 | orchestrator | Tuesday 28 April 2026 05:31:26 +0000 (0:00:01.136) 0:15:59.435 ********* 2026-04-28 05:31:38.326385 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:31:38.326395 | orchestrator | 2026-04-28 05:31:38.326404 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 05:31:38.326414 | orchestrator | Tuesday 28 April 2026 05:31:27 +0000 (0:00:01.114) 0:16:00.549 ********* 2026-04-28 05:31:38.326423 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:31:38.326433 | orchestrator | 2026-04-28 05:31:38.326442 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 05:31:38.326452 | orchestrator | Tuesday 28 April 2026 05:31:28 +0000 (0:00:01.143) 0:16:01.692 ********* 2026-04-28 05:31:38.326461 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:31:38.326471 | orchestrator | 2026-04-28 05:31:38.326480 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 05:31:38.326490 | orchestrator | Tuesday 28 April 2026 05:31:29 +0000 (0:00:01.565) 0:16:03.258 ********* 2026-04-28 05:31:38.326500 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:31:38.326509 | orchestrator | 2026-04-28 05:31:38.326519 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 05:31:38.326528 | orchestrator | Tuesday 28 April 2026 05:31:30 +0000 (0:00:01.096) 0:16:04.355 ********* 2026-04-28 05:31:38.326538 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:31:38.326547 | orchestrator | 2026-04-28 05:31:38.326557 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 05:31:38.326566 | orchestrator | Tuesday 28 April 2026 05:31:32 +0000 (0:00:01.142) 0:16:05.497 ********* 2026-04-28 05:31:38.326576 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:31:38.326585 | orchestrator | 2026-04-28 05:31:38.326595 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 05:31:38.326604 | orchestrator | Tuesday 28 April 2026 05:31:33 +0000 (0:00:01.526) 0:16:07.024 ********* 2026-04-28 05:31:38.326614 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:31:38.326624 | orchestrator | 2026-04-28 05:31:38.326633 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 05:31:38.326643 | orchestrator | Tuesday 28 April 2026 05:31:35 +0000 (0:00:01.511) 0:16:08.535 ********* 2026-04-28 05:31:38.326659 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:31:38.326668 | orchestrator | 2026-04-28 05:31:38.326678 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 05:31:38.326688 | orchestrator | Tuesday 28 April 2026 05:31:35 +0000 (0:00:00.750) 0:16:09.286 ********* 2026-04-28 05:31:38.326697 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:31:38.326707 | orchestrator | 2026-04-28 05:31:38.326716 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 05:31:38.326726 | orchestrator | Tuesday 28 April 2026 05:31:36 +0000 (0:00:00.838) 0:16:10.124 ********* 2026-04-28 05:31:38.326735 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:31:38.326745 | orchestrator | 2026-04-28 05:31:38.326754 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 05:31:38.326764 | orchestrator | Tuesday 28 April 2026 05:31:37 +0000 (0:00:00.762) 0:16:10.887 ********* 2026-04-28 05:31:38.326773 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:31:38.326783 | orchestrator | 2026-04-28 05:31:38.326792 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 05:31:38.326802 | orchestrator | Tuesday 28 April 2026 05:31:38 +0000 (0:00:00.760) 0:16:11.648 ********* 2026-04-28 05:31:38.326819 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.714253 | orchestrator | 2026-04-28 05:32:19.714375 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 05:32:19.714393 | orchestrator | Tuesday 28 April 2026 05:31:39 +0000 (0:00:00.769) 0:16:12.418 ********* 2026-04-28 05:32:19.714405 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.714417 | orchestrator | 2026-04-28 05:32:19.714428 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 05:32:19.714439 | orchestrator | Tuesday 28 April 2026 05:31:39 +0000 (0:00:00.772) 0:16:13.191 ********* 2026-04-28 05:32:19.714450 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.714460 | orchestrator | 2026-04-28 05:32:19.714471 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 05:32:19.714482 | orchestrator | Tuesday 28 April 2026 05:31:40 +0000 (0:00:00.794) 0:16:13.985 ********* 2026-04-28 05:32:19.714493 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:32:19.714505 | orchestrator | 2026-04-28 05:32:19.714515 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 05:32:19.714526 | orchestrator | Tuesday 28 April 2026 05:31:41 +0000 (0:00:00.786) 0:16:14.772 ********* 2026-04-28 05:32:19.714537 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:32:19.714547 | orchestrator | 2026-04-28 05:32:19.714558 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 05:32:19.714569 | orchestrator | Tuesday 28 April 2026 05:31:42 +0000 (0:00:00.789) 0:16:15.562 ********* 2026-04-28 05:32:19.714585 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:32:19.714605 | orchestrator | 2026-04-28 05:32:19.714625 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-28 05:32:19.714646 | orchestrator | Tuesday 28 April 2026 05:31:42 +0000 (0:00:00.799) 0:16:16.362 ********* 2026-04-28 05:32:19.714666 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.714685 | orchestrator | 2026-04-28 05:32:19.714704 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-28 05:32:19.714723 | orchestrator | Tuesday 28 April 2026 05:31:43 +0000 (0:00:00.760) 0:16:17.122 ********* 2026-04-28 05:32:19.714743 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.714763 | orchestrator | 2026-04-28 05:32:19.714785 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-28 05:32:19.714801 | orchestrator | Tuesday 28 April 2026 05:31:44 +0000 (0:00:00.772) 0:16:17.895 ********* 2026-04-28 05:32:19.714812 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.714823 | orchestrator | 2026-04-28 05:32:19.714833 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-28 05:32:19.714844 | orchestrator | Tuesday 28 April 2026 05:31:45 +0000 (0:00:00.757) 0:16:18.653 ********* 2026-04-28 05:32:19.714901 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.714913 | orchestrator | 2026-04-28 05:32:19.714924 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-28 05:32:19.714935 | orchestrator | Tuesday 28 April 2026 05:31:46 +0000 (0:00:00.952) 0:16:19.606 ********* 2026-04-28 05:32:19.714945 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.714955 | orchestrator | 2026-04-28 05:32:19.714966 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-28 05:32:19.714977 | orchestrator | Tuesday 28 April 2026 05:31:47 +0000 (0:00:00.777) 0:16:20.384 ********* 2026-04-28 05:32:19.714987 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.714998 | orchestrator | 2026-04-28 05:32:19.715008 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-28 05:32:19.715019 | orchestrator | Tuesday 28 April 2026 05:31:47 +0000 (0:00:00.813) 0:16:21.197 ********* 2026-04-28 05:32:19.715029 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.715040 | orchestrator | 2026-04-28 05:32:19.715050 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-28 05:32:19.715062 | orchestrator | Tuesday 28 April 2026 05:31:48 +0000 (0:00:00.755) 0:16:21.952 ********* 2026-04-28 05:32:19.715072 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.715083 | orchestrator | 2026-04-28 05:32:19.715093 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-28 05:32:19.715104 | orchestrator | Tuesday 28 April 2026 05:31:49 +0000 (0:00:00.786) 0:16:22.739 ********* 2026-04-28 05:32:19.715114 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.715125 | orchestrator | 2026-04-28 05:32:19.715135 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-28 05:32:19.715146 | orchestrator | Tuesday 28 April 2026 05:31:50 +0000 (0:00:00.787) 0:16:23.526 ********* 2026-04-28 05:32:19.715156 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.715166 | orchestrator | 2026-04-28 05:32:19.715178 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-28 05:32:19.715188 | orchestrator | Tuesday 28 April 2026 05:31:50 +0000 (0:00:00.797) 0:16:24.324 ********* 2026-04-28 05:32:19.715252 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.715265 | orchestrator | 2026-04-28 05:32:19.715276 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-28 05:32:19.715287 | orchestrator | Tuesday 28 April 2026 05:31:51 +0000 (0:00:00.789) 0:16:25.113 ********* 2026-04-28 05:32:19.715297 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.715308 | orchestrator | 2026-04-28 05:32:19.715318 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-28 05:32:19.715329 | orchestrator | Tuesday 28 April 2026 05:31:52 +0000 (0:00:00.797) 0:16:25.911 ********* 2026-04-28 05:32:19.715340 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:32:19.715351 | orchestrator | 2026-04-28 05:32:19.715361 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-28 05:32:19.715372 | orchestrator | Tuesday 28 April 2026 05:31:54 +0000 (0:00:01.593) 0:16:27.504 ********* 2026-04-28 05:32:19.715383 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:32:19.715393 | orchestrator | 2026-04-28 05:32:19.715404 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-28 05:32:19.715415 | orchestrator | Tuesday 28 April 2026 05:31:56 +0000 (0:00:02.223) 0:16:29.728 ********* 2026-04-28 05:32:19.715426 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-2 2026-04-28 05:32:19.715438 | orchestrator | 2026-04-28 05:32:19.715470 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-28 05:32:19.715482 | orchestrator | Tuesday 28 April 2026 05:31:57 +0000 (0:00:01.128) 0:16:30.857 ********* 2026-04-28 05:32:19.715492 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.715503 | orchestrator | 2026-04-28 05:32:19.715514 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-28 05:32:19.715534 | orchestrator | Tuesday 28 April 2026 05:31:58 +0000 (0:00:01.117) 0:16:31.975 ********* 2026-04-28 05:32:19.715545 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.715555 | orchestrator | 2026-04-28 05:32:19.715566 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-28 05:32:19.715577 | orchestrator | Tuesday 28 April 2026 05:31:59 +0000 (0:00:01.123) 0:16:33.098 ********* 2026-04-28 05:32:19.715587 | orchestrator | ok: [testbed-node-2] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-28 05:32:19.715598 | orchestrator | ok: [testbed-node-2] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-28 05:32:19.715609 | orchestrator | 2026-04-28 05:32:19.715620 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-28 05:32:19.715630 | orchestrator | Tuesday 28 April 2026 05:32:01 +0000 (0:00:01.810) 0:16:34.909 ********* 2026-04-28 05:32:19.715641 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:32:19.715652 | orchestrator | 2026-04-28 05:32:19.715662 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-28 05:32:19.715673 | orchestrator | Tuesday 28 April 2026 05:32:02 +0000 (0:00:01.452) 0:16:36.361 ********* 2026-04-28 05:32:19.715684 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.715694 | orchestrator | 2026-04-28 05:32:19.715705 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-28 05:32:19.715715 | orchestrator | Tuesday 28 April 2026 05:32:04 +0000 (0:00:01.118) 0:16:37.480 ********* 2026-04-28 05:32:19.715726 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.715737 | orchestrator | 2026-04-28 05:32:19.715747 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-28 05:32:19.715758 | orchestrator | Tuesday 28 April 2026 05:32:04 +0000 (0:00:00.793) 0:16:38.273 ********* 2026-04-28 05:32:19.715768 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.715779 | orchestrator | 2026-04-28 05:32:19.715790 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-28 05:32:19.715800 | orchestrator | Tuesday 28 April 2026 05:32:05 +0000 (0:00:00.780) 0:16:39.054 ********* 2026-04-28 05:32:19.715811 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-2 2026-04-28 05:32:19.715822 | orchestrator | 2026-04-28 05:32:19.715838 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-28 05:32:19.715849 | orchestrator | Tuesday 28 April 2026 05:32:06 +0000 (0:00:01.170) 0:16:40.224 ********* 2026-04-28 05:32:19.715860 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:32:19.715871 | orchestrator | 2026-04-28 05:32:19.715882 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-28 05:32:19.715893 | orchestrator | Tuesday 28 April 2026 05:32:09 +0000 (0:00:02.731) 0:16:42.956 ********* 2026-04-28 05:32:19.715903 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-28 05:32:19.715914 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-28 05:32:19.715925 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-28 05:32:19.715935 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.715946 | orchestrator | 2026-04-28 05:32:19.715957 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-28 05:32:19.715968 | orchestrator | Tuesday 28 April 2026 05:32:10 +0000 (0:00:01.157) 0:16:44.114 ********* 2026-04-28 05:32:19.715978 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.715989 | orchestrator | 2026-04-28 05:32:19.716000 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-28 05:32:19.716010 | orchestrator | Tuesday 28 April 2026 05:32:11 +0000 (0:00:01.112) 0:16:45.227 ********* 2026-04-28 05:32:19.716021 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.716032 | orchestrator | 2026-04-28 05:32:19.716042 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-28 05:32:19.716060 | orchestrator | Tuesday 28 April 2026 05:32:13 +0000 (0:00:01.182) 0:16:46.410 ********* 2026-04-28 05:32:19.716070 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.716081 | orchestrator | 2026-04-28 05:32:19.716092 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-28 05:32:19.716102 | orchestrator | Tuesday 28 April 2026 05:32:14 +0000 (0:00:01.174) 0:16:47.585 ********* 2026-04-28 05:32:19.716113 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.716124 | orchestrator | 2026-04-28 05:32:19.716134 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-28 05:32:19.716145 | orchestrator | Tuesday 28 April 2026 05:32:15 +0000 (0:00:01.286) 0:16:48.871 ********* 2026-04-28 05:32:19.716156 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:19.716166 | orchestrator | 2026-04-28 05:32:19.716177 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-28 05:32:19.716188 | orchestrator | Tuesday 28 April 2026 05:32:16 +0000 (0:00:00.816) 0:16:49.688 ********* 2026-04-28 05:32:19.716219 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:32:19.716230 | orchestrator | 2026-04-28 05:32:19.716241 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-28 05:32:19.716252 | orchestrator | Tuesday 28 April 2026 05:32:18 +0000 (0:00:02.366) 0:16:52.054 ********* 2026-04-28 05:32:19.716262 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:32:19.716273 | orchestrator | 2026-04-28 05:32:19.716284 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-28 05:32:19.716294 | orchestrator | Tuesday 28 April 2026 05:32:19 +0000 (0:00:00.799) 0:16:52.854 ********* 2026-04-28 05:32:19.716305 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-2 2026-04-28 05:32:19.716316 | orchestrator | 2026-04-28 05:32:19.716334 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-28 05:32:56.171970 | orchestrator | Tuesday 28 April 2026 05:32:20 +0000 (0:00:01.123) 0:16:53.978 ********* 2026-04-28 05:32:56.172071 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.172088 | orchestrator | 2026-04-28 05:32:56.172100 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-28 05:32:56.172111 | orchestrator | Tuesday 28 April 2026 05:32:21 +0000 (0:00:01.169) 0:16:55.147 ********* 2026-04-28 05:32:56.172122 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.172133 | orchestrator | 2026-04-28 05:32:56.172211 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-28 05:32:56.172236 | orchestrator | Tuesday 28 April 2026 05:32:22 +0000 (0:00:01.170) 0:16:56.318 ********* 2026-04-28 05:32:56.172248 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.172259 | orchestrator | 2026-04-28 05:32:56.172270 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-28 05:32:56.172281 | orchestrator | Tuesday 28 April 2026 05:32:24 +0000 (0:00:01.238) 0:16:57.556 ********* 2026-04-28 05:32:56.172291 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.172302 | orchestrator | 2026-04-28 05:32:56.172313 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-28 05:32:56.172323 | orchestrator | Tuesday 28 April 2026 05:32:25 +0000 (0:00:01.232) 0:16:58.788 ********* 2026-04-28 05:32:56.172334 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.172344 | orchestrator | 2026-04-28 05:32:56.172355 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-28 05:32:56.172366 | orchestrator | Tuesday 28 April 2026 05:32:26 +0000 (0:00:01.146) 0:16:59.935 ********* 2026-04-28 05:32:56.172377 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.172387 | orchestrator | 2026-04-28 05:32:56.172398 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-28 05:32:56.172408 | orchestrator | Tuesday 28 April 2026 05:32:27 +0000 (0:00:01.115) 0:17:01.051 ********* 2026-04-28 05:32:56.172419 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.172430 | orchestrator | 2026-04-28 05:32:56.172440 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-28 05:32:56.172479 | orchestrator | Tuesday 28 April 2026 05:32:28 +0000 (0:00:01.133) 0:17:02.185 ********* 2026-04-28 05:32:56.172509 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.172530 | orchestrator | 2026-04-28 05:32:56.172550 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-28 05:32:56.172568 | orchestrator | Tuesday 28 April 2026 05:32:29 +0000 (0:00:01.137) 0:17:03.322 ********* 2026-04-28 05:32:56.172604 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:32:56.172624 | orchestrator | 2026-04-28 05:32:56.172640 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-28 05:32:56.172653 | orchestrator | Tuesday 28 April 2026 05:32:30 +0000 (0:00:00.774) 0:17:04.096 ********* 2026-04-28 05:32:56.172666 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-2 2026-04-28 05:32:56.172678 | orchestrator | 2026-04-28 05:32:56.172691 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-28 05:32:56.172705 | orchestrator | Tuesday 28 April 2026 05:32:31 +0000 (0:00:01.107) 0:17:05.204 ********* 2026-04-28 05:32:56.172717 | orchestrator | ok: [testbed-node-2] => (item=/etc/ceph) 2026-04-28 05:32:56.172730 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/) 2026-04-28 05:32:56.172742 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/mon) 2026-04-28 05:32:56.172755 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/osd) 2026-04-28 05:32:56.172768 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/mds) 2026-04-28 05:32:56.172779 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/tmp) 2026-04-28 05:32:56.172792 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/crash) 2026-04-28 05:32:56.172804 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/radosgw) 2026-04-28 05:32:56.172816 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-28 05:32:56.172828 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-28 05:32:56.172841 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-28 05:32:56.172853 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-28 05:32:56.172866 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-28 05:32:56.172878 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-28 05:32:56.172888 | orchestrator | ok: [testbed-node-2] => (item=/var/run/ceph) 2026-04-28 05:32:56.172899 | orchestrator | ok: [testbed-node-2] => (item=/var/log/ceph) 2026-04-28 05:32:56.172910 | orchestrator | 2026-04-28 05:32:56.172921 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-28 05:32:56.172931 | orchestrator | Tuesday 28 April 2026 05:32:38 +0000 (0:00:06.369) 0:17:11.573 ********* 2026-04-28 05:32:56.172942 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.172953 | orchestrator | 2026-04-28 05:32:56.172963 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-28 05:32:56.172974 | orchestrator | Tuesday 28 April 2026 05:32:38 +0000 (0:00:00.736) 0:17:12.310 ********* 2026-04-28 05:32:56.172984 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.172995 | orchestrator | 2026-04-28 05:32:56.173006 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-28 05:32:56.173016 | orchestrator | Tuesday 28 April 2026 05:32:39 +0000 (0:00:00.737) 0:17:13.047 ********* 2026-04-28 05:32:56.173027 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.173038 | orchestrator | 2026-04-28 05:32:56.173049 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-28 05:32:56.173060 | orchestrator | Tuesday 28 April 2026 05:32:40 +0000 (0:00:00.726) 0:17:13.773 ********* 2026-04-28 05:32:56.173071 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.173081 | orchestrator | 2026-04-28 05:32:56.173092 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-28 05:32:56.173130 | orchestrator | Tuesday 28 April 2026 05:32:41 +0000 (0:00:00.751) 0:17:14.525 ********* 2026-04-28 05:32:56.173143 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.173174 | orchestrator | 2026-04-28 05:32:56.173185 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-28 05:32:56.173196 | orchestrator | Tuesday 28 April 2026 05:32:41 +0000 (0:00:00.775) 0:17:15.300 ********* 2026-04-28 05:32:56.173207 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.173217 | orchestrator | 2026-04-28 05:32:56.173228 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-28 05:32:56.173239 | orchestrator | Tuesday 28 April 2026 05:32:42 +0000 (0:00:00.754) 0:17:16.054 ********* 2026-04-28 05:32:56.173250 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.173260 | orchestrator | 2026-04-28 05:32:56.173271 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-28 05:32:56.173282 | orchestrator | Tuesday 28 April 2026 05:32:43 +0000 (0:00:00.772) 0:17:16.827 ********* 2026-04-28 05:32:56.173293 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.173304 | orchestrator | 2026-04-28 05:32:56.173314 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-28 05:32:56.173325 | orchestrator | Tuesday 28 April 2026 05:32:44 +0000 (0:00:00.806) 0:17:17.634 ********* 2026-04-28 05:32:56.173336 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.173346 | orchestrator | 2026-04-28 05:32:56.173357 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-28 05:32:56.173368 | orchestrator | Tuesday 28 April 2026 05:32:45 +0000 (0:00:00.768) 0:17:18.403 ********* 2026-04-28 05:32:56.173379 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.173389 | orchestrator | 2026-04-28 05:32:56.173400 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-28 05:32:56.173410 | orchestrator | Tuesday 28 April 2026 05:32:45 +0000 (0:00:00.800) 0:17:19.204 ********* 2026-04-28 05:32:56.173421 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.173432 | orchestrator | 2026-04-28 05:32:56.173442 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-28 05:32:56.173453 | orchestrator | Tuesday 28 April 2026 05:32:46 +0000 (0:00:00.835) 0:17:20.039 ********* 2026-04-28 05:32:56.173463 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.173474 | orchestrator | 2026-04-28 05:32:56.173485 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-28 05:32:56.173501 | orchestrator | Tuesday 28 April 2026 05:32:47 +0000 (0:00:00.764) 0:17:20.804 ********* 2026-04-28 05:32:56.173511 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.173522 | orchestrator | 2026-04-28 05:32:56.173533 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-28 05:32:56.173543 | orchestrator | Tuesday 28 April 2026 05:32:48 +0000 (0:00:00.896) 0:17:21.701 ********* 2026-04-28 05:32:56.173554 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.173565 | orchestrator | 2026-04-28 05:32:56.173575 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-28 05:32:56.173586 | orchestrator | Tuesday 28 April 2026 05:32:49 +0000 (0:00:00.777) 0:17:22.478 ********* 2026-04-28 05:32:56.173596 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.173607 | orchestrator | 2026-04-28 05:32:56.173617 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-28 05:32:56.173628 | orchestrator | Tuesday 28 April 2026 05:32:49 +0000 (0:00:00.880) 0:17:23.358 ********* 2026-04-28 05:32:56.173638 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.173649 | orchestrator | 2026-04-28 05:32:56.173660 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-28 05:32:56.173670 | orchestrator | Tuesday 28 April 2026 05:32:50 +0000 (0:00:00.858) 0:17:24.217 ********* 2026-04-28 05:32:56.173681 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.173692 | orchestrator | 2026-04-28 05:32:56.173709 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 05:32:56.173721 | orchestrator | Tuesday 28 April 2026 05:32:51 +0000 (0:00:00.813) 0:17:25.031 ********* 2026-04-28 05:32:56.173731 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.173742 | orchestrator | 2026-04-28 05:32:56.173752 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 05:32:56.173763 | orchestrator | Tuesday 28 April 2026 05:32:52 +0000 (0:00:00.803) 0:17:25.834 ********* 2026-04-28 05:32:56.173773 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.173784 | orchestrator | 2026-04-28 05:32:56.173795 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 05:32:56.173805 | orchestrator | Tuesday 28 April 2026 05:32:53 +0000 (0:00:00.791) 0:17:26.625 ********* 2026-04-28 05:32:56.173816 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.173826 | orchestrator | 2026-04-28 05:32:56.173837 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 05:32:56.173852 | orchestrator | Tuesday 28 April 2026 05:32:54 +0000 (0:00:00.905) 0:17:27.531 ********* 2026-04-28 05:32:56.173878 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.173902 | orchestrator | 2026-04-28 05:32:56.173922 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 05:32:56.173940 | orchestrator | Tuesday 28 April 2026 05:32:54 +0000 (0:00:00.796) 0:17:28.327 ********* 2026-04-28 05:32:56.173961 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-28 05:32:56.173981 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-28 05:32:56.174001 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-28 05:32:56.174091 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:32:56.174116 | orchestrator | 2026-04-28 05:32:56.174136 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 05:32:56.174191 | orchestrator | Tuesday 28 April 2026 05:32:55 +0000 (0:00:01.004) 0:17:29.332 ********* 2026-04-28 05:32:56.174209 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-28 05:32:56.174244 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-28 05:34:16.508160 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-28 05:34:16.508277 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:34:16.508294 | orchestrator | 2026-04-28 05:34:16.508307 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 05:34:16.508319 | orchestrator | Tuesday 28 April 2026 05:32:56 +0000 (0:00:00.977) 0:17:30.309 ********* 2026-04-28 05:34:16.508330 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-28 05:34:16.508341 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-28 05:34:16.508352 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-28 05:34:16.508362 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:34:16.508373 | orchestrator | 2026-04-28 05:34:16.508384 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 05:34:16.508395 | orchestrator | Tuesday 28 April 2026 05:32:57 +0000 (0:00:00.968) 0:17:31.278 ********* 2026-04-28 05:34:16.508406 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:34:16.508417 | orchestrator | 2026-04-28 05:34:16.508428 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 05:34:16.508438 | orchestrator | Tuesday 28 April 2026 05:32:58 +0000 (0:00:00.786) 0:17:32.065 ********* 2026-04-28 05:34:16.508449 | orchestrator | skipping: [testbed-node-2] => (item=0)  2026-04-28 05:34:16.508460 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:34:16.508471 | orchestrator | 2026-04-28 05:34:16.508481 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-28 05:34:16.508492 | orchestrator | Tuesday 28 April 2026 05:32:59 +0000 (0:00:00.883) 0:17:32.948 ********* 2026-04-28 05:34:16.508503 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:34:16.508539 | orchestrator | 2026-04-28 05:34:16.508551 | orchestrator | TASK [ceph-mon : Set_fact container_exec_cmd] ********************************** 2026-04-28 05:34:16.508562 | orchestrator | Tuesday 28 April 2026 05:33:00 +0000 (0:00:01.353) 0:17:34.302 ********* 2026-04-28 05:34:16.508573 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:34:16.508583 | orchestrator | 2026-04-28 05:34:16.508594 | orchestrator | TASK [ceph-mon : Include deploy_monitors.yml] ********************************** 2026-04-28 05:34:16.508604 | orchestrator | Tuesday 28 April 2026 05:33:01 +0000 (0:00:00.812) 0:17:35.114 ********* 2026-04-28 05:34:16.508615 | orchestrator | included: /ansible/roles/ceph-mon/tasks/deploy_monitors.yml for testbed-node-2 2026-04-28 05:34:16.508628 | orchestrator | 2026-04-28 05:34:16.508640 | orchestrator | TASK [ceph-mon : Check if monitor initial keyring already exists] ************** 2026-04-28 05:34:16.508667 | orchestrator | Tuesday 28 April 2026 05:33:02 +0000 (0:00:01.177) 0:17:36.292 ********* 2026-04-28 05:34:16.508680 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:34:16.508692 | orchestrator | 2026-04-28 05:34:16.508704 | orchestrator | TASK [ceph-mon : Generate monitor initial keyring] ***************************** 2026-04-28 05:34:16.508716 | orchestrator | Tuesday 28 April 2026 05:33:06 +0000 (0:00:03.498) 0:17:39.790 ********* 2026-04-28 05:34:16.508729 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:34:16.508741 | orchestrator | 2026-04-28 05:34:16.508753 | orchestrator | TASK [ceph-mon : Set_fact _initial_mon_key_success] **************************** 2026-04-28 05:34:16.508765 | orchestrator | Tuesday 28 April 2026 05:33:07 +0000 (0:00:01.245) 0:17:41.036 ********* 2026-04-28 05:34:16.508777 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:34:16.508789 | orchestrator | 2026-04-28 05:34:16.508801 | orchestrator | TASK [ceph-mon : Get initial keyring when it already exists] ******************* 2026-04-28 05:34:16.508813 | orchestrator | Tuesday 28 April 2026 05:33:08 +0000 (0:00:01.135) 0:17:42.172 ********* 2026-04-28 05:34:16.508825 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:34:16.508838 | orchestrator | 2026-04-28 05:34:16.508850 | orchestrator | TASK [ceph-mon : Create monitor initial keyring] ******************************* 2026-04-28 05:34:16.508863 | orchestrator | Tuesday 28 April 2026 05:33:09 +0000 (0:00:01.147) 0:17:43.319 ********* 2026-04-28 05:34:16.508875 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:34:16.508887 | orchestrator | 2026-04-28 05:34:16.508899 | orchestrator | TASK [ceph-mon : Copy the initial key in /etc/ceph (for containers)] *********** 2026-04-28 05:34:16.508911 | orchestrator | Tuesday 28 April 2026 05:33:12 +0000 (0:00:02.110) 0:17:45.430 ********* 2026-04-28 05:34:16.508923 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:34:16.508937 | orchestrator | 2026-04-28 05:34:16.508948 | orchestrator | TASK [ceph-mon : Create monitor directory] ************************************* 2026-04-28 05:34:16.508959 | orchestrator | Tuesday 28 April 2026 05:33:13 +0000 (0:00:01.587) 0:17:47.017 ********* 2026-04-28 05:34:16.508969 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:34:16.508980 | orchestrator | 2026-04-28 05:34:16.508991 | orchestrator | TASK [ceph-mon : Recursively fix ownership of monitor directory] *************** 2026-04-28 05:34:16.509001 | orchestrator | Tuesday 28 April 2026 05:33:15 +0000 (0:00:01.485) 0:17:48.503 ********* 2026-04-28 05:34:16.509012 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:34:16.509022 | orchestrator | 2026-04-28 05:34:16.509033 | orchestrator | TASK [ceph-mon : Create admin keyring] ***************************************** 2026-04-28 05:34:16.509043 | orchestrator | Tuesday 28 April 2026 05:33:16 +0000 (0:00:01.471) 0:17:49.974 ********* 2026-04-28 05:34:16.509080 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-28 05:34:16.509092 | orchestrator | 2026-04-28 05:34:16.509103 | orchestrator | TASK [ceph-mon : Slurp admin keyring] ****************************************** 2026-04-28 05:34:16.509113 | orchestrator | Tuesday 28 April 2026 05:33:18 +0000 (0:00:01.641) 0:17:51.615 ********* 2026-04-28 05:34:16.509124 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-28 05:34:16.509134 | orchestrator | 2026-04-28 05:34:16.509145 | orchestrator | TASK [ceph-mon : Copy admin keyring over to mons] ****************************** 2026-04-28 05:34:16.509155 | orchestrator | Tuesday 28 April 2026 05:33:19 +0000 (0:00:01.562) 0:17:53.178 ********* 2026-04-28 05:34:16.509174 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 05:34:16.509184 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=None) 2026-04-28 05:34:16.509195 | orchestrator | ok: [testbed-node-2] => (item=None) 2026-04-28 05:34:16.509206 | orchestrator | ok: [testbed-node-2 -> {{ item }}] 2026-04-28 05:34:16.509217 | orchestrator | 2026-04-28 05:34:16.509246 | orchestrator | TASK [ceph-mon : Import admin keyring into mon keyring] ************************ 2026-04-28 05:34:16.509257 | orchestrator | Tuesday 28 April 2026 05:33:23 +0000 (0:00:03.856) 0:17:57.035 ********* 2026-04-28 05:34:16.509268 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:34:16.509279 | orchestrator | 2026-04-28 05:34:16.509290 | orchestrator | TASK [ceph-mon : Set_fact ceph-mon container command] ************************** 2026-04-28 05:34:16.509300 | orchestrator | Tuesday 28 April 2026 05:33:25 +0000 (0:00:02.092) 0:17:59.128 ********* 2026-04-28 05:34:16.509310 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:34:16.509321 | orchestrator | 2026-04-28 05:34:16.509332 | orchestrator | TASK [ceph-mon : Set_fact monmaptool container command] ************************ 2026-04-28 05:34:16.509342 | orchestrator | Tuesday 28 April 2026 05:33:26 +0000 (0:00:01.179) 0:18:00.307 ********* 2026-04-28 05:34:16.509353 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:34:16.509363 | orchestrator | 2026-04-28 05:34:16.509374 | orchestrator | TASK [ceph-mon : Generate initial monmap] ************************************** 2026-04-28 05:34:16.509384 | orchestrator | Tuesday 28 April 2026 05:33:28 +0000 (0:00:01.118) 0:18:01.426 ********* 2026-04-28 05:34:16.509395 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:34:16.509405 | orchestrator | 2026-04-28 05:34:16.509416 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs with keyring] ******************************* 2026-04-28 05:34:16.509426 | orchestrator | Tuesday 28 April 2026 05:33:30 +0000 (0:00:02.199) 0:18:03.626 ********* 2026-04-28 05:34:16.509437 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:34:16.509447 | orchestrator | 2026-04-28 05:34:16.509458 | orchestrator | TASK [ceph-mon : Ceph monitor mkfs without keyring] **************************** 2026-04-28 05:34:16.509468 | orchestrator | Tuesday 28 April 2026 05:33:31 +0000 (0:00:01.486) 0:18:05.113 ********* 2026-04-28 05:34:16.509479 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:34:16.509489 | orchestrator | 2026-04-28 05:34:16.509500 | orchestrator | TASK [ceph-mon : Include start_monitor.yml] ************************************ 2026-04-28 05:34:16.509510 | orchestrator | Tuesday 28 April 2026 05:33:32 +0000 (0:00:00.796) 0:18:05.910 ********* 2026-04-28 05:34:16.509521 | orchestrator | included: /ansible/roles/ceph-mon/tasks/start_monitor.yml for testbed-node-2 2026-04-28 05:34:16.509531 | orchestrator | 2026-04-28 05:34:16.509542 | orchestrator | TASK [ceph-mon : Ensure systemd service override directory exists] ************* 2026-04-28 05:34:16.509552 | orchestrator | Tuesday 28 April 2026 05:33:33 +0000 (0:00:01.125) 0:18:07.035 ********* 2026-04-28 05:34:16.509563 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:34:16.509573 | orchestrator | 2026-04-28 05:34:16.509584 | orchestrator | TASK [ceph-mon : Add ceph-mon systemd service overrides] *********************** 2026-04-28 05:34:16.509600 | orchestrator | Tuesday 28 April 2026 05:33:34 +0000 (0:00:01.097) 0:18:08.133 ********* 2026-04-28 05:34:16.509611 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:34:16.509621 | orchestrator | 2026-04-28 05:34:16.509632 | orchestrator | TASK [ceph-mon : Include_tasks systemd.yml] ************************************ 2026-04-28 05:34:16.509642 | orchestrator | Tuesday 28 April 2026 05:33:35 +0000 (0:00:01.124) 0:18:09.258 ********* 2026-04-28 05:34:16.509653 | orchestrator | included: /ansible/roles/ceph-mon/tasks/systemd.yml for testbed-node-2 2026-04-28 05:34:16.509663 | orchestrator | 2026-04-28 05:34:16.509674 | orchestrator | TASK [ceph-mon : Generate systemd unit file for mon container] ***************** 2026-04-28 05:34:16.509685 | orchestrator | Tuesday 28 April 2026 05:33:36 +0000 (0:00:01.091) 0:18:10.349 ********* 2026-04-28 05:34:16.509695 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:34:16.509706 | orchestrator | 2026-04-28 05:34:16.509716 | orchestrator | TASK [ceph-mon : Generate systemd ceph-mon target file] ************************ 2026-04-28 05:34:16.509734 | orchestrator | Tuesday 28 April 2026 05:33:39 +0000 (0:00:02.340) 0:18:12.689 ********* 2026-04-28 05:34:16.509744 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:34:16.509755 | orchestrator | 2026-04-28 05:34:16.509765 | orchestrator | TASK [ceph-mon : Enable ceph-mon.target] *************************************** 2026-04-28 05:34:16.509776 | orchestrator | Tuesday 28 April 2026 05:33:41 +0000 (0:00:02.007) 0:18:14.697 ********* 2026-04-28 05:34:16.509786 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:34:16.509797 | orchestrator | 2026-04-28 05:34:16.509807 | orchestrator | TASK [ceph-mon : Start the monitor service] ************************************ 2026-04-28 05:34:16.509817 | orchestrator | Tuesday 28 April 2026 05:33:43 +0000 (0:00:02.450) 0:18:17.147 ********* 2026-04-28 05:34:16.509828 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:34:16.509838 | orchestrator | 2026-04-28 05:34:16.509849 | orchestrator | TASK [ceph-mon : Include_tasks ceph_keys.yml] ********************************** 2026-04-28 05:34:16.509859 | orchestrator | Tuesday 28 April 2026 05:33:46 +0000 (0:00:03.109) 0:18:20.256 ********* 2026-04-28 05:34:16.509870 | orchestrator | included: /ansible/roles/ceph-mon/tasks/ceph_keys.yml for testbed-node-2 2026-04-28 05:34:16.509880 | orchestrator | 2026-04-28 05:34:16.509891 | orchestrator | TASK [ceph-mon : Waiting for the monitor(s) to form the quorum...] ************* 2026-04-28 05:34:16.509902 | orchestrator | Tuesday 28 April 2026 05:33:48 +0000 (0:00:01.290) 0:18:21.546 ********* 2026-04-28 05:34:16.509912 | orchestrator | FAILED - RETRYING: [testbed-node-2]: Waiting for the monitor(s) to form the quorum... (10 retries left). 2026-04-28 05:34:16.509923 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:34:16.509934 | orchestrator | 2026-04-28 05:34:16.509945 | orchestrator | TASK [ceph-mon : Fetch ceph initial keys] ************************************** 2026-04-28 05:34:16.509956 | orchestrator | Tuesday 28 April 2026 05:34:11 +0000 (0:00:22.894) 0:18:44.441 ********* 2026-04-28 05:34:16.509966 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:34:16.509977 | orchestrator | 2026-04-28 05:34:16.509987 | orchestrator | TASK [ceph-mon : Include secure_cluster.yml] *********************************** 2026-04-28 05:34:16.509998 | orchestrator | Tuesday 28 April 2026 05:34:13 +0000 (0:00:02.781) 0:18:47.223 ********* 2026-04-28 05:34:16.510008 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:34:16.510096 | orchestrator | 2026-04-28 05:34:16.510111 | orchestrator | TASK [ceph-mon : Set cluster configs] ****************************************** 2026-04-28 05:34:16.510122 | orchestrator | Tuesday 28 April 2026 05:34:14 +0000 (0:00:00.774) 0:18:47.997 ********* 2026-04-28 05:34:16.510143 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'public_network', 'value': '192.168.16.0/20'}]) 2026-04-28 05:34:59.496173 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'cluster_network', 'value': '192.168.16.0/20'}]) 2026-04-28 05:34:59.496293 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'osd_pool_default_crush_rule', 'value': -1}]) 2026-04-28 05:34:59.496312 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'ms_bind_ipv6', 'value': 'False'}]) 2026-04-28 05:34:59.496364 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'ms_bind_ipv4', 'value': 'True'}]) 2026-04-28 05:34:59.496377 | orchestrator | skipping: [testbed-node-2] => (item=[{'key': 'global', 'value': {'public_network': '192.168.16.0/20', 'cluster_network': '192.168.16.0/20', 'osd_pool_default_crush_rule': -1, 'ms_bind_ipv6': 'False', 'ms_bind_ipv4': 'True', 'osd_crush_chooseleaf_type': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}}, {'key': 'osd_crush_chooseleaf_type', 'value': '__omit_place_holder__a4a220f1c6def60802a8b4a18b9368bdeb1a0375'}])  2026-04-28 05:34:59.496391 | orchestrator | 2026-04-28 05:34:59.496404 | orchestrator | TASK [Start ceph mgr] ********************************************************** 2026-04-28 05:34:59.496416 | orchestrator | Tuesday 28 April 2026 05:34:24 +0000 (0:00:09.780) 0:18:57.778 ********* 2026-04-28 05:34:59.496427 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:34:59.496438 | orchestrator | 2026-04-28 05:34:59.496449 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-28 05:34:59.496460 | orchestrator | Tuesday 28 April 2026 05:34:26 +0000 (0:00:02.206) 0:18:59.984 ********* 2026-04-28 05:34:59.496471 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:34:59.496483 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-1) 2026-04-28 05:34:59.496513 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-2) 2026-04-28 05:34:59.496524 | orchestrator | 2026-04-28 05:34:59.496547 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-28 05:34:59.496558 | orchestrator | Tuesday 28 April 2026 05:34:28 +0000 (0:00:01.917) 0:19:01.902 ********* 2026-04-28 05:34:59.496569 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-28 05:34:59.496581 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-28 05:34:59.496591 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-28 05:34:59.496602 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:34:59.496613 | orchestrator | 2026-04-28 05:34:59.496624 | orchestrator | TASK [Non container | waiting for the monitor to join the quorum...] *********** 2026-04-28 05:34:59.496635 | orchestrator | Tuesday 28 April 2026 05:34:29 +0000 (0:00:01.123) 0:19:03.025 ********* 2026-04-28 05:34:59.496646 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:34:59.496657 | orchestrator | 2026-04-28 05:34:59.496667 | orchestrator | TASK [Container | waiting for the containerized monitor to join the quorum...] *** 2026-04-28 05:34:59.496678 | orchestrator | Tuesday 28 April 2026 05:34:30 +0000 (0:00:00.799) 0:19:03.825 ********* 2026-04-28 05:34:59.496689 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:34:59.496702 | orchestrator | 2026-04-28 05:34:59.496716 | orchestrator | PLAY [Reset mon_host] ********************************************************** 2026-04-28 05:34:59.496728 | orchestrator | 2026-04-28 05:34:59.496740 | orchestrator | TASK [Reset mon_host fact] ***************************************************** 2026-04-28 05:34:59.496753 | orchestrator | Tuesday 28 April 2026 05:34:33 +0000 (0:00:02.944) 0:19:06.769 ********* 2026-04-28 05:34:59.496765 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:34:59.496778 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:34:59.496790 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:34:59.496802 | orchestrator | 2026-04-28 05:34:59.496815 | orchestrator | PLAY [Upgrade ceph mgr nodes when implicitly collocated on monitors] *********** 2026-04-28 05:34:59.496827 | orchestrator | 2026-04-28 05:34:59.496839 | orchestrator | TASK [Stop ceph mgr] *********************************************************** 2026-04-28 05:34:59.496852 | orchestrator | Tuesday 28 April 2026 05:34:35 +0000 (0:00:01.656) 0:19:08.425 ********* 2026-04-28 05:34:59.496864 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:34:59.496883 | orchestrator | 2026-04-28 05:34:59.496894 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 05:34:59.496920 | orchestrator | Tuesday 28 April 2026 05:34:36 +0000 (0:00:01.231) 0:19:09.657 ********* 2026-04-28 05:34:59.496932 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:34:59.496943 | orchestrator | 2026-04-28 05:34:59.496954 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 05:34:59.496964 | orchestrator | Tuesday 28 April 2026 05:34:37 +0000 (0:00:01.131) 0:19:10.789 ********* 2026-04-28 05:34:59.496975 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:34:59.496986 | orchestrator | 2026-04-28 05:34:59.496997 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 05:34:59.497028 | orchestrator | Tuesday 28 April 2026 05:34:38 +0000 (0:00:01.173) 0:19:11.962 ********* 2026-04-28 05:34:59.497039 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:34:59.497050 | orchestrator | 2026-04-28 05:34:59.497061 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 05:34:59.497072 | orchestrator | Tuesday 28 April 2026 05:34:39 +0000 (0:00:01.176) 0:19:13.139 ********* 2026-04-28 05:34:59.497083 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:34:59.497094 | orchestrator | 2026-04-28 05:34:59.497104 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 05:34:59.497115 | orchestrator | Tuesday 28 April 2026 05:34:40 +0000 (0:00:01.148) 0:19:14.288 ********* 2026-04-28 05:34:59.497126 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:34:59.497137 | orchestrator | 2026-04-28 05:34:59.497147 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 05:34:59.497158 | orchestrator | Tuesday 28 April 2026 05:34:42 +0000 (0:00:01.226) 0:19:15.514 ********* 2026-04-28 05:34:59.497169 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:34:59.497180 | orchestrator | 2026-04-28 05:34:59.497191 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 05:34:59.497202 | orchestrator | Tuesday 28 April 2026 05:34:43 +0000 (0:00:01.153) 0:19:16.668 ********* 2026-04-28 05:34:59.497213 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:34:59.497224 | orchestrator | 2026-04-28 05:34:59.497235 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 05:34:59.497246 | orchestrator | Tuesday 28 April 2026 05:34:44 +0000 (0:00:01.181) 0:19:17.850 ********* 2026-04-28 05:34:59.497262 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:34:59.497273 | orchestrator | 2026-04-28 05:34:59.497284 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 05:34:59.497294 | orchestrator | Tuesday 28 April 2026 05:34:45 +0000 (0:00:01.173) 0:19:19.024 ********* 2026-04-28 05:34:59.497305 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:34:59.497316 | orchestrator | 2026-04-28 05:34:59.497327 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 05:34:59.497338 | orchestrator | Tuesday 28 April 2026 05:34:46 +0000 (0:00:01.189) 0:19:20.214 ********* 2026-04-28 05:34:59.497348 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:34:59.497359 | orchestrator | 2026-04-28 05:34:59.497370 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 05:34:59.497381 | orchestrator | Tuesday 28 April 2026 05:34:47 +0000 (0:00:01.135) 0:19:21.349 ********* 2026-04-28 05:34:59.497392 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:34:59.497402 | orchestrator | 2026-04-28 05:34:59.497413 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-28 05:34:59.497424 | orchestrator | Tuesday 28 April 2026 05:34:49 +0000 (0:00:01.115) 0:19:22.465 ********* 2026-04-28 05:34:59.497434 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:34:59.497445 | orchestrator | 2026-04-28 05:34:59.497456 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-28 05:34:59.497466 | orchestrator | Tuesday 28 April 2026 05:34:50 +0000 (0:00:01.096) 0:19:23.562 ********* 2026-04-28 05:34:59.497477 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:34:59.497495 | orchestrator | 2026-04-28 05:34:59.497506 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-28 05:34:59.497516 | orchestrator | Tuesday 28 April 2026 05:34:51 +0000 (0:00:01.115) 0:19:24.678 ********* 2026-04-28 05:34:59.497527 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:34:59.497538 | orchestrator | 2026-04-28 05:34:59.497549 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-28 05:34:59.497559 | orchestrator | Tuesday 28 April 2026 05:34:52 +0000 (0:00:01.113) 0:19:25.791 ********* 2026-04-28 05:34:59.497570 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:34:59.497581 | orchestrator | 2026-04-28 05:34:59.497592 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-28 05:34:59.497602 | orchestrator | Tuesday 28 April 2026 05:34:53 +0000 (0:00:01.106) 0:19:26.897 ********* 2026-04-28 05:34:59.497613 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:34:59.497624 | orchestrator | 2026-04-28 05:34:59.497634 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-28 05:34:59.497645 | orchestrator | Tuesday 28 April 2026 05:34:54 +0000 (0:00:01.122) 0:19:28.020 ********* 2026-04-28 05:34:59.497656 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:34:59.497666 | orchestrator | 2026-04-28 05:34:59.497677 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-28 05:34:59.497688 | orchestrator | Tuesday 28 April 2026 05:34:55 +0000 (0:00:01.149) 0:19:29.169 ********* 2026-04-28 05:34:59.497699 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:34:59.497709 | orchestrator | 2026-04-28 05:34:59.497720 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-28 05:34:59.497731 | orchestrator | Tuesday 28 April 2026 05:34:57 +0000 (0:00:01.265) 0:19:30.435 ********* 2026-04-28 05:34:59.497742 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:34:59.497752 | orchestrator | 2026-04-28 05:34:59.497763 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-28 05:34:59.497774 | orchestrator | Tuesday 28 April 2026 05:34:58 +0000 (0:00:01.184) 0:19:31.619 ********* 2026-04-28 05:34:59.497785 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:34:59.497795 | orchestrator | 2026-04-28 05:34:59.497806 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-28 05:34:59.497817 | orchestrator | Tuesday 28 April 2026 05:34:59 +0000 (0:00:01.193) 0:19:32.813 ********* 2026-04-28 05:34:59.497835 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.173440 | orchestrator | 2026-04-28 05:35:43.173554 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-28 05:35:43.173571 | orchestrator | Tuesday 28 April 2026 05:35:00 +0000 (0:00:01.133) 0:19:33.946 ********* 2026-04-28 05:35:43.173583 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.173595 | orchestrator | 2026-04-28 05:35:43.173607 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-28 05:35:43.173618 | orchestrator | Tuesday 28 April 2026 05:35:01 +0000 (0:00:01.135) 0:19:35.082 ********* 2026-04-28 05:35:43.173629 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.173639 | orchestrator | 2026-04-28 05:35:43.173650 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-28 05:35:43.173661 | orchestrator | Tuesday 28 April 2026 05:35:02 +0000 (0:00:01.144) 0:19:36.226 ********* 2026-04-28 05:35:43.173672 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.173682 | orchestrator | 2026-04-28 05:35:43.173693 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-28 05:35:43.173704 | orchestrator | Tuesday 28 April 2026 05:35:03 +0000 (0:00:01.120) 0:19:37.347 ********* 2026-04-28 05:35:43.173714 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.173725 | orchestrator | 2026-04-28 05:35:43.173736 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-28 05:35:43.173746 | orchestrator | Tuesday 28 April 2026 05:35:05 +0000 (0:00:01.113) 0:19:38.460 ********* 2026-04-28 05:35:43.173783 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.173795 | orchestrator | 2026-04-28 05:35:43.173805 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-28 05:35:43.173816 | orchestrator | Tuesday 28 April 2026 05:35:06 +0000 (0:00:01.119) 0:19:39.580 ********* 2026-04-28 05:35:43.173826 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.173837 | orchestrator | 2026-04-28 05:35:43.173848 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-28 05:35:43.173859 | orchestrator | Tuesday 28 April 2026 05:35:07 +0000 (0:00:01.155) 0:19:40.735 ********* 2026-04-28 05:35:43.173869 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.173880 | orchestrator | 2026-04-28 05:35:43.173905 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-28 05:35:43.173916 | orchestrator | Tuesday 28 April 2026 05:35:08 +0000 (0:00:01.101) 0:19:41.837 ********* 2026-04-28 05:35:43.173926 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.173937 | orchestrator | 2026-04-28 05:35:43.173947 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-28 05:35:43.173959 | orchestrator | Tuesday 28 April 2026 05:35:09 +0000 (0:00:01.097) 0:19:42.935 ********* 2026-04-28 05:35:43.173995 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.174007 | orchestrator | 2026-04-28 05:35:43.174077 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-28 05:35:43.174091 | orchestrator | Tuesday 28 April 2026 05:35:10 +0000 (0:00:01.111) 0:19:44.046 ********* 2026-04-28 05:35:43.174103 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.174115 | orchestrator | 2026-04-28 05:35:43.174127 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-28 05:35:43.174140 | orchestrator | Tuesday 28 April 2026 05:35:11 +0000 (0:00:01.133) 0:19:45.179 ********* 2026-04-28 05:35:43.174152 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.174164 | orchestrator | 2026-04-28 05:35:43.174177 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-28 05:35:43.174189 | orchestrator | Tuesday 28 April 2026 05:35:12 +0000 (0:00:01.116) 0:19:46.296 ********* 2026-04-28 05:35:43.174201 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.174213 | orchestrator | 2026-04-28 05:35:43.174225 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-28 05:35:43.174237 | orchestrator | Tuesday 28 April 2026 05:35:14 +0000 (0:00:01.100) 0:19:47.396 ********* 2026-04-28 05:35:43.174249 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.174261 | orchestrator | 2026-04-28 05:35:43.174273 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-28 05:35:43.174286 | orchestrator | Tuesday 28 April 2026 05:35:15 +0000 (0:00:01.118) 0:19:48.515 ********* 2026-04-28 05:35:43.174298 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.174310 | orchestrator | 2026-04-28 05:35:43.174323 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-28 05:35:43.174335 | orchestrator | Tuesday 28 April 2026 05:35:16 +0000 (0:00:01.141) 0:19:49.656 ********* 2026-04-28 05:35:43.174346 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.174356 | orchestrator | 2026-04-28 05:35:43.174367 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-28 05:35:43.174378 | orchestrator | Tuesday 28 April 2026 05:35:17 +0000 (0:00:01.124) 0:19:50.781 ********* 2026-04-28 05:35:43.174388 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.174399 | orchestrator | 2026-04-28 05:35:43.174410 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-28 05:35:43.174421 | orchestrator | Tuesday 28 April 2026 05:35:18 +0000 (0:00:01.110) 0:19:51.892 ********* 2026-04-28 05:35:43.174431 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.174442 | orchestrator | 2026-04-28 05:35:43.174452 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-28 05:35:43.174464 | orchestrator | Tuesday 28 April 2026 05:35:19 +0000 (0:00:01.149) 0:19:53.042 ********* 2026-04-28 05:35:43.174484 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.174495 | orchestrator | 2026-04-28 05:35:43.174506 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-28 05:35:43.174517 | orchestrator | Tuesday 28 April 2026 05:35:20 +0000 (0:00:01.163) 0:19:54.205 ********* 2026-04-28 05:35:43.174527 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.174538 | orchestrator | 2026-04-28 05:35:43.174549 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-28 05:35:43.174560 | orchestrator | Tuesday 28 April 2026 05:35:21 +0000 (0:00:01.147) 0:19:55.353 ********* 2026-04-28 05:35:43.174588 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.174599 | orchestrator | 2026-04-28 05:35:43.174610 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-28 05:35:43.174621 | orchestrator | Tuesday 28 April 2026 05:35:23 +0000 (0:00:01.106) 0:19:56.460 ********* 2026-04-28 05:35:43.174631 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.174642 | orchestrator | 2026-04-28 05:35:43.174653 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-28 05:35:43.174664 | orchestrator | Tuesday 28 April 2026 05:35:24 +0000 (0:00:01.181) 0:19:57.641 ********* 2026-04-28 05:35:43.174674 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.174685 | orchestrator | 2026-04-28 05:35:43.174695 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-28 05:35:43.174706 | orchestrator | Tuesday 28 April 2026 05:35:25 +0000 (0:00:01.201) 0:19:58.843 ********* 2026-04-28 05:35:43.174716 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.174727 | orchestrator | 2026-04-28 05:35:43.174738 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-28 05:35:43.174748 | orchestrator | Tuesday 28 April 2026 05:35:26 +0000 (0:00:01.133) 0:19:59.976 ********* 2026-04-28 05:35:43.174759 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.174769 | orchestrator | 2026-04-28 05:35:43.174780 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-28 05:35:43.174791 | orchestrator | Tuesday 28 April 2026 05:35:27 +0000 (0:00:01.263) 0:20:01.240 ********* 2026-04-28 05:35:43.174801 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.174812 | orchestrator | 2026-04-28 05:35:43.174822 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-28 05:35:43.174833 | orchestrator | Tuesday 28 April 2026 05:35:29 +0000 (0:00:01.150) 0:20:02.390 ********* 2026-04-28 05:35:43.174844 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.174854 | orchestrator | 2026-04-28 05:35:43.174865 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-28 05:35:43.174875 | orchestrator | Tuesday 28 April 2026 05:35:30 +0000 (0:00:01.190) 0:20:03.581 ********* 2026-04-28 05:35:43.174886 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.174897 | orchestrator | 2026-04-28 05:35:43.174913 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-28 05:35:43.174924 | orchestrator | Tuesday 28 April 2026 05:35:31 +0000 (0:00:01.119) 0:20:04.700 ********* 2026-04-28 05:35:43.174935 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.174946 | orchestrator | 2026-04-28 05:35:43.174957 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 05:35:43.175007 | orchestrator | Tuesday 28 April 2026 05:35:32 +0000 (0:00:01.113) 0:20:05.814 ********* 2026-04-28 05:35:43.175018 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.175029 | orchestrator | 2026-04-28 05:35:43.175039 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 05:35:43.175050 | orchestrator | Tuesday 28 April 2026 05:35:33 +0000 (0:00:01.136) 0:20:06.951 ********* 2026-04-28 05:35:43.175061 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.175072 | orchestrator | 2026-04-28 05:35:43.175082 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 05:35:43.175100 | orchestrator | Tuesday 28 April 2026 05:35:34 +0000 (0:00:01.107) 0:20:08.059 ********* 2026-04-28 05:35:43.175111 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.175122 | orchestrator | 2026-04-28 05:35:43.175133 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 05:35:43.175143 | orchestrator | Tuesday 28 April 2026 05:35:35 +0000 (0:00:01.131) 0:20:09.191 ********* 2026-04-28 05:35:43.175154 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.175165 | orchestrator | 2026-04-28 05:35:43.175176 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 05:35:43.175187 | orchestrator | Tuesday 28 April 2026 05:35:36 +0000 (0:00:01.119) 0:20:10.311 ********* 2026-04-28 05:35:43.175197 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-28 05:35:43.175209 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-28 05:35:43.175220 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-28 05:35:43.175230 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.175241 | orchestrator | 2026-04-28 05:35:43.175252 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 05:35:43.175263 | orchestrator | Tuesday 28 April 2026 05:35:38 +0000 (0:00:01.731) 0:20:12.043 ********* 2026-04-28 05:35:43.175273 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-28 05:35:43.175284 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-28 05:35:43.175295 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-28 05:35:43.175306 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.175317 | orchestrator | 2026-04-28 05:35:43.175328 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 05:35:43.175339 | orchestrator | Tuesday 28 April 2026 05:35:40 +0000 (0:00:01.792) 0:20:13.835 ********* 2026-04-28 05:35:43.175349 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-28 05:35:43.175360 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-28 05:35:43.175371 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-28 05:35:43.175382 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.175392 | orchestrator | 2026-04-28 05:35:43.175403 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 05:35:43.175414 | orchestrator | Tuesday 28 April 2026 05:35:41 +0000 (0:00:01.390) 0:20:15.226 ********* 2026-04-28 05:35:43.175425 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:35:43.175435 | orchestrator | 2026-04-28 05:35:43.175446 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 05:35:43.175457 | orchestrator | Tuesday 28 April 2026 05:35:42 +0000 (0:00:01.147) 0:20:16.374 ********* 2026-04-28 05:35:43.175469 | orchestrator | skipping: [testbed-node-0] => (item=0)  2026-04-28 05:35:43.175487 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:36:17.146306 | orchestrator | 2026-04-28 05:36:17.146415 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-28 05:36:17.146430 | orchestrator | Tuesday 28 April 2026 05:35:44 +0000 (0:00:01.300) 0:20:17.674 ********* 2026-04-28 05:36:17.146441 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:36:17.146452 | orchestrator | 2026-04-28 05:36:17.146462 | orchestrator | TASK [ceph-mgr : Set_fact container_exec_cmd] ********************************** 2026-04-28 05:36:17.146471 | orchestrator | Tuesday 28 April 2026 05:35:45 +0000 (0:00:01.130) 0:20:18.805 ********* 2026-04-28 05:36:17.146481 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-28 05:36:17.146491 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-28 05:36:17.146500 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-28 05:36:17.146510 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:36:17.146519 | orchestrator | 2026-04-28 05:36:17.146529 | orchestrator | TASK [ceph-mgr : Include common.yml] ******************************************* 2026-04-28 05:36:17.146563 | orchestrator | Tuesday 28 April 2026 05:35:46 +0000 (0:00:01.423) 0:20:20.228 ********* 2026-04-28 05:36:17.146573 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:36:17.146582 | orchestrator | 2026-04-28 05:36:17.146592 | orchestrator | TASK [ceph-mgr : Include pre_requisite.yml] ************************************ 2026-04-28 05:36:17.146601 | orchestrator | Tuesday 28 April 2026 05:35:47 +0000 (0:00:01.122) 0:20:21.351 ********* 2026-04-28 05:36:17.146610 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:36:17.146620 | orchestrator | 2026-04-28 05:36:17.146629 | orchestrator | TASK [ceph-mgr : Include start_mgr.yml] **************************************** 2026-04-28 05:36:17.146639 | orchestrator | Tuesday 28 April 2026 05:35:49 +0000 (0:00:01.174) 0:20:22.525 ********* 2026-04-28 05:36:17.146648 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:36:17.146658 | orchestrator | 2026-04-28 05:36:17.146667 | orchestrator | TASK [ceph-mgr : Include mgr_modules.yml] ************************************** 2026-04-28 05:36:17.146676 | orchestrator | Tuesday 28 April 2026 05:35:50 +0000 (0:00:01.137) 0:20:23.663 ********* 2026-04-28 05:36:17.146686 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:36:17.146695 | orchestrator | 2026-04-28 05:36:17.146718 | orchestrator | PLAY [Upgrade ceph mgr nodes when implicitly collocated on monitors] *********** 2026-04-28 05:36:17.146728 | orchestrator | 2026-04-28 05:36:17.146738 | orchestrator | TASK [Stop ceph mgr] *********************************************************** 2026-04-28 05:36:17.146747 | orchestrator | Tuesday 28 April 2026 05:35:51 +0000 (0:00:01.054) 0:20:24.717 ********* 2026-04-28 05:36:17.146756 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.146766 | orchestrator | 2026-04-28 05:36:17.146775 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 05:36:17.146785 | orchestrator | Tuesday 28 April 2026 05:35:52 +0000 (0:00:00.905) 0:20:25.623 ********* 2026-04-28 05:36:17.146794 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.146804 | orchestrator | 2026-04-28 05:36:17.146813 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 05:36:17.146840 | orchestrator | Tuesday 28 April 2026 05:35:53 +0000 (0:00:00.804) 0:20:26.427 ********* 2026-04-28 05:36:17.146851 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.146872 | orchestrator | 2026-04-28 05:36:17.146884 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 05:36:17.146895 | orchestrator | Tuesday 28 April 2026 05:35:53 +0000 (0:00:00.792) 0:20:27.220 ********* 2026-04-28 05:36:17.146905 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.146916 | orchestrator | 2026-04-28 05:36:17.146927 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 05:36:17.146938 | orchestrator | Tuesday 28 April 2026 05:35:54 +0000 (0:00:00.819) 0:20:28.039 ********* 2026-04-28 05:36:17.146972 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.146982 | orchestrator | 2026-04-28 05:36:17.146993 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 05:36:17.147004 | orchestrator | Tuesday 28 April 2026 05:35:55 +0000 (0:00:00.802) 0:20:28.842 ********* 2026-04-28 05:36:17.147015 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147026 | orchestrator | 2026-04-28 05:36:17.147037 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 05:36:17.147047 | orchestrator | Tuesday 28 April 2026 05:35:56 +0000 (0:00:00.757) 0:20:29.600 ********* 2026-04-28 05:36:17.147058 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147069 | orchestrator | 2026-04-28 05:36:17.147080 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 05:36:17.147091 | orchestrator | Tuesday 28 April 2026 05:35:57 +0000 (0:00:00.800) 0:20:30.400 ********* 2026-04-28 05:36:17.147102 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147113 | orchestrator | 2026-04-28 05:36:17.147124 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 05:36:17.147135 | orchestrator | Tuesday 28 April 2026 05:35:57 +0000 (0:00:00.798) 0:20:31.198 ********* 2026-04-28 05:36:17.147164 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147175 | orchestrator | 2026-04-28 05:36:17.147187 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 05:36:17.147199 | orchestrator | Tuesday 28 April 2026 05:35:58 +0000 (0:00:00.767) 0:20:31.966 ********* 2026-04-28 05:36:17.147210 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147220 | orchestrator | 2026-04-28 05:36:17.147230 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 05:36:17.147239 | orchestrator | Tuesday 28 April 2026 05:35:59 +0000 (0:00:00.817) 0:20:32.783 ********* 2026-04-28 05:36:17.147249 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147258 | orchestrator | 2026-04-28 05:36:17.147268 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 05:36:17.147277 | orchestrator | Tuesday 28 April 2026 05:36:00 +0000 (0:00:00.744) 0:20:33.528 ********* 2026-04-28 05:36:17.147287 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147296 | orchestrator | 2026-04-28 05:36:17.147306 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-28 05:36:17.147315 | orchestrator | Tuesday 28 April 2026 05:36:01 +0000 (0:00:00.926) 0:20:34.454 ********* 2026-04-28 05:36:17.147325 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147335 | orchestrator | 2026-04-28 05:36:17.147360 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-28 05:36:17.147371 | orchestrator | Tuesday 28 April 2026 05:36:01 +0000 (0:00:00.776) 0:20:35.231 ********* 2026-04-28 05:36:17.147380 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147390 | orchestrator | 2026-04-28 05:36:17.147399 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-28 05:36:17.147409 | orchestrator | Tuesday 28 April 2026 05:36:02 +0000 (0:00:00.761) 0:20:35.993 ********* 2026-04-28 05:36:17.147418 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147428 | orchestrator | 2026-04-28 05:36:17.147437 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-28 05:36:17.147447 | orchestrator | Tuesday 28 April 2026 05:36:03 +0000 (0:00:00.793) 0:20:36.786 ********* 2026-04-28 05:36:17.147456 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147466 | orchestrator | 2026-04-28 05:36:17.147475 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-28 05:36:17.147485 | orchestrator | Tuesday 28 April 2026 05:36:04 +0000 (0:00:00.760) 0:20:37.547 ********* 2026-04-28 05:36:17.147494 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147503 | orchestrator | 2026-04-28 05:36:17.147513 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-28 05:36:17.147522 | orchestrator | Tuesday 28 April 2026 05:36:04 +0000 (0:00:00.782) 0:20:38.330 ********* 2026-04-28 05:36:17.147532 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147541 | orchestrator | 2026-04-28 05:36:17.147551 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-28 05:36:17.147560 | orchestrator | Tuesday 28 April 2026 05:36:05 +0000 (0:00:00.763) 0:20:39.094 ********* 2026-04-28 05:36:17.147570 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147579 | orchestrator | 2026-04-28 05:36:17.147589 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-28 05:36:17.147599 | orchestrator | Tuesday 28 April 2026 05:36:06 +0000 (0:00:00.797) 0:20:39.892 ********* 2026-04-28 05:36:17.147613 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147623 | orchestrator | 2026-04-28 05:36:17.147633 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-28 05:36:17.147643 | orchestrator | Tuesday 28 April 2026 05:36:07 +0000 (0:00:00.772) 0:20:40.664 ********* 2026-04-28 05:36:17.147652 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147662 | orchestrator | 2026-04-28 05:36:17.147671 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-28 05:36:17.147680 | orchestrator | Tuesday 28 April 2026 05:36:08 +0000 (0:00:00.812) 0:20:41.477 ********* 2026-04-28 05:36:17.147696 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147705 | orchestrator | 2026-04-28 05:36:17.147715 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-28 05:36:17.147725 | orchestrator | Tuesday 28 April 2026 05:36:08 +0000 (0:00:00.849) 0:20:42.326 ********* 2026-04-28 05:36:17.147734 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147743 | orchestrator | 2026-04-28 05:36:17.147753 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-28 05:36:17.147762 | orchestrator | Tuesday 28 April 2026 05:36:09 +0000 (0:00:00.778) 0:20:43.105 ********* 2026-04-28 05:36:17.147772 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147781 | orchestrator | 2026-04-28 05:36:17.147790 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-28 05:36:17.147800 | orchestrator | Tuesday 28 April 2026 05:36:10 +0000 (0:00:00.921) 0:20:44.026 ********* 2026-04-28 05:36:17.147809 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147819 | orchestrator | 2026-04-28 05:36:17.147828 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-28 05:36:17.147837 | orchestrator | Tuesday 28 April 2026 05:36:11 +0000 (0:00:00.840) 0:20:44.867 ********* 2026-04-28 05:36:17.147847 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147856 | orchestrator | 2026-04-28 05:36:17.147866 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-28 05:36:17.147875 | orchestrator | Tuesday 28 April 2026 05:36:12 +0000 (0:00:00.802) 0:20:45.669 ********* 2026-04-28 05:36:17.147885 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147894 | orchestrator | 2026-04-28 05:36:17.147904 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-28 05:36:17.147913 | orchestrator | Tuesday 28 April 2026 05:36:13 +0000 (0:00:00.778) 0:20:46.448 ********* 2026-04-28 05:36:17.147922 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147932 | orchestrator | 2026-04-28 05:36:17.147956 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-28 05:36:17.147966 | orchestrator | Tuesday 28 April 2026 05:36:13 +0000 (0:00:00.816) 0:20:47.264 ********* 2026-04-28 05:36:17.147975 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.147985 | orchestrator | 2026-04-28 05:36:17.147994 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-28 05:36:17.148004 | orchestrator | Tuesday 28 April 2026 05:36:14 +0000 (0:00:00.772) 0:20:48.036 ********* 2026-04-28 05:36:17.148013 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.148023 | orchestrator | 2026-04-28 05:36:17.148032 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-28 05:36:17.148042 | orchestrator | Tuesday 28 April 2026 05:36:15 +0000 (0:00:00.801) 0:20:48.838 ********* 2026-04-28 05:36:17.148051 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.148060 | orchestrator | 2026-04-28 05:36:17.148070 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-28 05:36:17.148079 | orchestrator | Tuesday 28 April 2026 05:36:16 +0000 (0:00:00.770) 0:20:49.609 ********* 2026-04-28 05:36:17.148089 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.148098 | orchestrator | 2026-04-28 05:36:17.148108 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-28 05:36:17.148117 | orchestrator | Tuesday 28 April 2026 05:36:16 +0000 (0:00:00.763) 0:20:50.373 ********* 2026-04-28 05:36:17.148127 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:17.148137 | orchestrator | 2026-04-28 05:36:17.148153 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-28 05:36:47.398630 | orchestrator | Tuesday 28 April 2026 05:36:17 +0000 (0:00:00.777) 0:20:51.150 ********* 2026-04-28 05:36:47.398708 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.398715 | orchestrator | 2026-04-28 05:36:47.398720 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-28 05:36:47.398724 | orchestrator | Tuesday 28 April 2026 05:36:18 +0000 (0:00:00.766) 0:20:51.917 ********* 2026-04-28 05:36:47.398742 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.398746 | orchestrator | 2026-04-28 05:36:47.398750 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-28 05:36:47.398754 | orchestrator | Tuesday 28 April 2026 05:36:19 +0000 (0:00:00.770) 0:20:52.687 ********* 2026-04-28 05:36:47.398758 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.398762 | orchestrator | 2026-04-28 05:36:47.398766 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-28 05:36:47.398769 | orchestrator | Tuesday 28 April 2026 05:36:20 +0000 (0:00:00.769) 0:20:53.456 ********* 2026-04-28 05:36:47.398773 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.398777 | orchestrator | 2026-04-28 05:36:47.398781 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-28 05:36:47.398785 | orchestrator | Tuesday 28 April 2026 05:36:20 +0000 (0:00:00.816) 0:20:54.273 ********* 2026-04-28 05:36:47.398788 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.398792 | orchestrator | 2026-04-28 05:36:47.398796 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-28 05:36:47.398799 | orchestrator | Tuesday 28 April 2026 05:36:21 +0000 (0:00:00.783) 0:20:55.056 ********* 2026-04-28 05:36:47.398803 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.398807 | orchestrator | 2026-04-28 05:36:47.398810 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-28 05:36:47.398815 | orchestrator | Tuesday 28 April 2026 05:36:22 +0000 (0:00:00.769) 0:20:55.826 ********* 2026-04-28 05:36:47.398818 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.398822 | orchestrator | 2026-04-28 05:36:47.398835 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-28 05:36:47.398839 | orchestrator | Tuesday 28 April 2026 05:36:23 +0000 (0:00:00.780) 0:20:56.606 ********* 2026-04-28 05:36:47.398843 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.398847 | orchestrator | 2026-04-28 05:36:47.398851 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-28 05:36:47.398855 | orchestrator | Tuesday 28 April 2026 05:36:24 +0000 (0:00:00.784) 0:20:57.391 ********* 2026-04-28 05:36:47.398858 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.398862 | orchestrator | 2026-04-28 05:36:47.398866 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-28 05:36:47.398870 | orchestrator | Tuesday 28 April 2026 05:36:24 +0000 (0:00:00.789) 0:20:58.181 ********* 2026-04-28 05:36:47.398873 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.398877 | orchestrator | 2026-04-28 05:36:47.398881 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-28 05:36:47.398885 | orchestrator | Tuesday 28 April 2026 05:36:25 +0000 (0:00:00.768) 0:20:58.950 ********* 2026-04-28 05:36:47.398889 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.398892 | orchestrator | 2026-04-28 05:36:47.398896 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-28 05:36:47.398900 | orchestrator | Tuesday 28 April 2026 05:36:26 +0000 (0:00:00.766) 0:20:59.716 ********* 2026-04-28 05:36:47.398903 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.398907 | orchestrator | 2026-04-28 05:36:47.398910 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-28 05:36:47.398914 | orchestrator | Tuesday 28 April 2026 05:36:27 +0000 (0:00:00.753) 0:21:00.470 ********* 2026-04-28 05:36:47.398918 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.398921 | orchestrator | 2026-04-28 05:36:47.398958 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-28 05:36:47.398962 | orchestrator | Tuesday 28 April 2026 05:36:27 +0000 (0:00:00.868) 0:21:01.338 ********* 2026-04-28 05:36:47.398965 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.398969 | orchestrator | 2026-04-28 05:36:47.398973 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-28 05:36:47.398980 | orchestrator | Tuesday 28 April 2026 05:36:28 +0000 (0:00:00.780) 0:21:02.120 ********* 2026-04-28 05:36:47.398984 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.398987 | orchestrator | 2026-04-28 05:36:47.398991 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-28 05:36:47.398995 | orchestrator | Tuesday 28 April 2026 05:36:29 +0000 (0:00:00.865) 0:21:02.985 ********* 2026-04-28 05:36:47.398998 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.399002 | orchestrator | 2026-04-28 05:36:47.399006 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-28 05:36:47.399009 | orchestrator | Tuesday 28 April 2026 05:36:30 +0000 (0:00:00.786) 0:21:03.772 ********* 2026-04-28 05:36:47.399013 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.399017 | orchestrator | 2026-04-28 05:36:47.399020 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 05:36:47.399025 | orchestrator | Tuesday 28 April 2026 05:36:31 +0000 (0:00:00.847) 0:21:04.619 ********* 2026-04-28 05:36:47.399029 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.399033 | orchestrator | 2026-04-28 05:36:47.399037 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 05:36:47.399040 | orchestrator | Tuesday 28 April 2026 05:36:32 +0000 (0:00:00.765) 0:21:05.384 ********* 2026-04-28 05:36:47.399044 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.399048 | orchestrator | 2026-04-28 05:36:47.399051 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 05:36:47.399055 | orchestrator | Tuesday 28 April 2026 05:36:32 +0000 (0:00:00.765) 0:21:06.149 ********* 2026-04-28 05:36:47.399059 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.399063 | orchestrator | 2026-04-28 05:36:47.399075 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 05:36:47.399079 | orchestrator | Tuesday 28 April 2026 05:36:33 +0000 (0:00:00.771) 0:21:06.921 ********* 2026-04-28 05:36:47.399083 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.399086 | orchestrator | 2026-04-28 05:36:47.399090 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 05:36:47.399094 | orchestrator | Tuesday 28 April 2026 05:36:34 +0000 (0:00:00.767) 0:21:07.689 ********* 2026-04-28 05:36:47.399098 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-28 05:36:47.399102 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-28 05:36:47.399106 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-28 05:36:47.399109 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.399113 | orchestrator | 2026-04-28 05:36:47.399117 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 05:36:47.399120 | orchestrator | Tuesday 28 April 2026 05:36:35 +0000 (0:00:01.111) 0:21:08.800 ********* 2026-04-28 05:36:47.399124 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-28 05:36:47.399128 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-28 05:36:47.399131 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-28 05:36:47.399135 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.399139 | orchestrator | 2026-04-28 05:36:47.399142 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 05:36:47.399146 | orchestrator | Tuesday 28 April 2026 05:36:36 +0000 (0:00:01.069) 0:21:09.870 ********* 2026-04-28 05:36:47.399150 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-28 05:36:47.399153 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-28 05:36:47.399157 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-28 05:36:47.399161 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.399164 | orchestrator | 2026-04-28 05:36:47.399171 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 05:36:47.399180 | orchestrator | Tuesday 28 April 2026 05:36:37 +0000 (0:00:01.075) 0:21:10.946 ********* 2026-04-28 05:36:47.399184 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.399187 | orchestrator | 2026-04-28 05:36:47.399191 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 05:36:47.399195 | orchestrator | Tuesday 28 April 2026 05:36:38 +0000 (0:00:00.761) 0:21:11.707 ********* 2026-04-28 05:36:47.399199 | orchestrator | skipping: [testbed-node-1] => (item=0)  2026-04-28 05:36:47.399203 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.399207 | orchestrator | 2026-04-28 05:36:47.399211 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-28 05:36:47.399215 | orchestrator | Tuesday 28 April 2026 05:36:39 +0000 (0:00:00.899) 0:21:12.607 ********* 2026-04-28 05:36:47.399220 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.399224 | orchestrator | 2026-04-28 05:36:47.399228 | orchestrator | TASK [ceph-mgr : Set_fact container_exec_cmd] ********************************** 2026-04-28 05:36:47.399232 | orchestrator | Tuesday 28 April 2026 05:36:40 +0000 (0:00:00.801) 0:21:13.408 ********* 2026-04-28 05:36:47.399236 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-28 05:36:47.399241 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-28 05:36:47.399245 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-28 05:36:47.399249 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.399253 | orchestrator | 2026-04-28 05:36:47.399257 | orchestrator | TASK [ceph-mgr : Include common.yml] ******************************************* 2026-04-28 05:36:47.399262 | orchestrator | Tuesday 28 April 2026 05:36:41 +0000 (0:00:01.495) 0:21:14.904 ********* 2026-04-28 05:36:47.399266 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.399270 | orchestrator | 2026-04-28 05:36:47.399274 | orchestrator | TASK [ceph-mgr : Include pre_requisite.yml] ************************************ 2026-04-28 05:36:47.399278 | orchestrator | Tuesday 28 April 2026 05:36:42 +0000 (0:00:00.808) 0:21:15.712 ********* 2026-04-28 05:36:47.399283 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.399287 | orchestrator | 2026-04-28 05:36:47.399291 | orchestrator | TASK [ceph-mgr : Include start_mgr.yml] **************************************** 2026-04-28 05:36:47.399295 | orchestrator | Tuesday 28 April 2026 05:36:43 +0000 (0:00:00.781) 0:21:16.494 ********* 2026-04-28 05:36:47.399299 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.399304 | orchestrator | 2026-04-28 05:36:47.399308 | orchestrator | TASK [ceph-mgr : Include mgr_modules.yml] ************************************** 2026-04-28 05:36:47.399312 | orchestrator | Tuesday 28 April 2026 05:36:43 +0000 (0:00:00.782) 0:21:17.277 ********* 2026-04-28 05:36:47.399316 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:36:47.399320 | orchestrator | 2026-04-28 05:36:47.399324 | orchestrator | PLAY [Upgrade ceph mgr nodes when implicitly collocated on monitors] *********** 2026-04-28 05:36:47.399329 | orchestrator | 2026-04-28 05:36:47.399333 | orchestrator | TASK [Stop ceph mgr] *********************************************************** 2026-04-28 05:36:47.399337 | orchestrator | Tuesday 28 April 2026 05:36:44 +0000 (0:00:01.067) 0:21:18.345 ********* 2026-04-28 05:36:47.399341 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:36:47.399345 | orchestrator | 2026-04-28 05:36:47.399350 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 05:36:47.399354 | orchestrator | Tuesday 28 April 2026 05:36:45 +0000 (0:00:00.776) 0:21:19.122 ********* 2026-04-28 05:36:47.399358 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:36:47.399362 | orchestrator | 2026-04-28 05:36:47.399366 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 05:36:47.399371 | orchestrator | Tuesday 28 April 2026 05:36:46 +0000 (0:00:00.772) 0:21:19.894 ********* 2026-04-28 05:36:47.399375 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:36:47.399379 | orchestrator | 2026-04-28 05:36:47.399383 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 05:36:47.399388 | orchestrator | Tuesday 28 April 2026 05:36:47 +0000 (0:00:00.821) 0:21:20.716 ********* 2026-04-28 05:36:47.399398 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.324287 | orchestrator | 2026-04-28 05:37:19.324382 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 05:37:19.324395 | orchestrator | Tuesday 28 April 2026 05:36:48 +0000 (0:00:00.773) 0:21:21.490 ********* 2026-04-28 05:37:19.324402 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.324410 | orchestrator | 2026-04-28 05:37:19.324418 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 05:37:19.324425 | orchestrator | Tuesday 28 April 2026 05:36:48 +0000 (0:00:00.762) 0:21:22.252 ********* 2026-04-28 05:37:19.324431 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.324438 | orchestrator | 2026-04-28 05:37:19.324445 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 05:37:19.324452 | orchestrator | Tuesday 28 April 2026 05:36:49 +0000 (0:00:00.810) 0:21:23.063 ********* 2026-04-28 05:37:19.324459 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.324466 | orchestrator | 2026-04-28 05:37:19.324472 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 05:37:19.324479 | orchestrator | Tuesday 28 April 2026 05:36:50 +0000 (0:00:00.854) 0:21:23.918 ********* 2026-04-28 05:37:19.324485 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.324492 | orchestrator | 2026-04-28 05:37:19.324499 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 05:37:19.324506 | orchestrator | Tuesday 28 April 2026 05:36:51 +0000 (0:00:00.762) 0:21:24.681 ********* 2026-04-28 05:37:19.324512 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.324519 | orchestrator | 2026-04-28 05:37:19.324526 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 05:37:19.324532 | orchestrator | Tuesday 28 April 2026 05:36:52 +0000 (0:00:00.795) 0:21:25.477 ********* 2026-04-28 05:37:19.324539 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.324546 | orchestrator | 2026-04-28 05:37:19.324552 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 05:37:19.324559 | orchestrator | Tuesday 28 April 2026 05:36:52 +0000 (0:00:00.796) 0:21:26.274 ********* 2026-04-28 05:37:19.324581 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.324588 | orchestrator | 2026-04-28 05:37:19.324595 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 05:37:19.324602 | orchestrator | Tuesday 28 April 2026 05:36:53 +0000 (0:00:00.778) 0:21:27.053 ********* 2026-04-28 05:37:19.324608 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.324615 | orchestrator | 2026-04-28 05:37:19.324621 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-28 05:37:19.324628 | orchestrator | Tuesday 28 April 2026 05:36:54 +0000 (0:00:00.804) 0:21:27.857 ********* 2026-04-28 05:37:19.324634 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.324641 | orchestrator | 2026-04-28 05:37:19.324648 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-28 05:37:19.324655 | orchestrator | Tuesday 28 April 2026 05:36:55 +0000 (0:00:00.779) 0:21:28.637 ********* 2026-04-28 05:37:19.324661 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.324668 | orchestrator | 2026-04-28 05:37:19.324675 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-28 05:37:19.324681 | orchestrator | Tuesday 28 April 2026 05:36:56 +0000 (0:00:00.775) 0:21:29.413 ********* 2026-04-28 05:37:19.324688 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.324695 | orchestrator | 2026-04-28 05:37:19.324701 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-28 05:37:19.324708 | orchestrator | Tuesday 28 April 2026 05:36:56 +0000 (0:00:00.795) 0:21:30.209 ********* 2026-04-28 05:37:19.324714 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.324721 | orchestrator | 2026-04-28 05:37:19.324728 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-28 05:37:19.324735 | orchestrator | Tuesday 28 April 2026 05:36:57 +0000 (0:00:00.818) 0:21:31.027 ********* 2026-04-28 05:37:19.324760 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.324767 | orchestrator | 2026-04-28 05:37:19.324774 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-28 05:37:19.324781 | orchestrator | Tuesday 28 April 2026 05:36:58 +0000 (0:00:00.803) 0:21:31.831 ********* 2026-04-28 05:37:19.324787 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.324793 | orchestrator | 2026-04-28 05:37:19.324799 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-28 05:37:19.324805 | orchestrator | Tuesday 28 April 2026 05:36:59 +0000 (0:00:00.775) 0:21:32.607 ********* 2026-04-28 05:37:19.324810 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.324816 | orchestrator | 2026-04-28 05:37:19.324822 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-28 05:37:19.324829 | orchestrator | Tuesday 28 April 2026 05:37:00 +0000 (0:00:00.842) 0:21:33.449 ********* 2026-04-28 05:37:19.324835 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.324841 | orchestrator | 2026-04-28 05:37:19.324847 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-28 05:37:19.324854 | orchestrator | Tuesday 28 April 2026 05:37:00 +0000 (0:00:00.827) 0:21:34.277 ********* 2026-04-28 05:37:19.324860 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.324867 | orchestrator | 2026-04-28 05:37:19.324874 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-28 05:37:19.324880 | orchestrator | Tuesday 28 April 2026 05:37:01 +0000 (0:00:00.752) 0:21:35.030 ********* 2026-04-28 05:37:19.324888 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.324895 | orchestrator | 2026-04-28 05:37:19.324902 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-28 05:37:19.324929 | orchestrator | Tuesday 28 April 2026 05:37:02 +0000 (0:00:00.825) 0:21:35.856 ********* 2026-04-28 05:37:19.324936 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.324942 | orchestrator | 2026-04-28 05:37:19.324949 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-28 05:37:19.324955 | orchestrator | Tuesday 28 April 2026 05:37:03 +0000 (0:00:00.782) 0:21:36.638 ********* 2026-04-28 05:37:19.324962 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.324968 | orchestrator | 2026-04-28 05:37:19.324991 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-28 05:37:19.324999 | orchestrator | Tuesday 28 April 2026 05:37:04 +0000 (0:00:00.807) 0:21:37.446 ********* 2026-04-28 05:37:19.325006 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.325012 | orchestrator | 2026-04-28 05:37:19.325019 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-28 05:37:19.325026 | orchestrator | Tuesday 28 April 2026 05:37:04 +0000 (0:00:00.782) 0:21:38.228 ********* 2026-04-28 05:37:19.325033 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.325039 | orchestrator | 2026-04-28 05:37:19.325046 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-28 05:37:19.325052 | orchestrator | Tuesday 28 April 2026 05:37:05 +0000 (0:00:00.780) 0:21:39.008 ********* 2026-04-28 05:37:19.325059 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.325065 | orchestrator | 2026-04-28 05:37:19.325072 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-28 05:37:19.325078 | orchestrator | Tuesday 28 April 2026 05:37:06 +0000 (0:00:00.766) 0:21:39.775 ********* 2026-04-28 05:37:19.325085 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.325092 | orchestrator | 2026-04-28 05:37:19.325098 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-28 05:37:19.325104 | orchestrator | Tuesday 28 April 2026 05:37:07 +0000 (0:00:00.782) 0:21:40.558 ********* 2026-04-28 05:37:19.325111 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.325117 | orchestrator | 2026-04-28 05:37:19.325124 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-28 05:37:19.325138 | orchestrator | Tuesday 28 April 2026 05:37:07 +0000 (0:00:00.798) 0:21:41.356 ********* 2026-04-28 05:37:19.325144 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.325151 | orchestrator | 2026-04-28 05:37:19.325157 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-28 05:37:19.325164 | orchestrator | Tuesday 28 April 2026 05:37:08 +0000 (0:00:00.747) 0:21:42.104 ********* 2026-04-28 05:37:19.325171 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.325177 | orchestrator | 2026-04-28 05:37:19.325189 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-28 05:37:19.325196 | orchestrator | Tuesday 28 April 2026 05:37:09 +0000 (0:00:00.827) 0:21:42.932 ********* 2026-04-28 05:37:19.325202 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.325209 | orchestrator | 2026-04-28 05:37:19.325216 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-28 05:37:19.325222 | orchestrator | Tuesday 28 April 2026 05:37:10 +0000 (0:00:00.782) 0:21:43.715 ********* 2026-04-28 05:37:19.325228 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.325235 | orchestrator | 2026-04-28 05:37:19.325241 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-28 05:37:19.325248 | orchestrator | Tuesday 28 April 2026 05:37:11 +0000 (0:00:00.797) 0:21:44.513 ********* 2026-04-28 05:37:19.325254 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.325261 | orchestrator | 2026-04-28 05:37:19.325267 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-28 05:37:19.325273 | orchestrator | Tuesday 28 April 2026 05:37:11 +0000 (0:00:00.754) 0:21:45.268 ********* 2026-04-28 05:37:19.325280 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.325286 | orchestrator | 2026-04-28 05:37:19.325292 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-28 05:37:19.325299 | orchestrator | Tuesday 28 April 2026 05:37:12 +0000 (0:00:00.812) 0:21:46.081 ********* 2026-04-28 05:37:19.325305 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.325312 | orchestrator | 2026-04-28 05:37:19.325319 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-28 05:37:19.325325 | orchestrator | Tuesday 28 April 2026 05:37:13 +0000 (0:00:00.823) 0:21:46.904 ********* 2026-04-28 05:37:19.325331 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.325338 | orchestrator | 2026-04-28 05:37:19.325344 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-28 05:37:19.325351 | orchestrator | Tuesday 28 April 2026 05:37:14 +0000 (0:00:00.779) 0:21:47.684 ********* 2026-04-28 05:37:19.325357 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.325364 | orchestrator | 2026-04-28 05:37:19.325370 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-28 05:37:19.325377 | orchestrator | Tuesday 28 April 2026 05:37:15 +0000 (0:00:00.808) 0:21:48.492 ********* 2026-04-28 05:37:19.325383 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.325390 | orchestrator | 2026-04-28 05:37:19.325397 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-28 05:37:19.325404 | orchestrator | Tuesday 28 April 2026 05:37:15 +0000 (0:00:00.822) 0:21:49.315 ********* 2026-04-28 05:37:19.325411 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.325418 | orchestrator | 2026-04-28 05:37:19.325425 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-28 05:37:19.325432 | orchestrator | Tuesday 28 April 2026 05:37:16 +0000 (0:00:00.786) 0:21:50.102 ********* 2026-04-28 05:37:19.325438 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.325445 | orchestrator | 2026-04-28 05:37:19.325451 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-28 05:37:19.325458 | orchestrator | Tuesday 28 April 2026 05:37:17 +0000 (0:00:00.800) 0:21:50.903 ********* 2026-04-28 05:37:19.325465 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.325471 | orchestrator | 2026-04-28 05:37:19.325478 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-28 05:37:19.325488 | orchestrator | Tuesday 28 April 2026 05:37:18 +0000 (0:00:00.842) 0:21:51.746 ********* 2026-04-28 05:37:19.325495 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.325501 | orchestrator | 2026-04-28 05:37:19.325508 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-28 05:37:19.325514 | orchestrator | Tuesday 28 April 2026 05:37:19 +0000 (0:00:00.801) 0:21:52.547 ********* 2026-04-28 05:37:19.325520 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:37:19.325527 | orchestrator | 2026-04-28 05:37:19.325538 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-28 05:38:11.134701 | orchestrator | Tuesday 28 April 2026 05:37:19 +0000 (0:00:00.763) 0:21:53.311 ********* 2026-04-28 05:38:11.134819 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:38:11.134836 | orchestrator | 2026-04-28 05:38:11.134849 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-28 05:38:11.134861 | orchestrator | Tuesday 28 April 2026 05:37:20 +0000 (0:00:00.769) 0:21:54.080 ********* 2026-04-28 05:38:11.134873 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:38:11.134935 | orchestrator | 2026-04-28 05:38:11.134947 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-28 05:38:11.134958 | orchestrator | Tuesday 28 April 2026 05:37:21 +0000 (0:00:00.867) 0:21:54.948 ********* 2026-04-28 05:38:11.134969 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:38:11.134979 | orchestrator | 2026-04-28 05:38:11.134990 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-28 05:38:11.135001 | orchestrator | Tuesday 28 April 2026 05:37:22 +0000 (0:00:00.828) 0:21:55.777 ********* 2026-04-28 05:38:11.135012 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:38:11.135023 | orchestrator | 2026-04-28 05:38:11.135033 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-28 05:38:11.135044 | orchestrator | Tuesday 28 April 2026 05:37:23 +0000 (0:00:00.884) 0:21:56.662 ********* 2026-04-28 05:38:11.135055 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:38:11.135065 | orchestrator | 2026-04-28 05:38:11.135076 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-28 05:38:11.135087 | orchestrator | Tuesday 28 April 2026 05:37:24 +0000 (0:00:00.796) 0:21:57.458 ********* 2026-04-28 05:38:11.135097 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:38:11.135108 | orchestrator | 2026-04-28 05:38:11.135120 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 05:38:11.135148 | orchestrator | Tuesday 28 April 2026 05:37:24 +0000 (0:00:00.802) 0:21:58.261 ********* 2026-04-28 05:38:11.135160 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:38:11.135170 | orchestrator | 2026-04-28 05:38:11.135181 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 05:38:11.135192 | orchestrator | Tuesday 28 April 2026 05:37:25 +0000 (0:00:00.762) 0:21:59.024 ********* 2026-04-28 05:38:11.135203 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:38:11.135213 | orchestrator | 2026-04-28 05:38:11.135226 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 05:38:11.135238 | orchestrator | Tuesday 28 April 2026 05:37:26 +0000 (0:00:00.786) 0:21:59.811 ********* 2026-04-28 05:38:11.135250 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:38:11.135262 | orchestrator | 2026-04-28 05:38:11.135274 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 05:38:11.135287 | orchestrator | Tuesday 28 April 2026 05:37:27 +0000 (0:00:00.828) 0:22:00.640 ********* 2026-04-28 05:38:11.135299 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:38:11.135311 | orchestrator | 2026-04-28 05:38:11.135322 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 05:38:11.135334 | orchestrator | Tuesday 28 April 2026 05:37:28 +0000 (0:00:00.780) 0:22:01.421 ********* 2026-04-28 05:38:11.135370 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-28 05:38:11.135384 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-28 05:38:11.135397 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-28 05:38:11.135409 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:38:11.135421 | orchestrator | 2026-04-28 05:38:11.135433 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 05:38:11.135446 | orchestrator | Tuesday 28 April 2026 05:37:29 +0000 (0:00:01.413) 0:22:02.834 ********* 2026-04-28 05:38:11.135459 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-28 05:38:11.135470 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-28 05:38:11.135483 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-28 05:38:11.135494 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:38:11.135507 | orchestrator | 2026-04-28 05:38:11.135519 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 05:38:11.135532 | orchestrator | Tuesday 28 April 2026 05:37:30 +0000 (0:00:01.479) 0:22:04.314 ********* 2026-04-28 05:38:11.135544 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-28 05:38:11.135556 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-28 05:38:11.135567 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-28 05:38:11.135579 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:38:11.135592 | orchestrator | 2026-04-28 05:38:11.135603 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 05:38:11.135614 | orchestrator | Tuesday 28 April 2026 05:37:32 +0000 (0:00:01.615) 0:22:05.929 ********* 2026-04-28 05:38:11.135625 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:38:11.135635 | orchestrator | 2026-04-28 05:38:11.135646 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 05:38:11.135657 | orchestrator | Tuesday 28 April 2026 05:37:33 +0000 (0:00:00.775) 0:22:06.705 ********* 2026-04-28 05:38:11.135668 | orchestrator | skipping: [testbed-node-2] => (item=0)  2026-04-28 05:38:11.135679 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:38:11.135689 | orchestrator | 2026-04-28 05:38:11.135700 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-28 05:38:11.135711 | orchestrator | Tuesday 28 April 2026 05:37:34 +0000 (0:00:00.897) 0:22:07.602 ********* 2026-04-28 05:38:11.135721 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:38:11.135732 | orchestrator | 2026-04-28 05:38:11.135742 | orchestrator | TASK [ceph-mgr : Set_fact container_exec_cmd] ********************************** 2026-04-28 05:38:11.135753 | orchestrator | Tuesday 28 April 2026 05:37:35 +0000 (0:00:00.788) 0:22:08.391 ********* 2026-04-28 05:38:11.135764 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-28 05:38:11.135792 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-28 05:38:11.135803 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-28 05:38:11.135814 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:38:11.135825 | orchestrator | 2026-04-28 05:38:11.135836 | orchestrator | TASK [ceph-mgr : Include common.yml] ******************************************* 2026-04-28 05:38:11.135847 | orchestrator | Tuesday 28 April 2026 05:37:36 +0000 (0:00:01.117) 0:22:09.509 ********* 2026-04-28 05:38:11.135857 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:38:11.135868 | orchestrator | 2026-04-28 05:38:11.135913 | orchestrator | TASK [ceph-mgr : Include pre_requisite.yml] ************************************ 2026-04-28 05:38:11.135926 | orchestrator | Tuesday 28 April 2026 05:37:36 +0000 (0:00:00.776) 0:22:10.286 ********* 2026-04-28 05:38:11.135937 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:38:11.135947 | orchestrator | 2026-04-28 05:38:11.135958 | orchestrator | TASK [ceph-mgr : Include start_mgr.yml] **************************************** 2026-04-28 05:38:11.135969 | orchestrator | Tuesday 28 April 2026 05:37:37 +0000 (0:00:00.763) 0:22:11.049 ********* 2026-04-28 05:38:11.135979 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:38:11.136000 | orchestrator | 2026-04-28 05:38:11.136011 | orchestrator | TASK [ceph-mgr : Include mgr_modules.yml] ************************************** 2026-04-28 05:38:11.136021 | orchestrator | Tuesday 28 April 2026 05:37:38 +0000 (0:00:00.832) 0:22:11.881 ********* 2026-04-28 05:38:11.136032 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:38:11.136043 | orchestrator | 2026-04-28 05:38:11.136053 | orchestrator | PLAY [Upgrade ceph mgr nodes] ************************************************** 2026-04-28 05:38:11.136064 | orchestrator | 2026-04-28 05:38:11.136075 | orchestrator | TASK [Stop ceph mgr] *********************************************************** 2026-04-28 05:38:11.136085 | orchestrator | Tuesday 28 April 2026 05:37:39 +0000 (0:00:01.337) 0:22:13.219 ********* 2026-04-28 05:38:11.136096 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:38:11.136106 | orchestrator | 2026-04-28 05:38:11.136117 | orchestrator | TASK [Mask ceph mgr systemd unit] ********************************************** 2026-04-28 05:38:11.136133 | orchestrator | Tuesday 28 April 2026 05:37:52 +0000 (0:00:12.798) 0:22:26.018 ********* 2026-04-28 05:38:11.136144 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:38:11.136155 | orchestrator | 2026-04-28 05:38:11.136165 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 05:38:11.136176 | orchestrator | Tuesday 28 April 2026 05:37:55 +0000 (0:00:02.715) 0:22:28.733 ********* 2026-04-28 05:38:11.136187 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-0 2026-04-28 05:38:11.136197 | orchestrator | 2026-04-28 05:38:11.136208 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-28 05:38:11.136219 | orchestrator | Tuesday 28 April 2026 05:37:56 +0000 (0:00:01.139) 0:22:29.873 ********* 2026-04-28 05:38:11.136229 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:38:11.136240 | orchestrator | 2026-04-28 05:38:11.136251 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-28 05:38:11.136262 | orchestrator | Tuesday 28 April 2026 05:37:57 +0000 (0:00:01.502) 0:22:31.376 ********* 2026-04-28 05:38:11.136272 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:38:11.136287 | orchestrator | 2026-04-28 05:38:11.136305 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 05:38:11.136324 | orchestrator | Tuesday 28 April 2026 05:37:59 +0000 (0:00:01.129) 0:22:32.506 ********* 2026-04-28 05:38:11.136342 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:38:11.136362 | orchestrator | 2026-04-28 05:38:11.136381 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 05:38:11.136398 | orchestrator | Tuesday 28 April 2026 05:38:00 +0000 (0:00:01.460) 0:22:33.966 ********* 2026-04-28 05:38:11.136416 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:38:11.136427 | orchestrator | 2026-04-28 05:38:11.136438 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-28 05:38:11.136449 | orchestrator | Tuesday 28 April 2026 05:38:01 +0000 (0:00:01.126) 0:22:35.093 ********* 2026-04-28 05:38:11.136459 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:38:11.136470 | orchestrator | 2026-04-28 05:38:11.136480 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-28 05:38:11.136491 | orchestrator | Tuesday 28 April 2026 05:38:02 +0000 (0:00:01.114) 0:22:36.208 ********* 2026-04-28 05:38:11.136501 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:38:11.136512 | orchestrator | 2026-04-28 05:38:11.136523 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-28 05:38:11.136534 | orchestrator | Tuesday 28 April 2026 05:38:03 +0000 (0:00:01.138) 0:22:37.347 ********* 2026-04-28 05:38:11.136545 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:38:11.136555 | orchestrator | 2026-04-28 05:38:11.136566 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-28 05:38:11.136576 | orchestrator | Tuesday 28 April 2026 05:38:05 +0000 (0:00:01.171) 0:22:38.518 ********* 2026-04-28 05:38:11.136587 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:38:11.136598 | orchestrator | 2026-04-28 05:38:11.136608 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-28 05:38:11.136627 | orchestrator | Tuesday 28 April 2026 05:38:06 +0000 (0:00:01.129) 0:22:39.648 ********* 2026-04-28 05:38:11.136637 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:38:11.136648 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:38:11.136659 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:38:11.136670 | orchestrator | 2026-04-28 05:38:11.136680 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-28 05:38:11.136691 | orchestrator | Tuesday 28 April 2026 05:38:08 +0000 (0:00:01.976) 0:22:41.625 ********* 2026-04-28 05:38:11.136702 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:38:11.136712 | orchestrator | 2026-04-28 05:38:11.136723 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-28 05:38:11.136734 | orchestrator | Tuesday 28 April 2026 05:38:09 +0000 (0:00:01.661) 0:22:43.286 ********* 2026-04-28 05:38:11.136745 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:38:11.136763 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:38:34.609500 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:38:34.609610 | orchestrator | 2026-04-28 05:38:34.609626 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-28 05:38:34.609638 | orchestrator | Tuesday 28 April 2026 05:38:12 +0000 (0:00:02.856) 0:22:46.142 ********* 2026-04-28 05:38:34.609649 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-28 05:38:34.609659 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-28 05:38:34.609669 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-28 05:38:34.609679 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:38:34.609689 | orchestrator | 2026-04-28 05:38:34.609699 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-28 05:38:34.609708 | orchestrator | Tuesday 28 April 2026 05:38:14 +0000 (0:00:01.419) 0:22:47.562 ********* 2026-04-28 05:38:34.609719 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-28 05:38:34.609732 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-28 05:38:34.609757 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-28 05:38:34.609768 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:38:34.609778 | orchestrator | 2026-04-28 05:38:34.609788 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-28 05:38:34.609798 | orchestrator | Tuesday 28 April 2026 05:38:15 +0000 (0:00:01.726) 0:22:49.289 ********* 2026-04-28 05:38:34.609810 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:38:34.609823 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:38:34.609854 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:38:34.609916 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:38:34.609929 | orchestrator | 2026-04-28 05:38:34.609939 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-28 05:38:34.609948 | orchestrator | Tuesday 28 April 2026 05:38:17 +0000 (0:00:01.173) 0:22:50.463 ********* 2026-04-28 05:38:34.609960 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': 'e79a9ee6c12b', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-28 05:38:10.470613', 'end': '2026-04-28 05:38:10.521845', 'delta': '0:00:00.051232', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e79a9ee6c12b'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-28 05:38:34.609993 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': '00fb93644bb9', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-28 05:38:11.022546', 'end': '2026-04-28 05:38:11.080969', 'delta': '0:00:00.058423', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['00fb93644bb9'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-28 05:38:34.610012 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': '92b926b7d044', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-28 05:38:11.574525', 'end': '2026-04-28 05:38:11.621941', 'delta': '0:00:00.047416', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['92b926b7d044'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-28 05:38:34.610092 | orchestrator | 2026-04-28 05:38:34.610111 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-28 05:38:34.610131 | orchestrator | Tuesday 28 April 2026 05:38:18 +0000 (0:00:01.184) 0:22:51.648 ********* 2026-04-28 05:38:34.610143 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:38:34.610155 | orchestrator | 2026-04-28 05:38:34.610172 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-28 05:38:34.610187 | orchestrator | Tuesday 28 April 2026 05:38:19 +0000 (0:00:01.316) 0:22:52.964 ********* 2026-04-28 05:38:34.610204 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:38:34.610220 | orchestrator | 2026-04-28 05:38:34.610236 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-28 05:38:34.610252 | orchestrator | Tuesday 28 April 2026 05:38:20 +0000 (0:00:01.250) 0:22:54.214 ********* 2026-04-28 05:38:34.610282 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:38:34.610296 | orchestrator | 2026-04-28 05:38:34.610311 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-28 05:38:34.610328 | orchestrator | Tuesday 28 April 2026 05:38:21 +0000 (0:00:01.138) 0:22:55.353 ********* 2026-04-28 05:38:34.610344 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:38:34.610362 | orchestrator | 2026-04-28 05:38:34.610379 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 05:38:34.610395 | orchestrator | Tuesday 28 April 2026 05:38:23 +0000 (0:00:01.990) 0:22:57.343 ********* 2026-04-28 05:38:34.610411 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:38:34.610426 | orchestrator | 2026-04-28 05:38:34.610442 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-28 05:38:34.610459 | orchestrator | Tuesday 28 April 2026 05:38:25 +0000 (0:00:01.214) 0:22:58.557 ********* 2026-04-28 05:38:34.610475 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:38:34.610492 | orchestrator | 2026-04-28 05:38:34.610502 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-28 05:38:34.610511 | orchestrator | Tuesday 28 April 2026 05:38:26 +0000 (0:00:01.110) 0:22:59.668 ********* 2026-04-28 05:38:34.610521 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:38:34.610530 | orchestrator | 2026-04-28 05:38:34.610540 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 05:38:34.610549 | orchestrator | Tuesday 28 April 2026 05:38:27 +0000 (0:00:01.226) 0:23:00.895 ********* 2026-04-28 05:38:34.610558 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:38:34.610568 | orchestrator | 2026-04-28 05:38:34.610577 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-28 05:38:34.610586 | orchestrator | Tuesday 28 April 2026 05:38:28 +0000 (0:00:01.195) 0:23:02.091 ********* 2026-04-28 05:38:34.610596 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:38:34.610605 | orchestrator | 2026-04-28 05:38:34.610617 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-28 05:38:34.610632 | orchestrator | Tuesday 28 April 2026 05:38:29 +0000 (0:00:01.197) 0:23:03.288 ********* 2026-04-28 05:38:34.610649 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:38:34.610664 | orchestrator | 2026-04-28 05:38:34.610681 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-28 05:38:34.610697 | orchestrator | Tuesday 28 April 2026 05:38:31 +0000 (0:00:01.141) 0:23:04.430 ********* 2026-04-28 05:38:34.610713 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:38:34.610731 | orchestrator | 2026-04-28 05:38:34.610747 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-28 05:38:34.610763 | orchestrator | Tuesday 28 April 2026 05:38:32 +0000 (0:00:01.135) 0:23:05.565 ********* 2026-04-28 05:38:34.610772 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:38:34.610782 | orchestrator | 2026-04-28 05:38:34.610791 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-28 05:38:34.610801 | orchestrator | Tuesday 28 April 2026 05:38:33 +0000 (0:00:01.147) 0:23:06.713 ********* 2026-04-28 05:38:34.610810 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:38:34.610820 | orchestrator | 2026-04-28 05:38:34.610829 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-28 05:38:34.610839 | orchestrator | Tuesday 28 April 2026 05:38:34 +0000 (0:00:01.128) 0:23:07.842 ********* 2026-04-28 05:38:34.610849 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:38:34.610858 | orchestrator | 2026-04-28 05:38:34.610907 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-28 05:38:37.034405 | orchestrator | Tuesday 28 April 2026 05:38:35 +0000 (0:00:01.208) 0:23:09.051 ********* 2026-04-28 05:38:37.034522 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:38:37.034578 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:38:37.034625 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:38:37.034645 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-19-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 05:38:37.034665 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:38:37.034681 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:38:37.034699 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:38:37.034747 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '12b9c610', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part16', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part14', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part15', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part1', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:38:37.034786 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:38:37.034806 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:38:37.034824 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:38:37.034844 | orchestrator | 2026-04-28 05:38:37.034861 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-28 05:38:37.034955 | orchestrator | Tuesday 28 April 2026 05:38:36 +0000 (0:00:01.271) 0:23:10.322 ********* 2026-04-28 05:38:37.034977 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:38:37.034998 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:38:37.035029 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:38:48.355451 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-19-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:38:48.355583 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:38:48.355601 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:38:48.355614 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:38:48.355649 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '12b9c610', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part16', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part14', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part15', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part1', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:38:48.355693 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:38:48.355707 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:38:48.355719 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:38:48.355732 | orchestrator | 2026-04-28 05:38:48.355744 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-28 05:38:48.355756 | orchestrator | Tuesday 28 April 2026 05:38:38 +0000 (0:00:01.228) 0:23:11.550 ********* 2026-04-28 05:38:48.355767 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:38:48.355779 | orchestrator | 2026-04-28 05:38:48.355790 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-28 05:38:48.355801 | orchestrator | Tuesday 28 April 2026 05:38:39 +0000 (0:00:01.496) 0:23:13.047 ********* 2026-04-28 05:38:48.355812 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:38:48.355823 | orchestrator | 2026-04-28 05:38:48.355833 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 05:38:48.355844 | orchestrator | Tuesday 28 April 2026 05:38:40 +0000 (0:00:01.182) 0:23:14.230 ********* 2026-04-28 05:38:48.355855 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:38:48.355952 | orchestrator | 2026-04-28 05:38:48.355965 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 05:38:48.355976 | orchestrator | Tuesday 28 April 2026 05:38:42 +0000 (0:00:01.501) 0:23:15.732 ********* 2026-04-28 05:38:48.355989 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:38:48.356001 | orchestrator | 2026-04-28 05:38:48.356013 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 05:38:48.356026 | orchestrator | Tuesday 28 April 2026 05:38:43 +0000 (0:00:01.114) 0:23:16.847 ********* 2026-04-28 05:38:48.356038 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:38:48.356059 | orchestrator | 2026-04-28 05:38:48.356072 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 05:38:48.356085 | orchestrator | Tuesday 28 April 2026 05:38:45 +0000 (0:00:01.815) 0:23:18.662 ********* 2026-04-28 05:38:48.356097 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:38:48.356110 | orchestrator | 2026-04-28 05:38:48.356122 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-28 05:38:48.356135 | orchestrator | Tuesday 28 April 2026 05:38:46 +0000 (0:00:01.133) 0:23:19.796 ********* 2026-04-28 05:38:48.356146 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:38:48.356157 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-28 05:38:48.356168 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-28 05:38:48.356178 | orchestrator | 2026-04-28 05:38:48.356189 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-28 05:38:48.356200 | orchestrator | Tuesday 28 April 2026 05:38:48 +0000 (0:00:01.757) 0:23:21.553 ********* 2026-04-28 05:38:48.356210 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-28 05:38:48.356221 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-28 05:38:48.356232 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-28 05:38:48.356243 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:38:48.356254 | orchestrator | 2026-04-28 05:38:48.356273 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-28 05:39:32.825807 | orchestrator | Tuesday 28 April 2026 05:38:49 +0000 (0:00:01.137) 0:23:22.691 ********* 2026-04-28 05:39:32.825951 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.825968 | orchestrator | 2026-04-28 05:39:32.825980 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-28 05:39:32.825991 | orchestrator | Tuesday 28 April 2026 05:38:50 +0000 (0:00:01.125) 0:23:23.816 ********* 2026-04-28 05:39:32.826003 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:39:32.826014 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:39:32.826082 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:39:32.826093 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 05:39:32.826104 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 05:39:32.826114 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 05:39:32.826125 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 05:39:32.826136 | orchestrator | 2026-04-28 05:39:32.826147 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-28 05:39:32.826158 | orchestrator | Tuesday 28 April 2026 05:38:52 +0000 (0:00:01.864) 0:23:25.680 ********* 2026-04-28 05:39:32.826169 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:39:32.826180 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:39:32.826206 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:39:32.826217 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 05:39:32.826228 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 05:39:32.826239 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 05:39:32.826249 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 05:39:32.826260 | orchestrator | 2026-04-28 05:39:32.826271 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 05:39:32.826282 | orchestrator | Tuesday 28 April 2026 05:38:55 +0000 (0:00:02.709) 0:23:28.390 ********* 2026-04-28 05:39:32.826313 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-0 2026-04-28 05:39:32.826326 | orchestrator | 2026-04-28 05:39:32.826337 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 05:39:32.826349 | orchestrator | Tuesday 28 April 2026 05:38:56 +0000 (0:00:01.138) 0:23:29.529 ********* 2026-04-28 05:39:32.826363 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-0 2026-04-28 05:39:32.826375 | orchestrator | 2026-04-28 05:39:32.826387 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 05:39:32.826399 | orchestrator | Tuesday 28 April 2026 05:38:57 +0000 (0:00:01.102) 0:23:30.632 ********* 2026-04-28 05:39:32.826413 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:39:32.826425 | orchestrator | 2026-04-28 05:39:32.826437 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 05:39:32.826449 | orchestrator | Tuesday 28 April 2026 05:38:58 +0000 (0:00:01.541) 0:23:32.174 ********* 2026-04-28 05:39:32.826462 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.826474 | orchestrator | 2026-04-28 05:39:32.826486 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 05:39:32.826498 | orchestrator | Tuesday 28 April 2026 05:39:00 +0000 (0:00:01.284) 0:23:33.458 ********* 2026-04-28 05:39:32.826511 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.826523 | orchestrator | 2026-04-28 05:39:32.826535 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 05:39:32.826547 | orchestrator | Tuesday 28 April 2026 05:39:01 +0000 (0:00:01.138) 0:23:34.597 ********* 2026-04-28 05:39:32.826560 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.826572 | orchestrator | 2026-04-28 05:39:32.826584 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 05:39:32.826596 | orchestrator | Tuesday 28 April 2026 05:39:02 +0000 (0:00:01.160) 0:23:35.758 ********* 2026-04-28 05:39:32.826607 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:39:32.826618 | orchestrator | 2026-04-28 05:39:32.826628 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 05:39:32.826639 | orchestrator | Tuesday 28 April 2026 05:39:03 +0000 (0:00:01.605) 0:23:37.363 ********* 2026-04-28 05:39:32.826649 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.826660 | orchestrator | 2026-04-28 05:39:32.826670 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 05:39:32.826681 | orchestrator | Tuesday 28 April 2026 05:39:05 +0000 (0:00:01.220) 0:23:38.584 ********* 2026-04-28 05:39:32.826691 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.826702 | orchestrator | 2026-04-28 05:39:32.826712 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 05:39:32.826723 | orchestrator | Tuesday 28 April 2026 05:39:06 +0000 (0:00:01.167) 0:23:39.751 ********* 2026-04-28 05:39:32.826734 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:39:32.826744 | orchestrator | 2026-04-28 05:39:32.826755 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 05:39:32.826765 | orchestrator | Tuesday 28 April 2026 05:39:08 +0000 (0:00:01.689) 0:23:41.441 ********* 2026-04-28 05:39:32.826776 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:39:32.826787 | orchestrator | 2026-04-28 05:39:32.826797 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 05:39:32.826824 | orchestrator | Tuesday 28 April 2026 05:39:09 +0000 (0:00:01.571) 0:23:43.013 ********* 2026-04-28 05:39:32.826836 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.826867 | orchestrator | 2026-04-28 05:39:32.826878 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 05:39:32.826889 | orchestrator | Tuesday 28 April 2026 05:39:10 +0000 (0:00:01.166) 0:23:44.179 ********* 2026-04-28 05:39:32.826899 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:39:32.826910 | orchestrator | 2026-04-28 05:39:32.826921 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 05:39:32.826940 | orchestrator | Tuesday 28 April 2026 05:39:11 +0000 (0:00:01.145) 0:23:45.325 ********* 2026-04-28 05:39:32.826951 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.826961 | orchestrator | 2026-04-28 05:39:32.826972 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 05:39:32.826983 | orchestrator | Tuesday 28 April 2026 05:39:13 +0000 (0:00:01.121) 0:23:46.447 ********* 2026-04-28 05:39:32.826993 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.827004 | orchestrator | 2026-04-28 05:39:32.827015 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 05:39:32.827025 | orchestrator | Tuesday 28 April 2026 05:39:14 +0000 (0:00:01.121) 0:23:47.568 ********* 2026-04-28 05:39:32.827036 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.827047 | orchestrator | 2026-04-28 05:39:32.827058 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 05:39:32.827068 | orchestrator | Tuesday 28 April 2026 05:39:15 +0000 (0:00:01.144) 0:23:48.713 ********* 2026-04-28 05:39:32.827079 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.827090 | orchestrator | 2026-04-28 05:39:32.827100 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 05:39:32.827116 | orchestrator | Tuesday 28 April 2026 05:39:16 +0000 (0:00:01.184) 0:23:49.898 ********* 2026-04-28 05:39:32.827127 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.827138 | orchestrator | 2026-04-28 05:39:32.827149 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 05:39:32.827159 | orchestrator | Tuesday 28 April 2026 05:39:17 +0000 (0:00:01.290) 0:23:51.189 ********* 2026-04-28 05:39:32.827170 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:39:32.827181 | orchestrator | 2026-04-28 05:39:32.827192 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 05:39:32.827202 | orchestrator | Tuesday 28 April 2026 05:39:18 +0000 (0:00:01.134) 0:23:52.324 ********* 2026-04-28 05:39:32.827213 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:39:32.827224 | orchestrator | 2026-04-28 05:39:32.827235 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 05:39:32.827246 | orchestrator | Tuesday 28 April 2026 05:39:20 +0000 (0:00:01.155) 0:23:53.480 ********* 2026-04-28 05:39:32.827256 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:39:32.827267 | orchestrator | 2026-04-28 05:39:32.827278 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-28 05:39:32.827288 | orchestrator | Tuesday 28 April 2026 05:39:21 +0000 (0:00:01.121) 0:23:54.601 ********* 2026-04-28 05:39:32.827299 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.827310 | orchestrator | 2026-04-28 05:39:32.827321 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-28 05:39:32.827331 | orchestrator | Tuesday 28 April 2026 05:39:22 +0000 (0:00:01.163) 0:23:55.765 ********* 2026-04-28 05:39:32.827342 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.827353 | orchestrator | 2026-04-28 05:39:32.827363 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-28 05:39:32.827374 | orchestrator | Tuesday 28 April 2026 05:39:23 +0000 (0:00:01.135) 0:23:56.901 ********* 2026-04-28 05:39:32.827384 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.827395 | orchestrator | 2026-04-28 05:39:32.827406 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-28 05:39:32.827417 | orchestrator | Tuesday 28 April 2026 05:39:24 +0000 (0:00:01.206) 0:23:58.108 ********* 2026-04-28 05:39:32.827427 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.827438 | orchestrator | 2026-04-28 05:39:32.827448 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-28 05:39:32.827459 | orchestrator | Tuesday 28 April 2026 05:39:25 +0000 (0:00:01.115) 0:23:59.223 ********* 2026-04-28 05:39:32.827470 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.827480 | orchestrator | 2026-04-28 05:39:32.827491 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-28 05:39:32.827508 | orchestrator | Tuesday 28 April 2026 05:39:26 +0000 (0:00:01.158) 0:24:00.382 ********* 2026-04-28 05:39:32.827519 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.827530 | orchestrator | 2026-04-28 05:39:32.827540 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-28 05:39:32.827551 | orchestrator | Tuesday 28 April 2026 05:39:28 +0000 (0:00:01.135) 0:24:01.518 ********* 2026-04-28 05:39:32.827562 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.827572 | orchestrator | 2026-04-28 05:39:32.827583 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-28 05:39:32.827593 | orchestrator | Tuesday 28 April 2026 05:39:29 +0000 (0:00:01.146) 0:24:02.664 ********* 2026-04-28 05:39:32.827604 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.827615 | orchestrator | 2026-04-28 05:39:32.827625 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-28 05:39:32.827636 | orchestrator | Tuesday 28 April 2026 05:39:30 +0000 (0:00:01.121) 0:24:03.786 ********* 2026-04-28 05:39:32.827647 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.827657 | orchestrator | 2026-04-28 05:39:32.827668 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-28 05:39:32.827678 | orchestrator | Tuesday 28 April 2026 05:39:31 +0000 (0:00:01.173) 0:24:04.959 ********* 2026-04-28 05:39:32.827689 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.827700 | orchestrator | 2026-04-28 05:39:32.827710 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-28 05:39:32.827721 | orchestrator | Tuesday 28 April 2026 05:39:32 +0000 (0:00:01.099) 0:24:06.059 ********* 2026-04-28 05:39:32.827732 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:39:32.827742 | orchestrator | 2026-04-28 05:39:32.827759 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-28 05:40:21.809235 | orchestrator | Tuesday 28 April 2026 05:39:33 +0000 (0:00:01.126) 0:24:07.185 ********* 2026-04-28 05:40:21.809351 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:40:21.809366 | orchestrator | 2026-04-28 05:40:21.809377 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-28 05:40:21.809388 | orchestrator | Tuesday 28 April 2026 05:39:34 +0000 (0:00:01.142) 0:24:08.327 ********* 2026-04-28 05:40:21.809398 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:40:21.809408 | orchestrator | 2026-04-28 05:40:21.809418 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-28 05:40:21.809428 | orchestrator | Tuesday 28 April 2026 05:39:36 +0000 (0:00:01.968) 0:24:10.296 ********* 2026-04-28 05:40:21.809437 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:40:21.809447 | orchestrator | 2026-04-28 05:40:21.809456 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-28 05:40:21.809466 | orchestrator | Tuesday 28 April 2026 05:39:39 +0000 (0:00:02.371) 0:24:12.667 ********* 2026-04-28 05:40:21.809475 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-0 2026-04-28 05:40:21.809485 | orchestrator | 2026-04-28 05:40:21.809495 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-28 05:40:21.809504 | orchestrator | Tuesday 28 April 2026 05:39:40 +0000 (0:00:01.175) 0:24:13.843 ********* 2026-04-28 05:40:21.809514 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:40:21.809524 | orchestrator | 2026-04-28 05:40:21.809533 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-28 05:40:21.809543 | orchestrator | Tuesday 28 April 2026 05:39:41 +0000 (0:00:01.134) 0:24:14.978 ********* 2026-04-28 05:40:21.809569 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:40:21.809579 | orchestrator | 2026-04-28 05:40:21.809589 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-28 05:40:21.809598 | orchestrator | Tuesday 28 April 2026 05:39:42 +0000 (0:00:01.184) 0:24:16.162 ********* 2026-04-28 05:40:21.809608 | orchestrator | ok: [testbed-node-0] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-28 05:40:21.809638 | orchestrator | ok: [testbed-node-0] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-28 05:40:21.809649 | orchestrator | 2026-04-28 05:40:21.809659 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-28 05:40:21.809668 | orchestrator | Tuesday 28 April 2026 05:39:44 +0000 (0:00:01.843) 0:24:18.006 ********* 2026-04-28 05:40:21.809678 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:40:21.809687 | orchestrator | 2026-04-28 05:40:21.809697 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-28 05:40:21.809706 | orchestrator | Tuesday 28 April 2026 05:39:46 +0000 (0:00:01.494) 0:24:19.500 ********* 2026-04-28 05:40:21.809715 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:40:21.809725 | orchestrator | 2026-04-28 05:40:21.809734 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-28 05:40:21.809744 | orchestrator | Tuesday 28 April 2026 05:39:47 +0000 (0:00:01.163) 0:24:20.664 ********* 2026-04-28 05:40:21.809755 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:40:21.809766 | orchestrator | 2026-04-28 05:40:21.809776 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-28 05:40:21.809787 | orchestrator | Tuesday 28 April 2026 05:39:48 +0000 (0:00:01.129) 0:24:21.794 ********* 2026-04-28 05:40:21.809798 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:40:21.809809 | orchestrator | 2026-04-28 05:40:21.809820 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-28 05:40:21.809856 | orchestrator | Tuesday 28 April 2026 05:39:49 +0000 (0:00:01.256) 0:24:23.050 ********* 2026-04-28 05:40:21.809867 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-0 2026-04-28 05:40:21.809878 | orchestrator | 2026-04-28 05:40:21.809890 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-28 05:40:21.809900 | orchestrator | Tuesday 28 April 2026 05:39:50 +0000 (0:00:01.137) 0:24:24.188 ********* 2026-04-28 05:40:21.809911 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:40:21.809922 | orchestrator | 2026-04-28 05:40:21.809933 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-28 05:40:21.809944 | orchestrator | Tuesday 28 April 2026 05:39:52 +0000 (0:00:01.740) 0:24:25.929 ********* 2026-04-28 05:40:21.809955 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-28 05:40:21.809966 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-28 05:40:21.809977 | orchestrator | skipping: [testbed-node-0] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-28 05:40:21.809988 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:40:21.809998 | orchestrator | 2026-04-28 05:40:21.810009 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-28 05:40:21.810096 | orchestrator | Tuesday 28 April 2026 05:39:53 +0000 (0:00:01.167) 0:24:27.096 ********* 2026-04-28 05:40:21.810108 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:40:21.810118 | orchestrator | 2026-04-28 05:40:21.810128 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-28 05:40:21.810138 | orchestrator | Tuesday 28 April 2026 05:39:54 +0000 (0:00:01.155) 0:24:28.252 ********* 2026-04-28 05:40:21.810147 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:40:21.810157 | orchestrator | 2026-04-28 05:40:21.810166 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-28 05:40:21.810175 | orchestrator | Tuesday 28 April 2026 05:39:56 +0000 (0:00:01.210) 0:24:29.463 ********* 2026-04-28 05:40:21.810185 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:40:21.810194 | orchestrator | 2026-04-28 05:40:21.810203 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-28 05:40:21.810213 | orchestrator | Tuesday 28 April 2026 05:39:57 +0000 (0:00:01.142) 0:24:30.605 ********* 2026-04-28 05:40:21.810222 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:40:21.810231 | orchestrator | 2026-04-28 05:40:21.810258 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-28 05:40:21.810278 | orchestrator | Tuesday 28 April 2026 05:39:58 +0000 (0:00:01.160) 0:24:31.766 ********* 2026-04-28 05:40:21.810287 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:40:21.810297 | orchestrator | 2026-04-28 05:40:21.810306 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-28 05:40:21.810316 | orchestrator | Tuesday 28 April 2026 05:39:59 +0000 (0:00:01.159) 0:24:32.926 ********* 2026-04-28 05:40:21.810325 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:40:21.810340 | orchestrator | 2026-04-28 05:40:21.810355 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-28 05:40:21.810371 | orchestrator | Tuesday 28 April 2026 05:40:02 +0000 (0:00:02.633) 0:24:35.560 ********* 2026-04-28 05:40:21.810387 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:40:21.810402 | orchestrator | 2026-04-28 05:40:21.810415 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-28 05:40:21.810431 | orchestrator | Tuesday 28 April 2026 05:40:03 +0000 (0:00:01.164) 0:24:36.725 ********* 2026-04-28 05:40:21.810446 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-0 2026-04-28 05:40:21.810461 | orchestrator | 2026-04-28 05:40:21.810476 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-28 05:40:21.810491 | orchestrator | Tuesday 28 April 2026 05:40:04 +0000 (0:00:01.196) 0:24:37.921 ********* 2026-04-28 05:40:21.810506 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:40:21.810523 | orchestrator | 2026-04-28 05:40:21.810540 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-28 05:40:21.810556 | orchestrator | Tuesday 28 April 2026 05:40:05 +0000 (0:00:01.121) 0:24:39.042 ********* 2026-04-28 05:40:21.810578 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:40:21.810588 | orchestrator | 2026-04-28 05:40:21.810598 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-28 05:40:21.810607 | orchestrator | Tuesday 28 April 2026 05:40:06 +0000 (0:00:01.186) 0:24:40.229 ********* 2026-04-28 05:40:21.810617 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:40:21.810626 | orchestrator | 2026-04-28 05:40:21.810635 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-28 05:40:21.810645 | orchestrator | Tuesday 28 April 2026 05:40:07 +0000 (0:00:01.108) 0:24:41.338 ********* 2026-04-28 05:40:21.810654 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:40:21.810663 | orchestrator | 2026-04-28 05:40:21.810673 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-28 05:40:21.810682 | orchestrator | Tuesday 28 April 2026 05:40:09 +0000 (0:00:01.118) 0:24:42.456 ********* 2026-04-28 05:40:21.810691 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:40:21.810701 | orchestrator | 2026-04-28 05:40:21.810710 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-28 05:40:21.810719 | orchestrator | Tuesday 28 April 2026 05:40:10 +0000 (0:00:01.123) 0:24:43.580 ********* 2026-04-28 05:40:21.810729 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:40:21.810738 | orchestrator | 2026-04-28 05:40:21.810748 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-28 05:40:21.810757 | orchestrator | Tuesday 28 April 2026 05:40:11 +0000 (0:00:01.142) 0:24:44.722 ********* 2026-04-28 05:40:21.810767 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:40:21.810776 | orchestrator | 2026-04-28 05:40:21.810785 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-28 05:40:21.810795 | orchestrator | Tuesday 28 April 2026 05:40:12 +0000 (0:00:01.132) 0:24:45.854 ********* 2026-04-28 05:40:21.810804 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:40:21.810813 | orchestrator | 2026-04-28 05:40:21.810823 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-28 05:40:21.810858 | orchestrator | Tuesday 28 April 2026 05:40:13 +0000 (0:00:01.221) 0:24:47.076 ********* 2026-04-28 05:40:21.810868 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:40:21.810887 | orchestrator | 2026-04-28 05:40:21.810897 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-28 05:40:21.810906 | orchestrator | Tuesday 28 April 2026 05:40:14 +0000 (0:00:01.154) 0:24:48.231 ********* 2026-04-28 05:40:21.810916 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-0 2026-04-28 05:40:21.810925 | orchestrator | 2026-04-28 05:40:21.810935 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-28 05:40:21.810944 | orchestrator | Tuesday 28 April 2026 05:40:16 +0000 (0:00:01.315) 0:24:49.546 ********* 2026-04-28 05:40:21.810954 | orchestrator | ok: [testbed-node-0] => (item=/etc/ceph) 2026-04-28 05:40:21.810964 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/) 2026-04-28 05:40:21.810974 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/mon) 2026-04-28 05:40:21.810983 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/osd) 2026-04-28 05:40:21.810993 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/mds) 2026-04-28 05:40:21.811002 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/tmp) 2026-04-28 05:40:21.811012 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/crash) 2026-04-28 05:40:21.811021 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/radosgw) 2026-04-28 05:40:21.811031 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-28 05:40:21.811041 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-28 05:40:21.811050 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-28 05:40:21.811060 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-28 05:40:21.811069 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-28 05:40:21.811079 | orchestrator | ok: [testbed-node-0] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-28 05:40:21.811089 | orchestrator | ok: [testbed-node-0] => (item=/var/run/ceph) 2026-04-28 05:40:21.811098 | orchestrator | ok: [testbed-node-0] => (item=/var/log/ceph) 2026-04-28 05:40:21.811108 | orchestrator | 2026-04-28 05:40:21.811126 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-28 05:41:14.716055 | orchestrator | Tuesday 28 April 2026 05:40:22 +0000 (0:00:06.650) 0:24:56.197 ********* 2026-04-28 05:41:14.716174 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.716190 | orchestrator | 2026-04-28 05:41:14.716203 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-28 05:41:14.716214 | orchestrator | Tuesday 28 April 2026 05:40:23 +0000 (0:00:01.120) 0:24:57.317 ********* 2026-04-28 05:41:14.716225 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.716235 | orchestrator | 2026-04-28 05:41:14.716246 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-28 05:41:14.716257 | orchestrator | Tuesday 28 April 2026 05:40:25 +0000 (0:00:01.147) 0:24:58.464 ********* 2026-04-28 05:41:14.716268 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.716278 | orchestrator | 2026-04-28 05:41:14.716289 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-28 05:41:14.716300 | orchestrator | Tuesday 28 April 2026 05:40:26 +0000 (0:00:01.119) 0:24:59.584 ********* 2026-04-28 05:41:14.716310 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.716321 | orchestrator | 2026-04-28 05:41:14.716332 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-28 05:41:14.716342 | orchestrator | Tuesday 28 April 2026 05:40:27 +0000 (0:00:01.116) 0:25:00.700 ********* 2026-04-28 05:41:14.716353 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.716363 | orchestrator | 2026-04-28 05:41:14.716374 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-28 05:41:14.716385 | orchestrator | Tuesday 28 April 2026 05:40:28 +0000 (0:00:01.135) 0:25:01.836 ********* 2026-04-28 05:41:14.716395 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.716406 | orchestrator | 2026-04-28 05:41:14.716432 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-28 05:41:14.716468 | orchestrator | Tuesday 28 April 2026 05:40:29 +0000 (0:00:01.118) 0:25:02.954 ********* 2026-04-28 05:41:14.716479 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.716489 | orchestrator | 2026-04-28 05:41:14.716500 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-28 05:41:14.716511 | orchestrator | Tuesday 28 April 2026 05:40:30 +0000 (0:00:01.165) 0:25:04.120 ********* 2026-04-28 05:41:14.716521 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.716532 | orchestrator | 2026-04-28 05:41:14.716542 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-28 05:41:14.716553 | orchestrator | Tuesday 28 April 2026 05:40:31 +0000 (0:00:01.144) 0:25:05.264 ********* 2026-04-28 05:41:14.716564 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.716576 | orchestrator | 2026-04-28 05:41:14.716588 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-28 05:41:14.716601 | orchestrator | Tuesday 28 April 2026 05:40:32 +0000 (0:00:01.101) 0:25:06.366 ********* 2026-04-28 05:41:14.716613 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.716625 | orchestrator | 2026-04-28 05:41:14.716637 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-28 05:41:14.716649 | orchestrator | Tuesday 28 April 2026 05:40:34 +0000 (0:00:01.121) 0:25:07.487 ********* 2026-04-28 05:41:14.716662 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.716674 | orchestrator | 2026-04-28 05:41:14.716686 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-28 05:41:14.716699 | orchestrator | Tuesday 28 April 2026 05:40:35 +0000 (0:00:01.108) 0:25:08.596 ********* 2026-04-28 05:41:14.716711 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.716722 | orchestrator | 2026-04-28 05:41:14.716734 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-28 05:41:14.716746 | orchestrator | Tuesday 28 April 2026 05:40:36 +0000 (0:00:01.192) 0:25:09.789 ********* 2026-04-28 05:41:14.716758 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.716770 | orchestrator | 2026-04-28 05:41:14.716782 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-28 05:41:14.716794 | orchestrator | Tuesday 28 April 2026 05:40:37 +0000 (0:00:01.218) 0:25:11.008 ********* 2026-04-28 05:41:14.716806 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.716844 | orchestrator | 2026-04-28 05:41:14.716856 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-28 05:41:14.716868 | orchestrator | Tuesday 28 April 2026 05:40:38 +0000 (0:00:01.110) 0:25:12.118 ********* 2026-04-28 05:41:14.716881 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.716892 | orchestrator | 2026-04-28 05:41:14.716904 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-28 05:41:14.716917 | orchestrator | Tuesday 28 April 2026 05:40:39 +0000 (0:00:01.249) 0:25:13.368 ********* 2026-04-28 05:41:14.716929 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.716939 | orchestrator | 2026-04-28 05:41:14.716950 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-28 05:41:14.716960 | orchestrator | Tuesday 28 April 2026 05:40:41 +0000 (0:00:01.160) 0:25:14.529 ********* 2026-04-28 05:41:14.716971 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.716982 | orchestrator | 2026-04-28 05:41:14.716993 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 05:41:14.717005 | orchestrator | Tuesday 28 April 2026 05:40:42 +0000 (0:00:01.152) 0:25:15.681 ********* 2026-04-28 05:41:14.717016 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.717026 | orchestrator | 2026-04-28 05:41:14.717037 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 05:41:14.717048 | orchestrator | Tuesday 28 April 2026 05:40:43 +0000 (0:00:01.131) 0:25:16.813 ********* 2026-04-28 05:41:14.717068 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.717078 | orchestrator | 2026-04-28 05:41:14.717089 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 05:41:14.717100 | orchestrator | Tuesday 28 April 2026 05:40:44 +0000 (0:00:01.185) 0:25:17.998 ********* 2026-04-28 05:41:14.717111 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.717121 | orchestrator | 2026-04-28 05:41:14.717150 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 05:41:14.717162 | orchestrator | Tuesday 28 April 2026 05:40:45 +0000 (0:00:01.110) 0:25:19.109 ********* 2026-04-28 05:41:14.717172 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.717183 | orchestrator | 2026-04-28 05:41:14.717194 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 05:41:14.717204 | orchestrator | Tuesday 28 April 2026 05:40:46 +0000 (0:00:01.156) 0:25:20.265 ********* 2026-04-28 05:41:14.717215 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-28 05:41:14.717226 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-28 05:41:14.717237 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-28 05:41:14.717248 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.717258 | orchestrator | 2026-04-28 05:41:14.717269 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 05:41:14.717280 | orchestrator | Tuesday 28 April 2026 05:40:48 +0000 (0:00:01.422) 0:25:21.688 ********* 2026-04-28 05:41:14.717290 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-28 05:41:14.717301 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-28 05:41:14.717312 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-28 05:41:14.717322 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.717333 | orchestrator | 2026-04-28 05:41:14.717344 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 05:41:14.717360 | orchestrator | Tuesday 28 April 2026 05:40:50 +0000 (0:00:01.813) 0:25:23.502 ********* 2026-04-28 05:41:14.717371 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-28 05:41:14.717381 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-4)  2026-04-28 05:41:14.717392 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-28 05:41:14.717403 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.717413 | orchestrator | 2026-04-28 05:41:14.717424 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 05:41:14.717434 | orchestrator | Tuesday 28 April 2026 05:40:51 +0000 (0:00:01.782) 0:25:25.285 ********* 2026-04-28 05:41:14.717445 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.717456 | orchestrator | 2026-04-28 05:41:14.717466 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 05:41:14.717477 | orchestrator | Tuesday 28 April 2026 05:40:53 +0000 (0:00:01.259) 0:25:26.545 ********* 2026-04-28 05:41:14.717488 | orchestrator | skipping: [testbed-node-0] => (item=0)  2026-04-28 05:41:14.717499 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.717510 | orchestrator | 2026-04-28 05:41:14.717521 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-28 05:41:14.717531 | orchestrator | Tuesday 28 April 2026 05:40:54 +0000 (0:00:01.295) 0:25:27.840 ********* 2026-04-28 05:41:14.717542 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:41:14.717553 | orchestrator | 2026-04-28 05:41:14.717564 | orchestrator | TASK [ceph-mgr : Set_fact container_exec_cmd] ********************************** 2026-04-28 05:41:14.717575 | orchestrator | Tuesday 28 April 2026 05:40:56 +0000 (0:00:01.765) 0:25:29.605 ********* 2026-04-28 05:41:14.717585 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 05:41:14.717596 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:41:14.717608 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:41:14.717626 | orchestrator | 2026-04-28 05:41:14.717637 | orchestrator | TASK [ceph-mgr : Include common.yml] ******************************************* 2026-04-28 05:41:14.717647 | orchestrator | Tuesday 28 April 2026 05:40:57 +0000 (0:00:01.647) 0:25:31.254 ********* 2026-04-28 05:41:14.717658 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/common.yml for testbed-node-0 2026-04-28 05:41:14.717668 | orchestrator | 2026-04-28 05:41:14.717679 | orchestrator | TASK [ceph-mgr : Create mgr directory] ***************************************** 2026-04-28 05:41:14.717690 | orchestrator | Tuesday 28 April 2026 05:40:59 +0000 (0:00:01.449) 0:25:32.703 ********* 2026-04-28 05:41:14.717701 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:41:14.717711 | orchestrator | 2026-04-28 05:41:14.717722 | orchestrator | TASK [ceph-mgr : Fetch ceph mgr keyring] *************************************** 2026-04-28 05:41:14.717733 | orchestrator | Tuesday 28 April 2026 05:41:00 +0000 (0:00:01.580) 0:25:34.283 ********* 2026-04-28 05:41:14.717743 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:41:14.717754 | orchestrator | 2026-04-28 05:41:14.717765 | orchestrator | TASK [ceph-mgr : Create ceph mgr keyring(s) on a mon node] ********************* 2026-04-28 05:41:14.717775 | orchestrator | Tuesday 28 April 2026 05:41:02 +0000 (0:00:01.175) 0:25:35.459 ********* 2026-04-28 05:41:14.717786 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-28 05:41:14.717797 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-28 05:41:14.717829 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-28 05:41:14.717849 | orchestrator | ok: [testbed-node-0 -> {{ groups[mon_group_name][0] }}] 2026-04-28 05:41:14.717869 | orchestrator | 2026-04-28 05:41:14.717887 | orchestrator | TASK [ceph-mgr : Set_fact _mgr_keys] ******************************************* 2026-04-28 05:41:14.717904 | orchestrator | Tuesday 28 April 2026 05:41:09 +0000 (0:00:07.663) 0:25:43.122 ********* 2026-04-28 05:41:14.717916 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:41:14.717927 | orchestrator | 2026-04-28 05:41:14.717938 | orchestrator | TASK [ceph-mgr : Get keys from monitors] *************************************** 2026-04-28 05:41:14.717948 | orchestrator | Tuesday 28 April 2026 05:41:10 +0000 (0:00:01.231) 0:25:44.353 ********* 2026-04-28 05:41:14.717959 | orchestrator | skipping: [testbed-node-0] => (item=None)  2026-04-28 05:41:14.717970 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-28 05:41:14.717980 | orchestrator | 2026-04-28 05:41:14.717991 | orchestrator | TASK [ceph-mgr : Copy ceph key(s) if needed] *********************************** 2026-04-28 05:41:14.718002 | orchestrator | Tuesday 28 April 2026 05:41:14 +0000 (0:00:03.654) 0:25:48.007 ********* 2026-04-28 05:41:14.718078 | orchestrator | skipping: [testbed-node-0] => (item=None)  2026-04-28 05:42:02.088364 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-28 05:42:02.088486 | orchestrator | 2026-04-28 05:42:02.088510 | orchestrator | TASK [ceph-mgr : Set mgr key permissions] ************************************** 2026-04-28 05:42:02.088527 | orchestrator | Tuesday 28 April 2026 05:41:16 +0000 (0:00:02.149) 0:25:50.157 ********* 2026-04-28 05:42:02.088543 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:42:02.088559 | orchestrator | 2026-04-28 05:42:02.088573 | orchestrator | TASK [ceph-mgr : Append dashboard modules to ceph_mgr_modules] ***************** 2026-04-28 05:42:02.088586 | orchestrator | Tuesday 28 April 2026 05:41:18 +0000 (0:00:01.549) 0:25:51.707 ********* 2026-04-28 05:42:02.088596 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:42:02.088604 | orchestrator | 2026-04-28 05:42:02.088613 | orchestrator | TASK [ceph-mgr : Include pre_requisite.yml] ************************************ 2026-04-28 05:42:02.088622 | orchestrator | Tuesday 28 April 2026 05:41:19 +0000 (0:00:01.122) 0:25:52.830 ********* 2026-04-28 05:42:02.088631 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:42:02.088639 | orchestrator | 2026-04-28 05:42:02.088648 | orchestrator | TASK [ceph-mgr : Include start_mgr.yml] **************************************** 2026-04-28 05:42:02.088656 | orchestrator | Tuesday 28 April 2026 05:41:20 +0000 (0:00:01.169) 0:25:53.999 ********* 2026-04-28 05:42:02.088665 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/start_mgr.yml for testbed-node-0 2026-04-28 05:42:02.088674 | orchestrator | 2026-04-28 05:42:02.088706 | orchestrator | TASK [ceph-mgr : Ensure systemd service override directory exists] ************* 2026-04-28 05:42:02.088716 | orchestrator | Tuesday 28 April 2026 05:41:22 +0000 (0:00:01.504) 0:25:55.504 ********* 2026-04-28 05:42:02.088738 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:42:02.088747 | orchestrator | 2026-04-28 05:42:02.088755 | orchestrator | TASK [ceph-mgr : Add ceph-mgr systemd service overrides] *********************** 2026-04-28 05:42:02.088764 | orchestrator | Tuesday 28 April 2026 05:41:23 +0000 (0:00:01.232) 0:25:56.736 ********* 2026-04-28 05:42:02.088772 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:42:02.088781 | orchestrator | 2026-04-28 05:42:02.088789 | orchestrator | TASK [ceph-mgr : Include_tasks systemd.yml] ************************************ 2026-04-28 05:42:02.088798 | orchestrator | Tuesday 28 April 2026 05:41:24 +0000 (0:00:01.150) 0:25:57.886 ********* 2026-04-28 05:42:02.088857 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/systemd.yml for testbed-node-0 2026-04-28 05:42:02.088867 | orchestrator | 2026-04-28 05:42:02.088875 | orchestrator | TASK [ceph-mgr : Generate systemd unit file] *********************************** 2026-04-28 05:42:02.088884 | orchestrator | Tuesday 28 April 2026 05:41:26 +0000 (0:00:01.540) 0:25:59.427 ********* 2026-04-28 05:42:02.088893 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:42:02.088901 | orchestrator | 2026-04-28 05:42:02.088912 | orchestrator | TASK [ceph-mgr : Generate systemd ceph-mgr target file] ************************ 2026-04-28 05:42:02.088923 | orchestrator | Tuesday 28 April 2026 05:41:28 +0000 (0:00:02.124) 0:26:01.551 ********* 2026-04-28 05:42:02.088933 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:42:02.088944 | orchestrator | 2026-04-28 05:42:02.088954 | orchestrator | TASK [ceph-mgr : Enable ceph-mgr.target] *************************************** 2026-04-28 05:42:02.088964 | orchestrator | Tuesday 28 April 2026 05:41:30 +0000 (0:00:02.015) 0:26:03.567 ********* 2026-04-28 05:42:02.088974 | orchestrator | ok: [testbed-node-0] 2026-04-28 05:42:02.088984 | orchestrator | 2026-04-28 05:42:02.088994 | orchestrator | TASK [ceph-mgr : Systemd start mgr] ******************************************** 2026-04-28 05:42:02.089004 | orchestrator | Tuesday 28 April 2026 05:41:32 +0000 (0:00:02.453) 0:26:06.020 ********* 2026-04-28 05:42:02.089015 | orchestrator | changed: [testbed-node-0] 2026-04-28 05:42:02.089025 | orchestrator | 2026-04-28 05:42:02.089035 | orchestrator | TASK [ceph-mgr : Include mgr_modules.yml] ************************************** 2026-04-28 05:42:02.089046 | orchestrator | Tuesday 28 April 2026 05:41:36 +0000 (0:00:03.819) 0:26:09.840 ********* 2026-04-28 05:42:02.089057 | orchestrator | skipping: [testbed-node-0] 2026-04-28 05:42:02.089067 | orchestrator | 2026-04-28 05:42:02.089077 | orchestrator | PLAY [Upgrade ceph mgr nodes] ************************************************** 2026-04-28 05:42:02.089088 | orchestrator | 2026-04-28 05:42:02.089098 | orchestrator | TASK [Stop ceph mgr] *********************************************************** 2026-04-28 05:42:02.089108 | orchestrator | Tuesday 28 April 2026 05:41:37 +0000 (0:00:00.984) 0:26:10.825 ********* 2026-04-28 05:42:02.089118 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:42:02.089129 | orchestrator | 2026-04-28 05:42:02.089139 | orchestrator | TASK [Mask ceph mgr systemd unit] ********************************************** 2026-04-28 05:42:02.089149 | orchestrator | Tuesday 28 April 2026 05:41:40 +0000 (0:00:02.612) 0:26:13.437 ********* 2026-04-28 05:42:02.089159 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:42:02.089169 | orchestrator | 2026-04-28 05:42:02.089179 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 05:42:02.089189 | orchestrator | Tuesday 28 April 2026 05:41:42 +0000 (0:00:02.145) 0:26:15.583 ********* 2026-04-28 05:42:02.089200 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-1 2026-04-28 05:42:02.089210 | orchestrator | 2026-04-28 05:42:02.089220 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-28 05:42:02.089230 | orchestrator | Tuesday 28 April 2026 05:41:43 +0000 (0:00:01.116) 0:26:16.699 ********* 2026-04-28 05:42:02.089240 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:42:02.089250 | orchestrator | 2026-04-28 05:42:02.089260 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-28 05:42:02.089277 | orchestrator | Tuesday 28 April 2026 05:41:44 +0000 (0:00:01.514) 0:26:18.213 ********* 2026-04-28 05:42:02.089286 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:42:02.089294 | orchestrator | 2026-04-28 05:42:02.089302 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 05:42:02.089311 | orchestrator | Tuesday 28 April 2026 05:41:45 +0000 (0:00:01.149) 0:26:19.363 ********* 2026-04-28 05:42:02.089319 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:42:02.089328 | orchestrator | 2026-04-28 05:42:02.089336 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 05:42:02.089345 | orchestrator | Tuesday 28 April 2026 05:41:47 +0000 (0:00:01.480) 0:26:20.844 ********* 2026-04-28 05:42:02.089353 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:42:02.089362 | orchestrator | 2026-04-28 05:42:02.089388 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-28 05:42:02.089398 | orchestrator | Tuesday 28 April 2026 05:41:48 +0000 (0:00:01.155) 0:26:22.000 ********* 2026-04-28 05:42:02.089406 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:42:02.089415 | orchestrator | 2026-04-28 05:42:02.089423 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-28 05:42:02.089432 | orchestrator | Tuesday 28 April 2026 05:41:49 +0000 (0:00:01.123) 0:26:23.123 ********* 2026-04-28 05:42:02.089440 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:42:02.089448 | orchestrator | 2026-04-28 05:42:02.089457 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-28 05:42:02.089465 | orchestrator | Tuesday 28 April 2026 05:41:51 +0000 (0:00:01.263) 0:26:24.386 ********* 2026-04-28 05:42:02.089474 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:02.089482 | orchestrator | 2026-04-28 05:42:02.089490 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-28 05:42:02.089499 | orchestrator | Tuesday 28 April 2026 05:41:52 +0000 (0:00:01.185) 0:26:25.572 ********* 2026-04-28 05:42:02.089507 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:42:02.089516 | orchestrator | 2026-04-28 05:42:02.089524 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-28 05:42:02.089533 | orchestrator | Tuesday 28 April 2026 05:41:53 +0000 (0:00:01.145) 0:26:26.718 ********* 2026-04-28 05:42:02.089542 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:42:02.089550 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-28 05:42:02.089564 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:42:02.089572 | orchestrator | 2026-04-28 05:42:02.089581 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-28 05:42:02.089589 | orchestrator | Tuesday 28 April 2026 05:41:55 +0000 (0:00:01.690) 0:26:28.409 ********* 2026-04-28 05:42:02.089598 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:42:02.089606 | orchestrator | 2026-04-28 05:42:02.089614 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-28 05:42:02.089623 | orchestrator | Tuesday 28 April 2026 05:41:56 +0000 (0:00:01.271) 0:26:29.681 ********* 2026-04-28 05:42:02.089632 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:42:02.089640 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-28 05:42:02.089649 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:42:02.089657 | orchestrator | 2026-04-28 05:42:02.089666 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-28 05:42:02.089674 | orchestrator | Tuesday 28 April 2026 05:41:58 +0000 (0:00:02.662) 0:26:32.343 ********* 2026-04-28 05:42:02.089682 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-28 05:42:02.089692 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-28 05:42:02.089700 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-28 05:42:02.089708 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:02.089723 | orchestrator | 2026-04-28 05:42:02.089731 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-28 05:42:02.089740 | orchestrator | Tuesday 28 April 2026 05:42:00 +0000 (0:00:01.400) 0:26:33.743 ********* 2026-04-28 05:42:02.089750 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-28 05:42:02.089761 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-28 05:42:02.089770 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-28 05:42:02.089779 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:02.089787 | orchestrator | 2026-04-28 05:42:02.089796 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-28 05:42:02.089825 | orchestrator | Tuesday 28 April 2026 05:42:01 +0000 (0:00:01.625) 0:26:35.369 ********* 2026-04-28 05:42:02.089848 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:42:02.089869 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:42:02.089886 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:42:22.444604 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:22.444725 | orchestrator | 2026-04-28 05:42:22.444743 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-28 05:42:22.444756 | orchestrator | Tuesday 28 April 2026 05:42:03 +0000 (0:00:01.179) 0:26:36.548 ********* 2026-04-28 05:42:22.444787 | orchestrator | ok: [testbed-node-1] => (item={'changed': False, 'stdout': 'e79a9ee6c12b', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-28 05:41:56.792425', 'end': '2026-04-28 05:41:56.841964', 'delta': '0:00:00.049539', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e79a9ee6c12b'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-28 05:42:22.444869 | orchestrator | ok: [testbed-node-1] => (item={'changed': False, 'stdout': '00fb93644bb9', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-28 05:41:57.307276', 'end': '2026-04-28 05:41:57.335457', 'delta': '0:00:00.028181', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['00fb93644bb9'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-28 05:42:22.444906 | orchestrator | ok: [testbed-node-1] => (item={'changed': False, 'stdout': '92b926b7d044', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-28 05:41:57.792729', 'end': '2026-04-28 05:41:57.828682', 'delta': '0:00:00.035953', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['92b926b7d044'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-28 05:42:22.444918 | orchestrator | 2026-04-28 05:42:22.444929 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-28 05:42:22.444940 | orchestrator | Tuesday 28 April 2026 05:42:04 +0000 (0:00:01.204) 0:26:37.753 ********* 2026-04-28 05:42:22.444951 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:42:22.444963 | orchestrator | 2026-04-28 05:42:22.444974 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-28 05:42:22.444985 | orchestrator | Tuesday 28 April 2026 05:42:05 +0000 (0:00:01.250) 0:26:39.004 ********* 2026-04-28 05:42:22.444995 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:22.445006 | orchestrator | 2026-04-28 05:42:22.445016 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-28 05:42:22.445027 | orchestrator | Tuesday 28 April 2026 05:42:06 +0000 (0:00:01.243) 0:26:40.247 ********* 2026-04-28 05:42:22.445037 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:42:22.445048 | orchestrator | 2026-04-28 05:42:22.445059 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-28 05:42:22.445069 | orchestrator | Tuesday 28 April 2026 05:42:08 +0000 (0:00:01.139) 0:26:41.387 ********* 2026-04-28 05:42:22.445080 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] 2026-04-28 05:42:22.445091 | orchestrator | 2026-04-28 05:42:22.445101 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 05:42:22.445112 | orchestrator | Tuesday 28 April 2026 05:42:10 +0000 (0:00:02.803) 0:26:44.190 ********* 2026-04-28 05:42:22.445122 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:42:22.445133 | orchestrator | 2026-04-28 05:42:22.445145 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-28 05:42:22.445158 | orchestrator | Tuesday 28 April 2026 05:42:11 +0000 (0:00:01.130) 0:26:45.321 ********* 2026-04-28 05:42:22.445171 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:22.445184 | orchestrator | 2026-04-28 05:42:22.445196 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-28 05:42:22.445210 | orchestrator | Tuesday 28 April 2026 05:42:13 +0000 (0:00:01.189) 0:26:46.511 ********* 2026-04-28 05:42:22.445222 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:22.445234 | orchestrator | 2026-04-28 05:42:22.445246 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 05:42:22.445258 | orchestrator | Tuesday 28 April 2026 05:42:14 +0000 (0:00:01.225) 0:26:47.736 ********* 2026-04-28 05:42:22.445271 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:22.445283 | orchestrator | 2026-04-28 05:42:22.445314 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-28 05:42:22.445327 | orchestrator | Tuesday 28 April 2026 05:42:15 +0000 (0:00:01.113) 0:26:48.850 ********* 2026-04-28 05:42:22.445347 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:22.445359 | orchestrator | 2026-04-28 05:42:22.445371 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-28 05:42:22.445383 | orchestrator | Tuesday 28 April 2026 05:42:16 +0000 (0:00:01.141) 0:26:49.991 ********* 2026-04-28 05:42:22.445395 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:22.445407 | orchestrator | 2026-04-28 05:42:22.445419 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-28 05:42:22.445431 | orchestrator | Tuesday 28 April 2026 05:42:17 +0000 (0:00:01.159) 0:26:51.151 ********* 2026-04-28 05:42:22.445443 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:22.445455 | orchestrator | 2026-04-28 05:42:22.445468 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-28 05:42:22.445487 | orchestrator | Tuesday 28 April 2026 05:42:18 +0000 (0:00:01.124) 0:26:52.276 ********* 2026-04-28 05:42:22.445499 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:22.445510 | orchestrator | 2026-04-28 05:42:22.445521 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-28 05:42:22.445531 | orchestrator | Tuesday 28 April 2026 05:42:20 +0000 (0:00:01.121) 0:26:53.397 ********* 2026-04-28 05:42:22.445542 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:22.445552 | orchestrator | 2026-04-28 05:42:22.445563 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-28 05:42:22.445575 | orchestrator | Tuesday 28 April 2026 05:42:21 +0000 (0:00:01.171) 0:26:54.569 ********* 2026-04-28 05:42:22.445586 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:22.445596 | orchestrator | 2026-04-28 05:42:22.445607 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-28 05:42:22.445617 | orchestrator | Tuesday 28 April 2026 05:42:22 +0000 (0:00:01.125) 0:26:55.695 ********* 2026-04-28 05:42:22.445629 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:42:22.445642 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:42:22.445653 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:42:22.445666 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-12-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 05:42:22.445678 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:42:22.445697 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:42:22.445716 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:42:23.675583 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '16596406', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part16', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part14', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part15', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part1', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:42:23.675681 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:42:23.675696 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:42:23.675725 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:23.675736 | orchestrator | 2026-04-28 05:42:23.675745 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-28 05:42:23.675755 | orchestrator | Tuesday 28 April 2026 05:42:23 +0000 (0:00:01.236) 0:26:56.931 ********* 2026-04-28 05:42:23.675766 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:42:23.675795 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:42:23.675892 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:42:23.675903 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-12-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:42:23.675913 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:42:23.675923 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:42:23.675940 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:42:23.675965 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '16596406', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part16', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part14', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part15', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part1', 'scsi-SQEMU_QEMU_HARDDISK_16596406-df52-44b5-ad95-4abccf821828-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:42:58.693588 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:42:58.693709 | orchestrator | skipping: [testbed-node-1] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:42:58.693751 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:58.693767 | orchestrator | 2026-04-28 05:42:58.693779 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-28 05:42:58.693851 | orchestrator | Tuesday 28 April 2026 05:42:24 +0000 (0:00:01.236) 0:26:58.168 ********* 2026-04-28 05:42:58.693865 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:42:58.693877 | orchestrator | 2026-04-28 05:42:58.693888 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-28 05:42:58.693899 | orchestrator | Tuesday 28 April 2026 05:42:26 +0000 (0:00:01.680) 0:26:59.848 ********* 2026-04-28 05:42:58.693909 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:42:58.693920 | orchestrator | 2026-04-28 05:42:58.693930 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 05:42:58.693941 | orchestrator | Tuesday 28 April 2026 05:42:27 +0000 (0:00:01.134) 0:27:00.982 ********* 2026-04-28 05:42:58.693952 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:42:58.693962 | orchestrator | 2026-04-28 05:42:58.693973 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 05:42:58.693983 | orchestrator | Tuesday 28 April 2026 05:42:29 +0000 (0:00:01.505) 0:27:02.488 ********* 2026-04-28 05:42:58.693994 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:58.694004 | orchestrator | 2026-04-28 05:42:58.694067 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 05:42:58.694081 | orchestrator | Tuesday 28 April 2026 05:42:30 +0000 (0:00:01.289) 0:27:03.778 ********* 2026-04-28 05:42:58.694091 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:58.694102 | orchestrator | 2026-04-28 05:42:58.694113 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 05:42:58.694126 | orchestrator | Tuesday 28 April 2026 05:42:31 +0000 (0:00:01.224) 0:27:05.002 ********* 2026-04-28 05:42:58.694138 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:58.694150 | orchestrator | 2026-04-28 05:42:58.694162 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-28 05:42:58.694191 | orchestrator | Tuesday 28 April 2026 05:42:32 +0000 (0:00:01.153) 0:27:06.156 ********* 2026-04-28 05:42:58.694204 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-0) 2026-04-28 05:42:58.694217 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-28 05:42:58.694230 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-2) 2026-04-28 05:42:58.694242 | orchestrator | 2026-04-28 05:42:58.694254 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-28 05:42:58.694266 | orchestrator | Tuesday 28 April 2026 05:42:34 +0000 (0:00:01.726) 0:27:07.882 ********* 2026-04-28 05:42:58.694279 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-0)  2026-04-28 05:42:58.694291 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-1)  2026-04-28 05:42:58.694304 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-2)  2026-04-28 05:42:58.694316 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:58.694328 | orchestrator | 2026-04-28 05:42:58.694340 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-28 05:42:58.694352 | orchestrator | Tuesday 28 April 2026 05:42:35 +0000 (0:00:01.168) 0:27:09.050 ********* 2026-04-28 05:42:58.694364 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:58.694375 | orchestrator | 2026-04-28 05:42:58.694388 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-28 05:42:58.694410 | orchestrator | Tuesday 28 April 2026 05:42:36 +0000 (0:00:01.118) 0:27:10.169 ********* 2026-04-28 05:42:58.694422 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:42:58.694435 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-28 05:42:58.694448 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:42:58.694460 | orchestrator | ok: [testbed-node-1 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 05:42:58.694472 | orchestrator | ok: [testbed-node-1 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 05:42:58.694483 | orchestrator | ok: [testbed-node-1 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 05:42:58.694511 | orchestrator | ok: [testbed-node-1 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 05:42:58.694523 | orchestrator | 2026-04-28 05:42:58.694534 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-28 05:42:58.694544 | orchestrator | Tuesday 28 April 2026 05:42:39 +0000 (0:00:02.225) 0:27:12.394 ********* 2026-04-28 05:42:58.694555 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:42:58.694566 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-28 05:42:58.694576 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:42:58.694587 | orchestrator | ok: [testbed-node-1 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 05:42:58.694598 | orchestrator | ok: [testbed-node-1 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 05:42:58.694608 | orchestrator | ok: [testbed-node-1 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 05:42:58.694618 | orchestrator | ok: [testbed-node-1 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 05:42:58.694629 | orchestrator | 2026-04-28 05:42:58.694640 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 05:42:58.694650 | orchestrator | Tuesday 28 April 2026 05:42:41 +0000 (0:00:02.200) 0:27:14.595 ********* 2026-04-28 05:42:58.694660 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-1 2026-04-28 05:42:58.694672 | orchestrator | 2026-04-28 05:42:58.694683 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 05:42:58.694693 | orchestrator | Tuesday 28 April 2026 05:42:42 +0000 (0:00:01.075) 0:27:15.670 ********* 2026-04-28 05:42:58.694704 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-1 2026-04-28 05:42:58.694714 | orchestrator | 2026-04-28 05:42:58.694725 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 05:42:58.694736 | orchestrator | Tuesday 28 April 2026 05:42:43 +0000 (0:00:01.096) 0:27:16.767 ********* 2026-04-28 05:42:58.694746 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:42:58.694757 | orchestrator | 2026-04-28 05:42:58.694767 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 05:42:58.694778 | orchestrator | Tuesday 28 April 2026 05:42:44 +0000 (0:00:01.581) 0:27:18.348 ********* 2026-04-28 05:42:58.694789 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:58.694826 | orchestrator | 2026-04-28 05:42:58.694838 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 05:42:58.694848 | orchestrator | Tuesday 28 April 2026 05:42:46 +0000 (0:00:01.179) 0:27:19.528 ********* 2026-04-28 05:42:58.694859 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:58.694870 | orchestrator | 2026-04-28 05:42:58.694880 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 05:42:58.694891 | orchestrator | Tuesday 28 April 2026 05:42:47 +0000 (0:00:01.114) 0:27:20.642 ********* 2026-04-28 05:42:58.694902 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:58.694912 | orchestrator | 2026-04-28 05:42:58.694923 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 05:42:58.694942 | orchestrator | Tuesday 28 April 2026 05:42:48 +0000 (0:00:01.081) 0:27:21.724 ********* 2026-04-28 05:42:58.694953 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:42:58.694964 | orchestrator | 2026-04-28 05:42:58.694974 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 05:42:58.694985 | orchestrator | Tuesday 28 April 2026 05:42:49 +0000 (0:00:01.550) 0:27:23.275 ********* 2026-04-28 05:42:58.694995 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:58.695006 | orchestrator | 2026-04-28 05:42:58.695022 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 05:42:58.695033 | orchestrator | Tuesday 28 April 2026 05:42:51 +0000 (0:00:01.109) 0:27:24.384 ********* 2026-04-28 05:42:58.695044 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:58.695055 | orchestrator | 2026-04-28 05:42:58.695065 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 05:42:58.695076 | orchestrator | Tuesday 28 April 2026 05:42:52 +0000 (0:00:01.107) 0:27:25.492 ********* 2026-04-28 05:42:58.695086 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:42:58.695097 | orchestrator | 2026-04-28 05:42:58.695108 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 05:42:58.695118 | orchestrator | Tuesday 28 April 2026 05:42:53 +0000 (0:00:01.644) 0:27:27.136 ********* 2026-04-28 05:42:58.695129 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:42:58.695139 | orchestrator | 2026-04-28 05:42:58.695150 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 05:42:58.695161 | orchestrator | Tuesday 28 April 2026 05:42:55 +0000 (0:00:01.680) 0:27:28.817 ********* 2026-04-28 05:42:58.695171 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:58.695182 | orchestrator | 2026-04-28 05:42:58.695193 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 05:42:58.695203 | orchestrator | Tuesday 28 April 2026 05:42:56 +0000 (0:00:00.793) 0:27:29.610 ********* 2026-04-28 05:42:58.695214 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:42:58.695225 | orchestrator | 2026-04-28 05:42:58.695235 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 05:42:58.695246 | orchestrator | Tuesday 28 April 2026 05:42:57 +0000 (0:00:00.800) 0:27:30.411 ********* 2026-04-28 05:42:58.695256 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:58.695267 | orchestrator | 2026-04-28 05:42:58.695277 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 05:42:58.695288 | orchestrator | Tuesday 28 April 2026 05:42:57 +0000 (0:00:00.829) 0:27:31.241 ********* 2026-04-28 05:42:58.695299 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:42:58.695310 | orchestrator | 2026-04-28 05:42:58.695320 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 05:42:58.695331 | orchestrator | Tuesday 28 April 2026 05:42:58 +0000 (0:00:00.771) 0:27:32.012 ********* 2026-04-28 05:42:58.695348 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.029250 | orchestrator | 2026-04-28 05:43:39.029368 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 05:43:39.029385 | orchestrator | Tuesday 28 April 2026 05:42:59 +0000 (0:00:00.761) 0:27:32.774 ********* 2026-04-28 05:43:39.029398 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.029410 | orchestrator | 2026-04-28 05:43:39.029422 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 05:43:39.029433 | orchestrator | Tuesday 28 April 2026 05:43:00 +0000 (0:00:00.743) 0:27:33.518 ********* 2026-04-28 05:43:39.029444 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.029455 | orchestrator | 2026-04-28 05:43:39.029466 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 05:43:39.029477 | orchestrator | Tuesday 28 April 2026 05:43:00 +0000 (0:00:00.758) 0:27:34.276 ********* 2026-04-28 05:43:39.029487 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:43:39.029500 | orchestrator | 2026-04-28 05:43:39.029511 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 05:43:39.029547 | orchestrator | Tuesday 28 April 2026 05:43:01 +0000 (0:00:00.833) 0:27:35.109 ********* 2026-04-28 05:43:39.029559 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:43:39.029569 | orchestrator | 2026-04-28 05:43:39.029580 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 05:43:39.029591 | orchestrator | Tuesday 28 April 2026 05:43:02 +0000 (0:00:00.813) 0:27:35.923 ********* 2026-04-28 05:43:39.029601 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:43:39.029612 | orchestrator | 2026-04-28 05:43:39.029623 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-28 05:43:39.029634 | orchestrator | Tuesday 28 April 2026 05:43:03 +0000 (0:00:00.779) 0:27:36.703 ********* 2026-04-28 05:43:39.029644 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.029655 | orchestrator | 2026-04-28 05:43:39.029665 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-28 05:43:39.029676 | orchestrator | Tuesday 28 April 2026 05:43:04 +0000 (0:00:00.792) 0:27:37.496 ********* 2026-04-28 05:43:39.029686 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.029697 | orchestrator | 2026-04-28 05:43:39.029708 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-28 05:43:39.029718 | orchestrator | Tuesday 28 April 2026 05:43:04 +0000 (0:00:00.768) 0:27:38.264 ********* 2026-04-28 05:43:39.029729 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.029740 | orchestrator | 2026-04-28 05:43:39.029750 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-28 05:43:39.029761 | orchestrator | Tuesday 28 April 2026 05:43:05 +0000 (0:00:00.805) 0:27:39.070 ********* 2026-04-28 05:43:39.029774 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.029811 | orchestrator | 2026-04-28 05:43:39.029825 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-28 05:43:39.029838 | orchestrator | Tuesday 28 April 2026 05:43:06 +0000 (0:00:00.813) 0:27:39.884 ********* 2026-04-28 05:43:39.029851 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.029864 | orchestrator | 2026-04-28 05:43:39.029876 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-28 05:43:39.029888 | orchestrator | Tuesday 28 April 2026 05:43:07 +0000 (0:00:00.846) 0:27:40.730 ********* 2026-04-28 05:43:39.029901 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.029913 | orchestrator | 2026-04-28 05:43:39.029926 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-28 05:43:39.029938 | orchestrator | Tuesday 28 April 2026 05:43:08 +0000 (0:00:00.771) 0:27:41.501 ********* 2026-04-28 05:43:39.029951 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.029964 | orchestrator | 2026-04-28 05:43:39.029977 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-28 05:43:39.030005 | orchestrator | Tuesday 28 April 2026 05:43:08 +0000 (0:00:00.756) 0:27:42.258 ********* 2026-04-28 05:43:39.030077 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.030093 | orchestrator | 2026-04-28 05:43:39.030107 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-28 05:43:39.030120 | orchestrator | Tuesday 28 April 2026 05:43:09 +0000 (0:00:00.808) 0:27:43.067 ********* 2026-04-28 05:43:39.030131 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.030141 | orchestrator | 2026-04-28 05:43:39.030152 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-28 05:43:39.030162 | orchestrator | Tuesday 28 April 2026 05:43:10 +0000 (0:00:00.872) 0:27:43.939 ********* 2026-04-28 05:43:39.030173 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.030183 | orchestrator | 2026-04-28 05:43:39.030194 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-28 05:43:39.030205 | orchestrator | Tuesday 28 April 2026 05:43:11 +0000 (0:00:00.817) 0:27:44.756 ********* 2026-04-28 05:43:39.030215 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.030226 | orchestrator | 2026-04-28 05:43:39.030236 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-28 05:43:39.030256 | orchestrator | Tuesday 28 April 2026 05:43:12 +0000 (0:00:00.772) 0:27:45.529 ********* 2026-04-28 05:43:39.030267 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.030277 | orchestrator | 2026-04-28 05:43:39.030288 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-28 05:43:39.030299 | orchestrator | Tuesday 28 April 2026 05:43:12 +0000 (0:00:00.784) 0:27:46.313 ********* 2026-04-28 05:43:39.030310 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:43:39.030321 | orchestrator | 2026-04-28 05:43:39.030331 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-28 05:43:39.030342 | orchestrator | Tuesday 28 April 2026 05:43:14 +0000 (0:00:01.565) 0:27:47.879 ********* 2026-04-28 05:43:39.030352 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:43:39.030363 | orchestrator | 2026-04-28 05:43:39.030373 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-28 05:43:39.030388 | orchestrator | Tuesday 28 April 2026 05:43:16 +0000 (0:00:02.156) 0:27:50.035 ********* 2026-04-28 05:43:39.030399 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-1 2026-04-28 05:43:39.030411 | orchestrator | 2026-04-28 05:43:39.030442 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-28 05:43:39.030454 | orchestrator | Tuesday 28 April 2026 05:43:17 +0000 (0:00:01.136) 0:27:51.171 ********* 2026-04-28 05:43:39.030464 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.030475 | orchestrator | 2026-04-28 05:43:39.030486 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-28 05:43:39.030496 | orchestrator | Tuesday 28 April 2026 05:43:18 +0000 (0:00:01.134) 0:27:52.306 ********* 2026-04-28 05:43:39.030507 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.030517 | orchestrator | 2026-04-28 05:43:39.030528 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-28 05:43:39.030539 | orchestrator | Tuesday 28 April 2026 05:43:20 +0000 (0:00:01.180) 0:27:53.486 ********* 2026-04-28 05:43:39.030550 | orchestrator | ok: [testbed-node-1] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-28 05:43:39.030560 | orchestrator | ok: [testbed-node-1] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-28 05:43:39.030571 | orchestrator | 2026-04-28 05:43:39.030582 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-28 05:43:39.030592 | orchestrator | Tuesday 28 April 2026 05:43:21 +0000 (0:00:01.820) 0:27:55.307 ********* 2026-04-28 05:43:39.030603 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:43:39.030614 | orchestrator | 2026-04-28 05:43:39.030624 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-28 05:43:39.030635 | orchestrator | Tuesday 28 April 2026 05:43:23 +0000 (0:00:01.500) 0:27:56.808 ********* 2026-04-28 05:43:39.030645 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.030656 | orchestrator | 2026-04-28 05:43:39.030667 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-28 05:43:39.030677 | orchestrator | Tuesday 28 April 2026 05:43:24 +0000 (0:00:01.134) 0:27:57.942 ********* 2026-04-28 05:43:39.030688 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.030698 | orchestrator | 2026-04-28 05:43:39.030709 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-28 05:43:39.030720 | orchestrator | Tuesday 28 April 2026 05:43:25 +0000 (0:00:00.808) 0:27:58.751 ********* 2026-04-28 05:43:39.030730 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.030741 | orchestrator | 2026-04-28 05:43:39.030752 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-28 05:43:39.030762 | orchestrator | Tuesday 28 April 2026 05:43:26 +0000 (0:00:00.785) 0:27:59.537 ********* 2026-04-28 05:43:39.030773 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-1 2026-04-28 05:43:39.030817 | orchestrator | 2026-04-28 05:43:39.030829 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-28 05:43:39.030847 | orchestrator | Tuesday 28 April 2026 05:43:27 +0000 (0:00:01.132) 0:28:00.670 ********* 2026-04-28 05:43:39.030857 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:43:39.030868 | orchestrator | 2026-04-28 05:43:39.030879 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-28 05:43:39.030890 | orchestrator | Tuesday 28 April 2026 05:43:29 +0000 (0:00:01.713) 0:28:02.384 ********* 2026-04-28 05:43:39.030900 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-28 05:43:39.030911 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-28 05:43:39.030922 | orchestrator | skipping: [testbed-node-1] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-28 05:43:39.030933 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.030943 | orchestrator | 2026-04-28 05:43:39.030954 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-28 05:43:39.030965 | orchestrator | Tuesday 28 April 2026 05:43:30 +0000 (0:00:01.121) 0:28:03.505 ********* 2026-04-28 05:43:39.030976 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.030986 | orchestrator | 2026-04-28 05:43:39.030997 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-28 05:43:39.031007 | orchestrator | Tuesday 28 April 2026 05:43:31 +0000 (0:00:01.159) 0:28:04.665 ********* 2026-04-28 05:43:39.031018 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.031028 | orchestrator | 2026-04-28 05:43:39.031039 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-28 05:43:39.031050 | orchestrator | Tuesday 28 April 2026 05:43:32 +0000 (0:00:01.173) 0:28:05.839 ********* 2026-04-28 05:43:39.031061 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.031071 | orchestrator | 2026-04-28 05:43:39.031082 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-28 05:43:39.031092 | orchestrator | Tuesday 28 April 2026 05:43:33 +0000 (0:00:01.125) 0:28:06.964 ********* 2026-04-28 05:43:39.031103 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.031114 | orchestrator | 2026-04-28 05:43:39.031124 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-28 05:43:39.031135 | orchestrator | Tuesday 28 April 2026 05:43:34 +0000 (0:00:01.256) 0:28:08.220 ********* 2026-04-28 05:43:39.031146 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:43:39.031156 | orchestrator | 2026-04-28 05:43:39.031166 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-28 05:43:39.031177 | orchestrator | Tuesday 28 April 2026 05:43:35 +0000 (0:00:00.820) 0:28:09.041 ********* 2026-04-28 05:43:39.031188 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:43:39.031198 | orchestrator | 2026-04-28 05:43:39.031209 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-28 05:43:39.031220 | orchestrator | Tuesday 28 April 2026 05:43:37 +0000 (0:00:02.212) 0:28:11.254 ********* 2026-04-28 05:43:39.031230 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:43:39.031241 | orchestrator | 2026-04-28 05:43:39.031252 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-28 05:43:39.031262 | orchestrator | Tuesday 28 April 2026 05:43:38 +0000 (0:00:00.839) 0:28:12.094 ********* 2026-04-28 05:43:39.031273 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-1 2026-04-28 05:43:39.031284 | orchestrator | 2026-04-28 05:43:39.031302 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-28 05:44:15.829444 | orchestrator | Tuesday 28 April 2026 05:43:39 +0000 (0:00:01.200) 0:28:13.294 ********* 2026-04-28 05:44:15.829582 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.829607 | orchestrator | 2026-04-28 05:44:15.829628 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-28 05:44:15.829647 | orchestrator | Tuesday 28 April 2026 05:43:41 +0000 (0:00:01.179) 0:28:14.474 ********* 2026-04-28 05:44:15.829665 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.829715 | orchestrator | 2026-04-28 05:44:15.829735 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-28 05:44:15.829754 | orchestrator | Tuesday 28 April 2026 05:43:42 +0000 (0:00:01.119) 0:28:15.593 ********* 2026-04-28 05:44:15.829831 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.829854 | orchestrator | 2026-04-28 05:44:15.829871 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-28 05:44:15.829889 | orchestrator | Tuesday 28 April 2026 05:43:43 +0000 (0:00:01.138) 0:28:16.732 ********* 2026-04-28 05:44:15.829904 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.829921 | orchestrator | 2026-04-28 05:44:15.829938 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-28 05:44:15.829954 | orchestrator | Tuesday 28 April 2026 05:43:44 +0000 (0:00:01.165) 0:28:17.898 ********* 2026-04-28 05:44:15.829970 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.829987 | orchestrator | 2026-04-28 05:44:15.830003 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-28 05:44:15.830231 | orchestrator | Tuesday 28 April 2026 05:43:45 +0000 (0:00:01.137) 0:28:19.035 ********* 2026-04-28 05:44:15.830267 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.830284 | orchestrator | 2026-04-28 05:44:15.830300 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-28 05:44:15.830316 | orchestrator | Tuesday 28 April 2026 05:43:46 +0000 (0:00:01.162) 0:28:20.197 ********* 2026-04-28 05:44:15.830332 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.830348 | orchestrator | 2026-04-28 05:44:15.830365 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-28 05:44:15.830382 | orchestrator | Tuesday 28 April 2026 05:43:47 +0000 (0:00:01.158) 0:28:21.356 ********* 2026-04-28 05:44:15.830398 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.830414 | orchestrator | 2026-04-28 05:44:15.830430 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-28 05:44:15.830446 | orchestrator | Tuesday 28 April 2026 05:43:49 +0000 (0:00:01.171) 0:28:22.528 ********* 2026-04-28 05:44:15.830463 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:44:15.830498 | orchestrator | 2026-04-28 05:44:15.830530 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-28 05:44:15.830547 | orchestrator | Tuesday 28 April 2026 05:43:49 +0000 (0:00:00.802) 0:28:23.330 ********* 2026-04-28 05:44:15.830565 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-1 2026-04-28 05:44:15.830584 | orchestrator | 2026-04-28 05:44:15.830601 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-28 05:44:15.830619 | orchestrator | Tuesday 28 April 2026 05:43:51 +0000 (0:00:01.218) 0:28:24.549 ********* 2026-04-28 05:44:15.830636 | orchestrator | ok: [testbed-node-1] => (item=/etc/ceph) 2026-04-28 05:44:15.830655 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/) 2026-04-28 05:44:15.830673 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/mon) 2026-04-28 05:44:15.830690 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/osd) 2026-04-28 05:44:15.830708 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/mds) 2026-04-28 05:44:15.830731 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/tmp) 2026-04-28 05:44:15.830750 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/crash) 2026-04-28 05:44:15.830768 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/radosgw) 2026-04-28 05:44:15.830806 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-28 05:44:15.830823 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-28 05:44:15.830840 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-28 05:44:15.830856 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-28 05:44:15.830872 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-28 05:44:15.830888 | orchestrator | ok: [testbed-node-1] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-28 05:44:15.830919 | orchestrator | ok: [testbed-node-1] => (item=/var/run/ceph) 2026-04-28 05:44:15.830936 | orchestrator | ok: [testbed-node-1] => (item=/var/log/ceph) 2026-04-28 05:44:15.830951 | orchestrator | 2026-04-28 05:44:15.830968 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-28 05:44:15.830984 | orchestrator | Tuesday 28 April 2026 05:43:57 +0000 (0:00:06.505) 0:28:31.055 ********* 2026-04-28 05:44:15.831000 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.831016 | orchestrator | 2026-04-28 05:44:15.831033 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-28 05:44:15.831049 | orchestrator | Tuesday 28 April 2026 05:43:58 +0000 (0:00:00.778) 0:28:31.833 ********* 2026-04-28 05:44:15.831066 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.831082 | orchestrator | 2026-04-28 05:44:15.831098 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-28 05:44:15.831114 | orchestrator | Tuesday 28 April 2026 05:43:59 +0000 (0:00:00.810) 0:28:32.643 ********* 2026-04-28 05:44:15.831130 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.831146 | orchestrator | 2026-04-28 05:44:15.831163 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-28 05:44:15.831179 | orchestrator | Tuesday 28 April 2026 05:44:00 +0000 (0:00:00.784) 0:28:33.428 ********* 2026-04-28 05:44:15.831195 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.831211 | orchestrator | 2026-04-28 05:44:15.831228 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-28 05:44:15.831270 | orchestrator | Tuesday 28 April 2026 05:44:00 +0000 (0:00:00.803) 0:28:34.232 ********* 2026-04-28 05:44:15.831289 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.831306 | orchestrator | 2026-04-28 05:44:15.831322 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-28 05:44:15.831339 | orchestrator | Tuesday 28 April 2026 05:44:01 +0000 (0:00:00.781) 0:28:35.013 ********* 2026-04-28 05:44:15.831355 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.831372 | orchestrator | 2026-04-28 05:44:15.831388 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-28 05:44:15.831405 | orchestrator | Tuesday 28 April 2026 05:44:02 +0000 (0:00:00.759) 0:28:35.772 ********* 2026-04-28 05:44:15.831421 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.831437 | orchestrator | 2026-04-28 05:44:15.831454 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-28 05:44:15.831471 | orchestrator | Tuesday 28 April 2026 05:44:03 +0000 (0:00:00.787) 0:28:36.559 ********* 2026-04-28 05:44:15.831487 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.831503 | orchestrator | 2026-04-28 05:44:15.831518 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-28 05:44:15.831535 | orchestrator | Tuesday 28 April 2026 05:44:04 +0000 (0:00:00.832) 0:28:37.391 ********* 2026-04-28 05:44:15.831552 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.831568 | orchestrator | 2026-04-28 05:44:15.831584 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-28 05:44:15.831599 | orchestrator | Tuesday 28 April 2026 05:44:04 +0000 (0:00:00.803) 0:28:38.195 ********* 2026-04-28 05:44:15.831609 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.831618 | orchestrator | 2026-04-28 05:44:15.831628 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-28 05:44:15.831637 | orchestrator | Tuesday 28 April 2026 05:44:05 +0000 (0:00:00.786) 0:28:38.981 ********* 2026-04-28 05:44:15.831646 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.831656 | orchestrator | 2026-04-28 05:44:15.831665 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-28 05:44:15.831675 | orchestrator | Tuesday 28 April 2026 05:44:06 +0000 (0:00:00.772) 0:28:39.754 ********* 2026-04-28 05:44:15.831692 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.831702 | orchestrator | 2026-04-28 05:44:15.831711 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-28 05:44:15.831721 | orchestrator | Tuesday 28 April 2026 05:44:07 +0000 (0:00:00.758) 0:28:40.512 ********* 2026-04-28 05:44:15.831730 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.831740 | orchestrator | 2026-04-28 05:44:15.831749 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-28 05:44:15.831758 | orchestrator | Tuesday 28 April 2026 05:44:08 +0000 (0:00:00.873) 0:28:41.386 ********* 2026-04-28 05:44:15.831768 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.831795 | orchestrator | 2026-04-28 05:44:15.831805 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-28 05:44:15.831814 | orchestrator | Tuesday 28 April 2026 05:44:08 +0000 (0:00:00.764) 0:28:42.151 ********* 2026-04-28 05:44:15.831824 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.831833 | orchestrator | 2026-04-28 05:44:15.831842 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-28 05:44:15.831852 | orchestrator | Tuesday 28 April 2026 05:44:09 +0000 (0:00:00.862) 0:28:43.013 ********* 2026-04-28 05:44:15.831861 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.831871 | orchestrator | 2026-04-28 05:44:15.831880 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-28 05:44:15.831895 | orchestrator | Tuesday 28 April 2026 05:44:10 +0000 (0:00:00.782) 0:28:43.795 ********* 2026-04-28 05:44:15.831905 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.831914 | orchestrator | 2026-04-28 05:44:15.831924 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 05:44:15.831934 | orchestrator | Tuesday 28 April 2026 05:44:11 +0000 (0:00:00.755) 0:28:44.551 ********* 2026-04-28 05:44:15.831944 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.831953 | orchestrator | 2026-04-28 05:44:15.831962 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 05:44:15.831972 | orchestrator | Tuesday 28 April 2026 05:44:11 +0000 (0:00:00.750) 0:28:45.302 ********* 2026-04-28 05:44:15.831982 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.831991 | orchestrator | 2026-04-28 05:44:15.832000 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 05:44:15.832010 | orchestrator | Tuesday 28 April 2026 05:44:12 +0000 (0:00:00.836) 0:28:46.138 ********* 2026-04-28 05:44:15.832019 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.832028 | orchestrator | 2026-04-28 05:44:15.832038 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 05:44:15.832047 | orchestrator | Tuesday 28 April 2026 05:44:13 +0000 (0:00:00.875) 0:28:47.014 ********* 2026-04-28 05:44:15.832057 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.832066 | orchestrator | 2026-04-28 05:44:15.832076 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 05:44:15.832085 | orchestrator | Tuesday 28 April 2026 05:44:14 +0000 (0:00:00.856) 0:28:47.870 ********* 2026-04-28 05:44:15.832094 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-28 05:44:15.832104 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-28 05:44:15.832114 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-28 05:44:15.832123 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:44:15.832132 | orchestrator | 2026-04-28 05:44:15.832142 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 05:44:15.832151 | orchestrator | Tuesday 28 April 2026 05:44:15 +0000 (0:00:01.052) 0:28:48.923 ********* 2026-04-28 05:44:15.832161 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-28 05:44:15.832177 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-28 05:45:13.919912 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-28 05:45:13.920055 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:45:13.920072 | orchestrator | 2026-04-28 05:45:13.920084 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 05:45:13.920096 | orchestrator | Tuesday 28 April 2026 05:44:16 +0000 (0:00:01.101) 0:28:50.025 ********* 2026-04-28 05:45:13.920107 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-3)  2026-04-28 05:45:13.920118 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-4)  2026-04-28 05:45:13.920129 | orchestrator | skipping: [testbed-node-1] => (item=testbed-node-5)  2026-04-28 05:45:13.920139 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:45:13.920150 | orchestrator | 2026-04-28 05:45:13.920161 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 05:45:13.920172 | orchestrator | Tuesday 28 April 2026 05:44:17 +0000 (0:00:01.090) 0:28:51.116 ********* 2026-04-28 05:45:13.920183 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:45:13.920193 | orchestrator | 2026-04-28 05:45:13.920204 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 05:45:13.920214 | orchestrator | Tuesday 28 April 2026 05:44:18 +0000 (0:00:00.768) 0:28:51.884 ********* 2026-04-28 05:45:13.920225 | orchestrator | skipping: [testbed-node-1] => (item=0)  2026-04-28 05:45:13.920236 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:45:13.920246 | orchestrator | 2026-04-28 05:45:13.920257 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-28 05:45:13.920267 | orchestrator | Tuesday 28 April 2026 05:44:19 +0000 (0:00:00.918) 0:28:52.803 ********* 2026-04-28 05:45:13.920278 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:45:13.920289 | orchestrator | 2026-04-28 05:45:13.920299 | orchestrator | TASK [ceph-mgr : Set_fact container_exec_cmd] ********************************** 2026-04-28 05:45:13.920310 | orchestrator | Tuesday 28 April 2026 05:44:20 +0000 (0:00:01.415) 0:28:54.218 ********* 2026-04-28 05:45:13.920320 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:45:13.920332 | orchestrator | ok: [testbed-node-1] => (item=testbed-node-1) 2026-04-28 05:45:13.920342 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:45:13.920353 | orchestrator | 2026-04-28 05:45:13.920363 | orchestrator | TASK [ceph-mgr : Include common.yml] ******************************************* 2026-04-28 05:45:13.920374 | orchestrator | Tuesday 28 April 2026 05:44:22 +0000 (0:00:01.634) 0:28:55.852 ********* 2026-04-28 05:45:13.920384 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/common.yml for testbed-node-1 2026-04-28 05:45:13.920395 | orchestrator | 2026-04-28 05:45:13.920405 | orchestrator | TASK [ceph-mgr : Create mgr directory] ***************************************** 2026-04-28 05:45:13.920415 | orchestrator | Tuesday 28 April 2026 05:44:23 +0000 (0:00:01.145) 0:28:56.998 ********* 2026-04-28 05:45:13.920426 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:45:13.920436 | orchestrator | 2026-04-28 05:45:13.920447 | orchestrator | TASK [ceph-mgr : Fetch ceph mgr keyring] *************************************** 2026-04-28 05:45:13.920457 | orchestrator | Tuesday 28 April 2026 05:44:25 +0000 (0:00:01.509) 0:28:58.508 ********* 2026-04-28 05:45:13.920467 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:45:13.920478 | orchestrator | 2026-04-28 05:45:13.920488 | orchestrator | TASK [ceph-mgr : Create ceph mgr keyring(s) on a mon node] ********************* 2026-04-28 05:45:13.920499 | orchestrator | Tuesday 28 April 2026 05:44:26 +0000 (0:00:01.120) 0:28:59.629 ********* 2026-04-28 05:45:13.920509 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 05:45:13.920534 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 05:45:13.920545 | orchestrator | ok: [testbed-node-1 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 05:45:13.920555 | orchestrator | ok: [testbed-node-1 -> {{ groups[mon_group_name][0] }}] 2026-04-28 05:45:13.920566 | orchestrator | 2026-04-28 05:45:13.920576 | orchestrator | TASK [ceph-mgr : Set_fact _mgr_keys] ******************************************* 2026-04-28 05:45:13.920586 | orchestrator | Tuesday 28 April 2026 05:44:33 +0000 (0:00:07.331) 0:29:06.960 ********* 2026-04-28 05:45:13.920605 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:45:13.920615 | orchestrator | 2026-04-28 05:45:13.920626 | orchestrator | TASK [ceph-mgr : Get keys from monitors] *************************************** 2026-04-28 05:45:13.920637 | orchestrator | Tuesday 28 April 2026 05:44:34 +0000 (0:00:01.172) 0:29:08.133 ********* 2026-04-28 05:45:13.920647 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-28 05:45:13.920658 | orchestrator | ok: [testbed-node-1 -> testbed-node-2(192.168.16.12)] => (item=None) 2026-04-28 05:45:13.920668 | orchestrator | 2026-04-28 05:45:13.920679 | orchestrator | TASK [ceph-mgr : Copy ceph key(s) if needed] *********************************** 2026-04-28 05:45:13.920689 | orchestrator | Tuesday 28 April 2026 05:44:37 +0000 (0:00:03.156) 0:29:11.290 ********* 2026-04-28 05:45:13.920700 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-28 05:45:13.920710 | orchestrator | ok: [testbed-node-1] => (item=None) 2026-04-28 05:45:13.920721 | orchestrator | 2026-04-28 05:45:13.920731 | orchestrator | TASK [ceph-mgr : Set mgr key permissions] ************************************** 2026-04-28 05:45:13.920742 | orchestrator | Tuesday 28 April 2026 05:44:39 +0000 (0:00:02.089) 0:29:13.379 ********* 2026-04-28 05:45:13.920753 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:45:13.920763 | orchestrator | 2026-04-28 05:45:13.920800 | orchestrator | TASK [ceph-mgr : Append dashboard modules to ceph_mgr_modules] ***************** 2026-04-28 05:45:13.920811 | orchestrator | Tuesday 28 April 2026 05:44:41 +0000 (0:00:01.465) 0:29:14.845 ********* 2026-04-28 05:45:13.920822 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:45:13.920832 | orchestrator | 2026-04-28 05:45:13.920843 | orchestrator | TASK [ceph-mgr : Include pre_requisite.yml] ************************************ 2026-04-28 05:45:13.920853 | orchestrator | Tuesday 28 April 2026 05:44:42 +0000 (0:00:00.788) 0:29:15.633 ********* 2026-04-28 05:45:13.920864 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:45:13.920874 | orchestrator | 2026-04-28 05:45:13.920885 | orchestrator | TASK [ceph-mgr : Include start_mgr.yml] **************************************** 2026-04-28 05:45:13.920913 | orchestrator | Tuesday 28 April 2026 05:44:43 +0000 (0:00:00.762) 0:29:16.396 ********* 2026-04-28 05:45:13.920925 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/start_mgr.yml for testbed-node-1 2026-04-28 05:45:13.920935 | orchestrator | 2026-04-28 05:45:13.920946 | orchestrator | TASK [ceph-mgr : Ensure systemd service override directory exists] ************* 2026-04-28 05:45:13.920957 | orchestrator | Tuesday 28 April 2026 05:44:44 +0000 (0:00:01.112) 0:29:17.509 ********* 2026-04-28 05:45:13.920967 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:45:13.920978 | orchestrator | 2026-04-28 05:45:13.920989 | orchestrator | TASK [ceph-mgr : Add ceph-mgr systemd service overrides] *********************** 2026-04-28 05:45:13.920999 | orchestrator | Tuesday 28 April 2026 05:44:45 +0000 (0:00:01.166) 0:29:18.675 ********* 2026-04-28 05:45:13.921010 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:45:13.921020 | orchestrator | 2026-04-28 05:45:13.921031 | orchestrator | TASK [ceph-mgr : Include_tasks systemd.yml] ************************************ 2026-04-28 05:45:13.921041 | orchestrator | Tuesday 28 April 2026 05:44:46 +0000 (0:00:01.118) 0:29:19.794 ********* 2026-04-28 05:45:13.921052 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/systemd.yml for testbed-node-1 2026-04-28 05:45:13.921063 | orchestrator | 2026-04-28 05:45:13.921073 | orchestrator | TASK [ceph-mgr : Generate systemd unit file] *********************************** 2026-04-28 05:45:13.921084 | orchestrator | Tuesday 28 April 2026 05:44:47 +0000 (0:00:01.146) 0:29:20.941 ********* 2026-04-28 05:45:13.921095 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:45:13.921105 | orchestrator | 2026-04-28 05:45:13.921116 | orchestrator | TASK [ceph-mgr : Generate systemd ceph-mgr target file] ************************ 2026-04-28 05:45:13.921127 | orchestrator | Tuesday 28 April 2026 05:44:49 +0000 (0:00:02.424) 0:29:23.366 ********* 2026-04-28 05:45:13.921138 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:45:13.921148 | orchestrator | 2026-04-28 05:45:13.921159 | orchestrator | TASK [ceph-mgr : Enable ceph-mgr.target] *************************************** 2026-04-28 05:45:13.921170 | orchestrator | Tuesday 28 April 2026 05:44:51 +0000 (0:00:01.985) 0:29:25.351 ********* 2026-04-28 05:45:13.921187 | orchestrator | ok: [testbed-node-1] 2026-04-28 05:45:13.921198 | orchestrator | 2026-04-28 05:45:13.921209 | orchestrator | TASK [ceph-mgr : Systemd start mgr] ******************************************** 2026-04-28 05:45:13.921219 | orchestrator | Tuesday 28 April 2026 05:44:54 +0000 (0:00:02.515) 0:29:27.867 ********* 2026-04-28 05:45:13.921230 | orchestrator | changed: [testbed-node-1] 2026-04-28 05:45:13.921240 | orchestrator | 2026-04-28 05:45:13.921251 | orchestrator | TASK [ceph-mgr : Include mgr_modules.yml] ************************************** 2026-04-28 05:45:13.921262 | orchestrator | Tuesday 28 April 2026 05:44:58 +0000 (0:00:03.631) 0:29:31.499 ********* 2026-04-28 05:45:13.921272 | orchestrator | skipping: [testbed-node-1] 2026-04-28 05:45:13.921283 | orchestrator | 2026-04-28 05:45:13.921293 | orchestrator | PLAY [Upgrade ceph mgr nodes] ************************************************** 2026-04-28 05:45:13.921304 | orchestrator | 2026-04-28 05:45:13.921315 | orchestrator | TASK [Stop ceph mgr] *********************************************************** 2026-04-28 05:45:13.921325 | orchestrator | Tuesday 28 April 2026 05:44:59 +0000 (0:00:01.031) 0:29:32.530 ********* 2026-04-28 05:45:13.921336 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:45:13.921346 | orchestrator | 2026-04-28 05:45:13.921357 | orchestrator | TASK [Mask ceph mgr systemd unit] ********************************************** 2026-04-28 05:45:13.921367 | orchestrator | Tuesday 28 April 2026 05:45:01 +0000 (0:00:02.596) 0:29:35.127 ********* 2026-04-28 05:45:13.921378 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:45:13.921389 | orchestrator | 2026-04-28 05:45:13.921399 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 05:45:13.921410 | orchestrator | Tuesday 28 April 2026 05:45:03 +0000 (0:00:02.188) 0:29:37.316 ********* 2026-04-28 05:45:13.921426 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-2 2026-04-28 05:45:13.921437 | orchestrator | 2026-04-28 05:45:13.921447 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-28 05:45:13.921458 | orchestrator | Tuesday 28 April 2026 05:45:05 +0000 (0:00:01.193) 0:29:38.510 ********* 2026-04-28 05:45:13.921469 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:45:13.921479 | orchestrator | 2026-04-28 05:45:13.921490 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-28 05:45:13.921501 | orchestrator | Tuesday 28 April 2026 05:45:06 +0000 (0:00:01.467) 0:29:39.977 ********* 2026-04-28 05:45:13.921511 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:45:13.921522 | orchestrator | 2026-04-28 05:45:13.921533 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 05:45:13.921543 | orchestrator | Tuesday 28 April 2026 05:45:07 +0000 (0:00:01.117) 0:29:41.094 ********* 2026-04-28 05:45:13.921554 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:45:13.921565 | orchestrator | 2026-04-28 05:45:13.921575 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 05:45:13.921586 | orchestrator | Tuesday 28 April 2026 05:45:09 +0000 (0:00:01.472) 0:29:42.567 ********* 2026-04-28 05:45:13.921596 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:45:13.921607 | orchestrator | 2026-04-28 05:45:13.921617 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-28 05:45:13.921628 | orchestrator | Tuesday 28 April 2026 05:45:10 +0000 (0:00:01.137) 0:29:43.705 ********* 2026-04-28 05:45:13.921639 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:45:13.921649 | orchestrator | 2026-04-28 05:45:13.921660 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-28 05:45:13.921671 | orchestrator | Tuesday 28 April 2026 05:45:11 +0000 (0:00:01.142) 0:29:44.847 ********* 2026-04-28 05:45:13.921681 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:45:13.921692 | orchestrator | 2026-04-28 05:45:13.921703 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-28 05:45:13.921713 | orchestrator | Tuesday 28 April 2026 05:45:12 +0000 (0:00:01.154) 0:29:46.003 ********* 2026-04-28 05:45:13.921724 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:45:13.921734 | orchestrator | 2026-04-28 05:45:13.921751 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-28 05:45:13.921762 | orchestrator | Tuesday 28 April 2026 05:45:13 +0000 (0:00:01.140) 0:29:47.143 ********* 2026-04-28 05:45:13.921800 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:45:13.921812 | orchestrator | 2026-04-28 05:45:13.921829 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-28 05:45:39.054240 | orchestrator | Tuesday 28 April 2026 05:45:14 +0000 (0:00:01.136) 0:29:48.279 ********* 2026-04-28 05:45:39.054355 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:45:39.054373 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:45:39.054385 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-28 05:45:39.054397 | orchestrator | 2026-04-28 05:45:39.054409 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-28 05:45:39.054420 | orchestrator | Tuesday 28 April 2026 05:45:16 +0000 (0:00:01.752) 0:29:50.032 ********* 2026-04-28 05:45:39.054431 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:45:39.054442 | orchestrator | 2026-04-28 05:45:39.054453 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-28 05:45:39.054464 | orchestrator | Tuesday 28 April 2026 05:45:17 +0000 (0:00:01.302) 0:29:51.334 ********* 2026-04-28 05:45:39.054475 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:45:39.054486 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:45:39.054497 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-28 05:45:39.054508 | orchestrator | 2026-04-28 05:45:39.054519 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-28 05:45:39.054530 | orchestrator | Tuesday 28 April 2026 05:45:21 +0000 (0:00:03.223) 0:29:54.558 ********* 2026-04-28 05:45:39.054541 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-28 05:45:39.054552 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-28 05:45:39.054563 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-28 05:45:39.054574 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:45:39.054586 | orchestrator | 2026-04-28 05:45:39.054597 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-28 05:45:39.054608 | orchestrator | Tuesday 28 April 2026 05:45:22 +0000 (0:00:01.425) 0:29:55.984 ********* 2026-04-28 05:45:39.054620 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-28 05:45:39.054635 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-28 05:45:39.054646 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-28 05:45:39.054657 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:45:39.054668 | orchestrator | 2026-04-28 05:45:39.054680 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-28 05:45:39.054706 | orchestrator | Tuesday 28 April 2026 05:45:24 +0000 (0:00:02.054) 0:29:58.038 ********* 2026-04-28 05:45:39.054720 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:45:39.054757 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:45:39.054769 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:45:39.054820 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:45:39.054832 | orchestrator | 2026-04-28 05:45:39.054845 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-28 05:45:39.054858 | orchestrator | Tuesday 28 April 2026 05:45:25 +0000 (0:00:01.169) 0:29:59.207 ********* 2026-04-28 05:45:39.054891 | orchestrator | ok: [testbed-node-2] => (item={'changed': False, 'stdout': 'e79a9ee6c12b', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-28 05:45:18.453093', 'end': '2026-04-28 05:45:18.498086', 'delta': '0:00:00.044993', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e79a9ee6c12b'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-28 05:45:39.054909 | orchestrator | ok: [testbed-node-2] => (item={'changed': False, 'stdout': '00fb93644bb9', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-28 05:45:19.043827', 'end': '2026-04-28 05:45:19.089844', 'delta': '0:00:00.046017', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['00fb93644bb9'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-28 05:45:39.054923 | orchestrator | ok: [testbed-node-2] => (item={'changed': False, 'stdout': '92b926b7d044', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-28 05:45:19.948948', 'end': '2026-04-28 05:45:20.000195', 'delta': '0:00:00.051247', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['92b926b7d044'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-28 05:45:39.054936 | orchestrator | 2026-04-28 05:45:39.054949 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-28 05:45:39.054962 | orchestrator | Tuesday 28 April 2026 05:45:27 +0000 (0:00:01.215) 0:30:00.423 ********* 2026-04-28 05:45:39.054974 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:45:39.054987 | orchestrator | 2026-04-28 05:45:39.054999 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-28 05:45:39.055039 | orchestrator | Tuesday 28 April 2026 05:45:28 +0000 (0:00:01.683) 0:30:02.107 ********* 2026-04-28 05:45:39.055052 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:45:39.055064 | orchestrator | 2026-04-28 05:45:39.055077 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-28 05:45:39.055089 | orchestrator | Tuesday 28 April 2026 05:45:29 +0000 (0:00:01.270) 0:30:03.378 ********* 2026-04-28 05:45:39.055101 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:45:39.055114 | orchestrator | 2026-04-28 05:45:39.055126 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-28 05:45:39.055138 | orchestrator | Tuesday 28 April 2026 05:45:31 +0000 (0:00:01.149) 0:30:04.527 ********* 2026-04-28 05:45:39.055149 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-28 05:45:39.055159 | orchestrator | 2026-04-28 05:45:39.055170 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 05:45:39.055181 | orchestrator | Tuesday 28 April 2026 05:45:33 +0000 (0:00:01.951) 0:30:06.479 ********* 2026-04-28 05:45:39.055191 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:45:39.055202 | orchestrator | 2026-04-28 05:45:39.055213 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-28 05:45:39.055224 | orchestrator | Tuesday 28 April 2026 05:45:34 +0000 (0:00:01.131) 0:30:07.611 ********* 2026-04-28 05:45:39.055234 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:45:39.055245 | orchestrator | 2026-04-28 05:45:39.055256 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-28 05:45:39.055266 | orchestrator | Tuesday 28 April 2026 05:45:35 +0000 (0:00:01.155) 0:30:08.766 ********* 2026-04-28 05:45:39.055277 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:45:39.055287 | orchestrator | 2026-04-28 05:45:39.055298 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 05:45:39.055309 | orchestrator | Tuesday 28 April 2026 05:45:36 +0000 (0:00:01.217) 0:30:09.984 ********* 2026-04-28 05:45:39.055319 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:45:39.055330 | orchestrator | 2026-04-28 05:45:39.055341 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-28 05:45:39.055352 | orchestrator | Tuesday 28 April 2026 05:45:37 +0000 (0:00:01.144) 0:30:11.128 ********* 2026-04-28 05:45:39.055363 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:45:39.055373 | orchestrator | 2026-04-28 05:45:39.055384 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-28 05:45:39.055395 | orchestrator | Tuesday 28 April 2026 05:45:38 +0000 (0:00:01.139) 0:30:12.268 ********* 2026-04-28 05:45:39.055405 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:45:39.055416 | orchestrator | 2026-04-28 05:45:39.055434 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-28 05:45:45.806701 | orchestrator | Tuesday 28 April 2026 05:45:40 +0000 (0:00:01.126) 0:30:13.394 ********* 2026-04-28 05:45:45.806888 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:45:45.806918 | orchestrator | 2026-04-28 05:45:45.806937 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-28 05:45:45.806954 | orchestrator | Tuesday 28 April 2026 05:45:41 +0000 (0:00:01.132) 0:30:14.527 ********* 2026-04-28 05:45:45.806973 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:45:45.806984 | orchestrator | 2026-04-28 05:45:45.806994 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-28 05:45:45.807003 | orchestrator | Tuesday 28 April 2026 05:45:42 +0000 (0:00:01.108) 0:30:15.635 ********* 2026-04-28 05:45:45.807013 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:45:45.807022 | orchestrator | 2026-04-28 05:45:45.807032 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-28 05:45:45.807042 | orchestrator | Tuesday 28 April 2026 05:45:43 +0000 (0:00:01.118) 0:30:16.754 ********* 2026-04-28 05:45:45.807052 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:45:45.807061 | orchestrator | 2026-04-28 05:45:45.807071 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-28 05:45:45.807101 | orchestrator | Tuesday 28 April 2026 05:45:44 +0000 (0:00:01.147) 0:30:17.902 ********* 2026-04-28 05:45:45.807114 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:45:45.807128 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:45:45.807138 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:45:45.807165 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-16-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 05:45:45.807178 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:45:45.807189 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:45:45.807199 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:45:45.807236 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46c58400', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part16', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part14', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part15', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part1', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:45:45.807285 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:45:45.807306 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:45:45.807323 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:45:45.807339 | orchestrator | 2026-04-28 05:45:45.807356 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-28 05:45:45.807372 | orchestrator | Tuesday 28 April 2026 05:45:45 +0000 (0:00:01.192) 0:30:19.094 ********* 2026-04-28 05:45:45.807389 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:45:45.807422 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:45:54.555417 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:45:54.555562 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-16-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:45:54.555580 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:45:54.555609 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:45:54.555622 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:45:54.555658 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46c58400', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part16', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part14', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part15', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part1', 'scsi-SQEMU_QEMU_HARDDISK_46c58400-f4df-4002-8b02-dacbe7336f25-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:45:54.555703 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:45:54.555715 | orchestrator | skipping: [testbed-node-2] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:45:54.555727 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:45:54.555741 | orchestrator | 2026-04-28 05:45:54.555753 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-28 05:45:54.555764 | orchestrator | Tuesday 28 April 2026 05:45:46 +0000 (0:00:01.261) 0:30:20.356 ********* 2026-04-28 05:45:54.555868 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:45:54.555881 | orchestrator | 2026-04-28 05:45:54.555892 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-28 05:45:54.555903 | orchestrator | Tuesday 28 April 2026 05:45:48 +0000 (0:00:01.458) 0:30:21.815 ********* 2026-04-28 05:45:54.555914 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:45:54.555924 | orchestrator | 2026-04-28 05:45:54.555935 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 05:45:54.555948 | orchestrator | Tuesday 28 April 2026 05:45:49 +0000 (0:00:01.093) 0:30:22.908 ********* 2026-04-28 05:45:54.555960 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:45:54.555972 | orchestrator | 2026-04-28 05:45:54.555984 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 05:45:54.556008 | orchestrator | Tuesday 28 April 2026 05:45:51 +0000 (0:00:01.479) 0:30:24.388 ********* 2026-04-28 05:45:54.556020 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:45:54.556033 | orchestrator | 2026-04-28 05:45:54.556045 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 05:45:54.556057 | orchestrator | Tuesday 28 April 2026 05:45:52 +0000 (0:00:01.119) 0:30:25.508 ********* 2026-04-28 05:45:54.556069 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:45:54.556081 | orchestrator | 2026-04-28 05:45:54.556098 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 05:45:54.556117 | orchestrator | Tuesday 28 April 2026 05:45:53 +0000 (0:00:01.286) 0:30:26.794 ********* 2026-04-28 05:45:54.556135 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:45:54.556151 | orchestrator | 2026-04-28 05:45:54.556168 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-28 05:45:54.556196 | orchestrator | Tuesday 28 April 2026 05:45:54 +0000 (0:00:01.138) 0:30:27.933 ********* 2026-04-28 05:46:31.358859 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-0) 2026-04-28 05:46:31.358967 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-1) 2026-04-28 05:46:31.358980 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-28 05:46:31.358990 | orchestrator | 2026-04-28 05:46:31.359000 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-28 05:46:31.359010 | orchestrator | Tuesday 28 April 2026 05:45:56 +0000 (0:00:02.075) 0:30:30.009 ********* 2026-04-28 05:46:31.359020 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-0)  2026-04-28 05:46:31.359029 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-1)  2026-04-28 05:46:31.359038 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-2)  2026-04-28 05:46:31.359047 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:46:31.359056 | orchestrator | 2026-04-28 05:46:31.359065 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-28 05:46:31.359074 | orchestrator | Tuesday 28 April 2026 05:45:57 +0000 (0:00:01.152) 0:30:31.161 ********* 2026-04-28 05:46:31.359083 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:46:31.359092 | orchestrator | 2026-04-28 05:46:31.359100 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-28 05:46:31.359109 | orchestrator | Tuesday 28 April 2026 05:45:58 +0000 (0:00:01.128) 0:30:32.290 ********* 2026-04-28 05:46:31.359117 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:46:31.359127 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:46:31.359136 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-28 05:46:31.359144 | orchestrator | ok: [testbed-node-2 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 05:46:31.359153 | orchestrator | ok: [testbed-node-2 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 05:46:31.359161 | orchestrator | ok: [testbed-node-2 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 05:46:31.359170 | orchestrator | ok: [testbed-node-2 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 05:46:31.359178 | orchestrator | 2026-04-28 05:46:31.359187 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-28 05:46:31.359200 | orchestrator | Tuesday 28 April 2026 05:46:01 +0000 (0:00:02.193) 0:30:34.483 ********* 2026-04-28 05:46:31.359215 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:46:31.359238 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:46:31.359256 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-28 05:46:31.359271 | orchestrator | ok: [testbed-node-2 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 05:46:31.359308 | orchestrator | ok: [testbed-node-2 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 05:46:31.359345 | orchestrator | ok: [testbed-node-2 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 05:46:31.359354 | orchestrator | ok: [testbed-node-2 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 05:46:31.359363 | orchestrator | 2026-04-28 05:46:31.359375 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 05:46:31.359394 | orchestrator | Tuesday 28 April 2026 05:46:03 +0000 (0:00:02.619) 0:30:37.103 ********* 2026-04-28 05:46:31.359415 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-2 2026-04-28 05:46:31.359431 | orchestrator | 2026-04-28 05:46:31.359445 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 05:46:31.359459 | orchestrator | Tuesday 28 April 2026 05:46:04 +0000 (0:00:01.133) 0:30:38.236 ********* 2026-04-28 05:46:31.359474 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-2 2026-04-28 05:46:31.359489 | orchestrator | 2026-04-28 05:46:31.359503 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 05:46:31.359519 | orchestrator | Tuesday 28 April 2026 05:46:05 +0000 (0:00:01.126) 0:30:39.363 ********* 2026-04-28 05:46:31.359532 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:46:31.359548 | orchestrator | 2026-04-28 05:46:31.359563 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 05:46:31.359577 | orchestrator | Tuesday 28 April 2026 05:46:07 +0000 (0:00:01.536) 0:30:40.900 ********* 2026-04-28 05:46:31.359591 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:46:31.359604 | orchestrator | 2026-04-28 05:46:31.359619 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 05:46:31.359634 | orchestrator | Tuesday 28 April 2026 05:46:08 +0000 (0:00:01.140) 0:30:42.041 ********* 2026-04-28 05:46:31.359650 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:46:31.359663 | orchestrator | 2026-04-28 05:46:31.359679 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 05:46:31.359694 | orchestrator | Tuesday 28 April 2026 05:46:09 +0000 (0:00:01.127) 0:30:43.168 ********* 2026-04-28 05:46:31.359708 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:46:31.359722 | orchestrator | 2026-04-28 05:46:31.359737 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 05:46:31.359752 | orchestrator | Tuesday 28 April 2026 05:46:10 +0000 (0:00:01.163) 0:30:44.332 ********* 2026-04-28 05:46:31.359767 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:46:31.359813 | orchestrator | 2026-04-28 05:46:31.359823 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 05:46:31.359832 | orchestrator | Tuesday 28 April 2026 05:46:12 +0000 (0:00:01.517) 0:30:45.849 ********* 2026-04-28 05:46:31.359840 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:46:31.359849 | orchestrator | 2026-04-28 05:46:31.359858 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 05:46:31.359886 | orchestrator | Tuesday 28 April 2026 05:46:13 +0000 (0:00:01.120) 0:30:46.969 ********* 2026-04-28 05:46:31.359896 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:46:31.359904 | orchestrator | 2026-04-28 05:46:31.359912 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 05:46:31.359921 | orchestrator | Tuesday 28 April 2026 05:46:14 +0000 (0:00:01.129) 0:30:48.098 ********* 2026-04-28 05:46:31.359929 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:46:31.359938 | orchestrator | 2026-04-28 05:46:31.359946 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 05:46:31.359955 | orchestrator | Tuesday 28 April 2026 05:46:16 +0000 (0:00:01.613) 0:30:49.711 ********* 2026-04-28 05:46:31.359968 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:46:31.359983 | orchestrator | 2026-04-28 05:46:31.359997 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 05:46:31.360012 | orchestrator | Tuesday 28 April 2026 05:46:18 +0000 (0:00:01.672) 0:30:51.384 ********* 2026-04-28 05:46:31.360026 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:46:31.360056 | orchestrator | 2026-04-28 05:46:31.360071 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 05:46:31.360088 | orchestrator | Tuesday 28 April 2026 05:46:18 +0000 (0:00:00.753) 0:30:52.137 ********* 2026-04-28 05:46:31.360104 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:46:31.360119 | orchestrator | 2026-04-28 05:46:31.360129 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 05:46:31.360137 | orchestrator | Tuesday 28 April 2026 05:46:19 +0000 (0:00:00.763) 0:30:52.901 ********* 2026-04-28 05:46:31.360146 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:46:31.360154 | orchestrator | 2026-04-28 05:46:31.360163 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 05:46:31.360171 | orchestrator | Tuesday 28 April 2026 05:46:20 +0000 (0:00:00.777) 0:30:53.679 ********* 2026-04-28 05:46:31.360180 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:46:31.360188 | orchestrator | 2026-04-28 05:46:31.360196 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 05:46:31.360205 | orchestrator | Tuesday 28 April 2026 05:46:21 +0000 (0:00:00.787) 0:30:54.466 ********* 2026-04-28 05:46:31.360213 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:46:31.360222 | orchestrator | 2026-04-28 05:46:31.360230 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 05:46:31.360239 | orchestrator | Tuesday 28 April 2026 05:46:21 +0000 (0:00:00.751) 0:30:55.218 ********* 2026-04-28 05:46:31.360247 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:46:31.360256 | orchestrator | 2026-04-28 05:46:31.360264 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 05:46:31.360273 | orchestrator | Tuesday 28 April 2026 05:46:22 +0000 (0:00:00.768) 0:30:55.986 ********* 2026-04-28 05:46:31.360281 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:46:31.360289 | orchestrator | 2026-04-28 05:46:31.360298 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 05:46:31.360306 | orchestrator | Tuesday 28 April 2026 05:46:23 +0000 (0:00:00.759) 0:30:56.746 ********* 2026-04-28 05:46:31.360322 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:46:31.360331 | orchestrator | 2026-04-28 05:46:31.360339 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 05:46:31.360348 | orchestrator | Tuesday 28 April 2026 05:46:24 +0000 (0:00:00.821) 0:30:57.568 ********* 2026-04-28 05:46:31.360356 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:46:31.360364 | orchestrator | 2026-04-28 05:46:31.360373 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 05:46:31.360381 | orchestrator | Tuesday 28 April 2026 05:46:25 +0000 (0:00:00.828) 0:30:58.396 ********* 2026-04-28 05:46:31.360389 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:46:31.360398 | orchestrator | 2026-04-28 05:46:31.360406 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-28 05:46:31.360415 | orchestrator | Tuesday 28 April 2026 05:46:25 +0000 (0:00:00.790) 0:30:59.186 ********* 2026-04-28 05:46:31.360423 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:46:31.360432 | orchestrator | 2026-04-28 05:46:31.360440 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-28 05:46:31.360449 | orchestrator | Tuesday 28 April 2026 05:46:26 +0000 (0:00:00.860) 0:31:00.047 ********* 2026-04-28 05:46:31.360457 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:46:31.360466 | orchestrator | 2026-04-28 05:46:31.360474 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-28 05:46:31.360483 | orchestrator | Tuesday 28 April 2026 05:46:27 +0000 (0:00:00.763) 0:31:00.811 ********* 2026-04-28 05:46:31.360491 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:46:31.360499 | orchestrator | 2026-04-28 05:46:31.360507 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-28 05:46:31.360516 | orchestrator | Tuesday 28 April 2026 05:46:28 +0000 (0:00:00.767) 0:31:01.579 ********* 2026-04-28 05:46:31.360524 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:46:31.360539 | orchestrator | 2026-04-28 05:46:31.360547 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-28 05:46:31.360556 | orchestrator | Tuesday 28 April 2026 05:46:28 +0000 (0:00:00.773) 0:31:02.352 ********* 2026-04-28 05:46:31.360564 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:46:31.360573 | orchestrator | 2026-04-28 05:46:31.360581 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-28 05:46:31.360590 | orchestrator | Tuesday 28 April 2026 05:46:29 +0000 (0:00:00.762) 0:31:03.114 ********* 2026-04-28 05:46:31.360598 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:46:31.360606 | orchestrator | 2026-04-28 05:46:31.360615 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-28 05:46:31.360623 | orchestrator | Tuesday 28 April 2026 05:46:30 +0000 (0:00:00.788) 0:31:03.903 ********* 2026-04-28 05:46:31.360632 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:46:31.360640 | orchestrator | 2026-04-28 05:46:31.360649 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-28 05:46:31.360658 | orchestrator | Tuesday 28 April 2026 05:46:31 +0000 (0:00:00.778) 0:31:04.682 ********* 2026-04-28 05:46:31.360675 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.657086 | orchestrator | 2026-04-28 05:47:15.657202 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-28 05:47:15.657218 | orchestrator | Tuesday 28 April 2026 05:46:32 +0000 (0:00:00.771) 0:31:05.454 ********* 2026-04-28 05:47:15.657230 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.657242 | orchestrator | 2026-04-28 05:47:15.657253 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-28 05:47:15.657264 | orchestrator | Tuesday 28 April 2026 05:46:32 +0000 (0:00:00.787) 0:31:06.242 ********* 2026-04-28 05:47:15.657275 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.657285 | orchestrator | 2026-04-28 05:47:15.657296 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-28 05:47:15.657307 | orchestrator | Tuesday 28 April 2026 05:46:33 +0000 (0:00:00.800) 0:31:07.042 ********* 2026-04-28 05:47:15.657318 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.657329 | orchestrator | 2026-04-28 05:47:15.657339 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-28 05:47:15.657350 | orchestrator | Tuesday 28 April 2026 05:46:34 +0000 (0:00:00.769) 0:31:07.812 ********* 2026-04-28 05:47:15.657361 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.657372 | orchestrator | 2026-04-28 05:47:15.657382 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-28 05:47:15.657393 | orchestrator | Tuesday 28 April 2026 05:46:35 +0000 (0:00:00.767) 0:31:08.580 ********* 2026-04-28 05:47:15.657404 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:47:15.657416 | orchestrator | 2026-04-28 05:47:15.657427 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-28 05:47:15.657438 | orchestrator | Tuesday 28 April 2026 05:46:36 +0000 (0:00:01.619) 0:31:10.199 ********* 2026-04-28 05:47:15.657449 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:47:15.657460 | orchestrator | 2026-04-28 05:47:15.657471 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-28 05:47:15.657481 | orchestrator | Tuesday 28 April 2026 05:46:38 +0000 (0:00:02.147) 0:31:12.347 ********* 2026-04-28 05:47:15.657492 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-2 2026-04-28 05:47:15.657504 | orchestrator | 2026-04-28 05:47:15.657514 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-28 05:47:15.657525 | orchestrator | Tuesday 28 April 2026 05:46:40 +0000 (0:00:01.192) 0:31:13.539 ********* 2026-04-28 05:47:15.657536 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.657547 | orchestrator | 2026-04-28 05:47:15.657557 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-28 05:47:15.657568 | orchestrator | Tuesday 28 April 2026 05:46:41 +0000 (0:00:01.150) 0:31:14.689 ********* 2026-04-28 05:47:15.657605 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.657618 | orchestrator | 2026-04-28 05:47:15.657631 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-28 05:47:15.657643 | orchestrator | Tuesday 28 April 2026 05:46:42 +0000 (0:00:01.114) 0:31:15.804 ********* 2026-04-28 05:47:15.657670 | orchestrator | ok: [testbed-node-2] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-28 05:47:15.657683 | orchestrator | ok: [testbed-node-2] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-28 05:47:15.657696 | orchestrator | 2026-04-28 05:47:15.657709 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-28 05:47:15.657721 | orchestrator | Tuesday 28 April 2026 05:46:44 +0000 (0:00:01.808) 0:31:17.612 ********* 2026-04-28 05:47:15.657734 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:47:15.657747 | orchestrator | 2026-04-28 05:47:15.657759 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-28 05:47:15.657770 | orchestrator | Tuesday 28 April 2026 05:46:45 +0000 (0:00:01.433) 0:31:19.046 ********* 2026-04-28 05:47:15.657811 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.657824 | orchestrator | 2026-04-28 05:47:15.657837 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-28 05:47:15.657850 | orchestrator | Tuesday 28 April 2026 05:46:46 +0000 (0:00:01.172) 0:31:20.219 ********* 2026-04-28 05:47:15.657863 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.657875 | orchestrator | 2026-04-28 05:47:15.657887 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-28 05:47:15.657900 | orchestrator | Tuesday 28 April 2026 05:46:47 +0000 (0:00:00.811) 0:31:21.030 ********* 2026-04-28 05:47:15.657913 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.657926 | orchestrator | 2026-04-28 05:47:15.657938 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-28 05:47:15.657951 | orchestrator | Tuesday 28 April 2026 05:46:48 +0000 (0:00:00.763) 0:31:21.794 ********* 2026-04-28 05:47:15.657963 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-2 2026-04-28 05:47:15.657975 | orchestrator | 2026-04-28 05:47:15.657985 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-28 05:47:15.657996 | orchestrator | Tuesday 28 April 2026 05:46:49 +0000 (0:00:01.156) 0:31:22.951 ********* 2026-04-28 05:47:15.658007 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:47:15.658075 | orchestrator | 2026-04-28 05:47:15.658088 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-28 05:47:15.658099 | orchestrator | Tuesday 28 April 2026 05:46:51 +0000 (0:00:01.714) 0:31:24.665 ********* 2026-04-28 05:47:15.658109 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-28 05:47:15.658120 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-28 05:47:15.658130 | orchestrator | skipping: [testbed-node-2] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-28 05:47:15.658141 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.658152 | orchestrator | 2026-04-28 05:47:15.658162 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-28 05:47:15.658173 | orchestrator | Tuesday 28 April 2026 05:46:52 +0000 (0:00:01.180) 0:31:25.846 ********* 2026-04-28 05:47:15.658202 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.658214 | orchestrator | 2026-04-28 05:47:15.658225 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-28 05:47:15.658236 | orchestrator | Tuesday 28 April 2026 05:46:53 +0000 (0:00:01.126) 0:31:26.973 ********* 2026-04-28 05:47:15.658246 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.658257 | orchestrator | 2026-04-28 05:47:15.658268 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-28 05:47:15.658279 | orchestrator | Tuesday 28 April 2026 05:46:54 +0000 (0:00:01.154) 0:31:28.127 ********* 2026-04-28 05:47:15.658299 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.658310 | orchestrator | 2026-04-28 05:47:15.658320 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-28 05:47:15.658331 | orchestrator | Tuesday 28 April 2026 05:46:55 +0000 (0:00:01.181) 0:31:29.309 ********* 2026-04-28 05:47:15.658342 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.658352 | orchestrator | 2026-04-28 05:47:15.658363 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-28 05:47:15.658374 | orchestrator | Tuesday 28 April 2026 05:46:57 +0000 (0:00:01.181) 0:31:30.490 ********* 2026-04-28 05:47:15.658385 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.658395 | orchestrator | 2026-04-28 05:47:15.658406 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-28 05:47:15.658417 | orchestrator | Tuesday 28 April 2026 05:46:57 +0000 (0:00:00.791) 0:31:31.282 ********* 2026-04-28 05:47:15.658427 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:47:15.658438 | orchestrator | 2026-04-28 05:47:15.658449 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-28 05:47:15.658460 | orchestrator | Tuesday 28 April 2026 05:47:00 +0000 (0:00:02.163) 0:31:33.445 ********* 2026-04-28 05:47:15.658471 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:47:15.658482 | orchestrator | 2026-04-28 05:47:15.658493 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-28 05:47:15.658504 | orchestrator | Tuesday 28 April 2026 05:47:00 +0000 (0:00:00.755) 0:31:34.201 ********* 2026-04-28 05:47:15.658515 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-2 2026-04-28 05:47:15.658526 | orchestrator | 2026-04-28 05:47:15.658536 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-28 05:47:15.658547 | orchestrator | Tuesday 28 April 2026 05:47:01 +0000 (0:00:01.143) 0:31:35.345 ********* 2026-04-28 05:47:15.658558 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.658569 | orchestrator | 2026-04-28 05:47:15.658580 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-28 05:47:15.658591 | orchestrator | Tuesday 28 April 2026 05:47:03 +0000 (0:00:01.092) 0:31:36.438 ********* 2026-04-28 05:47:15.658602 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.658613 | orchestrator | 2026-04-28 05:47:15.658624 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-28 05:47:15.658635 | orchestrator | Tuesday 28 April 2026 05:47:04 +0000 (0:00:01.117) 0:31:37.555 ********* 2026-04-28 05:47:15.658651 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.658662 | orchestrator | 2026-04-28 05:47:15.658673 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-28 05:47:15.658684 | orchestrator | Tuesday 28 April 2026 05:47:05 +0000 (0:00:01.148) 0:31:38.703 ********* 2026-04-28 05:47:15.658695 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.658705 | orchestrator | 2026-04-28 05:47:15.658716 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-28 05:47:15.658727 | orchestrator | Tuesday 28 April 2026 05:47:06 +0000 (0:00:01.215) 0:31:39.919 ********* 2026-04-28 05:47:15.658738 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.658749 | orchestrator | 2026-04-28 05:47:15.658759 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-28 05:47:15.658770 | orchestrator | Tuesday 28 April 2026 05:47:07 +0000 (0:00:01.143) 0:31:41.063 ********* 2026-04-28 05:47:15.658797 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.658808 | orchestrator | 2026-04-28 05:47:15.658819 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-28 05:47:15.658830 | orchestrator | Tuesday 28 April 2026 05:47:08 +0000 (0:00:01.125) 0:31:42.188 ********* 2026-04-28 05:47:15.658840 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.658851 | orchestrator | 2026-04-28 05:47:15.658862 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-28 05:47:15.658873 | orchestrator | Tuesday 28 April 2026 05:47:09 +0000 (0:00:01.139) 0:31:43.327 ********* 2026-04-28 05:47:15.658890 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:15.658901 | orchestrator | 2026-04-28 05:47:15.658911 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-28 05:47:15.658922 | orchestrator | Tuesday 28 April 2026 05:47:11 +0000 (0:00:01.151) 0:31:44.479 ********* 2026-04-28 05:47:15.658933 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:47:15.658944 | orchestrator | 2026-04-28 05:47:15.658955 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-28 05:47:15.658966 | orchestrator | Tuesday 28 April 2026 05:47:11 +0000 (0:00:00.815) 0:31:45.294 ********* 2026-04-28 05:47:15.658977 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-2 2026-04-28 05:47:15.658987 | orchestrator | 2026-04-28 05:47:15.658998 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-28 05:47:15.659009 | orchestrator | Tuesday 28 April 2026 05:47:13 +0000 (0:00:01.132) 0:31:46.427 ********* 2026-04-28 05:47:15.659020 | orchestrator | ok: [testbed-node-2] => (item=/etc/ceph) 2026-04-28 05:47:15.659031 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/) 2026-04-28 05:47:15.659042 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/mon) 2026-04-28 05:47:15.659052 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/osd) 2026-04-28 05:47:15.659063 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/mds) 2026-04-28 05:47:15.659074 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/tmp) 2026-04-28 05:47:15.659092 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/crash) 2026-04-28 05:47:54.101592 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/radosgw) 2026-04-28 05:47:54.101718 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-28 05:47:54.101738 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-28 05:47:54.101752 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-28 05:47:54.101766 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-28 05:47:54.101779 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-28 05:47:54.101862 | orchestrator | ok: [testbed-node-2] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-28 05:47:54.101881 | orchestrator | ok: [testbed-node-2] => (item=/var/run/ceph) 2026-04-28 05:47:54.101897 | orchestrator | ok: [testbed-node-2] => (item=/var/log/ceph) 2026-04-28 05:47:54.101913 | orchestrator | 2026-04-28 05:47:54.101929 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-28 05:47:54.101945 | orchestrator | Tuesday 28 April 2026 05:47:19 +0000 (0:00:06.590) 0:31:53.018 ********* 2026-04-28 05:47:54.101961 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.101977 | orchestrator | 2026-04-28 05:47:54.101992 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-28 05:47:54.102008 | orchestrator | Tuesday 28 April 2026 05:47:20 +0000 (0:00:00.881) 0:31:53.900 ********* 2026-04-28 05:47:54.102085 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.102101 | orchestrator | 2026-04-28 05:47:54.102117 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-28 05:47:54.102133 | orchestrator | Tuesday 28 April 2026 05:47:21 +0000 (0:00:00.774) 0:31:54.674 ********* 2026-04-28 05:47:54.102150 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.102166 | orchestrator | 2026-04-28 05:47:54.102182 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-28 05:47:54.102199 | orchestrator | Tuesday 28 April 2026 05:47:22 +0000 (0:00:00.825) 0:31:55.500 ********* 2026-04-28 05:47:54.102217 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.102230 | orchestrator | 2026-04-28 05:47:54.102244 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-28 05:47:54.102258 | orchestrator | Tuesday 28 April 2026 05:47:23 +0000 (0:00:00.910) 0:31:56.410 ********* 2026-04-28 05:47:54.102302 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.102316 | orchestrator | 2026-04-28 05:47:54.102331 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-28 05:47:54.102346 | orchestrator | Tuesday 28 April 2026 05:47:23 +0000 (0:00:00.787) 0:31:57.198 ********* 2026-04-28 05:47:54.102360 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.102374 | orchestrator | 2026-04-28 05:47:54.102390 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-28 05:47:54.102405 | orchestrator | Tuesday 28 April 2026 05:47:24 +0000 (0:00:00.771) 0:31:57.970 ********* 2026-04-28 05:47:54.102419 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.102432 | orchestrator | 2026-04-28 05:47:54.102461 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-28 05:47:54.102475 | orchestrator | Tuesday 28 April 2026 05:47:25 +0000 (0:00:00.771) 0:31:58.742 ********* 2026-04-28 05:47:54.102490 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.102504 | orchestrator | 2026-04-28 05:47:54.102518 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-28 05:47:54.102532 | orchestrator | Tuesday 28 April 2026 05:47:26 +0000 (0:00:00.788) 0:31:59.530 ********* 2026-04-28 05:47:54.102546 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.102558 | orchestrator | 2026-04-28 05:47:54.102570 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-28 05:47:54.102582 | orchestrator | Tuesday 28 April 2026 05:47:26 +0000 (0:00:00.776) 0:32:00.307 ********* 2026-04-28 05:47:54.102595 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.102608 | orchestrator | 2026-04-28 05:47:54.102621 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-28 05:47:54.102635 | orchestrator | Tuesday 28 April 2026 05:47:27 +0000 (0:00:00.791) 0:32:01.098 ********* 2026-04-28 05:47:54.102647 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.102661 | orchestrator | 2026-04-28 05:47:54.102673 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-28 05:47:54.102685 | orchestrator | Tuesday 28 April 2026 05:47:28 +0000 (0:00:00.751) 0:32:01.850 ********* 2026-04-28 05:47:54.102694 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.102701 | orchestrator | 2026-04-28 05:47:54.102709 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-28 05:47:54.102717 | orchestrator | Tuesday 28 April 2026 05:47:29 +0000 (0:00:00.777) 0:32:02.627 ********* 2026-04-28 05:47:54.102725 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.102733 | orchestrator | 2026-04-28 05:47:54.102740 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-28 05:47:54.102748 | orchestrator | Tuesday 28 April 2026 05:47:30 +0000 (0:00:00.854) 0:32:03.482 ********* 2026-04-28 05:47:54.102756 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.102764 | orchestrator | 2026-04-28 05:47:54.102771 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-28 05:47:54.102779 | orchestrator | Tuesday 28 April 2026 05:47:30 +0000 (0:00:00.758) 0:32:04.240 ********* 2026-04-28 05:47:54.102787 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.102826 | orchestrator | 2026-04-28 05:47:54.102834 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-28 05:47:54.102841 | orchestrator | Tuesday 28 April 2026 05:47:31 +0000 (0:00:00.866) 0:32:05.107 ********* 2026-04-28 05:47:54.102849 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.102857 | orchestrator | 2026-04-28 05:47:54.102864 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-28 05:47:54.102872 | orchestrator | Tuesday 28 April 2026 05:47:32 +0000 (0:00:00.760) 0:32:05.868 ********* 2026-04-28 05:47:54.102900 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.102909 | orchestrator | 2026-04-28 05:47:54.102917 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 05:47:54.102937 | orchestrator | Tuesday 28 April 2026 05:47:33 +0000 (0:00:00.766) 0:32:06.634 ********* 2026-04-28 05:47:54.102945 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.102953 | orchestrator | 2026-04-28 05:47:54.102961 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 05:47:54.102969 | orchestrator | Tuesday 28 April 2026 05:47:34 +0000 (0:00:00.820) 0:32:07.455 ********* 2026-04-28 05:47:54.102976 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.102984 | orchestrator | 2026-04-28 05:47:54.102992 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 05:47:54.103000 | orchestrator | Tuesday 28 April 2026 05:47:34 +0000 (0:00:00.769) 0:32:08.224 ********* 2026-04-28 05:47:54.103007 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.103015 | orchestrator | 2026-04-28 05:47:54.103022 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 05:47:54.103030 | orchestrator | Tuesday 28 April 2026 05:47:35 +0000 (0:00:00.762) 0:32:08.987 ********* 2026-04-28 05:47:54.103038 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.103052 | orchestrator | 2026-04-28 05:47:54.103065 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 05:47:54.103078 | orchestrator | Tuesday 28 April 2026 05:47:36 +0000 (0:00:00.821) 0:32:09.809 ********* 2026-04-28 05:47:54.103090 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-28 05:47:54.103104 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-28 05:47:54.103116 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-28 05:47:54.103129 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.103142 | orchestrator | 2026-04-28 05:47:54.103156 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 05:47:54.103169 | orchestrator | Tuesday 28 April 2026 05:47:37 +0000 (0:00:01.047) 0:32:10.856 ********* 2026-04-28 05:47:54.103183 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-28 05:47:54.103197 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-28 05:47:54.103210 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-28 05:47:54.103224 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.103238 | orchestrator | 2026-04-28 05:47:54.103251 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 05:47:54.103265 | orchestrator | Tuesday 28 April 2026 05:47:38 +0000 (0:00:01.067) 0:32:11.923 ********* 2026-04-28 05:47:54.103278 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-3)  2026-04-28 05:47:54.103292 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-4)  2026-04-28 05:47:54.103306 | orchestrator | skipping: [testbed-node-2] => (item=testbed-node-5)  2026-04-28 05:47:54.103329 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.103343 | orchestrator | 2026-04-28 05:47:54.103357 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 05:47:54.103373 | orchestrator | Tuesday 28 April 2026 05:47:39 +0000 (0:00:01.068) 0:32:12.992 ********* 2026-04-28 05:47:54.103387 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.103397 | orchestrator | 2026-04-28 05:47:54.103404 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 05:47:54.103412 | orchestrator | Tuesday 28 April 2026 05:47:40 +0000 (0:00:00.785) 0:32:13.777 ********* 2026-04-28 05:47:54.103420 | orchestrator | skipping: [testbed-node-2] => (item=0)  2026-04-28 05:47:54.103428 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.103436 | orchestrator | 2026-04-28 05:47:54.103444 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-28 05:47:54.103452 | orchestrator | Tuesday 28 April 2026 05:47:41 +0000 (0:00:00.878) 0:32:14.656 ********* 2026-04-28 05:47:54.103460 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:47:54.103467 | orchestrator | 2026-04-28 05:47:54.103475 | orchestrator | TASK [ceph-mgr : Set_fact container_exec_cmd] ********************************** 2026-04-28 05:47:54.103490 | orchestrator | Tuesday 28 April 2026 05:47:42 +0000 (0:00:01.390) 0:32:16.046 ********* 2026-04-28 05:47:54.103498 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:47:54.103507 | orchestrator | ok: [testbed-node-2 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:47:54.103515 | orchestrator | ok: [testbed-node-2] => (item=testbed-node-2) 2026-04-28 05:47:54.103523 | orchestrator | 2026-04-28 05:47:54.103531 | orchestrator | TASK [ceph-mgr : Include common.yml] ******************************************* 2026-04-28 05:47:54.103538 | orchestrator | Tuesday 28 April 2026 05:47:44 +0000 (0:00:01.677) 0:32:17.724 ********* 2026-04-28 05:47:54.103546 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/common.yml for testbed-node-2 2026-04-28 05:47:54.103554 | orchestrator | 2026-04-28 05:47:54.103562 | orchestrator | TASK [ceph-mgr : Create mgr directory] ***************************************** 2026-04-28 05:47:54.103569 | orchestrator | Tuesday 28 April 2026 05:47:45 +0000 (0:00:01.242) 0:32:18.967 ********* 2026-04-28 05:47:54.103577 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:47:54.103585 | orchestrator | 2026-04-28 05:47:54.103593 | orchestrator | TASK [ceph-mgr : Fetch ceph mgr keyring] *************************************** 2026-04-28 05:47:54.103600 | orchestrator | Tuesday 28 April 2026 05:47:47 +0000 (0:00:01.596) 0:32:20.563 ********* 2026-04-28 05:47:54.103608 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:47:54.103616 | orchestrator | 2026-04-28 05:47:54.103624 | orchestrator | TASK [ceph-mgr : Create ceph mgr keyring(s) on a mon node] ********************* 2026-04-28 05:47:54.103631 | orchestrator | Tuesday 28 April 2026 05:47:48 +0000 (0:00:01.090) 0:32:21.654 ********* 2026-04-28 05:47:54.103639 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 05:47:54.103647 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 05:47:54.103662 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 05:48:40.637578 | orchestrator | ok: [testbed-node-2 -> {{ groups[mon_group_name][0] }}] 2026-04-28 05:48:40.637718 | orchestrator | 2026-04-28 05:48:40.637738 | orchestrator | TASK [ceph-mgr : Set_fact _mgr_keys] ******************************************* 2026-04-28 05:48:40.637751 | orchestrator | Tuesday 28 April 2026 05:47:55 +0000 (0:00:06.981) 0:32:28.635 ********* 2026-04-28 05:48:40.637762 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:48:40.637775 | orchestrator | 2026-04-28 05:48:40.637786 | orchestrator | TASK [ceph-mgr : Get keys from monitors] *************************************** 2026-04-28 05:48:40.637797 | orchestrator | Tuesday 28 April 2026 05:47:56 +0000 (0:00:01.226) 0:32:29.862 ********* 2026-04-28 05:48:40.637861 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-28 05:48:40.637873 | orchestrator | ok: [testbed-node-2] => (item=None) 2026-04-28 05:48:40.637883 | orchestrator | 2026-04-28 05:48:40.637894 | orchestrator | TASK [ceph-mgr : Copy ceph key(s) if needed] *********************************** 2026-04-28 05:48:40.637905 | orchestrator | Tuesday 28 April 2026 05:47:59 +0000 (0:00:03.404) 0:32:33.266 ********* 2026-04-28 05:48:40.637916 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-28 05:48:40.637927 | orchestrator | ok: [testbed-node-2] => (item=None) 2026-04-28 05:48:40.637937 | orchestrator | 2026-04-28 05:48:40.637948 | orchestrator | TASK [ceph-mgr : Set mgr key permissions] ************************************** 2026-04-28 05:48:40.637959 | orchestrator | Tuesday 28 April 2026 05:48:01 +0000 (0:00:02.034) 0:32:35.301 ********* 2026-04-28 05:48:40.637970 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:48:40.637981 | orchestrator | 2026-04-28 05:48:40.637992 | orchestrator | TASK [ceph-mgr : Append dashboard modules to ceph_mgr_modules] ***************** 2026-04-28 05:48:40.638002 | orchestrator | Tuesday 28 April 2026 05:48:03 +0000 (0:00:01.479) 0:32:36.780 ********* 2026-04-28 05:48:40.638078 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:48:40.638105 | orchestrator | 2026-04-28 05:48:40.638125 | orchestrator | TASK [ceph-mgr : Include pre_requisite.yml] ************************************ 2026-04-28 05:48:40.638145 | orchestrator | Tuesday 28 April 2026 05:48:04 +0000 (0:00:00.783) 0:32:37.564 ********* 2026-04-28 05:48:40.638192 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:48:40.638210 | orchestrator | 2026-04-28 05:48:40.638238 | orchestrator | TASK [ceph-mgr : Include start_mgr.yml] **************************************** 2026-04-28 05:48:40.638260 | orchestrator | Tuesday 28 April 2026 05:48:04 +0000 (0:00:00.772) 0:32:38.336 ********* 2026-04-28 05:48:40.638278 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/start_mgr.yml for testbed-node-2 2026-04-28 05:48:40.638296 | orchestrator | 2026-04-28 05:48:40.638314 | orchestrator | TASK [ceph-mgr : Ensure systemd service override directory exists] ************* 2026-04-28 05:48:40.638331 | orchestrator | Tuesday 28 April 2026 05:48:06 +0000 (0:00:01.128) 0:32:39.465 ********* 2026-04-28 05:48:40.638399 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:48:40.638420 | orchestrator | 2026-04-28 05:48:40.638439 | orchestrator | TASK [ceph-mgr : Add ceph-mgr systemd service overrides] *********************** 2026-04-28 05:48:40.638476 | orchestrator | Tuesday 28 April 2026 05:48:07 +0000 (0:00:01.136) 0:32:40.601 ********* 2026-04-28 05:48:40.638495 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:48:40.638513 | orchestrator | 2026-04-28 05:48:40.638532 | orchestrator | TASK [ceph-mgr : Include_tasks systemd.yml] ************************************ 2026-04-28 05:48:40.638551 | orchestrator | Tuesday 28 April 2026 05:48:08 +0000 (0:00:01.115) 0:32:41.717 ********* 2026-04-28 05:48:40.638570 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/systemd.yml for testbed-node-2 2026-04-28 05:48:40.638587 | orchestrator | 2026-04-28 05:48:40.638606 | orchestrator | TASK [ceph-mgr : Generate systemd unit file] *********************************** 2026-04-28 05:48:40.638625 | orchestrator | Tuesday 28 April 2026 05:48:09 +0000 (0:00:01.105) 0:32:42.823 ********* 2026-04-28 05:48:40.638643 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:48:40.638661 | orchestrator | 2026-04-28 05:48:40.638680 | orchestrator | TASK [ceph-mgr : Generate systemd ceph-mgr target file] ************************ 2026-04-28 05:48:40.638698 | orchestrator | Tuesday 28 April 2026 05:48:11 +0000 (0:00:01.986) 0:32:44.809 ********* 2026-04-28 05:48:40.638718 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:48:40.638735 | orchestrator | 2026-04-28 05:48:40.638753 | orchestrator | TASK [ceph-mgr : Enable ceph-mgr.target] *************************************** 2026-04-28 05:48:40.638772 | orchestrator | Tuesday 28 April 2026 05:48:13 +0000 (0:00:01.950) 0:32:46.760 ********* 2026-04-28 05:48:40.638789 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:48:40.638842 | orchestrator | 2026-04-28 05:48:40.638859 | orchestrator | TASK [ceph-mgr : Systemd start mgr] ******************************************** 2026-04-28 05:48:40.638876 | orchestrator | Tuesday 28 April 2026 05:48:15 +0000 (0:00:02.427) 0:32:49.188 ********* 2026-04-28 05:48:40.638894 | orchestrator | changed: [testbed-node-2] 2026-04-28 05:48:40.638911 | orchestrator | 2026-04-28 05:48:40.638930 | orchestrator | TASK [ceph-mgr : Include mgr_modules.yml] ************************************** 2026-04-28 05:48:40.638949 | orchestrator | Tuesday 28 April 2026 05:48:19 +0000 (0:00:03.576) 0:32:52.764 ********* 2026-04-28 05:48:40.638967 | orchestrator | included: /ansible/roles/ceph-mgr/tasks/mgr_modules.yml for testbed-node-2 2026-04-28 05:48:40.638985 | orchestrator | 2026-04-28 05:48:40.639003 | orchestrator | TASK [ceph-mgr : Wait for all mgr to be up] ************************************ 2026-04-28 05:48:40.639023 | orchestrator | Tuesday 28 April 2026 05:48:20 +0000 (0:00:01.559) 0:32:54.324 ********* 2026-04-28 05:48:40.639041 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-28 05:48:40.639060 | orchestrator | 2026-04-28 05:48:40.639079 | orchestrator | TASK [ceph-mgr : Get enabled modules from ceph-mgr] **************************** 2026-04-28 05:48:40.639096 | orchestrator | Tuesday 28 April 2026 05:48:23 +0000 (0:00:02.349) 0:32:56.674 ********* 2026-04-28 05:48:40.639114 | orchestrator | ok: [testbed-node-2 -> testbed-node-0(192.168.16.10)] 2026-04-28 05:48:40.639132 | orchestrator | 2026-04-28 05:48:40.639149 | orchestrator | TASK [ceph-mgr : Set _ceph_mgr_modules fact (convert _ceph_mgr_modules.stdout to a dict)] *** 2026-04-28 05:48:40.639167 | orchestrator | Tuesday 28 April 2026 05:48:25 +0000 (0:00:02.391) 0:32:59.066 ********* 2026-04-28 05:48:40.639186 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:48:40.639221 | orchestrator | 2026-04-28 05:48:40.639240 | orchestrator | TASK [ceph-mgr : Set _disabled_ceph_mgr_modules fact] ************************** 2026-04-28 05:48:40.639284 | orchestrator | Tuesday 28 April 2026 05:48:26 +0000 (0:00:01.291) 0:33:00.358 ********* 2026-04-28 05:48:40.639304 | orchestrator | ok: [testbed-node-2] 2026-04-28 05:48:40.639322 | orchestrator | 2026-04-28 05:48:40.639340 | orchestrator | TASK [ceph-mgr : Disable ceph mgr enabled modules] ***************************** 2026-04-28 05:48:40.639358 | orchestrator | Tuesday 28 April 2026 05:48:28 +0000 (0:00:01.202) 0:33:01.560 ********* 2026-04-28 05:48:40.639378 | orchestrator | skipping: [testbed-node-2] => (item=dashboard)  2026-04-28 05:48:40.639396 | orchestrator | skipping: [testbed-node-2] => (item=prometheus)  2026-04-28 05:48:40.639415 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:48:40.639427 | orchestrator | 2026-04-28 05:48:40.639438 | orchestrator | TASK [ceph-mgr : Add modules to ceph-mgr] ************************************** 2026-04-28 05:48:40.639449 | orchestrator | Tuesday 28 April 2026 05:48:29 +0000 (0:00:01.350) 0:33:02.910 ********* 2026-04-28 05:48:40.639459 | orchestrator | skipping: [testbed-node-2] => (item=balancer)  2026-04-28 05:48:40.639470 | orchestrator | skipping: [testbed-node-2] => (item=dashboard)  2026-04-28 05:48:40.639481 | orchestrator | skipping: [testbed-node-2] => (item=prometheus)  2026-04-28 05:48:40.639492 | orchestrator | skipping: [testbed-node-2] => (item=status)  2026-04-28 05:48:40.639502 | orchestrator | skipping: [testbed-node-2] 2026-04-28 05:48:40.639513 | orchestrator | 2026-04-28 05:48:40.639524 | orchestrator | PLAY [Set osd flags] *********************************************************** 2026-04-28 05:48:40.639534 | orchestrator | 2026-04-28 05:48:40.639545 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 05:48:40.639556 | orchestrator | Tuesday 28 April 2026 05:48:31 +0000 (0:00:01.913) 0:33:04.824 ********* 2026-04-28 05:48:40.639567 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:48:40.639577 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:48:40.639588 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:48:40.639598 | orchestrator | 2026-04-28 05:48:40.639609 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 05:48:40.639620 | orchestrator | Tuesday 28 April 2026 05:48:33 +0000 (0:00:01.617) 0:33:06.441 ********* 2026-04-28 05:48:40.639631 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:48:40.639641 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:48:40.639652 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:48:40.639663 | orchestrator | 2026-04-28 05:48:40.639674 | orchestrator | TASK [Get pool list] *********************************************************** 2026-04-28 05:48:40.639684 | orchestrator | Tuesday 28 April 2026 05:48:34 +0000 (0:00:01.627) 0:33:08.069 ********* 2026-04-28 05:48:40.639695 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-28 05:48:40.639706 | orchestrator | 2026-04-28 05:48:40.639716 | orchestrator | TASK [Get balancer module status] ********************************************** 2026-04-28 05:48:40.639727 | orchestrator | Tuesday 28 April 2026 05:48:37 +0000 (0:00:02.801) 0:33:10.870 ********* 2026-04-28 05:48:40.639738 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-28 05:48:40.639748 | orchestrator | 2026-04-28 05:48:40.639759 | orchestrator | TASK [Set_fact pools_pgautoscaler_mode] **************************************** 2026-04-28 05:48:40.639779 | orchestrator | Tuesday 28 April 2026 05:48:40 +0000 (0:00:02.798) 0:33:13.669 ********* 2026-04-28 05:48:40.639797 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 1, 'pool_name': '.mgr', 'create_time': '2026-04-28T03:08:36.042422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-28 05:48:40.639883 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 2, 'pool_name': 'cephfs_data', 'create_time': '2026-04-28T03:09:50.947848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '31', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-28 05:48:41.098225 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2026-04-28T03:09:54.403653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '31', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-28 05:48:41.098338 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 4, 'pool_name': 'default.rgw.buckets.data', 'create_time': '2026-04-28T03:10:55.964053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '65', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-28 05:48:41.098352 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 5, 'pool_name': 'default.rgw.buckets.index', 'create_time': '2026-04-28T03:11:02.092702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '67', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-28 05:48:41.098362 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 6, 'pool_name': 'default.rgw.control', 'create_time': '2026-04-28T03:11:08.363999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '68', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-28 05:48:41.098373 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 7, 'pool_name': 'default.rgw.log', 'create_time': '2026-04-28T03:11:14.611923+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '68', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-28 05:48:41.909985 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 8, 'pool_name': 'default.rgw.meta', 'create_time': '2026-04-28T03:11:20.806080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '70', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-28 05:48:41.910182 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 9, 'pool_name': '.rgw.root', 'create_time': '2026-04-28T03:11:34.107439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'on', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '112', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-28 05:48:41.910244 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 10, 'pool_name': 'backups', 'create_time': '2026-04-28T03:12:24.546032+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 107, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.059999942779541, 'score_stable': 2.059999942779541, 'optimal_score': 1, 'raw_score_acting': 2.059999942779541, 'raw_score_stable': 2.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-28 05:48:41.910263 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 11, 'pool_name': 'volumes', 'create_time': '2026-04-28T03:12:33.647792+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 116, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-28 05:48:41.910291 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 12, 'pool_name': 'images', 'create_time': '2026-04-28T03:12:43.346056+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '169', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 6, 'snap_epoch': 169, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-28 05:50:12.263456 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 13, 'pool_name': 'metrics', 'create_time': '2026-04-28T03:12:52.346184+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '130', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 130, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-28 05:50:12.263579 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'pool_id': 14, 'pool_name': 'vms', 'create_time': '2026-04-28T03:13:00.424239+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '138', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 138, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}) 2026-04-28 05:50:12.263598 | orchestrator | 2026-04-28 05:50:12.263627 | orchestrator | TASK [Disable balancer] ******************************************************** 2026-04-28 05:50:12.263646 | orchestrator | Tuesday 28 April 2026 05:48:43 +0000 (0:00:02.925) 0:33:16.595 ********* 2026-04-28 05:50:12.263657 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-28 05:50:12.263668 | orchestrator | 2026-04-28 05:50:12.263679 | orchestrator | TASK [Disable pg autoscale on pools] ******************************************* 2026-04-28 05:50:12.263698 | orchestrator | Tuesday 28 April 2026 05:48:46 +0000 (0:00:02.959) 0:33:19.555 ********* 2026-04-28 05:50:12.263709 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': '.mgr', 'mode': 'on'}) 2026-04-28 05:50:12.263721 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'cephfs_data', 'mode': 'on'}) 2026-04-28 05:50:12.263732 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'cephfs_metadata', 'mode': 'on'}) 2026-04-28 05:50:12.263743 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.buckets.data', 'mode': 'on'}) 2026-04-28 05:50:12.263755 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.buckets.index', 'mode': 'on'}) 2026-04-28 05:50:12.263766 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.control', 'mode': 'on'}) 2026-04-28 05:50:12.263776 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.log', 'mode': 'on'}) 2026-04-28 05:50:12.263787 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.meta', 'mode': 'on'}) 2026-04-28 05:50:12.263797 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': '.rgw.root', 'mode': 'on'}) 2026-04-28 05:50:12.263808 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'backups', 'mode': 'off'})  2026-04-28 05:50:12.263819 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'volumes', 'mode': 'off'})  2026-04-28 05:50:12.263881 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'images', 'mode': 'off'})  2026-04-28 05:50:12.263892 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'metrics', 'mode': 'off'})  2026-04-28 05:50:12.263903 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'vms', 'mode': 'off'})  2026-04-28 05:50:12.263913 | orchestrator | 2026-04-28 05:50:12.263924 | orchestrator | TASK [Set osd flags] *********************************************************** 2026-04-28 05:50:12.263935 | orchestrator | Tuesday 28 April 2026 05:49:56 +0000 (0:01:09.983) 0:34:29.538 ********* 2026-04-28 05:50:12.263945 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=noout) 2026-04-28 05:50:12.263955 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=nodeep-scrub) 2026-04-28 05:50:12.263966 | orchestrator | 2026-04-28 05:50:12.263979 | orchestrator | PLAY [Upgrade ceph osds cluster] *********************************************** 2026-04-28 05:50:12.263992 | orchestrator | 2026-04-28 05:50:12.264004 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 05:50:12.264016 | orchestrator | Tuesday 28 April 2026 05:50:02 +0000 (0:00:06.163) 0:34:35.701 ********* 2026-04-28 05:50:12.264028 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-3 2026-04-28 05:50:12.264040 | orchestrator | 2026-04-28 05:50:12.264053 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-28 05:50:12.264065 | orchestrator | Tuesday 28 April 2026 05:50:03 +0000 (0:00:01.136) 0:34:36.838 ********* 2026-04-28 05:50:12.264077 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:50:12.264090 | orchestrator | 2026-04-28 05:50:12.264102 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-28 05:50:12.264114 | orchestrator | Tuesday 28 April 2026 05:50:04 +0000 (0:00:01.537) 0:34:38.375 ********* 2026-04-28 05:50:12.264126 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:50:12.264139 | orchestrator | 2026-04-28 05:50:12.264150 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 05:50:12.264163 | orchestrator | Tuesday 28 April 2026 05:50:06 +0000 (0:00:01.174) 0:34:39.550 ********* 2026-04-28 05:50:12.264175 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:50:12.264187 | orchestrator | 2026-04-28 05:50:12.264200 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 05:50:12.264218 | orchestrator | Tuesday 28 April 2026 05:50:07 +0000 (0:00:01.439) 0:34:40.990 ********* 2026-04-28 05:50:12.264230 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:50:12.264242 | orchestrator | 2026-04-28 05:50:12.264254 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-28 05:50:12.264266 | orchestrator | Tuesday 28 April 2026 05:50:08 +0000 (0:00:01.113) 0:34:42.103 ********* 2026-04-28 05:50:12.264278 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:50:12.264290 | orchestrator | 2026-04-28 05:50:12.264302 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-28 05:50:12.264314 | orchestrator | Tuesday 28 April 2026 05:50:09 +0000 (0:00:01.157) 0:34:43.261 ********* 2026-04-28 05:50:12.264327 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:50:12.264339 | orchestrator | 2026-04-28 05:50:12.264349 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-28 05:50:12.264360 | orchestrator | Tuesday 28 April 2026 05:50:11 +0000 (0:00:01.150) 0:34:44.411 ********* 2026-04-28 05:50:12.264370 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:50:12.264381 | orchestrator | 2026-04-28 05:50:12.264392 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-28 05:50:12.264403 | orchestrator | Tuesday 28 April 2026 05:50:12 +0000 (0:00:01.086) 0:34:45.498 ********* 2026-04-28 05:50:12.264413 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:50:12.264424 | orchestrator | 2026-04-28 05:50:12.264447 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-28 05:50:37.360259 | orchestrator | Tuesday 28 April 2026 05:50:13 +0000 (0:00:01.161) 0:34:46.659 ********* 2026-04-28 05:50:37.360354 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:50:37.360366 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:50:37.360374 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:50:37.360381 | orchestrator | 2026-04-28 05:50:37.360389 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-28 05:50:37.360397 | orchestrator | Tuesday 28 April 2026 05:50:15 +0000 (0:00:01.964) 0:34:48.623 ********* 2026-04-28 05:50:37.360404 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:50:37.360413 | orchestrator | 2026-04-28 05:50:37.360420 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-28 05:50:37.360427 | orchestrator | Tuesday 28 April 2026 05:50:16 +0000 (0:00:01.297) 0:34:49.921 ********* 2026-04-28 05:50:37.360434 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:50:37.360441 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:50:37.360448 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:50:37.360455 | orchestrator | 2026-04-28 05:50:37.360462 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-28 05:50:37.360469 | orchestrator | Tuesday 28 April 2026 05:50:19 +0000 (0:00:03.247) 0:34:53.168 ********* 2026-04-28 05:50:37.360477 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-28 05:50:37.360485 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-28 05:50:37.360492 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-28 05:50:37.360499 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:50:37.360506 | orchestrator | 2026-04-28 05:50:37.360513 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-28 05:50:37.360521 | orchestrator | Tuesday 28 April 2026 05:50:21 +0000 (0:00:01.440) 0:34:54.608 ********* 2026-04-28 05:50:37.360529 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-28 05:50:37.360558 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-28 05:50:37.360566 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-28 05:50:37.360574 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:50:37.360581 | orchestrator | 2026-04-28 05:50:37.360588 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-28 05:50:37.360595 | orchestrator | Tuesday 28 April 2026 05:50:23 +0000 (0:00:02.052) 0:34:56.660 ********* 2026-04-28 05:50:37.360604 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:50:37.360613 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:50:37.360621 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:50:37.360628 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:50:37.360635 | orchestrator | 2026-04-28 05:50:37.360642 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-28 05:50:37.360650 | orchestrator | Tuesday 28 April 2026 05:50:24 +0000 (0:00:01.185) 0:34:57.846 ********* 2026-04-28 05:50:37.360682 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': 'e79a9ee6c12b', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-28 05:50:17.055309', 'end': '2026-04-28 05:50:17.087353', 'delta': '0:00:00.032044', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e79a9ee6c12b'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-28 05:50:37.360694 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': '00fb93644bb9', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-28 05:50:17.997383', 'end': '2026-04-28 05:50:18.048257', 'delta': '0:00:00.050874', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['00fb93644bb9'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-28 05:50:37.360708 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': '92b926b7d044', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-28 05:50:18.594684', 'end': '2026-04-28 05:50:18.641025', 'delta': '0:00:00.046341', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['92b926b7d044'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-28 05:50:37.360716 | orchestrator | 2026-04-28 05:50:37.360723 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-28 05:50:37.360730 | orchestrator | Tuesday 28 April 2026 05:50:25 +0000 (0:00:01.305) 0:34:59.151 ********* 2026-04-28 05:50:37.360737 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:50:37.360744 | orchestrator | 2026-04-28 05:50:37.360751 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-28 05:50:37.360758 | orchestrator | Tuesday 28 April 2026 05:50:27 +0000 (0:00:01.346) 0:35:00.498 ********* 2026-04-28 05:50:37.360765 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:50:37.360772 | orchestrator | 2026-04-28 05:50:37.360780 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-28 05:50:37.360787 | orchestrator | Tuesday 28 April 2026 05:50:28 +0000 (0:00:01.220) 0:35:01.719 ********* 2026-04-28 05:50:37.360794 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:50:37.360801 | orchestrator | 2026-04-28 05:50:37.360808 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-28 05:50:37.360816 | orchestrator | Tuesday 28 April 2026 05:50:29 +0000 (0:00:01.154) 0:35:02.874 ********* 2026-04-28 05:50:37.360825 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-28 05:50:37.360887 | orchestrator | 2026-04-28 05:50:37.360897 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 05:50:37.360905 | orchestrator | Tuesday 28 April 2026 05:50:31 +0000 (0:00:01.994) 0:35:04.868 ********* 2026-04-28 05:50:37.360913 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:50:37.360921 | orchestrator | 2026-04-28 05:50:37.360930 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-28 05:50:37.360938 | orchestrator | Tuesday 28 April 2026 05:50:32 +0000 (0:00:01.162) 0:35:06.030 ********* 2026-04-28 05:50:37.360946 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:50:37.360953 | orchestrator | 2026-04-28 05:50:37.360960 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-28 05:50:37.360967 | orchestrator | Tuesday 28 April 2026 05:50:33 +0000 (0:00:01.149) 0:35:07.180 ********* 2026-04-28 05:50:37.360974 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:50:37.360981 | orchestrator | 2026-04-28 05:50:37.360988 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 05:50:37.360995 | orchestrator | Tuesday 28 April 2026 05:50:35 +0000 (0:00:01.241) 0:35:08.422 ********* 2026-04-28 05:50:37.361002 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:50:37.361009 | orchestrator | 2026-04-28 05:50:37.361016 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-28 05:50:37.361023 | orchestrator | Tuesday 28 April 2026 05:50:36 +0000 (0:00:01.122) 0:35:09.544 ********* 2026-04-28 05:50:37.361030 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:50:37.361037 | orchestrator | 2026-04-28 05:50:37.361044 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-28 05:50:37.361055 | orchestrator | Tuesday 28 April 2026 05:50:37 +0000 (0:00:01.106) 0:35:10.651 ********* 2026-04-28 05:50:37.361069 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:50:43.349643 | orchestrator | 2026-04-28 05:50:43.349750 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-28 05:50:43.349791 | orchestrator | Tuesday 28 April 2026 05:50:38 +0000 (0:00:01.169) 0:35:11.820 ********* 2026-04-28 05:50:43.349804 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:50:43.349816 | orchestrator | 2026-04-28 05:50:43.349827 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-28 05:50:43.349885 | orchestrator | Tuesday 28 April 2026 05:50:39 +0000 (0:00:01.110) 0:35:12.931 ********* 2026-04-28 05:50:43.349897 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:50:43.349909 | orchestrator | 2026-04-28 05:50:43.349920 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-28 05:50:43.349931 | orchestrator | Tuesday 28 April 2026 05:50:40 +0000 (0:00:01.169) 0:35:14.101 ********* 2026-04-28 05:50:43.349941 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:50:43.349952 | orchestrator | 2026-04-28 05:50:43.349963 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-28 05:50:43.349975 | orchestrator | Tuesday 28 April 2026 05:50:41 +0000 (0:00:01.220) 0:35:15.321 ********* 2026-04-28 05:50:43.349986 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:50:43.349997 | orchestrator | 2026-04-28 05:50:43.350008 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-28 05:50:43.350074 | orchestrator | Tuesday 28 April 2026 05:50:43 +0000 (0:00:01.180) 0:35:16.502 ********* 2026-04-28 05:50:43.350088 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:50:43.350105 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1', 'dm-uuid-LVM-SMcSbjI9wnD6SeY7SKKJ6dCSoT074g1SuE3hmfWZ3V1NoBQYcdXeMp0c5DwXf9Jz'], 'uuids': ['bb15ffa5-db58-4aaf-8e50-4b001450e00b'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f7edf0fa', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz']}})  2026-04-28 05:50:43.350119 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c', 'scsi-SQEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '0b1dfca7', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:50:43.350132 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-CCJsyU-Xs4y-bAwu-Sr1U-RU9B-U5cX-8dk8mo', 'scsi-0QEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202', 'scsi-SQEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46b7ee74', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f']}})  2026-04-28 05:50:43.350155 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:50:43.350201 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:50:43.350216 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-18-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 05:50:43.350230 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:50:43.350243 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu', 'dm-uuid-CRYPT-LUKS2-5da20da06cd949e5b229e06742b9ea2c-94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 05:50:43.350256 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:50:43.350270 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f', 'dm-uuid-LVM-8dHS1FAptgldbJuN9Gw1hr0pl5XswJ3894zCAdztzvSylGKJfL2Zwu5Qsrm0jqWu'], 'uuids': ['5da20da0-6cd9-49e5-b229-e06742b9ea2c'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '46b7ee74', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu']}})  2026-04-28 05:50:43.350283 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-rTHLNA-XX65-cEa6-oPdR-i0kN-CrZ9-dGTohN', 'scsi-0QEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675', 'scsi-SQEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f7edf0fa', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1']}})  2026-04-28 05:50:43.350318 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:50:44.742465 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '3fe92a08', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:50:44.742566 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:50:44.742582 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:50:44.742594 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz', 'dm-uuid-CRYPT-LUKS2-bb15ffa5db584aaf8e504b001450e00b-uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 05:50:44.742630 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:50:44.742642 | orchestrator | 2026-04-28 05:50:44.742653 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-28 05:50:44.742664 | orchestrator | Tuesday 28 April 2026 05:50:44 +0000 (0:00:01.435) 0:35:17.937 ********* 2026-04-28 05:50:44.742708 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:50:44.742721 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1', 'dm-uuid-LVM-SMcSbjI9wnD6SeY7SKKJ6dCSoT074g1SuE3hmfWZ3V1NoBQYcdXeMp0c5DwXf9Jz'], 'uuids': ['bb15ffa5-db58-4aaf-8e50-4b001450e00b'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f7edf0fa', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:50:44.742733 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c', 'scsi-SQEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '0b1dfca7', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:50:44.742745 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-CCJsyU-Xs4y-bAwu-Sr1U-RU9B-U5cX-8dk8mo', 'scsi-0QEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202', 'scsi-SQEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46b7ee74', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:50:44.742764 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:50:44.742786 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:50:44.863268 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-18-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:50:44.863361 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:50:44.863376 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu', 'dm-uuid-CRYPT-LUKS2-5da20da06cd949e5b229e06742b9ea2c-94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:50:44.863387 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:50:44.863424 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f', 'dm-uuid-LVM-8dHS1FAptgldbJuN9Gw1hr0pl5XswJ3894zCAdztzvSylGKJfL2Zwu5Qsrm0jqWu'], 'uuids': ['5da20da0-6cd9-49e5-b229-e06742b9ea2c'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '46b7ee74', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:50:44.863469 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-rTHLNA-XX65-cEa6-oPdR-i0kN-CrZ9-dGTohN', 'scsi-0QEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675', 'scsi-SQEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f7edf0fa', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:50:44.863485 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:50:44.863498 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '3fe92a08', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:50:44.863523 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:50:44.863542 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:51:25.407604 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz', 'dm-uuid-CRYPT-LUKS2-bb15ffa5db584aaf8e504b001450e00b-uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:51:25.407722 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:51:25.407741 | orchestrator | 2026-04-28 05:51:25.407755 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-28 05:51:25.407768 | orchestrator | Tuesday 28 April 2026 05:50:46 +0000 (0:00:01.475) 0:35:19.413 ********* 2026-04-28 05:51:25.407779 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:51:25.407791 | orchestrator | 2026-04-28 05:51:25.407802 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-28 05:51:25.407813 | orchestrator | Tuesday 28 April 2026 05:50:47 +0000 (0:00:01.480) 0:35:20.894 ********* 2026-04-28 05:51:25.407824 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:51:25.407835 | orchestrator | 2026-04-28 05:51:25.407845 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 05:51:25.407908 | orchestrator | Tuesday 28 April 2026 05:50:48 +0000 (0:00:01.106) 0:35:22.001 ********* 2026-04-28 05:51:25.407945 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:51:25.407957 | orchestrator | 2026-04-28 05:51:25.407968 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 05:51:25.407979 | orchestrator | Tuesday 28 April 2026 05:50:50 +0000 (0:00:01.511) 0:35:23.512 ********* 2026-04-28 05:51:25.407989 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:51:25.408000 | orchestrator | 2026-04-28 05:51:25.408011 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 05:51:25.408022 | orchestrator | Tuesday 28 April 2026 05:50:51 +0000 (0:00:01.165) 0:35:24.677 ********* 2026-04-28 05:51:25.408033 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:51:25.408043 | orchestrator | 2026-04-28 05:51:25.408054 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 05:51:25.408064 | orchestrator | Tuesday 28 April 2026 05:50:52 +0000 (0:00:01.225) 0:35:25.903 ********* 2026-04-28 05:51:25.408075 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:51:25.408085 | orchestrator | 2026-04-28 05:51:25.408096 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-28 05:51:25.408106 | orchestrator | Tuesday 28 April 2026 05:50:53 +0000 (0:00:01.142) 0:35:27.046 ********* 2026-04-28 05:51:25.408117 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-0) 2026-04-28 05:51:25.408128 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-1) 2026-04-28 05:51:25.408141 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-2) 2026-04-28 05:51:25.408152 | orchestrator | 2026-04-28 05:51:25.408165 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-28 05:51:25.408177 | orchestrator | Tuesday 28 April 2026 05:50:55 +0000 (0:00:02.247) 0:35:29.293 ********* 2026-04-28 05:51:25.408190 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-28 05:51:25.408203 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-28 05:51:25.408215 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-28 05:51:25.408227 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:51:25.408240 | orchestrator | 2026-04-28 05:51:25.408252 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-28 05:51:25.408264 | orchestrator | Tuesday 28 April 2026 05:50:57 +0000 (0:00:01.162) 0:35:30.456 ********* 2026-04-28 05:51:25.408276 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-3 2026-04-28 05:51:25.408289 | orchestrator | 2026-04-28 05:51:25.408303 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 05:51:25.408330 | orchestrator | Tuesday 28 April 2026 05:50:58 +0000 (0:00:01.364) 0:35:31.820 ********* 2026-04-28 05:51:25.408343 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:51:25.408356 | orchestrator | 2026-04-28 05:51:25.408368 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 05:51:25.408380 | orchestrator | Tuesday 28 April 2026 05:50:59 +0000 (0:00:01.149) 0:35:32.970 ********* 2026-04-28 05:51:25.408392 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:51:25.408405 | orchestrator | 2026-04-28 05:51:25.408417 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 05:51:25.408429 | orchestrator | Tuesday 28 April 2026 05:51:00 +0000 (0:00:01.166) 0:35:34.137 ********* 2026-04-28 05:51:25.408441 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:51:25.408453 | orchestrator | 2026-04-28 05:51:25.408466 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 05:51:25.408478 | orchestrator | Tuesday 28 April 2026 05:51:01 +0000 (0:00:01.169) 0:35:35.306 ********* 2026-04-28 05:51:25.408491 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:51:25.408502 | orchestrator | 2026-04-28 05:51:25.408513 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 05:51:25.408523 | orchestrator | Tuesday 28 April 2026 05:51:03 +0000 (0:00:01.255) 0:35:36.562 ********* 2026-04-28 05:51:25.408534 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 05:51:25.408570 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 05:51:25.408582 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 05:51:25.408593 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:51:25.408603 | orchestrator | 2026-04-28 05:51:25.408614 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 05:51:25.408625 | orchestrator | Tuesday 28 April 2026 05:51:04 +0000 (0:00:01.518) 0:35:38.081 ********* 2026-04-28 05:51:25.408635 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 05:51:25.408646 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 05:51:25.408656 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 05:51:25.408667 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:51:25.408677 | orchestrator | 2026-04-28 05:51:25.408688 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 05:51:25.408698 | orchestrator | Tuesday 28 April 2026 05:51:06 +0000 (0:00:01.511) 0:35:39.593 ********* 2026-04-28 05:51:25.408709 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 05:51:25.408720 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 05:51:25.408730 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 05:51:25.408740 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:51:25.408751 | orchestrator | 2026-04-28 05:51:25.408762 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 05:51:25.408772 | orchestrator | Tuesday 28 April 2026 05:51:07 +0000 (0:00:01.439) 0:35:41.032 ********* 2026-04-28 05:51:25.408783 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:51:25.408793 | orchestrator | 2026-04-28 05:51:25.408804 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 05:51:25.408814 | orchestrator | Tuesday 28 April 2026 05:51:08 +0000 (0:00:01.166) 0:35:42.199 ********* 2026-04-28 05:51:25.408825 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-28 05:51:25.408835 | orchestrator | 2026-04-28 05:51:25.408877 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-28 05:51:25.408890 | orchestrator | Tuesday 28 April 2026 05:51:10 +0000 (0:00:01.370) 0:35:43.570 ********* 2026-04-28 05:51:25.408901 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:51:25.408911 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:51:25.408922 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:51:25.408932 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-28 05:51:25.408943 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 05:51:25.408953 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 05:51:25.408964 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 05:51:25.408975 | orchestrator | 2026-04-28 05:51:25.408985 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-28 05:51:25.408996 | orchestrator | Tuesday 28 April 2026 05:51:12 +0000 (0:00:02.337) 0:35:45.907 ********* 2026-04-28 05:51:25.409006 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:51:25.409017 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:51:25.409027 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:51:25.409038 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-28 05:51:25.409048 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 05:51:25.409059 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 05:51:25.409076 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 05:51:25.409087 | orchestrator | 2026-04-28 05:51:25.409097 | orchestrator | TASK [Get osd numbers - non container] ***************************************** 2026-04-28 05:51:25.409108 | orchestrator | Tuesday 28 April 2026 05:51:15 +0000 (0:00:02.666) 0:35:48.574 ********* 2026-04-28 05:51:25.409118 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:51:25.409129 | orchestrator | 2026-04-28 05:51:25.409139 | orchestrator | TASK [Set num_osds] ************************************************************ 2026-04-28 05:51:25.409156 | orchestrator | Tuesday 28 April 2026 05:51:16 +0000 (0:00:01.572) 0:35:50.147 ********* 2026-04-28 05:51:25.409167 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:51:25.409177 | orchestrator | 2026-04-28 05:51:25.409188 | orchestrator | TASK [Set_fact container_exec_cmd_osd] ***************************************** 2026-04-28 05:51:25.409198 | orchestrator | Tuesday 28 April 2026 05:51:17 +0000 (0:00:01.134) 0:35:51.281 ********* 2026-04-28 05:51:25.409209 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:51:25.409219 | orchestrator | 2026-04-28 05:51:25.409230 | orchestrator | TASK [Stop ceph osd] *********************************************************** 2026-04-28 05:51:25.409240 | orchestrator | Tuesday 28 April 2026 05:51:19 +0000 (0:00:01.322) 0:35:52.604 ********* 2026-04-28 05:51:25.409251 | orchestrator | changed: [testbed-node-3] => (item=0) 2026-04-28 05:51:25.409261 | orchestrator | changed: [testbed-node-3] => (item=3) 2026-04-28 05:51:25.409272 | orchestrator | 2026-04-28 05:51:25.409282 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 05:51:25.409293 | orchestrator | Tuesday 28 April 2026 05:51:24 +0000 (0:00:05.071) 0:35:57.675 ********* 2026-04-28 05:51:25.409303 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3 2026-04-28 05:51:25.409314 | orchestrator | 2026-04-28 05:51:25.409325 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 05:51:25.409342 | orchestrator | Tuesday 28 April 2026 05:51:25 +0000 (0:00:01.103) 0:35:58.779 ********* 2026-04-28 05:52:16.494165 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3 2026-04-28 05:52:16.494312 | orchestrator | 2026-04-28 05:52:16.494340 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 05:52:16.494359 | orchestrator | Tuesday 28 April 2026 05:51:26 +0000 (0:00:01.133) 0:35:59.912 ********* 2026-04-28 05:52:16.494379 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.494398 | orchestrator | 2026-04-28 05:52:16.494417 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 05:52:16.494438 | orchestrator | Tuesday 28 April 2026 05:51:27 +0000 (0:00:01.184) 0:36:01.097 ********* 2026-04-28 05:52:16.494457 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:52:16.494471 | orchestrator | 2026-04-28 05:52:16.494483 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 05:52:16.494496 | orchestrator | Tuesday 28 April 2026 05:51:29 +0000 (0:00:01.563) 0:36:02.661 ********* 2026-04-28 05:52:16.494509 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:52:16.494521 | orchestrator | 2026-04-28 05:52:16.494533 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 05:52:16.494546 | orchestrator | Tuesday 28 April 2026 05:51:30 +0000 (0:00:01.566) 0:36:04.228 ********* 2026-04-28 05:52:16.494559 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:52:16.494571 | orchestrator | 2026-04-28 05:52:16.494583 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 05:52:16.494596 | orchestrator | Tuesday 28 April 2026 05:51:32 +0000 (0:00:01.539) 0:36:05.767 ********* 2026-04-28 05:52:16.494608 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.494621 | orchestrator | 2026-04-28 05:52:16.494633 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 05:52:16.494645 | orchestrator | Tuesday 28 April 2026 05:51:33 +0000 (0:00:01.118) 0:36:06.886 ********* 2026-04-28 05:52:16.494657 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.494697 | orchestrator | 2026-04-28 05:52:16.494710 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 05:52:16.494723 | orchestrator | Tuesday 28 April 2026 05:51:34 +0000 (0:00:01.161) 0:36:08.048 ********* 2026-04-28 05:52:16.494735 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.494747 | orchestrator | 2026-04-28 05:52:16.494759 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 05:52:16.494771 | orchestrator | Tuesday 28 April 2026 05:51:35 +0000 (0:00:01.109) 0:36:09.158 ********* 2026-04-28 05:52:16.494784 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:52:16.494796 | orchestrator | 2026-04-28 05:52:16.494808 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 05:52:16.494818 | orchestrator | Tuesday 28 April 2026 05:51:37 +0000 (0:00:01.515) 0:36:10.673 ********* 2026-04-28 05:52:16.494829 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:52:16.494839 | orchestrator | 2026-04-28 05:52:16.494850 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 05:52:16.494862 | orchestrator | Tuesday 28 April 2026 05:51:38 +0000 (0:00:01.498) 0:36:12.172 ********* 2026-04-28 05:52:16.494906 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.494918 | orchestrator | 2026-04-28 05:52:16.494929 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 05:52:16.494939 | orchestrator | Tuesday 28 April 2026 05:51:39 +0000 (0:00:01.130) 0:36:13.303 ********* 2026-04-28 05:52:16.494950 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.494960 | orchestrator | 2026-04-28 05:52:16.494971 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 05:52:16.494981 | orchestrator | Tuesday 28 April 2026 05:51:41 +0000 (0:00:01.200) 0:36:14.503 ********* 2026-04-28 05:52:16.494992 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:52:16.495002 | orchestrator | 2026-04-28 05:52:16.495013 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 05:52:16.495024 | orchestrator | Tuesday 28 April 2026 05:51:42 +0000 (0:00:01.172) 0:36:15.676 ********* 2026-04-28 05:52:16.495034 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:52:16.495045 | orchestrator | 2026-04-28 05:52:16.495055 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 05:52:16.495066 | orchestrator | Tuesday 28 April 2026 05:51:43 +0000 (0:00:01.169) 0:36:16.846 ********* 2026-04-28 05:52:16.495076 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:52:16.495087 | orchestrator | 2026-04-28 05:52:16.495098 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 05:52:16.495108 | orchestrator | Tuesday 28 April 2026 05:51:44 +0000 (0:00:01.149) 0:36:17.996 ********* 2026-04-28 05:52:16.495119 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.495129 | orchestrator | 2026-04-28 05:52:16.495140 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 05:52:16.495165 | orchestrator | Tuesday 28 April 2026 05:51:45 +0000 (0:00:01.115) 0:36:19.112 ********* 2026-04-28 05:52:16.495176 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.495186 | orchestrator | 2026-04-28 05:52:16.495197 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 05:52:16.495207 | orchestrator | Tuesday 28 April 2026 05:51:46 +0000 (0:00:01.164) 0:36:20.277 ********* 2026-04-28 05:52:16.495218 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.495228 | orchestrator | 2026-04-28 05:52:16.495239 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 05:52:16.495249 | orchestrator | Tuesday 28 April 2026 05:51:48 +0000 (0:00:01.148) 0:36:21.426 ********* 2026-04-28 05:52:16.495260 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:52:16.495270 | orchestrator | 2026-04-28 05:52:16.495281 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 05:52:16.495292 | orchestrator | Tuesday 28 April 2026 05:51:49 +0000 (0:00:01.150) 0:36:22.576 ********* 2026-04-28 05:52:16.495302 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:52:16.495322 | orchestrator | 2026-04-28 05:52:16.495332 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-28 05:52:16.495343 | orchestrator | Tuesday 28 April 2026 05:51:50 +0000 (0:00:01.288) 0:36:23.865 ********* 2026-04-28 05:52:16.495354 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.495364 | orchestrator | 2026-04-28 05:52:16.495395 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-28 05:52:16.495407 | orchestrator | Tuesday 28 April 2026 05:51:51 +0000 (0:00:01.133) 0:36:24.998 ********* 2026-04-28 05:52:16.495417 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.495428 | orchestrator | 2026-04-28 05:52:16.495438 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-28 05:52:16.495449 | orchestrator | Tuesday 28 April 2026 05:51:52 +0000 (0:00:01.103) 0:36:26.101 ********* 2026-04-28 05:52:16.495459 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.495470 | orchestrator | 2026-04-28 05:52:16.495480 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-28 05:52:16.495491 | orchestrator | Tuesday 28 April 2026 05:51:53 +0000 (0:00:01.121) 0:36:27.223 ********* 2026-04-28 05:52:16.495502 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.495512 | orchestrator | 2026-04-28 05:52:16.495523 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-28 05:52:16.495533 | orchestrator | Tuesday 28 April 2026 05:51:55 +0000 (0:00:01.178) 0:36:28.401 ********* 2026-04-28 05:52:16.495544 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.495554 | orchestrator | 2026-04-28 05:52:16.495565 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-28 05:52:16.495576 | orchestrator | Tuesday 28 April 2026 05:51:56 +0000 (0:00:01.177) 0:36:29.579 ********* 2026-04-28 05:52:16.495587 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.495597 | orchestrator | 2026-04-28 05:52:16.495608 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-28 05:52:16.495618 | orchestrator | Tuesday 28 April 2026 05:51:57 +0000 (0:00:01.139) 0:36:30.718 ********* 2026-04-28 05:52:16.495629 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.495639 | orchestrator | 2026-04-28 05:52:16.495650 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-28 05:52:16.495661 | orchestrator | Tuesday 28 April 2026 05:51:58 +0000 (0:00:01.115) 0:36:31.834 ********* 2026-04-28 05:52:16.495672 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.495683 | orchestrator | 2026-04-28 05:52:16.495693 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-28 05:52:16.495703 | orchestrator | Tuesday 28 April 2026 05:51:59 +0000 (0:00:01.090) 0:36:32.924 ********* 2026-04-28 05:52:16.495714 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.495724 | orchestrator | 2026-04-28 05:52:16.495735 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-28 05:52:16.495745 | orchestrator | Tuesday 28 April 2026 05:52:00 +0000 (0:00:01.132) 0:36:34.057 ********* 2026-04-28 05:52:16.495756 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.495767 | orchestrator | 2026-04-28 05:52:16.495777 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-28 05:52:16.495788 | orchestrator | Tuesday 28 April 2026 05:52:01 +0000 (0:00:01.112) 0:36:35.170 ********* 2026-04-28 05:52:16.495798 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.495809 | orchestrator | 2026-04-28 05:52:16.495819 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-28 05:52:16.495830 | orchestrator | Tuesday 28 April 2026 05:52:02 +0000 (0:00:01.129) 0:36:36.300 ********* 2026-04-28 05:52:16.495841 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.495851 | orchestrator | 2026-04-28 05:52:16.495862 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-28 05:52:16.495898 | orchestrator | Tuesday 28 April 2026 05:52:04 +0000 (0:00:01.316) 0:36:37.617 ********* 2026-04-28 05:52:16.495918 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:52:16.495928 | orchestrator | 2026-04-28 05:52:16.495939 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-28 05:52:16.495950 | orchestrator | Tuesday 28 April 2026 05:52:06 +0000 (0:00:01.947) 0:36:39.564 ********* 2026-04-28 05:52:16.495960 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:52:16.495971 | orchestrator | 2026-04-28 05:52:16.495981 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-28 05:52:16.495992 | orchestrator | Tuesday 28 April 2026 05:52:08 +0000 (0:00:02.252) 0:36:41.817 ********* 2026-04-28 05:52:16.496002 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-3 2026-04-28 05:52:16.496013 | orchestrator | 2026-04-28 05:52:16.496024 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-28 05:52:16.496034 | orchestrator | Tuesday 28 April 2026 05:52:09 +0000 (0:00:01.177) 0:36:42.994 ********* 2026-04-28 05:52:16.496045 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.496055 | orchestrator | 2026-04-28 05:52:16.496066 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-28 05:52:16.496082 | orchestrator | Tuesday 28 April 2026 05:52:10 +0000 (0:00:01.161) 0:36:44.155 ********* 2026-04-28 05:52:16.496093 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.496104 | orchestrator | 2026-04-28 05:52:16.496114 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-28 05:52:16.496125 | orchestrator | Tuesday 28 April 2026 05:52:11 +0000 (0:00:01.200) 0:36:45.356 ********* 2026-04-28 05:52:16.496135 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-28 05:52:16.496146 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-28 05:52:16.496156 | orchestrator | 2026-04-28 05:52:16.496167 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-28 05:52:16.496178 | orchestrator | Tuesday 28 April 2026 05:52:13 +0000 (0:00:01.883) 0:36:47.240 ********* 2026-04-28 05:52:16.496188 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:52:16.496198 | orchestrator | 2026-04-28 05:52:16.496209 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-28 05:52:16.496220 | orchestrator | Tuesday 28 April 2026 05:52:15 +0000 (0:00:01.512) 0:36:48.752 ********* 2026-04-28 05:52:16.496230 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:52:16.496241 | orchestrator | 2026-04-28 05:52:16.496251 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-28 05:52:16.496270 | orchestrator | Tuesday 28 April 2026 05:52:16 +0000 (0:00:01.114) 0:36:49.867 ********* 2026-04-28 05:53:03.072093 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.072203 | orchestrator | 2026-04-28 05:53:03.072219 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-28 05:53:03.072231 | orchestrator | Tuesday 28 April 2026 05:52:17 +0000 (0:00:01.141) 0:36:51.009 ********* 2026-04-28 05:53:03.072241 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.072251 | orchestrator | 2026-04-28 05:53:03.072262 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-28 05:53:03.072272 | orchestrator | Tuesday 28 April 2026 05:52:18 +0000 (0:00:01.167) 0:36:52.176 ********* 2026-04-28 05:53:03.072282 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-3 2026-04-28 05:53:03.072292 | orchestrator | 2026-04-28 05:53:03.072302 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-28 05:53:03.072311 | orchestrator | Tuesday 28 April 2026 05:52:20 +0000 (0:00:01.335) 0:36:53.512 ********* 2026-04-28 05:53:03.072322 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:53:03.072340 | orchestrator | 2026-04-28 05:53:03.072358 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-28 05:53:03.072377 | orchestrator | Tuesday 28 April 2026 05:52:21 +0000 (0:00:01.777) 0:36:55.290 ********* 2026-04-28 05:53:03.072395 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-28 05:53:03.072442 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-28 05:53:03.072461 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-28 05:53:03.072479 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.072490 | orchestrator | 2026-04-28 05:53:03.072499 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-28 05:53:03.072509 | orchestrator | Tuesday 28 April 2026 05:52:23 +0000 (0:00:01.190) 0:36:56.480 ********* 2026-04-28 05:53:03.072518 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.072528 | orchestrator | 2026-04-28 05:53:03.072537 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-28 05:53:03.072547 | orchestrator | Tuesday 28 April 2026 05:52:24 +0000 (0:00:01.110) 0:36:57.591 ********* 2026-04-28 05:53:03.072556 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.072566 | orchestrator | 2026-04-28 05:53:03.072575 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-28 05:53:03.072585 | orchestrator | Tuesday 28 April 2026 05:52:25 +0000 (0:00:01.206) 0:36:58.797 ********* 2026-04-28 05:53:03.072595 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.072604 | orchestrator | 2026-04-28 05:53:03.072614 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-28 05:53:03.072624 | orchestrator | Tuesday 28 April 2026 05:52:26 +0000 (0:00:01.149) 0:36:59.947 ********* 2026-04-28 05:53:03.072635 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.072647 | orchestrator | 2026-04-28 05:53:03.072658 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-28 05:53:03.072669 | orchestrator | Tuesday 28 April 2026 05:52:27 +0000 (0:00:01.148) 0:37:01.096 ********* 2026-04-28 05:53:03.072681 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.072697 | orchestrator | 2026-04-28 05:53:03.072715 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-28 05:53:03.072732 | orchestrator | Tuesday 28 April 2026 05:52:28 +0000 (0:00:01.146) 0:37:02.243 ********* 2026-04-28 05:53:03.072748 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:53:03.072766 | orchestrator | 2026-04-28 05:53:03.072783 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-28 05:53:03.072801 | orchestrator | Tuesday 28 April 2026 05:52:31 +0000 (0:00:02.462) 0:37:04.706 ********* 2026-04-28 05:53:03.072813 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:53:03.072825 | orchestrator | 2026-04-28 05:53:03.072837 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-28 05:53:03.072848 | orchestrator | Tuesday 28 April 2026 05:52:32 +0000 (0:00:01.234) 0:37:05.940 ********* 2026-04-28 05:53:03.072860 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-3 2026-04-28 05:53:03.072871 | orchestrator | 2026-04-28 05:53:03.072880 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-28 05:53:03.072919 | orchestrator | Tuesday 28 April 2026 05:52:33 +0000 (0:00:01.143) 0:37:07.083 ********* 2026-04-28 05:53:03.072929 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.072939 | orchestrator | 2026-04-28 05:53:03.072948 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-28 05:53:03.072972 | orchestrator | Tuesday 28 April 2026 05:52:34 +0000 (0:00:01.215) 0:37:08.299 ********* 2026-04-28 05:53:03.072982 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.072991 | orchestrator | 2026-04-28 05:53:03.073001 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-28 05:53:03.073011 | orchestrator | Tuesday 28 April 2026 05:52:36 +0000 (0:00:01.232) 0:37:09.532 ********* 2026-04-28 05:53:03.073020 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.073029 | orchestrator | 2026-04-28 05:53:03.073039 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-28 05:53:03.073048 | orchestrator | Tuesday 28 April 2026 05:52:37 +0000 (0:00:01.130) 0:37:10.663 ********* 2026-04-28 05:53:03.073067 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.073076 | orchestrator | 2026-04-28 05:53:03.073086 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-28 05:53:03.073095 | orchestrator | Tuesday 28 April 2026 05:52:38 +0000 (0:00:01.128) 0:37:11.791 ********* 2026-04-28 05:53:03.073104 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.073114 | orchestrator | 2026-04-28 05:53:03.073123 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-28 05:53:03.073133 | orchestrator | Tuesday 28 April 2026 05:52:39 +0000 (0:00:01.150) 0:37:12.942 ********* 2026-04-28 05:53:03.073142 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.073152 | orchestrator | 2026-04-28 05:53:03.073180 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-28 05:53:03.073191 | orchestrator | Tuesday 28 April 2026 05:52:40 +0000 (0:00:01.137) 0:37:14.079 ********* 2026-04-28 05:53:03.073200 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.073210 | orchestrator | 2026-04-28 05:53:03.073219 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-28 05:53:03.073228 | orchestrator | Tuesday 28 April 2026 05:52:41 +0000 (0:00:01.158) 0:37:15.238 ********* 2026-04-28 05:53:03.073238 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.073247 | orchestrator | 2026-04-28 05:53:03.073257 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-28 05:53:03.073266 | orchestrator | Tuesday 28 April 2026 05:52:43 +0000 (0:00:01.236) 0:37:16.474 ********* 2026-04-28 05:53:03.073275 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:53:03.073285 | orchestrator | 2026-04-28 05:53:03.073294 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-28 05:53:03.073304 | orchestrator | Tuesday 28 April 2026 05:52:44 +0000 (0:00:01.138) 0:37:17.612 ********* 2026-04-28 05:53:03.073313 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-3 2026-04-28 05:53:03.073323 | orchestrator | 2026-04-28 05:53:03.073333 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-28 05:53:03.073342 | orchestrator | Tuesday 28 April 2026 05:52:45 +0000 (0:00:01.163) 0:37:18.776 ********* 2026-04-28 05:53:03.073352 | orchestrator | ok: [testbed-node-3] => (item=/etc/ceph) 2026-04-28 05:53:03.073361 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/) 2026-04-28 05:53:03.073371 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/mon) 2026-04-28 05:53:03.073380 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/osd) 2026-04-28 05:53:03.073390 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/mds) 2026-04-28 05:53:03.073399 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/tmp) 2026-04-28 05:53:03.073409 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/crash) 2026-04-28 05:53:03.073418 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/radosgw) 2026-04-28 05:53:03.073428 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-28 05:53:03.073438 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-28 05:53:03.073447 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-28 05:53:03.073457 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-28 05:53:03.073466 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-28 05:53:03.073476 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-28 05:53:03.073485 | orchestrator | ok: [testbed-node-3] => (item=/var/run/ceph) 2026-04-28 05:53:03.073495 | orchestrator | ok: [testbed-node-3] => (item=/var/log/ceph) 2026-04-28 05:53:03.073504 | orchestrator | 2026-04-28 05:53:03.073513 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-28 05:53:03.073523 | orchestrator | Tuesday 28 April 2026 05:52:52 +0000 (0:00:06.612) 0:37:25.389 ********* 2026-04-28 05:53:03.073532 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-3 2026-04-28 05:53:03.073549 | orchestrator | 2026-04-28 05:53:03.073559 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-28 05:53:03.073568 | orchestrator | Tuesday 28 April 2026 05:52:53 +0000 (0:00:01.611) 0:37:27.000 ********* 2026-04-28 05:53:03.073578 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-28 05:53:03.073589 | orchestrator | 2026-04-28 05:53:03.073598 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-28 05:53:03.073608 | orchestrator | Tuesday 28 April 2026 05:52:55 +0000 (0:00:01.584) 0:37:28.584 ********* 2026-04-28 05:53:03.073617 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-28 05:53:03.073627 | orchestrator | 2026-04-28 05:53:03.073636 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-28 05:53:03.073646 | orchestrator | Tuesday 28 April 2026 05:52:57 +0000 (0:00:02.053) 0:37:30.638 ********* 2026-04-28 05:53:03.073655 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.073665 | orchestrator | 2026-04-28 05:53:03.073674 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-28 05:53:03.073688 | orchestrator | Tuesday 28 April 2026 05:52:58 +0000 (0:00:01.113) 0:37:31.752 ********* 2026-04-28 05:53:03.073698 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.073707 | orchestrator | 2026-04-28 05:53:03.073717 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-28 05:53:03.073726 | orchestrator | Tuesday 28 April 2026 05:52:59 +0000 (0:00:01.106) 0:37:32.859 ********* 2026-04-28 05:53:03.073736 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.073745 | orchestrator | 2026-04-28 05:53:03.073755 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-28 05:53:03.073764 | orchestrator | Tuesday 28 April 2026 05:53:00 +0000 (0:00:01.154) 0:37:34.014 ********* 2026-04-28 05:53:03.073774 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.073783 | orchestrator | 2026-04-28 05:53:03.073792 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-28 05:53:03.073802 | orchestrator | Tuesday 28 April 2026 05:53:01 +0000 (0:00:01.143) 0:37:35.158 ********* 2026-04-28 05:53:03.073811 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.073821 | orchestrator | 2026-04-28 05:53:03.073830 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-28 05:53:03.073840 | orchestrator | Tuesday 28 April 2026 05:53:02 +0000 (0:00:01.132) 0:37:36.291 ********* 2026-04-28 05:53:03.073849 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:03.073859 | orchestrator | 2026-04-28 05:53:03.073874 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-28 05:53:54.232368 | orchestrator | Tuesday 28 April 2026 05:53:04 +0000 (0:00:01.140) 0:37:37.431 ********* 2026-04-28 05:53:54.232490 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:54.232507 | orchestrator | 2026-04-28 05:53:54.232520 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-28 05:53:54.232532 | orchestrator | Tuesday 28 April 2026 05:53:05 +0000 (0:00:01.146) 0:37:38.578 ********* 2026-04-28 05:53:54.232543 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:54.232554 | orchestrator | 2026-04-28 05:53:54.232565 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-28 05:53:54.232576 | orchestrator | Tuesday 28 April 2026 05:53:06 +0000 (0:00:01.111) 0:37:39.689 ********* 2026-04-28 05:53:54.232587 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:54.232598 | orchestrator | 2026-04-28 05:53:54.232609 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-28 05:53:54.232620 | orchestrator | Tuesday 28 April 2026 05:53:07 +0000 (0:00:01.181) 0:37:40.870 ********* 2026-04-28 05:53:54.232656 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:54.232668 | orchestrator | 2026-04-28 05:53:54.232679 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-28 05:53:54.232690 | orchestrator | Tuesday 28 April 2026 05:53:08 +0000 (0:00:01.132) 0:37:42.003 ********* 2026-04-28 05:53:54.232709 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:53:54.232728 | orchestrator | 2026-04-28 05:53:54.232746 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-28 05:53:54.232764 | orchestrator | Tuesday 28 April 2026 05:53:09 +0000 (0:00:01.199) 0:37:43.203 ********* 2026-04-28 05:53:54.232780 | orchestrator | changed: [testbed-node-3 -> testbed-node-2(192.168.16.12)] 2026-04-28 05:53:54.232798 | orchestrator | 2026-04-28 05:53:54.232816 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-28 05:53:54.232834 | orchestrator | Tuesday 28 April 2026 05:53:14 +0000 (0:00:05.016) 0:37:48.219 ********* 2026-04-28 05:53:54.232853 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-28 05:53:54.232866 | orchestrator | 2026-04-28 05:53:54.232877 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-28 05:53:54.232888 | orchestrator | Tuesday 28 April 2026 05:53:16 +0000 (0:00:01.218) 0:37:49.438 ********* 2026-04-28 05:53:54.232949 | orchestrator | changed: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log'}]) 2026-04-28 05:53:54.232975 | orchestrator | changed: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.13:8081'}]) 2026-04-28 05:53:54.232995 | orchestrator | 2026-04-28 05:53:54.233014 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-28 05:53:54.233032 | orchestrator | Tuesday 28 April 2026 05:53:23 +0000 (0:00:07.625) 0:37:57.064 ********* 2026-04-28 05:53:54.233050 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:54.233068 | orchestrator | 2026-04-28 05:53:54.233087 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-28 05:53:54.233107 | orchestrator | Tuesday 28 April 2026 05:53:24 +0000 (0:00:01.144) 0:37:58.208 ********* 2026-04-28 05:53:54.233125 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:54.233143 | orchestrator | 2026-04-28 05:53:54.233154 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 05:53:54.233165 | orchestrator | Tuesday 28 April 2026 05:53:25 +0000 (0:00:01.169) 0:37:59.377 ********* 2026-04-28 05:53:54.233176 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:54.233187 | orchestrator | 2026-04-28 05:53:54.233212 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 05:53:54.233223 | orchestrator | Tuesday 28 April 2026 05:53:27 +0000 (0:00:01.198) 0:38:00.576 ********* 2026-04-28 05:53:54.233234 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:54.233244 | orchestrator | 2026-04-28 05:53:54.233254 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 05:53:54.233265 | orchestrator | Tuesday 28 April 2026 05:53:28 +0000 (0:00:01.222) 0:38:01.799 ********* 2026-04-28 05:53:54.233275 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:54.233286 | orchestrator | 2026-04-28 05:53:54.233296 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 05:53:54.233307 | orchestrator | Tuesday 28 April 2026 05:53:29 +0000 (0:00:01.153) 0:38:02.952 ********* 2026-04-28 05:53:54.233329 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:53:54.233340 | orchestrator | 2026-04-28 05:53:54.233351 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 05:53:54.233361 | orchestrator | Tuesday 28 April 2026 05:53:30 +0000 (0:00:01.290) 0:38:04.243 ********* 2026-04-28 05:53:54.233372 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 05:53:54.233383 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 05:53:54.233394 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 05:53:54.233405 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:54.233415 | orchestrator | 2026-04-28 05:53:54.233426 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 05:53:54.233456 | orchestrator | Tuesday 28 April 2026 05:53:32 +0000 (0:00:01.445) 0:38:05.689 ********* 2026-04-28 05:53:54.233468 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 05:53:54.233478 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 05:53:54.233489 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 05:53:54.233500 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:54.233510 | orchestrator | 2026-04-28 05:53:54.233521 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 05:53:54.233531 | orchestrator | Tuesday 28 April 2026 05:53:33 +0000 (0:00:01.381) 0:38:07.070 ********* 2026-04-28 05:53:54.233542 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 05:53:54.233552 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 05:53:54.233563 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 05:53:54.233573 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:54.233583 | orchestrator | 2026-04-28 05:53:54.233594 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 05:53:54.233604 | orchestrator | Tuesday 28 April 2026 05:53:35 +0000 (0:00:01.892) 0:38:08.963 ********* 2026-04-28 05:53:54.233615 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:53:54.233626 | orchestrator | 2026-04-28 05:53:54.233636 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 05:53:54.233647 | orchestrator | Tuesday 28 April 2026 05:53:36 +0000 (0:00:01.186) 0:38:10.149 ********* 2026-04-28 05:53:54.233657 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-28 05:53:54.233668 | orchestrator | 2026-04-28 05:53:54.233679 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-28 05:53:54.233689 | orchestrator | Tuesday 28 April 2026 05:53:38 +0000 (0:00:02.043) 0:38:12.192 ********* 2026-04-28 05:53:54.233700 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:53:54.233710 | orchestrator | 2026-04-28 05:53:54.233721 | orchestrator | TASK [ceph-osd : Set_fact add_osd] ********************************************* 2026-04-28 05:53:54.233731 | orchestrator | Tuesday 28 April 2026 05:53:40 +0000 (0:00:01.832) 0:38:14.025 ********* 2026-04-28 05:53:54.233742 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:53:54.233753 | orchestrator | 2026-04-28 05:53:54.233763 | orchestrator | TASK [ceph-osd : Set_fact container_exec_cmd] ********************************** 2026-04-28 05:53:54.233773 | orchestrator | Tuesday 28 April 2026 05:53:41 +0000 (0:00:01.147) 0:38:15.173 ********* 2026-04-28 05:53:54.233784 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:53:54.233796 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:53:54.233806 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:53:54.233817 | orchestrator | 2026-04-28 05:53:54.233827 | orchestrator | TASK [ceph-osd : Include_tasks system_tuning.yml] ****************************** 2026-04-28 05:53:54.233837 | orchestrator | Tuesday 28 April 2026 05:53:43 +0000 (0:00:01.671) 0:38:16.844 ********* 2026-04-28 05:53:54.233849 | orchestrator | included: /ansible/roles/ceph-osd/tasks/system_tuning.yml for testbed-node-3 2026-04-28 05:53:54.233868 | orchestrator | 2026-04-28 05:53:54.233896 | orchestrator | TASK [ceph-osd : Create tmpfiles.d directory] ********************************** 2026-04-28 05:53:54.233938 | orchestrator | Tuesday 28 April 2026 05:53:44 +0000 (0:00:01.449) 0:38:18.294 ********* 2026-04-28 05:53:54.233957 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:54.233974 | orchestrator | 2026-04-28 05:53:54.233991 | orchestrator | TASK [ceph-osd : Disable transparent hugepage] ********************************* 2026-04-28 05:53:54.234009 | orchestrator | Tuesday 28 April 2026 05:53:46 +0000 (0:00:01.124) 0:38:19.418 ********* 2026-04-28 05:53:54.234111 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:54.234132 | orchestrator | 2026-04-28 05:53:54.234148 | orchestrator | TASK [ceph-osd : Get default vm.min_free_kbytes] ******************************* 2026-04-28 05:53:54.234159 | orchestrator | Tuesday 28 April 2026 05:53:47 +0000 (0:00:01.096) 0:38:20.515 ********* 2026-04-28 05:53:54.234170 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:53:54.234181 | orchestrator | 2026-04-28 05:53:54.234192 | orchestrator | TASK [ceph-osd : Set_fact vm_min_free_kbytes] ********************************** 2026-04-28 05:53:54.234202 | orchestrator | Tuesday 28 April 2026 05:53:48 +0000 (0:00:01.436) 0:38:21.952 ********* 2026-04-28 05:53:54.234213 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:53:54.234224 | orchestrator | 2026-04-28 05:53:54.234234 | orchestrator | TASK [ceph-osd : Apply operating system tuning] ******************************** 2026-04-28 05:53:54.234253 | orchestrator | Tuesday 28 April 2026 05:53:49 +0000 (0:00:01.148) 0:38:23.100 ********* 2026-04-28 05:53:54.234264 | orchestrator | ok: [testbed-node-3] => (item={'name': 'fs.aio-max-nr', 'value': '1048576', 'enable': True}) 2026-04-28 05:53:54.234275 | orchestrator | ok: [testbed-node-3] => (item={'name': 'fs.file-max', 'value': 26234859}) 2026-04-28 05:53:54.234285 | orchestrator | ok: [testbed-node-3] => (item={'name': 'vm.zone_reclaim_mode', 'value': 0}) 2026-04-28 05:53:54.234296 | orchestrator | ok: [testbed-node-3] => (item={'name': 'vm.swappiness', 'value': 10}) 2026-04-28 05:53:54.234306 | orchestrator | ok: [testbed-node-3] => (item={'name': 'vm.min_free_kbytes', 'value': '67584'}) 2026-04-28 05:53:54.234317 | orchestrator | 2026-04-28 05:53:54.234328 | orchestrator | TASK [ceph-osd : Install dependencies] ***************************************** 2026-04-28 05:53:54.234338 | orchestrator | Tuesday 28 April 2026 05:53:52 +0000 (0:00:02.947) 0:38:26.047 ********* 2026-04-28 05:53:54.234348 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:53:54.234359 | orchestrator | 2026-04-28 05:53:54.234369 | orchestrator | TASK [ceph-osd : Include_tasks common.yml] ************************************* 2026-04-28 05:53:54.234380 | orchestrator | Tuesday 28 April 2026 05:53:53 +0000 (0:00:01.312) 0:38:27.360 ********* 2026-04-28 05:53:54.234391 | orchestrator | included: /ansible/roles/ceph-osd/tasks/common.yml for testbed-node-3 2026-04-28 05:53:54.234401 | orchestrator | 2026-04-28 05:53:54.234412 | orchestrator | TASK [ceph-osd : Create bootstrap-osd and osd directories] ********************* 2026-04-28 05:55:01.680057 | orchestrator | Tuesday 28 April 2026 05:53:55 +0000 (0:00:01.551) 0:38:28.911 ********* 2026-04-28 05:55:01.680177 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-osd/) 2026-04-28 05:55:01.680194 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/osd/) 2026-04-28 05:55:01.680206 | orchestrator | 2026-04-28 05:55:01.680218 | orchestrator | TASK [ceph-osd : Get keys from monitors] *************************************** 2026-04-28 05:55:01.680230 | orchestrator | Tuesday 28 April 2026 05:53:57 +0000 (0:00:01.833) 0:38:30.745 ********* 2026-04-28 05:55:01.680241 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 05:55:01.680252 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-28 05:55:01.680263 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-28 05:55:01.680274 | orchestrator | 2026-04-28 05:55:01.680285 | orchestrator | TASK [ceph-osd : Copy ceph key(s) if needed] *********************************** 2026-04-28 05:55:01.680295 | orchestrator | Tuesday 28 April 2026 05:54:00 +0000 (0:00:03.186) 0:38:33.931 ********* 2026-04-28 05:55:01.680306 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-28 05:55:01.680319 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-28 05:55:01.680356 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:55:01.680368 | orchestrator | 2026-04-28 05:55:01.680379 | orchestrator | TASK [ceph-osd : Set noup flag] ************************************************ 2026-04-28 05:55:01.680390 | orchestrator | Tuesday 28 April 2026 05:54:02 +0000 (0:00:01.952) 0:38:35.884 ********* 2026-04-28 05:55:01.680401 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:55:01.680412 | orchestrator | 2026-04-28 05:55:01.680422 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm.yml] ****************************** 2026-04-28 05:55:01.680433 | orchestrator | Tuesday 28 April 2026 05:54:03 +0000 (0:00:01.267) 0:38:37.151 ********* 2026-04-28 05:55:01.680444 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:55:01.680454 | orchestrator | 2026-04-28 05:55:01.680465 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm-batch.yml] ************************ 2026-04-28 05:55:01.680476 | orchestrator | Tuesday 28 April 2026 05:54:04 +0000 (0:00:01.162) 0:38:38.314 ********* 2026-04-28 05:55:01.680486 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:55:01.680497 | orchestrator | 2026-04-28 05:55:01.680508 | orchestrator | TASK [ceph-osd : Include_tasks start_osds.yml] ********************************* 2026-04-28 05:55:01.680519 | orchestrator | Tuesday 28 April 2026 05:54:06 +0000 (0:00:01.164) 0:38:39.479 ********* 2026-04-28 05:55:01.680529 | orchestrator | included: /ansible/roles/ceph-osd/tasks/start_osds.yml for testbed-node-3 2026-04-28 05:55:01.680541 | orchestrator | 2026-04-28 05:55:01.680552 | orchestrator | TASK [ceph-osd : Get osd ids] ************************************************** 2026-04-28 05:55:01.680562 | orchestrator | Tuesday 28 April 2026 05:54:07 +0000 (0:00:01.414) 0:38:40.893 ********* 2026-04-28 05:55:01.680573 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:55:01.680584 | orchestrator | 2026-04-28 05:55:01.680594 | orchestrator | TASK [ceph-osd : Collect osd ids] ********************************************** 2026-04-28 05:55:01.680605 | orchestrator | Tuesday 28 April 2026 05:54:08 +0000 (0:00:01.445) 0:38:42.338 ********* 2026-04-28 05:55:01.680616 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:55:01.680627 | orchestrator | 2026-04-28 05:55:01.680637 | orchestrator | TASK [ceph-osd : Include_tasks systemd.yml] ************************************ 2026-04-28 05:55:01.680648 | orchestrator | Tuesday 28 April 2026 05:54:12 +0000 (0:00:03.417) 0:38:45.756 ********* 2026-04-28 05:55:01.680659 | orchestrator | included: /ansible/roles/ceph-osd/tasks/systemd.yml for testbed-node-3 2026-04-28 05:55:01.680669 | orchestrator | 2026-04-28 05:55:01.680680 | orchestrator | TASK [ceph-osd : Generate systemd unit file] *********************************** 2026-04-28 05:55:01.680691 | orchestrator | Tuesday 28 April 2026 05:54:13 +0000 (0:00:01.603) 0:38:47.360 ********* 2026-04-28 05:55:01.680702 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:55:01.680712 | orchestrator | 2026-04-28 05:55:01.680723 | orchestrator | TASK [ceph-osd : Generate systemd ceph-osd target file] ************************ 2026-04-28 05:55:01.680734 | orchestrator | Tuesday 28 April 2026 05:54:15 +0000 (0:00:01.938) 0:38:49.298 ********* 2026-04-28 05:55:01.680744 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:55:01.680755 | orchestrator | 2026-04-28 05:55:01.680766 | orchestrator | TASK [ceph-osd : Enable ceph-osd.target] *************************************** 2026-04-28 05:55:01.680777 | orchestrator | Tuesday 28 April 2026 05:54:17 +0000 (0:00:01.925) 0:38:51.223 ********* 2026-04-28 05:55:01.680787 | orchestrator | ok: [testbed-node-3] 2026-04-28 05:55:01.680798 | orchestrator | 2026-04-28 05:55:01.680816 | orchestrator | TASK [ceph-osd : Ensure systemd service override directory exists] ************* 2026-04-28 05:55:01.680853 | orchestrator | Tuesday 28 April 2026 05:54:20 +0000 (0:00:02.242) 0:38:53.466 ********* 2026-04-28 05:55:01.680874 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:55:01.680892 | orchestrator | 2026-04-28 05:55:01.680911 | orchestrator | TASK [ceph-osd : Add ceph-osd systemd service overrides] *********************** 2026-04-28 05:55:01.680929 | orchestrator | Tuesday 28 April 2026 05:54:21 +0000 (0:00:01.136) 0:38:54.603 ********* 2026-04-28 05:55:01.680973 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:55:01.680992 | orchestrator | 2026-04-28 05:55:01.681011 | orchestrator | TASK [ceph-osd : Ensure /var/lib/ceph/osd/- is present] ********* 2026-04-28 05:55:01.681039 | orchestrator | Tuesday 28 April 2026 05:54:22 +0000 (0:00:01.212) 0:38:55.816 ********* 2026-04-28 05:55:01.681051 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-28 05:55:01.681062 | orchestrator | ok: [testbed-node-3] => (item=3) 2026-04-28 05:55:01.681072 | orchestrator | 2026-04-28 05:55:01.681083 | orchestrator | TASK [ceph-osd : Write run file in /var/lib/ceph/osd/xxxx/run] ***************** 2026-04-28 05:55:01.681094 | orchestrator | Tuesday 28 April 2026 05:54:24 +0000 (0:00:01.778) 0:38:57.595 ********* 2026-04-28 05:55:01.681104 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-28 05:55:01.681115 | orchestrator | ok: [testbed-node-3] => (item=3) 2026-04-28 05:55:01.681126 | orchestrator | 2026-04-28 05:55:01.681136 | orchestrator | TASK [ceph-osd : Systemd start osd] ******************************************** 2026-04-28 05:55:01.681147 | orchestrator | Tuesday 28 April 2026 05:54:27 +0000 (0:00:02.842) 0:39:00.437 ********* 2026-04-28 05:55:01.681158 | orchestrator | changed: [testbed-node-3] => (item=0) 2026-04-28 05:55:01.681187 | orchestrator | changed: [testbed-node-3] => (item=3) 2026-04-28 05:55:01.681199 | orchestrator | 2026-04-28 05:55:01.681209 | orchestrator | TASK [ceph-osd : Unset noup flag] ********************************************** 2026-04-28 05:55:01.681220 | orchestrator | Tuesday 28 April 2026 05:54:31 +0000 (0:00:04.515) 0:39:04.953 ********* 2026-04-28 05:55:01.681231 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:55:01.681241 | orchestrator | 2026-04-28 05:55:01.681252 | orchestrator | TASK [ceph-osd : Wait for all osd to be up] ************************************ 2026-04-28 05:55:01.681262 | orchestrator | Tuesday 28 April 2026 05:54:32 +0000 (0:00:01.225) 0:39:06.179 ********* 2026-04-28 05:55:01.681273 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:55:01.681283 | orchestrator | 2026-04-28 05:55:01.681294 | orchestrator | TASK [ceph-osd : Include crush_rules.yml] ************************************** 2026-04-28 05:55:01.681304 | orchestrator | Tuesday 28 April 2026 05:54:34 +0000 (0:00:01.240) 0:39:07.419 ********* 2026-04-28 05:55:01.681321 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:55:01.681340 | orchestrator | 2026-04-28 05:55:01.681359 | orchestrator | TASK [Scan ceph-disk osds with ceph-volume if deploying nautilus] ************** 2026-04-28 05:55:01.681378 | orchestrator | Tuesday 28 April 2026 05:54:35 +0000 (0:00:01.383) 0:39:08.803 ********* 2026-04-28 05:55:01.681391 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:55:01.681402 | orchestrator | 2026-04-28 05:55:01.681413 | orchestrator | TASK [Activate scanned ceph-disk osds and migrate to ceph-volume if deploying nautilus] *** 2026-04-28 05:55:01.681424 | orchestrator | Tuesday 28 April 2026 05:54:36 +0000 (0:00:01.117) 0:39:09.921 ********* 2026-04-28 05:55:01.681435 | orchestrator | skipping: [testbed-node-3] 2026-04-28 05:55:01.681445 | orchestrator | 2026-04-28 05:55:01.681456 | orchestrator | TASK [Waiting for clean pgs...] ************************************************ 2026-04-28 05:55:01.681467 | orchestrator | Tuesday 28 April 2026 05:54:37 +0000 (0:00:01.096) 0:39:11.017 ********* 2026-04-28 05:55:01.681477 | orchestrator | FAILED - RETRYING: [testbed-node-3 -> testbed-node-0]: Waiting for clean pgs... (600 retries left). 2026-04-28 05:55:01.681489 | orchestrator | FAILED - RETRYING: [testbed-node-3 -> testbed-node-0]: Waiting for clean pgs... (599 retries left). 2026-04-28 05:55:01.681500 | orchestrator | FAILED - RETRYING: [testbed-node-3 -> testbed-node-0]: Waiting for clean pgs... (598 retries left). 2026-04-28 05:55:01.681511 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-28 05:55:01.681522 | orchestrator | 2026-04-28 05:55:01.681532 | orchestrator | PLAY [Upgrade ceph osds cluster] *********************************************** 2026-04-28 05:55:01.681543 | orchestrator | 2026-04-28 05:55:01.681554 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 05:55:01.681564 | orchestrator | Tuesday 28 April 2026 05:54:48 +0000 (0:00:11.189) 0:39:22.207 ********* 2026-04-28 05:55:01.681575 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-4 2026-04-28 05:55:01.681586 | orchestrator | 2026-04-28 05:55:01.681596 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-28 05:55:01.681607 | orchestrator | Tuesday 28 April 2026 05:54:49 +0000 (0:00:01.095) 0:39:23.303 ********* 2026-04-28 05:55:01.681631 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:55:01.681651 | orchestrator | 2026-04-28 05:55:01.681670 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-28 05:55:01.681689 | orchestrator | Tuesday 28 April 2026 05:54:51 +0000 (0:00:01.495) 0:39:24.798 ********* 2026-04-28 05:55:01.681701 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:55:01.681711 | orchestrator | 2026-04-28 05:55:01.681722 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 05:55:01.681733 | orchestrator | Tuesday 28 April 2026 05:54:52 +0000 (0:00:01.127) 0:39:25.925 ********* 2026-04-28 05:55:01.681743 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:55:01.681754 | orchestrator | 2026-04-28 05:55:01.681764 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 05:55:01.681775 | orchestrator | Tuesday 28 April 2026 05:54:54 +0000 (0:00:01.492) 0:39:27.418 ********* 2026-04-28 05:55:01.681786 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:55:01.681796 | orchestrator | 2026-04-28 05:55:01.681807 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-28 05:55:01.681818 | orchestrator | Tuesday 28 April 2026 05:54:55 +0000 (0:00:01.143) 0:39:28.562 ********* 2026-04-28 05:55:01.681828 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:55:01.681839 | orchestrator | 2026-04-28 05:55:01.681849 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-28 05:55:01.681867 | orchestrator | Tuesday 28 April 2026 05:54:56 +0000 (0:00:01.149) 0:39:29.712 ********* 2026-04-28 05:55:01.681878 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:55:01.681888 | orchestrator | 2026-04-28 05:55:01.681899 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-28 05:55:01.681910 | orchestrator | Tuesday 28 April 2026 05:54:57 +0000 (0:00:01.176) 0:39:30.888 ********* 2026-04-28 05:55:01.681920 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:55:01.681973 | orchestrator | 2026-04-28 05:55:01.681987 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-28 05:55:01.681998 | orchestrator | Tuesday 28 April 2026 05:54:58 +0000 (0:00:01.185) 0:39:32.074 ********* 2026-04-28 05:55:01.682009 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:55:01.682087 | orchestrator | 2026-04-28 05:55:01.682099 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-28 05:55:01.682109 | orchestrator | Tuesday 28 April 2026 05:54:59 +0000 (0:00:01.120) 0:39:33.195 ********* 2026-04-28 05:55:01.682120 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:55:01.682130 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:55:01.682141 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:55:01.682152 | orchestrator | 2026-04-28 05:55:01.682163 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-28 05:55:01.682173 | orchestrator | Tuesday 28 April 2026 05:55:01 +0000 (0:00:01.677) 0:39:34.872 ********* 2026-04-28 05:55:01.682194 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:55:26.494934 | orchestrator | 2026-04-28 05:55:26.495090 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-28 05:55:26.495118 | orchestrator | Tuesday 28 April 2026 05:55:02 +0000 (0:00:01.334) 0:39:36.207 ********* 2026-04-28 05:55:26.495138 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:55:26.495158 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:55:26.495176 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:55:26.495194 | orchestrator | 2026-04-28 05:55:26.495205 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-28 05:55:26.495216 | orchestrator | Tuesday 28 April 2026 05:55:05 +0000 (0:00:02.874) 0:39:39.081 ********* 2026-04-28 05:55:26.495249 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-28 05:55:26.495262 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-28 05:55:26.495272 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-28 05:55:26.495283 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:55:26.495294 | orchestrator | 2026-04-28 05:55:26.495304 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-28 05:55:26.495315 | orchestrator | Tuesday 28 April 2026 05:55:07 +0000 (0:00:01.410) 0:39:40.492 ********* 2026-04-28 05:55:26.495327 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-28 05:55:26.495341 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-28 05:55:26.495352 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-28 05:55:26.495363 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:55:26.495374 | orchestrator | 2026-04-28 05:55:26.495384 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-28 05:55:26.495395 | orchestrator | Tuesday 28 April 2026 05:55:08 +0000 (0:00:01.634) 0:39:42.127 ********* 2026-04-28 05:55:26.495408 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:55:26.495422 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:55:26.495448 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:55:26.495460 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:55:26.495471 | orchestrator | 2026-04-28 05:55:26.495482 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-28 05:55:26.495493 | orchestrator | Tuesday 28 April 2026 05:55:09 +0000 (0:00:01.139) 0:39:43.266 ********* 2026-04-28 05:55:26.495524 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': 'e79a9ee6c12b', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-28 05:55:03.331861', 'end': '2026-04-28 05:55:03.384436', 'delta': '0:00:00.052575', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e79a9ee6c12b'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-28 05:55:26.495546 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': '00fb93644bb9', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-28 05:55:03.912863', 'end': '2026-04-28 05:55:03.956950', 'delta': '0:00:00.044087', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['00fb93644bb9'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-28 05:55:26.495558 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': '92b926b7d044', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-28 05:55:04.476064', 'end': '2026-04-28 05:55:04.518457', 'delta': '0:00:00.042393', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['92b926b7d044'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-28 05:55:26.495569 | orchestrator | 2026-04-28 05:55:26.495580 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-28 05:55:26.495591 | orchestrator | Tuesday 28 April 2026 05:55:11 +0000 (0:00:01.170) 0:39:44.437 ********* 2026-04-28 05:55:26.495602 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:55:26.495613 | orchestrator | 2026-04-28 05:55:26.495623 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-28 05:55:26.495634 | orchestrator | Tuesday 28 April 2026 05:55:12 +0000 (0:00:01.207) 0:39:45.645 ********* 2026-04-28 05:55:26.495644 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:55:26.495655 | orchestrator | 2026-04-28 05:55:26.495665 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-28 05:55:26.495676 | orchestrator | Tuesday 28 April 2026 05:55:13 +0000 (0:00:01.231) 0:39:46.876 ********* 2026-04-28 05:55:26.495686 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:55:26.495697 | orchestrator | 2026-04-28 05:55:26.495707 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-28 05:55:26.495718 | orchestrator | Tuesday 28 April 2026 05:55:14 +0000 (0:00:01.138) 0:39:48.015 ********* 2026-04-28 05:55:26.495728 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-28 05:55:26.495739 | orchestrator | 2026-04-28 05:55:26.495749 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 05:55:26.495760 | orchestrator | Tuesday 28 April 2026 05:55:16 +0000 (0:00:02.353) 0:39:50.368 ********* 2026-04-28 05:55:26.495770 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:55:26.495781 | orchestrator | 2026-04-28 05:55:26.495791 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-28 05:55:26.495802 | orchestrator | Tuesday 28 April 2026 05:55:18 +0000 (0:00:01.225) 0:39:51.593 ********* 2026-04-28 05:55:26.495812 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:55:26.495822 | orchestrator | 2026-04-28 05:55:26.495833 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-28 05:55:26.495843 | orchestrator | Tuesday 28 April 2026 05:55:19 +0000 (0:00:01.139) 0:39:52.733 ********* 2026-04-28 05:55:26.495854 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:55:26.495864 | orchestrator | 2026-04-28 05:55:26.495880 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 05:55:26.495891 | orchestrator | Tuesday 28 April 2026 05:55:20 +0000 (0:00:01.237) 0:39:53.971 ********* 2026-04-28 05:55:26.495908 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:55:26.495918 | orchestrator | 2026-04-28 05:55:26.495929 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-28 05:55:26.495939 | orchestrator | Tuesday 28 April 2026 05:55:21 +0000 (0:00:01.129) 0:39:55.100 ********* 2026-04-28 05:55:26.495972 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:55:26.495983 | orchestrator | 2026-04-28 05:55:26.495993 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-28 05:55:26.496004 | orchestrator | Tuesday 28 April 2026 05:55:22 +0000 (0:00:01.132) 0:39:56.233 ********* 2026-04-28 05:55:26.496014 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:55:26.496025 | orchestrator | 2026-04-28 05:55:26.496035 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-28 05:55:26.496046 | orchestrator | Tuesday 28 April 2026 05:55:24 +0000 (0:00:01.210) 0:39:57.443 ********* 2026-04-28 05:55:26.496056 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:55:26.496067 | orchestrator | 2026-04-28 05:55:26.496077 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-28 05:55:26.496088 | orchestrator | Tuesday 28 April 2026 05:55:25 +0000 (0:00:01.232) 0:39:58.675 ********* 2026-04-28 05:55:26.496098 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:55:26.496109 | orchestrator | 2026-04-28 05:55:26.496120 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-28 05:55:26.496138 | orchestrator | Tuesday 28 April 2026 05:55:26 +0000 (0:00:01.191) 0:39:59.866 ********* 2026-04-28 05:55:29.044180 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:55:29.044276 | orchestrator | 2026-04-28 05:55:29.044291 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-28 05:55:29.044302 | orchestrator | Tuesday 28 April 2026 05:55:27 +0000 (0:00:01.166) 0:40:01.033 ********* 2026-04-28 05:55:29.044313 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:55:29.044324 | orchestrator | 2026-04-28 05:55:29.044334 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-28 05:55:29.044344 | orchestrator | Tuesday 28 April 2026 05:55:28 +0000 (0:00:01.162) 0:40:02.195 ********* 2026-04-28 05:55:29.044355 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:55:29.044370 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a', 'dm-uuid-LVM-Ef9S4L9mnk6YjVYwTU4OmJ1Dk0yNJkcNEeYiJgmdqy5Dk4JMIq1jh9ZhEgnxusYs'], 'uuids': ['46d73a0b-76ab-4c42-90e0-cf88eb28d186'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f49158cb', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs']}})  2026-04-28 05:55:29.044383 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80', 'scsi-SQEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '81043571', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:55:29.044432 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-l9OtEf-0x8l-OZFM-QMSY-xI5K-ifcY-q0IHfV', 'scsi-0QEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b', 'scsi-SQEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '6fed6807', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf']}})  2026-04-28 05:55:29.044444 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:55:29.044455 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:55:29.044483 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-13-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 05:55:29.044494 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:55:29.044505 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg', 'dm-uuid-CRYPT-LUKS2-699d16b2a15647d8861ce74191aa2e29-p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 05:55:29.044515 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:55:29.044525 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf', 'dm-uuid-LVM-jDSXafY010UkbP8ZmxeIQet2dAZt2ducp03EHOrl6D51efYCaF9MHllF0WrfMNUg'], 'uuids': ['699d16b2-a156-47d8-861c-e74191aa2e29'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '6fed6807', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg']}})  2026-04-28 05:55:29.044547 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-NfMdHp-i6Wd-iXE4-bdeT-UQcT-dakb-CDL8cZ', 'scsi-0QEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba', 'scsi-SQEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f49158cb', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a']}})  2026-04-28 05:55:29.044558 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:55:29.044581 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46815659', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:55:30.380736 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:55:30.380870 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:55:30.380903 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs', 'dm-uuid-CRYPT-LUKS2-46d73a0b76ab4c4290e0cf88eb28d186-EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 05:55:30.380920 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:55:30.380933 | orchestrator | 2026-04-28 05:55:30.380975 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-28 05:55:30.380990 | orchestrator | Tuesday 28 April 2026 05:55:30 +0000 (0:00:01.366) 0:40:03.562 ********* 2026-04-28 05:55:30.381034 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:55:30.381048 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a', 'dm-uuid-LVM-Ef9S4L9mnk6YjVYwTU4OmJ1Dk0yNJkcNEeYiJgmdqy5Dk4JMIq1jh9ZhEgnxusYs'], 'uuids': ['46d73a0b-76ab-4c42-90e0-cf88eb28d186'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f49158cb', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:55:30.381061 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80', 'scsi-SQEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '81043571', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:55:30.381103 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-l9OtEf-0x8l-OZFM-QMSY-xI5K-ifcY-q0IHfV', 'scsi-0QEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b', 'scsi-SQEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '6fed6807', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:55:30.381119 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:55:30.381131 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:55:30.381143 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-13-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:55:30.381182 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:55:30.381202 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg', 'dm-uuid-CRYPT-LUKS2-699d16b2a15647d8861ce74191aa2e29-p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:55:35.731544 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:55:35.731636 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf', 'dm-uuid-LVM-jDSXafY010UkbP8ZmxeIQet2dAZt2ducp03EHOrl6D51efYCaF9MHllF0WrfMNUg'], 'uuids': ['699d16b2-a156-47d8-861c-e74191aa2e29'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '6fed6807', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:55:35.731648 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-NfMdHp-i6Wd-iXE4-bdeT-UQcT-dakb-CDL8cZ', 'scsi-0QEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba', 'scsi-SQEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f49158cb', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:55:35.731656 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:55:35.731679 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46815659', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:55:35.731701 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:55:35.731708 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:55:35.731715 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs', 'dm-uuid-CRYPT-LUKS2-46d73a0b76ab4c4290e0cf88eb28d186-EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:55:35.731722 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:55:35.731735 | orchestrator | 2026-04-28 05:55:35.731742 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-28 05:55:35.731749 | orchestrator | Tuesday 28 April 2026 05:55:31 +0000 (0:00:01.366) 0:40:04.929 ********* 2026-04-28 05:55:35.731755 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:55:35.731761 | orchestrator | 2026-04-28 05:55:35.731767 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-28 05:55:35.731773 | orchestrator | Tuesday 28 April 2026 05:55:33 +0000 (0:00:01.495) 0:40:06.424 ********* 2026-04-28 05:55:35.731778 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:55:35.731784 | orchestrator | 2026-04-28 05:55:35.731790 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 05:55:35.731795 | orchestrator | Tuesday 28 April 2026 05:55:34 +0000 (0:00:01.206) 0:40:07.630 ********* 2026-04-28 05:55:35.731801 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:55:35.731807 | orchestrator | 2026-04-28 05:55:35.731812 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 05:55:35.731822 | orchestrator | Tuesday 28 April 2026 05:55:35 +0000 (0:00:01.479) 0:40:09.110 ********* 2026-04-28 05:56:17.110860 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:17.111046 | orchestrator | 2026-04-28 05:56:17.111067 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 05:56:17.111080 | orchestrator | Tuesday 28 April 2026 05:55:36 +0000 (0:00:01.120) 0:40:10.231 ********* 2026-04-28 05:56:17.111091 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:17.111102 | orchestrator | 2026-04-28 05:56:17.111113 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 05:56:17.111124 | orchestrator | Tuesday 28 April 2026 05:55:38 +0000 (0:00:01.240) 0:40:11.471 ********* 2026-04-28 05:56:17.111135 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:17.111145 | orchestrator | 2026-04-28 05:56:17.111156 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-28 05:56:17.111167 | orchestrator | Tuesday 28 April 2026 05:55:39 +0000 (0:00:01.165) 0:40:12.637 ********* 2026-04-28 05:56:17.111178 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-0) 2026-04-28 05:56:17.111189 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-1) 2026-04-28 05:56:17.111200 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-2) 2026-04-28 05:56:17.111210 | orchestrator | 2026-04-28 05:56:17.111221 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-28 05:56:17.111232 | orchestrator | Tuesday 28 April 2026 05:55:40 +0000 (0:00:01.706) 0:40:14.344 ********* 2026-04-28 05:56:17.111243 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-28 05:56:17.111254 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-28 05:56:17.111264 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-28 05:56:17.111291 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:17.111303 | orchestrator | 2026-04-28 05:56:17.111313 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-28 05:56:17.111324 | orchestrator | Tuesday 28 April 2026 05:55:42 +0000 (0:00:01.193) 0:40:15.537 ********* 2026-04-28 05:56:17.111334 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-4 2026-04-28 05:56:17.111345 | orchestrator | 2026-04-28 05:56:17.111357 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 05:56:17.111368 | orchestrator | Tuesday 28 April 2026 05:55:43 +0000 (0:00:01.145) 0:40:16.683 ********* 2026-04-28 05:56:17.111379 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:17.111389 | orchestrator | 2026-04-28 05:56:17.111402 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 05:56:17.111414 | orchestrator | Tuesday 28 April 2026 05:55:44 +0000 (0:00:01.128) 0:40:17.812 ********* 2026-04-28 05:56:17.111426 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:17.111438 | orchestrator | 2026-04-28 05:56:17.111475 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 05:56:17.111488 | orchestrator | Tuesday 28 April 2026 05:55:45 +0000 (0:00:01.135) 0:40:18.948 ********* 2026-04-28 05:56:17.111500 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:17.111511 | orchestrator | 2026-04-28 05:56:17.111522 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 05:56:17.111532 | orchestrator | Tuesday 28 April 2026 05:55:46 +0000 (0:00:01.158) 0:40:20.107 ********* 2026-04-28 05:56:17.111543 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:56:17.111554 | orchestrator | 2026-04-28 05:56:17.111564 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 05:56:17.111575 | orchestrator | Tuesday 28 April 2026 05:55:47 +0000 (0:00:01.250) 0:40:21.358 ********* 2026-04-28 05:56:17.111587 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-28 05:56:17.111607 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-28 05:56:17.111627 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-28 05:56:17.111645 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:17.111664 | orchestrator | 2026-04-28 05:56:17.111684 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 05:56:17.111702 | orchestrator | Tuesday 28 April 2026 05:55:49 +0000 (0:00:01.821) 0:40:23.180 ********* 2026-04-28 05:56:17.111714 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-28 05:56:17.111725 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-28 05:56:17.111735 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-28 05:56:17.111746 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:17.111756 | orchestrator | 2026-04-28 05:56:17.111767 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 05:56:17.111777 | orchestrator | Tuesday 28 April 2026 05:55:51 +0000 (0:00:01.941) 0:40:25.122 ********* 2026-04-28 05:56:17.111788 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-28 05:56:17.111798 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-28 05:56:17.111809 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-28 05:56:17.111819 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:17.111830 | orchestrator | 2026-04-28 05:56:17.111847 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 05:56:17.111865 | orchestrator | Tuesday 28 April 2026 05:55:53 +0000 (0:00:01.433) 0:40:26.556 ********* 2026-04-28 05:56:17.111876 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:56:17.111887 | orchestrator | 2026-04-28 05:56:17.111898 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 05:56:17.111908 | orchestrator | Tuesday 28 April 2026 05:55:54 +0000 (0:00:01.186) 0:40:27.742 ********* 2026-04-28 05:56:17.111919 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-28 05:56:17.111930 | orchestrator | 2026-04-28 05:56:17.111940 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-28 05:56:17.111951 | orchestrator | Tuesday 28 April 2026 05:55:55 +0000 (0:00:01.426) 0:40:29.168 ********* 2026-04-28 05:56:17.112011 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:56:17.112024 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:56:17.112035 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:56:17.112046 | orchestrator | ok: [testbed-node-4 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 05:56:17.112056 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-4) 2026-04-28 05:56:17.112067 | orchestrator | ok: [testbed-node-4 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 05:56:17.112077 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 05:56:17.112088 | orchestrator | 2026-04-28 05:56:17.112109 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-28 05:56:17.112119 | orchestrator | Tuesday 28 April 2026 05:55:57 +0000 (0:00:01.893) 0:40:31.061 ********* 2026-04-28 05:56:17.112130 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:56:17.112140 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:56:17.112151 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:56:17.112161 | orchestrator | ok: [testbed-node-4 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 05:56:17.112172 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-4) 2026-04-28 05:56:17.112188 | orchestrator | ok: [testbed-node-4 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 05:56:17.112199 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 05:56:17.112210 | orchestrator | 2026-04-28 05:56:17.112220 | orchestrator | TASK [Get osd numbers - non container] ***************************************** 2026-04-28 05:56:17.112231 | orchestrator | Tuesday 28 April 2026 05:55:59 +0000 (0:00:02.301) 0:40:33.363 ********* 2026-04-28 05:56:17.112241 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:56:17.112252 | orchestrator | 2026-04-28 05:56:17.112263 | orchestrator | TASK [Set num_osds] ************************************************************ 2026-04-28 05:56:17.112273 | orchestrator | Tuesday 28 April 2026 05:56:01 +0000 (0:00:01.104) 0:40:34.468 ********* 2026-04-28 05:56:17.112284 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:56:17.112294 | orchestrator | 2026-04-28 05:56:17.112304 | orchestrator | TASK [Set_fact container_exec_cmd_osd] ***************************************** 2026-04-28 05:56:17.112315 | orchestrator | Tuesday 28 April 2026 05:56:01 +0000 (0:00:00.817) 0:40:35.285 ********* 2026-04-28 05:56:17.112325 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:56:17.112336 | orchestrator | 2026-04-28 05:56:17.112346 | orchestrator | TASK [Stop ceph osd] *********************************************************** 2026-04-28 05:56:17.112357 | orchestrator | Tuesday 28 April 2026 05:56:02 +0000 (0:00:00.924) 0:40:36.210 ********* 2026-04-28 05:56:17.112368 | orchestrator | changed: [testbed-node-4] => (item=1) 2026-04-28 05:56:17.112378 | orchestrator | changed: [testbed-node-4] => (item=4) 2026-04-28 05:56:17.112389 | orchestrator | 2026-04-28 05:56:17.112400 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 05:56:17.112410 | orchestrator | Tuesday 28 April 2026 05:56:06 +0000 (0:00:03.678) 0:40:39.888 ********* 2026-04-28 05:56:17.112421 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-4 2026-04-28 05:56:17.112431 | orchestrator | 2026-04-28 05:56:17.112442 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 05:56:17.112452 | orchestrator | Tuesday 28 April 2026 05:56:07 +0000 (0:00:01.104) 0:40:40.993 ********* 2026-04-28 05:56:17.112463 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-4 2026-04-28 05:56:17.112473 | orchestrator | 2026-04-28 05:56:17.112484 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 05:56:17.112494 | orchestrator | Tuesday 28 April 2026 05:56:08 +0000 (0:00:01.291) 0:40:42.285 ********* 2026-04-28 05:56:17.112505 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:17.112515 | orchestrator | 2026-04-28 05:56:17.112526 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 05:56:17.112536 | orchestrator | Tuesday 28 April 2026 05:56:10 +0000 (0:00:01.107) 0:40:43.392 ********* 2026-04-28 05:56:17.112547 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:56:17.112557 | orchestrator | 2026-04-28 05:56:17.112568 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 05:56:17.112578 | orchestrator | Tuesday 28 April 2026 05:56:11 +0000 (0:00:01.553) 0:40:44.946 ********* 2026-04-28 05:56:17.112589 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:56:17.112599 | orchestrator | 2026-04-28 05:56:17.112617 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 05:56:17.112628 | orchestrator | Tuesday 28 April 2026 05:56:13 +0000 (0:00:01.557) 0:40:46.504 ********* 2026-04-28 05:56:17.112638 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:56:17.112649 | orchestrator | 2026-04-28 05:56:17.112659 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 05:56:17.112670 | orchestrator | Tuesday 28 April 2026 05:56:14 +0000 (0:00:01.540) 0:40:48.045 ********* 2026-04-28 05:56:17.112680 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:17.112691 | orchestrator | 2026-04-28 05:56:17.112701 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 05:56:17.112712 | orchestrator | Tuesday 28 April 2026 05:56:15 +0000 (0:00:01.155) 0:40:49.200 ********* 2026-04-28 05:56:17.112723 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:17.112733 | orchestrator | 2026-04-28 05:56:17.112743 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 05:56:17.112754 | orchestrator | Tuesday 28 April 2026 05:56:16 +0000 (0:00:01.125) 0:40:50.326 ********* 2026-04-28 05:56:17.112764 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:17.112775 | orchestrator | 2026-04-28 05:56:17.112792 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 05:56:57.087964 | orchestrator | Tuesday 28 April 2026 05:56:18 +0000 (0:00:01.150) 0:40:51.476 ********* 2026-04-28 05:56:57.088166 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:56:57.088184 | orchestrator | 2026-04-28 05:56:57.088198 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 05:56:57.088210 | orchestrator | Tuesday 28 April 2026 05:56:19 +0000 (0:00:01.578) 0:40:53.055 ********* 2026-04-28 05:56:57.088221 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:56:57.088233 | orchestrator | 2026-04-28 05:56:57.088244 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 05:56:57.088255 | orchestrator | Tuesday 28 April 2026 05:56:21 +0000 (0:00:01.474) 0:40:54.529 ********* 2026-04-28 05:56:57.088270 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.088290 | orchestrator | 2026-04-28 05:56:57.088308 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 05:56:57.088328 | orchestrator | Tuesday 28 April 2026 05:56:21 +0000 (0:00:00.766) 0:40:55.296 ********* 2026-04-28 05:56:57.088347 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.088367 | orchestrator | 2026-04-28 05:56:57.088385 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 05:56:57.088405 | orchestrator | Tuesday 28 April 2026 05:56:22 +0000 (0:00:00.765) 0:40:56.061 ********* 2026-04-28 05:56:57.088426 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:56:57.088444 | orchestrator | 2026-04-28 05:56:57.088464 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 05:56:57.088484 | orchestrator | Tuesday 28 April 2026 05:56:23 +0000 (0:00:00.915) 0:40:56.977 ********* 2026-04-28 05:56:57.088527 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:56:57.088549 | orchestrator | 2026-04-28 05:56:57.088569 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 05:56:57.088590 | orchestrator | Tuesday 28 April 2026 05:56:24 +0000 (0:00:00.778) 0:40:57.755 ********* 2026-04-28 05:56:57.088609 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:56:57.088622 | orchestrator | 2026-04-28 05:56:57.088635 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 05:56:57.088649 | orchestrator | Tuesday 28 April 2026 05:56:25 +0000 (0:00:00.808) 0:40:58.563 ********* 2026-04-28 05:56:57.088666 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.088684 | orchestrator | 2026-04-28 05:56:57.088703 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 05:56:57.088721 | orchestrator | Tuesday 28 April 2026 05:56:26 +0000 (0:00:00.854) 0:40:59.417 ********* 2026-04-28 05:56:57.088740 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.088757 | orchestrator | 2026-04-28 05:56:57.088776 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 05:56:57.088827 | orchestrator | Tuesday 28 April 2026 05:56:26 +0000 (0:00:00.780) 0:41:00.198 ********* 2026-04-28 05:56:57.088846 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.088862 | orchestrator | 2026-04-28 05:56:57.088878 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 05:56:57.088895 | orchestrator | Tuesday 28 April 2026 05:56:27 +0000 (0:00:00.767) 0:41:00.966 ********* 2026-04-28 05:56:57.088912 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:56:57.088929 | orchestrator | 2026-04-28 05:56:57.088947 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 05:56:57.088965 | orchestrator | Tuesday 28 April 2026 05:56:28 +0000 (0:00:00.818) 0:41:01.785 ********* 2026-04-28 05:56:57.089021 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:56:57.089043 | orchestrator | 2026-04-28 05:56:57.089061 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-28 05:56:57.089078 | orchestrator | Tuesday 28 April 2026 05:56:29 +0000 (0:00:00.839) 0:41:02.624 ********* 2026-04-28 05:56:57.089095 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.089113 | orchestrator | 2026-04-28 05:56:57.089130 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-28 05:56:57.089148 | orchestrator | Tuesday 28 April 2026 05:56:30 +0000 (0:00:00.760) 0:41:03.385 ********* 2026-04-28 05:56:57.089166 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.089183 | orchestrator | 2026-04-28 05:56:57.089200 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-28 05:56:57.089216 | orchestrator | Tuesday 28 April 2026 05:56:30 +0000 (0:00:00.778) 0:41:04.164 ********* 2026-04-28 05:56:57.089234 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.089251 | orchestrator | 2026-04-28 05:56:57.089269 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-28 05:56:57.089287 | orchestrator | Tuesday 28 April 2026 05:56:31 +0000 (0:00:00.790) 0:41:04.954 ********* 2026-04-28 05:56:57.089305 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.089324 | orchestrator | 2026-04-28 05:56:57.089343 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-28 05:56:57.089360 | orchestrator | Tuesday 28 April 2026 05:56:32 +0000 (0:00:00.777) 0:41:05.731 ********* 2026-04-28 05:56:57.089379 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.089398 | orchestrator | 2026-04-28 05:56:57.089417 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-28 05:56:57.089437 | orchestrator | Tuesday 28 April 2026 05:56:33 +0000 (0:00:00.881) 0:41:06.613 ********* 2026-04-28 05:56:57.089456 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.089473 | orchestrator | 2026-04-28 05:56:57.089490 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-28 05:56:57.089509 | orchestrator | Tuesday 28 April 2026 05:56:34 +0000 (0:00:00.772) 0:41:07.385 ********* 2026-04-28 05:56:57.089527 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.089546 | orchestrator | 2026-04-28 05:56:57.089566 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-28 05:56:57.089588 | orchestrator | Tuesday 28 April 2026 05:56:34 +0000 (0:00:00.783) 0:41:08.168 ********* 2026-04-28 05:56:57.089607 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.089625 | orchestrator | 2026-04-28 05:56:57.089645 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-28 05:56:57.089664 | orchestrator | Tuesday 28 April 2026 05:56:35 +0000 (0:00:00.825) 0:41:08.994 ********* 2026-04-28 05:56:57.089717 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.089737 | orchestrator | 2026-04-28 05:56:57.089756 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-28 05:56:57.089768 | orchestrator | Tuesday 28 April 2026 05:56:36 +0000 (0:00:00.765) 0:41:09.760 ********* 2026-04-28 05:56:57.089778 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.089789 | orchestrator | 2026-04-28 05:56:57.089817 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-28 05:56:57.089828 | orchestrator | Tuesday 28 April 2026 05:56:37 +0000 (0:00:00.765) 0:41:10.526 ********* 2026-04-28 05:56:57.089839 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.089850 | orchestrator | 2026-04-28 05:56:57.089861 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-28 05:56:57.089879 | orchestrator | Tuesday 28 April 2026 05:56:37 +0000 (0:00:00.820) 0:41:11.346 ********* 2026-04-28 05:56:57.089898 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.089915 | orchestrator | 2026-04-28 05:56:57.089933 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-28 05:56:57.089951 | orchestrator | Tuesday 28 April 2026 05:56:38 +0000 (0:00:00.758) 0:41:12.104 ********* 2026-04-28 05:56:57.089968 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:56:57.090012 | orchestrator | 2026-04-28 05:56:57.090122 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-28 05:56:57.090142 | orchestrator | Tuesday 28 April 2026 05:56:40 +0000 (0:00:01.570) 0:41:13.675 ********* 2026-04-28 05:56:57.090161 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:56:57.090180 | orchestrator | 2026-04-28 05:56:57.090199 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-28 05:56:57.090231 | orchestrator | Tuesday 28 April 2026 05:56:42 +0000 (0:00:01.835) 0:41:15.511 ********* 2026-04-28 05:56:57.090252 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-4 2026-04-28 05:56:57.090275 | orchestrator | 2026-04-28 05:56:57.090292 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-28 05:56:57.090303 | orchestrator | Tuesday 28 April 2026 05:56:43 +0000 (0:00:01.125) 0:41:16.636 ********* 2026-04-28 05:56:57.090314 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.090324 | orchestrator | 2026-04-28 05:56:57.090335 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-28 05:56:57.090346 | orchestrator | Tuesday 28 April 2026 05:56:44 +0000 (0:00:01.258) 0:41:17.895 ********* 2026-04-28 05:56:57.090357 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.090367 | orchestrator | 2026-04-28 05:56:57.090378 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-28 05:56:57.090389 | orchestrator | Tuesday 28 April 2026 05:56:45 +0000 (0:00:01.144) 0:41:19.039 ********* 2026-04-28 05:56:57.090400 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-28 05:56:57.090411 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-28 05:56:57.090422 | orchestrator | 2026-04-28 05:56:57.090432 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-28 05:56:57.090443 | orchestrator | Tuesday 28 April 2026 05:56:47 +0000 (0:00:01.896) 0:41:20.935 ********* 2026-04-28 05:56:57.090454 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:56:57.090465 | orchestrator | 2026-04-28 05:56:57.090476 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-28 05:56:57.090486 | orchestrator | Tuesday 28 April 2026 05:56:49 +0000 (0:00:01.475) 0:41:22.410 ********* 2026-04-28 05:56:57.090497 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.090508 | orchestrator | 2026-04-28 05:56:57.090519 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-28 05:56:57.090530 | orchestrator | Tuesday 28 April 2026 05:56:50 +0000 (0:00:01.149) 0:41:23.560 ********* 2026-04-28 05:56:57.090540 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.090551 | orchestrator | 2026-04-28 05:56:57.090562 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-28 05:56:57.090573 | orchestrator | Tuesday 28 April 2026 05:56:50 +0000 (0:00:00.821) 0:41:24.382 ********* 2026-04-28 05:56:57.090584 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.090594 | orchestrator | 2026-04-28 05:56:57.090605 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-28 05:56:57.090628 | orchestrator | Tuesday 28 April 2026 05:56:51 +0000 (0:00:00.777) 0:41:25.159 ********* 2026-04-28 05:56:57.090639 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-4 2026-04-28 05:56:57.090650 | orchestrator | 2026-04-28 05:56:57.090661 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-28 05:56:57.090680 | orchestrator | Tuesday 28 April 2026 05:56:52 +0000 (0:00:01.100) 0:41:26.260 ********* 2026-04-28 05:56:57.090698 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:56:57.090717 | orchestrator | 2026-04-28 05:56:57.090734 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-28 05:56:57.090752 | orchestrator | Tuesday 28 April 2026 05:56:54 +0000 (0:00:01.713) 0:41:27.974 ********* 2026-04-28 05:56:57.090770 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-28 05:56:57.090788 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-28 05:56:57.090806 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-28 05:56:57.090824 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.090841 | orchestrator | 2026-04-28 05:56:57.090860 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-28 05:56:57.090878 | orchestrator | Tuesday 28 April 2026 05:56:55 +0000 (0:00:01.226) 0:41:29.200 ********* 2026-04-28 05:56:57.090895 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:56:57.090914 | orchestrator | 2026-04-28 05:56:57.090931 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-28 05:56:57.090950 | orchestrator | Tuesday 28 April 2026 05:56:56 +0000 (0:00:01.162) 0:41:30.362 ********* 2026-04-28 05:56:57.091062 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.334270 | orchestrator | 2026-04-28 05:57:40.334393 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-28 05:57:40.334411 | orchestrator | Tuesday 28 April 2026 05:56:58 +0000 (0:00:01.185) 0:41:31.548 ********* 2026-04-28 05:57:40.334423 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.334435 | orchestrator | 2026-04-28 05:57:40.334447 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-28 05:57:40.334458 | orchestrator | Tuesday 28 April 2026 05:56:59 +0000 (0:00:01.160) 0:41:32.708 ********* 2026-04-28 05:57:40.334469 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.334479 | orchestrator | 2026-04-28 05:57:40.334490 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-28 05:57:40.334501 | orchestrator | Tuesday 28 April 2026 05:57:00 +0000 (0:00:01.275) 0:41:33.984 ********* 2026-04-28 05:57:40.334512 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.334522 | orchestrator | 2026-04-28 05:57:40.334533 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-28 05:57:40.334544 | orchestrator | Tuesday 28 April 2026 05:57:01 +0000 (0:00:00.783) 0:41:34.767 ********* 2026-04-28 05:57:40.334555 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:57:40.334567 | orchestrator | 2026-04-28 05:57:40.334577 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-28 05:57:40.334589 | orchestrator | Tuesday 28 April 2026 05:57:03 +0000 (0:00:02.025) 0:41:36.793 ********* 2026-04-28 05:57:40.334599 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:57:40.334610 | orchestrator | 2026-04-28 05:57:40.334636 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-28 05:57:40.334647 | orchestrator | Tuesday 28 April 2026 05:57:04 +0000 (0:00:00.779) 0:41:37.572 ********* 2026-04-28 05:57:40.334658 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-4 2026-04-28 05:57:40.334669 | orchestrator | 2026-04-28 05:57:40.334680 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-28 05:57:40.334690 | orchestrator | Tuesday 28 April 2026 05:57:05 +0000 (0:00:01.177) 0:41:38.749 ********* 2026-04-28 05:57:40.334726 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.334738 | orchestrator | 2026-04-28 05:57:40.334749 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-28 05:57:40.334760 | orchestrator | Tuesday 28 April 2026 05:57:06 +0000 (0:00:01.142) 0:41:39.892 ********* 2026-04-28 05:57:40.334770 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.334781 | orchestrator | 2026-04-28 05:57:40.334793 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-28 05:57:40.334805 | orchestrator | Tuesday 28 April 2026 05:57:07 +0000 (0:00:01.146) 0:41:41.039 ********* 2026-04-28 05:57:40.334818 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.334831 | orchestrator | 2026-04-28 05:57:40.334843 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-28 05:57:40.334855 | orchestrator | Tuesday 28 April 2026 05:57:08 +0000 (0:00:01.188) 0:41:42.228 ********* 2026-04-28 05:57:40.334867 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.334880 | orchestrator | 2026-04-28 05:57:40.334891 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-28 05:57:40.334904 | orchestrator | Tuesday 28 April 2026 05:57:10 +0000 (0:00:01.174) 0:41:43.403 ********* 2026-04-28 05:57:40.334916 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.334928 | orchestrator | 2026-04-28 05:57:40.334940 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-28 05:57:40.334952 | orchestrator | Tuesday 28 April 2026 05:57:11 +0000 (0:00:01.145) 0:41:44.549 ********* 2026-04-28 05:57:40.334964 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.334977 | orchestrator | 2026-04-28 05:57:40.334988 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-28 05:57:40.335001 | orchestrator | Tuesday 28 April 2026 05:57:12 +0000 (0:00:01.144) 0:41:45.693 ********* 2026-04-28 05:57:40.335036 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.335049 | orchestrator | 2026-04-28 05:57:40.335060 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-28 05:57:40.335073 | orchestrator | Tuesday 28 April 2026 05:57:13 +0000 (0:00:01.172) 0:41:46.866 ********* 2026-04-28 05:57:40.335085 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.335097 | orchestrator | 2026-04-28 05:57:40.335109 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-28 05:57:40.335121 | orchestrator | Tuesday 28 April 2026 05:57:14 +0000 (0:00:01.277) 0:41:48.143 ********* 2026-04-28 05:57:40.335134 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:57:40.335146 | orchestrator | 2026-04-28 05:57:40.335156 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-28 05:57:40.335167 | orchestrator | Tuesday 28 April 2026 05:57:15 +0000 (0:00:00.844) 0:41:48.988 ********* 2026-04-28 05:57:40.335178 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-4 2026-04-28 05:57:40.335189 | orchestrator | 2026-04-28 05:57:40.335200 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-28 05:57:40.335211 | orchestrator | Tuesday 28 April 2026 05:57:16 +0000 (0:00:01.173) 0:41:50.161 ********* 2026-04-28 05:57:40.335221 | orchestrator | ok: [testbed-node-4] => (item=/etc/ceph) 2026-04-28 05:57:40.335232 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/) 2026-04-28 05:57:40.335243 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/mon) 2026-04-28 05:57:40.335254 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/osd) 2026-04-28 05:57:40.335264 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/mds) 2026-04-28 05:57:40.335275 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/tmp) 2026-04-28 05:57:40.335286 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/crash) 2026-04-28 05:57:40.335296 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/radosgw) 2026-04-28 05:57:40.335307 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-28 05:57:40.335337 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-28 05:57:40.335357 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-28 05:57:40.335368 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-28 05:57:40.335379 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-28 05:57:40.335389 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-28 05:57:40.335400 | orchestrator | ok: [testbed-node-4] => (item=/var/run/ceph) 2026-04-28 05:57:40.335411 | orchestrator | ok: [testbed-node-4] => (item=/var/log/ceph) 2026-04-28 05:57:40.335422 | orchestrator | 2026-04-28 05:57:40.335433 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-28 05:57:40.335443 | orchestrator | Tuesday 28 April 2026 05:57:22 +0000 (0:00:06.067) 0:41:56.229 ********* 2026-04-28 05:57:40.335454 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-4 2026-04-28 05:57:40.335465 | orchestrator | 2026-04-28 05:57:40.335475 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-28 05:57:40.335486 | orchestrator | Tuesday 28 April 2026 05:57:23 +0000 (0:00:01.118) 0:41:57.347 ********* 2026-04-28 05:57:40.335497 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-28 05:57:40.335508 | orchestrator | 2026-04-28 05:57:40.335519 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-28 05:57:40.335535 | orchestrator | Tuesday 28 April 2026 05:57:25 +0000 (0:00:01.603) 0:41:58.951 ********* 2026-04-28 05:57:40.335546 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-28 05:57:40.335557 | orchestrator | 2026-04-28 05:57:40.335568 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-28 05:57:40.335578 | orchestrator | Tuesday 28 April 2026 05:57:27 +0000 (0:00:01.654) 0:42:00.605 ********* 2026-04-28 05:57:40.335589 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.335599 | orchestrator | 2026-04-28 05:57:40.335610 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-28 05:57:40.335620 | orchestrator | Tuesday 28 April 2026 05:57:28 +0000 (0:00:00.779) 0:42:01.385 ********* 2026-04-28 05:57:40.335631 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.335641 | orchestrator | 2026-04-28 05:57:40.335652 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-28 05:57:40.335662 | orchestrator | Tuesday 28 April 2026 05:57:28 +0000 (0:00:00.815) 0:42:02.200 ********* 2026-04-28 05:57:40.335673 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.335683 | orchestrator | 2026-04-28 05:57:40.335694 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-28 05:57:40.335704 | orchestrator | Tuesday 28 April 2026 05:57:29 +0000 (0:00:00.773) 0:42:02.973 ********* 2026-04-28 05:57:40.335715 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.335725 | orchestrator | 2026-04-28 05:57:40.335736 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-28 05:57:40.335747 | orchestrator | Tuesday 28 April 2026 05:57:30 +0000 (0:00:00.864) 0:42:03.839 ********* 2026-04-28 05:57:40.335757 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.335767 | orchestrator | 2026-04-28 05:57:40.335778 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-28 05:57:40.335789 | orchestrator | Tuesday 28 April 2026 05:57:31 +0000 (0:00:00.785) 0:42:04.624 ********* 2026-04-28 05:57:40.335799 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.335810 | orchestrator | 2026-04-28 05:57:40.335820 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-28 05:57:40.335831 | orchestrator | Tuesday 28 April 2026 05:57:31 +0000 (0:00:00.756) 0:42:05.380 ********* 2026-04-28 05:57:40.335841 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.335859 | orchestrator | 2026-04-28 05:57:40.335870 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-28 05:57:40.335881 | orchestrator | Tuesday 28 April 2026 05:57:32 +0000 (0:00:00.789) 0:42:06.170 ********* 2026-04-28 05:57:40.335891 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.335902 | orchestrator | 2026-04-28 05:57:40.335913 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-28 05:57:40.335923 | orchestrator | Tuesday 28 April 2026 05:57:33 +0000 (0:00:00.784) 0:42:06.954 ********* 2026-04-28 05:57:40.335934 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.335945 | orchestrator | 2026-04-28 05:57:40.335955 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-28 05:57:40.335965 | orchestrator | Tuesday 28 April 2026 05:57:34 +0000 (0:00:00.792) 0:42:07.747 ********* 2026-04-28 05:57:40.335976 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:57:40.335987 | orchestrator | 2026-04-28 05:57:40.335997 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-28 05:57:40.336023 | orchestrator | Tuesday 28 April 2026 05:57:35 +0000 (0:00:00.786) 0:42:08.533 ********* 2026-04-28 05:57:40.336035 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:57:40.336045 | orchestrator | 2026-04-28 05:57:40.336056 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-28 05:57:40.336066 | orchestrator | Tuesday 28 April 2026 05:57:36 +0000 (0:00:00.895) 0:42:09.429 ********* 2026-04-28 05:57:40.336077 | orchestrator | changed: [testbed-node-4 -> testbed-node-2(192.168.16.12)] 2026-04-28 05:57:40.336087 | orchestrator | 2026-04-28 05:57:40.336098 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-28 05:57:40.336108 | orchestrator | Tuesday 28 April 2026 05:57:40 +0000 (0:00:04.181) 0:42:13.610 ********* 2026-04-28 05:57:40.336127 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-28 05:58:22.559340 | orchestrator | 2026-04-28 05:58:22.559457 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-28 05:58:22.559474 | orchestrator | Tuesday 28 April 2026 05:57:41 +0000 (0:00:00.857) 0:42:14.468 ********* 2026-04-28 05:58:22.559488 | orchestrator | changed: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log'}]) 2026-04-28 05:58:22.559504 | orchestrator | changed: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.14:8081'}]) 2026-04-28 05:58:22.559516 | orchestrator | 2026-04-28 05:58:22.559527 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-28 05:58:22.559538 | orchestrator | Tuesday 28 April 2026 05:57:48 +0000 (0:00:07.468) 0:42:21.936 ********* 2026-04-28 05:58:22.559549 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:58:22.559561 | orchestrator | 2026-04-28 05:58:22.559588 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-28 05:58:22.559600 | orchestrator | Tuesday 28 April 2026 05:57:49 +0000 (0:00:00.783) 0:42:22.720 ********* 2026-04-28 05:58:22.559610 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:58:22.559621 | orchestrator | 2026-04-28 05:58:22.559632 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 05:58:22.559644 | orchestrator | Tuesday 28 April 2026 05:57:50 +0000 (0:00:00.750) 0:42:23.471 ********* 2026-04-28 05:58:22.559655 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:58:22.559666 | orchestrator | 2026-04-28 05:58:22.559701 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 05:58:22.559713 | orchestrator | Tuesday 28 April 2026 05:57:50 +0000 (0:00:00.909) 0:42:24.381 ********* 2026-04-28 05:58:22.559724 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:58:22.559734 | orchestrator | 2026-04-28 05:58:22.559745 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 05:58:22.559756 | orchestrator | Tuesday 28 April 2026 05:57:51 +0000 (0:00:00.812) 0:42:25.194 ********* 2026-04-28 05:58:22.559766 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:58:22.559777 | orchestrator | 2026-04-28 05:58:22.559788 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 05:58:22.559798 | orchestrator | Tuesday 28 April 2026 05:57:52 +0000 (0:00:00.801) 0:42:25.995 ********* 2026-04-28 05:58:22.559809 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:58:22.559821 | orchestrator | 2026-04-28 05:58:22.559831 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 05:58:22.559842 | orchestrator | Tuesday 28 April 2026 05:57:53 +0000 (0:00:00.866) 0:42:26.862 ********* 2026-04-28 05:58:22.559853 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-28 05:58:22.559864 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-28 05:58:22.559877 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-28 05:58:22.559889 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:58:22.559901 | orchestrator | 2026-04-28 05:58:22.559915 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 05:58:22.559928 | orchestrator | Tuesday 28 April 2026 05:57:54 +0000 (0:00:01.097) 0:42:27.959 ********* 2026-04-28 05:58:22.559940 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-28 05:58:22.559953 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-28 05:58:22.559965 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-28 05:58:22.559977 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:58:22.559989 | orchestrator | 2026-04-28 05:58:22.560002 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 05:58:22.560014 | orchestrator | Tuesday 28 April 2026 05:57:55 +0000 (0:00:01.197) 0:42:29.157 ********* 2026-04-28 05:58:22.560075 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-28 05:58:22.560090 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-28 05:58:22.560102 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-28 05:58:22.560115 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:58:22.560125 | orchestrator | 2026-04-28 05:58:22.560136 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 05:58:22.560147 | orchestrator | Tuesday 28 April 2026 05:57:56 +0000 (0:00:01.108) 0:42:30.266 ********* 2026-04-28 05:58:22.560157 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:58:22.560168 | orchestrator | 2026-04-28 05:58:22.560179 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 05:58:22.560189 | orchestrator | Tuesday 28 April 2026 05:57:57 +0000 (0:00:00.835) 0:42:31.101 ********* 2026-04-28 05:58:22.560200 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-28 05:58:22.560211 | orchestrator | 2026-04-28 05:58:22.560221 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-28 05:58:22.560232 | orchestrator | Tuesday 28 April 2026 05:57:58 +0000 (0:00:01.024) 0:42:32.126 ********* 2026-04-28 05:58:22.560242 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:58:22.560253 | orchestrator | 2026-04-28 05:58:22.560263 | orchestrator | TASK [ceph-osd : Set_fact add_osd] ********************************************* 2026-04-28 05:58:22.560274 | orchestrator | Tuesday 28 April 2026 05:58:00 +0000 (0:00:01.396) 0:42:33.522 ********* 2026-04-28 05:58:22.560285 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:58:22.560295 | orchestrator | 2026-04-28 05:58:22.560323 | orchestrator | TASK [ceph-osd : Set_fact container_exec_cmd] ********************************** 2026-04-28 05:58:22.560345 | orchestrator | Tuesday 28 April 2026 05:58:00 +0000 (0:00:00.766) 0:42:34.289 ********* 2026-04-28 05:58:22.560356 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:58:22.560367 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:58:22.560378 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:58:22.560389 | orchestrator | 2026-04-28 05:58:22.560399 | orchestrator | TASK [ceph-osd : Include_tasks system_tuning.yml] ****************************** 2026-04-28 05:58:22.560410 | orchestrator | Tuesday 28 April 2026 05:58:02 +0000 (0:00:01.827) 0:42:36.116 ********* 2026-04-28 05:58:22.560421 | orchestrator | included: /ansible/roles/ceph-osd/tasks/system_tuning.yml for testbed-node-4 2026-04-28 05:58:22.560432 | orchestrator | 2026-04-28 05:58:22.560442 | orchestrator | TASK [ceph-osd : Create tmpfiles.d directory] ********************************** 2026-04-28 05:58:22.560453 | orchestrator | Tuesday 28 April 2026 05:58:04 +0000 (0:00:01.426) 0:42:37.542 ********* 2026-04-28 05:58:22.560463 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:58:22.560474 | orchestrator | 2026-04-28 05:58:22.560485 | orchestrator | TASK [ceph-osd : Disable transparent hugepage] ********************************* 2026-04-28 05:58:22.560495 | orchestrator | Tuesday 28 April 2026 05:58:05 +0000 (0:00:01.186) 0:42:38.729 ********* 2026-04-28 05:58:22.560512 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:58:22.560523 | orchestrator | 2026-04-28 05:58:22.560534 | orchestrator | TASK [ceph-osd : Get default vm.min_free_kbytes] ******************************* 2026-04-28 05:58:22.560545 | orchestrator | Tuesday 28 April 2026 05:58:06 +0000 (0:00:01.132) 0:42:39.862 ********* 2026-04-28 05:58:22.560555 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:58:22.560566 | orchestrator | 2026-04-28 05:58:22.560576 | orchestrator | TASK [ceph-osd : Set_fact vm_min_free_kbytes] ********************************** 2026-04-28 05:58:22.560587 | orchestrator | Tuesday 28 April 2026 05:58:08 +0000 (0:00:01.528) 0:42:41.390 ********* 2026-04-28 05:58:22.560598 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:58:22.560608 | orchestrator | 2026-04-28 05:58:22.560619 | orchestrator | TASK [ceph-osd : Apply operating system tuning] ******************************** 2026-04-28 05:58:22.560629 | orchestrator | Tuesday 28 April 2026 05:58:09 +0000 (0:00:01.154) 0:42:42.545 ********* 2026-04-28 05:58:22.560640 | orchestrator | ok: [testbed-node-4] => (item={'name': 'fs.aio-max-nr', 'value': '1048576', 'enable': True}) 2026-04-28 05:58:22.560651 | orchestrator | ok: [testbed-node-4] => (item={'name': 'fs.file-max', 'value': 26234859}) 2026-04-28 05:58:22.560662 | orchestrator | ok: [testbed-node-4] => (item={'name': 'vm.zone_reclaim_mode', 'value': 0}) 2026-04-28 05:58:22.560672 | orchestrator | ok: [testbed-node-4] => (item={'name': 'vm.swappiness', 'value': 10}) 2026-04-28 05:58:22.560683 | orchestrator | ok: [testbed-node-4] => (item={'name': 'vm.min_free_kbytes', 'value': '67584'}) 2026-04-28 05:58:22.560693 | orchestrator | 2026-04-28 05:58:22.560704 | orchestrator | TASK [ceph-osd : Install dependencies] ***************************************** 2026-04-28 05:58:22.560714 | orchestrator | Tuesday 28 April 2026 05:58:11 +0000 (0:00:02.559) 0:42:45.105 ********* 2026-04-28 05:58:22.560725 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:58:22.560736 | orchestrator | 2026-04-28 05:58:22.560746 | orchestrator | TASK [ceph-osd : Include_tasks common.yml] ************************************* 2026-04-28 05:58:22.560757 | orchestrator | Tuesday 28 April 2026 05:58:12 +0000 (0:00:00.770) 0:42:45.876 ********* 2026-04-28 05:58:22.560768 | orchestrator | included: /ansible/roles/ceph-osd/tasks/common.yml for testbed-node-4 2026-04-28 05:58:22.560778 | orchestrator | 2026-04-28 05:58:22.560789 | orchestrator | TASK [ceph-osd : Create bootstrap-osd and osd directories] ********************* 2026-04-28 05:58:22.560799 | orchestrator | Tuesday 28 April 2026 05:58:13 +0000 (0:00:01.128) 0:42:47.004 ********* 2026-04-28 05:58:22.560810 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-osd/) 2026-04-28 05:58:22.560821 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/osd/) 2026-04-28 05:58:22.560831 | orchestrator | 2026-04-28 05:58:22.560849 | orchestrator | TASK [ceph-osd : Get keys from monitors] *************************************** 2026-04-28 05:58:22.560859 | orchestrator | Tuesday 28 April 2026 05:58:15 +0000 (0:00:01.790) 0:42:48.795 ********* 2026-04-28 05:58:22.560870 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 05:58:22.560881 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-28 05:58:22.560892 | orchestrator | ok: [testbed-node-4 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-28 05:58:22.560902 | orchestrator | 2026-04-28 05:58:22.560913 | orchestrator | TASK [ceph-osd : Copy ceph key(s) if needed] *********************************** 2026-04-28 05:58:22.560923 | orchestrator | Tuesday 28 April 2026 05:58:18 +0000 (0:00:03.167) 0:42:51.963 ********* 2026-04-28 05:58:22.560934 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-28 05:58:22.560945 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-28 05:58:22.560955 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:58:22.560966 | orchestrator | 2026-04-28 05:58:22.560977 | orchestrator | TASK [ceph-osd : Set noup flag] ************************************************ 2026-04-28 05:58:22.560987 | orchestrator | Tuesday 28 April 2026 05:58:20 +0000 (0:00:01.570) 0:42:53.533 ********* 2026-04-28 05:58:22.560998 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:58:22.561009 | orchestrator | 2026-04-28 05:58:22.561019 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm.yml] ****************************** 2026-04-28 05:58:22.561060 | orchestrator | Tuesday 28 April 2026 05:58:21 +0000 (0:00:01.366) 0:42:54.900 ********* 2026-04-28 05:58:22.561080 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:58:22.561099 | orchestrator | 2026-04-28 05:58:22.561117 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm-batch.yml] ************************ 2026-04-28 05:58:22.561129 | orchestrator | Tuesday 28 April 2026 05:58:22 +0000 (0:00:00.882) 0:42:55.783 ********* 2026-04-28 05:58:22.561140 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:58:22.561151 | orchestrator | 2026-04-28 05:58:22.561168 | orchestrator | TASK [ceph-osd : Include_tasks start_osds.yml] ********************************* 2026-04-28 05:59:27.685926 | orchestrator | Tuesday 28 April 2026 05:58:23 +0000 (0:00:00.746) 0:42:56.529 ********* 2026-04-28 05:59:27.686135 | orchestrator | included: /ansible/roles/ceph-osd/tasks/start_osds.yml for testbed-node-4 2026-04-28 05:59:27.686154 | orchestrator | 2026-04-28 05:59:27.686166 | orchestrator | TASK [ceph-osd : Get osd ids] ************************************************** 2026-04-28 05:59:27.686177 | orchestrator | Tuesday 28 April 2026 05:58:24 +0000 (0:00:01.130) 0:42:57.659 ********* 2026-04-28 05:59:27.686188 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:59:27.686233 | orchestrator | 2026-04-28 05:59:27.686245 | orchestrator | TASK [ceph-osd : Collect osd ids] ********************************************** 2026-04-28 05:59:27.686256 | orchestrator | Tuesday 28 April 2026 05:58:25 +0000 (0:00:01.471) 0:42:59.131 ********* 2026-04-28 05:59:27.686267 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:59:27.686278 | orchestrator | 2026-04-28 05:59:27.686289 | orchestrator | TASK [ceph-osd : Include_tasks systemd.yml] ************************************ 2026-04-28 05:59:27.686299 | orchestrator | Tuesday 28 April 2026 05:58:29 +0000 (0:00:03.307) 0:43:02.439 ********* 2026-04-28 05:59:27.686310 | orchestrator | included: /ansible/roles/ceph-osd/tasks/systemd.yml for testbed-node-4 2026-04-28 05:59:27.686321 | orchestrator | 2026-04-28 05:59:27.686332 | orchestrator | TASK [ceph-osd : Generate systemd unit file] *********************************** 2026-04-28 05:59:27.686343 | orchestrator | Tuesday 28 April 2026 05:58:30 +0000 (0:00:01.145) 0:43:03.585 ********* 2026-04-28 05:59:27.686371 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:59:27.686383 | orchestrator | 2026-04-28 05:59:27.686393 | orchestrator | TASK [ceph-osd : Generate systemd ceph-osd target file] ************************ 2026-04-28 05:59:27.686404 | orchestrator | Tuesday 28 April 2026 05:58:32 +0000 (0:00:01.980) 0:43:05.565 ********* 2026-04-28 05:59:27.686414 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:59:27.686425 | orchestrator | 2026-04-28 05:59:27.686435 | orchestrator | TASK [ceph-osd : Enable ceph-osd.target] *************************************** 2026-04-28 05:59:27.686446 | orchestrator | Tuesday 28 April 2026 05:58:34 +0000 (0:00:01.989) 0:43:07.554 ********* 2026-04-28 05:59:27.686481 | orchestrator | ok: [testbed-node-4] 2026-04-28 05:59:27.686494 | orchestrator | 2026-04-28 05:59:27.686506 | orchestrator | TASK [ceph-osd : Ensure systemd service override directory exists] ************* 2026-04-28 05:59:27.686518 | orchestrator | Tuesday 28 April 2026 05:58:36 +0000 (0:00:02.212) 0:43:09.766 ********* 2026-04-28 05:59:27.686530 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:59:27.686544 | orchestrator | 2026-04-28 05:59:27.686556 | orchestrator | TASK [ceph-osd : Add ceph-osd systemd service overrides] *********************** 2026-04-28 05:59:27.686568 | orchestrator | Tuesday 28 April 2026 05:58:37 +0000 (0:00:01.154) 0:43:10.921 ********* 2026-04-28 05:59:27.686580 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:59:27.686592 | orchestrator | 2026-04-28 05:59:27.686604 | orchestrator | TASK [ceph-osd : Ensure /var/lib/ceph/osd/- is present] ********* 2026-04-28 05:59:27.686616 | orchestrator | Tuesday 28 April 2026 05:58:38 +0000 (0:00:01.171) 0:43:12.092 ********* 2026-04-28 05:59:27.686629 | orchestrator | ok: [testbed-node-4] => (item=4) 2026-04-28 05:59:27.686640 | orchestrator | ok: [testbed-node-4] => (item=1) 2026-04-28 05:59:27.686650 | orchestrator | 2026-04-28 05:59:27.686661 | orchestrator | TASK [ceph-osd : Write run file in /var/lib/ceph/osd/xxxx/run] ***************** 2026-04-28 05:59:27.686671 | orchestrator | Tuesday 28 April 2026 05:58:40 +0000 (0:00:01.829) 0:43:13.922 ********* 2026-04-28 05:59:27.686682 | orchestrator | ok: [testbed-node-4] => (item=4) 2026-04-28 05:59:27.686692 | orchestrator | ok: [testbed-node-4] => (item=1) 2026-04-28 05:59:27.686703 | orchestrator | 2026-04-28 05:59:27.686713 | orchestrator | TASK [ceph-osd : Systemd start osd] ******************************************** 2026-04-28 05:59:27.686724 | orchestrator | Tuesday 28 April 2026 05:58:43 +0000 (0:00:02.842) 0:43:16.764 ********* 2026-04-28 05:59:27.686734 | orchestrator | changed: [testbed-node-4] => (item=4) 2026-04-28 05:59:27.686746 | orchestrator | changed: [testbed-node-4] => (item=1) 2026-04-28 05:59:27.686756 | orchestrator | 2026-04-28 05:59:27.686767 | orchestrator | TASK [ceph-osd : Unset noup flag] ********************************************** 2026-04-28 05:59:27.686778 | orchestrator | Tuesday 28 April 2026 05:58:48 +0000 (0:00:05.337) 0:43:22.101 ********* 2026-04-28 05:59:27.686788 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:59:27.686799 | orchestrator | 2026-04-28 05:59:27.686809 | orchestrator | TASK [ceph-osd : Wait for all osd to be up] ************************************ 2026-04-28 05:59:27.686820 | orchestrator | Tuesday 28 April 2026 05:58:49 +0000 (0:00:00.876) 0:43:22.978 ********* 2026-04-28 05:59:27.686830 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:59:27.686841 | orchestrator | 2026-04-28 05:59:27.686851 | orchestrator | TASK [ceph-osd : Include crush_rules.yml] ************************************** 2026-04-28 05:59:27.686862 | orchestrator | Tuesday 28 April 2026 05:58:50 +0000 (0:00:00.889) 0:43:23.867 ********* 2026-04-28 05:59:27.686872 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:59:27.686883 | orchestrator | 2026-04-28 05:59:27.686893 | orchestrator | TASK [Scan ceph-disk osds with ceph-volume if deploying nautilus] ************** 2026-04-28 05:59:27.686904 | orchestrator | Tuesday 28 April 2026 05:58:51 +0000 (0:00:00.905) 0:43:24.772 ********* 2026-04-28 05:59:27.686914 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:59:27.686925 | orchestrator | 2026-04-28 05:59:27.686935 | orchestrator | TASK [Activate scanned ceph-disk osds and migrate to ceph-volume if deploying nautilus] *** 2026-04-28 05:59:27.686946 | orchestrator | Tuesday 28 April 2026 05:58:52 +0000 (0:00:00.778) 0:43:25.551 ********* 2026-04-28 05:59:27.686956 | orchestrator | skipping: [testbed-node-4] 2026-04-28 05:59:27.686967 | orchestrator | 2026-04-28 05:59:27.686977 | orchestrator | TASK [Waiting for clean pgs...] ************************************************ 2026-04-28 05:59:27.686988 | orchestrator | Tuesday 28 April 2026 05:58:52 +0000 (0:00:00.799) 0:43:26.351 ********* 2026-04-28 05:59:27.686998 | orchestrator | FAILED - RETRYING: [testbed-node-4 -> testbed-node-0]: Waiting for clean pgs... (600 retries left). 2026-04-28 05:59:27.687010 | orchestrator | FAILED - RETRYING: [testbed-node-4 -> testbed-node-0]: Waiting for clean pgs... (599 retries left). 2026-04-28 05:59:27.687021 | orchestrator | FAILED - RETRYING: [testbed-node-4 -> testbed-node-0]: Waiting for clean pgs... (598 retries left). 2026-04-28 05:59:27.687080 | orchestrator | FAILED - RETRYING: [testbed-node-4 -> testbed-node-0]: Waiting for clean pgs... (597 retries left). 2026-04-28 05:59:27.687103 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-28 05:59:27.687121 | orchestrator | 2026-04-28 05:59:27.687140 | orchestrator | PLAY [Upgrade ceph osds cluster] *********************************************** 2026-04-28 05:59:27.687156 | orchestrator | 2026-04-28 05:59:27.687176 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 05:59:27.687187 | orchestrator | Tuesday 28 April 2026 05:59:06 +0000 (0:00:13.852) 0:43:40.203 ********* 2026-04-28 05:59:27.687198 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-5 2026-04-28 05:59:27.687208 | orchestrator | 2026-04-28 05:59:27.687219 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-28 05:59:27.687229 | orchestrator | Tuesday 28 April 2026 05:59:08 +0000 (0:00:01.327) 0:43:41.530 ********* 2026-04-28 05:59:27.687240 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:59:27.687250 | orchestrator | 2026-04-28 05:59:27.687261 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-28 05:59:27.687271 | orchestrator | Tuesday 28 April 2026 05:59:09 +0000 (0:00:01.426) 0:43:42.956 ********* 2026-04-28 05:59:27.687282 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:59:27.687293 | orchestrator | 2026-04-28 05:59:27.687303 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 05:59:27.687320 | orchestrator | Tuesday 28 April 2026 05:59:10 +0000 (0:00:01.162) 0:43:44.119 ********* 2026-04-28 05:59:27.687331 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:59:27.687342 | orchestrator | 2026-04-28 05:59:27.687352 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 05:59:27.687362 | orchestrator | Tuesday 28 April 2026 05:59:12 +0000 (0:00:01.423) 0:43:45.543 ********* 2026-04-28 05:59:27.687373 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:59:27.687383 | orchestrator | 2026-04-28 05:59:27.687394 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-28 05:59:27.687405 | orchestrator | Tuesday 28 April 2026 05:59:13 +0000 (0:00:01.144) 0:43:46.688 ********* 2026-04-28 05:59:27.687415 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:59:27.687426 | orchestrator | 2026-04-28 05:59:27.687436 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-28 05:59:27.687447 | orchestrator | Tuesday 28 April 2026 05:59:14 +0000 (0:00:01.196) 0:43:47.884 ********* 2026-04-28 05:59:27.687457 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:59:27.687468 | orchestrator | 2026-04-28 05:59:27.687478 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-28 05:59:27.687489 | orchestrator | Tuesday 28 April 2026 05:59:15 +0000 (0:00:01.219) 0:43:49.103 ********* 2026-04-28 05:59:27.687499 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:59:27.687510 | orchestrator | 2026-04-28 05:59:27.687520 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-28 05:59:27.687531 | orchestrator | Tuesday 28 April 2026 05:59:16 +0000 (0:00:01.168) 0:43:50.272 ********* 2026-04-28 05:59:27.687541 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:59:27.687552 | orchestrator | 2026-04-28 05:59:27.687562 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-28 05:59:27.687573 | orchestrator | Tuesday 28 April 2026 05:59:18 +0000 (0:00:01.180) 0:43:51.452 ********* 2026-04-28 05:59:27.687583 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:59:27.687594 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:59:27.687604 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:59:27.687615 | orchestrator | 2026-04-28 05:59:27.687625 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-28 05:59:27.687644 | orchestrator | Tuesday 28 April 2026 05:59:20 +0000 (0:00:02.222) 0:43:53.675 ********* 2026-04-28 05:59:27.687655 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:59:27.687665 | orchestrator | 2026-04-28 05:59:27.687676 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-28 05:59:27.687686 | orchestrator | Tuesday 28 April 2026 05:59:21 +0000 (0:00:01.292) 0:43:54.968 ********* 2026-04-28 05:59:27.687697 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 05:59:27.687707 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 05:59:27.687718 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 05:59:27.687728 | orchestrator | 2026-04-28 05:59:27.687739 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-28 05:59:27.687750 | orchestrator | Tuesday 28 April 2026 05:59:24 +0000 (0:00:03.320) 0:43:58.289 ********* 2026-04-28 05:59:27.687760 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-28 05:59:27.687772 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-28 05:59:27.687782 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-28 05:59:27.687793 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:59:27.687804 | orchestrator | 2026-04-28 05:59:27.687814 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-28 05:59:27.687825 | orchestrator | Tuesday 28 April 2026 05:59:26 +0000 (0:00:01.930) 0:44:00.219 ********* 2026-04-28 05:59:27.687836 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-28 05:59:27.687858 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-28 05:59:49.327881 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-28 05:59:49.327994 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:59:49.328012 | orchestrator | 2026-04-28 05:59:49.328024 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-28 05:59:49.328035 | orchestrator | Tuesday 28 April 2026 05:59:29 +0000 (0:00:02.188) 0:44:02.408 ********* 2026-04-28 05:59:49.328047 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:59:49.328130 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:59:49.328143 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 05:59:49.328174 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:59:49.328185 | orchestrator | 2026-04-28 05:59:49.328195 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-28 05:59:49.328204 | orchestrator | Tuesday 28 April 2026 05:59:30 +0000 (0:00:01.246) 0:44:03.654 ********* 2026-04-28 05:59:49.328217 | orchestrator | ok: [testbed-node-5] => (item={'changed': False, 'stdout': 'e79a9ee6c12b', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-28 05:59:22.128776', 'end': '2026-04-28 05:59:22.175252', 'delta': '0:00:00.046476', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e79a9ee6c12b'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-28 05:59:49.328230 | orchestrator | ok: [testbed-node-5] => (item={'changed': False, 'stdout': '00fb93644bb9', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-28 05:59:23.085514', 'end': '2026-04-28 05:59:23.130975', 'delta': '0:00:00.045461', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['00fb93644bb9'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-28 05:59:49.328258 | orchestrator | ok: [testbed-node-5] => (item={'changed': False, 'stdout': '92b926b7d044', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-28 05:59:23.686669', 'end': '2026-04-28 05:59:23.734150', 'delta': '0:00:00.047481', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['92b926b7d044'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-28 05:59:49.328269 | orchestrator | 2026-04-28 05:59:49.328279 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-28 05:59:49.328289 | orchestrator | Tuesday 28 April 2026 05:59:31 +0000 (0:00:01.198) 0:44:04.853 ********* 2026-04-28 05:59:49.328298 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:59:49.328309 | orchestrator | 2026-04-28 05:59:49.328319 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-28 05:59:49.328328 | orchestrator | Tuesday 28 April 2026 05:59:32 +0000 (0:00:01.323) 0:44:06.177 ********* 2026-04-28 05:59:49.328338 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:59:49.328347 | orchestrator | 2026-04-28 05:59:49.328357 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-28 05:59:49.328366 | orchestrator | Tuesday 28 April 2026 05:59:34 +0000 (0:00:01.261) 0:44:07.439 ********* 2026-04-28 05:59:49.328376 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:59:49.328385 | orchestrator | 2026-04-28 05:59:49.328395 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-28 05:59:49.328404 | orchestrator | Tuesday 28 April 2026 05:59:35 +0000 (0:00:01.206) 0:44:08.645 ********* 2026-04-28 05:59:49.328414 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-28 05:59:49.328425 | orchestrator | 2026-04-28 05:59:49.328441 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 05:59:49.328460 | orchestrator | Tuesday 28 April 2026 05:59:37 +0000 (0:00:02.025) 0:44:10.671 ********* 2026-04-28 05:59:49.328472 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:59:49.328483 | orchestrator | 2026-04-28 05:59:49.328493 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-28 05:59:49.328504 | orchestrator | Tuesday 28 April 2026 05:59:38 +0000 (0:00:01.248) 0:44:11.919 ********* 2026-04-28 05:59:49.328515 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:59:49.328526 | orchestrator | 2026-04-28 05:59:49.328537 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-28 05:59:49.328548 | orchestrator | Tuesday 28 April 2026 05:59:39 +0000 (0:00:01.106) 0:44:13.026 ********* 2026-04-28 05:59:49.328559 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:59:49.328570 | orchestrator | 2026-04-28 05:59:49.328581 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 05:59:49.328591 | orchestrator | Tuesday 28 April 2026 05:59:40 +0000 (0:00:01.252) 0:44:14.278 ********* 2026-04-28 05:59:49.328603 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:59:49.328614 | orchestrator | 2026-04-28 05:59:49.328624 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-28 05:59:49.328636 | orchestrator | Tuesday 28 April 2026 05:59:41 +0000 (0:00:01.097) 0:44:15.375 ********* 2026-04-28 05:59:49.328646 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:59:49.328657 | orchestrator | 2026-04-28 05:59:49.328668 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-28 05:59:49.328679 | orchestrator | Tuesday 28 April 2026 05:59:43 +0000 (0:00:01.205) 0:44:16.580 ********* 2026-04-28 05:59:49.328690 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:59:49.328700 | orchestrator | 2026-04-28 05:59:49.328712 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-28 05:59:49.328723 | orchestrator | Tuesday 28 April 2026 05:59:44 +0000 (0:00:01.215) 0:44:17.796 ********* 2026-04-28 05:59:49.328733 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:59:49.328744 | orchestrator | 2026-04-28 05:59:49.328755 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-28 05:59:49.328766 | orchestrator | Tuesday 28 April 2026 05:59:45 +0000 (0:00:01.245) 0:44:19.041 ********* 2026-04-28 05:59:49.328777 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:59:49.328786 | orchestrator | 2026-04-28 05:59:49.328796 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-28 05:59:49.328805 | orchestrator | Tuesday 28 April 2026 05:59:46 +0000 (0:00:01.217) 0:44:20.258 ********* 2026-04-28 05:59:49.328815 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:59:49.328824 | orchestrator | 2026-04-28 05:59:49.328834 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-28 05:59:49.328844 | orchestrator | Tuesday 28 April 2026 05:59:48 +0000 (0:00:01.163) 0:44:21.422 ********* 2026-04-28 05:59:49.328853 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:59:49.328863 | orchestrator | 2026-04-28 05:59:49.328872 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-28 05:59:49.328882 | orchestrator | Tuesday 28 April 2026 05:59:49 +0000 (0:00:01.168) 0:44:22.591 ********* 2026-04-28 05:59:49.328893 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:59:49.328910 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1', 'dm-uuid-LVM-L5YjMhWvYgnpoIfTj51PZeO1wrabnQEX7l2ME9eZWg9LEHQ0f9eDaf27dOm77xe0'], 'uuids': ['dfd6b477-c8eb-4a33-b64e-726cd73356df'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '953cbf01', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0']}})  2026-04-28 05:59:49.454465 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de', 'scsi-SQEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'eca06b16', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:59:49.454572 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-L2AQ1c-y7H3-F3Y3-6Qkf-SkKZ-Rdhw-Yd8PGb', 'scsi-0QEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79', 'scsi-SQEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '0d71173f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab']}})  2026-04-28 05:59:49.454587 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:59:49.454600 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:59:49.454610 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-15-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 05:59:49.454620 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:59:49.454629 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE', 'dm-uuid-CRYPT-LUKS2-49a0c8edea6a405ca40698859485fff3-xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 05:59:49.454672 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:59:49.454687 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab', 'dm-uuid-LVM-wa3l676dWvdqPItJjhbbIPxjjJMNXrWDxgNEYRSdoBZ0EZLJPUa6Po9zcB3PjLSE'], 'uuids': ['49a0c8ed-ea6a-405c-a406-98859485fff3'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '0d71173f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE']}})  2026-04-28 05:59:49.454698 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-vGsvHj-S1i8-Sw7N-17Sv-GX9v-DQYR-rG2tdh', 'scsi-0QEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89', 'scsi-SQEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '953cbf01', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1']}})  2026-04-28 05:59:49.454707 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:59:49.454727 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '4c7fe216', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 05:59:50.786687 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:59:50.786808 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 05:59:50.786826 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0', 'dm-uuid-CRYPT-LUKS2-dfd6b477c8eb4a33b64e726cd73356df-7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 05:59:50.786842 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:59:50.786854 | orchestrator | 2026-04-28 05:59:50.786866 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-28 05:59:50.786878 | orchestrator | Tuesday 28 April 2026 05:59:50 +0000 (0:00:01.366) 0:44:23.958 ********* 2026-04-28 05:59:50.786891 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:59:50.786904 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1', 'dm-uuid-LVM-L5YjMhWvYgnpoIfTj51PZeO1wrabnQEX7l2ME9eZWg9LEHQ0f9eDaf27dOm77xe0'], 'uuids': ['dfd6b477-c8eb-4a33-b64e-726cd73356df'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '953cbf01', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:59:50.786939 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de', 'scsi-SQEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'eca06b16', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:59:50.786979 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-L2AQ1c-y7H3-F3Y3-6Qkf-SkKZ-Rdhw-Yd8PGb', 'scsi-0QEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79', 'scsi-SQEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '0d71173f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:59:50.786996 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:59:50.787009 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:59:50.787021 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-15-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:59:50.787140 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:59:50.787164 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE', 'dm-uuid-CRYPT-LUKS2-49a0c8edea6a405ca40698859485fff3-xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:59:56.182289 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:59:56.182389 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab', 'dm-uuid-LVM-wa3l676dWvdqPItJjhbbIPxjjJMNXrWDxgNEYRSdoBZ0EZLJPUa6Po9zcB3PjLSE'], 'uuids': ['49a0c8ed-ea6a-405c-a406-98859485fff3'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '0d71173f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:59:56.182404 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-vGsvHj-S1i8-Sw7N-17Sv-GX9v-DQYR-rG2tdh', 'scsi-0QEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89', 'scsi-SQEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '953cbf01', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1']}}, 'ansible_loop_var': 'item'})  2026-04-28 05:59:56.182447 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:59:56.182483 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '4c7fe216', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:59:56.182496 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:59:56.182506 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:59:56.182523 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0', 'dm-uuid-CRYPT-LUKS2-dfd6b477c8eb4a33b64e726cd73356df-7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 05:59:56.182545 | orchestrator | skipping: [testbed-node-5] 2026-04-28 05:59:56.182557 | orchestrator | 2026-04-28 05:59:56.182567 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-28 05:59:56.182577 | orchestrator | Tuesday 28 April 2026 05:59:52 +0000 (0:00:01.468) 0:44:25.426 ********* 2026-04-28 05:59:56.182586 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:59:56.182595 | orchestrator | 2026-04-28 05:59:56.182604 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-28 05:59:56.182613 | orchestrator | Tuesday 28 April 2026 05:59:53 +0000 (0:00:01.470) 0:44:26.897 ********* 2026-04-28 05:59:56.182621 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:59:56.182630 | orchestrator | 2026-04-28 05:59:56.182638 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 05:59:56.182647 | orchestrator | Tuesday 28 April 2026 05:59:54 +0000 (0:00:01.152) 0:44:28.049 ********* 2026-04-28 05:59:56.182655 | orchestrator | ok: [testbed-node-5] 2026-04-28 05:59:56.182664 | orchestrator | 2026-04-28 05:59:56.182673 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 05:59:56.182687 | orchestrator | Tuesday 28 April 2026 05:59:56 +0000 (0:00:01.510) 0:44:29.560 ********* 2026-04-28 06:00:38.329226 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:00:38.329341 | orchestrator | 2026-04-28 06:00:38.329358 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 06:00:38.329371 | orchestrator | Tuesday 28 April 2026 05:59:57 +0000 (0:00:01.121) 0:44:30.682 ********* 2026-04-28 06:00:38.329382 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:00:38.329393 | orchestrator | 2026-04-28 06:00:38.329404 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 06:00:38.329415 | orchestrator | Tuesday 28 April 2026 05:59:58 +0000 (0:00:01.291) 0:44:31.973 ********* 2026-04-28 06:00:38.329426 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:00:38.329437 | orchestrator | 2026-04-28 06:00:38.329466 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-28 06:00:38.329477 | orchestrator | Tuesday 28 April 2026 06:00:00 +0000 (0:00:01.646) 0:44:33.620 ********* 2026-04-28 06:00:38.329489 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-0) 2026-04-28 06:00:38.329500 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-1) 2026-04-28 06:00:38.329511 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-2) 2026-04-28 06:00:38.329522 | orchestrator | 2026-04-28 06:00:38.329533 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-28 06:00:38.329544 | orchestrator | Tuesday 28 April 2026 06:00:02 +0000 (0:00:02.129) 0:44:35.750 ********* 2026-04-28 06:00:38.329555 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-28 06:00:38.329567 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-28 06:00:38.329578 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-28 06:00:38.329589 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:00:38.329599 | orchestrator | 2026-04-28 06:00:38.329610 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-28 06:00:38.329643 | orchestrator | Tuesday 28 April 2026 06:00:03 +0000 (0:00:01.339) 0:44:37.090 ********* 2026-04-28 06:00:38.329655 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-5 2026-04-28 06:00:38.329667 | orchestrator | 2026-04-28 06:00:38.329678 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 06:00:38.329690 | orchestrator | Tuesday 28 April 2026 06:00:04 +0000 (0:00:01.137) 0:44:38.227 ********* 2026-04-28 06:00:38.329703 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:00:38.329716 | orchestrator | 2026-04-28 06:00:38.329729 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 06:00:38.329742 | orchestrator | Tuesday 28 April 2026 06:00:05 +0000 (0:00:01.136) 0:44:39.364 ********* 2026-04-28 06:00:38.329756 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:00:38.329768 | orchestrator | 2026-04-28 06:00:38.329780 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 06:00:38.329793 | orchestrator | Tuesday 28 April 2026 06:00:07 +0000 (0:00:01.204) 0:44:40.568 ********* 2026-04-28 06:00:38.329805 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:00:38.329818 | orchestrator | 2026-04-28 06:00:38.329830 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 06:00:38.329842 | orchestrator | Tuesday 28 April 2026 06:00:08 +0000 (0:00:01.104) 0:44:41.673 ********* 2026-04-28 06:00:38.329854 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:00:38.329867 | orchestrator | 2026-04-28 06:00:38.329880 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 06:00:38.329892 | orchestrator | Tuesday 28 April 2026 06:00:09 +0000 (0:00:01.176) 0:44:42.850 ********* 2026-04-28 06:00:38.329904 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-28 06:00:38.329917 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-28 06:00:38.329930 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-28 06:00:38.329943 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:00:38.329953 | orchestrator | 2026-04-28 06:00:38.329964 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 06:00:38.329975 | orchestrator | Tuesday 28 April 2026 06:00:10 +0000 (0:00:01.356) 0:44:44.206 ********* 2026-04-28 06:00:38.329985 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-28 06:00:38.329996 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-28 06:00:38.330007 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-28 06:00:38.330075 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:00:38.330088 | orchestrator | 2026-04-28 06:00:38.330182 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 06:00:38.330194 | orchestrator | Tuesday 28 April 2026 06:00:12 +0000 (0:00:01.435) 0:44:45.642 ********* 2026-04-28 06:00:38.330205 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-28 06:00:38.330215 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-28 06:00:38.330226 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-28 06:00:38.330237 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:00:38.330247 | orchestrator | 2026-04-28 06:00:38.330258 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 06:00:38.330269 | orchestrator | Tuesday 28 April 2026 06:00:13 +0000 (0:00:01.359) 0:44:47.001 ********* 2026-04-28 06:00:38.330279 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:00:38.330290 | orchestrator | 2026-04-28 06:00:38.330301 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 06:00:38.330311 | orchestrator | Tuesday 28 April 2026 06:00:14 +0000 (0:00:01.161) 0:44:48.162 ********* 2026-04-28 06:00:38.330322 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-28 06:00:38.330333 | orchestrator | 2026-04-28 06:00:38.330343 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-28 06:00:38.330364 | orchestrator | Tuesday 28 April 2026 06:00:16 +0000 (0:00:01.338) 0:44:49.501 ********* 2026-04-28 06:00:38.330393 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:00:38.330405 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:00:38.330416 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:00:38.330427 | orchestrator | ok: [testbed-node-5 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 06:00:38.330437 | orchestrator | ok: [testbed-node-5 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 06:00:38.330448 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-5) 2026-04-28 06:00:38.330466 | orchestrator | ok: [testbed-node-5 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 06:00:38.330477 | orchestrator | 2026-04-28 06:00:38.330488 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-28 06:00:38.330499 | orchestrator | Tuesday 28 April 2026 06:00:18 +0000 (0:00:02.225) 0:44:51.726 ********* 2026-04-28 06:00:38.330510 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:00:38.330521 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:00:38.330531 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:00:38.330542 | orchestrator | ok: [testbed-node-5 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 06:00:38.330553 | orchestrator | ok: [testbed-node-5 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 06:00:38.330563 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-5) 2026-04-28 06:00:38.330574 | orchestrator | ok: [testbed-node-5 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 06:00:38.330585 | orchestrator | 2026-04-28 06:00:38.330596 | orchestrator | TASK [Get osd numbers - non container] ***************************************** 2026-04-28 06:00:38.330606 | orchestrator | Tuesday 28 April 2026 06:00:21 +0000 (0:00:02.720) 0:44:54.447 ********* 2026-04-28 06:00:38.330617 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:00:38.330628 | orchestrator | 2026-04-28 06:00:38.330639 | orchestrator | TASK [Set num_osds] ************************************************************ 2026-04-28 06:00:38.330650 | orchestrator | Tuesday 28 April 2026 06:00:22 +0000 (0:00:01.109) 0:44:55.557 ********* 2026-04-28 06:00:38.330660 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:00:38.330671 | orchestrator | 2026-04-28 06:00:38.330682 | orchestrator | TASK [Set_fact container_exec_cmd_osd] ***************************************** 2026-04-28 06:00:38.330693 | orchestrator | Tuesday 28 April 2026 06:00:22 +0000 (0:00:00.778) 0:44:56.336 ********* 2026-04-28 06:00:38.330703 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:00:38.330714 | orchestrator | 2026-04-28 06:00:38.330725 | orchestrator | TASK [Stop ceph osd] *********************************************************** 2026-04-28 06:00:38.330736 | orchestrator | Tuesday 28 April 2026 06:00:23 +0000 (0:00:00.895) 0:44:57.232 ********* 2026-04-28 06:00:38.330747 | orchestrator | changed: [testbed-node-5] => (item=2) 2026-04-28 06:00:38.330758 | orchestrator | changed: [testbed-node-5] => (item=5) 2026-04-28 06:00:38.330769 | orchestrator | 2026-04-28 06:00:38.330780 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 06:00:38.330790 | orchestrator | Tuesday 28 April 2026 06:00:27 +0000 (0:00:03.844) 0:45:01.076 ********* 2026-04-28 06:00:38.330801 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-5 2026-04-28 06:00:38.330812 | orchestrator | 2026-04-28 06:00:38.330823 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 06:00:38.330834 | orchestrator | Tuesday 28 April 2026 06:00:28 +0000 (0:00:01.133) 0:45:02.209 ********* 2026-04-28 06:00:38.330844 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-5 2026-04-28 06:00:38.330862 | orchestrator | 2026-04-28 06:00:38.330873 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 06:00:38.330884 | orchestrator | Tuesday 28 April 2026 06:00:30 +0000 (0:00:01.204) 0:45:03.414 ********* 2026-04-28 06:00:38.330894 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:00:38.330905 | orchestrator | 2026-04-28 06:00:38.330916 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 06:00:38.330927 | orchestrator | Tuesday 28 April 2026 06:00:31 +0000 (0:00:01.114) 0:45:04.528 ********* 2026-04-28 06:00:38.330937 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:00:38.330948 | orchestrator | 2026-04-28 06:00:38.330959 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 06:00:38.330970 | orchestrator | Tuesday 28 April 2026 06:00:32 +0000 (0:00:01.528) 0:45:06.057 ********* 2026-04-28 06:00:38.330980 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:00:38.330991 | orchestrator | 2026-04-28 06:00:38.331002 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 06:00:38.331013 | orchestrator | Tuesday 28 April 2026 06:00:34 +0000 (0:00:01.525) 0:45:07.583 ********* 2026-04-28 06:00:38.331023 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:00:38.331034 | orchestrator | 2026-04-28 06:00:38.331045 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 06:00:38.331055 | orchestrator | Tuesday 28 April 2026 06:00:35 +0000 (0:00:01.663) 0:45:09.247 ********* 2026-04-28 06:00:38.331066 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:00:38.331077 | orchestrator | 2026-04-28 06:00:38.331087 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 06:00:38.331119 | orchestrator | Tuesday 28 April 2026 06:00:37 +0000 (0:00:01.158) 0:45:10.405 ********* 2026-04-28 06:00:38.331130 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:00:38.331141 | orchestrator | 2026-04-28 06:00:38.331152 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 06:00:38.331163 | orchestrator | Tuesday 28 April 2026 06:00:38 +0000 (0:00:01.156) 0:45:11.562 ********* 2026-04-28 06:00:38.331174 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:00:38.331185 | orchestrator | 2026-04-28 06:00:38.331202 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 06:01:18.254413 | orchestrator | Tuesday 28 April 2026 06:00:39 +0000 (0:00:01.132) 0:45:12.694 ********* 2026-04-28 06:01:18.254558 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:01:18.254578 | orchestrator | 2026-04-28 06:01:18.254590 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 06:01:18.254602 | orchestrator | Tuesday 28 April 2026 06:00:40 +0000 (0:00:01.574) 0:45:14.269 ********* 2026-04-28 06:01:18.254613 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:01:18.254624 | orchestrator | 2026-04-28 06:01:18.254635 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 06:01:18.254646 | orchestrator | Tuesday 28 April 2026 06:00:42 +0000 (0:00:01.557) 0:45:15.826 ********* 2026-04-28 06:01:18.254674 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.254686 | orchestrator | 2026-04-28 06:01:18.254698 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 06:01:18.254709 | orchestrator | Tuesday 28 April 2026 06:00:43 +0000 (0:00:00.787) 0:45:16.614 ********* 2026-04-28 06:01:18.254719 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.254730 | orchestrator | 2026-04-28 06:01:18.254741 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 06:01:18.254752 | orchestrator | Tuesday 28 April 2026 06:00:44 +0000 (0:00:00.785) 0:45:17.400 ********* 2026-04-28 06:01:18.254763 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:01:18.254774 | orchestrator | 2026-04-28 06:01:18.254785 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 06:01:18.254796 | orchestrator | Tuesday 28 April 2026 06:00:44 +0000 (0:00:00.809) 0:45:18.210 ********* 2026-04-28 06:01:18.254807 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:01:18.254841 | orchestrator | 2026-04-28 06:01:18.254853 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 06:01:18.254865 | orchestrator | Tuesday 28 April 2026 06:00:45 +0000 (0:00:00.775) 0:45:18.985 ********* 2026-04-28 06:01:18.254882 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:01:18.254903 | orchestrator | 2026-04-28 06:01:18.254921 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 06:01:18.254934 | orchestrator | Tuesday 28 April 2026 06:00:46 +0000 (0:00:00.779) 0:45:19.765 ********* 2026-04-28 06:01:18.254947 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.254966 | orchestrator | 2026-04-28 06:01:18.254980 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 06:01:18.254994 | orchestrator | Tuesday 28 April 2026 06:00:47 +0000 (0:00:00.791) 0:45:20.556 ********* 2026-04-28 06:01:18.255006 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.255017 | orchestrator | 2026-04-28 06:01:18.255028 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 06:01:18.255038 | orchestrator | Tuesday 28 April 2026 06:00:47 +0000 (0:00:00.753) 0:45:21.310 ********* 2026-04-28 06:01:18.255049 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.255059 | orchestrator | 2026-04-28 06:01:18.255070 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 06:01:18.255081 | orchestrator | Tuesday 28 April 2026 06:00:48 +0000 (0:00:00.793) 0:45:22.104 ********* 2026-04-28 06:01:18.255091 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:01:18.255102 | orchestrator | 2026-04-28 06:01:18.255135 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 06:01:18.255146 | orchestrator | Tuesday 28 April 2026 06:00:49 +0000 (0:00:00.911) 0:45:23.015 ********* 2026-04-28 06:01:18.255157 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:01:18.255168 | orchestrator | 2026-04-28 06:01:18.255178 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-28 06:01:18.255189 | orchestrator | Tuesday 28 April 2026 06:00:50 +0000 (0:00:00.839) 0:45:23.855 ********* 2026-04-28 06:01:18.255200 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.255210 | orchestrator | 2026-04-28 06:01:18.255222 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-28 06:01:18.255233 | orchestrator | Tuesday 28 April 2026 06:00:51 +0000 (0:00:00.797) 0:45:24.653 ********* 2026-04-28 06:01:18.255243 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.255254 | orchestrator | 2026-04-28 06:01:18.255264 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-28 06:01:18.255275 | orchestrator | Tuesday 28 April 2026 06:00:52 +0000 (0:00:00.814) 0:45:25.467 ********* 2026-04-28 06:01:18.255286 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.255296 | orchestrator | 2026-04-28 06:01:18.255306 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-28 06:01:18.255317 | orchestrator | Tuesday 28 April 2026 06:00:52 +0000 (0:00:00.802) 0:45:26.270 ********* 2026-04-28 06:01:18.255328 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.255338 | orchestrator | 2026-04-28 06:01:18.255349 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-28 06:01:18.255360 | orchestrator | Tuesday 28 April 2026 06:00:53 +0000 (0:00:00.772) 0:45:27.042 ********* 2026-04-28 06:01:18.255370 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.255381 | orchestrator | 2026-04-28 06:01:18.255391 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-28 06:01:18.255402 | orchestrator | Tuesday 28 April 2026 06:00:54 +0000 (0:00:00.823) 0:45:27.866 ********* 2026-04-28 06:01:18.255413 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.255423 | orchestrator | 2026-04-28 06:01:18.255434 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-28 06:01:18.255445 | orchestrator | Tuesday 28 April 2026 06:00:55 +0000 (0:00:00.797) 0:45:28.664 ********* 2026-04-28 06:01:18.255455 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.255474 | orchestrator | 2026-04-28 06:01:18.255485 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-28 06:01:18.255497 | orchestrator | Tuesday 28 April 2026 06:00:56 +0000 (0:00:00.830) 0:45:29.494 ********* 2026-04-28 06:01:18.255508 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.255518 | orchestrator | 2026-04-28 06:01:18.255529 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-28 06:01:18.255540 | orchestrator | Tuesday 28 April 2026 06:00:56 +0000 (0:00:00.770) 0:45:30.265 ********* 2026-04-28 06:01:18.255570 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.255582 | orchestrator | 2026-04-28 06:01:18.255593 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-28 06:01:18.255604 | orchestrator | Tuesday 28 April 2026 06:00:57 +0000 (0:00:00.779) 0:45:31.045 ********* 2026-04-28 06:01:18.255614 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.255625 | orchestrator | 2026-04-28 06:01:18.255636 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-28 06:01:18.255647 | orchestrator | Tuesday 28 April 2026 06:00:58 +0000 (0:00:00.800) 0:45:31.846 ********* 2026-04-28 06:01:18.255658 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.255668 | orchestrator | 2026-04-28 06:01:18.255685 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-28 06:01:18.255696 | orchestrator | Tuesday 28 April 2026 06:00:59 +0000 (0:00:00.903) 0:45:32.750 ********* 2026-04-28 06:01:18.255707 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.255717 | orchestrator | 2026-04-28 06:01:18.255728 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-28 06:01:18.255739 | orchestrator | Tuesday 28 April 2026 06:01:00 +0000 (0:00:00.772) 0:45:33.522 ********* 2026-04-28 06:01:18.255749 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:01:18.255760 | orchestrator | 2026-04-28 06:01:18.255771 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-28 06:01:18.255781 | orchestrator | Tuesday 28 April 2026 06:01:01 +0000 (0:00:01.597) 0:45:35.119 ********* 2026-04-28 06:01:18.255792 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:01:18.255802 | orchestrator | 2026-04-28 06:01:18.255814 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-28 06:01:18.255824 | orchestrator | Tuesday 28 April 2026 06:01:03 +0000 (0:00:01.861) 0:45:36.981 ********* 2026-04-28 06:01:18.255835 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-5 2026-04-28 06:01:18.255846 | orchestrator | 2026-04-28 06:01:18.255857 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-28 06:01:18.255868 | orchestrator | Tuesday 28 April 2026 06:01:04 +0000 (0:00:01.102) 0:45:38.083 ********* 2026-04-28 06:01:18.255879 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.255889 | orchestrator | 2026-04-28 06:01:18.255900 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-28 06:01:18.255910 | orchestrator | Tuesday 28 April 2026 06:01:05 +0000 (0:00:01.128) 0:45:39.211 ********* 2026-04-28 06:01:18.255921 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.255932 | orchestrator | 2026-04-28 06:01:18.255943 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-28 06:01:18.255953 | orchestrator | Tuesday 28 April 2026 06:01:06 +0000 (0:00:01.103) 0:45:40.314 ********* 2026-04-28 06:01:18.255964 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-28 06:01:18.255975 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-28 06:01:18.255985 | orchestrator | 2026-04-28 06:01:18.255996 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-28 06:01:18.256007 | orchestrator | Tuesday 28 April 2026 06:01:08 +0000 (0:00:01.770) 0:45:42.085 ********* 2026-04-28 06:01:18.256017 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:01:18.256028 | orchestrator | 2026-04-28 06:01:18.256045 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-28 06:01:18.256056 | orchestrator | Tuesday 28 April 2026 06:01:10 +0000 (0:00:01.478) 0:45:43.564 ********* 2026-04-28 06:01:18.256067 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.256077 | orchestrator | 2026-04-28 06:01:18.256088 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-28 06:01:18.256099 | orchestrator | Tuesday 28 April 2026 06:01:11 +0000 (0:00:01.177) 0:45:44.741 ********* 2026-04-28 06:01:18.256109 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.256139 | orchestrator | 2026-04-28 06:01:18.256150 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-28 06:01:18.256161 | orchestrator | Tuesday 28 April 2026 06:01:12 +0000 (0:00:00.828) 0:45:45.570 ********* 2026-04-28 06:01:18.256172 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.256182 | orchestrator | 2026-04-28 06:01:18.256193 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-28 06:01:18.256204 | orchestrator | Tuesday 28 April 2026 06:01:13 +0000 (0:00:00.841) 0:45:46.412 ********* 2026-04-28 06:01:18.256214 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-5 2026-04-28 06:01:18.256225 | orchestrator | 2026-04-28 06:01:18.256236 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-28 06:01:18.256246 | orchestrator | Tuesday 28 April 2026 06:01:14 +0000 (0:00:01.126) 0:45:47.538 ********* 2026-04-28 06:01:18.256257 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:01:18.256268 | orchestrator | 2026-04-28 06:01:18.256278 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-28 06:01:18.256289 | orchestrator | Tuesday 28 April 2026 06:01:15 +0000 (0:00:01.715) 0:45:49.254 ********* 2026-04-28 06:01:18.256299 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-28 06:01:18.256310 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-28 06:01:18.256321 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-28 06:01:18.256331 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.256342 | orchestrator | 2026-04-28 06:01:18.256352 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-28 06:01:18.256363 | orchestrator | Tuesday 28 April 2026 06:01:17 +0000 (0:00:01.156) 0:45:50.411 ********* 2026-04-28 06:01:18.256374 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:01:18.256384 | orchestrator | 2026-04-28 06:01:18.256395 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-28 06:01:18.256406 | orchestrator | Tuesday 28 April 2026 06:01:18 +0000 (0:00:01.121) 0:45:51.533 ********* 2026-04-28 06:01:18.256423 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.786908 | orchestrator | 2026-04-28 06:02:01.787023 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-28 06:02:01.787041 | orchestrator | Tuesday 28 April 2026 06:01:19 +0000 (0:00:01.179) 0:45:52.713 ********* 2026-04-28 06:02:01.787053 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.787066 | orchestrator | 2026-04-28 06:02:01.787077 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-28 06:02:01.787088 | orchestrator | Tuesday 28 April 2026 06:01:20 +0000 (0:00:01.137) 0:45:53.850 ********* 2026-04-28 06:02:01.787099 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.787110 | orchestrator | 2026-04-28 06:02:01.787164 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-28 06:02:01.787177 | orchestrator | Tuesday 28 April 2026 06:01:21 +0000 (0:00:01.142) 0:45:54.993 ********* 2026-04-28 06:02:01.787188 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.787199 | orchestrator | 2026-04-28 06:02:01.787210 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-28 06:02:01.787221 | orchestrator | Tuesday 28 April 2026 06:01:22 +0000 (0:00:00.844) 0:45:55.838 ********* 2026-04-28 06:02:01.787257 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:02:01.787270 | orchestrator | 2026-04-28 06:02:01.787280 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-28 06:02:01.787292 | orchestrator | Tuesday 28 April 2026 06:01:24 +0000 (0:00:02.115) 0:45:57.953 ********* 2026-04-28 06:02:01.787303 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:02:01.787313 | orchestrator | 2026-04-28 06:02:01.787324 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-28 06:02:01.787335 | orchestrator | Tuesday 28 April 2026 06:01:25 +0000 (0:00:00.762) 0:45:58.716 ********* 2026-04-28 06:02:01.787346 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-5 2026-04-28 06:02:01.787357 | orchestrator | 2026-04-28 06:02:01.787367 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-28 06:02:01.787378 | orchestrator | Tuesday 28 April 2026 06:01:26 +0000 (0:00:01.302) 0:46:00.018 ********* 2026-04-28 06:02:01.787388 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.787399 | orchestrator | 2026-04-28 06:02:01.787410 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-28 06:02:01.787421 | orchestrator | Tuesday 28 April 2026 06:01:27 +0000 (0:00:01.152) 0:46:01.171 ********* 2026-04-28 06:02:01.787432 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.787442 | orchestrator | 2026-04-28 06:02:01.787456 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-28 06:02:01.787468 | orchestrator | Tuesday 28 April 2026 06:01:28 +0000 (0:00:01.148) 0:46:02.320 ********* 2026-04-28 06:02:01.787481 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.787494 | orchestrator | 2026-04-28 06:02:01.787506 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-28 06:02:01.787519 | orchestrator | Tuesday 28 April 2026 06:01:30 +0000 (0:00:01.118) 0:46:03.439 ********* 2026-04-28 06:02:01.787532 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.787544 | orchestrator | 2026-04-28 06:02:01.787557 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-28 06:02:01.787570 | orchestrator | Tuesday 28 April 2026 06:01:31 +0000 (0:00:01.193) 0:46:04.632 ********* 2026-04-28 06:02:01.787583 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.787596 | orchestrator | 2026-04-28 06:02:01.787609 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-28 06:02:01.787622 | orchestrator | Tuesday 28 April 2026 06:01:32 +0000 (0:00:01.143) 0:46:05.775 ********* 2026-04-28 06:02:01.787635 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.787648 | orchestrator | 2026-04-28 06:02:01.787661 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-28 06:02:01.787673 | orchestrator | Tuesday 28 April 2026 06:01:33 +0000 (0:00:01.164) 0:46:06.939 ********* 2026-04-28 06:02:01.787686 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.787699 | orchestrator | 2026-04-28 06:02:01.787712 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-28 06:02:01.787725 | orchestrator | Tuesday 28 April 2026 06:01:34 +0000 (0:00:01.152) 0:46:08.092 ********* 2026-04-28 06:02:01.787737 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.787750 | orchestrator | 2026-04-28 06:02:01.787763 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-28 06:02:01.787775 | orchestrator | Tuesday 28 April 2026 06:01:35 +0000 (0:00:01.145) 0:46:09.238 ********* 2026-04-28 06:02:01.787788 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:02:01.787801 | orchestrator | 2026-04-28 06:02:01.787812 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-28 06:02:01.787823 | orchestrator | Tuesday 28 April 2026 06:01:36 +0000 (0:00:00.845) 0:46:10.083 ********* 2026-04-28 06:02:01.787833 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-5 2026-04-28 06:02:01.787845 | orchestrator | 2026-04-28 06:02:01.787856 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-28 06:02:01.787876 | orchestrator | Tuesday 28 April 2026 06:01:37 +0000 (0:00:01.155) 0:46:11.239 ********* 2026-04-28 06:02:01.787887 | orchestrator | ok: [testbed-node-5] => (item=/etc/ceph) 2026-04-28 06:02:01.787898 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/) 2026-04-28 06:02:01.787909 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/mon) 2026-04-28 06:02:01.787919 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/osd) 2026-04-28 06:02:01.787930 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/mds) 2026-04-28 06:02:01.787941 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/tmp) 2026-04-28 06:02:01.787951 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/crash) 2026-04-28 06:02:01.787962 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/radosgw) 2026-04-28 06:02:01.787973 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-28 06:02:01.788002 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-28 06:02:01.788013 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-28 06:02:01.788024 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-28 06:02:01.788035 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-28 06:02:01.788045 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-28 06:02:01.788056 | orchestrator | ok: [testbed-node-5] => (item=/var/run/ceph) 2026-04-28 06:02:01.788067 | orchestrator | ok: [testbed-node-5] => (item=/var/log/ceph) 2026-04-28 06:02:01.788077 | orchestrator | 2026-04-28 06:02:01.788093 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-28 06:02:01.788104 | orchestrator | Tuesday 28 April 2026 06:01:44 +0000 (0:00:06.249) 0:46:17.489 ********* 2026-04-28 06:02:01.788115 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-5 2026-04-28 06:02:01.788126 | orchestrator | 2026-04-28 06:02:01.788172 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-28 06:02:01.788184 | orchestrator | Tuesday 28 April 2026 06:01:45 +0000 (0:00:01.325) 0:46:18.815 ********* 2026-04-28 06:02:01.788195 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-28 06:02:01.788208 | orchestrator | 2026-04-28 06:02:01.788219 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-28 06:02:01.788229 | orchestrator | Tuesday 28 April 2026 06:01:47 +0000 (0:00:01.576) 0:46:20.391 ********* 2026-04-28 06:02:01.788240 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-28 06:02:01.788251 | orchestrator | 2026-04-28 06:02:01.788262 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-28 06:02:01.788272 | orchestrator | Tuesday 28 April 2026 06:01:48 +0000 (0:00:01.610) 0:46:22.002 ********* 2026-04-28 06:02:01.788283 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.788293 | orchestrator | 2026-04-28 06:02:01.788304 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-28 06:02:01.788314 | orchestrator | Tuesday 28 April 2026 06:01:49 +0000 (0:00:00.777) 0:46:22.780 ********* 2026-04-28 06:02:01.788325 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.788335 | orchestrator | 2026-04-28 06:02:01.788346 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-28 06:02:01.788356 | orchestrator | Tuesday 28 April 2026 06:01:50 +0000 (0:00:00.783) 0:46:23.564 ********* 2026-04-28 06:02:01.788367 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.788377 | orchestrator | 2026-04-28 06:02:01.788388 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-28 06:02:01.788399 | orchestrator | Tuesday 28 April 2026 06:01:50 +0000 (0:00:00.815) 0:46:24.379 ********* 2026-04-28 06:02:01.788409 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.788430 | orchestrator | 2026-04-28 06:02:01.788441 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-28 06:02:01.788451 | orchestrator | Tuesday 28 April 2026 06:01:51 +0000 (0:00:00.757) 0:46:25.137 ********* 2026-04-28 06:02:01.788462 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.788473 | orchestrator | 2026-04-28 06:02:01.788483 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-28 06:02:01.788494 | orchestrator | Tuesday 28 April 2026 06:01:52 +0000 (0:00:00.804) 0:46:25.942 ********* 2026-04-28 06:02:01.788505 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.788516 | orchestrator | 2026-04-28 06:02:01.788526 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-28 06:02:01.788537 | orchestrator | Tuesday 28 April 2026 06:01:53 +0000 (0:00:00.811) 0:46:26.754 ********* 2026-04-28 06:02:01.788547 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.788558 | orchestrator | 2026-04-28 06:02:01.788568 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-28 06:02:01.788579 | orchestrator | Tuesday 28 April 2026 06:01:54 +0000 (0:00:00.824) 0:46:27.578 ********* 2026-04-28 06:02:01.788590 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.788601 | orchestrator | 2026-04-28 06:02:01.788611 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-28 06:02:01.788622 | orchestrator | Tuesday 28 April 2026 06:01:55 +0000 (0:00:00.809) 0:46:28.388 ********* 2026-04-28 06:02:01.788632 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.788643 | orchestrator | 2026-04-28 06:02:01.788653 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-28 06:02:01.788664 | orchestrator | Tuesday 28 April 2026 06:01:55 +0000 (0:00:00.807) 0:46:29.195 ********* 2026-04-28 06:02:01.788675 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:01.788685 | orchestrator | 2026-04-28 06:02:01.788696 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-28 06:02:01.788706 | orchestrator | Tuesday 28 April 2026 06:01:56 +0000 (0:00:00.949) 0:46:30.145 ********* 2026-04-28 06:02:01.788717 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:02:01.788727 | orchestrator | 2026-04-28 06:02:01.788738 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-28 06:02:01.788749 | orchestrator | Tuesday 28 April 2026 06:01:57 +0000 (0:00:00.845) 0:46:30.990 ********* 2026-04-28 06:02:01.788759 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] 2026-04-28 06:02:01.788770 | orchestrator | 2026-04-28 06:02:01.788780 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-28 06:02:01.788791 | orchestrator | Tuesday 28 April 2026 06:02:01 +0000 (0:00:04.072) 0:46:35.062 ********* 2026-04-28 06:02:01.788810 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-28 06:02:44.148932 | orchestrator | 2026-04-28 06:02:44.149043 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-28 06:02:44.149057 | orchestrator | Tuesday 28 April 2026 06:02:02 +0000 (0:00:00.858) 0:46:35.921 ********* 2026-04-28 06:02:44.149085 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log'}]) 2026-04-28 06:02:44.149100 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.15:8081'}]) 2026-04-28 06:02:44.149111 | orchestrator | 2026-04-28 06:02:44.149142 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-28 06:02:44.149153 | orchestrator | Tuesday 28 April 2026 06:02:09 +0000 (0:00:07.433) 0:46:43.355 ********* 2026-04-28 06:02:44.149208 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:44.149219 | orchestrator | 2026-04-28 06:02:44.149228 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-28 06:02:44.149238 | orchestrator | Tuesday 28 April 2026 06:02:10 +0000 (0:00:00.860) 0:46:44.216 ********* 2026-04-28 06:02:44.149247 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:44.149257 | orchestrator | 2026-04-28 06:02:44.149267 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 06:02:44.149278 | orchestrator | Tuesday 28 April 2026 06:02:11 +0000 (0:00:00.834) 0:46:45.050 ********* 2026-04-28 06:02:44.149287 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:44.149297 | orchestrator | 2026-04-28 06:02:44.149306 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 06:02:44.149316 | orchestrator | Tuesday 28 April 2026 06:02:12 +0000 (0:00:00.872) 0:46:45.923 ********* 2026-04-28 06:02:44.149325 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:44.149334 | orchestrator | 2026-04-28 06:02:44.149344 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 06:02:44.149353 | orchestrator | Tuesday 28 April 2026 06:02:13 +0000 (0:00:00.814) 0:46:46.738 ********* 2026-04-28 06:02:44.149363 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:44.149372 | orchestrator | 2026-04-28 06:02:44.149381 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 06:02:44.149391 | orchestrator | Tuesday 28 April 2026 06:02:14 +0000 (0:00:00.797) 0:46:47.536 ********* 2026-04-28 06:02:44.149401 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:02:44.149411 | orchestrator | 2026-04-28 06:02:44.149421 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 06:02:44.149430 | orchestrator | Tuesday 28 April 2026 06:02:15 +0000 (0:00:00.945) 0:46:48.482 ********* 2026-04-28 06:02:44.149440 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-28 06:02:44.149452 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-28 06:02:44.149463 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-28 06:02:44.149475 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:44.149486 | orchestrator | 2026-04-28 06:02:44.149497 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 06:02:44.149509 | orchestrator | Tuesday 28 April 2026 06:02:16 +0000 (0:00:01.504) 0:46:49.987 ********* 2026-04-28 06:02:44.149521 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-28 06:02:44.149532 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-28 06:02:44.149543 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-28 06:02:44.149555 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:44.149566 | orchestrator | 2026-04-28 06:02:44.149577 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 06:02:44.149587 | orchestrator | Tuesday 28 April 2026 06:02:18 +0000 (0:00:01.492) 0:46:51.479 ********* 2026-04-28 06:02:44.149596 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-28 06:02:44.149606 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-28 06:02:44.149615 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-28 06:02:44.149625 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:44.149634 | orchestrator | 2026-04-28 06:02:44.149644 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 06:02:44.149654 | orchestrator | Tuesday 28 April 2026 06:02:19 +0000 (0:00:01.603) 0:46:53.083 ********* 2026-04-28 06:02:44.149663 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:02:44.149673 | orchestrator | 2026-04-28 06:02:44.149682 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 06:02:44.149700 | orchestrator | Tuesday 28 April 2026 06:02:20 +0000 (0:00:00.828) 0:46:53.912 ********* 2026-04-28 06:02:44.149710 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-28 06:02:44.149719 | orchestrator | 2026-04-28 06:02:44.149729 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-28 06:02:44.149739 | orchestrator | Tuesday 28 April 2026 06:02:21 +0000 (0:00:01.025) 0:46:54.937 ********* 2026-04-28 06:02:44.149748 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:02:44.149758 | orchestrator | 2026-04-28 06:02:44.149767 | orchestrator | TASK [ceph-osd : Set_fact add_osd] ********************************************* 2026-04-28 06:02:44.149777 | orchestrator | Tuesday 28 April 2026 06:02:22 +0000 (0:00:01.434) 0:46:56.372 ********* 2026-04-28 06:02:44.149786 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:02:44.149796 | orchestrator | 2026-04-28 06:02:44.149821 | orchestrator | TASK [ceph-osd : Set_fact container_exec_cmd] ********************************** 2026-04-28 06:02:44.149832 | orchestrator | Tuesday 28 April 2026 06:02:23 +0000 (0:00:00.839) 0:46:57.212 ********* 2026-04-28 06:02:44.149842 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:02:44.149852 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:02:44.149862 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:02:44.149871 | orchestrator | 2026-04-28 06:02:44.149886 | orchestrator | TASK [ceph-osd : Include_tasks system_tuning.yml] ****************************** 2026-04-28 06:02:44.149896 | orchestrator | Tuesday 28 April 2026 06:02:25 +0000 (0:00:01.357) 0:46:58.569 ********* 2026-04-28 06:02:44.149906 | orchestrator | included: /ansible/roles/ceph-osd/tasks/system_tuning.yml for testbed-node-5 2026-04-28 06:02:44.149916 | orchestrator | 2026-04-28 06:02:44.149925 | orchestrator | TASK [ceph-osd : Create tmpfiles.d directory] ********************************** 2026-04-28 06:02:44.149934 | orchestrator | Tuesday 28 April 2026 06:02:26 +0000 (0:00:01.122) 0:46:59.691 ********* 2026-04-28 06:02:44.149944 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:44.149953 | orchestrator | 2026-04-28 06:02:44.149963 | orchestrator | TASK [ceph-osd : Disable transparent hugepage] ********************************* 2026-04-28 06:02:44.149973 | orchestrator | Tuesday 28 April 2026 06:02:27 +0000 (0:00:01.128) 0:47:00.820 ********* 2026-04-28 06:02:44.149982 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:44.149992 | orchestrator | 2026-04-28 06:02:44.150002 | orchestrator | TASK [ceph-osd : Get default vm.min_free_kbytes] ******************************* 2026-04-28 06:02:44.150011 | orchestrator | Tuesday 28 April 2026 06:02:28 +0000 (0:00:01.165) 0:47:01.986 ********* 2026-04-28 06:02:44.150080 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:02:44.150090 | orchestrator | 2026-04-28 06:02:44.150099 | orchestrator | TASK [ceph-osd : Set_fact vm_min_free_kbytes] ********************************** 2026-04-28 06:02:44.150108 | orchestrator | Tuesday 28 April 2026 06:02:30 +0000 (0:00:01.408) 0:47:03.394 ********* 2026-04-28 06:02:44.150118 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:02:44.150127 | orchestrator | 2026-04-28 06:02:44.150136 | orchestrator | TASK [ceph-osd : Apply operating system tuning] ******************************** 2026-04-28 06:02:44.150146 | orchestrator | Tuesday 28 April 2026 06:02:31 +0000 (0:00:01.246) 0:47:04.640 ********* 2026-04-28 06:02:44.150155 | orchestrator | ok: [testbed-node-5] => (item={'name': 'fs.aio-max-nr', 'value': '1048576', 'enable': True}) 2026-04-28 06:02:44.150181 | orchestrator | ok: [testbed-node-5] => (item={'name': 'fs.file-max', 'value': 26234859}) 2026-04-28 06:02:44.150220 | orchestrator | ok: [testbed-node-5] => (item={'name': 'vm.zone_reclaim_mode', 'value': 0}) 2026-04-28 06:02:44.150231 | orchestrator | ok: [testbed-node-5] => (item={'name': 'vm.swappiness', 'value': 10}) 2026-04-28 06:02:44.150241 | orchestrator | ok: [testbed-node-5] => (item={'name': 'vm.min_free_kbytes', 'value': '67584'}) 2026-04-28 06:02:44.150251 | orchestrator | 2026-04-28 06:02:44.150260 | orchestrator | TASK [ceph-osd : Install dependencies] ***************************************** 2026-04-28 06:02:44.150278 | orchestrator | Tuesday 28 April 2026 06:02:33 +0000 (0:00:02.573) 0:47:07.214 ********* 2026-04-28 06:02:44.150287 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:44.150297 | orchestrator | 2026-04-28 06:02:44.150307 | orchestrator | TASK [ceph-osd : Include_tasks common.yml] ************************************* 2026-04-28 06:02:44.150316 | orchestrator | Tuesday 28 April 2026 06:02:34 +0000 (0:00:00.773) 0:47:07.987 ********* 2026-04-28 06:02:44.150325 | orchestrator | included: /ansible/roles/ceph-osd/tasks/common.yml for testbed-node-5 2026-04-28 06:02:44.150335 | orchestrator | 2026-04-28 06:02:44.150345 | orchestrator | TASK [ceph-osd : Create bootstrap-osd and osd directories] ********************* 2026-04-28 06:02:44.150354 | orchestrator | Tuesday 28 April 2026 06:02:35 +0000 (0:00:01.140) 0:47:09.128 ********* 2026-04-28 06:02:44.150363 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-osd/) 2026-04-28 06:02:44.150373 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/osd/) 2026-04-28 06:02:44.150383 | orchestrator | 2026-04-28 06:02:44.150392 | orchestrator | TASK [ceph-osd : Get keys from monitors] *************************************** 2026-04-28 06:02:44.150401 | orchestrator | Tuesday 28 April 2026 06:02:37 +0000 (0:00:01.815) 0:47:10.943 ********* 2026-04-28 06:02:44.150411 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 06:02:44.150420 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-28 06:02:44.150430 | orchestrator | ok: [testbed-node-5 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-28 06:02:44.150439 | orchestrator | 2026-04-28 06:02:44.150449 | orchestrator | TASK [ceph-osd : Copy ceph key(s) if needed] *********************************** 2026-04-28 06:02:44.150458 | orchestrator | Tuesday 28 April 2026 06:02:40 +0000 (0:00:03.178) 0:47:14.122 ********* 2026-04-28 06:02:44.150467 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-28 06:02:44.150477 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-28 06:02:44.150487 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:02:44.150496 | orchestrator | 2026-04-28 06:02:44.150506 | orchestrator | TASK [ceph-osd : Set noup flag] ************************************************ 2026-04-28 06:02:44.150515 | orchestrator | Tuesday 28 April 2026 06:02:42 +0000 (0:00:01.568) 0:47:15.690 ********* 2026-04-28 06:02:44.150524 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:44.150534 | orchestrator | 2026-04-28 06:02:44.150544 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm.yml] ****************************** 2026-04-28 06:02:44.150553 | orchestrator | Tuesday 28 April 2026 06:02:43 +0000 (0:00:00.828) 0:47:16.520 ********* 2026-04-28 06:02:44.150562 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:44.150572 | orchestrator | 2026-04-28 06:02:44.150582 | orchestrator | TASK [ceph-osd : Include_tasks scenarios/lvm-batch.yml] ************************ 2026-04-28 06:02:44.150591 | orchestrator | Tuesday 28 April 2026 06:02:43 +0000 (0:00:00.814) 0:47:17.334 ********* 2026-04-28 06:02:44.150601 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:02:44.150611 | orchestrator | 2026-04-28 06:02:44.150627 | orchestrator | TASK [ceph-osd : Include_tasks start_osds.yml] ********************************* 2026-04-28 06:04:58.031247 | orchestrator | Tuesday 28 April 2026 06:02:44 +0000 (0:00:00.866) 0:47:18.201 ********* 2026-04-28 06:04:58.031365 | orchestrator | included: /ansible/roles/ceph-osd/tasks/start_osds.yml for testbed-node-5 2026-04-28 06:04:58.031383 | orchestrator | 2026-04-28 06:04:58.031396 | orchestrator | TASK [ceph-osd : Get osd ids] ************************************************** 2026-04-28 06:04:58.031407 | orchestrator | Tuesday 28 April 2026 06:02:45 +0000 (0:00:01.165) 0:47:19.366 ********* 2026-04-28 06:04:58.031418 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:04:58.031429 | orchestrator | 2026-04-28 06:04:58.031457 | orchestrator | TASK [ceph-osd : Collect osd ids] ********************************************** 2026-04-28 06:04:58.031468 | orchestrator | Tuesday 28 April 2026 06:02:47 +0000 (0:00:01.593) 0:47:20.959 ********* 2026-04-28 06:04:58.031479 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:04:58.031489 | orchestrator | 2026-04-28 06:04:58.031500 | orchestrator | TASK [ceph-osd : Include_tasks systemd.yml] ************************************ 2026-04-28 06:04:58.031511 | orchestrator | Tuesday 28 April 2026 06:02:50 +0000 (0:00:03.310) 0:47:24.269 ********* 2026-04-28 06:04:58.031545 | orchestrator | included: /ansible/roles/ceph-osd/tasks/systemd.yml for testbed-node-5 2026-04-28 06:04:58.031557 | orchestrator | 2026-04-28 06:04:58.031568 | orchestrator | TASK [ceph-osd : Generate systemd unit file] *********************************** 2026-04-28 06:04:58.031578 | orchestrator | Tuesday 28 April 2026 06:02:52 +0000 (0:00:01.143) 0:47:25.413 ********* 2026-04-28 06:04:58.031589 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:04:58.031599 | orchestrator | 2026-04-28 06:04:58.031610 | orchestrator | TASK [ceph-osd : Generate systemd ceph-osd target file] ************************ 2026-04-28 06:04:58.031621 | orchestrator | Tuesday 28 April 2026 06:02:54 +0000 (0:00:02.007) 0:47:27.421 ********* 2026-04-28 06:04:58.031631 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:04:58.031642 | orchestrator | 2026-04-28 06:04:58.031652 | orchestrator | TASK [ceph-osd : Enable ceph-osd.target] *************************************** 2026-04-28 06:04:58.031663 | orchestrator | Tuesday 28 April 2026 06:02:56 +0000 (0:00:02.039) 0:47:29.460 ********* 2026-04-28 06:04:58.031674 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:04:58.031684 | orchestrator | 2026-04-28 06:04:58.031695 | orchestrator | TASK [ceph-osd : Ensure systemd service override directory exists] ************* 2026-04-28 06:04:58.031706 | orchestrator | Tuesday 28 April 2026 06:02:58 +0000 (0:00:02.223) 0:47:31.683 ********* 2026-04-28 06:04:58.031717 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:04:58.031729 | orchestrator | 2026-04-28 06:04:58.031739 | orchestrator | TASK [ceph-osd : Add ceph-osd systemd service overrides] *********************** 2026-04-28 06:04:58.031750 | orchestrator | Tuesday 28 April 2026 06:02:59 +0000 (0:00:01.118) 0:47:32.802 ********* 2026-04-28 06:04:58.031760 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:04:58.031771 | orchestrator | 2026-04-28 06:04:58.031782 | orchestrator | TASK [ceph-osd : Ensure /var/lib/ceph/osd/- is present] ********* 2026-04-28 06:04:58.031795 | orchestrator | Tuesday 28 April 2026 06:03:00 +0000 (0:00:01.132) 0:47:33.935 ********* 2026-04-28 06:04:58.031808 | orchestrator | ok: [testbed-node-5] => (item=2) 2026-04-28 06:04:58.031821 | orchestrator | ok: [testbed-node-5] => (item=5) 2026-04-28 06:04:58.031833 | orchestrator | 2026-04-28 06:04:58.031846 | orchestrator | TASK [ceph-osd : Write run file in /var/lib/ceph/osd/xxxx/run] ***************** 2026-04-28 06:04:58.031859 | orchestrator | Tuesday 28 April 2026 06:03:02 +0000 (0:00:01.784) 0:47:35.719 ********* 2026-04-28 06:04:58.031871 | orchestrator | ok: [testbed-node-5] => (item=2) 2026-04-28 06:04:58.031908 | orchestrator | ok: [testbed-node-5] => (item=5) 2026-04-28 06:04:58.031922 | orchestrator | 2026-04-28 06:04:58.031935 | orchestrator | TASK [ceph-osd : Systemd start osd] ******************************************** 2026-04-28 06:04:58.031949 | orchestrator | Tuesday 28 April 2026 06:03:05 +0000 (0:00:02.837) 0:47:38.557 ********* 2026-04-28 06:04:58.031962 | orchestrator | changed: [testbed-node-5] => (item=2) 2026-04-28 06:04:58.031975 | orchestrator | changed: [testbed-node-5] => (item=5) 2026-04-28 06:04:58.031988 | orchestrator | 2026-04-28 06:04:58.032001 | orchestrator | TASK [ceph-osd : Unset noup flag] ********************************************** 2026-04-28 06:04:58.032013 | orchestrator | Tuesday 28 April 2026 06:03:09 +0000 (0:00:04.255) 0:47:42.813 ********* 2026-04-28 06:04:58.032026 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:04:58.032039 | orchestrator | 2026-04-28 06:04:58.032051 | orchestrator | TASK [ceph-osd : Wait for all osd to be up] ************************************ 2026-04-28 06:04:58.032064 | orchestrator | Tuesday 28 April 2026 06:03:10 +0000 (0:00:00.885) 0:47:43.698 ********* 2026-04-28 06:04:58.032076 | orchestrator | FAILED - RETRYING: [testbed-node-5 -> testbed-node-0]: Wait for all osd to be up (60 retries left). 2026-04-28 06:04:58.032090 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-28 06:04:58.032103 | orchestrator | 2026-04-28 06:04:58.032115 | orchestrator | TASK [ceph-osd : Include crush_rules.yml] ************************************** 2026-04-28 06:04:58.032128 | orchestrator | Tuesday 28 April 2026 06:03:23 +0000 (0:00:13.182) 0:47:56.880 ********* 2026-04-28 06:04:58.032141 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:04:58.032151 | orchestrator | 2026-04-28 06:04:58.032170 | orchestrator | TASK [Scan ceph-disk osds with ceph-volume if deploying nautilus] ************** 2026-04-28 06:04:58.032181 | orchestrator | Tuesday 28 April 2026 06:03:25 +0000 (0:00:01.511) 0:47:58.392 ********* 2026-04-28 06:04:58.032191 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:04:58.032202 | orchestrator | 2026-04-28 06:04:58.032213 | orchestrator | TASK [Activate scanned ceph-disk osds and migrate to ceph-volume if deploying nautilus] *** 2026-04-28 06:04:58.032223 | orchestrator | Tuesday 28 April 2026 06:03:25 +0000 (0:00:00.799) 0:47:59.192 ********* 2026-04-28 06:04:58.032234 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:04:58.032244 | orchestrator | 2026-04-28 06:04:58.032255 | orchestrator | TASK [Waiting for clean pgs...] ************************************************ 2026-04-28 06:04:58.032266 | orchestrator | Tuesday 28 April 2026 06:03:26 +0000 (0:00:00.817) 0:48:00.009 ********* 2026-04-28 06:04:58.032276 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-28 06:04:58.032287 | orchestrator | 2026-04-28 06:04:58.032297 | orchestrator | PLAY [Complete osd upgrade] **************************************************** 2026-04-28 06:04:58.032308 | orchestrator | 2026-04-28 06:04:58.032336 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 06:04:58.032348 | orchestrator | Tuesday 28 April 2026 06:03:29 +0000 (0:00:02.565) 0:48:02.575 ********* 2026-04-28 06:04:58.032359 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:04:58.032370 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:04:58.032381 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:04:58.032391 | orchestrator | 2026-04-28 06:04:58.032402 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 06:04:58.032413 | orchestrator | Tuesday 28 April 2026 06:03:30 +0000 (0:00:01.736) 0:48:04.311 ********* 2026-04-28 06:04:58.032424 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:04:58.032440 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:04:58.032451 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:04:58.032461 | orchestrator | 2026-04-28 06:04:58.032472 | orchestrator | TASK [Re-enable pg autoscale on pools] ***************************************** 2026-04-28 06:04:58.032483 | orchestrator | Tuesday 28 April 2026 06:03:32 +0000 (0:00:01.645) 0:48:05.957 ********* 2026-04-28 06:04:58.032493 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': '.mgr', 'mode': 'on'}) 2026-04-28 06:04:58.032504 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'cephfs_data', 'mode': 'on'}) 2026-04-28 06:04:58.032516 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'cephfs_metadata', 'mode': 'on'}) 2026-04-28 06:04:58.032527 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.buckets.data', 'mode': 'on'}) 2026-04-28 06:04:58.032539 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.buckets.index', 'mode': 'on'}) 2026-04-28 06:04:58.032550 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.control', 'mode': 'on'}) 2026-04-28 06:04:58.032560 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.log', 'mode': 'on'}) 2026-04-28 06:04:58.032571 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': 'default.rgw.meta', 'mode': 'on'}) 2026-04-28 06:04:58.032582 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'name': '.rgw.root', 'mode': 'on'}) 2026-04-28 06:04:58.032592 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'backups', 'mode': 'off'})  2026-04-28 06:04:58.032603 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'volumes', 'mode': 'off'})  2026-04-28 06:04:58.032614 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'images', 'mode': 'off'})  2026-04-28 06:04:58.032624 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'metrics', 'mode': 'off'})  2026-04-28 06:04:58.032635 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'vms', 'mode': 'off'})  2026-04-28 06:04:58.032653 | orchestrator | 2026-04-28 06:04:58.032663 | orchestrator | TASK [Unset osd flags] ********************************************************* 2026-04-28 06:04:58.032674 | orchestrator | Tuesday 28 April 2026 06:04:41 +0000 (0:01:09.101) 0:49:15.059 ********* 2026-04-28 06:04:58.032684 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=noout) 2026-04-28 06:04:58.032695 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=nodeep-scrub) 2026-04-28 06:04:58.032706 | orchestrator | 2026-04-28 06:04:58.032717 | orchestrator | TASK [Re-enable balancer] ****************************************************** 2026-04-28 06:04:58.032727 | orchestrator | Tuesday 28 April 2026 06:04:47 +0000 (0:00:05.501) 0:49:20.560 ********* 2026-04-28 06:04:58.032738 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-28 06:04:58.032749 | orchestrator | 2026-04-28 06:04:58.032759 | orchestrator | PLAY [Upgrade ceph mdss cluster, deactivate all rank > 0] ********************** 2026-04-28 06:04:58.032770 | orchestrator | 2026-04-28 06:04:58.032780 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 06:04:58.032791 | orchestrator | Tuesday 28 April 2026 06:04:50 +0000 (0:00:03.185) 0:49:23.745 ********* 2026-04-28 06:04:58.032801 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-0 2026-04-28 06:04:58.032812 | orchestrator | 2026-04-28 06:04:58.032823 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-28 06:04:58.032834 | orchestrator | Tuesday 28 April 2026 06:04:51 +0000 (0:00:01.146) 0:49:24.892 ********* 2026-04-28 06:04:58.032844 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:04:58.032855 | orchestrator | 2026-04-28 06:04:58.032866 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-28 06:04:58.032891 | orchestrator | Tuesday 28 April 2026 06:04:52 +0000 (0:00:01.460) 0:49:26.353 ********* 2026-04-28 06:04:58.032903 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:04:58.032914 | orchestrator | 2026-04-28 06:04:58.032924 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 06:04:58.032935 | orchestrator | Tuesday 28 April 2026 06:04:54 +0000 (0:00:01.156) 0:49:27.509 ********* 2026-04-28 06:04:58.032946 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:04:58.032957 | orchestrator | 2026-04-28 06:04:58.032967 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 06:04:58.032978 | orchestrator | Tuesday 28 April 2026 06:04:55 +0000 (0:00:01.457) 0:49:28.967 ********* 2026-04-28 06:04:58.032988 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:04:58.032999 | orchestrator | 2026-04-28 06:04:58.033010 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-28 06:04:58.033020 | orchestrator | Tuesday 28 April 2026 06:04:56 +0000 (0:00:01.289) 0:49:30.257 ********* 2026-04-28 06:04:58.033031 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:04:58.033042 | orchestrator | 2026-04-28 06:04:58.033052 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-28 06:04:58.033070 | orchestrator | Tuesday 28 April 2026 06:04:58 +0000 (0:00:01.148) 0:49:31.405 ********* 2026-04-28 06:05:23.022468 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:05:23.022617 | orchestrator | 2026-04-28 06:05:23.022647 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-28 06:05:23.022668 | orchestrator | Tuesday 28 April 2026 06:04:59 +0000 (0:00:01.227) 0:49:32.633 ********* 2026-04-28 06:05:23.022690 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:05:23.022781 | orchestrator | 2026-04-28 06:05:23.022807 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-28 06:05:23.022850 | orchestrator | Tuesday 28 April 2026 06:05:00 +0000 (0:00:01.222) 0:49:33.855 ********* 2026-04-28 06:05:23.022871 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:05:23.022890 | orchestrator | 2026-04-28 06:05:23.022911 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-28 06:05:23.022930 | orchestrator | Tuesday 28 April 2026 06:05:01 +0000 (0:00:01.140) 0:49:34.995 ********* 2026-04-28 06:05:23.022980 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 06:05:23.023002 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:05:23.023024 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:05:23.023040 | orchestrator | 2026-04-28 06:05:23.023054 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-28 06:05:23.023067 | orchestrator | Tuesday 28 April 2026 06:05:03 +0000 (0:00:01.721) 0:49:36.717 ********* 2026-04-28 06:05:23.023080 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:05:23.023093 | orchestrator | 2026-04-28 06:05:23.023107 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-28 06:05:23.023120 | orchestrator | Tuesday 28 April 2026 06:05:04 +0000 (0:00:01.246) 0:49:37.964 ********* 2026-04-28 06:05:23.023133 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 06:05:23.023146 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:05:23.023159 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:05:23.023172 | orchestrator | 2026-04-28 06:05:23.023185 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-28 06:05:23.023198 | orchestrator | Tuesday 28 April 2026 06:05:07 +0000 (0:00:02.874) 0:49:40.838 ********* 2026-04-28 06:05:23.023211 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-28 06:05:23.023224 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-28 06:05:23.023237 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-28 06:05:23.023250 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:05:23.023262 | orchestrator | 2026-04-28 06:05:23.023275 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-28 06:05:23.023288 | orchestrator | Tuesday 28 April 2026 06:05:08 +0000 (0:00:01.427) 0:49:42.265 ********* 2026-04-28 06:05:23.023303 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-28 06:05:23.023320 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-28 06:05:23.023332 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-28 06:05:23.023344 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:05:23.023355 | orchestrator | 2026-04-28 06:05:23.023365 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-28 06:05:23.023376 | orchestrator | Tuesday 28 April 2026 06:05:10 +0000 (0:00:01.864) 0:49:44.130 ********* 2026-04-28 06:05:23.023390 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 06:05:23.023404 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 06:05:23.023444 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 06:05:23.023457 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:05:23.023468 | orchestrator | 2026-04-28 06:05:23.023479 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-28 06:05:23.023490 | orchestrator | Tuesday 28 April 2026 06:05:11 +0000 (0:00:01.247) 0:49:45.377 ********* 2026-04-28 06:05:23.023510 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': 'e79a9ee6c12b', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-28 06:05:05.131789', 'end': '2026-04-28 06:05:05.174906', 'delta': '0:00:00.043117', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e79a9ee6c12b'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-28 06:05:23.023527 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': '00fb93644bb9', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-28 06:05:05.717993', 'end': '2026-04-28 06:05:05.756247', 'delta': '0:00:00.038254', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['00fb93644bb9'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-28 06:05:23.023538 | orchestrator | ok: [testbed-node-0] => (item={'changed': False, 'stdout': '92b926b7d044', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-28 06:05:06.300581', 'end': '2026-04-28 06:05:06.341037', 'delta': '0:00:00.040456', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['92b926b7d044'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-28 06:05:23.023550 | orchestrator | 2026-04-28 06:05:23.023561 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-28 06:05:23.023572 | orchestrator | Tuesday 28 April 2026 06:05:13 +0000 (0:00:01.224) 0:49:46.602 ********* 2026-04-28 06:05:23.023583 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:05:23.023594 | orchestrator | 2026-04-28 06:05:23.023605 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-28 06:05:23.023615 | orchestrator | Tuesday 28 April 2026 06:05:14 +0000 (0:00:01.239) 0:49:47.841 ********* 2026-04-28 06:05:23.023626 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:05:23.023637 | orchestrator | 2026-04-28 06:05:23.023647 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-28 06:05:23.023658 | orchestrator | Tuesday 28 April 2026 06:05:16 +0000 (0:00:01.820) 0:49:49.661 ********* 2026-04-28 06:05:23.023669 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:05:23.023687 | orchestrator | 2026-04-28 06:05:23.023698 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-28 06:05:23.023709 | orchestrator | Tuesday 28 April 2026 06:05:17 +0000 (0:00:01.156) 0:49:50.818 ********* 2026-04-28 06:05:23.023760 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:05:23.023780 | orchestrator | 2026-04-28 06:05:23.023798 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 06:05:23.023811 | orchestrator | Tuesday 28 April 2026 06:05:19 +0000 (0:00:01.980) 0:49:52.798 ********* 2026-04-28 06:05:23.023822 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:05:23.023833 | orchestrator | 2026-04-28 06:05:23.023844 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-28 06:05:23.023854 | orchestrator | Tuesday 28 April 2026 06:05:20 +0000 (0:00:01.187) 0:49:53.986 ********* 2026-04-28 06:05:23.023865 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:05:23.023876 | orchestrator | 2026-04-28 06:05:23.023886 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-28 06:05:23.023897 | orchestrator | Tuesday 28 April 2026 06:05:21 +0000 (0:00:01.127) 0:49:55.114 ********* 2026-04-28 06:05:23.023908 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:05:23.023919 | orchestrator | 2026-04-28 06:05:23.023930 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 06:05:23.023950 | orchestrator | Tuesday 28 April 2026 06:05:23 +0000 (0:00:01.283) 0:49:56.397 ********* 2026-04-28 06:05:32.517509 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:05:32.517618 | orchestrator | 2026-04-28 06:05:32.517632 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-28 06:05:32.517644 | orchestrator | Tuesday 28 April 2026 06:05:24 +0000 (0:00:01.111) 0:49:57.509 ********* 2026-04-28 06:05:32.517733 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:05:32.517754 | orchestrator | 2026-04-28 06:05:32.517789 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-28 06:05:32.517805 | orchestrator | Tuesday 28 April 2026 06:05:25 +0000 (0:00:01.131) 0:49:58.641 ********* 2026-04-28 06:05:32.517822 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:05:32.517838 | orchestrator | 2026-04-28 06:05:32.517855 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-28 06:05:32.517872 | orchestrator | Tuesday 28 April 2026 06:05:26 +0000 (0:00:01.135) 0:49:59.776 ********* 2026-04-28 06:05:32.517888 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:05:32.517905 | orchestrator | 2026-04-28 06:05:32.517922 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-28 06:05:32.517938 | orchestrator | Tuesday 28 April 2026 06:05:27 +0000 (0:00:01.169) 0:50:00.946 ********* 2026-04-28 06:05:32.517954 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:05:32.517970 | orchestrator | 2026-04-28 06:05:32.517986 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-28 06:05:32.518002 | orchestrator | Tuesday 28 April 2026 06:05:28 +0000 (0:00:01.147) 0:50:02.094 ********* 2026-04-28 06:05:32.518092 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:05:32.518118 | orchestrator | 2026-04-28 06:05:32.518137 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-28 06:05:32.518156 | orchestrator | Tuesday 28 April 2026 06:05:29 +0000 (0:00:01.137) 0:50:03.232 ********* 2026-04-28 06:05:32.518175 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:05:32.518194 | orchestrator | 2026-04-28 06:05:32.518209 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-28 06:05:32.518227 | orchestrator | Tuesday 28 April 2026 06:05:30 +0000 (0:00:01.145) 0:50:04.378 ********* 2026-04-28 06:05:32.518247 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:05:32.518297 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:05:32.518318 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:05:32.518338 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-19-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 06:05:32.518361 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:05:32.518405 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:05:32.518434 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:05:32.518455 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '12b9c610', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part16', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part14', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part15', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part1', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 06:05:32.518488 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:05:32.518502 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:05:32.518512 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:05:32.518522 | orchestrator | 2026-04-28 06:05:32.518532 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-28 06:05:32.518542 | orchestrator | Tuesday 28 April 2026 06:05:32 +0000 (0:00:01.414) 0:50:05.792 ********* 2026-04-28 06:05:32.518560 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:05:37.854815 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:05:37.854942 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:05:37.854998 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-19-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:05:37.855020 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:05:37.855040 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:05:37.855059 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:05:37.855118 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '12b9c610', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part16', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part14', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part15', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part1', 'scsi-SQEMU_QEMU_HARDDISK_12b9c610-e3be-4093-9151-0aff94d13d7f-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:05:37.855145 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:05:37.855157 | orchestrator | skipping: [testbed-node-0] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'inventory_hostname in groups.get(osd_group_name, [])', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:05:37.855169 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:05:37.855182 | orchestrator | 2026-04-28 06:05:37.855195 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-28 06:05:37.855207 | orchestrator | Tuesday 28 April 2026 06:05:33 +0000 (0:00:01.331) 0:50:07.124 ********* 2026-04-28 06:05:37.855218 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:05:37.855229 | orchestrator | 2026-04-28 06:05:37.855240 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-28 06:05:37.855251 | orchestrator | Tuesday 28 April 2026 06:05:35 +0000 (0:00:01.527) 0:50:08.651 ********* 2026-04-28 06:05:37.855262 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:05:37.855272 | orchestrator | 2026-04-28 06:05:37.855283 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 06:05:37.855294 | orchestrator | Tuesday 28 April 2026 06:05:36 +0000 (0:00:01.154) 0:50:09.806 ********* 2026-04-28 06:05:37.855304 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:05:37.855315 | orchestrator | 2026-04-28 06:05:37.855328 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 06:05:37.855349 | orchestrator | Tuesday 28 April 2026 06:05:37 +0000 (0:00:01.428) 0:50:11.234 ********* 2026-04-28 06:06:32.263705 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:06:32.263844 | orchestrator | 2026-04-28 06:06:32.263862 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 06:06:32.263892 | orchestrator | Tuesday 28 April 2026 06:05:38 +0000 (0:00:01.125) 0:50:12.360 ********* 2026-04-28 06:06:32.263941 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:06:32.263955 | orchestrator | 2026-04-28 06:06:32.263966 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 06:06:32.264001 | orchestrator | Tuesday 28 April 2026 06:05:40 +0000 (0:00:01.282) 0:50:13.642 ********* 2026-04-28 06:06:32.264012 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:06:32.264023 | orchestrator | 2026-04-28 06:06:32.264034 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-28 06:06:32.264045 | orchestrator | Tuesday 28 April 2026 06:05:41 +0000 (0:00:01.214) 0:50:14.857 ********* 2026-04-28 06:06:32.264056 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 06:06:32.264068 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-28 06:06:32.264079 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-28 06:06:32.264089 | orchestrator | 2026-04-28 06:06:32.264100 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-28 06:06:32.264111 | orchestrator | Tuesday 28 April 2026 06:05:43 +0000 (0:00:02.075) 0:50:16.932 ********* 2026-04-28 06:06:32.264122 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-0)  2026-04-28 06:06:32.264133 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-1)  2026-04-28 06:06:32.264144 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-2)  2026-04-28 06:06:32.264155 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:06:32.264165 | orchestrator | 2026-04-28 06:06:32.264176 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-28 06:06:32.264187 | orchestrator | Tuesday 28 April 2026 06:05:44 +0000 (0:00:01.197) 0:50:18.130 ********* 2026-04-28 06:06:32.264198 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:06:32.264208 | orchestrator | 2026-04-28 06:06:32.264219 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-28 06:06:32.264230 | orchestrator | Tuesday 28 April 2026 06:05:45 +0000 (0:00:01.152) 0:50:19.282 ********* 2026-04-28 06:06:32.264243 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 06:06:32.264256 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:06:32.264270 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:06:32.264282 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 06:06:32.264324 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 06:06:32.264339 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 06:06:32.264352 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 06:06:32.264364 | orchestrator | 2026-04-28 06:06:32.264377 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-28 06:06:32.264390 | orchestrator | Tuesday 28 April 2026 06:05:48 +0000 (0:00:02.267) 0:50:21.550 ********* 2026-04-28 06:06:32.264403 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 06:06:32.264417 | orchestrator | ok: [testbed-node-0 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:06:32.264429 | orchestrator | ok: [testbed-node-0 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:06:32.264441 | orchestrator | ok: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 06:06:32.264454 | orchestrator | ok: [testbed-node-0 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 06:06:32.264467 | orchestrator | ok: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 06:06:32.264479 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 06:06:32.264491 | orchestrator | 2026-04-28 06:06:32.264504 | orchestrator | TASK [Set max_mds 1 on ceph fs] ************************************************ 2026-04-28 06:06:32.264517 | orchestrator | Tuesday 28 April 2026 06:05:50 +0000 (0:00:02.713) 0:50:24.264 ********* 2026-04-28 06:06:32.264529 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:06:32.264550 | orchestrator | 2026-04-28 06:06:32.264563 | orchestrator | TASK [Wait until only rank 0 is up] ******************************************** 2026-04-28 06:06:32.264576 | orchestrator | Tuesday 28 April 2026 06:05:54 +0000 (0:00:03.883) 0:50:28.147 ********* 2026-04-28 06:06:32.264588 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:06:32.264601 | orchestrator | 2026-04-28 06:06:32.264614 | orchestrator | TASK [Get name of remaining active mds] **************************************** 2026-04-28 06:06:32.264626 | orchestrator | Tuesday 28 April 2026 06:05:57 +0000 (0:00:02.913) 0:50:31.061 ********* 2026-04-28 06:06:32.264637 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:06:32.264647 | orchestrator | 2026-04-28 06:06:32.264658 | orchestrator | TASK [Set_fact mds_active_name] ************************************************ 2026-04-28 06:06:32.264669 | orchestrator | Tuesday 28 April 2026 06:05:59 +0000 (0:00:02.179) 0:50:33.240 ********* 2026-04-28 06:06:32.264713 | orchestrator | ok: [testbed-node-0] => (item={'key': 'gid_4726', 'value': {'gid': 4726, 'name': 'testbed-node-4', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 2, 'addr': '192.168.16.14:6817/597579889', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '192.168.16.14:6816', 'nonce': 597579889}, {'type': 'v1', 'addr': '192.168.16.14:6817', 'nonce': 597579889}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}) 2026-04-28 06:06:32.264737 | orchestrator | 2026-04-28 06:06:32.264752 | orchestrator | TASK [Set_fact mds_active_host] ************************************************ 2026-04-28 06:06:32.264763 | orchestrator | Tuesday 28 April 2026 06:06:01 +0000 (0:00:01.149) 0:50:34.390 ********* 2026-04-28 06:06:32.264774 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-3)  2026-04-28 06:06:32.264785 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-4) 2026-04-28 06:06:32.264796 | orchestrator | skipping: [testbed-node-0] => (item=testbed-node-5)  2026-04-28 06:06:32.264806 | orchestrator | 2026-04-28 06:06:32.264818 | orchestrator | TASK [Create standby_mdss group] *********************************************** 2026-04-28 06:06:32.264828 | orchestrator | Tuesday 28 April 2026 06:06:02 +0000 (0:00:01.585) 0:50:35.975 ********* 2026-04-28 06:06:32.264844 | orchestrator | changed: [testbed-node-0] => (item=testbed-node-3) 2026-04-28 06:06:32.264861 | orchestrator | changed: [testbed-node-0] => (item=testbed-node-5) 2026-04-28 06:06:32.264880 | orchestrator | 2026-04-28 06:06:32.264900 | orchestrator | TASK [Stop standby ceph mds] *************************************************** 2026-04-28 06:06:32.264918 | orchestrator | Tuesday 28 April 2026 06:06:04 +0000 (0:00:01.492) 0:50:37.468 ********* 2026-04-28 06:06:32.264931 | orchestrator | changed: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 06:06:32.264941 | orchestrator | changed: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 06:06:32.264952 | orchestrator | 2026-04-28 06:06:32.264962 | orchestrator | TASK [Mask systemd units for standby ceph mds] ********************************* 2026-04-28 06:06:32.264973 | orchestrator | Tuesday 28 April 2026 06:06:14 +0000 (0:00:10.559) 0:50:48.029 ********* 2026-04-28 06:06:32.264983 | orchestrator | changed: [testbed-node-0 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 06:06:32.264994 | orchestrator | changed: [testbed-node-0 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 06:06:32.265004 | orchestrator | 2026-04-28 06:06:32.265015 | orchestrator | TASK [Wait until all standbys mds are stopped] ********************************* 2026-04-28 06:06:32.265025 | orchestrator | Tuesday 28 April 2026 06:06:18 +0000 (0:00:03.802) 0:50:51.831 ********* 2026-04-28 06:06:32.265036 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:06:32.265047 | orchestrator | 2026-04-28 06:06:32.265057 | orchestrator | TASK [Create active_mdss group] ************************************************ 2026-04-28 06:06:32.265075 | orchestrator | Tuesday 28 April 2026 06:06:20 +0000 (0:00:02.051) 0:50:53.883 ********* 2026-04-28 06:06:32.265086 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:06:32.265097 | orchestrator | 2026-04-28 06:06:32.265108 | orchestrator | PLAY [Upgrade active mds] ****************************************************** 2026-04-28 06:06:32.265118 | orchestrator | 2026-04-28 06:06:32.265129 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 06:06:32.265139 | orchestrator | Tuesday 28 April 2026 06:06:22 +0000 (0:00:01.539) 0:50:55.423 ********* 2026-04-28 06:06:32.265150 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-4 2026-04-28 06:06:32.265160 | orchestrator | 2026-04-28 06:06:32.265171 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-28 06:06:32.265182 | orchestrator | Tuesday 28 April 2026 06:06:23 +0000 (0:00:01.325) 0:50:56.748 ********* 2026-04-28 06:06:32.265192 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:06:32.265203 | orchestrator | 2026-04-28 06:06:32.265214 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-28 06:06:32.265224 | orchestrator | Tuesday 28 April 2026 06:06:24 +0000 (0:00:01.432) 0:50:58.181 ********* 2026-04-28 06:06:32.265235 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:06:32.265245 | orchestrator | 2026-04-28 06:06:32.265256 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 06:06:32.265266 | orchestrator | Tuesday 28 April 2026 06:06:25 +0000 (0:00:01.162) 0:50:59.344 ********* 2026-04-28 06:06:32.265277 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:06:32.265288 | orchestrator | 2026-04-28 06:06:32.265321 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 06:06:32.265333 | orchestrator | Tuesday 28 April 2026 06:06:27 +0000 (0:00:01.465) 0:51:00.809 ********* 2026-04-28 06:06:32.265343 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:06:32.265354 | orchestrator | 2026-04-28 06:06:32.265364 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-28 06:06:32.265375 | orchestrator | Tuesday 28 April 2026 06:06:28 +0000 (0:00:01.123) 0:51:01.933 ********* 2026-04-28 06:06:32.265386 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:06:32.265396 | orchestrator | 2026-04-28 06:06:32.265407 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-28 06:06:32.265418 | orchestrator | Tuesday 28 April 2026 06:06:29 +0000 (0:00:01.141) 0:51:03.075 ********* 2026-04-28 06:06:32.265428 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:06:32.265439 | orchestrator | 2026-04-28 06:06:32.265449 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-28 06:06:32.265460 | orchestrator | Tuesday 28 April 2026 06:06:30 +0000 (0:00:01.186) 0:51:04.261 ********* 2026-04-28 06:06:32.265471 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:06:32.265481 | orchestrator | 2026-04-28 06:06:32.265492 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-28 06:06:32.265503 | orchestrator | Tuesday 28 April 2026 06:06:32 +0000 (0:00:01.205) 0:51:05.467 ********* 2026-04-28 06:06:32.265514 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:06:32.265524 | orchestrator | 2026-04-28 06:06:32.265543 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-28 06:06:58.165399 | orchestrator | Tuesday 28 April 2026 06:06:33 +0000 (0:00:01.177) 0:51:06.645 ********* 2026-04-28 06:06:58.165543 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:06:58.165560 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:06:58.165572 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:06:58.165583 | orchestrator | 2026-04-28 06:06:58.165596 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-28 06:06:58.165606 | orchestrator | Tuesday 28 April 2026 06:06:35 +0000 (0:00:02.040) 0:51:08.686 ********* 2026-04-28 06:06:58.165647 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:06:58.165661 | orchestrator | 2026-04-28 06:06:58.165672 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-28 06:06:58.165688 | orchestrator | Tuesday 28 April 2026 06:06:36 +0000 (0:00:01.329) 0:51:10.015 ********* 2026-04-28 06:06:58.165699 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:06:58.165710 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:06:58.165721 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:06:58.165731 | orchestrator | 2026-04-28 06:06:58.165742 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-28 06:06:58.165753 | orchestrator | Tuesday 28 April 2026 06:06:39 +0000 (0:00:03.253) 0:51:13.268 ********* 2026-04-28 06:06:58.165764 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-28 06:06:58.165776 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-28 06:06:58.165787 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-28 06:06:58.165798 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:06:58.165808 | orchestrator | 2026-04-28 06:06:58.165820 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-28 06:06:58.165831 | orchestrator | Tuesday 28 April 2026 06:06:41 +0000 (0:00:01.897) 0:51:15.166 ********* 2026-04-28 06:06:58.165844 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-28 06:06:58.165859 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-28 06:06:58.165873 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-28 06:06:58.165885 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:06:58.165898 | orchestrator | 2026-04-28 06:06:58.165912 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-28 06:06:58.165925 | orchestrator | Tuesday 28 April 2026 06:06:43 +0000 (0:00:02.103) 0:51:17.269 ********* 2026-04-28 06:06:58.165940 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 06:06:58.165958 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 06:06:58.165972 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 06:06:58.165985 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:06:58.166005 | orchestrator | 2026-04-28 06:06:58.166089 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-28 06:06:58.166102 | orchestrator | Tuesday 28 April 2026 06:06:45 +0000 (0:00:01.355) 0:51:18.625 ********* 2026-04-28 06:06:58.166151 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': 'e79a9ee6c12b', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-28 06:06:37.175401', 'end': '2026-04-28 06:06:37.233502', 'delta': '0:00:00.058101', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e79a9ee6c12b'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-28 06:06:58.166193 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': '00fb93644bb9', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-28 06:06:38.125521', 'end': '2026-04-28 06:06:38.173696', 'delta': '0:00:00.048175', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['00fb93644bb9'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-28 06:06:58.166207 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': '92b926b7d044', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-28 06:06:38.685264', 'end': '2026-04-28 06:06:38.729355', 'delta': '0:00:00.044091', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['92b926b7d044'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-28 06:06:58.166220 | orchestrator | 2026-04-28 06:06:58.166231 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-28 06:06:58.166242 | orchestrator | Tuesday 28 April 2026 06:06:46 +0000 (0:00:01.208) 0:51:19.834 ********* 2026-04-28 06:06:58.166253 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:06:58.166264 | orchestrator | 2026-04-28 06:06:58.166275 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-28 06:06:58.166285 | orchestrator | Tuesday 28 April 2026 06:06:47 +0000 (0:00:01.285) 0:51:21.119 ********* 2026-04-28 06:06:58.166296 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:06:58.166307 | orchestrator | 2026-04-28 06:06:58.166317 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-28 06:06:58.166328 | orchestrator | Tuesday 28 April 2026 06:06:48 +0000 (0:00:01.235) 0:51:22.355 ********* 2026-04-28 06:06:58.166339 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:06:58.166350 | orchestrator | 2026-04-28 06:06:58.166360 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-28 06:06:58.166371 | orchestrator | Tuesday 28 April 2026 06:06:50 +0000 (0:00:01.125) 0:51:23.480 ********* 2026-04-28 06:06:58.166381 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-28 06:06:58.166392 | orchestrator | 2026-04-28 06:06:58.166403 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 06:06:58.166413 | orchestrator | Tuesday 28 April 2026 06:06:52 +0000 (0:00:02.085) 0:51:25.566 ********* 2026-04-28 06:06:58.166432 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:06:58.166443 | orchestrator | 2026-04-28 06:06:58.166453 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-28 06:06:58.166464 | orchestrator | Tuesday 28 April 2026 06:06:53 +0000 (0:00:01.155) 0:51:26.722 ********* 2026-04-28 06:06:58.166475 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:06:58.166486 | orchestrator | 2026-04-28 06:06:58.166496 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-28 06:06:58.166507 | orchestrator | Tuesday 28 April 2026 06:06:54 +0000 (0:00:01.117) 0:51:27.839 ********* 2026-04-28 06:06:58.166517 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:06:58.166528 | orchestrator | 2026-04-28 06:06:58.166538 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 06:06:58.166549 | orchestrator | Tuesday 28 April 2026 06:06:55 +0000 (0:00:01.270) 0:51:29.110 ********* 2026-04-28 06:06:58.166559 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:06:58.166570 | orchestrator | 2026-04-28 06:06:58.166581 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-28 06:06:58.166592 | orchestrator | Tuesday 28 April 2026 06:06:56 +0000 (0:00:01.176) 0:51:30.286 ********* 2026-04-28 06:06:58.166602 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:06:58.166613 | orchestrator | 2026-04-28 06:06:58.166623 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-28 06:06:58.166634 | orchestrator | Tuesday 28 April 2026 06:06:58 +0000 (0:00:01.168) 0:51:31.454 ********* 2026-04-28 06:06:58.166652 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:07:04.142787 | orchestrator | 2026-04-28 06:07:04.142956 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-28 06:07:04.142974 | orchestrator | Tuesday 28 April 2026 06:06:59 +0000 (0:00:01.154) 0:51:32.609 ********* 2026-04-28 06:07:04.142987 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:07:04.142999 | orchestrator | 2026-04-28 06:07:04.143011 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-28 06:07:04.143022 | orchestrator | Tuesday 28 April 2026 06:07:00 +0000 (0:00:01.118) 0:51:33.728 ********* 2026-04-28 06:07:04.143033 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:07:04.143046 | orchestrator | 2026-04-28 06:07:04.143057 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-28 06:07:04.143068 | orchestrator | Tuesday 28 April 2026 06:07:01 +0000 (0:00:01.306) 0:51:35.034 ********* 2026-04-28 06:07:04.143079 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:07:04.143090 | orchestrator | 2026-04-28 06:07:04.143101 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-28 06:07:04.143112 | orchestrator | Tuesday 28 April 2026 06:07:02 +0000 (0:00:01.125) 0:51:36.159 ********* 2026-04-28 06:07:04.143180 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:07:04.143194 | orchestrator | 2026-04-28 06:07:04.143205 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-28 06:07:04.143215 | orchestrator | Tuesday 28 April 2026 06:07:03 +0000 (0:00:01.154) 0:51:37.314 ********* 2026-04-28 06:07:04.143230 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:07:04.143249 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a', 'dm-uuid-LVM-Ef9S4L9mnk6YjVYwTU4OmJ1Dk0yNJkcNEeYiJgmdqy5Dk4JMIq1jh9ZhEgnxusYs'], 'uuids': ['46d73a0b-76ab-4c42-90e0-cf88eb28d186'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f49158cb', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs']}})  2026-04-28 06:07:04.143298 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80', 'scsi-SQEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '81043571', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 06:07:04.143315 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-l9OtEf-0x8l-OZFM-QMSY-xI5K-ifcY-q0IHfV', 'scsi-0QEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b', 'scsi-SQEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '6fed6807', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf']}})  2026-04-28 06:07:04.143329 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:07:04.143372 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:07:04.143389 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-13-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 06:07:04.143403 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:07:04.143417 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg', 'dm-uuid-CRYPT-LUKS2-699d16b2a15647d8861ce74191aa2e29-p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 06:07:04.143440 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:07:04.143454 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf', 'dm-uuid-LVM-jDSXafY010UkbP8ZmxeIQet2dAZt2ducp03EHOrl6D51efYCaF9MHllF0WrfMNUg'], 'uuids': ['699d16b2-a156-47d8-861c-e74191aa2e29'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '6fed6807', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg']}})  2026-04-28 06:07:04.143470 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-NfMdHp-i6Wd-iXE4-bdeT-UQcT-dakb-CDL8cZ', 'scsi-0QEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba', 'scsi-SQEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f49158cb', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a']}})  2026-04-28 06:07:04.143499 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:07:05.478386 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46815659', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 06:07:05.478530 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:07:05.478550 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:07:05.478564 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs', 'dm-uuid-CRYPT-LUKS2-46d73a0b76ab4c4290e0cf88eb28d186-EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 06:07:05.478578 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:07:05.478591 | orchestrator | 2026-04-28 06:07:05.478603 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-28 06:07:05.478616 | orchestrator | Tuesday 28 April 2026 06:07:05 +0000 (0:00:01.372) 0:51:38.687 ********* 2026-04-28 06:07:05.478671 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:07:05.478697 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a', 'dm-uuid-LVM-Ef9S4L9mnk6YjVYwTU4OmJ1Dk0yNJkcNEeYiJgmdqy5Dk4JMIq1jh9ZhEgnxusYs'], 'uuids': ['46d73a0b-76ab-4c42-90e0-cf88eb28d186'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f49158cb', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:07:05.478729 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80', 'scsi-SQEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '81043571', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:07:05.478747 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-l9OtEf-0x8l-OZFM-QMSY-xI5K-ifcY-q0IHfV', 'scsi-0QEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b', 'scsi-SQEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '6fed6807', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:07:05.478767 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:07:05.478816 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:07:05.604424 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-13-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:07:05.604539 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:07:05.604554 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg', 'dm-uuid-CRYPT-LUKS2-699d16b2a15647d8861ce74191aa2e29-p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:07:05.604563 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:07:05.604573 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf', 'dm-uuid-LVM-jDSXafY010UkbP8ZmxeIQet2dAZt2ducp03EHOrl6D51efYCaF9MHllF0WrfMNUg'], 'uuids': ['699d16b2-a156-47d8-861c-e74191aa2e29'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '6fed6807', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:07:05.604615 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-NfMdHp-i6Wd-iXE4-bdeT-UQcT-dakb-CDL8cZ', 'scsi-0QEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba', 'scsi-SQEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f49158cb', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:07:05.604628 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:07:05.604645 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46815659', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:07:05.604660 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:07:05.604675 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:07:42.240301 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs', 'dm-uuid-CRYPT-LUKS2-46d73a0b76ab4c4290e0cf88eb28d186-EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:07:42.240438 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:07:42.240457 | orchestrator | 2026-04-28 06:07:42.240470 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-28 06:07:42.240482 | orchestrator | Tuesday 28 April 2026 06:07:06 +0000 (0:00:01.487) 0:51:40.174 ********* 2026-04-28 06:07:42.240506 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:07:42.241290 | orchestrator | 2026-04-28 06:07:42.241311 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-28 06:07:42.241323 | orchestrator | Tuesday 28 April 2026 06:07:08 +0000 (0:00:01.500) 0:51:41.674 ********* 2026-04-28 06:07:42.241334 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:07:42.241345 | orchestrator | 2026-04-28 06:07:42.241356 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 06:07:42.241366 | orchestrator | Tuesday 28 April 2026 06:07:09 +0000 (0:00:01.161) 0:51:42.836 ********* 2026-04-28 06:07:42.241377 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:07:42.241388 | orchestrator | 2026-04-28 06:07:42.241400 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 06:07:42.241419 | orchestrator | Tuesday 28 April 2026 06:07:11 +0000 (0:00:01.609) 0:51:44.446 ********* 2026-04-28 06:07:42.241437 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:07:42.241455 | orchestrator | 2026-04-28 06:07:42.241474 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 06:07:42.241493 | orchestrator | Tuesday 28 April 2026 06:07:12 +0000 (0:00:01.128) 0:51:45.575 ********* 2026-04-28 06:07:42.241515 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:07:42.241527 | orchestrator | 2026-04-28 06:07:42.241538 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 06:07:42.241553 | orchestrator | Tuesday 28 April 2026 06:07:13 +0000 (0:00:01.257) 0:51:46.832 ********* 2026-04-28 06:07:42.241571 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:07:42.241590 | orchestrator | 2026-04-28 06:07:42.241610 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-28 06:07:42.241621 | orchestrator | Tuesday 28 April 2026 06:07:14 +0000 (0:00:01.152) 0:51:47.984 ********* 2026-04-28 06:07:42.241632 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-0) 2026-04-28 06:07:42.241643 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-1) 2026-04-28 06:07:42.241654 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-2) 2026-04-28 06:07:42.241665 | orchestrator | 2026-04-28 06:07:42.241676 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-28 06:07:42.241686 | orchestrator | Tuesday 28 April 2026 06:07:16 +0000 (0:00:02.159) 0:51:50.144 ********* 2026-04-28 06:07:42.241697 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-28 06:07:42.241709 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-28 06:07:42.241719 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-28 06:07:42.241730 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:07:42.241740 | orchestrator | 2026-04-28 06:07:42.241751 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-28 06:07:42.241762 | orchestrator | Tuesday 28 April 2026 06:07:17 +0000 (0:00:01.187) 0:51:51.332 ********* 2026-04-28 06:07:42.241800 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-4 2026-04-28 06:07:42.241813 | orchestrator | 2026-04-28 06:07:42.241824 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 06:07:42.241836 | orchestrator | Tuesday 28 April 2026 06:07:19 +0000 (0:00:01.289) 0:51:52.621 ********* 2026-04-28 06:07:42.241847 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:07:42.241858 | orchestrator | 2026-04-28 06:07:42.241892 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 06:07:42.241912 | orchestrator | Tuesday 28 April 2026 06:07:20 +0000 (0:00:01.178) 0:51:53.800 ********* 2026-04-28 06:07:42.241951 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:07:42.241962 | orchestrator | 2026-04-28 06:07:42.241973 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 06:07:42.241984 | orchestrator | Tuesday 28 April 2026 06:07:21 +0000 (0:00:01.165) 0:51:54.965 ********* 2026-04-28 06:07:42.241995 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:07:42.242005 | orchestrator | 2026-04-28 06:07:42.242069 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 06:07:42.242083 | orchestrator | Tuesday 28 April 2026 06:07:22 +0000 (0:00:01.149) 0:51:56.115 ********* 2026-04-28 06:07:42.242093 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:07:42.242104 | orchestrator | 2026-04-28 06:07:42.242115 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 06:07:42.242125 | orchestrator | Tuesday 28 April 2026 06:07:23 +0000 (0:00:01.235) 0:51:57.350 ********* 2026-04-28 06:07:42.242136 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-28 06:07:42.242168 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-28 06:07:42.242180 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-28 06:07:42.242191 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:07:42.242201 | orchestrator | 2026-04-28 06:07:42.242217 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 06:07:42.242236 | orchestrator | Tuesday 28 April 2026 06:07:25 +0000 (0:00:01.470) 0:51:58.821 ********* 2026-04-28 06:07:42.242255 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-28 06:07:42.242276 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-28 06:07:42.242296 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-28 06:07:42.242308 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:07:42.242318 | orchestrator | 2026-04-28 06:07:42.242329 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 06:07:42.242345 | orchestrator | Tuesday 28 April 2026 06:07:26 +0000 (0:00:01.403) 0:52:00.225 ********* 2026-04-28 06:07:42.242364 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-28 06:07:42.242383 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-28 06:07:42.242402 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-28 06:07:42.242420 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:07:42.242435 | orchestrator | 2026-04-28 06:07:42.242446 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 06:07:42.242457 | orchestrator | Tuesday 28 April 2026 06:07:28 +0000 (0:00:01.416) 0:52:01.641 ********* 2026-04-28 06:07:42.242467 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:07:42.242477 | orchestrator | 2026-04-28 06:07:42.242488 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 06:07:42.242505 | orchestrator | Tuesday 28 April 2026 06:07:29 +0000 (0:00:01.169) 0:52:02.811 ********* 2026-04-28 06:07:42.242523 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-28 06:07:42.242550 | orchestrator | 2026-04-28 06:07:42.242571 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-28 06:07:42.242605 | orchestrator | Tuesday 28 April 2026 06:07:30 +0000 (0:00:01.339) 0:52:04.150 ********* 2026-04-28 06:07:42.242623 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:07:42.242640 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:07:42.242658 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:07:42.242677 | orchestrator | ok: [testbed-node-4 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 06:07:42.242695 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-4) 2026-04-28 06:07:42.242713 | orchestrator | ok: [testbed-node-4 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 06:07:42.242730 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 06:07:42.242747 | orchestrator | 2026-04-28 06:07:42.242765 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-28 06:07:42.242783 | orchestrator | Tuesday 28 April 2026 06:07:32 +0000 (0:00:02.223) 0:52:06.373 ********* 2026-04-28 06:07:42.242801 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:07:42.242821 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:07:42.242838 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:07:42.242856 | orchestrator | ok: [testbed-node-4 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 06:07:42.242875 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-4) 2026-04-28 06:07:42.242894 | orchestrator | ok: [testbed-node-4 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 06:07:42.242911 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 06:07:42.242952 | orchestrator | 2026-04-28 06:07:42.242964 | orchestrator | TASK [Prevent restart from the packaging] ************************************** 2026-04-28 06:07:42.242975 | orchestrator | Tuesday 28 April 2026 06:07:36 +0000 (0:00:03.212) 0:52:09.586 ********* 2026-04-28 06:07:42.242986 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:07:42.242997 | orchestrator | 2026-04-28 06:07:42.243007 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 06:07:42.243018 | orchestrator | Tuesday 28 April 2026 06:07:37 +0000 (0:00:01.088) 0:52:10.675 ********* 2026-04-28 06:07:42.243038 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-4 2026-04-28 06:07:42.243049 | orchestrator | 2026-04-28 06:07:42.243059 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 06:07:42.243070 | orchestrator | Tuesday 28 April 2026 06:07:38 +0000 (0:00:01.152) 0:52:11.828 ********* 2026-04-28 06:07:42.243081 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-4 2026-04-28 06:07:42.243091 | orchestrator | 2026-04-28 06:07:42.243102 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 06:07:42.243113 | orchestrator | Tuesday 28 April 2026 06:07:39 +0000 (0:00:01.098) 0:52:12.927 ********* 2026-04-28 06:07:42.243123 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:07:42.243133 | orchestrator | 2026-04-28 06:07:42.243144 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 06:07:42.243155 | orchestrator | Tuesday 28 April 2026 06:07:40 +0000 (0:00:01.117) 0:52:14.045 ********* 2026-04-28 06:07:42.243165 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:07:42.243176 | orchestrator | 2026-04-28 06:07:42.243187 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 06:07:42.243209 | orchestrator | Tuesday 28 April 2026 06:07:42 +0000 (0:00:01.569) 0:52:15.615 ********* 2026-04-28 06:08:32.357537 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:08:32.357747 | orchestrator | 2026-04-28 06:08:32.357770 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 06:08:32.357810 | orchestrator | Tuesday 28 April 2026 06:07:43 +0000 (0:00:01.561) 0:52:17.176 ********* 2026-04-28 06:08:32.357822 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:08:32.357833 | orchestrator | 2026-04-28 06:08:32.357845 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 06:08:32.357856 | orchestrator | Tuesday 28 April 2026 06:07:45 +0000 (0:00:01.489) 0:52:18.666 ********* 2026-04-28 06:08:32.357867 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.357878 | orchestrator | 2026-04-28 06:08:32.357889 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 06:08:32.357900 | orchestrator | Tuesday 28 April 2026 06:07:46 +0000 (0:00:01.120) 0:52:19.787 ********* 2026-04-28 06:08:32.357911 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.357922 | orchestrator | 2026-04-28 06:08:32.357933 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 06:08:32.357943 | orchestrator | Tuesday 28 April 2026 06:07:47 +0000 (0:00:01.153) 0:52:20.940 ********* 2026-04-28 06:08:32.357954 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.357965 | orchestrator | 2026-04-28 06:08:32.357975 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 06:08:32.357986 | orchestrator | Tuesday 28 April 2026 06:07:48 +0000 (0:00:01.117) 0:52:22.058 ********* 2026-04-28 06:08:32.357997 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:08:32.358007 | orchestrator | 2026-04-28 06:08:32.358084 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 06:08:32.358098 | orchestrator | Tuesday 28 April 2026 06:07:50 +0000 (0:00:01.565) 0:52:23.624 ********* 2026-04-28 06:08:32.358110 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:08:32.358122 | orchestrator | 2026-04-28 06:08:32.358136 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 06:08:32.358148 | orchestrator | Tuesday 28 April 2026 06:07:51 +0000 (0:00:01.515) 0:52:25.139 ********* 2026-04-28 06:08:32.358161 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.358173 | orchestrator | 2026-04-28 06:08:32.358186 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 06:08:32.358198 | orchestrator | Tuesday 28 April 2026 06:07:52 +0000 (0:00:01.119) 0:52:26.259 ********* 2026-04-28 06:08:32.358211 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.358223 | orchestrator | 2026-04-28 06:08:32.358235 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 06:08:32.358248 | orchestrator | Tuesday 28 April 2026 06:07:53 +0000 (0:00:01.107) 0:52:27.366 ********* 2026-04-28 06:08:32.358261 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:08:32.358273 | orchestrator | 2026-04-28 06:08:32.358286 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 06:08:32.358298 | orchestrator | Tuesday 28 April 2026 06:07:55 +0000 (0:00:01.144) 0:52:28.511 ********* 2026-04-28 06:08:32.358310 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:08:32.358322 | orchestrator | 2026-04-28 06:08:32.358334 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 06:08:32.358347 | orchestrator | Tuesday 28 April 2026 06:07:56 +0000 (0:00:01.156) 0:52:29.668 ********* 2026-04-28 06:08:32.358359 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:08:32.358373 | orchestrator | 2026-04-28 06:08:32.358385 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 06:08:32.358397 | orchestrator | Tuesday 28 April 2026 06:07:57 +0000 (0:00:01.144) 0:52:30.812 ********* 2026-04-28 06:08:32.358410 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.358423 | orchestrator | 2026-04-28 06:08:32.358436 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 06:08:32.358446 | orchestrator | Tuesday 28 April 2026 06:07:58 +0000 (0:00:01.155) 0:52:31.968 ********* 2026-04-28 06:08:32.358457 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.358468 | orchestrator | 2026-04-28 06:08:32.358479 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 06:08:32.358498 | orchestrator | Tuesday 28 April 2026 06:07:59 +0000 (0:00:01.132) 0:52:33.100 ********* 2026-04-28 06:08:32.358509 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.358519 | orchestrator | 2026-04-28 06:08:32.358531 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 06:08:32.358541 | orchestrator | Tuesday 28 April 2026 06:08:00 +0000 (0:00:01.154) 0:52:34.255 ********* 2026-04-28 06:08:32.358552 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:08:32.358563 | orchestrator | 2026-04-28 06:08:32.358574 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 06:08:32.358585 | orchestrator | Tuesday 28 April 2026 06:08:02 +0000 (0:00:01.161) 0:52:35.417 ********* 2026-04-28 06:08:32.358595 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:08:32.358606 | orchestrator | 2026-04-28 06:08:32.358631 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-28 06:08:32.358642 | orchestrator | Tuesday 28 April 2026 06:08:03 +0000 (0:00:01.167) 0:52:36.585 ********* 2026-04-28 06:08:32.358653 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.358664 | orchestrator | 2026-04-28 06:08:32.358675 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-28 06:08:32.358685 | orchestrator | Tuesday 28 April 2026 06:08:04 +0000 (0:00:01.188) 0:52:37.773 ********* 2026-04-28 06:08:32.358722 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.358734 | orchestrator | 2026-04-28 06:08:32.358744 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-28 06:08:32.358755 | orchestrator | Tuesday 28 April 2026 06:08:05 +0000 (0:00:01.116) 0:52:38.890 ********* 2026-04-28 06:08:32.358766 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.358777 | orchestrator | 2026-04-28 06:08:32.358787 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-28 06:08:32.358798 | orchestrator | Tuesday 28 April 2026 06:08:06 +0000 (0:00:01.107) 0:52:39.997 ********* 2026-04-28 06:08:32.358809 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.358819 | orchestrator | 2026-04-28 06:08:32.358830 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-28 06:08:32.358859 | orchestrator | Tuesday 28 April 2026 06:08:07 +0000 (0:00:01.142) 0:52:41.139 ********* 2026-04-28 06:08:32.358871 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.358881 | orchestrator | 2026-04-28 06:08:32.358892 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-28 06:08:32.358903 | orchestrator | Tuesday 28 April 2026 06:08:08 +0000 (0:00:01.139) 0:52:42.279 ********* 2026-04-28 06:08:32.358913 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.358924 | orchestrator | 2026-04-28 06:08:32.358935 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-28 06:08:32.358946 | orchestrator | Tuesday 28 April 2026 06:08:10 +0000 (0:00:01.150) 0:52:43.430 ********* 2026-04-28 06:08:32.358956 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.358967 | orchestrator | 2026-04-28 06:08:32.358978 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-28 06:08:32.358989 | orchestrator | Tuesday 28 April 2026 06:08:11 +0000 (0:00:01.117) 0:52:44.548 ********* 2026-04-28 06:08:32.359000 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.359010 | orchestrator | 2026-04-28 06:08:32.359021 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-28 06:08:32.359032 | orchestrator | Tuesday 28 April 2026 06:08:12 +0000 (0:00:01.138) 0:52:45.686 ********* 2026-04-28 06:08:32.359042 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.359053 | orchestrator | 2026-04-28 06:08:32.359063 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-28 06:08:32.359074 | orchestrator | Tuesday 28 April 2026 06:08:13 +0000 (0:00:01.109) 0:52:46.796 ********* 2026-04-28 06:08:32.359085 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.359095 | orchestrator | 2026-04-28 06:08:32.359106 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-28 06:08:32.359124 | orchestrator | Tuesday 28 April 2026 06:08:14 +0000 (0:00:01.119) 0:52:47.915 ********* 2026-04-28 06:08:32.359135 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.359145 | orchestrator | 2026-04-28 06:08:32.359156 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-28 06:08:32.359167 | orchestrator | Tuesday 28 April 2026 06:08:15 +0000 (0:00:01.146) 0:52:49.062 ********* 2026-04-28 06:08:32.359178 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.359189 | orchestrator | 2026-04-28 06:08:32.359199 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-28 06:08:32.359210 | orchestrator | Tuesday 28 April 2026 06:08:16 +0000 (0:00:01.120) 0:52:50.182 ********* 2026-04-28 06:08:32.359221 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:08:32.359232 | orchestrator | 2026-04-28 06:08:32.359242 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-28 06:08:32.359253 | orchestrator | Tuesday 28 April 2026 06:08:18 +0000 (0:00:01.899) 0:52:52.081 ********* 2026-04-28 06:08:32.359264 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:08:32.359275 | orchestrator | 2026-04-28 06:08:32.359285 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-28 06:08:32.359296 | orchestrator | Tuesday 28 April 2026 06:08:21 +0000 (0:00:02.334) 0:52:54.416 ********* 2026-04-28 06:08:32.359307 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-4 2026-04-28 06:08:32.359318 | orchestrator | 2026-04-28 06:08:32.359329 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-28 06:08:32.359340 | orchestrator | Tuesday 28 April 2026 06:08:22 +0000 (0:00:01.115) 0:52:55.531 ********* 2026-04-28 06:08:32.359351 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.359362 | orchestrator | 2026-04-28 06:08:32.359372 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-28 06:08:32.359383 | orchestrator | Tuesday 28 April 2026 06:08:23 +0000 (0:00:01.124) 0:52:56.656 ********* 2026-04-28 06:08:32.359394 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.359404 | orchestrator | 2026-04-28 06:08:32.359415 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-28 06:08:32.359426 | orchestrator | Tuesday 28 April 2026 06:08:24 +0000 (0:00:01.116) 0:52:57.773 ********* 2026-04-28 06:08:32.359437 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-28 06:08:32.359448 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-28 06:08:32.359458 | orchestrator | 2026-04-28 06:08:32.359469 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-28 06:08:32.359480 | orchestrator | Tuesday 28 April 2026 06:08:26 +0000 (0:00:01.795) 0:52:59.568 ********* 2026-04-28 06:08:32.359490 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:08:32.359501 | orchestrator | 2026-04-28 06:08:32.359512 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-28 06:08:32.359528 | orchestrator | Tuesday 28 April 2026 06:08:27 +0000 (0:00:01.450) 0:53:01.019 ********* 2026-04-28 06:08:32.359539 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.359550 | orchestrator | 2026-04-28 06:08:32.359561 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-28 06:08:32.359571 | orchestrator | Tuesday 28 April 2026 06:08:28 +0000 (0:00:01.174) 0:53:02.194 ********* 2026-04-28 06:08:32.359607 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.359619 | orchestrator | 2026-04-28 06:08:32.359630 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-28 06:08:32.359641 | orchestrator | Tuesday 28 April 2026 06:08:29 +0000 (0:00:01.156) 0:53:03.350 ********* 2026-04-28 06:08:32.359651 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:08:32.359662 | orchestrator | 2026-04-28 06:08:32.359673 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-28 06:08:32.359684 | orchestrator | Tuesday 28 April 2026 06:08:31 +0000 (0:00:01.254) 0:53:04.604 ********* 2026-04-28 06:08:32.359740 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-4 2026-04-28 06:08:32.359752 | orchestrator | 2026-04-28 06:08:32.359763 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-28 06:08:32.359799 | orchestrator | Tuesday 28 April 2026 06:08:32 +0000 (0:00:01.127) 0:53:05.732 ********* 2026-04-28 06:09:18.221930 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:09:18.222108 | orchestrator | 2026-04-28 06:09:18.222137 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-28 06:09:18.222160 | orchestrator | Tuesday 28 April 2026 06:08:34 +0000 (0:00:01.727) 0:53:07.459 ********* 2026-04-28 06:09:18.222180 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-28 06:09:18.222201 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-28 06:09:18.222221 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-28 06:09:18.222240 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.222261 | orchestrator | 2026-04-28 06:09:18.222282 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-28 06:09:18.222303 | orchestrator | Tuesday 28 April 2026 06:08:35 +0000 (0:00:01.324) 0:53:08.784 ********* 2026-04-28 06:09:18.222324 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.222338 | orchestrator | 2026-04-28 06:09:18.222350 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-28 06:09:18.222361 | orchestrator | Tuesday 28 April 2026 06:08:36 +0000 (0:00:01.108) 0:53:09.893 ********* 2026-04-28 06:09:18.222372 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.222383 | orchestrator | 2026-04-28 06:09:18.222394 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-28 06:09:18.222405 | orchestrator | Tuesday 28 April 2026 06:08:37 +0000 (0:00:01.170) 0:53:11.063 ********* 2026-04-28 06:09:18.222416 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.222427 | orchestrator | 2026-04-28 06:09:18.222438 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-28 06:09:18.222449 | orchestrator | Tuesday 28 April 2026 06:08:38 +0000 (0:00:01.164) 0:53:12.228 ********* 2026-04-28 06:09:18.222460 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.222471 | orchestrator | 2026-04-28 06:09:18.222481 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-28 06:09:18.222527 | orchestrator | Tuesday 28 April 2026 06:08:40 +0000 (0:00:01.247) 0:53:13.476 ********* 2026-04-28 06:09:18.222542 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.222554 | orchestrator | 2026-04-28 06:09:18.222565 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-28 06:09:18.222576 | orchestrator | Tuesday 28 April 2026 06:08:41 +0000 (0:00:01.181) 0:53:14.658 ********* 2026-04-28 06:09:18.222587 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:09:18.222598 | orchestrator | 2026-04-28 06:09:18.222609 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-28 06:09:18.222620 | orchestrator | Tuesday 28 April 2026 06:08:43 +0000 (0:00:02.454) 0:53:17.112 ********* 2026-04-28 06:09:18.222631 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:09:18.222641 | orchestrator | 2026-04-28 06:09:18.222652 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-28 06:09:18.222663 | orchestrator | Tuesday 28 April 2026 06:08:44 +0000 (0:00:01.172) 0:53:18.285 ********* 2026-04-28 06:09:18.222674 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-4 2026-04-28 06:09:18.222685 | orchestrator | 2026-04-28 06:09:18.222696 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-28 06:09:18.222707 | orchestrator | Tuesday 28 April 2026 06:08:46 +0000 (0:00:01.139) 0:53:19.424 ********* 2026-04-28 06:09:18.222718 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.222729 | orchestrator | 2026-04-28 06:09:18.222767 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-28 06:09:18.222779 | orchestrator | Tuesday 28 April 2026 06:08:47 +0000 (0:00:01.201) 0:53:20.625 ********* 2026-04-28 06:09:18.222790 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.222800 | orchestrator | 2026-04-28 06:09:18.222811 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-28 06:09:18.222822 | orchestrator | Tuesday 28 April 2026 06:08:48 +0000 (0:00:01.119) 0:53:21.745 ********* 2026-04-28 06:09:18.222833 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.222843 | orchestrator | 2026-04-28 06:09:18.222854 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-28 06:09:18.222865 | orchestrator | Tuesday 28 April 2026 06:08:49 +0000 (0:00:01.136) 0:53:22.882 ********* 2026-04-28 06:09:18.222876 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.222886 | orchestrator | 2026-04-28 06:09:18.222897 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-28 06:09:18.222908 | orchestrator | Tuesday 28 April 2026 06:08:50 +0000 (0:00:01.238) 0:53:24.120 ********* 2026-04-28 06:09:18.222918 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.222929 | orchestrator | 2026-04-28 06:09:18.222954 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-28 06:09:18.222965 | orchestrator | Tuesday 28 April 2026 06:08:51 +0000 (0:00:01.137) 0:53:25.257 ********* 2026-04-28 06:09:18.222976 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.222986 | orchestrator | 2026-04-28 06:09:18.222997 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-28 06:09:18.223008 | orchestrator | Tuesday 28 April 2026 06:08:53 +0000 (0:00:01.136) 0:53:26.394 ********* 2026-04-28 06:09:18.223019 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.223030 | orchestrator | 2026-04-28 06:09:18.223040 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-28 06:09:18.223051 | orchestrator | Tuesday 28 April 2026 06:08:54 +0000 (0:00:01.166) 0:53:27.560 ********* 2026-04-28 06:09:18.223062 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.223072 | orchestrator | 2026-04-28 06:09:18.223083 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-28 06:09:18.223093 | orchestrator | Tuesday 28 April 2026 06:08:55 +0000 (0:00:01.148) 0:53:28.709 ********* 2026-04-28 06:09:18.223104 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:09:18.223115 | orchestrator | 2026-04-28 06:09:18.223126 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-28 06:09:18.223157 | orchestrator | Tuesday 28 April 2026 06:08:56 +0000 (0:00:01.220) 0:53:29.929 ********* 2026-04-28 06:09:18.223169 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-4 2026-04-28 06:09:18.223181 | orchestrator | 2026-04-28 06:09:18.223198 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-28 06:09:18.223216 | orchestrator | Tuesday 28 April 2026 06:08:57 +0000 (0:00:01.197) 0:53:31.126 ********* 2026-04-28 06:09:18.223234 | orchestrator | ok: [testbed-node-4] => (item=/etc/ceph) 2026-04-28 06:09:18.223252 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/) 2026-04-28 06:09:18.223269 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/mon) 2026-04-28 06:09:18.223287 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/osd) 2026-04-28 06:09:18.223303 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/mds) 2026-04-28 06:09:18.223321 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/tmp) 2026-04-28 06:09:18.223338 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/crash) 2026-04-28 06:09:18.223355 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/radosgw) 2026-04-28 06:09:18.223372 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-28 06:09:18.223390 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-28 06:09:18.223409 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-28 06:09:18.223473 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-28 06:09:18.223487 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-28 06:09:18.223532 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-28 06:09:18.223544 | orchestrator | ok: [testbed-node-4] => (item=/var/run/ceph) 2026-04-28 06:09:18.223555 | orchestrator | ok: [testbed-node-4] => (item=/var/log/ceph) 2026-04-28 06:09:18.223566 | orchestrator | 2026-04-28 06:09:18.223576 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-28 06:09:18.223587 | orchestrator | Tuesday 28 April 2026 06:09:04 +0000 (0:00:06.412) 0:53:37.539 ********* 2026-04-28 06:09:18.223598 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-4 2026-04-28 06:09:18.223609 | orchestrator | 2026-04-28 06:09:18.223619 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-28 06:09:18.223630 | orchestrator | Tuesday 28 April 2026 06:09:05 +0000 (0:00:01.124) 0:53:38.664 ********* 2026-04-28 06:09:18.223641 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-28 06:09:18.223653 | orchestrator | 2026-04-28 06:09:18.223664 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-28 06:09:18.223674 | orchestrator | Tuesday 28 April 2026 06:09:06 +0000 (0:00:01.556) 0:53:40.221 ********* 2026-04-28 06:09:18.223685 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-28 06:09:18.223696 | orchestrator | 2026-04-28 06:09:18.223707 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-28 06:09:18.223718 | orchestrator | Tuesday 28 April 2026 06:09:08 +0000 (0:00:02.047) 0:53:42.268 ********* 2026-04-28 06:09:18.223728 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.223739 | orchestrator | 2026-04-28 06:09:18.223749 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-28 06:09:18.223760 | orchestrator | Tuesday 28 April 2026 06:09:10 +0000 (0:00:01.181) 0:53:43.449 ********* 2026-04-28 06:09:18.223771 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.223782 | orchestrator | 2026-04-28 06:09:18.223792 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-28 06:09:18.223803 | orchestrator | Tuesday 28 April 2026 06:09:11 +0000 (0:00:01.113) 0:53:44.563 ********* 2026-04-28 06:09:18.223814 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.223825 | orchestrator | 2026-04-28 06:09:18.223844 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-28 06:09:18.223869 | orchestrator | Tuesday 28 April 2026 06:09:12 +0000 (0:00:01.142) 0:53:45.706 ********* 2026-04-28 06:09:18.223895 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.223914 | orchestrator | 2026-04-28 06:09:18.223932 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-28 06:09:18.223951 | orchestrator | Tuesday 28 April 2026 06:09:13 +0000 (0:00:01.173) 0:53:46.879 ********* 2026-04-28 06:09:18.223968 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.223986 | orchestrator | 2026-04-28 06:09:18.224016 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-28 06:09:18.224035 | orchestrator | Tuesday 28 April 2026 06:09:14 +0000 (0:00:01.158) 0:53:48.038 ********* 2026-04-28 06:09:18.224056 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.224076 | orchestrator | 2026-04-28 06:09:18.224096 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-28 06:09:18.224108 | orchestrator | Tuesday 28 April 2026 06:09:15 +0000 (0:00:01.123) 0:53:49.162 ********* 2026-04-28 06:09:18.224119 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.224130 | orchestrator | 2026-04-28 06:09:18.224140 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-28 06:09:18.224162 | orchestrator | Tuesday 28 April 2026 06:09:16 +0000 (0:00:01.142) 0:53:50.305 ********* 2026-04-28 06:09:18.224172 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.224183 | orchestrator | 2026-04-28 06:09:18.224194 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-28 06:09:18.224205 | orchestrator | Tuesday 28 April 2026 06:09:18 +0000 (0:00:01.115) 0:53:51.421 ********* 2026-04-28 06:09:18.224216 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:09:18.224227 | orchestrator | 2026-04-28 06:09:18.224249 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-28 06:10:14.291861 | orchestrator | Tuesday 28 April 2026 06:09:19 +0000 (0:00:01.178) 0:53:52.600 ********* 2026-04-28 06:10:14.291980 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:10:14.292016 | orchestrator | 2026-04-28 06:10:14.292029 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-28 06:10:14.292054 | orchestrator | Tuesday 28 April 2026 06:09:20 +0000 (0:00:01.135) 0:53:53.736 ********* 2026-04-28 06:10:14.292065 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:10:14.292076 | orchestrator | 2026-04-28 06:10:14.292087 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-28 06:10:14.292098 | orchestrator | Tuesday 28 April 2026 06:09:21 +0000 (0:00:01.134) 0:53:54.870 ********* 2026-04-28 06:10:14.292109 | orchestrator | changed: [testbed-node-4 -> testbed-node-2(192.168.16.12)] 2026-04-28 06:10:14.292120 | orchestrator | 2026-04-28 06:10:14.292131 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-28 06:10:14.292142 | orchestrator | Tuesday 28 April 2026 06:09:26 +0000 (0:00:04.633) 0:53:59.504 ********* 2026-04-28 06:10:14.292153 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-28 06:10:14.292165 | orchestrator | 2026-04-28 06:10:14.292176 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-28 06:10:14.292187 | orchestrator | Tuesday 28 April 2026 06:09:27 +0000 (0:00:01.207) 0:54:00.712 ********* 2026-04-28 06:10:14.292200 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log'}]) 2026-04-28 06:10:14.292214 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.14:8081'}]) 2026-04-28 06:10:14.292226 | orchestrator | 2026-04-28 06:10:14.292237 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-28 06:10:14.292248 | orchestrator | Tuesday 28 April 2026 06:09:32 +0000 (0:00:05.269) 0:54:05.982 ********* 2026-04-28 06:10:14.292258 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:10:14.292295 | orchestrator | 2026-04-28 06:10:14.292306 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-28 06:10:14.292317 | orchestrator | Tuesday 28 April 2026 06:09:33 +0000 (0:00:01.128) 0:54:07.111 ********* 2026-04-28 06:10:14.292328 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:10:14.292339 | orchestrator | 2026-04-28 06:10:14.292350 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 06:10:14.292361 | orchestrator | Tuesday 28 April 2026 06:09:34 +0000 (0:00:01.135) 0:54:08.246 ********* 2026-04-28 06:10:14.292371 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:10:14.292382 | orchestrator | 2026-04-28 06:10:14.292393 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 06:10:14.292432 | orchestrator | Tuesday 28 April 2026 06:09:36 +0000 (0:00:01.155) 0:54:09.402 ********* 2026-04-28 06:10:14.292445 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:10:14.292458 | orchestrator | 2026-04-28 06:10:14.292470 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 06:10:14.292483 | orchestrator | Tuesday 28 April 2026 06:09:37 +0000 (0:00:01.134) 0:54:10.537 ********* 2026-04-28 06:10:14.292495 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:10:14.292507 | orchestrator | 2026-04-28 06:10:14.292519 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 06:10:14.292532 | orchestrator | Tuesday 28 April 2026 06:09:38 +0000 (0:00:01.149) 0:54:11.687 ********* 2026-04-28 06:10:14.292544 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:10:14.292558 | orchestrator | 2026-04-28 06:10:14.292568 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 06:10:14.292579 | orchestrator | Tuesday 28 April 2026 06:09:39 +0000 (0:00:01.255) 0:54:12.942 ********* 2026-04-28 06:10:14.292605 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-28 06:10:14.292616 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-28 06:10:14.292627 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-28 06:10:14.292637 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:10:14.292648 | orchestrator | 2026-04-28 06:10:14.292659 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 06:10:14.292669 | orchestrator | Tuesday 28 April 2026 06:09:40 +0000 (0:00:01.438) 0:54:14.381 ********* 2026-04-28 06:10:14.292680 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-28 06:10:14.292691 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-28 06:10:14.292701 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-28 06:10:14.292712 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:10:14.292723 | orchestrator | 2026-04-28 06:10:14.292733 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 06:10:14.292744 | orchestrator | Tuesday 28 April 2026 06:09:42 +0000 (0:00:01.506) 0:54:15.887 ********* 2026-04-28 06:10:14.292755 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-28 06:10:14.292765 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-28 06:10:14.292776 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-28 06:10:14.292802 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:10:14.292813 | orchestrator | 2026-04-28 06:10:14.292824 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 06:10:14.292835 | orchestrator | Tuesday 28 April 2026 06:09:43 +0000 (0:00:01.414) 0:54:17.302 ********* 2026-04-28 06:10:14.292845 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:10:14.292856 | orchestrator | 2026-04-28 06:10:14.292867 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 06:10:14.292877 | orchestrator | Tuesday 28 April 2026 06:09:45 +0000 (0:00:01.186) 0:54:18.488 ********* 2026-04-28 06:10:14.292888 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-28 06:10:14.292899 | orchestrator | 2026-04-28 06:10:14.292909 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-28 06:10:14.292920 | orchestrator | Tuesday 28 April 2026 06:09:46 +0000 (0:00:01.395) 0:54:19.884 ********* 2026-04-28 06:10:14.292930 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:10:14.292941 | orchestrator | 2026-04-28 06:10:14.292952 | orchestrator | TASK [ceph-mds : Include create_mds_filesystems.yml] *************************** 2026-04-28 06:10:14.292962 | orchestrator | Tuesday 28 April 2026 06:09:48 +0000 (0:00:02.346) 0:54:22.230 ********* 2026-04-28 06:10:14.292973 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:10:14.292983 | orchestrator | 2026-04-28 06:10:14.292994 | orchestrator | TASK [ceph-mds : Include common.yml] ******************************************* 2026-04-28 06:10:14.293004 | orchestrator | Tuesday 28 April 2026 06:09:49 +0000 (0:00:01.124) 0:54:23.355 ********* 2026-04-28 06:10:14.293023 | orchestrator | included: /ansible/roles/ceph-mds/tasks/common.yml for testbed-node-4 2026-04-28 06:10:14.293034 | orchestrator | 2026-04-28 06:10:14.293049 | orchestrator | TASK [ceph-mds : Create bootstrap-mds and mds directories] ********************* 2026-04-28 06:10:14.293066 | orchestrator | Tuesday 28 April 2026 06:09:51 +0000 (0:00:01.476) 0:54:24.832 ********* 2026-04-28 06:10:14.293085 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mds/) 2026-04-28 06:10:14.293103 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/mds/ceph-testbed-node-4) 2026-04-28 06:10:14.293121 | orchestrator | 2026-04-28 06:10:14.293138 | orchestrator | TASK [ceph-mds : Get keys from monitors] *************************************** 2026-04-28 06:10:14.293156 | orchestrator | Tuesday 28 April 2026 06:09:53 +0000 (0:00:01.883) 0:54:26.715 ********* 2026-04-28 06:10:14.293174 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 06:10:14.293192 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-28 06:10:14.293204 | orchestrator | ok: [testbed-node-4 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-28 06:10:14.293215 | orchestrator | 2026-04-28 06:10:14.293225 | orchestrator | TASK [ceph-mds : Copy ceph key(s) if needed] *********************************** 2026-04-28 06:10:14.293236 | orchestrator | Tuesday 28 April 2026 06:09:56 +0000 (0:00:03.075) 0:54:29.792 ********* 2026-04-28 06:10:14.293246 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-28 06:10:14.293257 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-28 06:10:14.293303 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:10:14.293317 | orchestrator | 2026-04-28 06:10:14.293328 | orchestrator | TASK [ceph-mds : Create mds keyring] ******************************************* 2026-04-28 06:10:14.293339 | orchestrator | Tuesday 28 April 2026 06:09:58 +0000 (0:00:01.915) 0:54:31.708 ********* 2026-04-28 06:10:14.293349 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:10:14.293360 | orchestrator | 2026-04-28 06:10:14.293370 | orchestrator | TASK [ceph-mds : Non_containerized.yml] **************************************** 2026-04-28 06:10:14.293381 | orchestrator | Tuesday 28 April 2026 06:09:59 +0000 (0:00:01.545) 0:54:33.253 ********* 2026-04-28 06:10:14.293392 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:10:14.293402 | orchestrator | 2026-04-28 06:10:14.293413 | orchestrator | TASK [ceph-mds : Containerized.yml] ******************************************** 2026-04-28 06:10:14.293423 | orchestrator | Tuesday 28 April 2026 06:10:00 +0000 (0:00:01.111) 0:54:34.364 ********* 2026-04-28 06:10:14.293434 | orchestrator | included: /ansible/roles/ceph-mds/tasks/containerized.yml for testbed-node-4 2026-04-28 06:10:14.293446 | orchestrator | 2026-04-28 06:10:14.293457 | orchestrator | TASK [ceph-mds : Include_tasks systemd.yml] ************************************ 2026-04-28 06:10:14.293467 | orchestrator | Tuesday 28 April 2026 06:10:02 +0000 (0:00:01.465) 0:54:35.830 ********* 2026-04-28 06:10:14.293478 | orchestrator | included: /ansible/roles/ceph-mds/tasks/systemd.yml for testbed-node-4 2026-04-28 06:10:14.293489 | orchestrator | 2026-04-28 06:10:14.293499 | orchestrator | TASK [ceph-mds : Generate systemd unit file] *********************************** 2026-04-28 06:10:14.293510 | orchestrator | Tuesday 28 April 2026 06:10:04 +0000 (0:00:01.652) 0:54:37.483 ********* 2026-04-28 06:10:14.293520 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:10:14.293531 | orchestrator | 2026-04-28 06:10:14.293547 | orchestrator | TASK [ceph-mds : Generate systemd ceph-mds target file] ************************ 2026-04-28 06:10:14.293558 | orchestrator | Tuesday 28 April 2026 06:10:06 +0000 (0:00:02.050) 0:54:39.533 ********* 2026-04-28 06:10:14.293569 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:10:14.293582 | orchestrator | 2026-04-28 06:10:14.293601 | orchestrator | TASK [ceph-mds : Enable ceph-mds.target] *************************************** 2026-04-28 06:10:14.293620 | orchestrator | Tuesday 28 April 2026 06:10:08 +0000 (0:00:01.995) 0:54:41.529 ********* 2026-04-28 06:10:14.293640 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:10:14.293659 | orchestrator | 2026-04-28 06:10:14.293698 | orchestrator | TASK [ceph-mds : Systemd start mds container] ********************************** 2026-04-28 06:10:14.293716 | orchestrator | Tuesday 28 April 2026 06:10:10 +0000 (0:00:02.211) 0:54:43.740 ********* 2026-04-28 06:10:14.293745 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:10:14.293756 | orchestrator | 2026-04-28 06:10:14.293767 | orchestrator | TASK [ceph-mds : Wait for mds socket to exist] ********************************* 2026-04-28 06:10:14.293778 | orchestrator | Tuesday 28 April 2026 06:10:12 +0000 (0:00:02.223) 0:54:45.964 ********* 2026-04-28 06:10:14.293788 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:10:14.293799 | orchestrator | 2026-04-28 06:10:14.293810 | orchestrator | TASK [Restart ceph mds] ******************************************************** 2026-04-28 06:10:14.293820 | orchestrator | Tuesday 28 April 2026 06:10:14 +0000 (0:00:01.656) 0:54:47.620 ********* 2026-04-28 06:10:14.293842 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:10:48.648860 | orchestrator | 2026-04-28 06:10:48.649024 | orchestrator | TASK [Restart active mds] ****************************************************** 2026-04-28 06:10:48.649055 | orchestrator | Tuesday 28 April 2026 06:10:15 +0000 (0:00:01.106) 0:54:48.726 ********* 2026-04-28 06:10:48.649077 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:10:48.649098 | orchestrator | 2026-04-28 06:10:48.649112 | orchestrator | PLAY [Upgrade standbys ceph mdss cluster] ************************************** 2026-04-28 06:10:48.649123 | orchestrator | 2026-04-28 06:10:48.649134 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 06:10:48.649190 | orchestrator | Tuesday 28 April 2026 06:10:25 +0000 (0:00:09.774) 0:54:58.501 ********* 2026-04-28 06:10:48.649211 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-3, testbed-node-5 2026-04-28 06:10:48.649231 | orchestrator | 2026-04-28 06:10:48.649248 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-28 06:10:48.649267 | orchestrator | Tuesday 28 April 2026 06:10:26 +0000 (0:00:01.518) 0:55:00.020 ********* 2026-04-28 06:10:48.649286 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:10:48.649304 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:10:48.649321 | orchestrator | 2026-04-28 06:10:48.649340 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-28 06:10:48.649358 | orchestrator | Tuesday 28 April 2026 06:10:28 +0000 (0:00:01.615) 0:55:01.635 ********* 2026-04-28 06:10:48.649377 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:10:48.649396 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:10:48.649415 | orchestrator | 2026-04-28 06:10:48.649435 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 06:10:48.649454 | orchestrator | Tuesday 28 April 2026 06:10:29 +0000 (0:00:01.263) 0:55:02.899 ********* 2026-04-28 06:10:48.649473 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:10:48.649492 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:10:48.649511 | orchestrator | 2026-04-28 06:10:48.649531 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 06:10:48.649551 | orchestrator | Tuesday 28 April 2026 06:10:31 +0000 (0:00:01.583) 0:55:04.483 ********* 2026-04-28 06:10:48.649570 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:10:48.649590 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:10:48.649609 | orchestrator | 2026-04-28 06:10:48.649628 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-28 06:10:48.649646 | orchestrator | Tuesday 28 April 2026 06:10:32 +0000 (0:00:01.277) 0:55:05.761 ********* 2026-04-28 06:10:48.649665 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:10:48.649683 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:10:48.649701 | orchestrator | 2026-04-28 06:10:48.649720 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-28 06:10:48.649738 | orchestrator | Tuesday 28 April 2026 06:10:33 +0000 (0:00:01.224) 0:55:06.986 ********* 2026-04-28 06:10:48.649757 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:10:48.649776 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:10:48.649794 | orchestrator | 2026-04-28 06:10:48.649813 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-28 06:10:48.649831 | orchestrator | Tuesday 28 April 2026 06:10:34 +0000 (0:00:01.347) 0:55:08.333 ********* 2026-04-28 06:10:48.649850 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:10:48.649905 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:10:48.649924 | orchestrator | 2026-04-28 06:10:48.649942 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-28 06:10:48.649961 | orchestrator | Tuesday 28 April 2026 06:10:36 +0000 (0:00:01.255) 0:55:09.588 ********* 2026-04-28 06:10:48.649980 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:10:48.649999 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:10:48.650090 | orchestrator | 2026-04-28 06:10:48.650132 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-28 06:10:48.650194 | orchestrator | Tuesday 28 April 2026 06:10:37 +0000 (0:00:01.245) 0:55:10.834 ********* 2026-04-28 06:10:48.650212 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:10:48.650229 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:10:48.650248 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:10:48.650265 | orchestrator | 2026-04-28 06:10:48.650281 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-28 06:10:48.650298 | orchestrator | Tuesday 28 April 2026 06:10:39 +0000 (0:00:01.712) 0:55:12.547 ********* 2026-04-28 06:10:48.650316 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:10:48.650335 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:10:48.650353 | orchestrator | 2026-04-28 06:10:48.650371 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-28 06:10:48.650391 | orchestrator | Tuesday 28 April 2026 06:10:40 +0000 (0:00:01.404) 0:55:13.951 ********* 2026-04-28 06:10:48.650408 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:10:48.650425 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:10:48.650443 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:10:48.650460 | orchestrator | 2026-04-28 06:10:48.650478 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-28 06:10:48.650496 | orchestrator | Tuesday 28 April 2026 06:10:43 +0000 (0:00:03.246) 0:55:17.198 ********* 2026-04-28 06:10:48.650516 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-28 06:10:48.650536 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-28 06:10:48.650555 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-28 06:10:48.650574 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:10:48.650591 | orchestrator | 2026-04-28 06:10:48.650610 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-28 06:10:48.650630 | orchestrator | Tuesday 28 April 2026 06:10:45 +0000 (0:00:01.559) 0:55:18.757 ********* 2026-04-28 06:10:48.650676 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-28 06:10:48.650699 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-28 06:10:48.650719 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-28 06:10:48.650739 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:10:48.650757 | orchestrator | 2026-04-28 06:10:48.650776 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-28 06:10:48.650795 | orchestrator | Tuesday 28 April 2026 06:10:47 +0000 (0:00:01.989) 0:55:20.747 ********* 2026-04-28 06:10:48.650816 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 06:10:48.650904 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 06:10:48.650929 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 06:10:48.650947 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:10:48.650966 | orchestrator | 2026-04-28 06:10:48.650984 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-28 06:10:48.651003 | orchestrator | Tuesday 28 April 2026 06:10:48 +0000 (0:00:01.162) 0:55:21.910 ********* 2026-04-28 06:10:48.651025 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': 'e79a9ee6c12b', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-28 06:10:41.085106', 'end': '2026-04-28 06:10:41.127464', 'delta': '0:00:00.042358', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e79a9ee6c12b'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-28 06:10:48.651056 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': '00fb93644bb9', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-28 06:10:41.640294', 'end': '2026-04-28 06:10:41.687408', 'delta': '0:00:00.047114', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['00fb93644bb9'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-28 06:10:48.651091 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': '92b926b7d044', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-28 06:10:42.575430', 'end': '2026-04-28 06:10:42.627775', 'delta': '0:00:00.052345', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['92b926b7d044'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-28 06:11:09.221644 | orchestrator | 2026-04-28 06:11:09.221760 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-28 06:11:09.221803 | orchestrator | Tuesday 28 April 2026 06:10:49 +0000 (0:00:01.248) 0:55:23.158 ********* 2026-04-28 06:11:09.221834 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:11:09.221847 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:11:09.221869 | orchestrator | 2026-04-28 06:11:09.221880 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-28 06:11:09.221891 | orchestrator | Tuesday 28 April 2026 06:10:51 +0000 (0:00:01.830) 0:55:24.989 ********* 2026-04-28 06:11:09.221902 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:11:09.221913 | orchestrator | 2026-04-28 06:11:09.221924 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-28 06:11:09.221935 | orchestrator | Tuesday 28 April 2026 06:10:52 +0000 (0:00:01.227) 0:55:26.216 ********* 2026-04-28 06:11:09.221946 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:11:09.221957 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:11:09.221967 | orchestrator | 2026-04-28 06:11:09.221978 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-28 06:11:09.221988 | orchestrator | Tuesday 28 April 2026 06:10:54 +0000 (0:00:01.263) 0:55:27.480 ********* 2026-04-28 06:11:09.222000 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-28 06:11:09.222011 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-28 06:11:09.222107 | orchestrator | 2026-04-28 06:11:09.222118 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 06:11:09.222129 | orchestrator | Tuesday 28 April 2026 06:10:56 +0000 (0:00:02.218) 0:55:29.699 ********* 2026-04-28 06:11:09.222140 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:11:09.222150 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:11:09.222161 | orchestrator | 2026-04-28 06:11:09.222172 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-28 06:11:09.222185 | orchestrator | Tuesday 28 April 2026 06:10:57 +0000 (0:00:01.286) 0:55:30.986 ********* 2026-04-28 06:11:09.222198 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:11:09.222211 | orchestrator | 2026-04-28 06:11:09.222224 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-28 06:11:09.222237 | orchestrator | Tuesday 28 April 2026 06:10:58 +0000 (0:00:01.135) 0:55:32.122 ********* 2026-04-28 06:11:09.222249 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:11:09.222262 | orchestrator | 2026-04-28 06:11:09.222274 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 06:11:09.222287 | orchestrator | Tuesday 28 April 2026 06:11:00 +0000 (0:00:01.316) 0:55:33.438 ********* 2026-04-28 06:11:09.222300 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:11:09.222313 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:11:09.222325 | orchestrator | 2026-04-28 06:11:09.222337 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-28 06:11:09.222350 | orchestrator | Tuesday 28 April 2026 06:11:01 +0000 (0:00:01.277) 0:55:34.716 ********* 2026-04-28 06:11:09.222362 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:11:09.222375 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:11:09.222388 | orchestrator | 2026-04-28 06:11:09.222401 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-28 06:11:09.222414 | orchestrator | Tuesday 28 April 2026 06:11:02 +0000 (0:00:01.317) 0:55:36.033 ********* 2026-04-28 06:11:09.222426 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:11:09.222439 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:11:09.222451 | orchestrator | 2026-04-28 06:11:09.222464 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-28 06:11:09.222477 | orchestrator | Tuesday 28 April 2026 06:11:03 +0000 (0:00:01.338) 0:55:37.372 ********* 2026-04-28 06:11:09.222490 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:11:09.222503 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:11:09.222516 | orchestrator | 2026-04-28 06:11:09.222528 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-28 06:11:09.222554 | orchestrator | Tuesday 28 April 2026 06:11:05 +0000 (0:00:01.225) 0:55:38.598 ********* 2026-04-28 06:11:09.222578 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:11:09.222589 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:11:09.222600 | orchestrator | 2026-04-28 06:11:09.222610 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-28 06:11:09.222621 | orchestrator | Tuesday 28 April 2026 06:11:06 +0000 (0:00:01.312) 0:55:39.910 ********* 2026-04-28 06:11:09.222632 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:11:09.222643 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:11:09.222653 | orchestrator | 2026-04-28 06:11:09.222664 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-28 06:11:09.222676 | orchestrator | Tuesday 28 April 2026 06:11:07 +0000 (0:00:01.288) 0:55:41.199 ********* 2026-04-28 06:11:09.222686 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:11:09.222697 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:11:09.222708 | orchestrator | 2026-04-28 06:11:09.222718 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-28 06:11:09.222729 | orchestrator | Tuesday 28 April 2026 06:11:09 +0000 (0:00:01.238) 0:55:42.437 ********* 2026-04-28 06:11:09.222743 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:11:09.222813 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1', 'dm-uuid-LVM-SMcSbjI9wnD6SeY7SKKJ6dCSoT074g1SuE3hmfWZ3V1NoBQYcdXeMp0c5DwXf9Jz'], 'uuids': ['bb15ffa5-db58-4aaf-8e50-4b001450e00b'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f7edf0fa', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz']}})  2026-04-28 06:11:09.222830 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c', 'scsi-SQEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '0b1dfca7', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 06:11:09.222843 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-CCJsyU-Xs4y-bAwu-Sr1U-RU9B-U5cX-8dk8mo', 'scsi-0QEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202', 'scsi-SQEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46b7ee74', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f']}})  2026-04-28 06:11:09.222855 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:11:09.222881 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:11:09.222894 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-18-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 06:11:09.222905 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:11:09.222925 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu', 'dm-uuid-CRYPT-LUKS2-5da20da06cd949e5b229e06742b9ea2c-94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 06:11:09.353212 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:11:09.353299 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f', 'dm-uuid-LVM-8dHS1FAptgldbJuN9Gw1hr0pl5XswJ3894zCAdztzvSylGKJfL2Zwu5Qsrm0jqWu'], 'uuids': ['5da20da0-6cd9-49e5-b229-e06742b9ea2c'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '46b7ee74', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu']}})  2026-04-28 06:11:09.353311 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-rTHLNA-XX65-cEa6-oPdR-i0kN-CrZ9-dGTohN', 'scsi-0QEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675', 'scsi-SQEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f7edf0fa', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1']}})  2026-04-28 06:11:09.353338 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:11:09.353374 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '3fe92a08', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 06:11:09.353384 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:11:09.353392 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:11:09.353398 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:11:09.353414 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1', 'dm-uuid-LVM-L5YjMhWvYgnpoIfTj51PZeO1wrabnQEX7l2ME9eZWg9LEHQ0f9eDaf27dOm77xe0'], 'uuids': ['dfd6b477-c8eb-4a33-b64e-726cd73356df'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '953cbf01', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0']}})  2026-04-28 06:11:09.353422 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz', 'dm-uuid-CRYPT-LUKS2-bb15ffa5db584aaf8e504b001450e00b-uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 06:11:09.353431 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de', 'scsi-SQEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'eca06b16', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 06:11:09.353439 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:11:09.353454 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-L2AQ1c-y7H3-F3Y3-6Qkf-SkKZ-Rdhw-Yd8PGb', 'scsi-0QEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79', 'scsi-SQEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '0d71173f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab']}})  2026-04-28 06:11:09.436514 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:11:09.436687 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:11:09.436719 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-15-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 06:11:09.436780 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:11:09.436821 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE', 'dm-uuid-CRYPT-LUKS2-49a0c8edea6a405ca40698859485fff3-xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 06:11:09.436844 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:11:09.436868 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab', 'dm-uuid-LVM-wa3l676dWvdqPItJjhbbIPxjjJMNXrWDxgNEYRSdoBZ0EZLJPUa6Po9zcB3PjLSE'], 'uuids': ['49a0c8ed-ea6a-405c-a406-98859485fff3'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '0d71173f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE']}})  2026-04-28 06:11:09.436918 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-vGsvHj-S1i8-Sw7N-17Sv-GX9v-DQYR-rG2tdh', 'scsi-0QEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89', 'scsi-SQEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '953cbf01', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1']}})  2026-04-28 06:11:09.436941 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:11:09.436975 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '4c7fe216', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 06:11:09.437015 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:11:09.437039 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:11:09.437144 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0', 'dm-uuid-CRYPT-LUKS2-dfd6b477c8eb4a33b64e726cd73356df-7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 06:11:11.286198 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:11:11.286299 | orchestrator | 2026-04-28 06:11:11.286316 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-28 06:11:11.286330 | orchestrator | Tuesday 28 April 2026 06:11:10 +0000 (0:00:01.565) 0:55:44.003 ********* 2026-04-28 06:11:11.286344 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.286387 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1', 'dm-uuid-LVM-SMcSbjI9wnD6SeY7SKKJ6dCSoT074g1SuE3hmfWZ3V1NoBQYcdXeMp0c5DwXf9Jz'], 'uuids': ['bb15ffa5-db58-4aaf-8e50-4b001450e00b'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f7edf0fa', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.286423 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c', 'scsi-SQEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '0b1dfca7', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.286437 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-CCJsyU-Xs4y-bAwu-Sr1U-RU9B-U5cX-8dk8mo', 'scsi-0QEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202', 'scsi-SQEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46b7ee74', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.286469 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.286482 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.286502 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.286519 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-18-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.286531 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1', 'dm-uuid-LVM-L5YjMhWvYgnpoIfTj51PZeO1wrabnQEX7l2ME9eZWg9LEHQ0f9eDaf27dOm77xe0'], 'uuids': ['dfd6b477-c8eb-4a33-b64e-726cd73356df'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '953cbf01', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.286543 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.286562 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de', 'scsi-SQEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'eca06b16', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.358723 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu', 'dm-uuid-CRYPT-LUKS2-5da20da06cd949e5b229e06742b9ea2c-94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.358840 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-L2AQ1c-y7H3-F3Y3-6Qkf-SkKZ-Rdhw-Yd8PGb', 'scsi-0QEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79', 'scsi-SQEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '0d71173f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.358861 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.358875 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.358887 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f', 'dm-uuid-LVM-8dHS1FAptgldbJuN9Gw1hr0pl5XswJ3894zCAdztzvSylGKJfL2Zwu5Qsrm0jqWu'], 'uuids': ['5da20da0-6cd9-49e5-b229-e06742b9ea2c'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '46b7ee74', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.358941 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.358954 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-rTHLNA-XX65-cEa6-oPdR-i0kN-CrZ9-dGTohN', 'scsi-0QEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675', 'scsi-SQEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f7edf0fa', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.358971 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-15-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.358983 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.358994 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.359016 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '3fe92a08', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.454614 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE', 'dm-uuid-CRYPT-LUKS2-49a0c8edea6a405ca40698859485fff3-xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.454712 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.454728 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.454761 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.454774 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab', 'dm-uuid-LVM-wa3l676dWvdqPItJjhbbIPxjjJMNXrWDxgNEYRSdoBZ0EZLJPUa6Po9zcB3PjLSE'], 'uuids': ['49a0c8ed-ea6a-405c-a406-98859485fff3'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '0d71173f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.454808 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz', 'dm-uuid-CRYPT-LUKS2-bb15ffa5db584aaf8e504b001450e00b-uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.454823 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-vGsvHj-S1i8-Sw7N-17Sv-GX9v-DQYR-rG2tdh', 'scsi-0QEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89', 'scsi-SQEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '953cbf01', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.454837 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:11:11.454851 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:11.454901 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '4c7fe216', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:39.343930 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:39.344091 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:39.344112 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0', 'dm-uuid-CRYPT-LUKS2-dfd6b477c8eb4a33b64e726cd73356df-7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:11:39.344154 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:11:39.344168 | orchestrator | 2026-04-28 06:11:39.344180 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-28 06:11:39.344192 | orchestrator | Tuesday 28 April 2026 06:11:12 +0000 (0:00:01.935) 0:55:45.939 ********* 2026-04-28 06:11:39.344203 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:11:39.344215 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:11:39.344226 | orchestrator | 2026-04-28 06:11:39.344237 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-28 06:11:39.344248 | orchestrator | Tuesday 28 April 2026 06:11:14 +0000 (0:00:01.732) 0:55:47.671 ********* 2026-04-28 06:11:39.344259 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:11:39.344269 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:11:39.344280 | orchestrator | 2026-04-28 06:11:39.344291 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 06:11:39.344302 | orchestrator | Tuesday 28 April 2026 06:11:15 +0000 (0:00:01.306) 0:55:48.978 ********* 2026-04-28 06:11:39.344312 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:11:39.344323 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:11:39.344333 | orchestrator | 2026-04-28 06:11:39.344344 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 06:11:39.344355 | orchestrator | Tuesday 28 April 2026 06:11:17 +0000 (0:00:01.664) 0:55:50.643 ********* 2026-04-28 06:11:39.344365 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:11:39.344376 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:11:39.344387 | orchestrator | 2026-04-28 06:11:39.344397 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 06:11:39.344408 | orchestrator | Tuesday 28 April 2026 06:11:18 +0000 (0:00:01.241) 0:55:51.884 ********* 2026-04-28 06:11:39.344419 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:11:39.344429 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:11:39.344440 | orchestrator | 2026-04-28 06:11:39.344451 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 06:11:39.344470 | orchestrator | Tuesday 28 April 2026 06:11:19 +0000 (0:00:01.325) 0:55:53.210 ********* 2026-04-28 06:11:39.344490 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:11:39.344510 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:11:39.344527 | orchestrator | 2026-04-28 06:11:39.344544 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-28 06:11:39.344565 | orchestrator | Tuesday 28 April 2026 06:11:21 +0000 (0:00:01.411) 0:55:54.621 ********* 2026-04-28 06:11:39.344586 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-0) 2026-04-28 06:11:39.344607 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-0) 2026-04-28 06:11:39.344628 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-1) 2026-04-28 06:11:39.344647 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-1) 2026-04-28 06:11:39.344661 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-2) 2026-04-28 06:11:39.344673 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-2) 2026-04-28 06:11:39.344686 | orchestrator | 2026-04-28 06:11:39.344698 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-28 06:11:39.344711 | orchestrator | Tuesday 28 April 2026 06:11:23 +0000 (0:00:01.848) 0:55:56.470 ********* 2026-04-28 06:11:39.344757 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-28 06:11:39.344771 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-28 06:11:39.344784 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-28 06:11:39.344796 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:11:39.344818 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-28 06:11:39.344829 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-28 06:11:39.344840 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-28 06:11:39.344850 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:11:39.344861 | orchestrator | 2026-04-28 06:11:39.344872 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-28 06:11:39.344883 | orchestrator | Tuesday 28 April 2026 06:11:24 +0000 (0:00:01.326) 0:55:57.797 ********* 2026-04-28 06:11:39.344894 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-3, testbed-node-5 2026-04-28 06:11:39.344906 | orchestrator | 2026-04-28 06:11:39.344917 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 06:11:39.344929 | orchestrator | Tuesday 28 April 2026 06:11:25 +0000 (0:00:01.241) 0:55:59.038 ********* 2026-04-28 06:11:39.344940 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:11:39.344951 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:11:39.344961 | orchestrator | 2026-04-28 06:11:39.344995 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 06:11:39.345007 | orchestrator | Tuesday 28 April 2026 06:11:26 +0000 (0:00:01.304) 0:56:00.343 ********* 2026-04-28 06:11:39.345018 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:11:39.345028 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:11:39.345039 | orchestrator | 2026-04-28 06:11:39.345049 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 06:11:39.345060 | orchestrator | Tuesday 28 April 2026 06:11:28 +0000 (0:00:01.266) 0:56:01.610 ********* 2026-04-28 06:11:39.345070 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:11:39.345081 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:11:39.345092 | orchestrator | 2026-04-28 06:11:39.345102 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 06:11:39.345113 | orchestrator | Tuesday 28 April 2026 06:11:29 +0000 (0:00:01.642) 0:56:03.252 ********* 2026-04-28 06:11:39.345124 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:11:39.345135 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:11:39.345145 | orchestrator | 2026-04-28 06:11:39.345156 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 06:11:39.345166 | orchestrator | Tuesday 28 April 2026 06:11:31 +0000 (0:00:01.375) 0:56:04.628 ********* 2026-04-28 06:11:39.345177 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 06:11:39.345188 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 06:11:39.345198 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 06:11:39.345209 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:11:39.345220 | orchestrator | 2026-04-28 06:11:39.345230 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 06:11:39.345241 | orchestrator | Tuesday 28 April 2026 06:11:32 +0000 (0:00:01.410) 0:56:06.039 ********* 2026-04-28 06:11:39.345251 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 06:11:39.345262 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 06:11:39.345273 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 06:11:39.345283 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:11:39.345294 | orchestrator | 2026-04-28 06:11:39.345304 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 06:11:39.345315 | orchestrator | Tuesday 28 April 2026 06:11:34 +0000 (0:00:01.377) 0:56:07.416 ********* 2026-04-28 06:11:39.345326 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 06:11:39.345336 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 06:11:39.345347 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 06:11:39.345364 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:11:39.345375 | orchestrator | 2026-04-28 06:11:39.345386 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 06:11:39.345396 | orchestrator | Tuesday 28 April 2026 06:11:35 +0000 (0:00:01.426) 0:56:08.842 ********* 2026-04-28 06:11:39.345407 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:11:39.345418 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:11:39.345428 | orchestrator | 2026-04-28 06:11:39.345439 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 06:11:39.345449 | orchestrator | Tuesday 28 April 2026 06:11:36 +0000 (0:00:01.324) 0:56:10.167 ********* 2026-04-28 06:11:39.345460 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-28 06:11:39.345471 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-28 06:11:39.345481 | orchestrator | 2026-04-28 06:11:39.345492 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-28 06:11:39.345502 | orchestrator | Tuesday 28 April 2026 06:11:38 +0000 (0:00:01.421) 0:56:11.589 ********* 2026-04-28 06:11:39.345513 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:11:39.345523 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:11:39.345534 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:11:39.345545 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-28 06:11:39.345555 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 06:11:39.345566 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 06:11:39.345588 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 06:12:25.224698 | orchestrator | 2026-04-28 06:12:25.224812 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-28 06:12:25.224935 | orchestrator | Tuesday 28 April 2026 06:11:40 +0000 (0:00:02.219) 0:56:13.808 ********* 2026-04-28 06:12:25.224954 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:12:25.224966 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:12:25.224977 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:12:25.224989 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-28 06:12:25.225000 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 06:12:25.225011 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 06:12:25.225022 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 06:12:25.225033 | orchestrator | 2026-04-28 06:12:25.225044 | orchestrator | TASK [Prevent restarts from the packaging] ************************************* 2026-04-28 06:12:25.225054 | orchestrator | Tuesday 28 April 2026 06:11:43 +0000 (0:00:02.969) 0:56:16.777 ********* 2026-04-28 06:12:25.225065 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:12:25.225077 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:12:25.225087 | orchestrator | 2026-04-28 06:12:25.225098 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 06:12:25.225109 | orchestrator | Tuesday 28 April 2026 06:11:44 +0000 (0:00:01.333) 0:56:18.111 ********* 2026-04-28 06:12:25.225119 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3, testbed-node-5 2026-04-28 06:12:25.225130 | orchestrator | 2026-04-28 06:12:25.225141 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 06:12:25.225152 | orchestrator | Tuesday 28 April 2026 06:11:45 +0000 (0:00:01.228) 0:56:19.340 ********* 2026-04-28 06:12:25.225162 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3, testbed-node-5 2026-04-28 06:12:25.225200 | orchestrator | 2026-04-28 06:12:25.225213 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 06:12:25.225226 | orchestrator | Tuesday 28 April 2026 06:11:47 +0000 (0:00:01.205) 0:56:20.546 ********* 2026-04-28 06:12:25.225239 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:12:25.225251 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:12:25.225264 | orchestrator | 2026-04-28 06:12:25.225276 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 06:12:25.225289 | orchestrator | Tuesday 28 April 2026 06:11:48 +0000 (0:00:01.311) 0:56:21.857 ********* 2026-04-28 06:12:25.225301 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:12:25.225315 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:12:25.225326 | orchestrator | 2026-04-28 06:12:25.225339 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 06:12:25.225351 | orchestrator | Tuesday 28 April 2026 06:11:50 +0000 (0:00:01.642) 0:56:23.500 ********* 2026-04-28 06:12:25.225363 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:12:25.225375 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:12:25.225388 | orchestrator | 2026-04-28 06:12:25.225400 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 06:12:25.225413 | orchestrator | Tuesday 28 April 2026 06:11:51 +0000 (0:00:01.641) 0:56:25.142 ********* 2026-04-28 06:12:25.225426 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:12:25.225438 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:12:25.225451 | orchestrator | 2026-04-28 06:12:25.225463 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 06:12:25.225476 | orchestrator | Tuesday 28 April 2026 06:11:53 +0000 (0:00:01.694) 0:56:26.836 ********* 2026-04-28 06:12:25.225488 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:12:25.225500 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:12:25.225512 | orchestrator | 2026-04-28 06:12:25.225525 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 06:12:25.225538 | orchestrator | Tuesday 28 April 2026 06:11:54 +0000 (0:00:01.244) 0:56:28.081 ********* 2026-04-28 06:12:25.225550 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:12:25.225563 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:12:25.225575 | orchestrator | 2026-04-28 06:12:25.225588 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 06:12:25.225608 | orchestrator | Tuesday 28 April 2026 06:11:56 +0000 (0:00:01.317) 0:56:29.398 ********* 2026-04-28 06:12:25.225627 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:12:25.225646 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:12:25.225666 | orchestrator | 2026-04-28 06:12:25.225686 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 06:12:25.225707 | orchestrator | Tuesday 28 April 2026 06:11:57 +0000 (0:00:01.259) 0:56:30.658 ********* 2026-04-28 06:12:25.225727 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:12:25.225739 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:12:25.225749 | orchestrator | 2026-04-28 06:12:25.225760 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 06:12:25.225771 | orchestrator | Tuesday 28 April 2026 06:11:59 +0000 (0:00:02.366) 0:56:33.024 ********* 2026-04-28 06:12:25.225781 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:12:25.225792 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:12:25.225802 | orchestrator | 2026-04-28 06:12:25.225813 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 06:12:25.225824 | orchestrator | Tuesday 28 April 2026 06:12:01 +0000 (0:00:01.671) 0:56:34.695 ********* 2026-04-28 06:12:25.225869 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:12:25.225881 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:12:25.225891 | orchestrator | 2026-04-28 06:12:25.225902 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 06:12:25.225930 | orchestrator | Tuesday 28 April 2026 06:12:02 +0000 (0:00:01.216) 0:56:35.912 ********* 2026-04-28 06:12:25.225941 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:12:25.225982 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:12:25.225994 | orchestrator | 2026-04-28 06:12:25.226005 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 06:12:25.226074 | orchestrator | Tuesday 28 April 2026 06:12:03 +0000 (0:00:01.217) 0:56:37.130 ********* 2026-04-28 06:12:25.226089 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:12:25.226100 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:12:25.226111 | orchestrator | 2026-04-28 06:12:25.226122 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 06:12:25.226132 | orchestrator | Tuesday 28 April 2026 06:12:04 +0000 (0:00:01.230) 0:56:38.360 ********* 2026-04-28 06:12:25.226143 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:12:25.226154 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:12:25.226164 | orchestrator | 2026-04-28 06:12:25.226175 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 06:12:25.226186 | orchestrator | Tuesday 28 April 2026 06:12:06 +0000 (0:00:01.313) 0:56:39.674 ********* 2026-04-28 06:12:25.226197 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:12:25.226207 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:12:25.226218 | orchestrator | 2026-04-28 06:12:25.226229 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 06:12:25.226240 | orchestrator | Tuesday 28 April 2026 06:12:07 +0000 (0:00:01.214) 0:56:40.888 ********* 2026-04-28 06:12:25.226251 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:12:25.226262 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:12:25.226272 | orchestrator | 2026-04-28 06:12:25.226283 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 06:12:25.226294 | orchestrator | Tuesday 28 April 2026 06:12:09 +0000 (0:00:01.622) 0:56:42.512 ********* 2026-04-28 06:12:25.226304 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:12:25.226315 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:12:25.226326 | orchestrator | 2026-04-28 06:12:25.226337 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 06:12:25.226348 | orchestrator | Tuesday 28 April 2026 06:12:10 +0000 (0:00:01.272) 0:56:43.784 ********* 2026-04-28 06:12:25.226358 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:12:25.226369 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:12:25.226380 | orchestrator | 2026-04-28 06:12:25.226391 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 06:12:25.226401 | orchestrator | Tuesday 28 April 2026 06:12:11 +0000 (0:00:01.285) 0:56:45.069 ********* 2026-04-28 06:12:25.226412 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:12:25.226423 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:12:25.226434 | orchestrator | 2026-04-28 06:12:25.226444 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 06:12:25.226455 | orchestrator | Tuesday 28 April 2026 06:12:12 +0000 (0:00:01.238) 0:56:46.308 ********* 2026-04-28 06:12:25.226466 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:12:25.226477 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:12:25.226488 | orchestrator | 2026-04-28 06:12:25.226498 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-28 06:12:25.226509 | orchestrator | Tuesday 28 April 2026 06:12:14 +0000 (0:00:01.343) 0:56:47.651 ********* 2026-04-28 06:12:25.226520 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:12:25.226531 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:12:25.226541 | orchestrator | 2026-04-28 06:12:25.226552 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-28 06:12:25.226563 | orchestrator | Tuesday 28 April 2026 06:12:15 +0000 (0:00:01.326) 0:56:48.978 ********* 2026-04-28 06:12:25.226574 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:12:25.226585 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:12:25.226596 | orchestrator | 2026-04-28 06:12:25.226606 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-28 06:12:25.226617 | orchestrator | Tuesday 28 April 2026 06:12:16 +0000 (0:00:01.337) 0:56:50.316 ********* 2026-04-28 06:12:25.226635 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:12:25.226646 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:12:25.226662 | orchestrator | 2026-04-28 06:12:25.226680 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-28 06:12:25.226698 | orchestrator | Tuesday 28 April 2026 06:12:18 +0000 (0:00:01.273) 0:56:51.589 ********* 2026-04-28 06:12:25.226718 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:12:25.226737 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:12:25.226755 | orchestrator | 2026-04-28 06:12:25.226772 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-28 06:12:25.226783 | orchestrator | Tuesday 28 April 2026 06:12:19 +0000 (0:00:01.271) 0:56:52.860 ********* 2026-04-28 06:12:25.226794 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:12:25.226804 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:12:25.226815 | orchestrator | 2026-04-28 06:12:25.226825 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-28 06:12:25.226863 | orchestrator | Tuesday 28 April 2026 06:12:20 +0000 (0:00:01.242) 0:56:54.103 ********* 2026-04-28 06:12:25.226875 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:12:25.226886 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:12:25.226897 | orchestrator | 2026-04-28 06:12:25.226907 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-28 06:12:25.226918 | orchestrator | Tuesday 28 April 2026 06:12:21 +0000 (0:00:01.257) 0:56:55.360 ********* 2026-04-28 06:12:25.226929 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:12:25.226939 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:12:25.226972 | orchestrator | 2026-04-28 06:12:25.226983 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-28 06:12:25.226994 | orchestrator | Tuesday 28 April 2026 06:12:23 +0000 (0:00:01.257) 0:56:56.617 ********* 2026-04-28 06:12:25.227005 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:12:25.227016 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:12:25.227026 | orchestrator | 2026-04-28 06:12:25.227037 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-28 06:12:25.227061 | orchestrator | Tuesday 28 April 2026 06:12:24 +0000 (0:00:01.740) 0:56:58.358 ********* 2026-04-28 06:12:25.227072 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:12:25.227083 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:12:25.227093 | orchestrator | 2026-04-28 06:12:25.227120 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-28 06:13:10.536034 | orchestrator | Tuesday 28 April 2026 06:12:26 +0000 (0:00:01.360) 0:56:59.718 ********* 2026-04-28 06:13:10.536149 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:10.536166 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:10.536178 | orchestrator | 2026-04-28 06:13:10.536190 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-28 06:13:10.536201 | orchestrator | Tuesday 28 April 2026 06:12:27 +0000 (0:00:01.275) 0:57:00.994 ********* 2026-04-28 06:13:10.536212 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:10.536223 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:10.536234 | orchestrator | 2026-04-28 06:13:10.536245 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-28 06:13:10.536255 | orchestrator | Tuesday 28 April 2026 06:12:28 +0000 (0:00:01.306) 0:57:02.300 ********* 2026-04-28 06:13:10.536266 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:10.536277 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:10.536289 | orchestrator | 2026-04-28 06:13:10.536299 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-28 06:13:10.536310 | orchestrator | Tuesday 28 April 2026 06:12:30 +0000 (0:00:01.278) 0:57:03.578 ********* 2026-04-28 06:13:10.536321 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:13:10.536333 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:13:10.536344 | orchestrator | 2026-04-28 06:13:10.536354 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-28 06:13:10.536391 | orchestrator | Tuesday 28 April 2026 06:12:32 +0000 (0:00:02.029) 0:57:05.608 ********* 2026-04-28 06:13:10.536402 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:13:10.536413 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:13:10.536424 | orchestrator | 2026-04-28 06:13:10.536434 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-28 06:13:10.536445 | orchestrator | Tuesday 28 April 2026 06:12:35 +0000 (0:00:02.807) 0:57:08.416 ********* 2026-04-28 06:13:10.536457 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-3, testbed-node-5 2026-04-28 06:13:10.536468 | orchestrator | 2026-04-28 06:13:10.536479 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-28 06:13:10.536489 | orchestrator | Tuesday 28 April 2026 06:12:36 +0000 (0:00:01.317) 0:57:09.734 ********* 2026-04-28 06:13:10.536500 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:10.536511 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:10.536522 | orchestrator | 2026-04-28 06:13:10.536533 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-28 06:13:10.536543 | orchestrator | Tuesday 28 April 2026 06:12:37 +0000 (0:00:01.230) 0:57:10.964 ********* 2026-04-28 06:13:10.536554 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:10.536565 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:10.536578 | orchestrator | 2026-04-28 06:13:10.536590 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-28 06:13:10.536604 | orchestrator | Tuesday 28 April 2026 06:12:38 +0000 (0:00:01.288) 0:57:12.252 ********* 2026-04-28 06:13:10.536616 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-28 06:13:10.536628 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-28 06:13:10.536641 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-28 06:13:10.536653 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-28 06:13:10.536667 | orchestrator | 2026-04-28 06:13:10.536679 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-28 06:13:10.536692 | orchestrator | Tuesday 28 April 2026 06:12:40 +0000 (0:00:01.893) 0:57:14.146 ********* 2026-04-28 06:13:10.536727 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:13:10.536741 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:13:10.536753 | orchestrator | 2026-04-28 06:13:10.536764 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-28 06:13:10.536775 | orchestrator | Tuesday 28 April 2026 06:12:42 +0000 (0:00:01.539) 0:57:15.685 ********* 2026-04-28 06:13:10.536786 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:10.536796 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:10.536807 | orchestrator | 2026-04-28 06:13:10.536818 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-28 06:13:10.536828 | orchestrator | Tuesday 28 April 2026 06:12:43 +0000 (0:00:01.251) 0:57:16.937 ********* 2026-04-28 06:13:10.536839 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:10.536850 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:10.536860 | orchestrator | 2026-04-28 06:13:10.536871 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-28 06:13:10.536881 | orchestrator | Tuesday 28 April 2026 06:12:44 +0000 (0:00:01.271) 0:57:18.208 ********* 2026-04-28 06:13:10.536892 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:10.536903 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:10.536914 | orchestrator | 2026-04-28 06:13:10.536924 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-28 06:13:10.536935 | orchestrator | Tuesday 28 April 2026 06:12:46 +0000 (0:00:01.294) 0:57:19.503 ********* 2026-04-28 06:13:10.536946 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-3, testbed-node-5 2026-04-28 06:13:10.536956 | orchestrator | 2026-04-28 06:13:10.536975 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-28 06:13:10.536986 | orchestrator | Tuesday 28 April 2026 06:12:47 +0000 (0:00:01.216) 0:57:20.720 ********* 2026-04-28 06:13:10.536997 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:13:10.537007 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:13:10.537018 | orchestrator | 2026-04-28 06:13:10.537028 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-28 06:13:10.537039 | orchestrator | Tuesday 28 April 2026 06:12:49 +0000 (0:00:01.937) 0:57:22.657 ********* 2026-04-28 06:13:10.537064 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-28 06:13:10.537092 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-28 06:13:10.537103 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-28 06:13:10.537114 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:10.537125 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-28 06:13:10.537136 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-28 06:13:10.537146 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-28 06:13:10.537157 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:10.537183 | orchestrator | 2026-04-28 06:13:10.537195 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-28 06:13:10.537217 | orchestrator | Tuesday 28 April 2026 06:12:50 +0000 (0:00:01.649) 0:57:24.306 ********* 2026-04-28 06:13:10.537228 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:10.537239 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:10.537249 | orchestrator | 2026-04-28 06:13:10.537260 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-28 06:13:10.537271 | orchestrator | Tuesday 28 April 2026 06:12:52 +0000 (0:00:01.210) 0:57:25.517 ********* 2026-04-28 06:13:10.537282 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:10.537292 | orchestrator | 2026-04-28 06:13:10.537303 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-28 06:13:10.537314 | orchestrator | Tuesday 28 April 2026 06:12:53 +0000 (0:00:01.155) 0:57:26.673 ********* 2026-04-28 06:13:10.537324 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:10.537335 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:10.537346 | orchestrator | 2026-04-28 06:13:10.537356 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-28 06:13:10.537367 | orchestrator | Tuesday 28 April 2026 06:12:54 +0000 (0:00:01.286) 0:57:27.959 ********* 2026-04-28 06:13:10.537378 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:10.537389 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:10.537399 | orchestrator | 2026-04-28 06:13:10.537410 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-28 06:13:10.537420 | orchestrator | Tuesday 28 April 2026 06:12:55 +0000 (0:00:01.323) 0:57:29.283 ********* 2026-04-28 06:13:10.537431 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:10.537442 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:10.537452 | orchestrator | 2026-04-28 06:13:10.537463 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-28 06:13:10.537473 | orchestrator | Tuesday 28 April 2026 06:12:57 +0000 (0:00:01.282) 0:57:30.566 ********* 2026-04-28 06:13:10.537484 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:13:10.537495 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:13:10.537505 | orchestrator | 2026-04-28 06:13:10.537516 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-28 06:13:10.537527 | orchestrator | Tuesday 28 April 2026 06:12:59 +0000 (0:00:02.722) 0:57:33.288 ********* 2026-04-28 06:13:10.537537 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:13:10.537548 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:13:10.537559 | orchestrator | 2026-04-28 06:13:10.537569 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-28 06:13:10.537587 | orchestrator | Tuesday 28 April 2026 06:13:01 +0000 (0:00:01.265) 0:57:34.553 ********* 2026-04-28 06:13:10.537597 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-3, testbed-node-5 2026-04-28 06:13:10.537609 | orchestrator | 2026-04-28 06:13:10.537620 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-28 06:13:10.537631 | orchestrator | Tuesday 28 April 2026 06:13:02 +0000 (0:00:01.242) 0:57:35.796 ********* 2026-04-28 06:13:10.537641 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:10.537652 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:10.537663 | orchestrator | 2026-04-28 06:13:10.537674 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-28 06:13:10.537684 | orchestrator | Tuesday 28 April 2026 06:13:03 +0000 (0:00:01.227) 0:57:37.023 ********* 2026-04-28 06:13:10.537695 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:10.537744 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:10.537756 | orchestrator | 2026-04-28 06:13:10.537766 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-28 06:13:10.537777 | orchestrator | Tuesday 28 April 2026 06:13:04 +0000 (0:00:01.284) 0:57:38.307 ********* 2026-04-28 06:13:10.537788 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:10.537798 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:10.537809 | orchestrator | 2026-04-28 06:13:10.537820 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-28 06:13:10.537830 | orchestrator | Tuesday 28 April 2026 06:13:06 +0000 (0:00:01.252) 0:57:39.560 ********* 2026-04-28 06:13:10.537841 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:10.537851 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:10.537862 | orchestrator | 2026-04-28 06:13:10.537873 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-28 06:13:10.537884 | orchestrator | Tuesday 28 April 2026 06:13:07 +0000 (0:00:01.219) 0:57:40.780 ********* 2026-04-28 06:13:10.537894 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:10.537905 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:10.537916 | orchestrator | 2026-04-28 06:13:10.537926 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-28 06:13:10.537937 | orchestrator | Tuesday 28 April 2026 06:13:09 +0000 (0:00:01.611) 0:57:42.391 ********* 2026-04-28 06:13:10.537948 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:10.537958 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:10.537969 | orchestrator | 2026-04-28 06:13:10.537980 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-28 06:13:10.537991 | orchestrator | Tuesday 28 April 2026 06:13:10 +0000 (0:00:01.250) 0:57:43.642 ********* 2026-04-28 06:13:10.538001 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:10.538080 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:10.538106 | orchestrator | 2026-04-28 06:13:10.538138 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-28 06:13:50.443299 | orchestrator | Tuesday 28 April 2026 06:13:11 +0000 (0:00:01.247) 0:57:44.889 ********* 2026-04-28 06:13:50.443418 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:50.443435 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:50.443448 | orchestrator | 2026-04-28 06:13:50.443460 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-28 06:13:50.443471 | orchestrator | Tuesday 28 April 2026 06:13:12 +0000 (0:00:01.245) 0:57:46.135 ********* 2026-04-28 06:13:50.443482 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:13:50.443494 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:13:50.443505 | orchestrator | 2026-04-28 06:13:50.443516 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-28 06:13:50.443527 | orchestrator | Tuesday 28 April 2026 06:13:14 +0000 (0:00:01.305) 0:57:47.441 ********* 2026-04-28 06:13:50.443539 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-3, testbed-node-5 2026-04-28 06:13:50.443577 | orchestrator | 2026-04-28 06:13:50.443588 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-28 06:13:50.443668 | orchestrator | Tuesday 28 April 2026 06:13:15 +0000 (0:00:01.510) 0:57:48.951 ********* 2026-04-28 06:13:50.443679 | orchestrator | ok: [testbed-node-3] => (item=/etc/ceph) 2026-04-28 06:13:50.443690 | orchestrator | ok: [testbed-node-5] => (item=/etc/ceph) 2026-04-28 06:13:50.443701 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/) 2026-04-28 06:13:50.443712 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/) 2026-04-28 06:13:50.443723 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/mon) 2026-04-28 06:13:50.443733 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/mon) 2026-04-28 06:13:50.443744 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/osd) 2026-04-28 06:13:50.443755 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/osd) 2026-04-28 06:13:50.443765 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/mds) 2026-04-28 06:13:50.443775 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/mds) 2026-04-28 06:13:50.443786 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/tmp) 2026-04-28 06:13:50.443796 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/tmp) 2026-04-28 06:13:50.443807 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/crash) 2026-04-28 06:13:50.443817 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/crash) 2026-04-28 06:13:50.443828 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/radosgw) 2026-04-28 06:13:50.443842 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/radosgw) 2026-04-28 06:13:50.443854 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-28 06:13:50.443867 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-28 06:13:50.443879 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-28 06:13:50.443891 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-28 06:13:50.443903 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-28 06:13:50.443916 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-28 06:13:50.443928 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-28 06:13:50.443939 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-28 06:13:50.443951 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-28 06:13:50.443963 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-28 06:13:50.443976 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-28 06:13:50.443988 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-28 06:13:50.444001 | orchestrator | ok: [testbed-node-3] => (item=/var/run/ceph) 2026-04-28 06:13:50.444013 | orchestrator | ok: [testbed-node-5] => (item=/var/run/ceph) 2026-04-28 06:13:50.444025 | orchestrator | ok: [testbed-node-3] => (item=/var/log/ceph) 2026-04-28 06:13:50.444037 | orchestrator | ok: [testbed-node-5] => (item=/var/log/ceph) 2026-04-28 06:13:50.444049 | orchestrator | 2026-04-28 06:13:50.444061 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-28 06:13:50.444074 | orchestrator | Tuesday 28 April 2026 06:13:22 +0000 (0:00:06.681) 0:57:55.633 ********* 2026-04-28 06:13:50.444086 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-3, testbed-node-5 2026-04-28 06:13:50.444098 | orchestrator | 2026-04-28 06:13:50.444110 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-28 06:13:50.444123 | orchestrator | Tuesday 28 April 2026 06:13:23 +0000 (0:00:01.274) 0:57:56.908 ********* 2026-04-28 06:13:50.444136 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-28 06:13:50.444150 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-28 06:13:50.444172 | orchestrator | 2026-04-28 06:13:50.444184 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-28 06:13:50.444195 | orchestrator | Tuesday 28 April 2026 06:13:25 +0000 (0:00:01.591) 0:57:58.499 ********* 2026-04-28 06:13:50.444206 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-28 06:13:50.444217 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-28 06:13:50.444228 | orchestrator | 2026-04-28 06:13:50.444253 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-28 06:13:50.444338 | orchestrator | Tuesday 28 April 2026 06:13:27 +0000 (0:00:02.062) 0:58:00.562 ********* 2026-04-28 06:13:50.444351 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:50.444362 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:50.444373 | orchestrator | 2026-04-28 06:13:50.444383 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-28 06:13:50.444394 | orchestrator | Tuesday 28 April 2026 06:13:28 +0000 (0:00:01.730) 0:58:02.292 ********* 2026-04-28 06:13:50.444405 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:50.444416 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:50.444426 | orchestrator | 2026-04-28 06:13:50.444437 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-28 06:13:50.444448 | orchestrator | Tuesday 28 April 2026 06:13:30 +0000 (0:00:01.278) 0:58:03.570 ********* 2026-04-28 06:13:50.444458 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:50.444469 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:50.444480 | orchestrator | 2026-04-28 06:13:50.444490 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-28 06:13:50.444501 | orchestrator | Tuesday 28 April 2026 06:13:31 +0000 (0:00:01.313) 0:58:04.884 ********* 2026-04-28 06:13:50.444511 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:50.444522 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:50.444533 | orchestrator | 2026-04-28 06:13:50.444544 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-28 06:13:50.444554 | orchestrator | Tuesday 28 April 2026 06:13:32 +0000 (0:00:01.221) 0:58:06.105 ********* 2026-04-28 06:13:50.444565 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:50.444576 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:50.444586 | orchestrator | 2026-04-28 06:13:50.444619 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-28 06:13:50.444630 | orchestrator | Tuesday 28 April 2026 06:13:33 +0000 (0:00:01.216) 0:58:07.321 ********* 2026-04-28 06:13:50.444641 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:50.444652 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:50.444662 | orchestrator | 2026-04-28 06:13:50.444673 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-28 06:13:50.444684 | orchestrator | Tuesday 28 April 2026 06:13:35 +0000 (0:00:01.266) 0:58:08.588 ********* 2026-04-28 06:13:50.444695 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:50.444706 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:50.444716 | orchestrator | 2026-04-28 06:13:50.444727 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-28 06:13:50.444738 | orchestrator | Tuesday 28 April 2026 06:13:36 +0000 (0:00:01.463) 0:58:10.051 ********* 2026-04-28 06:13:50.444749 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:50.444760 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:50.444770 | orchestrator | 2026-04-28 06:13:50.444781 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-28 06:13:50.444792 | orchestrator | Tuesday 28 April 2026 06:13:37 +0000 (0:00:01.234) 0:58:11.286 ********* 2026-04-28 06:13:50.444811 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:50.444822 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:50.444833 | orchestrator | 2026-04-28 06:13:50.444844 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-28 06:13:50.444855 | orchestrator | Tuesday 28 April 2026 06:13:39 +0000 (0:00:01.234) 0:58:12.521 ********* 2026-04-28 06:13:50.444866 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:50.444876 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:50.444887 | orchestrator | 2026-04-28 06:13:50.444898 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-28 06:13:50.444909 | orchestrator | Tuesday 28 April 2026 06:13:40 +0000 (0:00:01.285) 0:58:13.807 ********* 2026-04-28 06:13:50.444920 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:13:50.444930 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:13:50.444941 | orchestrator | 2026-04-28 06:13:50.444952 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-28 06:13:50.444962 | orchestrator | Tuesday 28 April 2026 06:13:41 +0000 (0:00:01.234) 0:58:15.041 ********* 2026-04-28 06:13:50.444973 | orchestrator | changed: [testbed-node-3 -> testbed-node-2(192.168.16.12)] 2026-04-28 06:13:50.444984 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] 2026-04-28 06:13:50.444995 | orchestrator | 2026-04-28 06:13:50.445006 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-28 06:13:50.445017 | orchestrator | Tuesday 28 April 2026 06:13:46 +0000 (0:00:05.017) 0:58:20.058 ********* 2026-04-28 06:13:50.445028 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-28 06:13:50.445039 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-28 06:13:50.445049 | orchestrator | 2026-04-28 06:13:50.445060 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-28 06:13:50.445071 | orchestrator | Tuesday 28 April 2026 06:13:47 +0000 (0:00:01.309) 0:58:21.368 ********* 2026-04-28 06:13:50.445084 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log'}]) 2026-04-28 06:13:50.445112 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log'}]) 2026-04-28 06:14:41.106354 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.13:8081'}]) 2026-04-28 06:14:41.106456 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.15:8081'}]) 2026-04-28 06:14:41.106525 | orchestrator | 2026-04-28 06:14:41.106539 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-28 06:14:41.106548 | orchestrator | Tuesday 28 April 2026 06:13:53 +0000 (0:00:05.532) 0:58:26.900 ********* 2026-04-28 06:14:41.106556 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:14:41.106566 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:14:41.106574 | orchestrator | 2026-04-28 06:14:41.106604 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-28 06:14:41.106613 | orchestrator | Tuesday 28 April 2026 06:13:54 +0000 (0:00:01.281) 0:58:28.182 ********* 2026-04-28 06:14:41.106620 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:14:41.106628 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:14:41.106636 | orchestrator | 2026-04-28 06:14:41.106644 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 06:14:41.106653 | orchestrator | Tuesday 28 April 2026 06:13:56 +0000 (0:00:01.254) 0:58:29.436 ********* 2026-04-28 06:14:41.106661 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:14:41.106669 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:14:41.106677 | orchestrator | 2026-04-28 06:14:41.106684 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 06:14:41.106692 | orchestrator | Tuesday 28 April 2026 06:13:57 +0000 (0:00:01.249) 0:58:30.685 ********* 2026-04-28 06:14:41.106700 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:14:41.106707 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:14:41.106715 | orchestrator | 2026-04-28 06:14:41.106723 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 06:14:41.106730 | orchestrator | Tuesday 28 April 2026 06:13:58 +0000 (0:00:01.287) 0:58:31.973 ********* 2026-04-28 06:14:41.106738 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:14:41.106746 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:14:41.106753 | orchestrator | 2026-04-28 06:14:41.106761 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 06:14:41.106769 | orchestrator | Tuesday 28 April 2026 06:13:59 +0000 (0:00:01.289) 0:58:33.263 ********* 2026-04-28 06:14:41.106776 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:14:41.106786 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:14:41.106793 | orchestrator | 2026-04-28 06:14:41.106801 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 06:14:41.106809 | orchestrator | Tuesday 28 April 2026 06:14:01 +0000 (0:00:01.404) 0:58:34.667 ********* 2026-04-28 06:14:41.106816 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 06:14:41.106824 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 06:14:41.106832 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 06:14:41.106840 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:14:41.106848 | orchestrator | 2026-04-28 06:14:41.106855 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 06:14:41.106863 | orchestrator | Tuesday 28 April 2026 06:14:03 +0000 (0:00:01.962) 0:58:36.630 ********* 2026-04-28 06:14:41.106871 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 06:14:41.106878 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 06:14:41.106886 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 06:14:41.106893 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:14:41.106902 | orchestrator | 2026-04-28 06:14:41.106911 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 06:14:41.106920 | orchestrator | Tuesday 28 April 2026 06:14:04 +0000 (0:00:01.432) 0:58:38.063 ********* 2026-04-28 06:14:41.106928 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 06:14:41.106937 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 06:14:41.106946 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 06:14:41.106955 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:14:41.106965 | orchestrator | 2026-04-28 06:14:41.106974 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 06:14:41.106983 | orchestrator | Tuesday 28 April 2026 06:14:06 +0000 (0:00:01.512) 0:58:39.575 ********* 2026-04-28 06:14:41.106992 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:14:41.107001 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:14:41.107016 | orchestrator | 2026-04-28 06:14:41.107025 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 06:14:41.107034 | orchestrator | Tuesday 28 April 2026 06:14:07 +0000 (0:00:01.260) 0:58:40.836 ********* 2026-04-28 06:14:41.107043 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-28 06:14:41.107052 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-28 06:14:41.107060 | orchestrator | 2026-04-28 06:14:41.107081 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-28 06:14:41.107090 | orchestrator | Tuesday 28 April 2026 06:14:08 +0000 (0:00:01.481) 0:58:42.318 ********* 2026-04-28 06:14:41.107099 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:14:41.107108 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:14:41.107118 | orchestrator | 2026-04-28 06:14:41.107141 | orchestrator | TASK [ceph-mds : Include create_mds_filesystems.yml] *************************** 2026-04-28 06:14:41.107151 | orchestrator | Tuesday 28 April 2026 06:14:10 +0000 (0:00:01.842) 0:58:44.160 ********* 2026-04-28 06:14:41.107160 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:14:41.107168 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:14:41.107175 | orchestrator | 2026-04-28 06:14:41.107183 | orchestrator | TASK [ceph-mds : Include common.yml] ******************************************* 2026-04-28 06:14:41.107191 | orchestrator | Tuesday 28 April 2026 06:14:12 +0000 (0:00:01.767) 0:58:45.928 ********* 2026-04-28 06:14:41.107199 | orchestrator | included: /ansible/roles/ceph-mds/tasks/common.yml for testbed-node-3, testbed-node-5 2026-04-28 06:14:41.107207 | orchestrator | 2026-04-28 06:14:41.107215 | orchestrator | TASK [ceph-mds : Create bootstrap-mds and mds directories] ********************* 2026-04-28 06:14:41.107222 | orchestrator | Tuesday 28 April 2026 06:14:13 +0000 (0:00:01.269) 0:58:47.197 ********* 2026-04-28 06:14:41.107230 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mds/) 2026-04-28 06:14:41.107237 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mds/) 2026-04-28 06:14:41.107245 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/mds/ceph-testbed-node-3) 2026-04-28 06:14:41.107253 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/mds/ceph-testbed-node-5) 2026-04-28 06:14:41.107260 | orchestrator | 2026-04-28 06:14:41.107268 | orchestrator | TASK [ceph-mds : Get keys from monitors] *************************************** 2026-04-28 06:14:41.107276 | orchestrator | Tuesday 28 April 2026 06:14:15 +0000 (0:00:01.936) 0:58:49.133 ********* 2026-04-28 06:14:41.107283 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 06:14:41.107291 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-28 06:14:41.107299 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-28 06:14:41.107306 | orchestrator | 2026-04-28 06:14:41.107314 | orchestrator | TASK [ceph-mds : Copy ceph key(s) if needed] *********************************** 2026-04-28 06:14:41.107322 | orchestrator | Tuesday 28 April 2026 06:14:18 +0000 (0:00:03.218) 0:58:52.352 ********* 2026-04-28 06:14:41.107330 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-28 06:14:41.107337 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-28 06:14:41.107345 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:14:41.107353 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-28 06:14:41.107361 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-28 06:14:41.107368 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:14:41.107376 | orchestrator | 2026-04-28 06:14:41.107383 | orchestrator | TASK [ceph-mds : Create mds keyring] ******************************************* 2026-04-28 06:14:41.107391 | orchestrator | Tuesday 28 April 2026 06:14:21 +0000 (0:00:02.139) 0:58:54.491 ********* 2026-04-28 06:14:41.107399 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:14:41.107406 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:14:41.107414 | orchestrator | 2026-04-28 06:14:41.107422 | orchestrator | TASK [ceph-mds : Non_containerized.yml] **************************************** 2026-04-28 06:14:41.107429 | orchestrator | Tuesday 28 April 2026 06:14:22 +0000 (0:00:01.599) 0:58:56.091 ********* 2026-04-28 06:14:41.107437 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:14:41.107450 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:14:41.107458 | orchestrator | 2026-04-28 06:14:41.107465 | orchestrator | TASK [ceph-mds : Containerized.yml] ******************************************** 2026-04-28 06:14:41.107498 | orchestrator | Tuesday 28 April 2026 06:14:24 +0000 (0:00:01.670) 0:58:57.762 ********* 2026-04-28 06:14:41.107506 | orchestrator | included: /ansible/roles/ceph-mds/tasks/containerized.yml for testbed-node-3, testbed-node-5 2026-04-28 06:14:41.107514 | orchestrator | 2026-04-28 06:14:41.107522 | orchestrator | TASK [ceph-mds : Include_tasks systemd.yml] ************************************ 2026-04-28 06:14:41.107529 | orchestrator | Tuesday 28 April 2026 06:14:25 +0000 (0:00:01.314) 0:58:59.077 ********* 2026-04-28 06:14:41.107537 | orchestrator | included: /ansible/roles/ceph-mds/tasks/systemd.yml for testbed-node-3, testbed-node-5 2026-04-28 06:14:41.107544 | orchestrator | 2026-04-28 06:14:41.107552 | orchestrator | TASK [ceph-mds : Generate systemd unit file] *********************************** 2026-04-28 06:14:41.107560 | orchestrator | Tuesday 28 April 2026 06:14:27 +0000 (0:00:01.322) 0:59:00.399 ********* 2026-04-28 06:14:41.107567 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:14:41.107575 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:14:41.107582 | orchestrator | 2026-04-28 06:14:41.107590 | orchestrator | TASK [ceph-mds : Generate systemd ceph-mds target file] ************************ 2026-04-28 06:14:41.107598 | orchestrator | Tuesday 28 April 2026 06:14:29 +0000 (0:00:02.132) 0:59:02.532 ********* 2026-04-28 06:14:41.107605 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:14:41.107613 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:14:41.107620 | orchestrator | 2026-04-28 06:14:41.107628 | orchestrator | TASK [ceph-mds : Enable ceph-mds.target] *************************************** 2026-04-28 06:14:41.107636 | orchestrator | Tuesday 28 April 2026 06:14:31 +0000 (0:00:02.249) 0:59:04.781 ********* 2026-04-28 06:14:41.107644 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:14:41.107651 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:14:41.107659 | orchestrator | 2026-04-28 06:14:41.107667 | orchestrator | TASK [ceph-mds : Systemd start mds container] ********************************** 2026-04-28 06:14:41.107674 | orchestrator | Tuesday 28 April 2026 06:14:33 +0000 (0:00:02.431) 0:59:07.213 ********* 2026-04-28 06:14:41.107682 | orchestrator | changed: [testbed-node-3] 2026-04-28 06:14:41.107689 | orchestrator | changed: [testbed-node-5] 2026-04-28 06:14:41.107697 | orchestrator | 2026-04-28 06:14:41.107705 | orchestrator | TASK [ceph-mds : Wait for mds socket to exist] ********************************* 2026-04-28 06:14:41.107712 | orchestrator | Tuesday 28 April 2026 06:14:37 +0000 (0:00:03.507) 0:59:10.720 ********* 2026-04-28 06:14:41.107720 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:14:41.107728 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:14:41.107735 | orchestrator | 2026-04-28 06:14:41.107747 | orchestrator | TASK [Set max_mds] ************************************************************* 2026-04-28 06:14:41.107755 | orchestrator | Tuesday 28 April 2026 06:14:39 +0000 (0:00:01.730) 0:59:12.451 ********* 2026-04-28 06:14:41.107763 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:14:41.107775 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-28 06:15:05.828576 | orchestrator | 2026-04-28 06:15:05.828696 | orchestrator | PLAY [Upgrade ceph rgws cluster] *********************************************** 2026-04-28 06:15:05.828712 | orchestrator | 2026-04-28 06:15:05.828724 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 06:15:05.828736 | orchestrator | Tuesday 28 April 2026 06:14:42 +0000 (0:00:03.356) 0:59:15.807 ********* 2026-04-28 06:15:05.828747 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-3 2026-04-28 06:15:05.828757 | orchestrator | 2026-04-28 06:15:05.828768 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-28 06:15:05.828779 | orchestrator | Tuesday 28 April 2026 06:14:43 +0000 (0:00:01.354) 0:59:17.162 ********* 2026-04-28 06:15:05.828790 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:15:05.828803 | orchestrator | 2026-04-28 06:15:05.828814 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-28 06:15:05.828850 | orchestrator | Tuesday 28 April 2026 06:14:45 +0000 (0:00:01.444) 0:59:18.607 ********* 2026-04-28 06:15:05.828862 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:15:05.828872 | orchestrator | 2026-04-28 06:15:05.828883 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 06:15:05.828894 | orchestrator | Tuesday 28 April 2026 06:14:46 +0000 (0:00:01.145) 0:59:19.753 ********* 2026-04-28 06:15:05.828905 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:15:05.828916 | orchestrator | 2026-04-28 06:15:05.828927 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 06:15:05.828938 | orchestrator | Tuesday 28 April 2026 06:14:47 +0000 (0:00:01.449) 0:59:21.202 ********* 2026-04-28 06:15:05.828948 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:15:05.828959 | orchestrator | 2026-04-28 06:15:05.828970 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-28 06:15:05.828981 | orchestrator | Tuesday 28 April 2026 06:14:48 +0000 (0:00:01.123) 0:59:22.326 ********* 2026-04-28 06:15:05.828991 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:15:05.829002 | orchestrator | 2026-04-28 06:15:05.829014 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-28 06:15:05.829025 | orchestrator | Tuesday 28 April 2026 06:14:50 +0000 (0:00:01.139) 0:59:23.465 ********* 2026-04-28 06:15:05.829036 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:15:05.829046 | orchestrator | 2026-04-28 06:15:05.829057 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-28 06:15:05.829071 | orchestrator | Tuesday 28 April 2026 06:14:51 +0000 (0:00:01.216) 0:59:24.682 ********* 2026-04-28 06:15:05.829084 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:05.829097 | orchestrator | 2026-04-28 06:15:05.829110 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-28 06:15:05.829123 | orchestrator | Tuesday 28 April 2026 06:14:52 +0000 (0:00:01.129) 0:59:25.812 ********* 2026-04-28 06:15:05.829136 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:15:05.829148 | orchestrator | 2026-04-28 06:15:05.829176 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-28 06:15:05.829189 | orchestrator | Tuesday 28 April 2026 06:14:53 +0000 (0:00:01.122) 0:59:26.935 ********* 2026-04-28 06:15:05.829201 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:15:05.829213 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:15:05.829226 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:15:05.829238 | orchestrator | 2026-04-28 06:15:05.829251 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-28 06:15:05.829264 | orchestrator | Tuesday 28 April 2026 06:14:55 +0000 (0:00:02.184) 0:59:29.120 ********* 2026-04-28 06:15:05.829277 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:15:05.829289 | orchestrator | 2026-04-28 06:15:05.829302 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-28 06:15:05.829315 | orchestrator | Tuesday 28 April 2026 06:14:57 +0000 (0:00:01.299) 0:59:30.419 ********* 2026-04-28 06:15:05.829327 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:15:05.829340 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:15:05.829353 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:15:05.829366 | orchestrator | 2026-04-28 06:15:05.829379 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-28 06:15:05.829392 | orchestrator | Tuesday 28 April 2026 06:15:00 +0000 (0:00:03.284) 0:59:33.704 ********* 2026-04-28 06:15:05.829406 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-28 06:15:05.829438 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-28 06:15:05.829449 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-28 06:15:05.829468 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:05.829479 | orchestrator | 2026-04-28 06:15:05.829490 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-28 06:15:05.829501 | orchestrator | Tuesday 28 April 2026 06:15:02 +0000 (0:00:01.892) 0:59:35.597 ********* 2026-04-28 06:15:05.829513 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-28 06:15:05.829542 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-28 06:15:05.829572 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-28 06:15:05.829584 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:05.829595 | orchestrator | 2026-04-28 06:15:05.829606 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-28 06:15:05.829617 | orchestrator | Tuesday 28 April 2026 06:15:04 +0000 (0:00:02.194) 0:59:37.792 ********* 2026-04-28 06:15:05.829631 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 06:15:05.829646 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 06:15:05.829657 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 06:15:05.829669 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:05.829680 | orchestrator | 2026-04-28 06:15:05.829691 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-28 06:15:05.829702 | orchestrator | Tuesday 28 April 2026 06:15:05 +0000 (0:00:01.187) 0:59:38.980 ********* 2026-04-28 06:15:05.829716 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': 'e79a9ee6c12b', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-28 06:14:57.590367', 'end': '2026-04-28 06:14:57.640956', 'delta': '0:00:00.050589', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e79a9ee6c12b'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-28 06:15:05.829731 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': '00fb93644bb9', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-28 06:14:58.550816', 'end': '2026-04-28 06:14:58.600486', 'delta': '0:00:00.049670', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['00fb93644bb9'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-28 06:15:05.829756 | orchestrator | ok: [testbed-node-3] => (item={'changed': False, 'stdout': '92b926b7d044', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-28 06:14:59.115588', 'end': '2026-04-28 06:14:59.169873', 'delta': '0:00:00.054285', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['92b926b7d044'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-28 06:15:05.829768 | orchestrator | 2026-04-28 06:15:05.829786 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-28 06:15:23.958328 | orchestrator | Tuesday 28 April 2026 06:15:06 +0000 (0:00:01.180) 0:59:40.161 ********* 2026-04-28 06:15:23.958505 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:15:23.958523 | orchestrator | 2026-04-28 06:15:23.958535 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-28 06:15:23.958546 | orchestrator | Tuesday 28 April 2026 06:15:07 +0000 (0:00:01.179) 0:59:41.341 ********* 2026-04-28 06:15:23.958556 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:23.958567 | orchestrator | 2026-04-28 06:15:23.958577 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-28 06:15:23.958586 | orchestrator | Tuesday 28 April 2026 06:15:09 +0000 (0:00:01.201) 0:59:42.542 ********* 2026-04-28 06:15:23.958596 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:15:23.958606 | orchestrator | 2026-04-28 06:15:23.958616 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-28 06:15:23.958626 | orchestrator | Tuesday 28 April 2026 06:15:10 +0000 (0:00:01.108) 0:59:43.651 ********* 2026-04-28 06:15:23.958635 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-28 06:15:23.958645 | orchestrator | 2026-04-28 06:15:23.958655 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 06:15:23.958665 | orchestrator | Tuesday 28 April 2026 06:15:12 +0000 (0:00:01.894) 0:59:45.546 ********* 2026-04-28 06:15:23.958674 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:15:23.958684 | orchestrator | 2026-04-28 06:15:23.958693 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-28 06:15:23.958703 | orchestrator | Tuesday 28 April 2026 06:15:13 +0000 (0:00:01.103) 0:59:46.650 ********* 2026-04-28 06:15:23.958713 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:23.958722 | orchestrator | 2026-04-28 06:15:23.958732 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-28 06:15:23.958741 | orchestrator | Tuesday 28 April 2026 06:15:14 +0000 (0:00:01.109) 0:59:47.760 ********* 2026-04-28 06:15:23.958751 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:23.958761 | orchestrator | 2026-04-28 06:15:23.958770 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 06:15:23.958781 | orchestrator | Tuesday 28 April 2026 06:15:15 +0000 (0:00:01.215) 0:59:48.976 ********* 2026-04-28 06:15:23.958791 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:23.958801 | orchestrator | 2026-04-28 06:15:23.958810 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-28 06:15:23.958820 | orchestrator | Tuesday 28 April 2026 06:15:16 +0000 (0:00:01.172) 0:59:50.148 ********* 2026-04-28 06:15:23.958853 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:23.958865 | orchestrator | 2026-04-28 06:15:23.958876 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-28 06:15:23.958887 | orchestrator | Tuesday 28 April 2026 06:15:17 +0000 (0:00:01.145) 0:59:51.294 ********* 2026-04-28 06:15:23.958898 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:15:23.958909 | orchestrator | 2026-04-28 06:15:23.958921 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-28 06:15:23.958931 | orchestrator | Tuesday 28 April 2026 06:15:19 +0000 (0:00:01.148) 0:59:52.443 ********* 2026-04-28 06:15:23.958943 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:23.958953 | orchestrator | 2026-04-28 06:15:23.958962 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-28 06:15:23.958972 | orchestrator | Tuesday 28 April 2026 06:15:20 +0000 (0:00:01.091) 0:59:53.534 ********* 2026-04-28 06:15:23.958981 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:15:23.958991 | orchestrator | 2026-04-28 06:15:23.959000 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-28 06:15:23.959010 | orchestrator | Tuesday 28 April 2026 06:15:21 +0000 (0:00:01.265) 0:59:54.799 ********* 2026-04-28 06:15:23.959019 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:23.959029 | orchestrator | 2026-04-28 06:15:23.959038 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-28 06:15:23.959048 | orchestrator | Tuesday 28 April 2026 06:15:22 +0000 (0:00:01.103) 0:59:55.903 ********* 2026-04-28 06:15:23.959057 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:15:23.959067 | orchestrator | 2026-04-28 06:15:23.959076 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-28 06:15:23.959086 | orchestrator | Tuesday 28 April 2026 06:15:23 +0000 (0:00:01.234) 0:59:57.139 ********* 2026-04-28 06:15:23.959098 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:15:23.959126 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1', 'dm-uuid-LVM-SMcSbjI9wnD6SeY7SKKJ6dCSoT074g1SuE3hmfWZ3V1NoBQYcdXeMp0c5DwXf9Jz'], 'uuids': ['bb15ffa5-db58-4aaf-8e50-4b001450e00b'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f7edf0fa', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz']}})  2026-04-28 06:15:23.959159 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c', 'scsi-SQEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '0b1dfca7', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 06:15:23.959172 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-CCJsyU-Xs4y-bAwu-Sr1U-RU9B-U5cX-8dk8mo', 'scsi-0QEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202', 'scsi-SQEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46b7ee74', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f']}})  2026-04-28 06:15:23.959193 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:15:23.959204 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:15:23.959215 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-18-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 06:15:23.959226 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:15:23.959241 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu', 'dm-uuid-CRYPT-LUKS2-5da20da06cd949e5b229e06742b9ea2c-94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 06:15:23.959260 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:15:25.263097 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f', 'dm-uuid-LVM-8dHS1FAptgldbJuN9Gw1hr0pl5XswJ3894zCAdztzvSylGKJfL2Zwu5Qsrm0jqWu'], 'uuids': ['5da20da0-6cd9-49e5-b229-e06742b9ea2c'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '46b7ee74', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu']}})  2026-04-28 06:15:25.263223 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-rTHLNA-XX65-cEa6-oPdR-i0kN-CrZ9-dGTohN', 'scsi-0QEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675', 'scsi-SQEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f7edf0fa', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1']}})  2026-04-28 06:15:25.263241 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:15:25.263273 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '3fe92a08', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 06:15:25.263309 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:15:25.263330 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:15:25.263343 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz', 'dm-uuid-CRYPT-LUKS2-bb15ffa5db584aaf8e504b001450e00b-uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 06:15:25.263357 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:25.263415 | orchestrator | 2026-04-28 06:15:25.263429 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-28 06:15:25.263441 | orchestrator | Tuesday 28 April 2026 06:15:25 +0000 (0:00:01.367) 0:59:58.506 ********* 2026-04-28 06:15:25.263454 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:15:25.263468 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1', 'dm-uuid-LVM-SMcSbjI9wnD6SeY7SKKJ6dCSoT074g1SuE3hmfWZ3V1NoBQYcdXeMp0c5DwXf9Jz'], 'uuids': ['bb15ffa5-db58-4aaf-8e50-4b001450e00b'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f7edf0fa', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:15:25.263486 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c', 'scsi-SQEMU_QEMU_HARDDISK_0b1dfca7-ca1b-4a54-8f84-50c64916129c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '0b1dfca7', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:15:25.263508 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-CCJsyU-Xs4y-bAwu-Sr1U-RU9B-U5cX-8dk8mo', 'scsi-0QEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202', 'scsi-SQEMU_QEMU_HARDDISK_46b7ee74-39f0-45ac-8133-a4f9630b6202'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46b7ee74', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:15:25.403264 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:15:25.403365 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:15:25.403441 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-18-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:15:25.403454 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:15:25.403484 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu', 'dm-uuid-CRYPT-LUKS2-5da20da06cd949e5b229e06742b9ea2c-94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:15:25.403518 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:15:25.403556 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f-osd--block--b91f22db--c1ee--55b4--b9b8--1bae9cdca76f', 'dm-uuid-LVM-8dHS1FAptgldbJuN9Gw1hr0pl5XswJ3894zCAdztzvSylGKJfL2Zwu5Qsrm0jqWu'], 'uuids': ['5da20da0-6cd9-49e5-b229-e06742b9ea2c'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '46b7ee74', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['94zCAd-ztzv-SylG-KJfL-2Zwu-5Qsr-m0jqWu']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:15:25.403577 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-rTHLNA-XX65-cEa6-oPdR-i0kN-CrZ9-dGTohN', 'scsi-0QEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675', 'scsi-SQEMU_QEMU_HARDDISK_f7edf0fa-df72-4a27-ba4e-1e8a72709675'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f7edf0fa', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--be99929f--8eb5--5413--bbfd--d844b44bc4d1-osd--block--be99929f--8eb5--5413--bbfd--d844b44bc4d1']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:15:25.403591 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:15:25.403619 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '3fe92a08', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1', 'scsi-SQEMU_QEMU_HARDDISK_3fe92a08-106b-4716-8c84-89d856c2d73e-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:15:55.202588 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:15:55.202740 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:15:55.202768 | orchestrator | skipping: [testbed-node-3] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz', 'dm-uuid-CRYPT-LUKS2-bb15ffa5db584aaf8e504b001450e00b-uE3hmf-WZ3V-1NoB-QYcd-XeMp-0c5D-wXf9Jz'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:15:55.202790 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:55.202812 | orchestrator | 2026-04-28 06:15:55.202832 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-28 06:15:55.202852 | orchestrator | Tuesday 28 April 2026 06:15:26 +0000 (0:00:01.464) 0:59:59.971 ********* 2026-04-28 06:15:55.202890 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:15:55.202943 | orchestrator | 2026-04-28 06:15:55.202962 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-28 06:15:55.202981 | orchestrator | Tuesday 28 April 2026 06:15:28 +0000 (0:00:01.522) 1:00:01.494 ********* 2026-04-28 06:15:55.202999 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:15:55.203017 | orchestrator | 2026-04-28 06:15:55.203035 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 06:15:55.203052 | orchestrator | Tuesday 28 April 2026 06:15:29 +0000 (0:00:01.131) 1:00:02.626 ********* 2026-04-28 06:15:55.203069 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:15:55.203088 | orchestrator | 2026-04-28 06:15:55.203108 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 06:15:55.203128 | orchestrator | Tuesday 28 April 2026 06:15:30 +0000 (0:00:01.505) 1:00:04.131 ********* 2026-04-28 06:15:55.203141 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:55.203155 | orchestrator | 2026-04-28 06:15:55.203167 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 06:15:55.203179 | orchestrator | Tuesday 28 April 2026 06:15:31 +0000 (0:00:01.151) 1:00:05.283 ********* 2026-04-28 06:15:55.203191 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:55.203203 | orchestrator | 2026-04-28 06:15:55.203215 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 06:15:55.203227 | orchestrator | Tuesday 28 April 2026 06:15:33 +0000 (0:00:01.220) 1:00:06.504 ********* 2026-04-28 06:15:55.203239 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:55.203251 | orchestrator | 2026-04-28 06:15:55.203267 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-28 06:15:55.203285 | orchestrator | Tuesday 28 April 2026 06:15:34 +0000 (0:00:01.128) 1:00:07.632 ********* 2026-04-28 06:15:55.203347 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-0) 2026-04-28 06:15:55.203370 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-1) 2026-04-28 06:15:55.203388 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-2) 2026-04-28 06:15:55.203407 | orchestrator | 2026-04-28 06:15:55.203424 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-28 06:15:55.203442 | orchestrator | Tuesday 28 April 2026 06:15:36 +0000 (0:00:02.078) 1:00:09.711 ********* 2026-04-28 06:15:55.203459 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-0)  2026-04-28 06:15:55.203478 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-1)  2026-04-28 06:15:55.203496 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-2)  2026-04-28 06:15:55.203514 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:55.203533 | orchestrator | 2026-04-28 06:15:55.203553 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-28 06:15:55.203572 | orchestrator | Tuesday 28 April 2026 06:15:37 +0000 (0:00:01.171) 1:00:10.883 ********* 2026-04-28 06:15:55.203618 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-3 2026-04-28 06:15:55.203640 | orchestrator | 2026-04-28 06:15:55.203660 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 06:15:55.203680 | orchestrator | Tuesday 28 April 2026 06:15:38 +0000 (0:00:01.364) 1:00:12.247 ********* 2026-04-28 06:15:55.203699 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:55.203715 | orchestrator | 2026-04-28 06:15:55.203734 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 06:15:55.203752 | orchestrator | Tuesday 28 April 2026 06:15:40 +0000 (0:00:01.185) 1:00:13.432 ********* 2026-04-28 06:15:55.203770 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:55.203790 | orchestrator | 2026-04-28 06:15:55.203808 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 06:15:55.203826 | orchestrator | Tuesday 28 April 2026 06:15:41 +0000 (0:00:01.149) 1:00:14.582 ********* 2026-04-28 06:15:55.203845 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:55.203884 | orchestrator | 2026-04-28 06:15:55.203906 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 06:15:55.203925 | orchestrator | Tuesday 28 April 2026 06:15:42 +0000 (0:00:01.147) 1:00:15.729 ********* 2026-04-28 06:15:55.203944 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:15:55.203962 | orchestrator | 2026-04-28 06:15:55.203981 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 06:15:55.203995 | orchestrator | Tuesday 28 April 2026 06:15:43 +0000 (0:00:01.210) 1:00:16.940 ********* 2026-04-28 06:15:55.204006 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 06:15:55.204017 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 06:15:55.204027 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 06:15:55.204038 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:55.204049 | orchestrator | 2026-04-28 06:15:55.204059 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 06:15:55.204070 | orchestrator | Tuesday 28 April 2026 06:15:44 +0000 (0:00:01.440) 1:00:18.381 ********* 2026-04-28 06:15:55.204080 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 06:15:55.204092 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 06:15:55.204103 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 06:15:55.204114 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:55.204124 | orchestrator | 2026-04-28 06:15:55.204135 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 06:15:55.204146 | orchestrator | Tuesday 28 April 2026 06:15:46 +0000 (0:00:01.428) 1:00:19.809 ********* 2026-04-28 06:15:55.204156 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 06:15:55.204167 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 06:15:55.204177 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 06:15:55.204187 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:15:55.204198 | orchestrator | 2026-04-28 06:15:55.204218 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 06:15:55.204229 | orchestrator | Tuesday 28 April 2026 06:15:47 +0000 (0:00:01.455) 1:00:21.265 ********* 2026-04-28 06:15:55.204240 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:15:55.204251 | orchestrator | 2026-04-28 06:15:55.204261 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 06:15:55.204272 | orchestrator | Tuesday 28 April 2026 06:15:49 +0000 (0:00:01.162) 1:00:22.428 ********* 2026-04-28 06:15:55.204283 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-28 06:15:55.204293 | orchestrator | 2026-04-28 06:15:55.204330 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-28 06:15:55.204344 | orchestrator | Tuesday 28 April 2026 06:15:50 +0000 (0:00:01.361) 1:00:23.789 ********* 2026-04-28 06:15:55.204354 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:15:55.204365 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:15:55.204375 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:15:55.204386 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-28 06:15:55.204397 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 06:15:55.204407 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 06:15:55.204418 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 06:15:55.204428 | orchestrator | 2026-04-28 06:15:55.204439 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-28 06:15:55.204450 | orchestrator | Tuesday 28 April 2026 06:15:52 +0000 (0:00:02.267) 1:00:26.057 ********* 2026-04-28 06:15:55.204460 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:15:55.204479 | orchestrator | ok: [testbed-node-3 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:15:55.204490 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:15:55.204500 | orchestrator | ok: [testbed-node-3] => (item=testbed-node-3) 2026-04-28 06:15:55.204511 | orchestrator | ok: [testbed-node-3 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 06:15:55.204521 | orchestrator | ok: [testbed-node-3 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 06:15:55.204532 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 06:15:55.204543 | orchestrator | 2026-04-28 06:15:55.204564 | orchestrator | TASK [Stop ceph rgw when upgrading from stable-3.2] **************************** 2026-04-28 06:16:49.128976 | orchestrator | Tuesday 28 April 2026 06:15:55 +0000 (0:00:03.210) 1:00:29.267 ********* 2026-04-28 06:16:49.129107 | orchestrator | changed: [testbed-node-3] 2026-04-28 06:16:49.129126 | orchestrator | 2026-04-28 06:16:49.129139 | orchestrator | TASK [Stop ceph rgw (pt. 1)] *************************************************** 2026-04-28 06:16:49.129151 | orchestrator | Tuesday 28 April 2026 06:15:58 +0000 (0:00:02.274) 1:00:31.542 ********* 2026-04-28 06:16:49.129162 | orchestrator | changed: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-28 06:16:49.129175 | orchestrator | 2026-04-28 06:16:49.129186 | orchestrator | TASK [Stop ceph rgw (pt. 2)] *************************************************** 2026-04-28 06:16:49.129233 | orchestrator | Tuesday 28 April 2026 06:16:01 +0000 (0:00:02.905) 1:00:34.447 ********* 2026-04-28 06:16:49.129246 | orchestrator | changed: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-28 06:16:49.129257 | orchestrator | 2026-04-28 06:16:49.129268 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 06:16:49.129279 | orchestrator | Tuesday 28 April 2026 06:16:03 +0000 (0:00:02.330) 1:00:36.778 ********* 2026-04-28 06:16:49.129289 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-3 2026-04-28 06:16:49.129301 | orchestrator | 2026-04-28 06:16:49.129311 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 06:16:49.129322 | orchestrator | Tuesday 28 April 2026 06:16:04 +0000 (0:00:01.090) 1:00:37.869 ********* 2026-04-28 06:16:49.129333 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-3 2026-04-28 06:16:49.129344 | orchestrator | 2026-04-28 06:16:49.129354 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 06:16:49.129365 | orchestrator | Tuesday 28 April 2026 06:16:05 +0000 (0:00:01.124) 1:00:38.993 ********* 2026-04-28 06:16:49.129376 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:16:49.129386 | orchestrator | 2026-04-28 06:16:49.129397 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 06:16:49.129408 | orchestrator | Tuesday 28 April 2026 06:16:06 +0000 (0:00:01.113) 1:00:40.107 ********* 2026-04-28 06:16:49.129419 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:16:49.129430 | orchestrator | 2026-04-28 06:16:49.129441 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 06:16:49.129452 | orchestrator | Tuesday 28 April 2026 06:16:08 +0000 (0:00:01.514) 1:00:41.622 ********* 2026-04-28 06:16:49.129463 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:16:49.129473 | orchestrator | 2026-04-28 06:16:49.129484 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 06:16:49.129495 | orchestrator | Tuesday 28 April 2026 06:16:09 +0000 (0:00:01.522) 1:00:43.144 ********* 2026-04-28 06:16:49.129506 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:16:49.129519 | orchestrator | 2026-04-28 06:16:49.129531 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 06:16:49.129561 | orchestrator | Tuesday 28 April 2026 06:16:11 +0000 (0:00:01.537) 1:00:44.681 ********* 2026-04-28 06:16:49.129597 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:16:49.129610 | orchestrator | 2026-04-28 06:16:49.129623 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 06:16:49.129635 | orchestrator | Tuesday 28 April 2026 06:16:12 +0000 (0:00:01.136) 1:00:45.818 ********* 2026-04-28 06:16:49.129647 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:16:49.129659 | orchestrator | 2026-04-28 06:16:49.129671 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 06:16:49.129685 | orchestrator | Tuesday 28 April 2026 06:16:13 +0000 (0:00:01.222) 1:00:47.040 ********* 2026-04-28 06:16:49.129697 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:16:49.129710 | orchestrator | 2026-04-28 06:16:49.129722 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 06:16:49.129735 | orchestrator | Tuesday 28 April 2026 06:16:14 +0000 (0:00:01.152) 1:00:48.193 ********* 2026-04-28 06:16:49.129747 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:16:49.129759 | orchestrator | 2026-04-28 06:16:49.129771 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 06:16:49.129784 | orchestrator | Tuesday 28 April 2026 06:16:16 +0000 (0:00:01.590) 1:00:49.784 ********* 2026-04-28 06:16:49.129796 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:16:49.129808 | orchestrator | 2026-04-28 06:16:49.129821 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 06:16:49.129833 | orchestrator | Tuesday 28 April 2026 06:16:17 +0000 (0:00:01.540) 1:00:51.325 ********* 2026-04-28 06:16:49.129846 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:16:49.129858 | orchestrator | 2026-04-28 06:16:49.129870 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 06:16:49.129881 | orchestrator | Tuesday 28 April 2026 06:16:19 +0000 (0:00:01.110) 1:00:52.436 ********* 2026-04-28 06:16:49.129891 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:16:49.129902 | orchestrator | 2026-04-28 06:16:49.129912 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 06:16:49.129923 | orchestrator | Tuesday 28 April 2026 06:16:20 +0000 (0:00:01.143) 1:00:53.579 ********* 2026-04-28 06:16:49.129934 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:16:49.129944 | orchestrator | 2026-04-28 06:16:49.129955 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 06:16:49.129966 | orchestrator | Tuesday 28 April 2026 06:16:21 +0000 (0:00:01.137) 1:00:54.717 ********* 2026-04-28 06:16:49.129976 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:16:49.129987 | orchestrator | 2026-04-28 06:16:49.129997 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 06:16:49.130008 | orchestrator | Tuesday 28 April 2026 06:16:22 +0000 (0:00:01.132) 1:00:55.849 ********* 2026-04-28 06:16:49.130081 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:16:49.130096 | orchestrator | 2026-04-28 06:16:49.130125 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 06:16:49.130137 | orchestrator | Tuesday 28 April 2026 06:16:23 +0000 (0:00:01.149) 1:00:56.999 ********* 2026-04-28 06:16:49.130148 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:16:49.130158 | orchestrator | 2026-04-28 06:16:49.130169 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 06:16:49.130180 | orchestrator | Tuesday 28 April 2026 06:16:24 +0000 (0:00:01.131) 1:00:58.131 ********* 2026-04-28 06:16:49.130190 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:16:49.130223 | orchestrator | 2026-04-28 06:16:49.130235 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 06:16:49.130245 | orchestrator | Tuesday 28 April 2026 06:16:25 +0000 (0:00:01.174) 1:00:59.305 ********* 2026-04-28 06:16:49.130256 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:16:49.130267 | orchestrator | 2026-04-28 06:16:49.130277 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 06:16:49.130288 | orchestrator | Tuesday 28 April 2026 06:16:27 +0000 (0:00:01.190) 1:01:00.495 ********* 2026-04-28 06:16:49.130308 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:16:49.130319 | orchestrator | 2026-04-28 06:16:49.130329 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 06:16:49.130340 | orchestrator | Tuesday 28 April 2026 06:16:28 +0000 (0:00:01.159) 1:01:01.655 ********* 2026-04-28 06:16:49.130350 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:16:49.130361 | orchestrator | 2026-04-28 06:16:49.130371 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-28 06:16:49.130382 | orchestrator | Tuesday 28 April 2026 06:16:29 +0000 (0:00:01.413) 1:01:03.068 ********* 2026-04-28 06:16:49.130392 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:16:49.130403 | orchestrator | 2026-04-28 06:16:49.130414 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-28 06:16:49.130424 | orchestrator | Tuesday 28 April 2026 06:16:30 +0000 (0:00:01.160) 1:01:04.229 ********* 2026-04-28 06:16:49.130435 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:16:49.130445 | orchestrator | 2026-04-28 06:16:49.130456 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-28 06:16:49.130467 | orchestrator | Tuesday 28 April 2026 06:16:32 +0000 (0:00:01.173) 1:01:05.402 ********* 2026-04-28 06:16:49.130477 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:16:49.130488 | orchestrator | 2026-04-28 06:16:49.130499 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-28 06:16:49.130509 | orchestrator | Tuesday 28 April 2026 06:16:33 +0000 (0:00:01.122) 1:01:06.524 ********* 2026-04-28 06:16:49.130520 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:16:49.130530 | orchestrator | 2026-04-28 06:16:49.130541 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-28 06:16:49.130551 | orchestrator | Tuesday 28 April 2026 06:16:34 +0000 (0:00:01.143) 1:01:07.668 ********* 2026-04-28 06:16:49.130562 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:16:49.130572 | orchestrator | 2026-04-28 06:16:49.130583 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-28 06:16:49.130594 | orchestrator | Tuesday 28 April 2026 06:16:35 +0000 (0:00:01.166) 1:01:08.835 ********* 2026-04-28 06:16:49.130604 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:16:49.130615 | orchestrator | 2026-04-28 06:16:49.130632 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-28 06:16:49.130643 | orchestrator | Tuesday 28 April 2026 06:16:36 +0000 (0:00:01.122) 1:01:09.958 ********* 2026-04-28 06:16:49.130653 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:16:49.130664 | orchestrator | 2026-04-28 06:16:49.130675 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-28 06:16:49.130686 | orchestrator | Tuesday 28 April 2026 06:16:37 +0000 (0:00:01.110) 1:01:11.068 ********* 2026-04-28 06:16:49.130697 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:16:49.130707 | orchestrator | 2026-04-28 06:16:49.130718 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-28 06:16:49.130729 | orchestrator | Tuesday 28 April 2026 06:16:38 +0000 (0:00:01.111) 1:01:12.179 ********* 2026-04-28 06:16:49.130739 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:16:49.130750 | orchestrator | 2026-04-28 06:16:49.130760 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-28 06:16:49.130771 | orchestrator | Tuesday 28 April 2026 06:16:39 +0000 (0:00:01.139) 1:01:13.319 ********* 2026-04-28 06:16:49.130782 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:16:49.130792 | orchestrator | 2026-04-28 06:16:49.130803 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-28 06:16:49.130813 | orchestrator | Tuesday 28 April 2026 06:16:41 +0000 (0:00:01.152) 1:01:14.471 ********* 2026-04-28 06:16:49.130824 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:16:49.130834 | orchestrator | 2026-04-28 06:16:49.130845 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-28 06:16:49.130855 | orchestrator | Tuesday 28 April 2026 06:16:42 +0000 (0:00:01.133) 1:01:15.605 ********* 2026-04-28 06:16:49.130873 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:16:49.130884 | orchestrator | 2026-04-28 06:16:49.130894 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-28 06:16:49.130905 | orchestrator | Tuesday 28 April 2026 06:16:43 +0000 (0:00:01.396) 1:01:17.001 ********* 2026-04-28 06:16:49.130915 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:16:49.130926 | orchestrator | 2026-04-28 06:16:49.130937 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-28 06:16:49.130947 | orchestrator | Tuesday 28 April 2026 06:16:45 +0000 (0:00:02.077) 1:01:19.079 ********* 2026-04-28 06:16:49.130958 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:16:49.130968 | orchestrator | 2026-04-28 06:16:49.130979 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-28 06:16:49.130989 | orchestrator | Tuesday 28 April 2026 06:16:47 +0000 (0:00:02.297) 1:01:21.376 ********* 2026-04-28 06:16:49.131000 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-3 2026-04-28 06:16:49.131010 | orchestrator | 2026-04-28 06:16:49.131021 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-28 06:16:49.131039 | orchestrator | Tuesday 28 April 2026 06:16:49 +0000 (0:00:01.128) 1:01:22.504 ********* 2026-04-28 06:17:35.865006 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:17:35.865170 | orchestrator | 2026-04-28 06:17:35.865189 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-28 06:17:35.865202 | orchestrator | Tuesday 28 April 2026 06:16:50 +0000 (0:00:01.122) 1:01:23.627 ********* 2026-04-28 06:17:35.865212 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:17:35.865222 | orchestrator | 2026-04-28 06:17:35.865232 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-28 06:17:35.865242 | orchestrator | Tuesday 28 April 2026 06:16:51 +0000 (0:00:01.137) 1:01:24.765 ********* 2026-04-28 06:17:35.865252 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-28 06:17:35.865262 | orchestrator | ok: [testbed-node-3] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-28 06:17:35.865272 | orchestrator | 2026-04-28 06:17:35.865282 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-28 06:17:35.865291 | orchestrator | Tuesday 28 April 2026 06:16:53 +0000 (0:00:01.829) 1:01:26.594 ********* 2026-04-28 06:17:35.865301 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:17:35.865312 | orchestrator | 2026-04-28 06:17:35.865322 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-28 06:17:35.865339 | orchestrator | Tuesday 28 April 2026 06:16:54 +0000 (0:00:01.497) 1:01:28.092 ********* 2026-04-28 06:17:35.865356 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:17:35.865373 | orchestrator | 2026-04-28 06:17:35.865391 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-28 06:17:35.865408 | orchestrator | Tuesday 28 April 2026 06:16:55 +0000 (0:00:01.185) 1:01:29.278 ********* 2026-04-28 06:17:35.865424 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:17:35.865440 | orchestrator | 2026-04-28 06:17:35.865458 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-28 06:17:35.865475 | orchestrator | Tuesday 28 April 2026 06:16:57 +0000 (0:00:01.237) 1:01:30.515 ********* 2026-04-28 06:17:35.865491 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:17:35.865509 | orchestrator | 2026-04-28 06:17:35.865527 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-28 06:17:35.865544 | orchestrator | Tuesday 28 April 2026 06:16:58 +0000 (0:00:01.120) 1:01:31.636 ********* 2026-04-28 06:17:35.865562 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-3 2026-04-28 06:17:35.865580 | orchestrator | 2026-04-28 06:17:35.865598 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-28 06:17:35.865618 | orchestrator | Tuesday 28 April 2026 06:16:59 +0000 (0:00:01.322) 1:01:32.958 ********* 2026-04-28 06:17:35.865670 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:17:35.865691 | orchestrator | 2026-04-28 06:17:35.865710 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-28 06:17:35.865728 | orchestrator | Tuesday 28 April 2026 06:17:01 +0000 (0:00:01.706) 1:01:34.665 ********* 2026-04-28 06:17:35.865743 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-28 06:17:35.865768 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-28 06:17:35.865779 | orchestrator | skipping: [testbed-node-3] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-28 06:17:35.865791 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:17:35.865802 | orchestrator | 2026-04-28 06:17:35.865813 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-28 06:17:35.865824 | orchestrator | Tuesday 28 April 2026 06:17:02 +0000 (0:00:01.140) 1:01:35.805 ********* 2026-04-28 06:17:35.865835 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:17:35.865846 | orchestrator | 2026-04-28 06:17:35.865857 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-28 06:17:35.865868 | orchestrator | Tuesday 28 April 2026 06:17:03 +0000 (0:00:01.099) 1:01:36.905 ********* 2026-04-28 06:17:35.865879 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:17:35.865888 | orchestrator | 2026-04-28 06:17:35.865898 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-28 06:17:35.865907 | orchestrator | Tuesday 28 April 2026 06:17:04 +0000 (0:00:01.152) 1:01:38.057 ********* 2026-04-28 06:17:35.865917 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:17:35.865926 | orchestrator | 2026-04-28 06:17:35.865935 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-28 06:17:35.865945 | orchestrator | Tuesday 28 April 2026 06:17:05 +0000 (0:00:01.157) 1:01:39.214 ********* 2026-04-28 06:17:35.865955 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:17:35.865964 | orchestrator | 2026-04-28 06:17:35.865974 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-28 06:17:35.865983 | orchestrator | Tuesday 28 April 2026 06:17:06 +0000 (0:00:01.131) 1:01:40.346 ********* 2026-04-28 06:17:35.865993 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:17:35.866002 | orchestrator | 2026-04-28 06:17:35.866011 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-28 06:17:35.866088 | orchestrator | Tuesday 28 April 2026 06:17:08 +0000 (0:00:01.150) 1:01:41.496 ********* 2026-04-28 06:17:35.866099 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:17:35.866161 | orchestrator | 2026-04-28 06:17:35.866173 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-28 06:17:35.866183 | orchestrator | Tuesday 28 April 2026 06:17:10 +0000 (0:00:02.463) 1:01:43.960 ********* 2026-04-28 06:17:35.866193 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:17:35.866202 | orchestrator | 2026-04-28 06:17:35.866221 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-28 06:17:35.866231 | orchestrator | Tuesday 28 April 2026 06:17:11 +0000 (0:00:01.134) 1:01:45.095 ********* 2026-04-28 06:17:35.866240 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-3 2026-04-28 06:17:35.866250 | orchestrator | 2026-04-28 06:17:35.866259 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-28 06:17:35.866289 | orchestrator | Tuesday 28 April 2026 06:17:12 +0000 (0:00:01.112) 1:01:46.207 ********* 2026-04-28 06:17:35.866299 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:17:35.866309 | orchestrator | 2026-04-28 06:17:35.866318 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-28 06:17:35.866328 | orchestrator | Tuesday 28 April 2026 06:17:14 +0000 (0:00:01.209) 1:01:47.417 ********* 2026-04-28 06:17:35.866337 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:17:35.866346 | orchestrator | 2026-04-28 06:17:35.866356 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-28 06:17:35.866388 | orchestrator | Tuesday 28 April 2026 06:17:15 +0000 (0:00:01.364) 1:01:48.782 ********* 2026-04-28 06:17:35.866398 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:17:35.866408 | orchestrator | 2026-04-28 06:17:35.866417 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-28 06:17:35.866427 | orchestrator | Tuesday 28 April 2026 06:17:16 +0000 (0:00:01.121) 1:01:49.904 ********* 2026-04-28 06:17:35.866436 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:17:35.866446 | orchestrator | 2026-04-28 06:17:35.866455 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-28 06:17:35.866465 | orchestrator | Tuesday 28 April 2026 06:17:17 +0000 (0:00:01.196) 1:01:51.100 ********* 2026-04-28 06:17:35.866474 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:17:35.866483 | orchestrator | 2026-04-28 06:17:35.866493 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-28 06:17:35.866502 | orchestrator | Tuesday 28 April 2026 06:17:18 +0000 (0:00:01.147) 1:01:52.248 ********* 2026-04-28 06:17:35.866512 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:17:35.866521 | orchestrator | 2026-04-28 06:17:35.866531 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-28 06:17:35.866540 | orchestrator | Tuesday 28 April 2026 06:17:20 +0000 (0:00:01.159) 1:01:53.407 ********* 2026-04-28 06:17:35.866550 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:17:35.866559 | orchestrator | 2026-04-28 06:17:35.866569 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-28 06:17:35.866578 | orchestrator | Tuesday 28 April 2026 06:17:21 +0000 (0:00:01.156) 1:01:54.564 ********* 2026-04-28 06:17:35.866587 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:17:35.866597 | orchestrator | 2026-04-28 06:17:35.866607 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-28 06:17:35.866616 | orchestrator | Tuesday 28 April 2026 06:17:22 +0000 (0:00:01.131) 1:01:55.695 ********* 2026-04-28 06:17:35.866626 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:17:35.866635 | orchestrator | 2026-04-28 06:17:35.866645 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-28 06:17:35.866654 | orchestrator | Tuesday 28 April 2026 06:17:23 +0000 (0:00:01.161) 1:01:56.856 ********* 2026-04-28 06:17:35.866664 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-3 2026-04-28 06:17:35.866673 | orchestrator | 2026-04-28 06:17:35.866683 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-28 06:17:35.866692 | orchestrator | Tuesday 28 April 2026 06:17:24 +0000 (0:00:01.154) 1:01:58.010 ********* 2026-04-28 06:17:35.866708 | orchestrator | ok: [testbed-node-3] => (item=/etc/ceph) 2026-04-28 06:17:35.866718 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/) 2026-04-28 06:17:35.866728 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/mon) 2026-04-28 06:17:35.866738 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/osd) 2026-04-28 06:17:35.866747 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/mds) 2026-04-28 06:17:35.866756 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/tmp) 2026-04-28 06:17:35.866766 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/crash) 2026-04-28 06:17:35.866775 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/radosgw) 2026-04-28 06:17:35.866785 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-28 06:17:35.866795 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-28 06:17:35.866804 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-28 06:17:35.866813 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-28 06:17:35.866823 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-28 06:17:35.866832 | orchestrator | ok: [testbed-node-3] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-28 06:17:35.866842 | orchestrator | ok: [testbed-node-3] => (item=/var/run/ceph) 2026-04-28 06:17:35.866857 | orchestrator | ok: [testbed-node-3] => (item=/var/log/ceph) 2026-04-28 06:17:35.866866 | orchestrator | 2026-04-28 06:17:35.866876 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-28 06:17:35.866885 | orchestrator | Tuesday 28 April 2026 06:17:31 +0000 (0:00:06.518) 1:02:04.529 ********* 2026-04-28 06:17:35.866894 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-3 2026-04-28 06:17:35.866904 | orchestrator | 2026-04-28 06:17:35.866913 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-28 06:17:35.866923 | orchestrator | Tuesday 28 April 2026 06:17:32 +0000 (0:00:01.261) 1:02:05.790 ********* 2026-04-28 06:17:35.866933 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-28 06:17:35.866943 | orchestrator | 2026-04-28 06:17:35.866953 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-28 06:17:35.866963 | orchestrator | Tuesday 28 April 2026 06:17:33 +0000 (0:00:01.471) 1:02:07.262 ********* 2026-04-28 06:17:35.866972 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-28 06:17:35.866982 | orchestrator | 2026-04-28 06:17:35.866991 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-28 06:17:35.867007 | orchestrator | Tuesday 28 April 2026 06:17:35 +0000 (0:00:01.979) 1:02:09.241 ********* 2026-04-28 06:18:25.348889 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:18:25.349001 | orchestrator | 2026-04-28 06:18:25.349017 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-28 06:18:25.349093 | orchestrator | Tuesday 28 April 2026 06:17:37 +0000 (0:00:01.189) 1:02:10.431 ********* 2026-04-28 06:18:25.349106 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:18:25.349116 | orchestrator | 2026-04-28 06:18:25.349126 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-28 06:18:25.349136 | orchestrator | Tuesday 28 April 2026 06:17:38 +0000 (0:00:01.120) 1:02:11.551 ********* 2026-04-28 06:18:25.349146 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:18:25.349156 | orchestrator | 2026-04-28 06:18:25.349165 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-28 06:18:25.349175 | orchestrator | Tuesday 28 April 2026 06:17:39 +0000 (0:00:01.106) 1:02:12.658 ********* 2026-04-28 06:18:25.349184 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:18:25.349194 | orchestrator | 2026-04-28 06:18:25.349203 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-28 06:18:25.349213 | orchestrator | Tuesday 28 April 2026 06:17:40 +0000 (0:00:01.163) 1:02:13.822 ********* 2026-04-28 06:18:25.349222 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:18:25.349232 | orchestrator | 2026-04-28 06:18:25.349241 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-28 06:18:25.349252 | orchestrator | Tuesday 28 April 2026 06:17:41 +0000 (0:00:01.128) 1:02:14.951 ********* 2026-04-28 06:18:25.349273 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:18:25.349283 | orchestrator | 2026-04-28 06:18:25.349293 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-28 06:18:25.349303 | orchestrator | Tuesday 28 April 2026 06:17:42 +0000 (0:00:01.128) 1:02:16.079 ********* 2026-04-28 06:18:25.349313 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:18:25.349323 | orchestrator | 2026-04-28 06:18:25.349333 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-28 06:18:25.349343 | orchestrator | Tuesday 28 April 2026 06:17:43 +0000 (0:00:01.135) 1:02:17.215 ********* 2026-04-28 06:18:25.349352 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:18:25.349362 | orchestrator | 2026-04-28 06:18:25.349372 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-28 06:18:25.349406 | orchestrator | Tuesday 28 April 2026 06:17:45 +0000 (0:00:01.181) 1:02:18.397 ********* 2026-04-28 06:18:25.349418 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:18:25.349429 | orchestrator | 2026-04-28 06:18:25.349439 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-28 06:18:25.349450 | orchestrator | Tuesday 28 April 2026 06:17:46 +0000 (0:00:01.127) 1:02:19.524 ********* 2026-04-28 06:18:25.349461 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:18:25.349471 | orchestrator | 2026-04-28 06:18:25.349482 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-28 06:18:25.349506 | orchestrator | Tuesday 28 April 2026 06:17:47 +0000 (0:00:01.107) 1:02:20.632 ********* 2026-04-28 06:18:25.349517 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:18:25.349528 | orchestrator | 2026-04-28 06:18:25.349538 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-28 06:18:25.349549 | orchestrator | Tuesday 28 April 2026 06:17:48 +0000 (0:00:01.276) 1:02:21.908 ********* 2026-04-28 06:18:25.349560 | orchestrator | changed: [testbed-node-3 -> testbed-node-2(192.168.16.12)] 2026-04-28 06:18:25.349571 | orchestrator | 2026-04-28 06:18:25.349581 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-28 06:18:25.349592 | orchestrator | Tuesday 28 April 2026 06:17:52 +0000 (0:00:04.415) 1:02:26.323 ********* 2026-04-28 06:18:25.349603 | orchestrator | ok: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-28 06:18:25.349615 | orchestrator | 2026-04-28 06:18:25.349626 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-28 06:18:25.349636 | orchestrator | Tuesday 28 April 2026 06:17:54 +0000 (0:00:01.175) 1:02:27.499 ********* 2026-04-28 06:18:25.349649 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log'}]) 2026-04-28 06:18:25.349664 | orchestrator | ok: [testbed-node-3 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-3.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-3.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.13:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.13:8081'}]) 2026-04-28 06:18:25.349677 | orchestrator | 2026-04-28 06:18:25.349687 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-28 06:18:25.349698 | orchestrator | Tuesday 28 April 2026 06:17:58 +0000 (0:00:04.807) 1:02:32.307 ********* 2026-04-28 06:18:25.349709 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:18:25.349720 | orchestrator | 2026-04-28 06:18:25.349731 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-28 06:18:25.349742 | orchestrator | Tuesday 28 April 2026 06:18:00 +0000 (0:00:01.133) 1:02:33.441 ********* 2026-04-28 06:18:25.349753 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:18:25.349764 | orchestrator | 2026-04-28 06:18:25.349774 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 06:18:25.349800 | orchestrator | Tuesday 28 April 2026 06:18:01 +0000 (0:00:01.137) 1:02:34.578 ********* 2026-04-28 06:18:25.349811 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:18:25.349821 | orchestrator | 2026-04-28 06:18:25.349830 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 06:18:25.349840 | orchestrator | Tuesday 28 April 2026 06:18:02 +0000 (0:00:01.162) 1:02:35.741 ********* 2026-04-28 06:18:25.349849 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:18:25.349859 | orchestrator | 2026-04-28 06:18:25.349868 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 06:18:25.349878 | orchestrator | Tuesday 28 April 2026 06:18:03 +0000 (0:00:01.145) 1:02:36.887 ********* 2026-04-28 06:18:25.349895 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:18:25.349904 | orchestrator | 2026-04-28 06:18:25.349914 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 06:18:25.349924 | orchestrator | Tuesday 28 April 2026 06:18:04 +0000 (0:00:01.143) 1:02:38.031 ********* 2026-04-28 06:18:25.349933 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:18:25.349944 | orchestrator | 2026-04-28 06:18:25.349953 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 06:18:25.349963 | orchestrator | Tuesday 28 April 2026 06:18:05 +0000 (0:00:01.259) 1:02:39.291 ********* 2026-04-28 06:18:25.349972 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 06:18:25.349982 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 06:18:25.349992 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 06:18:25.350002 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:18:25.350011 | orchestrator | 2026-04-28 06:18:25.350108 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 06:18:25.350126 | orchestrator | Tuesday 28 April 2026 06:18:07 +0000 (0:00:01.435) 1:02:40.726 ********* 2026-04-28 06:18:25.350144 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 06:18:25.350154 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 06:18:25.350163 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 06:18:25.350173 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:18:25.350182 | orchestrator | 2026-04-28 06:18:25.350192 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 06:18:25.350201 | orchestrator | Tuesday 28 April 2026 06:18:08 +0000 (0:00:01.410) 1:02:42.137 ********* 2026-04-28 06:18:25.350211 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-3)  2026-04-28 06:18:25.350220 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-4)  2026-04-28 06:18:25.350230 | orchestrator | skipping: [testbed-node-3] => (item=testbed-node-5)  2026-04-28 06:18:25.350239 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:18:25.350249 | orchestrator | 2026-04-28 06:18:25.350258 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 06:18:25.350268 | orchestrator | Tuesday 28 April 2026 06:18:10 +0000 (0:00:01.901) 1:02:44.038 ********* 2026-04-28 06:18:25.350277 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:18:25.350286 | orchestrator | 2026-04-28 06:18:25.350302 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 06:18:25.350312 | orchestrator | Tuesday 28 April 2026 06:18:11 +0000 (0:00:01.193) 1:02:45.232 ********* 2026-04-28 06:18:25.350321 | orchestrator | ok: [testbed-node-3] => (item=0) 2026-04-28 06:18:25.350331 | orchestrator | 2026-04-28 06:18:25.350341 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-28 06:18:25.350350 | orchestrator | Tuesday 28 April 2026 06:18:13 +0000 (0:00:01.942) 1:02:47.175 ********* 2026-04-28 06:18:25.350360 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:18:25.350369 | orchestrator | 2026-04-28 06:18:25.350379 | orchestrator | TASK [ceph-rgw : Include common.yml] ******************************************* 2026-04-28 06:18:25.350388 | orchestrator | Tuesday 28 April 2026 06:18:15 +0000 (0:00:01.745) 1:02:48.921 ********* 2026-04-28 06:18:25.350398 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/common.yml for testbed-node-3 2026-04-28 06:18:25.350407 | orchestrator | 2026-04-28 06:18:25.350416 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-28 06:18:25.350426 | orchestrator | Tuesday 28 April 2026 06:18:17 +0000 (0:00:01.493) 1:02:50.414 ********* 2026-04-28 06:18:25.350435 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 06:18:25.350445 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-28 06:18:25.350454 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-28 06:18:25.350464 | orchestrator | 2026-04-28 06:18:25.350481 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-28 06:18:25.350490 | orchestrator | Tuesday 28 April 2026 06:18:20 +0000 (0:00:03.172) 1:02:53.586 ********* 2026-04-28 06:18:25.350500 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-28 06:18:25.350509 | orchestrator | skipping: [testbed-node-3] => (item=None)  2026-04-28 06:18:25.350519 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:18:25.350529 | orchestrator | 2026-04-28 06:18:25.350538 | orchestrator | TASK [ceph-rgw : Copy SSL certificate & key data to certificate path] ********** 2026-04-28 06:18:25.350547 | orchestrator | Tuesday 28 April 2026 06:18:22 +0000 (0:00:01.967) 1:02:55.554 ********* 2026-04-28 06:18:25.350557 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:18:25.350567 | orchestrator | 2026-04-28 06:18:25.350576 | orchestrator | TASK [ceph-rgw : Include_tasks pre_requisite.yml] ****************************** 2026-04-28 06:18:25.350586 | orchestrator | Tuesday 28 April 2026 06:18:23 +0000 (0:00:01.136) 1:02:56.691 ********* 2026-04-28 06:18:25.350595 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/pre_requisite.yml for testbed-node-3 2026-04-28 06:18:25.350606 | orchestrator | 2026-04-28 06:18:25.350615 | orchestrator | TASK [ceph-rgw : Create rados gateway directories] ***************************** 2026-04-28 06:18:25.350625 | orchestrator | Tuesday 28 April 2026 06:18:24 +0000 (0:00:01.457) 1:02:58.148 ********* 2026-04-28 06:18:25.350642 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-28 06:19:40.060747 | orchestrator | 2026-04-28 06:19:40.060865 | orchestrator | TASK [ceph-rgw : Create rgw keyrings] ****************************************** 2026-04-28 06:19:40.060882 | orchestrator | Tuesday 28 April 2026 06:18:26 +0000 (0:00:01.680) 1:02:59.829 ********* 2026-04-28 06:19:40.060894 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 06:19:40.060906 | orchestrator | changed: [testbed-node-3 -> {{ groups[mon_group_name][0] if groups.get(mon_group_name, []) | length > 0 else 'localhost' }}] 2026-04-28 06:19:40.060966 | orchestrator | 2026-04-28 06:19:40.060977 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-28 06:19:40.060988 | orchestrator | Tuesday 28 April 2026 06:18:31 +0000 (0:00:05.134) 1:03:04.964 ********* 2026-04-28 06:19:40.060999 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 06:19:40.061011 | orchestrator | ok: [testbed-node-3 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-28 06:19:40.061022 | orchestrator | 2026-04-28 06:19:40.061032 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-28 06:19:40.061043 | orchestrator | Tuesday 28 April 2026 06:18:35 +0000 (0:00:03.496) 1:03:08.460 ********* 2026-04-28 06:19:40.061054 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-28 06:19:40.061066 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:19:40.061078 | orchestrator | 2026-04-28 06:19:40.061089 | orchestrator | TASK [ceph-rgw : Rgw pool creation tasks] ************************************** 2026-04-28 06:19:40.061100 | orchestrator | Tuesday 28 April 2026 06:18:37 +0000 (0:00:02.044) 1:03:10.505 ********* 2026-04-28 06:19:40.061111 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/rgw_create_pools.yml for testbed-node-3 2026-04-28 06:19:40.061122 | orchestrator | 2026-04-28 06:19:40.061132 | orchestrator | TASK [ceph-rgw : Create ec profile] ******************************************** 2026-04-28 06:19:40.061143 | orchestrator | Tuesday 28 April 2026 06:18:38 +0000 (0:00:01.468) 1:03:11.973 ********* 2026-04-28 06:19:40.061155 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:19:40.061166 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:19:40.061177 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:19:40.061188 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:19:40.061239 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:19:40.061251 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:19:40.061262 | orchestrator | 2026-04-28 06:19:40.061275 | orchestrator | TASK [ceph-rgw : Set crush rule] *********************************************** 2026-04-28 06:19:40.061287 | orchestrator | Tuesday 28 April 2026 06:18:40 +0000 (0:00:01.582) 1:03:13.556 ********* 2026-04-28 06:19:40.061299 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:19:40.061312 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:19:40.061324 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:19:40.061338 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:19:40.061350 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:19:40.061362 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:19:40.061375 | orchestrator | 2026-04-28 06:19:40.061387 | orchestrator | TASK [ceph-rgw : Create rgw pools] ********************************************* 2026-04-28 06:19:40.061399 | orchestrator | Tuesday 28 April 2026 06:18:41 +0000 (0:00:01.599) 1:03:15.156 ********* 2026-04-28 06:19:40.061412 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-28 06:19:40.061426 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-28 06:19:40.061437 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-28 06:19:40.061448 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-28 06:19:40.061461 | orchestrator | ok: [testbed-node-3 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-28 06:19:40.061471 | orchestrator | 2026-04-28 06:19:40.061482 | orchestrator | TASK [ceph-rgw : Include_tasks openstack-keystone.yml] ************************* 2026-04-28 06:19:40.061511 | orchestrator | Tuesday 28 April 2026 06:19:12 +0000 (0:00:30.710) 1:03:45.866 ********* 2026-04-28 06:19:40.061524 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:19:40.061535 | orchestrator | 2026-04-28 06:19:40.061546 | orchestrator | TASK [ceph-rgw : Include_tasks start_radosgw.yml] ****************************** 2026-04-28 06:19:40.061556 | orchestrator | Tuesday 28 April 2026 06:19:13 +0000 (0:00:01.130) 1:03:46.997 ********* 2026-04-28 06:19:40.061567 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:19:40.061578 | orchestrator | 2026-04-28 06:19:40.061589 | orchestrator | TASK [ceph-rgw : Include start_docker_rgw.yml] ********************************* 2026-04-28 06:19:40.061600 | orchestrator | Tuesday 28 April 2026 06:19:14 +0000 (0:00:01.202) 1:03:48.200 ********* 2026-04-28 06:19:40.061611 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/start_docker_rgw.yml for testbed-node-3 2026-04-28 06:19:40.061621 | orchestrator | 2026-04-28 06:19:40.061632 | orchestrator | TASK [ceph-rgw : Include_task systemd.yml] ************************************* 2026-04-28 06:19:40.061643 | orchestrator | Tuesday 28 April 2026 06:19:16 +0000 (0:00:01.544) 1:03:49.744 ********* 2026-04-28 06:19:40.061654 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/systemd.yml for testbed-node-3 2026-04-28 06:19:40.061673 | orchestrator | 2026-04-28 06:19:40.061684 | orchestrator | TASK [ceph-rgw : Generate systemd unit file] *********************************** 2026-04-28 06:19:40.061694 | orchestrator | Tuesday 28 April 2026 06:19:17 +0000 (0:00:01.479) 1:03:51.224 ********* 2026-04-28 06:19:40.061705 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:19:40.061716 | orchestrator | 2026-04-28 06:19:40.061726 | orchestrator | TASK [ceph-rgw : Generate systemd ceph-radosgw target file] ******************** 2026-04-28 06:19:40.061737 | orchestrator | Tuesday 28 April 2026 06:19:20 +0000 (0:00:02.492) 1:03:53.716 ********* 2026-04-28 06:19:40.061747 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:19:40.061758 | orchestrator | 2026-04-28 06:19:40.061769 | orchestrator | TASK [ceph-rgw : Enable ceph-radosgw.target] *********************************** 2026-04-28 06:19:40.061779 | orchestrator | Tuesday 28 April 2026 06:19:22 +0000 (0:00:01.884) 1:03:55.600 ********* 2026-04-28 06:19:40.061790 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:19:40.061800 | orchestrator | 2026-04-28 06:19:40.061811 | orchestrator | TASK [ceph-rgw : Systemd start rgw container] ********************************** 2026-04-28 06:19:40.061822 | orchestrator | Tuesday 28 April 2026 06:19:24 +0000 (0:00:02.263) 1:03:57.864 ********* 2026-04-28 06:19:40.061832 | orchestrator | changed: [testbed-node-3] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.13', 'radosgw_frontend_port': 8081}) 2026-04-28 06:19:40.061843 | orchestrator | 2026-04-28 06:19:40.061854 | orchestrator | PLAY [Upgrade ceph rgws cluster] *********************************************** 2026-04-28 06:19:40.061864 | orchestrator | 2026-04-28 06:19:40.061875 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 06:19:40.061885 | orchestrator | Tuesday 28 April 2026 06:19:27 +0000 (0:00:02.820) 1:04:00.685 ********* 2026-04-28 06:19:40.061896 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-4 2026-04-28 06:19:40.061907 | orchestrator | 2026-04-28 06:19:40.061961 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-28 06:19:40.061972 | orchestrator | Tuesday 28 April 2026 06:19:28 +0000 (0:00:01.139) 1:04:01.825 ********* 2026-04-28 06:19:40.061983 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:19:40.061994 | orchestrator | 2026-04-28 06:19:40.062005 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-28 06:19:40.062069 | orchestrator | Tuesday 28 April 2026 06:19:29 +0000 (0:00:01.466) 1:04:03.291 ********* 2026-04-28 06:19:40.062082 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:19:40.062093 | orchestrator | 2026-04-28 06:19:40.062104 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 06:19:40.062115 | orchestrator | Tuesday 28 April 2026 06:19:31 +0000 (0:00:01.166) 1:04:04.458 ********* 2026-04-28 06:19:40.062126 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:19:40.062137 | orchestrator | 2026-04-28 06:19:40.062158 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 06:19:40.062169 | orchestrator | Tuesday 28 April 2026 06:19:32 +0000 (0:00:01.456) 1:04:05.915 ********* 2026-04-28 06:19:40.062180 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:19:40.062191 | orchestrator | 2026-04-28 06:19:40.062202 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-28 06:19:40.062213 | orchestrator | Tuesday 28 April 2026 06:19:33 +0000 (0:00:01.131) 1:04:07.047 ********* 2026-04-28 06:19:40.062224 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:19:40.062235 | orchestrator | 2026-04-28 06:19:40.062246 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-28 06:19:40.062257 | orchestrator | Tuesday 28 April 2026 06:19:34 +0000 (0:00:01.209) 1:04:08.256 ********* 2026-04-28 06:19:40.062268 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:19:40.062278 | orchestrator | 2026-04-28 06:19:40.062289 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-28 06:19:40.062300 | orchestrator | Tuesday 28 April 2026 06:19:36 +0000 (0:00:01.220) 1:04:09.477 ********* 2026-04-28 06:19:40.062311 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:19:40.062322 | orchestrator | 2026-04-28 06:19:40.062332 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-28 06:19:40.062351 | orchestrator | Tuesday 28 April 2026 06:19:37 +0000 (0:00:01.144) 1:04:10.622 ********* 2026-04-28 06:19:40.062362 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:19:40.062375 | orchestrator | 2026-04-28 06:19:40.062394 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-28 06:19:40.062412 | orchestrator | Tuesday 28 April 2026 06:19:38 +0000 (0:00:01.113) 1:04:11.735 ********* 2026-04-28 06:19:40.062430 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:19:40.062447 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:19:40.062465 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:19:40.062482 | orchestrator | 2026-04-28 06:19:40.062500 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-28 06:19:40.062529 | orchestrator | Tuesday 28 April 2026 06:19:40 +0000 (0:00:01.701) 1:04:13.437 ********* 2026-04-28 06:20:04.909734 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:20:04.909922 | orchestrator | 2026-04-28 06:20:04.909951 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-28 06:20:04.909971 | orchestrator | Tuesday 28 April 2026 06:19:41 +0000 (0:00:01.302) 1:04:14.739 ********* 2026-04-28 06:20:04.909990 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:20:04.910009 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:20:04.910103 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:20:04.910123 | orchestrator | 2026-04-28 06:20:04.910141 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-28 06:20:04.910160 | orchestrator | Tuesday 28 April 2026 06:19:44 +0000 (0:00:02.868) 1:04:17.608 ********* 2026-04-28 06:20:04.910178 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-28 06:20:04.910197 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-28 06:20:04.910215 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-28 06:20:04.910235 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:04.910254 | orchestrator | 2026-04-28 06:20:04.910273 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-28 06:20:04.910292 | orchestrator | Tuesday 28 April 2026 06:19:45 +0000 (0:00:01.465) 1:04:19.074 ********* 2026-04-28 06:20:04.910313 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-28 06:20:04.910336 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-28 06:20:04.910356 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-28 06:20:04.910392 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:04.910426 | orchestrator | 2026-04-28 06:20:04.910444 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-28 06:20:04.910462 | orchestrator | Tuesday 28 April 2026 06:19:47 +0000 (0:00:01.730) 1:04:20.805 ********* 2026-04-28 06:20:04.910502 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 06:20:04.910555 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 06:20:04.910574 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 06:20:04.910592 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:04.910611 | orchestrator | 2026-04-28 06:20:04.910629 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-28 06:20:04.910647 | orchestrator | Tuesday 28 April 2026 06:19:48 +0000 (0:00:01.197) 1:04:22.003 ********* 2026-04-28 06:20:04.910689 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': 'e79a9ee6c12b', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-28 06:19:41.858591', 'end': '2026-04-28 06:19:41.904608', 'delta': '0:00:00.046017', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e79a9ee6c12b'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-28 06:20:04.910713 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': '00fb93644bb9', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-28 06:19:42.443972', 'end': '2026-04-28 06:19:42.487662', 'delta': '0:00:00.043690', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['00fb93644bb9'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-28 06:20:04.910731 | orchestrator | ok: [testbed-node-4] => (item={'changed': False, 'stdout': '92b926b7d044', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-28 06:19:43.049698', 'end': '2026-04-28 06:19:43.096519', 'delta': '0:00:00.046821', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['92b926b7d044'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-28 06:20:04.910749 | orchestrator | 2026-04-28 06:20:04.910768 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-28 06:20:04.910786 | orchestrator | Tuesday 28 April 2026 06:19:49 +0000 (0:00:01.184) 1:04:23.187 ********* 2026-04-28 06:20:04.910804 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:20:04.910822 | orchestrator | 2026-04-28 06:20:04.910840 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-28 06:20:04.910871 | orchestrator | Tuesday 28 April 2026 06:19:51 +0000 (0:00:01.255) 1:04:24.443 ********* 2026-04-28 06:20:04.910926 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:04.910945 | orchestrator | 2026-04-28 06:20:04.910965 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-28 06:20:04.910983 | orchestrator | Tuesday 28 April 2026 06:19:52 +0000 (0:00:01.184) 1:04:25.628 ********* 2026-04-28 06:20:04.911001 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:20:04.911019 | orchestrator | 2026-04-28 06:20:04.911037 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-28 06:20:04.911054 | orchestrator | Tuesday 28 April 2026 06:19:53 +0000 (0:00:01.143) 1:04:26.771 ********* 2026-04-28 06:20:04.911071 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-28 06:20:04.911089 | orchestrator | 2026-04-28 06:20:04.911107 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 06:20:04.911124 | orchestrator | Tuesday 28 April 2026 06:19:55 +0000 (0:00:02.313) 1:04:29.085 ********* 2026-04-28 06:20:04.911141 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:20:04.911159 | orchestrator | 2026-04-28 06:20:04.911177 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-28 06:20:04.911195 | orchestrator | Tuesday 28 April 2026 06:19:56 +0000 (0:00:01.149) 1:04:30.235 ********* 2026-04-28 06:20:04.911212 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:04.911230 | orchestrator | 2026-04-28 06:20:04.911247 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-28 06:20:04.911264 | orchestrator | Tuesday 28 April 2026 06:19:57 +0000 (0:00:01.120) 1:04:31.355 ********* 2026-04-28 06:20:04.911281 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:04.911298 | orchestrator | 2026-04-28 06:20:04.911315 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 06:20:04.911331 | orchestrator | Tuesday 28 April 2026 06:19:59 +0000 (0:00:01.243) 1:04:32.599 ********* 2026-04-28 06:20:04.911349 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:04.911365 | orchestrator | 2026-04-28 06:20:04.911383 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-28 06:20:04.911400 | orchestrator | Tuesday 28 April 2026 06:20:00 +0000 (0:00:01.089) 1:04:33.688 ********* 2026-04-28 06:20:04.911417 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:04.911432 | orchestrator | 2026-04-28 06:20:04.911447 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-28 06:20:04.911462 | orchestrator | Tuesday 28 April 2026 06:20:01 +0000 (0:00:01.132) 1:04:34.820 ********* 2026-04-28 06:20:04.911477 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:20:04.911492 | orchestrator | 2026-04-28 06:20:04.911507 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-28 06:20:04.911522 | orchestrator | Tuesday 28 April 2026 06:20:02 +0000 (0:00:01.189) 1:04:36.010 ********* 2026-04-28 06:20:04.911537 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:04.911552 | orchestrator | 2026-04-28 06:20:04.911567 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-28 06:20:04.911583 | orchestrator | Tuesday 28 April 2026 06:20:03 +0000 (0:00:01.124) 1:04:37.134 ********* 2026-04-28 06:20:04.911598 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:20:04.911613 | orchestrator | 2026-04-28 06:20:04.911629 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-28 06:20:04.911655 | orchestrator | Tuesday 28 April 2026 06:20:04 +0000 (0:00:01.150) 1:04:38.284 ********* 2026-04-28 06:20:07.411467 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:07.411558 | orchestrator | 2026-04-28 06:20:07.411574 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-28 06:20:07.411586 | orchestrator | Tuesday 28 April 2026 06:20:06 +0000 (0:00:01.173) 1:04:39.458 ********* 2026-04-28 06:20:07.411598 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:20:07.411609 | orchestrator | 2026-04-28 06:20:07.411621 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-28 06:20:07.411653 | orchestrator | Tuesday 28 April 2026 06:20:07 +0000 (0:00:01.128) 1:04:40.586 ********* 2026-04-28 06:20:07.411667 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:20:07.411683 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a', 'dm-uuid-LVM-Ef9S4L9mnk6YjVYwTU4OmJ1Dk0yNJkcNEeYiJgmdqy5Dk4JMIq1jh9ZhEgnxusYs'], 'uuids': ['46d73a0b-76ab-4c42-90e0-cf88eb28d186'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f49158cb', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs']}})  2026-04-28 06:20:07.411710 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80', 'scsi-SQEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '81043571', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 06:20:07.411723 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-l9OtEf-0x8l-OZFM-QMSY-xI5K-ifcY-q0IHfV', 'scsi-0QEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b', 'scsi-SQEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '6fed6807', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf']}})  2026-04-28 06:20:07.411736 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:20:07.411748 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:20:07.411776 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-13-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 06:20:07.411797 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:20:07.411809 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg', 'dm-uuid-CRYPT-LUKS2-699d16b2a15647d8861ce74191aa2e29-p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 06:20:07.411834 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:20:07.411850 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf', 'dm-uuid-LVM-jDSXafY010UkbP8ZmxeIQet2dAZt2ducp03EHOrl6D51efYCaF9MHllF0WrfMNUg'], 'uuids': ['699d16b2-a156-47d8-861c-e74191aa2e29'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '6fed6807', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg']}})  2026-04-28 06:20:07.411862 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-NfMdHp-i6Wd-iXE4-bdeT-UQcT-dakb-CDL8cZ', 'scsi-0QEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba', 'scsi-SQEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f49158cb', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a']}})  2026-04-28 06:20:07.411914 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:20:07.411941 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46815659', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 06:20:08.716938 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:20:08.717040 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:20:08.717059 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs', 'dm-uuid-CRYPT-LUKS2-46d73a0b76ab4c4290e0cf88eb28d186-EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 06:20:08.717075 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:08.717088 | orchestrator | 2026-04-28 06:20:08.717099 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-28 06:20:08.717111 | orchestrator | Tuesday 28 April 2026 06:20:08 +0000 (0:00:01.344) 1:04:41.930 ********* 2026-04-28 06:20:08.717123 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:20:08.717157 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a', 'dm-uuid-LVM-Ef9S4L9mnk6YjVYwTU4OmJ1Dk0yNJkcNEeYiJgmdqy5Dk4JMIq1jh9ZhEgnxusYs'], 'uuids': ['46d73a0b-76ab-4c42-90e0-cf88eb28d186'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': 'f49158cb', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:20:08.717171 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80', 'scsi-SQEMU_QEMU_HARDDISK_81043571-8916-4793-8453-c8f133401e80'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '81043571', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:20:08.717207 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-l9OtEf-0x8l-OZFM-QMSY-xI5K-ifcY-q0IHfV', 'scsi-0QEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b', 'scsi-SQEMU_QEMU_HARDDISK_6fed6807-d741-439c-9f91-474adcad671b'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '6fed6807', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:20:08.717223 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:20:08.717235 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:20:08.717254 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-13-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:20:08.717266 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:20:08.717285 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg', 'dm-uuid-CRYPT-LUKS2-699d16b2a15647d8861ce74191aa2e29-p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:20:13.978547 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:20:13.978656 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--1455ab40--e845--5ac6--aa29--4f0468cc06bf-osd--block--1455ab40--e845--5ac6--aa29--4f0468cc06bf', 'dm-uuid-LVM-jDSXafY010UkbP8ZmxeIQet2dAZt2ducp03EHOrl6D51efYCaF9MHllF0WrfMNUg'], 'uuids': ['699d16b2-a156-47d8-861c-e74191aa2e29'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '6fed6807', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['p03EHO-rl6D-51ef-YCaF-9MHl-lF0W-rfMNUg']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:20:13.978698 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-NfMdHp-i6Wd-iXE4-bdeT-UQcT-dakb-CDL8cZ', 'scsi-0QEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba', 'scsi-SQEMU_QEMU_HARDDISK_f49158cb-7d22-4543-817c-5ac821d1ceba'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'f49158cb', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--b3b62482--c8be--5063--9ecc--120425980b0a-osd--block--b3b62482--c8be--5063--9ecc--120425980b0a']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:20:13.978715 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:20:13.978757 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '46815659', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1', 'scsi-SQEMU_QEMU_HARDDISK_46815659-874f-4607-872f-4275fd1627fb-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:20:13.978773 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:20:13.978794 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:20:13.978806 | orchestrator | skipping: [testbed-node-4] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs', 'dm-uuid-CRYPT-LUKS2-46d73a0b76ab4c4290e0cf88eb28d186-EeYiJg-mdqy-5Dk4-JMIq-1jh9-ZhEg-nxusYs'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:20:13.978819 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:13.978833 | orchestrator | 2026-04-28 06:20:13.978846 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-28 06:20:13.978858 | orchestrator | Tuesday 28 April 2026 06:20:09 +0000 (0:00:01.319) 1:04:43.250 ********* 2026-04-28 06:20:13.978923 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:20:13.978935 | orchestrator | 2026-04-28 06:20:13.978947 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-28 06:20:13.978958 | orchestrator | Tuesday 28 April 2026 06:20:11 +0000 (0:00:01.501) 1:04:44.752 ********* 2026-04-28 06:20:13.978968 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:20:13.978979 | orchestrator | 2026-04-28 06:20:13.978990 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 06:20:13.979000 | orchestrator | Tuesday 28 April 2026 06:20:12 +0000 (0:00:01.164) 1:04:45.917 ********* 2026-04-28 06:20:13.979011 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:20:13.979022 | orchestrator | 2026-04-28 06:20:13.979033 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 06:20:13.979052 | orchestrator | Tuesday 28 April 2026 06:20:13 +0000 (0:00:01.443) 1:04:47.361 ********* 2026-04-28 06:20:55.727624 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:55.727778 | orchestrator | 2026-04-28 06:20:55.727891 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 06:20:55.727911 | orchestrator | Tuesday 28 April 2026 06:20:15 +0000 (0:00:01.162) 1:04:48.523 ********* 2026-04-28 06:20:55.727922 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:55.727934 | orchestrator | 2026-04-28 06:20:55.727945 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 06:20:55.727956 | orchestrator | Tuesday 28 April 2026 06:20:16 +0000 (0:00:01.298) 1:04:49.822 ********* 2026-04-28 06:20:55.727966 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:55.727977 | orchestrator | 2026-04-28 06:20:55.727987 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-28 06:20:55.727998 | orchestrator | Tuesday 28 April 2026 06:20:17 +0000 (0:00:01.186) 1:04:51.008 ********* 2026-04-28 06:20:55.728035 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-0) 2026-04-28 06:20:55.728047 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-1) 2026-04-28 06:20:55.728058 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-2) 2026-04-28 06:20:55.728077 | orchestrator | 2026-04-28 06:20:55.728095 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-28 06:20:55.728114 | orchestrator | Tuesday 28 April 2026 06:20:19 +0000 (0:00:01.759) 1:04:52.767 ********* 2026-04-28 06:20:55.728132 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-0)  2026-04-28 06:20:55.728150 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-1)  2026-04-28 06:20:55.728169 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-2)  2026-04-28 06:20:55.728189 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:55.728208 | orchestrator | 2026-04-28 06:20:55.728226 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-28 06:20:55.728246 | orchestrator | Tuesday 28 April 2026 06:20:20 +0000 (0:00:01.221) 1:04:53.989 ********* 2026-04-28 06:20:55.728265 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-4 2026-04-28 06:20:55.728284 | orchestrator | 2026-04-28 06:20:55.728303 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 06:20:55.728322 | orchestrator | Tuesday 28 April 2026 06:20:21 +0000 (0:00:01.135) 1:04:55.124 ********* 2026-04-28 06:20:55.728341 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:55.728359 | orchestrator | 2026-04-28 06:20:55.728379 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 06:20:55.728398 | orchestrator | Tuesday 28 April 2026 06:20:22 +0000 (0:00:01.147) 1:04:56.272 ********* 2026-04-28 06:20:55.728419 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:55.728439 | orchestrator | 2026-04-28 06:20:55.728459 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 06:20:55.728475 | orchestrator | Tuesday 28 April 2026 06:20:24 +0000 (0:00:01.145) 1:04:57.417 ********* 2026-04-28 06:20:55.728488 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:55.728500 | orchestrator | 2026-04-28 06:20:55.728510 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 06:20:55.728521 | orchestrator | Tuesday 28 April 2026 06:20:25 +0000 (0:00:01.125) 1:04:58.542 ********* 2026-04-28 06:20:55.728532 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:20:55.728542 | orchestrator | 2026-04-28 06:20:55.728553 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 06:20:55.728563 | orchestrator | Tuesday 28 April 2026 06:20:26 +0000 (0:00:01.328) 1:04:59.871 ********* 2026-04-28 06:20:55.728574 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-28 06:20:55.728585 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-28 06:20:55.728595 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-28 06:20:55.728605 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:55.728616 | orchestrator | 2026-04-28 06:20:55.728626 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 06:20:55.728637 | orchestrator | Tuesday 28 April 2026 06:20:27 +0000 (0:00:01.449) 1:05:01.321 ********* 2026-04-28 06:20:55.728647 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-28 06:20:55.728658 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-28 06:20:55.728668 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-28 06:20:55.728679 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:55.728689 | orchestrator | 2026-04-28 06:20:55.728700 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 06:20:55.728711 | orchestrator | Tuesday 28 April 2026 06:20:29 +0000 (0:00:01.484) 1:05:02.805 ********* 2026-04-28 06:20:55.728730 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-28 06:20:55.728764 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-28 06:20:55.728782 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-28 06:20:55.728800 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:55.728842 | orchestrator | 2026-04-28 06:20:55.728861 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 06:20:55.728880 | orchestrator | Tuesday 28 April 2026 06:20:30 +0000 (0:00:01.422) 1:05:04.228 ********* 2026-04-28 06:20:55.728900 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:20:55.728918 | orchestrator | 2026-04-28 06:20:55.728995 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 06:20:55.729037 | orchestrator | Tuesday 28 April 2026 06:20:32 +0000 (0:00:01.190) 1:05:05.418 ********* 2026-04-28 06:20:55.729055 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-28 06:20:55.729074 | orchestrator | 2026-04-28 06:20:55.729094 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-28 06:20:55.729112 | orchestrator | Tuesday 28 April 2026 06:20:33 +0000 (0:00:01.378) 1:05:06.797 ********* 2026-04-28 06:20:55.729146 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:20:55.729168 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:20:55.729179 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:20:55.729189 | orchestrator | ok: [testbed-node-4 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 06:20:55.729200 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-4) 2026-04-28 06:20:55.729211 | orchestrator | ok: [testbed-node-4 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 06:20:55.729221 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 06:20:55.729232 | orchestrator | 2026-04-28 06:20:55.729242 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-28 06:20:55.729253 | orchestrator | Tuesday 28 April 2026 06:20:35 +0000 (0:00:01.924) 1:05:08.722 ********* 2026-04-28 06:20:55.729263 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:20:55.729274 | orchestrator | ok: [testbed-node-4 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:20:55.729285 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:20:55.729295 | orchestrator | ok: [testbed-node-4 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 06:20:55.729306 | orchestrator | ok: [testbed-node-4] => (item=testbed-node-4) 2026-04-28 06:20:55.729316 | orchestrator | ok: [testbed-node-4 -> testbed-node-5(192.168.16.15)] => (item=testbed-node-5) 2026-04-28 06:20:55.729327 | orchestrator | ok: [testbed-node-4 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 06:20:55.729338 | orchestrator | 2026-04-28 06:20:55.729348 | orchestrator | TASK [Stop ceph rgw when upgrading from stable-3.2] **************************** 2026-04-28 06:20:55.729359 | orchestrator | Tuesday 28 April 2026 06:20:37 +0000 (0:00:02.421) 1:05:11.143 ********* 2026-04-28 06:20:55.729369 | orchestrator | changed: [testbed-node-4] 2026-04-28 06:20:55.729380 | orchestrator | 2026-04-28 06:20:55.729390 | orchestrator | TASK [Stop ceph rgw (pt. 1)] *************************************************** 2026-04-28 06:20:55.729401 | orchestrator | Tuesday 28 April 2026 06:20:39 +0000 (0:00:01.865) 1:05:13.008 ********* 2026-04-28 06:20:55.729411 | orchestrator | changed: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-28 06:20:55.729422 | orchestrator | 2026-04-28 06:20:55.729433 | orchestrator | TASK [Stop ceph rgw (pt. 2)] *************************************************** 2026-04-28 06:20:55.729443 | orchestrator | Tuesday 28 April 2026 06:20:42 +0000 (0:00:02.590) 1:05:15.599 ********* 2026-04-28 06:20:55.729454 | orchestrator | changed: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-28 06:20:55.729478 | orchestrator | 2026-04-28 06:20:55.729489 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 06:20:55.729500 | orchestrator | Tuesday 28 April 2026 06:20:44 +0000 (0:00:01.899) 1:05:17.499 ********* 2026-04-28 06:20:55.729510 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-4 2026-04-28 06:20:55.729521 | orchestrator | 2026-04-28 06:20:55.729531 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 06:20:55.729542 | orchestrator | Tuesday 28 April 2026 06:20:45 +0000 (0:00:01.286) 1:05:18.785 ********* 2026-04-28 06:20:55.729552 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-4 2026-04-28 06:20:55.729563 | orchestrator | 2026-04-28 06:20:55.729573 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 06:20:55.729583 | orchestrator | Tuesday 28 April 2026 06:20:46 +0000 (0:00:01.103) 1:05:19.888 ********* 2026-04-28 06:20:55.729594 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:55.729604 | orchestrator | 2026-04-28 06:20:55.729614 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 06:20:55.729625 | orchestrator | Tuesday 28 April 2026 06:20:47 +0000 (0:00:01.135) 1:05:21.024 ********* 2026-04-28 06:20:55.729635 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:20:55.729646 | orchestrator | 2026-04-28 06:20:55.729656 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 06:20:55.729667 | orchestrator | Tuesday 28 April 2026 06:20:49 +0000 (0:00:01.514) 1:05:22.539 ********* 2026-04-28 06:20:55.729677 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:20:55.729688 | orchestrator | 2026-04-28 06:20:55.729698 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 06:20:55.729709 | orchestrator | Tuesday 28 April 2026 06:20:50 +0000 (0:00:01.547) 1:05:24.086 ********* 2026-04-28 06:20:55.729719 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:20:55.729730 | orchestrator | 2026-04-28 06:20:55.729740 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 06:20:55.729751 | orchestrator | Tuesday 28 April 2026 06:20:52 +0000 (0:00:01.570) 1:05:25.657 ********* 2026-04-28 06:20:55.729761 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:55.729772 | orchestrator | 2026-04-28 06:20:55.729782 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 06:20:55.729793 | orchestrator | Tuesday 28 April 2026 06:20:53 +0000 (0:00:01.117) 1:05:26.775 ********* 2026-04-28 06:20:55.729832 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:55.729849 | orchestrator | 2026-04-28 06:20:55.729859 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 06:20:55.729870 | orchestrator | Tuesday 28 April 2026 06:20:54 +0000 (0:00:01.158) 1:05:27.934 ********* 2026-04-28 06:20:55.729881 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:20:55.729891 | orchestrator | 2026-04-28 06:20:55.729902 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 06:20:55.729925 | orchestrator | Tuesday 28 April 2026 06:20:55 +0000 (0:00:01.169) 1:05:29.104 ********* 2026-04-28 06:21:36.113545 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:21:36.113636 | orchestrator | 2026-04-28 06:21:36.113656 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 06:21:36.113664 | orchestrator | Tuesday 28 April 2026 06:20:57 +0000 (0:00:01.596) 1:05:30.700 ********* 2026-04-28 06:21:36.113670 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:21:36.113676 | orchestrator | 2026-04-28 06:21:36.113683 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 06:21:36.113689 | orchestrator | Tuesday 28 April 2026 06:20:58 +0000 (0:00:01.632) 1:05:32.332 ********* 2026-04-28 06:21:36.113695 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.113701 | orchestrator | 2026-04-28 06:21:36.113708 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 06:21:36.113731 | orchestrator | Tuesday 28 April 2026 06:20:59 +0000 (0:00:00.819) 1:05:33.152 ********* 2026-04-28 06:21:36.113738 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.113744 | orchestrator | 2026-04-28 06:21:36.113749 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 06:21:36.113802 | orchestrator | Tuesday 28 April 2026 06:21:00 +0000 (0:00:00.969) 1:05:34.122 ********* 2026-04-28 06:21:36.113809 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:21:36.113815 | orchestrator | 2026-04-28 06:21:36.113821 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 06:21:36.113826 | orchestrator | Tuesday 28 April 2026 06:21:01 +0000 (0:00:00.851) 1:05:34.973 ********* 2026-04-28 06:21:36.113832 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:21:36.113838 | orchestrator | 2026-04-28 06:21:36.113844 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 06:21:36.113850 | orchestrator | Tuesday 28 April 2026 06:21:02 +0000 (0:00:00.841) 1:05:35.815 ********* 2026-04-28 06:21:36.113856 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:21:36.113861 | orchestrator | 2026-04-28 06:21:36.113867 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 06:21:36.113873 | orchestrator | Tuesday 28 April 2026 06:21:03 +0000 (0:00:00.788) 1:05:36.604 ********* 2026-04-28 06:21:36.113879 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.113885 | orchestrator | 2026-04-28 06:21:36.113890 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 06:21:36.113896 | orchestrator | Tuesday 28 April 2026 06:21:04 +0000 (0:00:00.790) 1:05:37.395 ********* 2026-04-28 06:21:36.113902 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.113907 | orchestrator | 2026-04-28 06:21:36.113913 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 06:21:36.113919 | orchestrator | Tuesday 28 April 2026 06:21:04 +0000 (0:00:00.844) 1:05:38.240 ********* 2026-04-28 06:21:36.113924 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.113930 | orchestrator | 2026-04-28 06:21:36.113936 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 06:21:36.113941 | orchestrator | Tuesday 28 April 2026 06:21:05 +0000 (0:00:00.778) 1:05:39.018 ********* 2026-04-28 06:21:36.113947 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:21:36.113952 | orchestrator | 2026-04-28 06:21:36.113958 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 06:21:36.113964 | orchestrator | Tuesday 28 April 2026 06:21:06 +0000 (0:00:00.915) 1:05:39.934 ********* 2026-04-28 06:21:36.113969 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:21:36.113975 | orchestrator | 2026-04-28 06:21:36.113981 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-28 06:21:36.113986 | orchestrator | Tuesday 28 April 2026 06:21:07 +0000 (0:00:00.834) 1:05:40.769 ********* 2026-04-28 06:21:36.113992 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.113998 | orchestrator | 2026-04-28 06:21:36.114003 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-28 06:21:36.114009 | orchestrator | Tuesday 28 April 2026 06:21:08 +0000 (0:00:00.806) 1:05:41.575 ********* 2026-04-28 06:21:36.114055 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.114062 | orchestrator | 2026-04-28 06:21:36.114076 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-28 06:21:36.114082 | orchestrator | Tuesday 28 April 2026 06:21:08 +0000 (0:00:00.771) 1:05:42.347 ********* 2026-04-28 06:21:36.114087 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.114093 | orchestrator | 2026-04-28 06:21:36.114099 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-28 06:21:36.114104 | orchestrator | Tuesday 28 April 2026 06:21:09 +0000 (0:00:00.794) 1:05:43.141 ********* 2026-04-28 06:21:36.114111 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.114118 | orchestrator | 2026-04-28 06:21:36.114124 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-28 06:21:36.114136 | orchestrator | Tuesday 28 April 2026 06:21:10 +0000 (0:00:00.813) 1:05:43.955 ********* 2026-04-28 06:21:36.114143 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.114149 | orchestrator | 2026-04-28 06:21:36.114156 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-28 06:21:36.114162 | orchestrator | Tuesday 28 April 2026 06:21:11 +0000 (0:00:00.918) 1:05:44.874 ********* 2026-04-28 06:21:36.114169 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.114175 | orchestrator | 2026-04-28 06:21:36.114182 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-28 06:21:36.114188 | orchestrator | Tuesday 28 April 2026 06:21:12 +0000 (0:00:00.794) 1:05:45.668 ********* 2026-04-28 06:21:36.114195 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.114202 | orchestrator | 2026-04-28 06:21:36.114208 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-28 06:21:36.114216 | orchestrator | Tuesday 28 April 2026 06:21:13 +0000 (0:00:00.826) 1:05:46.495 ********* 2026-04-28 06:21:36.114223 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.114229 | orchestrator | 2026-04-28 06:21:36.114236 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-28 06:21:36.114243 | orchestrator | Tuesday 28 April 2026 06:21:13 +0000 (0:00:00.798) 1:05:47.294 ********* 2026-04-28 06:21:36.114249 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.114256 | orchestrator | 2026-04-28 06:21:36.114285 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-28 06:21:36.114292 | orchestrator | Tuesday 28 April 2026 06:21:14 +0000 (0:00:00.820) 1:05:48.114 ********* 2026-04-28 06:21:36.114299 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.114305 | orchestrator | 2026-04-28 06:21:36.114312 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-28 06:21:36.114319 | orchestrator | Tuesday 28 April 2026 06:21:15 +0000 (0:00:00.840) 1:05:48.955 ********* 2026-04-28 06:21:36.114325 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.114332 | orchestrator | 2026-04-28 06:21:36.114338 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-28 06:21:36.114345 | orchestrator | Tuesday 28 April 2026 06:21:16 +0000 (0:00:00.784) 1:05:49.739 ********* 2026-04-28 06:21:36.114351 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.114358 | orchestrator | 2026-04-28 06:21:36.114365 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-28 06:21:36.114371 | orchestrator | Tuesday 28 April 2026 06:21:17 +0000 (0:00:00.806) 1:05:50.546 ********* 2026-04-28 06:21:36.114378 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:21:36.114385 | orchestrator | 2026-04-28 06:21:36.114392 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-28 06:21:36.114398 | orchestrator | Tuesday 28 April 2026 06:21:18 +0000 (0:00:01.610) 1:05:52.157 ********* 2026-04-28 06:21:36.114405 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:21:36.114412 | orchestrator | 2026-04-28 06:21:36.114419 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-28 06:21:36.114425 | orchestrator | Tuesday 28 April 2026 06:21:20 +0000 (0:00:01.857) 1:05:54.015 ********* 2026-04-28 06:21:36.114431 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-4 2026-04-28 06:21:36.114438 | orchestrator | 2026-04-28 06:21:36.114444 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-28 06:21:36.114449 | orchestrator | Tuesday 28 April 2026 06:21:21 +0000 (0:00:01.138) 1:05:55.154 ********* 2026-04-28 06:21:36.114455 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.114461 | orchestrator | 2026-04-28 06:21:36.114467 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-28 06:21:36.114472 | orchestrator | Tuesday 28 April 2026 06:21:23 +0000 (0:00:01.312) 1:05:56.467 ********* 2026-04-28 06:21:36.114478 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.114488 | orchestrator | 2026-04-28 06:21:36.114494 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-28 06:21:36.114500 | orchestrator | Tuesday 28 April 2026 06:21:24 +0000 (0:00:01.169) 1:05:57.637 ********* 2026-04-28 06:21:36.114506 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-28 06:21:36.114512 | orchestrator | ok: [testbed-node-4] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-28 06:21:36.114517 | orchestrator | 2026-04-28 06:21:36.114523 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-28 06:21:36.114529 | orchestrator | Tuesday 28 April 2026 06:21:26 +0000 (0:00:01.871) 1:05:59.508 ********* 2026-04-28 06:21:36.114534 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:21:36.114540 | orchestrator | 2026-04-28 06:21:36.114546 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-28 06:21:36.114552 | orchestrator | Tuesday 28 April 2026 06:21:27 +0000 (0:00:01.467) 1:06:00.976 ********* 2026-04-28 06:21:36.114557 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.114563 | orchestrator | 2026-04-28 06:21:36.114569 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-28 06:21:36.114575 | orchestrator | Tuesday 28 April 2026 06:21:28 +0000 (0:00:01.176) 1:06:02.153 ********* 2026-04-28 06:21:36.114580 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.114586 | orchestrator | 2026-04-28 06:21:36.114592 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-28 06:21:36.114598 | orchestrator | Tuesday 28 April 2026 06:21:29 +0000 (0:00:00.922) 1:06:03.075 ********* 2026-04-28 06:21:36.114603 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.114609 | orchestrator | 2026-04-28 06:21:36.114615 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-28 06:21:36.114620 | orchestrator | Tuesday 28 April 2026 06:21:30 +0000 (0:00:00.845) 1:06:03.921 ********* 2026-04-28 06:21:36.114626 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-4 2026-04-28 06:21:36.114632 | orchestrator | 2026-04-28 06:21:36.114638 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-28 06:21:36.114643 | orchestrator | Tuesday 28 April 2026 06:21:31 +0000 (0:00:01.197) 1:06:05.119 ********* 2026-04-28 06:21:36.114649 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:21:36.114655 | orchestrator | 2026-04-28 06:21:36.114661 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-28 06:21:36.114667 | orchestrator | Tuesday 28 April 2026 06:21:33 +0000 (0:00:01.813) 1:06:06.933 ********* 2026-04-28 06:21:36.114673 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-28 06:21:36.114678 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-28 06:21:36.114684 | orchestrator | skipping: [testbed-node-4] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-28 06:21:36.114690 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.114696 | orchestrator | 2026-04-28 06:21:36.114701 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-28 06:21:36.114707 | orchestrator | Tuesday 28 April 2026 06:21:34 +0000 (0:00:01.194) 1:06:08.127 ********* 2026-04-28 06:21:36.114713 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.114718 | orchestrator | 2026-04-28 06:21:36.114724 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-28 06:21:36.114730 | orchestrator | Tuesday 28 April 2026 06:21:35 +0000 (0:00:01.150) 1:06:09.278 ********* 2026-04-28 06:21:36.114735 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:21:36.114741 | orchestrator | 2026-04-28 06:21:36.114767 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-28 06:22:20.145946 | orchestrator | Tuesday 28 April 2026 06:21:37 +0000 (0:00:01.205) 1:06:10.483 ********* 2026-04-28 06:22:20.146106 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.146122 | orchestrator | 2026-04-28 06:22:20.146132 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-28 06:22:20.146161 | orchestrator | Tuesday 28 April 2026 06:21:38 +0000 (0:00:01.396) 1:06:11.880 ********* 2026-04-28 06:22:20.146170 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.146178 | orchestrator | 2026-04-28 06:22:20.146186 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-28 06:22:20.146194 | orchestrator | Tuesday 28 April 2026 06:21:39 +0000 (0:00:01.230) 1:06:13.110 ********* 2026-04-28 06:22:20.146202 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.146210 | orchestrator | 2026-04-28 06:22:20.146217 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-28 06:22:20.146225 | orchestrator | Tuesday 28 April 2026 06:21:40 +0000 (0:00:00.838) 1:06:13.949 ********* 2026-04-28 06:22:20.146233 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:22:20.146242 | orchestrator | 2026-04-28 06:22:20.146250 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-28 06:22:20.146259 | orchestrator | Tuesday 28 April 2026 06:21:42 +0000 (0:00:02.065) 1:06:16.014 ********* 2026-04-28 06:22:20.146267 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:22:20.146274 | orchestrator | 2026-04-28 06:22:20.146282 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-28 06:22:20.146290 | orchestrator | Tuesday 28 April 2026 06:21:43 +0000 (0:00:00.795) 1:06:16.810 ********* 2026-04-28 06:22:20.146298 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-4 2026-04-28 06:22:20.146306 | orchestrator | 2026-04-28 06:22:20.146314 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-28 06:22:20.146322 | orchestrator | Tuesday 28 April 2026 06:21:44 +0000 (0:00:01.226) 1:06:18.037 ********* 2026-04-28 06:22:20.146330 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.146337 | orchestrator | 2026-04-28 06:22:20.146345 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-28 06:22:20.146353 | orchestrator | Tuesday 28 April 2026 06:21:45 +0000 (0:00:01.192) 1:06:19.229 ********* 2026-04-28 06:22:20.146361 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.146368 | orchestrator | 2026-04-28 06:22:20.146376 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-28 06:22:20.146384 | orchestrator | Tuesday 28 April 2026 06:21:47 +0000 (0:00:01.187) 1:06:20.417 ********* 2026-04-28 06:22:20.146392 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.146399 | orchestrator | 2026-04-28 06:22:20.146407 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-28 06:22:20.146415 | orchestrator | Tuesday 28 April 2026 06:21:48 +0000 (0:00:01.153) 1:06:21.571 ********* 2026-04-28 06:22:20.146423 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.146431 | orchestrator | 2026-04-28 06:22:20.146439 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-28 06:22:20.146447 | orchestrator | Tuesday 28 April 2026 06:21:49 +0000 (0:00:01.156) 1:06:22.728 ********* 2026-04-28 06:22:20.146455 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.146463 | orchestrator | 2026-04-28 06:22:20.146471 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-28 06:22:20.146480 | orchestrator | Tuesday 28 April 2026 06:21:50 +0000 (0:00:01.166) 1:06:23.894 ********* 2026-04-28 06:22:20.146489 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.146498 | orchestrator | 2026-04-28 06:22:20.146507 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-28 06:22:20.146516 | orchestrator | Tuesday 28 April 2026 06:21:51 +0000 (0:00:01.142) 1:06:25.037 ********* 2026-04-28 06:22:20.146525 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.146534 | orchestrator | 2026-04-28 06:22:20.146544 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-28 06:22:20.146553 | orchestrator | Tuesday 28 April 2026 06:21:52 +0000 (0:00:01.305) 1:06:26.342 ********* 2026-04-28 06:22:20.146561 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.146576 | orchestrator | 2026-04-28 06:22:20.146585 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-28 06:22:20.146595 | orchestrator | Tuesday 28 April 2026 06:21:54 +0000 (0:00:01.153) 1:06:27.495 ********* 2026-04-28 06:22:20.146604 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:22:20.146613 | orchestrator | 2026-04-28 06:22:20.146622 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-28 06:22:20.146630 | orchestrator | Tuesday 28 April 2026 06:21:54 +0000 (0:00:00.839) 1:06:28.335 ********* 2026-04-28 06:22:20.146640 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-4 2026-04-28 06:22:20.146650 | orchestrator | 2026-04-28 06:22:20.146659 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-28 06:22:20.146668 | orchestrator | Tuesday 28 April 2026 06:21:56 +0000 (0:00:01.231) 1:06:29.566 ********* 2026-04-28 06:22:20.146677 | orchestrator | ok: [testbed-node-4] => (item=/etc/ceph) 2026-04-28 06:22:20.146687 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/) 2026-04-28 06:22:20.146696 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/mon) 2026-04-28 06:22:20.146724 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/osd) 2026-04-28 06:22:20.146734 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/mds) 2026-04-28 06:22:20.146743 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/tmp) 2026-04-28 06:22:20.146752 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/crash) 2026-04-28 06:22:20.146762 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/radosgw) 2026-04-28 06:22:20.146771 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-28 06:22:20.146781 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-28 06:22:20.146802 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-28 06:22:20.146827 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-28 06:22:20.146836 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-28 06:22:20.146844 | orchestrator | ok: [testbed-node-4] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-28 06:22:20.146852 | orchestrator | ok: [testbed-node-4] => (item=/var/run/ceph) 2026-04-28 06:22:20.146860 | orchestrator | ok: [testbed-node-4] => (item=/var/log/ceph) 2026-04-28 06:22:20.146868 | orchestrator | 2026-04-28 06:22:20.146876 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-28 06:22:20.146884 | orchestrator | Tuesday 28 April 2026 06:22:02 +0000 (0:00:06.203) 1:06:35.770 ********* 2026-04-28 06:22:20.146891 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-4 2026-04-28 06:22:20.146899 | orchestrator | 2026-04-28 06:22:20.146907 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-28 06:22:20.146915 | orchestrator | Tuesday 28 April 2026 06:22:03 +0000 (0:00:01.110) 1:06:36.881 ********* 2026-04-28 06:22:20.146923 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-28 06:22:20.146932 | orchestrator | 2026-04-28 06:22:20.146940 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-28 06:22:20.146947 | orchestrator | Tuesday 28 April 2026 06:22:05 +0000 (0:00:01.517) 1:06:38.398 ********* 2026-04-28 06:22:20.146955 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-28 06:22:20.146963 | orchestrator | 2026-04-28 06:22:20.146971 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-28 06:22:20.146979 | orchestrator | Tuesday 28 April 2026 06:22:06 +0000 (0:00:01.685) 1:06:40.084 ********* 2026-04-28 06:22:20.146986 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.146994 | orchestrator | 2026-04-28 06:22:20.147002 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-28 06:22:20.147016 | orchestrator | Tuesday 28 April 2026 06:22:07 +0000 (0:00:00.833) 1:06:40.918 ********* 2026-04-28 06:22:20.147024 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.147031 | orchestrator | 2026-04-28 06:22:20.147039 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-28 06:22:20.147047 | orchestrator | Tuesday 28 April 2026 06:22:08 +0000 (0:00:00.766) 1:06:41.684 ********* 2026-04-28 06:22:20.147055 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.147062 | orchestrator | 2026-04-28 06:22:20.147070 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-28 06:22:20.147078 | orchestrator | Tuesday 28 April 2026 06:22:09 +0000 (0:00:00.765) 1:06:42.450 ********* 2026-04-28 06:22:20.147086 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.147093 | orchestrator | 2026-04-28 06:22:20.147101 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-28 06:22:20.147109 | orchestrator | Tuesday 28 April 2026 06:22:10 +0000 (0:00:01.033) 1:06:43.484 ********* 2026-04-28 06:22:20.147117 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.147124 | orchestrator | 2026-04-28 06:22:20.147132 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-28 06:22:20.147140 | orchestrator | Tuesday 28 April 2026 06:22:10 +0000 (0:00:00.800) 1:06:44.284 ********* 2026-04-28 06:22:20.147148 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.147156 | orchestrator | 2026-04-28 06:22:20.147164 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-28 06:22:20.147172 | orchestrator | Tuesday 28 April 2026 06:22:11 +0000 (0:00:00.818) 1:06:45.103 ********* 2026-04-28 06:22:20.147179 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.147187 | orchestrator | 2026-04-28 06:22:20.147195 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-28 06:22:20.147203 | orchestrator | Tuesday 28 April 2026 06:22:12 +0000 (0:00:00.790) 1:06:45.894 ********* 2026-04-28 06:22:20.147211 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.147219 | orchestrator | 2026-04-28 06:22:20.147227 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-28 06:22:20.147234 | orchestrator | Tuesday 28 April 2026 06:22:13 +0000 (0:00:00.808) 1:06:46.702 ********* 2026-04-28 06:22:20.147242 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.147250 | orchestrator | 2026-04-28 06:22:20.147258 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-28 06:22:20.147265 | orchestrator | Tuesday 28 April 2026 06:22:14 +0000 (0:00:00.786) 1:06:47.488 ********* 2026-04-28 06:22:20.147273 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.147281 | orchestrator | 2026-04-28 06:22:20.147289 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-28 06:22:20.147296 | orchestrator | Tuesday 28 April 2026 06:22:14 +0000 (0:00:00.875) 1:06:48.364 ********* 2026-04-28 06:22:20.147304 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:22:20.147312 | orchestrator | 2026-04-28 06:22:20.147320 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-28 06:22:20.147327 | orchestrator | Tuesday 28 April 2026 06:22:15 +0000 (0:00:00.784) 1:06:49.148 ********* 2026-04-28 06:22:20.147335 | orchestrator | changed: [testbed-node-4 -> testbed-node-2(192.168.16.12)] 2026-04-28 06:22:20.147343 | orchestrator | 2026-04-28 06:22:20.147351 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-28 06:22:20.147358 | orchestrator | Tuesday 28 April 2026 06:22:19 +0000 (0:00:04.153) 1:06:53.302 ********* 2026-04-28 06:22:20.147366 | orchestrator | ok: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-28 06:22:20.147374 | orchestrator | 2026-04-28 06:22:20.147391 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-28 06:23:01.078649 | orchestrator | Tuesday 28 April 2026 06:22:20 +0000 (0:00:00.868) 1:06:54.170 ********* 2026-04-28 06:23:01.078841 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log'}]) 2026-04-28 06:23:01.078861 | orchestrator | ok: [testbed-node-4 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-4.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-4.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.14:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.14:8081'}]) 2026-04-28 06:23:01.078875 | orchestrator | 2026-04-28 06:23:01.078887 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-28 06:23:01.078898 | orchestrator | Tuesday 28 April 2026 06:22:25 +0000 (0:00:04.691) 1:06:58.861 ********* 2026-04-28 06:23:01.078910 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:23:01.078922 | orchestrator | 2026-04-28 06:23:01.078934 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-28 06:23:01.078945 | orchestrator | Tuesday 28 April 2026 06:22:26 +0000 (0:00:00.782) 1:06:59.643 ********* 2026-04-28 06:23:01.078956 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:23:01.078967 | orchestrator | 2026-04-28 06:23:01.078978 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 06:23:01.078991 | orchestrator | Tuesday 28 April 2026 06:22:27 +0000 (0:00:00.817) 1:07:00.461 ********* 2026-04-28 06:23:01.079002 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:23:01.079013 | orchestrator | 2026-04-28 06:23:01.079024 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 06:23:01.079035 | orchestrator | Tuesday 28 April 2026 06:22:28 +0000 (0:00:01.034) 1:07:01.496 ********* 2026-04-28 06:23:01.079046 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:23:01.079057 | orchestrator | 2026-04-28 06:23:01.079067 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 06:23:01.079078 | orchestrator | Tuesday 28 April 2026 06:22:28 +0000 (0:00:00.807) 1:07:02.303 ********* 2026-04-28 06:23:01.079089 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:23:01.079100 | orchestrator | 2026-04-28 06:23:01.079111 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 06:23:01.079121 | orchestrator | Tuesday 28 April 2026 06:22:29 +0000 (0:00:00.858) 1:07:03.162 ********* 2026-04-28 06:23:01.079132 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:23:01.079145 | orchestrator | 2026-04-28 06:23:01.079155 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 06:23:01.079166 | orchestrator | Tuesday 28 April 2026 06:22:30 +0000 (0:00:00.928) 1:07:04.091 ********* 2026-04-28 06:23:01.079177 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-28 06:23:01.079189 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-28 06:23:01.079200 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-28 06:23:01.079211 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:23:01.079222 | orchestrator | 2026-04-28 06:23:01.079233 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 06:23:01.079244 | orchestrator | Tuesday 28 April 2026 06:22:31 +0000 (0:00:01.138) 1:07:05.229 ********* 2026-04-28 06:23:01.079255 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-28 06:23:01.079266 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-28 06:23:01.079276 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-28 06:23:01.079287 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:23:01.079298 | orchestrator | 2026-04-28 06:23:01.079309 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 06:23:01.079328 | orchestrator | Tuesday 28 April 2026 06:22:32 +0000 (0:00:01.116) 1:07:06.346 ********* 2026-04-28 06:23:01.079339 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-3)  2026-04-28 06:23:01.079350 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-4)  2026-04-28 06:23:01.079361 | orchestrator | skipping: [testbed-node-4] => (item=testbed-node-5)  2026-04-28 06:23:01.079372 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:23:01.079382 | orchestrator | 2026-04-28 06:23:01.079394 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 06:23:01.079404 | orchestrator | Tuesday 28 April 2026 06:22:34 +0000 (0:00:01.078) 1:07:07.425 ********* 2026-04-28 06:23:01.079415 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:23:01.079426 | orchestrator | 2026-04-28 06:23:01.079437 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 06:23:01.079448 | orchestrator | Tuesday 28 April 2026 06:22:34 +0000 (0:00:00.842) 1:07:08.267 ********* 2026-04-28 06:23:01.079459 | orchestrator | ok: [testbed-node-4] => (item=0) 2026-04-28 06:23:01.079470 | orchestrator | 2026-04-28 06:23:01.079481 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-28 06:23:01.079492 | orchestrator | Tuesday 28 April 2026 06:22:35 +0000 (0:00:01.046) 1:07:09.314 ********* 2026-04-28 06:23:01.079502 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:23:01.079513 | orchestrator | 2026-04-28 06:23:01.079524 | orchestrator | TASK [ceph-rgw : Include common.yml] ******************************************* 2026-04-28 06:23:01.079535 | orchestrator | Tuesday 28 April 2026 06:22:37 +0000 (0:00:01.407) 1:07:10.722 ********* 2026-04-28 06:23:01.079561 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/common.yml for testbed-node-4 2026-04-28 06:23:01.079572 | orchestrator | 2026-04-28 06:23:01.079600 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-28 06:23:01.079612 | orchestrator | Tuesday 28 April 2026 06:22:38 +0000 (0:00:01.335) 1:07:12.058 ********* 2026-04-28 06:23:01.079623 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 06:23:01.079633 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-28 06:23:01.079644 | orchestrator | ok: [testbed-node-4 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-28 06:23:01.079655 | orchestrator | 2026-04-28 06:23:01.079708 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-28 06:23:01.079728 | orchestrator | Tuesday 28 April 2026 06:22:41 +0000 (0:00:03.190) 1:07:15.249 ********* 2026-04-28 06:23:01.079746 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-28 06:23:01.079766 | orchestrator | skipping: [testbed-node-4] => (item=None)  2026-04-28 06:23:01.079777 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:23:01.079788 | orchestrator | 2026-04-28 06:23:01.079799 | orchestrator | TASK [ceph-rgw : Copy SSL certificate & key data to certificate path] ********** 2026-04-28 06:23:01.079809 | orchestrator | Tuesday 28 April 2026 06:22:43 +0000 (0:00:01.948) 1:07:17.197 ********* 2026-04-28 06:23:01.079820 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:23:01.079830 | orchestrator | 2026-04-28 06:23:01.079841 | orchestrator | TASK [ceph-rgw : Include_tasks pre_requisite.yml] ****************************** 2026-04-28 06:23:01.079851 | orchestrator | Tuesday 28 April 2026 06:22:44 +0000 (0:00:00.810) 1:07:18.008 ********* 2026-04-28 06:23:01.079862 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/pre_requisite.yml for testbed-node-4 2026-04-28 06:23:01.079874 | orchestrator | 2026-04-28 06:23:01.079885 | orchestrator | TASK [ceph-rgw : Create rados gateway directories] ***************************** 2026-04-28 06:23:01.079896 | orchestrator | Tuesday 28 April 2026 06:22:45 +0000 (0:00:01.156) 1:07:19.165 ********* 2026-04-28 06:23:01.079907 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-28 06:23:01.079919 | orchestrator | 2026-04-28 06:23:01.079930 | orchestrator | TASK [ceph-rgw : Create rgw keyrings] ****************************************** 2026-04-28 06:23:01.079941 | orchestrator | Tuesday 28 April 2026 06:22:47 +0000 (0:00:01.689) 1:07:20.854 ********* 2026-04-28 06:23:01.079960 | orchestrator | changed: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 06:23:01.079971 | orchestrator | changed: [testbed-node-4 -> {{ groups[mon_group_name][0] if groups.get(mon_group_name, []) | length > 0 else 'localhost' }}] 2026-04-28 06:23:01.079982 | orchestrator | 2026-04-28 06:23:01.079993 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-28 06:23:01.080003 | orchestrator | Tuesday 28 April 2026 06:22:52 +0000 (0:00:04.868) 1:07:25.723 ********* 2026-04-28 06:23:01.080014 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 06:23:01.080024 | orchestrator | ok: [testbed-node-4 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-28 06:23:01.080035 | orchestrator | 2026-04-28 06:23:01.080046 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-28 06:23:01.080056 | orchestrator | Tuesday 28 April 2026 06:22:55 +0000 (0:00:02.987) 1:07:28.711 ********* 2026-04-28 06:23:01.080067 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-28 06:23:01.080078 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:23:01.080089 | orchestrator | 2026-04-28 06:23:01.080099 | orchestrator | TASK [ceph-rgw : Rgw pool creation tasks] ************************************** 2026-04-28 06:23:01.080110 | orchestrator | Tuesday 28 April 2026 06:22:56 +0000 (0:00:01.582) 1:07:30.294 ********* 2026-04-28 06:23:01.080120 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/rgw_create_pools.yml for testbed-node-4 2026-04-28 06:23:01.080131 | orchestrator | 2026-04-28 06:23:01.080142 | orchestrator | TASK [ceph-rgw : Create ec profile] ******************************************** 2026-04-28 06:23:01.080152 | orchestrator | Tuesday 28 April 2026 06:22:58 +0000 (0:00:01.215) 1:07:31.509 ********* 2026-04-28 06:23:01.080163 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:23:01.080174 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:23:01.080185 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:23:01.080196 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:23:01.080207 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:23:01.080218 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:23:01.080228 | orchestrator | 2026-04-28 06:23:01.080239 | orchestrator | TASK [ceph-rgw : Set crush rule] *********************************************** 2026-04-28 06:23:01.080250 | orchestrator | Tuesday 28 April 2026 06:23:00 +0000 (0:00:02.045) 1:07:33.555 ********* 2026-04-28 06:23:01.080261 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:23:01.080271 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:23:01.080288 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:23:01.080306 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:24:06.869919 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:24:06.870106 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:24:06.870126 | orchestrator | 2026-04-28 06:24:06.870139 | orchestrator | TASK [ceph-rgw : Create rgw pools] ********************************************* 2026-04-28 06:24:06.870152 | orchestrator | Tuesday 28 April 2026 06:23:02 +0000 (0:00:02.238) 1:07:35.794 ********* 2026-04-28 06:24:06.870194 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-28 06:24:06.870208 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-28 06:24:06.870219 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-28 06:24:06.870230 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-28 06:24:06.870242 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-28 06:24:06.870253 | orchestrator | 2026-04-28 06:24:06.870264 | orchestrator | TASK [ceph-rgw : Include_tasks openstack-keystone.yml] ************************* 2026-04-28 06:24:06.870275 | orchestrator | Tuesday 28 April 2026 06:23:32 +0000 (0:00:30.205) 1:08:05.999 ********* 2026-04-28 06:24:06.870286 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:24:06.870297 | orchestrator | 2026-04-28 06:24:06.870307 | orchestrator | TASK [ceph-rgw : Include_tasks start_radosgw.yml] ****************************** 2026-04-28 06:24:06.870318 | orchestrator | Tuesday 28 April 2026 06:23:33 +0000 (0:00:00.788) 1:08:06.788 ********* 2026-04-28 06:24:06.870328 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:24:06.870339 | orchestrator | 2026-04-28 06:24:06.870350 | orchestrator | TASK [ceph-rgw : Include start_docker_rgw.yml] ********************************* 2026-04-28 06:24:06.870362 | orchestrator | Tuesday 28 April 2026 06:23:34 +0000 (0:00:00.790) 1:08:07.579 ********* 2026-04-28 06:24:06.870372 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/start_docker_rgw.yml for testbed-node-4 2026-04-28 06:24:06.870384 | orchestrator | 2026-04-28 06:24:06.870395 | orchestrator | TASK [ceph-rgw : Include_task systemd.yml] ************************************* 2026-04-28 06:24:06.870406 | orchestrator | Tuesday 28 April 2026 06:23:35 +0000 (0:00:01.134) 1:08:08.714 ********* 2026-04-28 06:24:06.870417 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/systemd.yml for testbed-node-4 2026-04-28 06:24:06.870427 | orchestrator | 2026-04-28 06:24:06.870438 | orchestrator | TASK [ceph-rgw : Generate systemd unit file] *********************************** 2026-04-28 06:24:06.870449 | orchestrator | Tuesday 28 April 2026 06:23:36 +0000 (0:00:01.102) 1:08:09.816 ********* 2026-04-28 06:24:06.870461 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:24:06.870475 | orchestrator | 2026-04-28 06:24:06.870487 | orchestrator | TASK [ceph-rgw : Generate systemd ceph-radosgw target file] ******************** 2026-04-28 06:24:06.870499 | orchestrator | Tuesday 28 April 2026 06:23:38 +0000 (0:00:02.037) 1:08:11.854 ********* 2026-04-28 06:24:06.870512 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:24:06.870524 | orchestrator | 2026-04-28 06:24:06.870535 | orchestrator | TASK [ceph-rgw : Enable ceph-radosgw.target] *********************************** 2026-04-28 06:24:06.870545 | orchestrator | Tuesday 28 April 2026 06:23:40 +0000 (0:00:01.979) 1:08:13.833 ********* 2026-04-28 06:24:06.870556 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:24:06.870567 | orchestrator | 2026-04-28 06:24:06.870577 | orchestrator | TASK [ceph-rgw : Systemd start rgw container] ********************************** 2026-04-28 06:24:06.870588 | orchestrator | Tuesday 28 April 2026 06:23:42 +0000 (0:00:02.272) 1:08:16.106 ********* 2026-04-28 06:24:06.870621 | orchestrator | changed: [testbed-node-4] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.14', 'radosgw_frontend_port': 8081}) 2026-04-28 06:24:06.870633 | orchestrator | 2026-04-28 06:24:06.870643 | orchestrator | PLAY [Upgrade ceph rgws cluster] *********************************************** 2026-04-28 06:24:06.870654 | orchestrator | 2026-04-28 06:24:06.870664 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 06:24:06.870675 | orchestrator | Tuesday 28 April 2026 06:23:45 +0000 (0:00:03.084) 1:08:19.190 ********* 2026-04-28 06:24:06.870685 | orchestrator | included: /ansible/roles/ceph-facts/tasks/facts.yml for testbed-node-5 2026-04-28 06:24:06.870704 | orchestrator | 2026-04-28 06:24:06.870715 | orchestrator | TASK [ceph-facts : Check if it is atomic host] ********************************* 2026-04-28 06:24:06.870726 | orchestrator | Tuesday 28 April 2026 06:23:46 +0000 (0:00:01.140) 1:08:20.330 ********* 2026-04-28 06:24:06.870737 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:24:06.870747 | orchestrator | 2026-04-28 06:24:06.870758 | orchestrator | TASK [ceph-facts : Set_fact is_atomic] ***************************************** 2026-04-28 06:24:06.870769 | orchestrator | Tuesday 28 April 2026 06:23:48 +0000 (0:00:01.440) 1:08:21.771 ********* 2026-04-28 06:24:06.870779 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:24:06.870790 | orchestrator | 2026-04-28 06:24:06.870800 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 06:24:06.870811 | orchestrator | Tuesday 28 April 2026 06:23:49 +0000 (0:00:01.126) 1:08:22.898 ********* 2026-04-28 06:24:06.870821 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:24:06.870832 | orchestrator | 2026-04-28 06:24:06.870856 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 06:24:06.870867 | orchestrator | Tuesday 28 April 2026 06:23:51 +0000 (0:00:01.519) 1:08:24.418 ********* 2026-04-28 06:24:06.870878 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:24:06.870889 | orchestrator | 2026-04-28 06:24:06.870918 | orchestrator | TASK [ceph-facts : Set_fact ceph_cmd] ****************************************** 2026-04-28 06:24:06.870929 | orchestrator | Tuesday 28 April 2026 06:23:52 +0000 (0:00:01.126) 1:08:25.544 ********* 2026-04-28 06:24:06.870940 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:24:06.870950 | orchestrator | 2026-04-28 06:24:06.870961 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python] ********************* 2026-04-28 06:24:06.870972 | orchestrator | Tuesday 28 April 2026 06:23:53 +0000 (0:00:01.136) 1:08:26.681 ********* 2026-04-28 06:24:06.870983 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:24:06.870993 | orchestrator | 2026-04-28 06:24:06.871004 | orchestrator | TASK [ceph-facts : Set_fact discovered_interpreter_python if not previously set] *** 2026-04-28 06:24:06.871015 | orchestrator | Tuesday 28 April 2026 06:23:54 +0000 (0:00:01.175) 1:08:27.856 ********* 2026-04-28 06:24:06.871026 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:24:06.871036 | orchestrator | 2026-04-28 06:24:06.871047 | orchestrator | TASK [ceph-facts : Set_fact ceph_release ceph_stable_release] ****************** 2026-04-28 06:24:06.871057 | orchestrator | Tuesday 28 April 2026 06:23:55 +0000 (0:00:01.126) 1:08:28.983 ********* 2026-04-28 06:24:06.871068 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:24:06.871078 | orchestrator | 2026-04-28 06:24:06.871089 | orchestrator | TASK [ceph-facts : Set_fact monitor_name ansible_facts['hostname']] ************ 2026-04-28 06:24:06.871100 | orchestrator | Tuesday 28 April 2026 06:23:56 +0000 (0:00:01.183) 1:08:30.167 ********* 2026-04-28 06:24:06.871110 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:24:06.871121 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:24:06.871132 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:24:06.871142 | orchestrator | 2026-04-28 06:24:06.871153 | orchestrator | TASK [ceph-facts : Set_fact container_exec_cmd] ******************************** 2026-04-28 06:24:06.871164 | orchestrator | Tuesday 28 April 2026 06:23:58 +0000 (0:00:02.101) 1:08:32.268 ********* 2026-04-28 06:24:06.871174 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:24:06.871185 | orchestrator | 2026-04-28 06:24:06.871196 | orchestrator | TASK [ceph-facts : Find a running mon container] ******************************* 2026-04-28 06:24:06.871206 | orchestrator | Tuesday 28 April 2026 06:24:00 +0000 (0:00:01.256) 1:08:33.524 ********* 2026-04-28 06:24:06.871217 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:24:06.871228 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:24:06.871238 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:24:06.871259 | orchestrator | 2026-04-28 06:24:06.871270 | orchestrator | TASK [ceph-facts : Check for a ceph mon socket] ******************************** 2026-04-28 06:24:06.871281 | orchestrator | Tuesday 28 April 2026 06:24:03 +0000 (0:00:03.383) 1:08:36.907 ********* 2026-04-28 06:24:06.871291 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-28 06:24:06.871303 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-28 06:24:06.871314 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-28 06:24:06.871324 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:24:06.871335 | orchestrator | 2026-04-28 06:24:06.871346 | orchestrator | TASK [ceph-facts : Check if the ceph mon socket is in-use] ********************* 2026-04-28 06:24:06.871357 | orchestrator | Tuesday 28 April 2026 06:24:04 +0000 (0:00:01.459) 1:08:38.367 ********* 2026-04-28 06:24:06.871369 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'})  2026-04-28 06:24:06.871383 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'})  2026-04-28 06:24:06.871394 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'})  2026-04-28 06:24:06.871405 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:24:06.871416 | orchestrator | 2026-04-28 06:24:06.871427 | orchestrator | TASK [ceph-facts : Set_fact running_mon - non_container] *********************** 2026-04-28 06:24:06.871438 | orchestrator | Tuesday 28 April 2026 06:24:06 +0000 (0:00:01.789) 1:08:40.157 ********* 2026-04-28 06:24:06.871450 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 06:24:06.871476 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 06:24:27.057650 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': {'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'not containerized_deployment | bool', 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}, 'ansible_loop_var': 'item'})  2026-04-28 06:24:27.057769 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:24:27.057786 | orchestrator | 2026-04-28 06:24:27.057800 | orchestrator | TASK [ceph-facts : Set_fact running_mon - container] *************************** 2026-04-28 06:24:27.057812 | orchestrator | Tuesday 28 April 2026 06:24:07 +0000 (0:00:01.212) 1:08:41.369 ********* 2026-04-28 06:24:27.057826 | orchestrator | ok: [testbed-node-5] => (item={'changed': False, 'stdout': 'e79a9ee6c12b', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-0'], 'start': '2026-04-28 06:24:01.107373', 'end': '2026-04-28 06:24:01.149110', 'delta': '0:00:00.041737', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-0', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['e79a9ee6c12b'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-0', 'ansible_loop_var': 'item'}) 2026-04-28 06:24:27.057867 | orchestrator | ok: [testbed-node-5] => (item={'changed': False, 'stdout': '00fb93644bb9', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-1'], 'start': '2026-04-28 06:24:01.671243', 'end': '2026-04-28 06:24:01.720126', 'delta': '0:00:00.048883', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-1', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['00fb93644bb9'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-1', 'ansible_loop_var': 'item'}) 2026-04-28 06:24:27.057881 | orchestrator | ok: [testbed-node-5] => (item={'changed': False, 'stdout': '92b926b7d044', 'stderr': '', 'rc': 0, 'cmd': ['docker', 'ps', '-q', '--filter', 'name=ceph-mon-testbed-node-2'], 'start': '2026-04-28 06:24:02.255601', 'end': '2026-04-28 06:24:02.296862', 'delta': '0:00:00.041261', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'docker ps -q --filter name=ceph-mon-testbed-node-2', '_uses_shell': False, 'expand_argument_vars': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['92b926b7d044'], 'stderr_lines': [], 'failed': False, 'failed_when_result': False, 'item': 'testbed-node-2', 'ansible_loop_var': 'item'}) 2026-04-28 06:24:27.057892 | orchestrator | 2026-04-28 06:24:27.057903 | orchestrator | TASK [ceph-facts : Set_fact _container_exec_cmd] ******************************* 2026-04-28 06:24:27.057914 | orchestrator | Tuesday 28 April 2026 06:24:09 +0000 (0:00:01.289) 1:08:42.659 ********* 2026-04-28 06:24:27.057925 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:24:27.057937 | orchestrator | 2026-04-28 06:24:27.057947 | orchestrator | TASK [ceph-facts : Get current fsid if cluster is already running] ************* 2026-04-28 06:24:27.057958 | orchestrator | Tuesday 28 April 2026 06:24:10 +0000 (0:00:01.308) 1:08:43.967 ********* 2026-04-28 06:24:27.057969 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:24:27.057979 | orchestrator | 2026-04-28 06:24:27.057990 | orchestrator | TASK [ceph-facts : Set_fact current_fsid rc 1] ********************************* 2026-04-28 06:24:27.058000 | orchestrator | Tuesday 28 April 2026 06:24:11 +0000 (0:00:01.289) 1:08:45.256 ********* 2026-04-28 06:24:27.058011 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:24:27.058086 | orchestrator | 2026-04-28 06:24:27.058099 | orchestrator | TASK [ceph-facts : Get current fsid] ******************************************* 2026-04-28 06:24:27.058110 | orchestrator | Tuesday 28 April 2026 06:24:13 +0000 (0:00:01.157) 1:08:46.414 ********* 2026-04-28 06:24:27.058120 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] 2026-04-28 06:24:27.058131 | orchestrator | 2026-04-28 06:24:27.058144 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 06:24:27.058170 | orchestrator | Tuesday 28 April 2026 06:24:15 +0000 (0:00:02.032) 1:08:48.446 ********* 2026-04-28 06:24:27.058183 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:24:27.058196 | orchestrator | 2026-04-28 06:24:27.058208 | orchestrator | TASK [ceph-facts : Set_fact fsid from current_fsid] **************************** 2026-04-28 06:24:27.058221 | orchestrator | Tuesday 28 April 2026 06:24:16 +0000 (0:00:01.194) 1:08:49.641 ********* 2026-04-28 06:24:27.058251 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:24:27.058265 | orchestrator | 2026-04-28 06:24:27.058277 | orchestrator | TASK [ceph-facts : Generate cluster fsid] ************************************** 2026-04-28 06:24:27.058289 | orchestrator | Tuesday 28 April 2026 06:24:17 +0000 (0:00:01.168) 1:08:50.810 ********* 2026-04-28 06:24:27.058312 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:24:27.058324 | orchestrator | 2026-04-28 06:24:27.058337 | orchestrator | TASK [ceph-facts : Set_fact fsid] ********************************************** 2026-04-28 06:24:27.058350 | orchestrator | Tuesday 28 April 2026 06:24:18 +0000 (0:00:01.234) 1:08:52.045 ********* 2026-04-28 06:24:27.058362 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:24:27.058374 | orchestrator | 2026-04-28 06:24:27.058384 | orchestrator | TASK [ceph-facts : Resolve device link(s)] ************************************* 2026-04-28 06:24:27.058395 | orchestrator | Tuesday 28 April 2026 06:24:19 +0000 (0:00:01.132) 1:08:53.177 ********* 2026-04-28 06:24:27.058405 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:24:27.058416 | orchestrator | 2026-04-28 06:24:27.058427 | orchestrator | TASK [ceph-facts : Set_fact build devices from resolved symlinks] ************** 2026-04-28 06:24:27.058437 | orchestrator | Tuesday 28 April 2026 06:24:21 +0000 (0:00:01.266) 1:08:54.443 ********* 2026-04-28 06:24:27.058448 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:24:27.058458 | orchestrator | 2026-04-28 06:24:27.058469 | orchestrator | TASK [ceph-facts : Resolve dedicated_device link(s)] *************************** 2026-04-28 06:24:27.058480 | orchestrator | Tuesday 28 April 2026 06:24:22 +0000 (0:00:01.169) 1:08:55.613 ********* 2026-04-28 06:24:27.058490 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:24:27.058501 | orchestrator | 2026-04-28 06:24:27.058511 | orchestrator | TASK [ceph-facts : Set_fact build dedicated_devices from resolved symlinks] **** 2026-04-28 06:24:27.058522 | orchestrator | Tuesday 28 April 2026 06:24:23 +0000 (0:00:01.121) 1:08:56.735 ********* 2026-04-28 06:24:27.058532 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:24:27.058543 | orchestrator | 2026-04-28 06:24:27.058554 | orchestrator | TASK [ceph-facts : Resolve bluestore_wal_device link(s)] *********************** 2026-04-28 06:24:27.058564 | orchestrator | Tuesday 28 April 2026 06:24:24 +0000 (0:00:01.211) 1:08:57.947 ********* 2026-04-28 06:24:27.058595 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:24:27.058606 | orchestrator | 2026-04-28 06:24:27.058617 | orchestrator | TASK [ceph-facts : Set_fact build bluestore_wal_devices from resolved symlinks] *** 2026-04-28 06:24:27.058629 | orchestrator | Tuesday 28 April 2026 06:24:25 +0000 (0:00:01.110) 1:08:59.058 ********* 2026-04-28 06:24:27.058640 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:24:27.058650 | orchestrator | 2026-04-28 06:24:27.058661 | orchestrator | TASK [ceph-facts : Collect existed devices] ************************************ 2026-04-28 06:24:27.058672 | orchestrator | Tuesday 28 April 2026 06:24:26 +0000 (0:00:01.221) 1:09:00.280 ********* 2026-04-28 06:24:27.058683 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:24:27.058695 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1', 'dm-uuid-LVM-L5YjMhWvYgnpoIfTj51PZeO1wrabnQEX7l2ME9eZWg9LEHQ0f9eDaf27dOm77xe0'], 'uuids': ['dfd6b477-c8eb-4a33-b64e-726cd73356df'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '953cbf01', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0']}})  2026-04-28 06:24:27.058709 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de', 'scsi-SQEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'eca06b16', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 06:24:27.058737 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-L2AQ1c-y7H3-F3Y3-6Qkf-SkKZ-Rdhw-Yd8PGb', 'scsi-0QEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79', 'scsi-SQEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '0d71173f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab']}})  2026-04-28 06:24:27.178937 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:24:27.179020 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:24:27.179032 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-15-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}})  2026-04-28 06:24:27.179042 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:24:27.179049 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE', 'dm-uuid-CRYPT-LUKS2-49a0c8edea6a405ca40698859485fff3-xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 06:24:27.179087 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:24:27.179114 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab', 'dm-uuid-LVM-wa3l676dWvdqPItJjhbbIPxjjJMNXrWDxgNEYRSdoBZ0EZLJPUa6Po9zcB3PjLSE'], 'uuids': ['49a0c8ed-ea6a-405c-a406-98859485fff3'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '0d71173f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE']}})  2026-04-28 06:24:27.179141 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-vGsvHj-S1i8-Sw7N-17Sv-GX9v-DQYR-rG2tdh', 'scsi-0QEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89', 'scsi-SQEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '953cbf01', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1']}})  2026-04-28 06:24:27.179150 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:24:27.179159 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '4c7fe216', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}})  2026-04-28 06:24:27.179174 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:24:27.179184 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}})  2026-04-28 06:24:27.179197 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0', 'dm-uuid-CRYPT-LUKS2-dfd6b477c8eb4a33b64e726cd73356df-7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}})  2026-04-28 06:24:28.542307 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:24:28.542400 | orchestrator | 2026-04-28 06:24:28.542415 | orchestrator | TASK [ceph-facts : Set_fact devices generate device list when osd_auto_discovery] *** 2026-04-28 06:24:28.542426 | orchestrator | Tuesday 28 April 2026 06:24:28 +0000 (0:00:01.418) 1:09:01.698 ********* 2026-04-28 06:24:28.542440 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop1', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:24:28.542454 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1', 'dm-uuid-LVM-L5YjMhWvYgnpoIfTj51PZeO1wrabnQEX7l2ME9eZWg9LEHQ0f9eDaf27dOm77xe0'], 'uuids': ['dfd6b477-c8eb-4a33-b64e-726cd73356df'], 'labels': [], 'masters': ['dm-3']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '953cbf01', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:24:28.542466 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdd', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de', 'scsi-SQEMU_QEMU_HARDDISK_eca06b16-1c2b-4006-9914-55ad19a918de'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': 'eca06b16', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:24:28.542515 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdb', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-L2AQ1c-y7H3-F3Y3-6Qkf-SkKZ-Rdhw-Yd8PGb', 'scsi-0QEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79', 'scsi-SQEMU_QEMU_HARDDISK_0d71173f-dd7e-4ff7-a0ba-55a8c11a3f79'], 'uuids': [], 'labels': [], 'masters': ['dm-0']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '0d71173f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:24:28.542546 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop6', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:24:28.542555 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop4', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:24:28.542564 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sr0', 'value': {'virtual': 1, 'links': {'ids': ['ata-QEMU_DVD-ROM_QM00001'], 'uuids': ['2026-04-28-01-45-15-00'], 'labels': ['config-2'], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU DVD-ROM', 'sas_address': None, 'sas_device_handle': None, 'removable': '1', 'support_discard': '0', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1012', 'sectorsize': '2048', 'size': '506.00 KB', 'host': 'IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:24:28.542613 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop2', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:24:28.542624 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE', 'dm-uuid-CRYPT-LUKS2-49a0c8edea6a405ca40698859485fff3-xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:24:28.542640 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop0', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:24:28.542698 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-ceph--d7e38cf3--e59d--5932--97d5--5021af3eecab-osd--block--d7e38cf3--e59d--5932--97d5--5021af3eecab', 'dm-uuid-LVM-wa3l676dWvdqPItJjhbbIPxjjJMNXrWDxgNEYRSdoBZ0EZLJPUa6Po9zcB3PjLSE'], 'uuids': ['49a0c8ed-ea6a-405c-a406-98859485fff3'], 'labels': [], 'masters': ['dm-2']}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'serial': '0d71173f', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41934848', 'sectorsize': '512', 'size': '20.00 GB', 'host': '', 'holders': ['xgNEYR-SdoB-Z0EZ-LJPU-a6Po-9zcB-3PjLSE']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:24:40.925248 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sdc', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-vGsvHj-S1i8-Sw7N-17Sv-GX9v-DQYR-rG2tdh', 'scsi-0QEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89', 'scsi-SQEMU_QEMU_HARDDISK_953cbf01-df11-44f0-95ad-2441de21fe89'], 'uuids': [], 'labels': [], 'masters': ['dm-1']}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '953cbf01', 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '41943040', 'sectorsize': '512', 'size': '20.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': ['ceph--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1-osd--block--bdda1e24--8b47--5b08--be8f--b7cb87fd92e1']}}, 'ansible_loop_var': 'item'})  2026-04-28 06:24:40.925376 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop7', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:24:40.925414 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'QEMU', 'model': 'QEMU HARDDISK', 'sas_address': None, 'sas_device_handle': None, 'serial': '4c7fe216', 'removable': '0', 'support_discard': '4096', 'partitions': {'sda16': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part16'], 'uuids': ['09d53dc1-1e03-4286-bbb8-2b1796cf92ec'], 'labels': ['BOOT'], 'masters': []}, 'start': '227328', 'sectors': '1869825', 'sectorsize': 512, 'size': '913.00 MB', 'uuid': '09d53dc1-1e03-4286-bbb8-2b1796cf92ec', 'holders': []}, 'sda14': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part14'], 'uuids': [], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '8192', 'sectorsize': 512, 'size': '4.00 MB', 'uuid': None, 'holders': []}, 'sda15': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part15'], 'uuids': ['5C78-612A'], 'labels': ['UEFI'], 'masters': []}, 'start': '10240', 'sectors': '217088', 'sectorsize': 512, 'size': '106.00 MB', 'uuid': '5C78-612A', 'holders': []}, 'sda1': {'links': {'ids': ['scsi-0QEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1', 'scsi-SQEMU_QEMU_HARDDISK_4c7fe216-c7b7-453a-b900-b915aea67c50-part1'], 'uuids': ['b852d8d2-8460-44aa-8998-23e4f04d73cf'], 'labels': ['cloudimg-rootfs'], 'masters': []}, 'start': '2099200', 'sectors': '165672927', 'sectorsize': 512, 'size': '79.00 GB', 'uuid': 'b852d8d2-8460-44aa-8998-23e4f04d73cf', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'none', 'sectors': '167772160', 'sectorsize': '512', 'size': '80.00 GB', 'host': 'SCSI storage controller: Red Hat, Inc. Virtio SCSI', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:24:40.925473 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop5', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:24:40.925488 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'loop3', 'value': {'virtual': 1, 'links': {'ids': [], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '0', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '0', 'sectorsize': '512', 'size': '0.00 Bytes', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:24:40.925502 | orchestrator | skipping: [testbed-node-5] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'false_condition': 'osd_auto_discovery | default(False) | bool', 'item': {'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0', 'dm-uuid-CRYPT-LUKS2-dfd6b477c8eb4a33b64e726cd73356df-7l2ME9-eZWg-9LEH-Q0f9-eDaf-27dO-m77xe0'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '4096', 'partitions': {}, 'rotational': '1', 'scheduler_mode': '', 'sectors': '41902080', 'sectorsize': '512', 'size': '19.98 GB', 'host': '', 'holders': []}}, 'ansible_loop_var': 'item'})  2026-04-28 06:24:40.925524 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:24:40.925537 | orchestrator | 2026-04-28 06:24:40.925550 | orchestrator | TASK [ceph-facts : Check if the ceph conf exists] ****************************** 2026-04-28 06:24:40.925589 | orchestrator | Tuesday 28 April 2026 06:24:29 +0000 (0:00:01.530) 1:09:03.229 ********* 2026-04-28 06:24:40.925601 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:24:40.925613 | orchestrator | 2026-04-28 06:24:40.925624 | orchestrator | TASK [ceph-facts : Set default osd_pool_default_crush_rule fact] *************** 2026-04-28 06:24:40.925635 | orchestrator | Tuesday 28 April 2026 06:24:31 +0000 (0:00:01.486) 1:09:04.715 ********* 2026-04-28 06:24:40.925646 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:24:40.925656 | orchestrator | 2026-04-28 06:24:40.925667 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 06:24:40.925678 | orchestrator | Tuesday 28 April 2026 06:24:32 +0000 (0:00:01.167) 1:09:05.883 ********* 2026-04-28 06:24:40.925689 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:24:40.925699 | orchestrator | 2026-04-28 06:24:40.925710 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 06:24:40.925721 | orchestrator | Tuesday 28 April 2026 06:24:34 +0000 (0:00:01.568) 1:09:07.452 ********* 2026-04-28 06:24:40.925731 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:24:40.925742 | orchestrator | 2026-04-28 06:24:40.925753 | orchestrator | TASK [ceph-facts : Read osd pool default crush rule] *************************** 2026-04-28 06:24:40.925764 | orchestrator | Tuesday 28 April 2026 06:24:35 +0000 (0:00:01.131) 1:09:08.583 ********* 2026-04-28 06:24:40.925776 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:24:40.925788 | orchestrator | 2026-04-28 06:24:40.925800 | orchestrator | TASK [ceph-facts : Set osd_pool_default_crush_rule fact] *********************** 2026-04-28 06:24:40.925812 | orchestrator | Tuesday 28 April 2026 06:24:36 +0000 (0:00:01.301) 1:09:09.885 ********* 2026-04-28 06:24:40.925824 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:24:40.925836 | orchestrator | 2026-04-28 06:24:40.925849 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv4] ************************* 2026-04-28 06:24:40.925861 | orchestrator | Tuesday 28 April 2026 06:24:37 +0000 (0:00:01.273) 1:09:11.159 ********* 2026-04-28 06:24:40.925879 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-0) 2026-04-28 06:24:40.925892 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-1) 2026-04-28 06:24:40.925905 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-2) 2026-04-28 06:24:40.925916 | orchestrator | 2026-04-28 06:24:40.925929 | orchestrator | TASK [ceph-facts : Set_fact _monitor_addresses - ipv6] ************************* 2026-04-28 06:24:40.925941 | orchestrator | Tuesday 28 April 2026 06:24:39 +0000 (0:00:01.703) 1:09:12.862 ********* 2026-04-28 06:24:40.925954 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-0)  2026-04-28 06:24:40.925967 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-1)  2026-04-28 06:24:40.925979 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-2)  2026-04-28 06:24:40.925992 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:24:40.926004 | orchestrator | 2026-04-28 06:24:40.926078 | orchestrator | TASK [ceph-facts : Import_tasks set_radosgw_address.yml] *********************** 2026-04-28 06:24:40.926093 | orchestrator | Tuesday 28 April 2026 06:24:40 +0000 (0:00:01.191) 1:09:14.054 ********* 2026-04-28 06:24:40.926106 | orchestrator | included: /ansible/roles/ceph-facts/tasks/set_radosgw_address.yml for testbed-node-5 2026-04-28 06:24:40.926119 | orchestrator | 2026-04-28 06:24:40.926148 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 06:25:24.017294 | orchestrator | Tuesday 28 April 2026 06:24:41 +0000 (0:00:01.151) 1:09:15.205 ********* 2026-04-28 06:25:24.017439 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:25:24.017467 | orchestrator | 2026-04-28 06:25:24.017489 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 06:25:24.017603 | orchestrator | Tuesday 28 April 2026 06:24:43 +0000 (0:00:01.198) 1:09:16.403 ********* 2026-04-28 06:25:24.017627 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:25:24.017648 | orchestrator | 2026-04-28 06:25:24.017671 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 06:25:24.017693 | orchestrator | Tuesday 28 April 2026 06:24:44 +0000 (0:00:01.249) 1:09:17.653 ********* 2026-04-28 06:25:24.017714 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:25:24.017734 | orchestrator | 2026-04-28 06:25:24.017756 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 06:25:24.017778 | orchestrator | Tuesday 28 April 2026 06:24:45 +0000 (0:00:01.155) 1:09:18.809 ********* 2026-04-28 06:25:24.017799 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:25:24.017822 | orchestrator | 2026-04-28 06:25:24.017844 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 06:25:24.017865 | orchestrator | Tuesday 28 April 2026 06:24:46 +0000 (0:00:01.380) 1:09:20.190 ********* 2026-04-28 06:25:24.017888 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-28 06:25:24.017910 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-28 06:25:24.017931 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-28 06:25:24.017953 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:25:24.017975 | orchestrator | 2026-04-28 06:25:24.017997 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 06:25:24.018108 | orchestrator | Tuesday 28 April 2026 06:24:48 +0000 (0:00:01.434) 1:09:21.624 ********* 2026-04-28 06:25:24.018136 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-28 06:25:24.018157 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-28 06:25:24.018177 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-28 06:25:24.018198 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:25:24.018218 | orchestrator | 2026-04-28 06:25:24.018237 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 06:25:24.018257 | orchestrator | Tuesday 28 April 2026 06:24:49 +0000 (0:00:01.397) 1:09:23.022 ********* 2026-04-28 06:25:24.018277 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-28 06:25:24.018298 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-28 06:25:24.018317 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-28 06:25:24.018338 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:25:24.018358 | orchestrator | 2026-04-28 06:25:24.018378 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 06:25:24.018398 | orchestrator | Tuesday 28 April 2026 06:24:51 +0000 (0:00:01.467) 1:09:24.489 ********* 2026-04-28 06:25:24.018419 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:25:24.018440 | orchestrator | 2026-04-28 06:25:24.018460 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 06:25:24.018481 | orchestrator | Tuesday 28 April 2026 06:24:52 +0000 (0:00:01.156) 1:09:25.645 ********* 2026-04-28 06:25:24.018501 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-28 06:25:24.018521 | orchestrator | 2026-04-28 06:25:24.018571 | orchestrator | TASK [ceph-facts : Set_fact ceph_run_cmd] ************************************** 2026-04-28 06:25:24.018592 | orchestrator | Tuesday 28 April 2026 06:24:54 +0000 (0:00:01.897) 1:09:27.543 ********* 2026-04-28 06:25:24.018612 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:25:24.018633 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:25:24.018653 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:25:24.018673 | orchestrator | ok: [testbed-node-5 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 06:25:24.018693 | orchestrator | ok: [testbed-node-5 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 06:25:24.018728 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-5) 2026-04-28 06:25:24.018749 | orchestrator | ok: [testbed-node-5 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 06:25:24.018769 | orchestrator | 2026-04-28 06:25:24.018789 | orchestrator | TASK [ceph-facts : Set_fact ceph_admin_command] ******************************** 2026-04-28 06:25:24.018827 | orchestrator | Tuesday 28 April 2026 06:24:56 +0000 (0:00:02.495) 1:09:30.039 ********* 2026-04-28 06:25:24.018847 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=testbed-node-0) 2026-04-28 06:25:24.018868 | orchestrator | ok: [testbed-node-5 -> testbed-node-1(192.168.16.11)] => (item=testbed-node-1) 2026-04-28 06:25:24.018888 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=testbed-node-2) 2026-04-28 06:25:24.018908 | orchestrator | ok: [testbed-node-5 -> testbed-node-3(192.168.16.13)] => (item=testbed-node-3) 2026-04-28 06:25:24.018928 | orchestrator | ok: [testbed-node-5 -> testbed-node-4(192.168.16.14)] => (item=testbed-node-4) 2026-04-28 06:25:24.018948 | orchestrator | ok: [testbed-node-5] => (item=testbed-node-5) 2026-04-28 06:25:24.018969 | orchestrator | ok: [testbed-node-5 -> testbed-manager(192.168.16.5)] => (item=testbed-manager) 2026-04-28 06:25:24.018989 | orchestrator | 2026-04-28 06:25:24.019008 | orchestrator | TASK [Stop ceph rgw when upgrading from stable-3.2] **************************** 2026-04-28 06:25:24.019026 | orchestrator | Tuesday 28 April 2026 06:24:59 +0000 (0:00:02.370) 1:09:32.409 ********* 2026-04-28 06:25:24.019044 | orchestrator | changed: [testbed-node-5] 2026-04-28 06:25:24.019063 | orchestrator | 2026-04-28 06:25:24.019107 | orchestrator | TASK [Stop ceph rgw (pt. 1)] *************************************************** 2026-04-28 06:25:24.019128 | orchestrator | Tuesday 28 April 2026 06:25:01 +0000 (0:00:01.999) 1:09:34.409 ********* 2026-04-28 06:25:24.019147 | orchestrator | changed: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-28 06:25:24.019166 | orchestrator | 2026-04-28 06:25:24.019178 | orchestrator | TASK [Stop ceph rgw (pt. 2)] *************************************************** 2026-04-28 06:25:24.019189 | orchestrator | Tuesday 28 April 2026 06:25:03 +0000 (0:00:02.554) 1:09:36.965 ********* 2026-04-28 06:25:24.019200 | orchestrator | changed: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-28 06:25:24.019211 | orchestrator | 2026-04-28 06:25:24.019222 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 06:25:24.019233 | orchestrator | Tuesday 28 April 2026 06:25:05 +0000 (0:00:01.970) 1:09:38.936 ********* 2026-04-28 06:25:24.019243 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-5 2026-04-28 06:25:24.019254 | orchestrator | 2026-04-28 06:25:24.019265 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 06:25:24.019276 | orchestrator | Tuesday 28 April 2026 06:25:06 +0000 (0:00:01.178) 1:09:40.115 ********* 2026-04-28 06:25:24.019287 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-5 2026-04-28 06:25:24.019298 | orchestrator | 2026-04-28 06:25:24.019308 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 06:25:24.019319 | orchestrator | Tuesday 28 April 2026 06:25:07 +0000 (0:00:01.118) 1:09:41.234 ********* 2026-04-28 06:25:24.019330 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:25:24.019341 | orchestrator | 2026-04-28 06:25:24.019351 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 06:25:24.019362 | orchestrator | Tuesday 28 April 2026 06:25:08 +0000 (0:00:01.092) 1:09:42.326 ********* 2026-04-28 06:25:24.019373 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:25:24.019384 | orchestrator | 2026-04-28 06:25:24.019395 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 06:25:24.019406 | orchestrator | Tuesday 28 April 2026 06:25:10 +0000 (0:00:01.495) 1:09:43.822 ********* 2026-04-28 06:25:24.019416 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:25:24.019437 | orchestrator | 2026-04-28 06:25:24.019448 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 06:25:24.019459 | orchestrator | Tuesday 28 April 2026 06:25:11 +0000 (0:00:01.524) 1:09:45.346 ********* 2026-04-28 06:25:24.019469 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:25:24.019480 | orchestrator | 2026-04-28 06:25:24.019491 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 06:25:24.019502 | orchestrator | Tuesday 28 April 2026 06:25:13 +0000 (0:00:01.468) 1:09:46.814 ********* 2026-04-28 06:25:24.019512 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:25:24.019557 | orchestrator | 2026-04-28 06:25:24.019569 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 06:25:24.019580 | orchestrator | Tuesday 28 April 2026 06:25:14 +0000 (0:00:01.144) 1:09:47.959 ********* 2026-04-28 06:25:24.019591 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:25:24.019601 | orchestrator | 2026-04-28 06:25:24.019612 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 06:25:24.019623 | orchestrator | Tuesday 28 April 2026 06:25:15 +0000 (0:00:01.133) 1:09:49.093 ********* 2026-04-28 06:25:24.019634 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:25:24.019644 | orchestrator | 2026-04-28 06:25:24.019655 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 06:25:24.019666 | orchestrator | Tuesday 28 April 2026 06:25:16 +0000 (0:00:01.114) 1:09:50.208 ********* 2026-04-28 06:25:24.019676 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:25:24.019686 | orchestrator | 2026-04-28 06:25:24.019695 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 06:25:24.019705 | orchestrator | Tuesday 28 April 2026 06:25:18 +0000 (0:00:01.592) 1:09:51.800 ********* 2026-04-28 06:25:24.019714 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:25:24.019724 | orchestrator | 2026-04-28 06:25:24.019733 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 06:25:24.019742 | orchestrator | Tuesday 28 April 2026 06:25:19 +0000 (0:00:01.531) 1:09:53.332 ********* 2026-04-28 06:25:24.019752 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:25:24.019762 | orchestrator | 2026-04-28 06:25:24.019773 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 06:25:24.019798 | orchestrator | Tuesday 28 April 2026 06:25:20 +0000 (0:00:00.772) 1:09:54.104 ********* 2026-04-28 06:25:24.019815 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:25:24.019831 | orchestrator | 2026-04-28 06:25:24.019847 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 06:25:24.019864 | orchestrator | Tuesday 28 April 2026 06:25:21 +0000 (0:00:00.791) 1:09:54.896 ********* 2026-04-28 06:25:24.019874 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:25:24.019884 | orchestrator | 2026-04-28 06:25:24.019893 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 06:25:24.019902 | orchestrator | Tuesday 28 April 2026 06:25:22 +0000 (0:00:00.802) 1:09:55.698 ********* 2026-04-28 06:25:24.019912 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:25:24.019921 | orchestrator | 2026-04-28 06:25:24.019931 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 06:25:24.019940 | orchestrator | Tuesday 28 April 2026 06:25:23 +0000 (0:00:00.784) 1:09:56.482 ********* 2026-04-28 06:25:24.019950 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:25:24.019959 | orchestrator | 2026-04-28 06:25:24.019969 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 06:25:24.019978 | orchestrator | Tuesday 28 April 2026 06:25:23 +0000 (0:00:00.768) 1:09:57.251 ********* 2026-04-28 06:25:24.019988 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:25:24.019997 | orchestrator | 2026-04-28 06:25:24.020014 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 06:26:05.253117 | orchestrator | Tuesday 28 April 2026 06:25:24 +0000 (0:00:00.773) 1:09:58.025 ********* 2026-04-28 06:26:05.253234 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.253277 | orchestrator | 2026-04-28 06:26:05.253291 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 06:26:05.253302 | orchestrator | Tuesday 28 April 2026 06:25:25 +0000 (0:00:00.783) 1:09:58.808 ********* 2026-04-28 06:26:05.253313 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.253324 | orchestrator | 2026-04-28 06:26:05.253335 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 06:26:05.253346 | orchestrator | Tuesday 28 April 2026 06:25:26 +0000 (0:00:00.935) 1:09:59.744 ********* 2026-04-28 06:26:05.253356 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:26:05.253368 | orchestrator | 2026-04-28 06:26:05.253379 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 06:26:05.253389 | orchestrator | Tuesday 28 April 2026 06:25:27 +0000 (0:00:00.788) 1:10:00.533 ********* 2026-04-28 06:26:05.253400 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:26:05.253410 | orchestrator | 2026-04-28 06:26:05.253421 | orchestrator | TASK [ceph-common : Include configure_repository.yml] ************************** 2026-04-28 06:26:05.253432 | orchestrator | Tuesday 28 April 2026 06:25:27 +0000 (0:00:00.818) 1:10:01.352 ********* 2026-04-28 06:26:05.253442 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.253453 | orchestrator | 2026-04-28 06:26:05.253463 | orchestrator | TASK [ceph-common : Include installs/install_redhat_packages.yml] ************** 2026-04-28 06:26:05.253474 | orchestrator | Tuesday 28 April 2026 06:25:28 +0000 (0:00:00.784) 1:10:02.136 ********* 2026-04-28 06:26:05.253485 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.253539 | orchestrator | 2026-04-28 06:26:05.253551 | orchestrator | TASK [ceph-common : Include installs/install_suse_packages.yml] **************** 2026-04-28 06:26:05.253561 | orchestrator | Tuesday 28 April 2026 06:25:29 +0000 (0:00:00.796) 1:10:02.933 ********* 2026-04-28 06:26:05.253572 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.253582 | orchestrator | 2026-04-28 06:26:05.253593 | orchestrator | TASK [ceph-common : Include installs/install_on_debian.yml] ******************** 2026-04-28 06:26:05.253604 | orchestrator | Tuesday 28 April 2026 06:25:30 +0000 (0:00:00.803) 1:10:03.736 ********* 2026-04-28 06:26:05.253614 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.253625 | orchestrator | 2026-04-28 06:26:05.253637 | orchestrator | TASK [ceph-common : Include_tasks installs/install_on_clear.yml] *************** 2026-04-28 06:26:05.253650 | orchestrator | Tuesday 28 April 2026 06:25:31 +0000 (0:00:00.804) 1:10:04.541 ********* 2026-04-28 06:26:05.253663 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.253677 | orchestrator | 2026-04-28 06:26:05.253689 | orchestrator | TASK [ceph-common : Get ceph version] ****************************************** 2026-04-28 06:26:05.253703 | orchestrator | Tuesday 28 April 2026 06:25:31 +0000 (0:00:00.769) 1:10:05.311 ********* 2026-04-28 06:26:05.253715 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.253728 | orchestrator | 2026-04-28 06:26:05.253741 | orchestrator | TASK [ceph-common : Set_fact ceph_version] ************************************* 2026-04-28 06:26:05.253754 | orchestrator | Tuesday 28 April 2026 06:25:32 +0000 (0:00:00.789) 1:10:06.100 ********* 2026-04-28 06:26:05.253766 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.253778 | orchestrator | 2026-04-28 06:26:05.253791 | orchestrator | TASK [ceph-common : Set_fact ceph_release - override ceph_release with ceph_stable_release] *** 2026-04-28 06:26:05.253805 | orchestrator | Tuesday 28 April 2026 06:25:33 +0000 (0:00:00.785) 1:10:06.886 ********* 2026-04-28 06:26:05.253818 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.253831 | orchestrator | 2026-04-28 06:26:05.253844 | orchestrator | TASK [ceph-common : Include create_rbd_client_dir.yml] ************************* 2026-04-28 06:26:05.253856 | orchestrator | Tuesday 28 April 2026 06:25:34 +0000 (0:00:00.766) 1:10:07.653 ********* 2026-04-28 06:26:05.253868 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.253880 | orchestrator | 2026-04-28 06:26:05.253893 | orchestrator | TASK [ceph-common : Include configure_cluster_name.yml] ************************ 2026-04-28 06:26:05.253905 | orchestrator | Tuesday 28 April 2026 06:25:35 +0000 (0:00:00.785) 1:10:08.438 ********* 2026-04-28 06:26:05.253918 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.253940 | orchestrator | 2026-04-28 06:26:05.253952 | orchestrator | TASK [ceph-common : Include configure_memory_allocator.yml] ******************** 2026-04-28 06:26:05.253963 | orchestrator | Tuesday 28 April 2026 06:25:35 +0000 (0:00:00.913) 1:10:09.351 ********* 2026-04-28 06:26:05.253974 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.253985 | orchestrator | 2026-04-28 06:26:05.253995 | orchestrator | TASK [ceph-common : Include selinux.yml] *************************************** 2026-04-28 06:26:05.254006 | orchestrator | Tuesday 28 April 2026 06:25:36 +0000 (0:00:00.784) 1:10:10.136 ********* 2026-04-28 06:26:05.254076 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.254091 | orchestrator | 2026-04-28 06:26:05.254117 | orchestrator | TASK [ceph-container-common : Generate systemd ceph target file] *************** 2026-04-28 06:26:05.254129 | orchestrator | Tuesday 28 April 2026 06:25:37 +0000 (0:00:00.763) 1:10:10.900 ********* 2026-04-28 06:26:05.254140 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:26:05.254150 | orchestrator | 2026-04-28 06:26:05.254161 | orchestrator | TASK [ceph-container-common : Enable ceph.target] ****************************** 2026-04-28 06:26:05.254172 | orchestrator | Tuesday 28 April 2026 06:25:39 +0000 (0:00:01.605) 1:10:12.505 ********* 2026-04-28 06:26:05.254182 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:26:05.254193 | orchestrator | 2026-04-28 06:26:05.254203 | orchestrator | TASK [ceph-container-common : Include prerequisites.yml] *********************** 2026-04-28 06:26:05.254214 | orchestrator | Tuesday 28 April 2026 06:25:40 +0000 (0:00:01.849) 1:10:14.355 ********* 2026-04-28 06:26:05.254225 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/prerequisites.yml for testbed-node-5 2026-04-28 06:26:05.254237 | orchestrator | 2026-04-28 06:26:05.254247 | orchestrator | TASK [ceph-container-common : Stop lvmetad] ************************************ 2026-04-28 06:26:05.254258 | orchestrator | Tuesday 28 April 2026 06:25:42 +0000 (0:00:01.123) 1:10:15.478 ********* 2026-04-28 06:26:05.254269 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.254279 | orchestrator | 2026-04-28 06:26:05.254290 | orchestrator | TASK [ceph-container-common : Disable and mask lvmetad service] **************** 2026-04-28 06:26:05.254319 | orchestrator | Tuesday 28 April 2026 06:25:43 +0000 (0:00:01.118) 1:10:16.596 ********* 2026-04-28 06:26:05.254331 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.254341 | orchestrator | 2026-04-28 06:26:05.254352 | orchestrator | TASK [ceph-container-common : Remove ceph udev rules] ************************** 2026-04-28 06:26:05.254363 | orchestrator | Tuesday 28 April 2026 06:25:44 +0000 (0:00:01.160) 1:10:17.757 ********* 2026-04-28 06:26:05.254373 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) 2026-04-28 06:26:05.254384 | orchestrator | ok: [testbed-node-5] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) 2026-04-28 06:26:05.254395 | orchestrator | 2026-04-28 06:26:05.254406 | orchestrator | TASK [ceph-container-common : Ensure tmpfiles.d is present] ******************** 2026-04-28 06:26:05.254417 | orchestrator | Tuesday 28 April 2026 06:25:46 +0000 (0:00:01.859) 1:10:19.617 ********* 2026-04-28 06:26:05.254428 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:26:05.254438 | orchestrator | 2026-04-28 06:26:05.254449 | orchestrator | TASK [ceph-container-common : Restore certificates selinux context] ************ 2026-04-28 06:26:05.254459 | orchestrator | Tuesday 28 April 2026 06:25:47 +0000 (0:00:01.488) 1:10:21.106 ********* 2026-04-28 06:26:05.254470 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.254480 | orchestrator | 2026-04-28 06:26:05.254522 | orchestrator | TASK [ceph-container-common : Install python3 on osd nodes] ******************** 2026-04-28 06:26:05.254534 | orchestrator | Tuesday 28 April 2026 06:25:48 +0000 (0:00:01.140) 1:10:22.246 ********* 2026-04-28 06:26:05.254545 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.254555 | orchestrator | 2026-04-28 06:26:05.254566 | orchestrator | TASK [ceph-container-common : Include registry.yml] **************************** 2026-04-28 06:26:05.254576 | orchestrator | Tuesday 28 April 2026 06:25:49 +0000 (0:00:00.783) 1:10:23.029 ********* 2026-04-28 06:26:05.254587 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.254598 | orchestrator | 2026-04-28 06:26:05.254618 | orchestrator | TASK [ceph-container-common : Include fetch_image.yml] ************************* 2026-04-28 06:26:05.254629 | orchestrator | Tuesday 28 April 2026 06:25:50 +0000 (0:00:00.873) 1:10:23.903 ********* 2026-04-28 06:26:05.254639 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/fetch_image.yml for testbed-node-5 2026-04-28 06:26:05.254650 | orchestrator | 2026-04-28 06:26:05.254660 | orchestrator | TASK [ceph-container-common : Pulling Ceph container image] ******************** 2026-04-28 06:26:05.254671 | orchestrator | Tuesday 28 April 2026 06:25:51 +0000 (0:00:01.121) 1:10:25.025 ********* 2026-04-28 06:26:05.254681 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:26:05.254692 | orchestrator | 2026-04-28 06:26:05.254703 | orchestrator | TASK [ceph-container-common : Pulling alertmanager/prometheus/grafana container images] *** 2026-04-28 06:26:05.254714 | orchestrator | Tuesday 28 April 2026 06:25:53 +0000 (0:00:01.783) 1:10:26.808 ********* 2026-04-28 06:26:05.254725 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/alertmanager:v0.16.2)  2026-04-28 06:26:05.254735 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/prom/prometheus:v2.7.2)  2026-04-28 06:26:05.254746 | orchestrator | skipping: [testbed-node-5] => (item=docker.io/grafana/grafana:6.7.4)  2026-04-28 06:26:05.254757 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.254768 | orchestrator | 2026-04-28 06:26:05.254778 | orchestrator | TASK [ceph-container-common : Pulling node-exporter container image] *********** 2026-04-28 06:26:05.254789 | orchestrator | Tuesday 28 April 2026 06:25:54 +0000 (0:00:01.151) 1:10:27.959 ********* 2026-04-28 06:26:05.254799 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.254810 | orchestrator | 2026-04-28 06:26:05.254821 | orchestrator | TASK [ceph-container-common : Export local ceph dev image] ********************* 2026-04-28 06:26:05.254831 | orchestrator | Tuesday 28 April 2026 06:25:55 +0000 (0:00:01.117) 1:10:29.077 ********* 2026-04-28 06:26:05.254842 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.254853 | orchestrator | 2026-04-28 06:26:05.254864 | orchestrator | TASK [ceph-container-common : Copy ceph dev image file] ************************ 2026-04-28 06:26:05.254874 | orchestrator | Tuesday 28 April 2026 06:25:56 +0000 (0:00:01.191) 1:10:30.268 ********* 2026-04-28 06:26:05.254885 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.254895 | orchestrator | 2026-04-28 06:26:05.254906 | orchestrator | TASK [ceph-container-common : Load ceph dev image] ***************************** 2026-04-28 06:26:05.254917 | orchestrator | Tuesday 28 April 2026 06:25:58 +0000 (0:00:01.129) 1:10:31.398 ********* 2026-04-28 06:26:05.254927 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.254938 | orchestrator | 2026-04-28 06:26:05.254948 | orchestrator | TASK [ceph-container-common : Remove tmp ceph dev image file] ****************** 2026-04-28 06:26:05.254959 | orchestrator | Tuesday 28 April 2026 06:25:59 +0000 (0:00:01.119) 1:10:32.517 ********* 2026-04-28 06:26:05.254970 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.254980 | orchestrator | 2026-04-28 06:26:05.254996 | orchestrator | TASK [ceph-container-common : Get ceph version] ******************************** 2026-04-28 06:26:05.255007 | orchestrator | Tuesday 28 April 2026 06:25:59 +0000 (0:00:00.789) 1:10:33.307 ********* 2026-04-28 06:26:05.255018 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:26:05.255029 | orchestrator | 2026-04-28 06:26:05.255039 | orchestrator | TASK [ceph-container-common : Set_fact ceph_version ceph_version.stdout.split] *** 2026-04-28 06:26:05.255050 | orchestrator | Tuesday 28 April 2026 06:26:02 +0000 (0:00:02.077) 1:10:35.384 ********* 2026-04-28 06:26:05.255060 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:26:05.255071 | orchestrator | 2026-04-28 06:26:05.255082 | orchestrator | TASK [ceph-container-common : Include release.yml] ***************************** 2026-04-28 06:26:05.255092 | orchestrator | Tuesday 28 April 2026 06:26:02 +0000 (0:00:00.787) 1:10:36.171 ********* 2026-04-28 06:26:05.255103 | orchestrator | included: /ansible/roles/ceph-container-common/tasks/release.yml for testbed-node-5 2026-04-28 06:26:05.255114 | orchestrator | 2026-04-28 06:26:05.255125 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release jewel] ********************* 2026-04-28 06:26:05.255135 | orchestrator | Tuesday 28 April 2026 06:26:04 +0000 (0:00:01.308) 1:10:37.480 ********* 2026-04-28 06:26:05.255155 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:05.255165 | orchestrator | 2026-04-28 06:26:05.255176 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release kraken] ******************** 2026-04-28 06:26:05.255195 | orchestrator | Tuesday 28 April 2026 06:26:05 +0000 (0:00:01.148) 1:10:38.628 ********* 2026-04-28 06:26:46.348378 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:46.348549 | orchestrator | 2026-04-28 06:26:46.348569 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release luminous] ****************** 2026-04-28 06:26:46.348584 | orchestrator | Tuesday 28 April 2026 06:26:06 +0000 (0:00:01.149) 1:10:39.778 ********* 2026-04-28 06:26:46.348596 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:46.348607 | orchestrator | 2026-04-28 06:26:46.348618 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release mimic] ********************* 2026-04-28 06:26:46.348629 | orchestrator | Tuesday 28 April 2026 06:26:07 +0000 (0:00:01.133) 1:10:40.912 ********* 2026-04-28 06:26:46.348640 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:46.348651 | orchestrator | 2026-04-28 06:26:46.348662 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release nautilus] ****************** 2026-04-28 06:26:46.348673 | orchestrator | Tuesday 28 April 2026 06:26:08 +0000 (0:00:01.144) 1:10:42.057 ********* 2026-04-28 06:26:46.348683 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:46.348694 | orchestrator | 2026-04-28 06:26:46.348705 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release octopus] ******************* 2026-04-28 06:26:46.348716 | orchestrator | Tuesday 28 April 2026 06:26:09 +0000 (0:00:01.167) 1:10:43.224 ********* 2026-04-28 06:26:46.348727 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:46.348737 | orchestrator | 2026-04-28 06:26:46.348748 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release pacific] ******************* 2026-04-28 06:26:46.348759 | orchestrator | Tuesday 28 April 2026 06:26:11 +0000 (0:00:01.166) 1:10:44.391 ********* 2026-04-28 06:26:46.348769 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:46.348780 | orchestrator | 2026-04-28 06:26:46.348791 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release quincy] ******************** 2026-04-28 06:26:46.348802 | orchestrator | Tuesday 28 April 2026 06:26:12 +0000 (0:00:01.210) 1:10:45.601 ********* 2026-04-28 06:26:46.348812 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:46.348823 | orchestrator | 2026-04-28 06:26:46.348834 | orchestrator | TASK [ceph-container-common : Set_fact ceph_release reef] ********************** 2026-04-28 06:26:46.348844 | orchestrator | Tuesday 28 April 2026 06:26:13 +0000 (0:00:01.121) 1:10:46.723 ********* 2026-04-28 06:26:46.348855 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:26:46.348868 | orchestrator | 2026-04-28 06:26:46.348879 | orchestrator | TASK [ceph-config : Include create_ceph_initial_dirs.yml] ********************** 2026-04-28 06:26:46.348890 | orchestrator | Tuesday 28 April 2026 06:26:14 +0000 (0:00:00.781) 1:10:47.504 ********* 2026-04-28 06:26:46.348900 | orchestrator | included: /ansible/roles/ceph-config/tasks/create_ceph_initial_dirs.yml for testbed-node-5 2026-04-28 06:26:46.348914 | orchestrator | 2026-04-28 06:26:46.348927 | orchestrator | TASK [ceph-config : Create ceph initial directories] *************************** 2026-04-28 06:26:46.348939 | orchestrator | Tuesday 28 April 2026 06:26:15 +0000 (0:00:01.100) 1:10:48.605 ********* 2026-04-28 06:26:46.348951 | orchestrator | ok: [testbed-node-5] => (item=/etc/ceph) 2026-04-28 06:26:46.348964 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/) 2026-04-28 06:26:46.348977 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/mon) 2026-04-28 06:26:46.348989 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/osd) 2026-04-28 06:26:46.349002 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/mds) 2026-04-28 06:26:46.349015 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/tmp) 2026-04-28 06:26:46.349028 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/crash) 2026-04-28 06:26:46.349040 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/radosgw) 2026-04-28 06:26:46.349053 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rgw) 2026-04-28 06:26:46.349092 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mgr) 2026-04-28 06:26:46.349105 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-mds) 2026-04-28 06:26:46.349117 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-osd) 2026-04-28 06:26:46.349130 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd) 2026-04-28 06:26:46.349141 | orchestrator | ok: [testbed-node-5] => (item=/var/lib/ceph/bootstrap-rbd-mirror) 2026-04-28 06:26:46.349152 | orchestrator | ok: [testbed-node-5] => (item=/var/run/ceph) 2026-04-28 06:26:46.349162 | orchestrator | ok: [testbed-node-5] => (item=/var/log/ceph) 2026-04-28 06:26:46.349173 | orchestrator | 2026-04-28 06:26:46.349184 | orchestrator | TASK [ceph-config : Include_tasks rgw_systemd_environment_file.yml] ************ 2026-04-28 06:26:46.349194 | orchestrator | Tuesday 28 April 2026 06:26:21 +0000 (0:00:06.223) 1:10:54.828 ********* 2026-04-28 06:26:46.349219 | orchestrator | included: /ansible/roles/ceph-config/tasks/rgw_systemd_environment_file.yml for testbed-node-5 2026-04-28 06:26:46.349231 | orchestrator | 2026-04-28 06:26:46.349241 | orchestrator | TASK [ceph-config : Create rados gateway instance directories] ***************** 2026-04-28 06:26:46.349252 | orchestrator | Tuesday 28 April 2026 06:26:22 +0000 (0:00:01.135) 1:10:55.963 ********* 2026-04-28 06:26:46.349263 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-28 06:26:46.349275 | orchestrator | 2026-04-28 06:26:46.349286 | orchestrator | TASK [ceph-config : Generate environment file] ********************************* 2026-04-28 06:26:46.349296 | orchestrator | Tuesday 28 April 2026 06:26:24 +0000 (0:00:01.554) 1:10:57.517 ********* 2026-04-28 06:26:46.349307 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-28 06:26:46.349318 | orchestrator | 2026-04-28 06:26:46.349328 | orchestrator | TASK [ceph-config : Reset num_osds] ******************************************** 2026-04-28 06:26:46.349339 | orchestrator | Tuesday 28 April 2026 06:26:25 +0000 (0:00:01.612) 1:10:59.130 ********* 2026-04-28 06:26:46.349350 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:46.349361 | orchestrator | 2026-04-28 06:26:46.349371 | orchestrator | TASK [ceph-config : Count number of osds for lvm scenario] ********************* 2026-04-28 06:26:46.349400 | orchestrator | Tuesday 28 April 2026 06:26:26 +0000 (0:00:00.806) 1:10:59.937 ********* 2026-04-28 06:26:46.349412 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:46.349423 | orchestrator | 2026-04-28 06:26:46.349434 | orchestrator | TASK [ceph-config : Look up for ceph-volume rejected devices] ****************** 2026-04-28 06:26:46.349445 | orchestrator | Tuesday 28 April 2026 06:26:27 +0000 (0:00:00.782) 1:11:00.719 ********* 2026-04-28 06:26:46.349475 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:46.349487 | orchestrator | 2026-04-28 06:26:46.349497 | orchestrator | TASK [ceph-config : Set_fact rejected_devices] ********************************* 2026-04-28 06:26:46.349508 | orchestrator | Tuesday 28 April 2026 06:26:28 +0000 (0:00:00.779) 1:11:01.499 ********* 2026-04-28 06:26:46.349519 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:46.349530 | orchestrator | 2026-04-28 06:26:46.349540 | orchestrator | TASK [ceph-config : Set_fact _devices] ***************************************** 2026-04-28 06:26:46.349551 | orchestrator | Tuesday 28 April 2026 06:26:28 +0000 (0:00:00.771) 1:11:02.270 ********* 2026-04-28 06:26:46.349561 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:46.349572 | orchestrator | 2026-04-28 06:26:46.349582 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm batch --report' to see how many osds are to be created] *** 2026-04-28 06:26:46.349593 | orchestrator | Tuesday 28 April 2026 06:26:29 +0000 (0:00:00.779) 1:11:03.050 ********* 2026-04-28 06:26:46.349604 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:46.349614 | orchestrator | 2026-04-28 06:26:46.349630 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (legacy report)] *** 2026-04-28 06:26:46.349650 | orchestrator | Tuesday 28 April 2026 06:26:30 +0000 (0:00:00.802) 1:11:03.853 ********* 2026-04-28 06:26:46.349680 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:46.349692 | orchestrator | 2026-04-28 06:26:46.349703 | orchestrator | TASK [ceph-config : Set_fact num_osds from the output of 'ceph-volume lvm batch --report' (new report)] *** 2026-04-28 06:26:46.349714 | orchestrator | Tuesday 28 April 2026 06:26:31 +0000 (0:00:00.790) 1:11:04.643 ********* 2026-04-28 06:26:46.349724 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:46.349735 | orchestrator | 2026-04-28 06:26:46.349745 | orchestrator | TASK [ceph-config : Run 'ceph-volume lvm list' to see how many osds have already been created] *** 2026-04-28 06:26:46.349756 | orchestrator | Tuesday 28 April 2026 06:26:32 +0000 (0:00:00.769) 1:11:05.413 ********* 2026-04-28 06:26:46.349766 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:46.349777 | orchestrator | 2026-04-28 06:26:46.349788 | orchestrator | TASK [ceph-config : Set_fact num_osds (add existing osds)] ********************* 2026-04-28 06:26:46.349798 | orchestrator | Tuesday 28 April 2026 06:26:32 +0000 (0:00:00.920) 1:11:06.334 ********* 2026-04-28 06:26:46.349809 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:46.349819 | orchestrator | 2026-04-28 06:26:46.349830 | orchestrator | TASK [ceph-config : Set_fact _osd_memory_target] ******************************* 2026-04-28 06:26:46.349841 | orchestrator | Tuesday 28 April 2026 06:26:33 +0000 (0:00:00.760) 1:11:07.095 ********* 2026-04-28 06:26:46.349851 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:46.349862 | orchestrator | 2026-04-28 06:26:46.349872 | orchestrator | TASK [ceph-config : Set osd_memory_target to cluster host config] ************** 2026-04-28 06:26:46.349883 | orchestrator | Tuesday 28 April 2026 06:26:34 +0000 (0:00:00.791) 1:11:07.886 ********* 2026-04-28 06:26:46.349894 | orchestrator | changed: [testbed-node-5 -> testbed-node-2(192.168.16.12)] 2026-04-28 06:26:46.349904 | orchestrator | 2026-04-28 06:26:46.349915 | orchestrator | TASK [ceph-config : Render rgw configs] **************************************** 2026-04-28 06:26:46.349925 | orchestrator | Tuesday 28 April 2026 06:26:38 +0000 (0:00:04.084) 1:11:11.971 ********* 2026-04-28 06:26:46.349936 | orchestrator | ok: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-28 06:26:46.349947 | orchestrator | 2026-04-28 06:26:46.349957 | orchestrator | TASK [ceph-config : Set config to cluster] ************************************* 2026-04-28 06:26:46.349968 | orchestrator | Tuesday 28 April 2026 06:26:39 +0000 (0:00:00.824) 1:11:12.796 ********* 2026-04-28 06:26:46.349981 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'log_file', 'value': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log'}]) 2026-04-28 06:26:46.350000 | orchestrator | ok: [testbed-node-5 -> testbed-node-2(192.168.16.12)] => (item=[{'key': 'client.rgw.default.testbed-node-5.rgw0', 'value': {'log_file': '/var/log/ceph/ceph-rgw-default-testbed-node-5.rgw0.log', 'rgw_frontends': 'beast endpoint=192.168.16.15:8081'}}, {'key': 'rgw_frontends', 'value': 'beast endpoint=192.168.16.15:8081'}]) 2026-04-28 06:26:46.350013 | orchestrator | 2026-04-28 06:26:46.350088 | orchestrator | TASK [ceph-config : Set rgw configs to file] *********************************** 2026-04-28 06:26:46.350099 | orchestrator | Tuesday 28 April 2026 06:26:43 +0000 (0:00:04.501) 1:11:17.297 ********* 2026-04-28 06:26:46.350110 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:46.350121 | orchestrator | 2026-04-28 06:26:46.350132 | orchestrator | TASK [ceph-config : Create ceph conf directory] ******************************** 2026-04-28 06:26:46.350142 | orchestrator | Tuesday 28 April 2026 06:26:44 +0000 (0:00:00.816) 1:11:18.114 ********* 2026-04-28 06:26:46.350153 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:46.350164 | orchestrator | 2026-04-28 06:26:46.350175 | orchestrator | TASK [ceph-facts : Set current radosgw_address_block, radosgw_address, radosgw_interface from node "{{ ceph_dashboard_call_item }}"] *** 2026-04-28 06:26:46.350186 | orchestrator | Tuesday 28 April 2026 06:26:45 +0000 (0:00:00.776) 1:11:18.890 ********* 2026-04-28 06:26:46.350196 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:26:46.350215 | orchestrator | 2026-04-28 06:26:46.350226 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv4] **** 2026-04-28 06:26:46.350245 | orchestrator | Tuesday 28 April 2026 06:26:46 +0000 (0:00:00.837) 1:11:19.728 ********* 2026-04-28 06:27:53.056471 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:27:53.056547 | orchestrator | 2026-04-28 06:27:53.056553 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address_block ipv6] **** 2026-04-28 06:27:53.056559 | orchestrator | Tuesday 28 April 2026 06:26:47 +0000 (0:00:00.793) 1:11:20.522 ********* 2026-04-28 06:27:53.056563 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:27:53.056567 | orchestrator | 2026-04-28 06:27:53.056571 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_address] *************** 2026-04-28 06:27:53.056575 | orchestrator | Tuesday 28 April 2026 06:26:47 +0000 (0:00:00.843) 1:11:21.365 ********* 2026-04-28 06:27:53.056579 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:27:53.056584 | orchestrator | 2026-04-28 06:27:53.056588 | orchestrator | TASK [ceph-facts : Set_fact _interface] **************************************** 2026-04-28 06:27:53.056592 | orchestrator | Tuesday 28 April 2026 06:26:48 +0000 (0:00:00.925) 1:11:22.291 ********* 2026-04-28 06:27:53.056595 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-28 06:27:53.056600 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-28 06:27:53.056603 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-28 06:27:53.056607 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:27:53.056611 | orchestrator | 2026-04-28 06:27:53.056615 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv4] ****** 2026-04-28 06:27:53.056618 | orchestrator | Tuesday 28 April 2026 06:26:50 +0000 (0:00:01.552) 1:11:23.843 ********* 2026-04-28 06:27:53.056622 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-28 06:27:53.056626 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-28 06:27:53.056630 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-28 06:27:53.056634 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:27:53.056637 | orchestrator | 2026-04-28 06:27:53.056641 | orchestrator | TASK [ceph-facts : Set_fact _radosgw_address to radosgw_interface - ipv6] ****** 2026-04-28 06:27:53.056645 | orchestrator | Tuesday 28 April 2026 06:26:52 +0000 (0:00:01.681) 1:11:25.525 ********* 2026-04-28 06:27:53.056651 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-3)  2026-04-28 06:27:53.056657 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-4)  2026-04-28 06:27:53.056662 | orchestrator | skipping: [testbed-node-5] => (item=testbed-node-5)  2026-04-28 06:27:53.056668 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:27:53.056673 | orchestrator | 2026-04-28 06:27:53.056679 | orchestrator | TASK [ceph-facts : Reset rgw_instances (workaround)] *************************** 2026-04-28 06:27:53.056685 | orchestrator | Tuesday 28 April 2026 06:26:53 +0000 (0:00:01.077) 1:11:26.602 ********* 2026-04-28 06:27:53.056692 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:27:53.056697 | orchestrator | 2026-04-28 06:27:53.056703 | orchestrator | TASK [ceph-facts : Set_fact rgw_instances] ************************************* 2026-04-28 06:27:53.056709 | orchestrator | Tuesday 28 April 2026 06:26:54 +0000 (0:00:00.829) 1:11:27.432 ********* 2026-04-28 06:27:53.056716 | orchestrator | ok: [testbed-node-5] => (item=0) 2026-04-28 06:27:53.056722 | orchestrator | 2026-04-28 06:27:53.056726 | orchestrator | TASK [ceph-config : Generate Ceph file] **************************************** 2026-04-28 06:27:53.056730 | orchestrator | Tuesday 28 April 2026 06:26:55 +0000 (0:00:01.039) 1:11:28.471 ********* 2026-04-28 06:27:53.056733 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:27:53.056737 | orchestrator | 2026-04-28 06:27:53.056741 | orchestrator | TASK [ceph-rgw : Include common.yml] ******************************************* 2026-04-28 06:27:53.056745 | orchestrator | Tuesday 28 April 2026 06:26:56 +0000 (0:00:01.397) 1:11:29.869 ********* 2026-04-28 06:27:53.056748 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/common.yml for testbed-node-5 2026-04-28 06:27:53.056752 | orchestrator | 2026-04-28 06:27:53.056770 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-28 06:27:53.056774 | orchestrator | Tuesday 28 April 2026 06:26:57 +0000 (0:00:01.104) 1:11:30.973 ********* 2026-04-28 06:27:53.056777 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 06:27:53.056781 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-28 06:27:53.056785 | orchestrator | ok: [testbed-node-5 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-28 06:27:53.056789 | orchestrator | 2026-04-28 06:27:53.056792 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-28 06:27:53.056796 | orchestrator | Tuesday 28 April 2026 06:27:00 +0000 (0:00:03.213) 1:11:34.187 ********* 2026-04-28 06:27:53.056800 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-28 06:27:53.056814 | orchestrator | skipping: [testbed-node-5] => (item=None)  2026-04-28 06:27:53.056818 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:27:53.056822 | orchestrator | 2026-04-28 06:27:53.056826 | orchestrator | TASK [ceph-rgw : Copy SSL certificate & key data to certificate path] ********** 2026-04-28 06:27:53.056829 | orchestrator | Tuesday 28 April 2026 06:27:02 +0000 (0:00:02.003) 1:11:36.190 ********* 2026-04-28 06:27:53.056833 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:27:53.056837 | orchestrator | 2026-04-28 06:27:53.056840 | orchestrator | TASK [ceph-rgw : Include_tasks pre_requisite.yml] ****************************** 2026-04-28 06:27:53.056844 | orchestrator | Tuesday 28 April 2026 06:27:03 +0000 (0:00:00.842) 1:11:37.033 ********* 2026-04-28 06:27:53.056848 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/pre_requisite.yml for testbed-node-5 2026-04-28 06:27:53.056853 | orchestrator | 2026-04-28 06:27:53.056856 | orchestrator | TASK [ceph-rgw : Create rados gateway directories] ***************************** 2026-04-28 06:27:53.056860 | orchestrator | Tuesday 28 April 2026 06:27:04 +0000 (0:00:01.136) 1:11:38.169 ********* 2026-04-28 06:27:53.056864 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-28 06:27:53.056869 | orchestrator | 2026-04-28 06:27:53.056873 | orchestrator | TASK [ceph-rgw : Create rgw keyrings] ****************************************** 2026-04-28 06:27:53.056877 | orchestrator | Tuesday 28 April 2026 06:27:06 +0000 (0:00:02.213) 1:11:40.383 ********* 2026-04-28 06:27:53.056891 | orchestrator | changed: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 06:27:53.056895 | orchestrator | changed: [testbed-node-5 -> {{ groups[mon_group_name][0] if groups.get(mon_group_name, []) | length > 0 else 'localhost' }}] 2026-04-28 06:27:53.056899 | orchestrator | 2026-04-28 06:27:53.056903 | orchestrator | TASK [ceph-rgw : Get keys from monitors] *************************************** 2026-04-28 06:27:53.056907 | orchestrator | Tuesday 28 April 2026 06:27:11 +0000 (0:00:04.972) 1:11:45.355 ********* 2026-04-28 06:27:53.056910 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item=None) 2026-04-28 06:27:53.056914 | orchestrator | ok: [testbed-node-5 -> {{ groups.get(mon_group_name)[0] }}] 2026-04-28 06:27:53.056918 | orchestrator | 2026-04-28 06:27:53.056921 | orchestrator | TASK [ceph-rgw : Copy ceph key(s) if needed] *********************************** 2026-04-28 06:27:53.056925 | orchestrator | Tuesday 28 April 2026 06:27:15 +0000 (0:00:03.049) 1:11:48.405 ********* 2026-04-28 06:27:53.056929 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-28 06:27:53.056933 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:27:53.056936 | orchestrator | 2026-04-28 06:27:53.056940 | orchestrator | TASK [ceph-rgw : Rgw pool creation tasks] ************************************** 2026-04-28 06:27:53.056944 | orchestrator | Tuesday 28 April 2026 06:27:16 +0000 (0:00:01.679) 1:11:50.084 ********* 2026-04-28 06:27:53.056947 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/rgw_create_pools.yml for testbed-node-5 2026-04-28 06:27:53.056951 | orchestrator | 2026-04-28 06:27:53.056955 | orchestrator | TASK [ceph-rgw : Create ec profile] ******************************************** 2026-04-28 06:27:53.056959 | orchestrator | Tuesday 28 April 2026 06:27:17 +0000 (0:00:01.177) 1:11:51.262 ********* 2026-04-28 06:27:53.056966 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:27:53.056971 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:27:53.056975 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:27:53.056978 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:27:53.056982 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:27:53.056986 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:27:53.056990 | orchestrator | 2026-04-28 06:27:53.056993 | orchestrator | TASK [ceph-rgw : Set crush rule] *********************************************** 2026-04-28 06:27:53.056997 | orchestrator | Tuesday 28 April 2026 06:27:19 +0000 (0:00:01.555) 1:11:52.818 ********* 2026-04-28 06:27:53.057001 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:27:53.057004 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:27:53.057008 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:27:53.057012 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:27:53.057016 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}})  2026-04-28 06:27:53.057019 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:27:53.057023 | orchestrator | 2026-04-28 06:27:53.057027 | orchestrator | TASK [ceph-rgw : Create rgw pools] ********************************************* 2026-04-28 06:27:53.057031 | orchestrator | Tuesday 28 April 2026 06:27:21 +0000 (0:00:01.569) 1:11:54.388 ********* 2026-04-28 06:27:53.057037 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.data', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-28 06:27:53.057043 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.buckets.index', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-28 06:27:53.057047 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.control', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-28 06:27:53.057051 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.log', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-28 06:27:53.057057 | orchestrator | ok: [testbed-node-5 -> testbed-node-0(192.168.16.10)] => (item={'key': 'default.rgw.meta', 'value': {'pg_num': 8, 'size': 3, 'type': 'replicated'}}) 2026-04-28 06:27:53.057062 | orchestrator | 2026-04-28 06:27:53.057066 | orchestrator | TASK [ceph-rgw : Include_tasks openstack-keystone.yml] ************************* 2026-04-28 06:27:53.057071 | orchestrator | Tuesday 28 April 2026 06:27:52 +0000 (0:00:31.264) 1:12:25.653 ********* 2026-04-28 06:27:53.057075 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:27:53.057079 | orchestrator | 2026-04-28 06:27:53.057084 | orchestrator | TASK [ceph-rgw : Include_tasks start_radosgw.yml] ****************************** 2026-04-28 06:27:53.057091 | orchestrator | Tuesday 28 April 2026 06:27:53 +0000 (0:00:00.779) 1:12:26.432 ********* 2026-04-28 06:28:47.495953 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:28:47.496066 | orchestrator | 2026-04-28 06:28:47.496083 | orchestrator | TASK [ceph-rgw : Include start_docker_rgw.yml] ********************************* 2026-04-28 06:28:47.496095 | orchestrator | Tuesday 28 April 2026 06:27:53 +0000 (0:00:00.794) 1:12:27.226 ********* 2026-04-28 06:28:47.496131 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/start_docker_rgw.yml for testbed-node-5 2026-04-28 06:28:47.496144 | orchestrator | 2026-04-28 06:28:47.496155 | orchestrator | TASK [ceph-rgw : Include_task systemd.yml] ************************************* 2026-04-28 06:28:47.496166 | orchestrator | Tuesday 28 April 2026 06:27:55 +0000 (0:00:01.157) 1:12:28.384 ********* 2026-04-28 06:28:47.496177 | orchestrator | included: /ansible/roles/ceph-rgw/tasks/systemd.yml for testbed-node-5 2026-04-28 06:28:47.496187 | orchestrator | 2026-04-28 06:28:47.496198 | orchestrator | TASK [ceph-rgw : Generate systemd unit file] *********************************** 2026-04-28 06:28:47.496209 | orchestrator | Tuesday 28 April 2026 06:27:56 +0000 (0:00:01.340) 1:12:29.725 ********* 2026-04-28 06:28:47.496219 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:28:47.496231 | orchestrator | 2026-04-28 06:28:47.496241 | orchestrator | TASK [ceph-rgw : Generate systemd ceph-radosgw target file] ******************** 2026-04-28 06:28:47.496252 | orchestrator | Tuesday 28 April 2026 06:27:58 +0000 (0:00:02.054) 1:12:31.780 ********* 2026-04-28 06:28:47.496262 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:28:47.496273 | orchestrator | 2026-04-28 06:28:47.496284 | orchestrator | TASK [ceph-rgw : Enable ceph-radosgw.target] *********************************** 2026-04-28 06:28:47.496294 | orchestrator | Tuesday 28 April 2026 06:28:00 +0000 (0:00:01.926) 1:12:33.707 ********* 2026-04-28 06:28:47.496305 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:28:47.496315 | orchestrator | 2026-04-28 06:28:47.496326 | orchestrator | TASK [ceph-rgw : Systemd start rgw container] ********************************** 2026-04-28 06:28:47.496336 | orchestrator | Tuesday 28 April 2026 06:28:02 +0000 (0:00:02.318) 1:12:36.026 ********* 2026-04-28 06:28:47.496348 | orchestrator | changed: [testbed-node-5] => (item={'instance_name': 'rgw0', 'radosgw_address': '192.168.16.15', 'radosgw_frontend_port': 8081}) 2026-04-28 06:28:47.496360 | orchestrator | 2026-04-28 06:28:47.496399 | orchestrator | PLAY [Upgrade ceph rbd mirror node] ******************************************** 2026-04-28 06:28:47.496411 | orchestrator | skipping: no hosts matched 2026-04-28 06:28:47.496422 | orchestrator | 2026-04-28 06:28:47.496432 | orchestrator | PLAY [Upgrade ceph nfs node] *************************************************** 2026-04-28 06:28:47.496443 | orchestrator | skipping: no hosts matched 2026-04-28 06:28:47.496454 | orchestrator | 2026-04-28 06:28:47.496465 | orchestrator | PLAY [Upgrade ceph client node] ************************************************ 2026-04-28 06:28:47.496475 | orchestrator | skipping: no hosts matched 2026-04-28 06:28:47.496491 | orchestrator | 2026-04-28 06:28:47.496503 | orchestrator | PLAY [Upgrade ceph-crash daemons] ********************************************** 2026-04-28 06:28:47.496515 | orchestrator | 2026-04-28 06:28:47.496528 | orchestrator | TASK [Stop the ceph-crash service] ********************************************* 2026-04-28 06:28:47.496540 | orchestrator | Tuesday 28 April 2026 06:28:07 +0000 (0:00:05.167) 1:12:41.193 ********* 2026-04-28 06:28:47.496552 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:28:47.496564 | orchestrator | changed: [testbed-node-1] 2026-04-28 06:28:47.496576 | orchestrator | changed: [testbed-node-3] 2026-04-28 06:28:47.496588 | orchestrator | changed: [testbed-node-2] 2026-04-28 06:28:47.496600 | orchestrator | changed: [testbed-node-4] 2026-04-28 06:28:47.496615 | orchestrator | changed: [testbed-node-5] 2026-04-28 06:28:47.496636 | orchestrator | 2026-04-28 06:28:47.496656 | orchestrator | TASK [Mask and disable the ceph-crash service] ********************************* 2026-04-28 06:28:47.496676 | orchestrator | Tuesday 28 April 2026 06:28:10 +0000 (0:00:02.556) 1:12:43.750 ********* 2026-04-28 06:28:47.496696 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:28:47.496717 | orchestrator | changed: [testbed-node-1] 2026-04-28 06:28:47.496736 | orchestrator | changed: [testbed-node-3] 2026-04-28 06:28:47.496755 | orchestrator | changed: [testbed-node-4] 2026-04-28 06:28:47.496776 | orchestrator | changed: [testbed-node-2] 2026-04-28 06:28:47.496797 | orchestrator | changed: [testbed-node-5] 2026-04-28 06:28:47.496818 | orchestrator | 2026-04-28 06:28:47.496838 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 06:28:47.496865 | orchestrator | Tuesday 28 April 2026 06:28:13 +0000 (0:00:03.456) 1:12:47.206 ********* 2026-04-28 06:28:47.496876 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:28:47.496887 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:28:47.496897 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:28:47.496908 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:28:47.496919 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:28:47.496929 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:28:47.496940 | orchestrator | 2026-04-28 06:28:47.496965 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 06:28:47.496977 | orchestrator | Tuesday 28 April 2026 06:28:16 +0000 (0:00:02.542) 1:12:49.749 ********* 2026-04-28 06:28:47.496987 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:28:47.496998 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:28:47.497008 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:28:47.497019 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:28:47.497029 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:28:47.497040 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:28:47.497051 | orchestrator | 2026-04-28 06:28:47.497061 | orchestrator | TASK [ceph-handler : Include check_running_cluster.yml] ************************ 2026-04-28 06:28:47.497072 | orchestrator | Tuesday 28 April 2026 06:28:18 +0000 (0:00:02.161) 1:12:51.910 ********* 2026-04-28 06:28:47.497084 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_cluster.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 06:28:47.497096 | orchestrator | 2026-04-28 06:28:47.497107 | orchestrator | TASK [ceph-handler : Include check_running_containers.yml] ********************* 2026-04-28 06:28:47.497117 | orchestrator | Tuesday 28 April 2026 06:28:20 +0000 (0:00:02.213) 1:12:54.124 ********* 2026-04-28 06:28:47.497128 | orchestrator | included: /ansible/roles/ceph-handler/tasks/check_running_containers.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 06:28:47.497139 | orchestrator | 2026-04-28 06:28:47.497170 | orchestrator | TASK [ceph-handler : Check for a mon container] ******************************** 2026-04-28 06:28:47.497181 | orchestrator | Tuesday 28 April 2026 06:28:22 +0000 (0:00:02.213) 1:12:56.338 ********* 2026-04-28 06:28:47.497192 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:28:47.497203 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:28:47.497213 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:28:47.497224 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:28:47.497235 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:28:47.497245 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:28:47.497256 | orchestrator | 2026-04-28 06:28:47.497266 | orchestrator | TASK [ceph-handler : Check for an osd container] ******************************* 2026-04-28 06:28:47.497277 | orchestrator | Tuesday 28 April 2026 06:28:25 +0000 (0:00:02.323) 1:12:58.662 ********* 2026-04-28 06:28:47.497287 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:28:47.497298 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:28:47.497308 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:28:47.497319 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:28:47.497329 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:28:47.497340 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:28:47.497350 | orchestrator | 2026-04-28 06:28:47.497361 | orchestrator | TASK [ceph-handler : Check for a mds container] ******************************** 2026-04-28 06:28:47.497394 | orchestrator | Tuesday 28 April 2026 06:28:27 +0000 (0:00:02.280) 1:13:00.943 ********* 2026-04-28 06:28:47.497405 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:28:47.497416 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:28:47.497426 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:28:47.497437 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:28:47.497447 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:28:47.497458 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:28:47.497468 | orchestrator | 2026-04-28 06:28:47.497479 | orchestrator | TASK [ceph-handler : Check for a rgw container] ******************************** 2026-04-28 06:28:47.497490 | orchestrator | Tuesday 28 April 2026 06:28:30 +0000 (0:00:02.698) 1:13:03.641 ********* 2026-04-28 06:28:47.497508 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:28:47.497518 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:28:47.497529 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:28:47.497540 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:28:47.497550 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:28:47.497561 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:28:47.497571 | orchestrator | 2026-04-28 06:28:47.497582 | orchestrator | TASK [ceph-handler : Check for a mgr container] ******************************** 2026-04-28 06:28:47.497593 | orchestrator | Tuesday 28 April 2026 06:28:32 +0000 (0:00:02.459) 1:13:06.100 ********* 2026-04-28 06:28:47.497604 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:28:47.497615 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:28:47.497625 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:28:47.497636 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:28:47.497646 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:28:47.497657 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:28:47.497668 | orchestrator | 2026-04-28 06:28:47.497678 | orchestrator | TASK [ceph-handler : Check for a rbd mirror container] ************************* 2026-04-28 06:28:47.497688 | orchestrator | Tuesday 28 April 2026 06:28:35 +0000 (0:00:02.379) 1:13:08.480 ********* 2026-04-28 06:28:47.497699 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:28:47.497709 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:28:47.497720 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:28:47.497730 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:28:47.497741 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:28:47.497751 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:28:47.497762 | orchestrator | 2026-04-28 06:28:47.497773 | orchestrator | TASK [ceph-handler : Check for a nfs container] ******************************** 2026-04-28 06:28:47.497783 | orchestrator | Tuesday 28 April 2026 06:28:37 +0000 (0:00:01.966) 1:13:10.447 ********* 2026-04-28 06:28:47.497794 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:28:47.497805 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:28:47.497815 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:28:47.497826 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:28:47.497836 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:28:47.497847 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:28:47.497857 | orchestrator | 2026-04-28 06:28:47.497868 | orchestrator | TASK [ceph-handler : Check for a ceph-crash container] ************************* 2026-04-28 06:28:47.497878 | orchestrator | Tuesday 28 April 2026 06:28:39 +0000 (0:00:02.338) 1:13:12.786 ********* 2026-04-28 06:28:47.497889 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:28:47.497900 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:28:47.497910 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:28:47.497921 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:28:47.497931 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:28:47.497942 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:28:47.497952 | orchestrator | 2026-04-28 06:28:47.497969 | orchestrator | TASK [ceph-handler : Check for a ceph-exporter container] ********************** 2026-04-28 06:28:47.497979 | orchestrator | Tuesday 28 April 2026 06:28:41 +0000 (0:00:02.388) 1:13:15.174 ********* 2026-04-28 06:28:47.497990 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:28:47.498001 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:28:47.498011 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:28:47.498084 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:28:47.498096 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:28:47.498106 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:28:47.498117 | orchestrator | 2026-04-28 06:28:47.498127 | orchestrator | TASK [ceph-handler : Include check_socket_non_container.yml] ******************* 2026-04-28 06:28:47.498138 | orchestrator | Tuesday 28 April 2026 06:28:44 +0000 (0:00:02.707) 1:13:17.882 ********* 2026-04-28 06:28:47.498149 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:28:47.498160 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:28:47.498170 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:28:47.498181 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:28:47.498198 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:28:47.498209 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:28:47.498219 | orchestrator | 2026-04-28 06:28:47.498230 | orchestrator | TASK [ceph-handler : Set_fact handler_mon_status] ****************************** 2026-04-28 06:28:47.498241 | orchestrator | Tuesday 28 April 2026 06:28:46 +0000 (0:00:01.961) 1:13:19.844 ********* 2026-04-28 06:28:47.498252 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:28:47.498263 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:28:47.498273 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:28:47.498284 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:28:47.498295 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:28:47.498306 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:28:47.498317 | orchestrator | 2026-04-28 06:28:47.498336 | orchestrator | TASK [ceph-handler : Set_fact handler_osd_status] ****************************** 2026-04-28 06:29:46.186630 | orchestrator | Tuesday 28 April 2026 06:28:48 +0000 (0:00:02.336) 1:13:22.180 ********* 2026-04-28 06:29:46.186746 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:29:46.186762 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:29:46.186774 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:29:46.186785 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:29:46.186797 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:29:46.186808 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:29:46.186819 | orchestrator | 2026-04-28 06:29:46.186831 | orchestrator | TASK [ceph-handler : Set_fact handler_mds_status] ****************************** 2026-04-28 06:29:46.186842 | orchestrator | Tuesday 28 April 2026 06:28:50 +0000 (0:00:01.923) 1:13:24.104 ********* 2026-04-28 06:29:46.186853 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:29:46.186864 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:29:46.186874 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:29:46.186885 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:29:46.186896 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:29:46.186906 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:29:46.186917 | orchestrator | 2026-04-28 06:29:46.186928 | orchestrator | TASK [ceph-handler : Set_fact handler_rgw_status] ****************************** 2026-04-28 06:29:46.186939 | orchestrator | Tuesday 28 April 2026 06:28:52 +0000 (0:00:01.938) 1:13:26.043 ********* 2026-04-28 06:29:46.186949 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:29:46.186960 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:29:46.186971 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:29:46.186981 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:29:46.186992 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:29:46.187003 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:29:46.187013 | orchestrator | 2026-04-28 06:29:46.187024 | orchestrator | TASK [ceph-handler : Set_fact handler_nfs_status] ****************************** 2026-04-28 06:29:46.187035 | orchestrator | Tuesday 28 April 2026 06:28:55 +0000 (0:00:02.549) 1:13:28.592 ********* 2026-04-28 06:29:46.187046 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:29:46.187056 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:29:46.187067 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:29:46.187077 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:29:46.187088 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:29:46.187098 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:29:46.187109 | orchestrator | 2026-04-28 06:29:46.187120 | orchestrator | TASK [ceph-handler : Set_fact handler_rbd_status] ****************************** 2026-04-28 06:29:46.187131 | orchestrator | Tuesday 28 April 2026 06:28:57 +0000 (0:00:02.014) 1:13:30.606 ********* 2026-04-28 06:29:46.187141 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:29:46.187152 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:29:46.187164 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:29:46.187176 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:29:46.187189 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:29:46.187201 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:29:46.187213 | orchestrator | 2026-04-28 06:29:46.187226 | orchestrator | TASK [ceph-handler : Set_fact handler_mgr_status] ****************************** 2026-04-28 06:29:46.187265 | orchestrator | Tuesday 28 April 2026 06:28:59 +0000 (0:00:02.457) 1:13:33.063 ********* 2026-04-28 06:29:46.187278 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:29:46.187290 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:29:46.187303 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:29:46.187315 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:29:46.187352 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:29:46.187365 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:29:46.187378 | orchestrator | 2026-04-28 06:29:46.187390 | orchestrator | TASK [ceph-handler : Set_fact handler_crash_status] **************************** 2026-04-28 06:29:46.187402 | orchestrator | Tuesday 28 April 2026 06:29:01 +0000 (0:00:02.089) 1:13:35.153 ********* 2026-04-28 06:29:46.187415 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:29:46.187427 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:29:46.187438 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:29:46.187451 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:29:46.187463 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:29:46.187475 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:29:46.187487 | orchestrator | 2026-04-28 06:29:46.187500 | orchestrator | TASK [ceph-handler : Set_fact handler_exporter_status] ************************* 2026-04-28 06:29:46.187512 | orchestrator | Tuesday 28 April 2026 06:29:04 +0000 (0:00:02.401) 1:13:37.555 ********* 2026-04-28 06:29:46.187523 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:29:46.187533 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:29:46.187544 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:29:46.187554 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:29:46.187565 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:29:46.187575 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:29:46.187586 | orchestrator | 2026-04-28 06:29:46.187611 | orchestrator | TASK [ceph-crash : Create client.crash keyring] ******************************** 2026-04-28 06:29:46.187622 | orchestrator | Tuesday 28 April 2026 06:29:06 +0000 (0:00:02.266) 1:13:39.822 ********* 2026-04-28 06:29:46.187633 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:29:46.187644 | orchestrator | 2026-04-28 06:29:46.187654 | orchestrator | TASK [ceph-crash : Get keys from monitors] ************************************* 2026-04-28 06:29:46.187665 | orchestrator | Tuesday 28 April 2026 06:29:09 +0000 (0:00:03.082) 1:13:42.904 ********* 2026-04-28 06:29:46.187676 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:29:46.187686 | orchestrator | 2026-04-28 06:29:46.187697 | orchestrator | TASK [ceph-crash : Copy ceph key(s) if needed] ********************************* 2026-04-28 06:29:46.187708 | orchestrator | Tuesday 28 April 2026 06:29:12 +0000 (0:00:03.038) 1:13:45.943 ********* 2026-04-28 06:29:46.187718 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:29:46.187729 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:29:46.187739 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:29:46.187750 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:29:46.187760 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:29:46.187771 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:29:46.187781 | orchestrator | 2026-04-28 06:29:46.187792 | orchestrator | TASK [ceph-crash : Create /var/lib/ceph/crash/posted] ************************** 2026-04-28 06:29:46.187803 | orchestrator | Tuesday 28 April 2026 06:29:15 +0000 (0:00:02.685) 1:13:48.628 ********* 2026-04-28 06:29:46.187813 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:29:46.187824 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:29:46.187834 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:29:46.187845 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:29:46.187856 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:29:46.187866 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:29:46.187877 | orchestrator | 2026-04-28 06:29:46.187888 | orchestrator | TASK [ceph-crash : Include_tasks systemd.yml] ********************************** 2026-04-28 06:29:46.187917 | orchestrator | Tuesday 28 April 2026 06:29:18 +0000 (0:00:02.817) 1:13:51.446 ********* 2026-04-28 06:29:46.187930 | orchestrator | included: /ansible/roles/ceph-crash/tasks/systemd.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 06:29:46.187951 | orchestrator | 2026-04-28 06:29:46.187963 | orchestrator | TASK [ceph-crash : Generate systemd unit file for ceph-crash container] ******** 2026-04-28 06:29:46.187974 | orchestrator | Tuesday 28 April 2026 06:29:20 +0000 (0:00:02.539) 1:13:53.985 ********* 2026-04-28 06:29:46.187984 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:29:46.187995 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:29:46.188005 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:29:46.188016 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:29:46.188027 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:29:46.188038 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:29:46.188049 | orchestrator | 2026-04-28 06:29:46.188059 | orchestrator | TASK [ceph-crash : Start the ceph-crash service] ******************************* 2026-04-28 06:29:46.188070 | orchestrator | Tuesday 28 April 2026 06:29:23 +0000 (0:00:02.538) 1:13:56.524 ********* 2026-04-28 06:29:46.188081 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:29:46.188092 | orchestrator | changed: [testbed-node-3] 2026-04-28 06:29:46.188102 | orchestrator | changed: [testbed-node-4] 2026-04-28 06:29:46.188113 | orchestrator | changed: [testbed-node-5] 2026-04-28 06:29:46.188124 | orchestrator | changed: [testbed-node-1] 2026-04-28 06:29:46.188134 | orchestrator | changed: [testbed-node-2] 2026-04-28 06:29:46.188145 | orchestrator | 2026-04-28 06:29:46.188156 | orchestrator | PLAY [Complete upgrade] ******************************************************** 2026-04-28 06:29:46.188167 | orchestrator | 2026-04-28 06:29:46.188177 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 06:29:46.188188 | orchestrator | Tuesday 28 April 2026 06:29:27 +0000 (0:00:04.851) 1:14:01.376 ********* 2026-04-28 06:29:46.188199 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:29:46.188209 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:29:46.188220 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:29:46.188231 | orchestrator | 2026-04-28 06:29:46.188241 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 06:29:46.188252 | orchestrator | Tuesday 28 April 2026 06:29:29 +0000 (0:00:01.643) 1:14:03.019 ********* 2026-04-28 06:29:46.188263 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:29:46.188274 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:29:46.188284 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:29:46.188295 | orchestrator | 2026-04-28 06:29:46.188305 | orchestrator | TASK [Container | disallow pre-reef OSDs and enable all new reef-only functionality] *** 2026-04-28 06:29:46.188317 | orchestrator | Tuesday 28 April 2026 06:29:31 +0000 (0:00:01.759) 1:14:04.779 ********* 2026-04-28 06:29:46.188349 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:29:46.188359 | orchestrator | 2026-04-28 06:29:46.188371 | orchestrator | TASK [Non container | disallow pre-reef OSDs and enable all new reef-only functionality] *** 2026-04-28 06:29:46.188382 | orchestrator | Tuesday 28 April 2026 06:29:33 +0000 (0:00:02.292) 1:14:07.072 ********* 2026-04-28 06:29:46.188392 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:29:46.188403 | orchestrator | 2026-04-28 06:29:46.188414 | orchestrator | PLAY [Upgrade node-exporter] *************************************************** 2026-04-28 06:29:46.188425 | orchestrator | 2026-04-28 06:29:46.188436 | orchestrator | TASK [Stop node-exporter] ****************************************************** 2026-04-28 06:29:46.188447 | orchestrator | Tuesday 28 April 2026 06:29:35 +0000 (0:00:02.234) 1:14:09.306 ********* 2026-04-28 06:29:46.188457 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:29:46.188468 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:29:46.188479 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:29:46.188490 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:29:46.188500 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:29:46.188511 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:29:46.188522 | orchestrator | skipping: [testbed-manager] 2026-04-28 06:29:46.188532 | orchestrator | 2026-04-28 06:29:46.188543 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 06:29:46.188554 | orchestrator | Tuesday 28 April 2026 06:29:37 +0000 (0:00:01.909) 1:14:11.216 ********* 2026-04-28 06:29:46.188565 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:29:46.188584 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:29:46.188594 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:29:46.188605 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:29:46.188628 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:29:46.188651 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:29:46.188662 | orchestrator | skipping: [testbed-manager] 2026-04-28 06:29:46.188673 | orchestrator | 2026-04-28 06:29:46.188689 | orchestrator | TASK [ceph-container-engine : Include pre_requisites/prerequisites.yml] ******** 2026-04-28 06:29:46.188701 | orchestrator | Tuesday 28 April 2026 06:29:40 +0000 (0:00:02.429) 1:14:13.645 ********* 2026-04-28 06:29:46.188712 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:29:46.188731 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:29:46.188751 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:29:46.188770 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:29:46.188791 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:29:46.188811 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:29:46.188831 | orchestrator | skipping: [testbed-manager] 2026-04-28 06:29:46.188845 | orchestrator | 2026-04-28 06:29:46.188855 | orchestrator | TASK [ceph-container-common : Container registry authentication] *************** 2026-04-28 06:29:46.188866 | orchestrator | Tuesday 28 April 2026 06:29:42 +0000 (0:00:02.516) 1:14:16.162 ********* 2026-04-28 06:29:46.188877 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:29:46.188887 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:29:46.188898 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:29:46.188908 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:29:46.188919 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:29:46.188929 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:29:46.188940 | orchestrator | skipping: [testbed-manager] 2026-04-28 06:29:46.188950 | orchestrator | 2026-04-28 06:29:46.188961 | orchestrator | TASK [ceph-node-exporter : Include setup_container.yml] ************************ 2026-04-28 06:29:46.188972 | orchestrator | Tuesday 28 April 2026 06:29:45 +0000 (0:00:02.551) 1:14:18.713 ********* 2026-04-28 06:29:46.188983 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:29:46.188993 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:29:46.189004 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:29:46.189022 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:30:34.203466 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:30:34.203586 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:30:34.203603 | orchestrator | skipping: [testbed-manager] 2026-04-28 06:30:34.203615 | orchestrator | 2026-04-28 06:30:34.203628 | orchestrator | PLAY [Upgrade monitoring node] ************************************************* 2026-04-28 06:30:34.203639 | orchestrator | 2026-04-28 06:30:34.203650 | orchestrator | TASK [Stop monitoring services] ************************************************ 2026-04-28 06:30:34.203662 | orchestrator | Tuesday 28 April 2026 06:29:48 +0000 (0:00:03.363) 1:14:22.077 ********* 2026-04-28 06:30:34.203673 | orchestrator | skipping: [testbed-manager] => (item=alertmanager)  2026-04-28 06:30:34.203684 | orchestrator | skipping: [testbed-manager] => (item=prometheus)  2026-04-28 06:30:34.203695 | orchestrator | skipping: [testbed-manager] => (item=grafana-server)  2026-04-28 06:30:34.203715 | orchestrator | skipping: [testbed-manager] 2026-04-28 06:30:34.203735 | orchestrator | 2026-04-28 06:30:34.203755 | orchestrator | TASK [ceph-facts : Set grafana_server_addr fact - ipv4] ************************ 2026-04-28 06:30:34.203775 | orchestrator | Tuesday 28 April 2026 06:29:49 +0000 (0:00:01.145) 1:14:23.223 ********* 2026-04-28 06:30:34.203793 | orchestrator | skipping: [testbed-manager] 2026-04-28 06:30:34.203813 | orchestrator | 2026-04-28 06:30:34.203831 | orchestrator | TASK [ceph-facts : Set grafana_server_addr fact - ipv6] ************************ 2026-04-28 06:30:34.203850 | orchestrator | Tuesday 28 April 2026 06:29:50 +0000 (0:00:01.100) 1:14:24.325 ********* 2026-04-28 06:30:34.203871 | orchestrator | skipping: [testbed-manager] 2026-04-28 06:30:34.203892 | orchestrator | 2026-04-28 06:30:34.203914 | orchestrator | TASK [ceph-facts : Set grafana_server_addrs fact - ipv4] *********************** 2026-04-28 06:30:34.203933 | orchestrator | Tuesday 28 April 2026 06:29:52 +0000 (0:00:01.117) 1:14:25.442 ********* 2026-04-28 06:30:34.203988 | orchestrator | skipping: [testbed-manager] 2026-04-28 06:30:34.204002 | orchestrator | 2026-04-28 06:30:34.204013 | orchestrator | TASK [ceph-facts : Set grafana_server_addrs fact - ipv6] *********************** 2026-04-28 06:30:34.204023 | orchestrator | Tuesday 28 April 2026 06:29:53 +0000 (0:00:01.125) 1:14:26.568 ********* 2026-04-28 06:30:34.204034 | orchestrator | skipping: [testbed-manager] 2026-04-28 06:30:34.204045 | orchestrator | 2026-04-28 06:30:34.204056 | orchestrator | TASK [ceph-prometheus : Create prometheus directories] ************************* 2026-04-28 06:30:34.204067 | orchestrator | Tuesday 28 April 2026 06:29:54 +0000 (0:00:01.127) 1:14:27.696 ********* 2026-04-28 06:30:34.204077 | orchestrator | skipping: [testbed-manager] => (item=/etc/prometheus)  2026-04-28 06:30:34.204089 | orchestrator | skipping: [testbed-manager] => (item=/var/lib/prometheus)  2026-04-28 06:30:34.204101 | orchestrator | skipping: [testbed-manager] 2026-04-28 06:30:34.204112 | orchestrator | 2026-04-28 06:30:34.204122 | orchestrator | TASK [ceph-prometheus : Write prometheus config file] ************************** 2026-04-28 06:30:34.204133 | orchestrator | Tuesday 28 April 2026 06:29:55 +0000 (0:00:01.204) 1:14:28.901 ********* 2026-04-28 06:30:34.204143 | orchestrator | skipping: [testbed-manager] 2026-04-28 06:30:34.204154 | orchestrator | 2026-04-28 06:30:34.204165 | orchestrator | TASK [ceph-prometheus : Make sure the alerting rules directory exists] ********* 2026-04-28 06:30:34.204175 | orchestrator | Tuesday 28 April 2026 06:29:56 +0000 (0:00:01.286) 1:14:30.187 ********* 2026-04-28 06:30:34.204186 | orchestrator | skipping: [testbed-manager] 2026-04-28 06:30:34.204196 | orchestrator | 2026-04-28 06:30:34.204207 | orchestrator | TASK [ceph-prometheus : Copy alerting rules] *********************************** 2026-04-28 06:30:34.204217 | orchestrator | Tuesday 28 April 2026 06:29:57 +0000 (0:00:01.116) 1:14:31.303 ********* 2026-04-28 06:30:34.204228 | orchestrator | skipping: [testbed-manager] 2026-04-28 06:30:34.204238 | orchestrator | 2026-04-28 06:30:34.204249 | orchestrator | TASK [ceph-prometheus : Create alertmanager directories] *********************** 2026-04-28 06:30:34.204260 | orchestrator | Tuesday 28 April 2026 06:29:59 +0000 (0:00:01.147) 1:14:32.451 ********* 2026-04-28 06:30:34.204270 | orchestrator | skipping: [testbed-manager] => (item=/etc/alertmanager)  2026-04-28 06:30:34.204281 | orchestrator | skipping: [testbed-manager] => (item=/var/lib/alertmanager)  2026-04-28 06:30:34.204317 | orchestrator | skipping: [testbed-manager] 2026-04-28 06:30:34.204330 | orchestrator | 2026-04-28 06:30:34.204341 | orchestrator | TASK [ceph-prometheus : Write alertmanager config file] ************************ 2026-04-28 06:30:34.204351 | orchestrator | Tuesday 28 April 2026 06:30:00 +0000 (0:00:01.113) 1:14:33.565 ********* 2026-04-28 06:30:34.204362 | orchestrator | skipping: [testbed-manager] 2026-04-28 06:30:34.204373 | orchestrator | 2026-04-28 06:30:34.204397 | orchestrator | TASK [ceph-prometheus : Include setup_container.yml] *************************** 2026-04-28 06:30:34.204408 | orchestrator | Tuesday 28 April 2026 06:30:01 +0000 (0:00:01.111) 1:14:34.677 ********* 2026-04-28 06:30:34.204419 | orchestrator | skipping: [testbed-manager] 2026-04-28 06:30:34.204429 | orchestrator | 2026-04-28 06:30:34.204440 | orchestrator | TASK [ceph-grafana : Include setup_container.yml] ****************************** 2026-04-28 06:30:34.204451 | orchestrator | Tuesday 28 April 2026 06:30:02 +0000 (0:00:01.138) 1:14:35.816 ********* 2026-04-28 06:30:34.204462 | orchestrator | skipping: [testbed-manager] 2026-04-28 06:30:34.204472 | orchestrator | 2026-04-28 06:30:34.204483 | orchestrator | TASK [ceph-grafana : Include configure_grafana.yml] **************************** 2026-04-28 06:30:34.204494 | orchestrator | Tuesday 28 April 2026 06:30:03 +0000 (0:00:01.137) 1:14:36.953 ********* 2026-04-28 06:30:34.204504 | orchestrator | skipping: [testbed-manager] 2026-04-28 06:30:34.204515 | orchestrator | 2026-04-28 06:30:34.204526 | orchestrator | PLAY [Upgrade ceph dashboard] ************************************************** 2026-04-28 06:30:34.204537 | orchestrator | 2026-04-28 06:30:34.204547 | orchestrator | TASK [ceph-facts : Include facts.yml] ****************************************** 2026-04-28 06:30:34.204558 | orchestrator | Tuesday 28 April 2026 06:30:05 +0000 (0:00:02.154) 1:14:39.107 ********* 2026-04-28 06:30:34.204578 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:30:34.204590 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:30:34.204600 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:30:34.204611 | orchestrator | 2026-04-28 06:30:34.204622 | orchestrator | TASK [ceph-facts : Set grafana_server_addr fact - ipv4] ************************ 2026-04-28 06:30:34.204633 | orchestrator | Tuesday 28 April 2026 06:30:07 +0000 (0:00:01.623) 1:14:40.731 ********* 2026-04-28 06:30:34.204644 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:30:34.204655 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:30:34.204687 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:30:34.204699 | orchestrator | 2026-04-28 06:30:34.204710 | orchestrator | TASK [ceph-facts : Set grafana_server_addr fact - ipv6] ************************ 2026-04-28 06:30:34.204720 | orchestrator | Tuesday 28 April 2026 06:30:08 +0000 (0:00:01.496) 1:14:42.227 ********* 2026-04-28 06:30:34.204731 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:30:34.204742 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:30:34.204753 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:30:34.204763 | orchestrator | 2026-04-28 06:30:34.204774 | orchestrator | TASK [ceph-facts : Set grafana_server_addrs fact - ipv4] *********************** 2026-04-28 06:30:34.204784 | orchestrator | Tuesday 28 April 2026 06:30:10 +0000 (0:00:01.522) 1:14:43.750 ********* 2026-04-28 06:30:34.204795 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:30:34.204806 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:30:34.204816 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:30:34.204827 | orchestrator | 2026-04-28 06:30:34.204838 | orchestrator | TASK [ceph-facts : Set grafana_server_addrs fact - ipv6] *********************** 2026-04-28 06:30:34.204848 | orchestrator | Tuesday 28 April 2026 06:30:11 +0000 (0:00:01.309) 1:14:45.059 ********* 2026-04-28 06:30:34.204859 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:30:34.204869 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:30:34.204880 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:30:34.204890 | orchestrator | 2026-04-28 06:30:34.204901 | orchestrator | TASK [ceph-dashboard : Include configure_dashboard.yml] ************************ 2026-04-28 06:30:34.204912 | orchestrator | Tuesday 28 April 2026 06:30:13 +0000 (0:00:01.490) 1:14:46.549 ********* 2026-04-28 06:30:34.204922 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:30:34.204933 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:30:34.204944 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:30:34.204954 | orchestrator | 2026-04-28 06:30:34.204965 | orchestrator | TASK [ceph-dashboard : Print dashboard URL] ************************************ 2026-04-28 06:30:34.204975 | orchestrator | Tuesday 28 April 2026 06:30:14 +0000 (0:00:01.517) 1:14:48.067 ********* 2026-04-28 06:30:34.204986 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:30:34.204996 | orchestrator | 2026-04-28 06:30:34.205007 | orchestrator | PLAY [Switch any existing crush buckets to straw2] ***************************** 2026-04-28 06:30:34.205018 | orchestrator | 2026-04-28 06:30:34.205028 | orchestrator | TASK [ceph-facts : Check if podman binary is present] ************************** 2026-04-28 06:30:34.205039 | orchestrator | Tuesday 28 April 2026 06:30:16 +0000 (0:00:01.939) 1:14:50.006 ********* 2026-04-28 06:30:34.205050 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:30:34.205061 | orchestrator | 2026-04-28 06:30:34.205071 | orchestrator | TASK [ceph-facts : Set_fact container_binary] ********************************** 2026-04-28 06:30:34.205082 | orchestrator | Tuesday 28 April 2026 06:30:18 +0000 (0:00:01.424) 1:14:51.431 ********* 2026-04-28 06:30:34.205093 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:30:34.205104 | orchestrator | 2026-04-28 06:30:34.205114 | orchestrator | TASK [Set_fact ceph_cmd] ******************************************************* 2026-04-28 06:30:34.205125 | orchestrator | Tuesday 28 April 2026 06:30:19 +0000 (0:00:01.167) 1:14:52.598 ********* 2026-04-28 06:30:34.205136 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:30:34.205146 | orchestrator | 2026-04-28 06:30:34.205157 | orchestrator | TASK [Backup the crushmap] ***************************************************** 2026-04-28 06:30:34.205168 | orchestrator | Tuesday 28 April 2026 06:30:20 +0000 (0:00:01.172) 1:14:53.771 ********* 2026-04-28 06:30:34.205185 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:30:34.205196 | orchestrator | 2026-04-28 06:30:34.205207 | orchestrator | TASK [Switch crush buckets to straw2] ****************************************** 2026-04-28 06:30:34.205217 | orchestrator | Tuesday 28 April 2026 06:30:23 +0000 (0:00:02.794) 1:14:56.565 ********* 2026-04-28 06:30:34.205228 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:30:34.205239 | orchestrator | 2026-04-28 06:30:34.205249 | orchestrator | TASK [Remove crushmap backup] ************************************************** 2026-04-28 06:30:34.205260 | orchestrator | Tuesday 28 April 2026 06:30:26 +0000 (0:00:03.751) 1:15:00.316 ********* 2026-04-28 06:30:34.205271 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:30:34.205281 | orchestrator | 2026-04-28 06:30:34.205351 | orchestrator | PLAY [Show ceph status] ******************************************************** 2026-04-28 06:30:34.205365 | orchestrator | 2026-04-28 06:30:34.205376 | orchestrator | TASK [Set_fact container_exec_cmd_status] ************************************** 2026-04-28 06:30:34.205387 | orchestrator | Tuesday 28 April 2026 06:30:29 +0000 (0:00:02.171) 1:15:02.488 ********* 2026-04-28 06:30:34.205397 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:30:34.205408 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:30:34.205419 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:30:34.205429 | orchestrator | 2026-04-28 06:30:34.205446 | orchestrator | TASK [Show ceph status] ******************************************************** 2026-04-28 06:30:34.205457 | orchestrator | Tuesday 28 April 2026 06:30:30 +0000 (0:00:01.602) 1:15:04.090 ********* 2026-04-28 06:30:34.205467 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:30:34.205478 | orchestrator | 2026-04-28 06:30:34.205489 | orchestrator | TASK [Show all daemons version] ************************************************ 2026-04-28 06:30:34.205499 | orchestrator | Tuesday 28 April 2026 06:30:33 +0000 (0:00:02.301) 1:15:06.392 ********* 2026-04-28 06:30:34.205510 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:30:34.205520 | orchestrator | 2026-04-28 06:30:34.205531 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 06:30:34.205543 | orchestrator | localhost : ok=0 changed=0 unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 06:30:34.205555 | orchestrator | testbed-manager : ok=25  changed=1  unreachable=0 failed=0 skipped=76  rescued=0 ignored=0 2026-04-28 06:30:34.205567 | orchestrator | testbed-node-0 : ok=248  changed=19  unreachable=0 failed=0 skipped=369  rescued=0 ignored=0 2026-04-28 06:30:34.205578 | orchestrator | testbed-node-1 : ok=191  changed=14  unreachable=0 failed=0 skipped=343  rescued=0 ignored=0 2026-04-28 06:30:34.205597 | orchestrator | testbed-node-2 : ok=196  changed=14  unreachable=0 failed=0 skipped=344  rescued=0 ignored=0 2026-04-28 06:30:37.024778 | orchestrator | testbed-node-3 : ok=316  changed=21  unreachable=0 failed=0 skipped=355  rescued=0 ignored=0 2026-04-28 06:30:37.024879 | orchestrator | testbed-node-4 : ok=308  changed=16  unreachable=0 failed=0 skipped=352  rescued=0 ignored=0 2026-04-28 06:30:37.024893 | orchestrator | testbed-node-5 : ok=303  changed=17  unreachable=0 failed=0 skipped=337  rescued=0 ignored=0 2026-04-28 06:30:37.024905 | orchestrator | 2026-04-28 06:30:37.024917 | orchestrator | 2026-04-28 06:30:37.024927 | orchestrator | 2026-04-28 06:30:37.024939 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 06:30:37.024951 | orchestrator | Tuesday 28 April 2026 06:30:36 +0000 (0:00:03.333) 1:15:09.725 ********* 2026-04-28 06:30:37.024962 | orchestrator | =============================================================================== 2026-04-28 06:30:37.024972 | orchestrator | Disable pg autoscale on pools ------------------------------------------ 69.98s 2026-04-28 06:30:37.024983 | orchestrator | Re-enable pg autoscale on pools ---------------------------------------- 69.10s 2026-04-28 06:30:37.025028 | orchestrator | ceph-rgw : Create rgw pools -------------------------------------------- 31.26s 2026-04-28 06:30:37.025039 | orchestrator | Gather and delegate facts ---------------------------------------------- 31.05s 2026-04-28 06:30:37.025050 | orchestrator | ceph-rgw : Create rgw pools -------------------------------------------- 30.71s 2026-04-28 06:30:37.025064 | orchestrator | ceph-rgw : Create rgw pools -------------------------------------------- 30.21s 2026-04-28 06:30:37.025082 | orchestrator | ceph-mon : Set cluster configs ----------------------------------------- 29.11s 2026-04-28 06:30:37.025099 | orchestrator | Waiting for clean pgs... ----------------------------------------------- 27.61s 2026-04-28 06:30:37.025117 | orchestrator | ceph-mon : Waiting for the monitor(s) to form the quorum... ------------ 22.89s 2026-04-28 06:30:37.025135 | orchestrator | ceph-mon : Waiting for the monitor(s) to form the quorum... ------------ 22.87s 2026-04-28 06:30:37.025153 | orchestrator | ceph-config : Set config to cluster ------------------------------------ 22.53s 2026-04-28 06:30:37.025171 | orchestrator | ceph-infra : Update cache for Debian based OSs ------------------------- 19.32s 2026-04-28 06:30:37.025189 | orchestrator | Stop ceph mgr ---------------------------------------------------------- 18.01s 2026-04-28 06:30:37.025207 | orchestrator | Create potentially missing keys (rbd and rbd-mirror) ------------------- 16.39s 2026-04-28 06:30:37.025224 | orchestrator | ceph-osd : Wait for all osd to be up ----------------------------------- 15.31s 2026-04-28 06:30:37.025242 | orchestrator | ceph-config : Set config to cluster ------------------------------------ 14.00s 2026-04-28 06:30:37.025260 | orchestrator | ceph-config : Set osd_memory_target to cluster host config ------------- 13.27s 2026-04-28 06:30:37.025279 | orchestrator | ceph-config : Set osd_memory_target to cluster host config ------------- 12.66s 2026-04-28 06:30:37.025344 | orchestrator | Stop ceph osd ---------------------------------------------------------- 12.59s 2026-04-28 06:30:37.025360 | orchestrator | Stop standby ceph mds -------------------------------------------------- 10.56s 2026-04-28 06:30:37.223568 | orchestrator | + osism apply cephclient 2026-04-28 06:30:38.509812 | orchestrator | 2026-04-28 06:30:38 | INFO  | Prepare task for execution of cephclient. 2026-04-28 06:30:38.588395 | orchestrator | 2026-04-28 06:30:38 | INFO  | Task 3d6533fa-ad62-465a-a5f8-739106434961 (cephclient) was prepared for execution. 2026-04-28 06:30:38.588491 | orchestrator | 2026-04-28 06:30:38 | INFO  | It takes a moment until task 3d6533fa-ad62-465a-a5f8-739106434961 (cephclient) has been started and output is visible here. 2026-04-28 06:30:57.074177 | orchestrator | 2026-04-28 06:30:57.074410 | orchestrator | PLAY [Apply role cephclient] *************************************************** 2026-04-28 06:30:57.074440 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-28 06:30:57.074460 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-28 06:30:57.074492 | orchestrator | 2026-04-28 06:30:57.074508 | orchestrator | TASK [osism.services.cephclient : Include container tasks] ********************* 2026-04-28 06:30:57.074524 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-28 06:30:57.074541 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-28 06:30:57.074574 | orchestrator | Tuesday 28 April 2026 06:30:44 +0000 (0:00:01.705) 0:00:01.705 ********* 2026-04-28 06:30:57.074591 | orchestrator | included: /usr/share/ansible/collections/ansible_collections/osism/services/roles/cephclient/tasks/container.yml for testbed-manager 2026-04-28 06:30:57.074610 | orchestrator | 2026-04-28 06:30:57.074626 | orchestrator | TASK [osism.services.cephclient : Create required directories] ***************** 2026-04-28 06:30:57.074644 | orchestrator | Tuesday 28 April 2026 06:30:45 +0000 (0:00:00.820) 0:00:02.525 ********* 2026-04-28 06:30:57.074655 | orchestrator | ok: [testbed-manager] => (item=/opt/cephclient/configuration) 2026-04-28 06:30:57.074687 | orchestrator | ok: [testbed-manager] => (item=/opt/cephclient/data) 2026-04-28 06:30:57.074700 | orchestrator | ok: [testbed-manager] => (item=/opt/cephclient) 2026-04-28 06:30:57.074712 | orchestrator | 2026-04-28 06:30:57.074724 | orchestrator | TASK [osism.services.cephclient : Copy configuration files] ******************** 2026-04-28 06:30:57.074735 | orchestrator | Tuesday 28 April 2026 06:30:46 +0000 (0:00:01.646) 0:00:04.172 ********* 2026-04-28 06:30:57.074749 | orchestrator | ok: [testbed-manager] => (item={'src': 'ceph.conf.j2', 'dest': '/opt/cephclient/configuration/ceph.conf'}) 2026-04-28 06:30:57.074766 | orchestrator | 2026-04-28 06:30:57.074790 | orchestrator | TASK [osism.services.cephclient : Copy keyring file] *************************** 2026-04-28 06:30:57.074809 | orchestrator | Tuesday 28 April 2026 06:30:47 +0000 (0:00:01.061) 0:00:05.233 ********* 2026-04-28 06:30:57.074825 | orchestrator | ok: [testbed-manager] 2026-04-28 06:30:57.074841 | orchestrator | 2026-04-28 06:30:57.074856 | orchestrator | TASK [osism.services.cephclient : Copy docker-compose.yml file] **************** 2026-04-28 06:30:57.074873 | orchestrator | Tuesday 28 April 2026 06:30:48 +0000 (0:00:00.933) 0:00:06.166 ********* 2026-04-28 06:30:57.074888 | orchestrator | ok: [testbed-manager] 2026-04-28 06:30:57.074905 | orchestrator | 2026-04-28 06:30:57.074921 | orchestrator | TASK [osism.services.cephclient : Manage cephclient service] ******************* 2026-04-28 06:30:57.074937 | orchestrator | Tuesday 28 April 2026 06:30:49 +0000 (0:00:00.968) 0:00:07.135 ********* 2026-04-28 06:30:57.074952 | orchestrator | ok: [testbed-manager] 2026-04-28 06:30:57.074966 | orchestrator | 2026-04-28 06:30:57.074981 | orchestrator | TASK [osism.services.cephclient : Copy wrapper scripts] ************************ 2026-04-28 06:30:57.074996 | orchestrator | Tuesday 28 April 2026 06:30:51 +0000 (0:00:01.447) 0:00:08.582 ********* 2026-04-28 06:30:57.075010 | orchestrator | ok: [testbed-manager] => (item=ceph) 2026-04-28 06:30:57.075029 | orchestrator | ok: [testbed-manager] => (item=ceph-authtool) 2026-04-28 06:30:57.075044 | orchestrator | ok: [testbed-manager] => (item=rados) 2026-04-28 06:30:57.075060 | orchestrator | ok: [testbed-manager] => (item=radosgw-admin) 2026-04-28 06:30:57.075075 | orchestrator | ok: [testbed-manager] => (item=rbd) 2026-04-28 06:30:57.075092 | orchestrator | 2026-04-28 06:30:57.075109 | orchestrator | TASK [osism.services.cephclient : Remove old wrapper scripts] ****************** 2026-04-28 06:30:57.075124 | orchestrator | Tuesday 28 April 2026 06:30:55 +0000 (0:00:04.013) 0:00:12.596 ********* 2026-04-28 06:30:57.075140 | orchestrator | ok: [testbed-manager] => (item=crushtool) 2026-04-28 06:30:57.075156 | orchestrator | 2026-04-28 06:30:57.075173 | orchestrator | TASK [osism.services.cephclient : Include package tasks] *********************** 2026-04-28 06:30:57.075188 | orchestrator | Tuesday 28 April 2026 06:30:55 +0000 (0:00:00.481) 0:00:13.078 ********* 2026-04-28 06:30:57.075206 | orchestrator | skipping: [testbed-manager] 2026-04-28 06:30:57.075221 | orchestrator | 2026-04-28 06:30:57.075238 | orchestrator | TASK [osism.services.cephclient : Include rook task] *************************** 2026-04-28 06:30:57.075254 | orchestrator | Tuesday 28 April 2026 06:30:55 +0000 (0:00:00.163) 0:00:13.242 ********* 2026-04-28 06:30:57.075270 | orchestrator | skipping: [testbed-manager] 2026-04-28 06:30:57.075318 | orchestrator | 2026-04-28 06:30:57.075335 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 06:30:57.075353 | orchestrator | testbed-manager : ok=8  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 06:30:57.075371 | orchestrator | 2026-04-28 06:30:57.075387 | orchestrator | 2026-04-28 06:30:57.075403 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 06:30:57.075419 | orchestrator | Tuesday 28 April 2026 06:30:56 +0000 (0:00:00.909) 0:00:14.151 ********* 2026-04-28 06:30:57.075437 | orchestrator | =============================================================================== 2026-04-28 06:30:57.075453 | orchestrator | osism.services.cephclient : Copy wrapper scripts ------------------------ 4.01s 2026-04-28 06:30:57.075470 | orchestrator | osism.services.cephclient : Create required directories ----------------- 1.65s 2026-04-28 06:30:57.075506 | orchestrator | osism.services.cephclient : Manage cephclient service ------------------- 1.45s 2026-04-28 06:30:57.075523 | orchestrator | osism.services.cephclient : Copy configuration files -------------------- 1.06s 2026-04-28 06:30:57.075540 | orchestrator | osism.services.cephclient : Copy docker-compose.yml file ---------------- 0.97s 2026-04-28 06:30:57.075556 | orchestrator | osism.services.cephclient : Copy keyring file --------------------------- 0.93s 2026-04-28 06:30:57.075612 | orchestrator | osism.services.cephclient : Include rook task --------------------------- 0.91s 2026-04-28 06:30:57.075632 | orchestrator | osism.services.cephclient : Include container tasks --------------------- 0.82s 2026-04-28 06:30:57.075648 | orchestrator | osism.services.cephclient : Remove old wrapper scripts ------------------ 0.48s 2026-04-28 06:30:57.075665 | orchestrator | osism.services.cephclient : Include package tasks ----------------------- 0.16s 2026-04-28 06:30:57.271645 | orchestrator | + [[ false == \f\a\l\s\e ]] 2026-04-28 06:30:57.271740 | orchestrator | + sh -c /opt/configuration/scripts/upgrade/300-openstack.sh 2026-04-28 06:30:57.277219 | orchestrator | + set -e 2026-04-28 06:30:57.277320 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-28 06:30:57.277341 | orchestrator | ++ export INTERACTIVE=false 2026-04-28 06:30:57.277354 | orchestrator | ++ INTERACTIVE=false 2026-04-28 06:30:57.277367 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-28 06:30:57.277379 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-28 06:30:57.277390 | orchestrator | + source /opt/manager-vars.sh 2026-04-28 06:30:57.277401 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-28 06:30:57.277413 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-28 06:30:57.277425 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-28 06:30:57.277437 | orchestrator | ++ CEPH_VERSION=reef 2026-04-28 06:30:57.277449 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-28 06:30:57.277462 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-28 06:30:57.277476 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-28 06:30:57.277489 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-28 06:30:57.277501 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-28 06:30:57.277513 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-28 06:30:57.277526 | orchestrator | ++ export ARA=false 2026-04-28 06:30:57.277538 | orchestrator | ++ ARA=false 2026-04-28 06:30:57.277552 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-28 06:30:57.277566 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-28 06:30:57.277579 | orchestrator | ++ export TEMPEST=false 2026-04-28 06:30:57.277592 | orchestrator | ++ TEMPEST=false 2026-04-28 06:30:57.277604 | orchestrator | ++ export IS_ZUUL=true 2026-04-28 06:30:57.277616 | orchestrator | ++ IS_ZUUL=true 2026-04-28 06:30:57.277629 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 06:30:57.277643 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 06:30:57.277656 | orchestrator | ++ export EXTERNAL_API=false 2026-04-28 06:30:57.277669 | orchestrator | ++ EXTERNAL_API=false 2026-04-28 06:30:57.277683 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-28 06:30:57.277694 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-28 06:30:57.277706 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-28 06:30:57.277719 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-28 06:30:57.277733 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-28 06:30:57.277746 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-28 06:30:57.277759 | orchestrator | ++ export RABBITMQ3TO4=true 2026-04-28 06:30:57.277772 | orchestrator | ++ RABBITMQ3TO4=true 2026-04-28 06:30:57.277784 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-28 06:30:57.278153 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-28 06:30:57.284066 | orchestrator | ++ export MANAGER_VERSION=10.0.0 2026-04-28 06:30:57.284117 | orchestrator | ++ MANAGER_VERSION=10.0.0 2026-04-28 06:30:57.284128 | orchestrator | + [[ true == \t\r\u\e ]] 2026-04-28 06:30:57.284135 | orchestrator | + osism migrate rabbitmq3to4 prepare 2026-04-28 06:31:06.537711 | orchestrator | 2026-04-28 06:31:06 | ERROR  | Unable to get ansible vault password 2026-04-28 06:31:06.537828 | orchestrator | 2026-04-28 06:31:06 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-28 06:31:06.537850 | orchestrator | 2026-04-28 06:31:06 | ERROR  | Dropping encrypted entries 2026-04-28 06:31:06.573085 | orchestrator | 2026-04-28 06:31:06 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-28 06:31:06.573766 | orchestrator | 2026-04-28 06:31:06 | INFO  | Kolla configuration check passed 2026-04-28 06:31:06.745993 | orchestrator | 2026-04-28 06:31:06 | INFO  | Created vhost 'openstack' with default_queue_type=quorum 2026-04-28 06:31:06.769076 | orchestrator | 2026-04-28 06:31:06 | INFO  | Set permissions for user 'openstack' on vhost 'openstack' 2026-04-28 06:31:07.028363 | orchestrator | + osism migrate rabbitmq3to4 list 2026-04-28 06:31:13.284811 | orchestrator | 2026-04-28 06:31:13 | ERROR  | Unable to get ansible vault password 2026-04-28 06:31:13.284917 | orchestrator | 2026-04-28 06:31:13 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-28 06:31:13.284934 | orchestrator | 2026-04-28 06:31:13 | ERROR  | Dropping encrypted entries 2026-04-28 06:31:13.318798 | orchestrator | 2026-04-28 06:31:13 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-28 06:31:13.454423 | orchestrator | 2026-04-28 06:31:13 | INFO  | Found 206 classic queue(s) in vhost '/': 2026-04-28 06:31:13.454548 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - alarm.all.sample (vhost: /, messages: 0) 2026-04-28 06:31:13.454559 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - alarming.sample (vhost: /, messages: 0) 2026-04-28 06:31:13.454566 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - barbican.workers (vhost: /, messages: 0) 2026-04-28 06:31:13.454573 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - barbican.workers.barbican.queue (vhost: /, messages: 0) 2026-04-28 06:31:13.454588 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - barbican.workers_fanout_257befa41c8e49f09fae4afa2836a6f8 (vhost: /, messages: 0) 2026-04-28 06:31:13.454751 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - barbican.workers_fanout_4b10364e7a8146d19d800a6f26722212 (vhost: /, messages: 0) 2026-04-28 06:31:13.455031 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - barbican.workers_fanout_a2aad0d41e3b4d0e9cb2959979dc221b (vhost: /, messages: 0) 2026-04-28 06:31:13.455393 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - barbican_notifications.info (vhost: /, messages: 0) 2026-04-28 06:31:13.455576 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - central (vhost: /, messages: 0) 2026-04-28 06:31:13.455955 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - central.testbed-node-0 (vhost: /, messages: 0) 2026-04-28 06:31:13.456407 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - central.testbed-node-1 (vhost: /, messages: 0) 2026-04-28 06:31:13.456422 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - central.testbed-node-2 (vhost: /, messages: 0) 2026-04-28 06:31:13.456429 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - central_fanout_1746274fc9fd4b1b975552a22477ea4f (vhost: /, messages: 0) 2026-04-28 06:31:13.457375 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - central_fanout_2b73462715644146b960a568f88b712a (vhost: /, messages: 0) 2026-04-28 06:31:13.457396 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - central_fanout_654af88a92224ca4a7fa54abfc64ca11 (vhost: /, messages: 0) 2026-04-28 06:31:13.457404 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - central_fanout_694677d4d2414e6cb895b2fca0f03868 (vhost: /, messages: 0) 2026-04-28 06:31:13.457582 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - central_fanout_a7ff3d4d97974639a40cb9352e4d8b24 (vhost: /, messages: 0) 2026-04-28 06:31:13.457665 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - central_fanout_f16ff3095f2748d2ac8fc39dab707205 (vhost: /, messages: 0) 2026-04-28 06:31:13.457769 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-backup (vhost: /, messages: 0) 2026-04-28 06:31:13.458084 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-backup.testbed-node-0 (vhost: /, messages: 0) 2026-04-28 06:31:13.458287 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-backup.testbed-node-1 (vhost: /, messages: 0) 2026-04-28 06:31:13.458600 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-backup.testbed-node-2 (vhost: /, messages: 0) 2026-04-28 06:31:13.458681 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-backup_fanout_2aa458d8b1ab406b8009fa6d75d7072e (vhost: /, messages: 0) 2026-04-28 06:31:13.458915 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-backup_fanout_407b20690d7c440ba9512545991d3dc2 (vhost: /, messages: 0) 2026-04-28 06:31:13.459088 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-backup_fanout_55036cb0bd9540e394d2cc2674a5f518 (vhost: /, messages: 0) 2026-04-28 06:31:13.459260 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-scheduler (vhost: /, messages: 0) 2026-04-28 06:31:13.459522 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-scheduler.testbed-node-0 (vhost: /, messages: 0) 2026-04-28 06:31:13.459795 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-scheduler.testbed-node-1 (vhost: /, messages: 0) 2026-04-28 06:31:13.460152 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-scheduler.testbed-node-2 (vhost: /, messages: 0) 2026-04-28 06:31:13.460260 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-scheduler_fanout_6ee74a36feda40ca8e588e3c31a96424 (vhost: /, messages: 0) 2026-04-28 06:31:13.460341 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-scheduler_fanout_8312e412e5ab49428ae79441fb3c6cd0 (vhost: /, messages: 0) 2026-04-28 06:31:13.460546 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-scheduler_fanout_f13a3c7cc2ae4bbea31aa373f8fff954 (vhost: /, messages: 0) 2026-04-28 06:31:13.460899 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-volume (vhost: /, messages: 0) 2026-04-28 06:31:13.460911 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-volume.testbed-node-0@rbd-volumes (vhost: /, messages: 0) 2026-04-28 06:31:13.461295 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-volume.testbed-node-0@rbd-volumes.testbed-node-0 (vhost: /, messages: 0) 2026-04-28 06:31:13.461535 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-volume.testbed-node-0@rbd-volumes_fanout_1de4aef7e5e64835a081acf83a3822c7 (vhost: /, messages: 0) 2026-04-28 06:31:13.461591 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-volume.testbed-node-1@rbd-volumes (vhost: /, messages: 0) 2026-04-28 06:31:13.461676 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-volume.testbed-node-1@rbd-volumes.testbed-node-1 (vhost: /, messages: 0) 2026-04-28 06:31:13.461882 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-volume.testbed-node-1@rbd-volumes_fanout_b0ab062b54454a9c85dcc3992731ce9b (vhost: /, messages: 0) 2026-04-28 06:31:13.461893 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-volume.testbed-node-2@rbd-volumes (vhost: /, messages: 0) 2026-04-28 06:31:13.462176 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-volume.testbed-node-2@rbd-volumes.testbed-node-2 (vhost: /, messages: 0) 2026-04-28 06:31:13.462324 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-volume.testbed-node-2@rbd-volumes_fanout_963da4d414ff4c5688471bc3ce80e4b4 (vhost: /, messages: 0) 2026-04-28 06:31:13.462583 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-volume_fanout_26b75e2e7f5e4c83a2a218a96e6fba9e (vhost: /, messages: 0) 2026-04-28 06:31:13.462720 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-volume_fanout_e4aad6a361bb46ada577cdc1f05f4043 (vhost: /, messages: 0) 2026-04-28 06:31:13.462743 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - cinder-volume_fanout_e6c5ee15578a4fb883ef797fc91eeee0 (vhost: /, messages: 0) 2026-04-28 06:31:13.463016 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - compute (vhost: /, messages: 0) 2026-04-28 06:31:13.463028 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - compute.testbed-node-3 (vhost: /, messages: 0) 2026-04-28 06:31:13.463244 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - compute.testbed-node-4 (vhost: /, messages: 0) 2026-04-28 06:31:13.463367 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - compute.testbed-node-5 (vhost: /, messages: 0) 2026-04-28 06:31:13.463682 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - compute_fanout_bec8cce040524fbab9cc0ba4715df9d0 (vhost: /, messages: 0) 2026-04-28 06:31:13.463896 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - compute_fanout_d5380b65bb9f4747ad0a51abd7ead04e (vhost: /, messages: 0) 2026-04-28 06:31:13.463981 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - compute_fanout_dc2f855c85fe4a90ba73d7d0c1480353 (vhost: /, messages: 0) 2026-04-28 06:31:13.464235 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - conductor (vhost: /, messages: 0) 2026-04-28 06:31:13.464393 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - conductor.testbed-node-0 (vhost: /, messages: 0) 2026-04-28 06:31:13.464568 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - conductor.testbed-node-1 (vhost: /, messages: 0) 2026-04-28 06:31:13.464663 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - conductor.testbed-node-2 (vhost: /, messages: 0) 2026-04-28 06:31:13.464880 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - conductor_fanout_0996973c521b4558bfed0045cc66940a (vhost: /, messages: 0) 2026-04-28 06:31:13.465054 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - conductor_fanout_8efb2b65d76d4c19a022a32fa6326bb1 (vhost: /, messages: 0) 2026-04-28 06:31:13.465221 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - conductor_fanout_ae8fffabd3c846b18db682318598ff99 (vhost: /, messages: 0) 2026-04-28 06:31:13.465355 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - conductor_fanout_e0057e59e1104722a5ce2cb4032e6a89 (vhost: /, messages: 0) 2026-04-28 06:31:13.465675 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - conductor_fanout_e9f2991cea6149a5a419464c6bfb8b4b (vhost: /, messages: 0) 2026-04-28 06:31:13.465756 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - conductor_fanout_f1e0199f36ad49b5b92c6d95c0ce2fc2 (vhost: /, messages: 0) 2026-04-28 06:31:13.465919 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - event.sample (vhost: /, messages: 3) 2026-04-28 06:31:13.466095 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - magnum-conductor (vhost: /, messages: 0) 2026-04-28 06:31:13.466258 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - magnum-conductor.23kkdtj7kbpm (vhost: /, messages: 0) 2026-04-28 06:31:13.466339 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - magnum-conductor.muqkm72ic6fj (vhost: /, messages: 0) 2026-04-28 06:31:13.466769 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - magnum-conductor.qunrydm2gv3l (vhost: /, messages: 0) 2026-04-28 06:31:13.466783 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - magnum-conductor_fanout_41b4e1df1fc74cdfbb272b2aa0c9e317 (vhost: /, messages: 0) 2026-04-28 06:31:13.466944 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - magnum-conductor_fanout_6c2a82c0a6e44417b411a4b92f1e0521 (vhost: /, messages: 0) 2026-04-28 06:31:13.467081 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - magnum-conductor_fanout_715ca76c0c934524a7eca1241992ad3c (vhost: /, messages: 0) 2026-04-28 06:31:13.467331 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - magnum-conductor_fanout_795a296cfe344d8c9374c3a7a5b6916d (vhost: /, messages: 0) 2026-04-28 06:31:13.467358 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - magnum-conductor_fanout_8aafe37959e3460ca46a034f98e9aa91 (vhost: /, messages: 0) 2026-04-28 06:31:13.467666 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - magnum-conductor_fanout_999a9c0a490c4a53bebb71262b81af4f (vhost: /, messages: 0) 2026-04-28 06:31:13.467676 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - magnum-conductor_fanout_ab63e6713e5b47758e8155046faa7e89 (vhost: /, messages: 0) 2026-04-28 06:31:13.467816 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - magnum-conductor_fanout_b390359272bd4aa98103a57a9a65a2a8 (vhost: /, messages: 0) 2026-04-28 06:31:13.468076 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - magnum-conductor_fanout_cfbbd35d982f4bde89e50cf974c58485 (vhost: /, messages: 0) 2026-04-28 06:31:13.468086 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - manila-data (vhost: /, messages: 0) 2026-04-28 06:31:13.468216 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - manila-data.testbed-node-0 (vhost: /, messages: 0) 2026-04-28 06:31:13.468636 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - manila-data.testbed-node-1 (vhost: /, messages: 0) 2026-04-28 06:31:13.468647 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - manila-data.testbed-node-2 (vhost: /, messages: 0) 2026-04-28 06:31:13.468795 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - manila-data_fanout_0755452be5254343abfaf2136a3f3a6f (vhost: /, messages: 0) 2026-04-28 06:31:13.469045 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - manila-data_fanout_2187fa02c0594368826d1047ff42db03 (vhost: /, messages: 0) 2026-04-28 06:31:13.469055 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - manila-data_fanout_28ac00cd35024057be0a2c6392277347 (vhost: /, messages: 0) 2026-04-28 06:31:13.469299 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - manila-scheduler (vhost: /, messages: 0) 2026-04-28 06:31:13.469310 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - manila-scheduler.testbed-node-0 (vhost: /, messages: 0) 2026-04-28 06:31:13.469514 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - manila-scheduler.testbed-node-1 (vhost: /, messages: 0) 2026-04-28 06:31:13.469719 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - manila-scheduler.testbed-node-2 (vhost: /, messages: 0) 2026-04-28 06:31:13.469793 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - manila-scheduler_fanout_1c3b80a3ec1f45a7a9f40dc5525ca89c (vhost: /, messages: 0) 2026-04-28 06:31:13.469997 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - manila-scheduler_fanout_919aa22b568c4d2aa00ec04fe077fc56 (vhost: /, messages: 0) 2026-04-28 06:31:13.470077 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - manila-scheduler_fanout_9bf9bdb493f4455bba1236d4109843a9 (vhost: /, messages: 0) 2026-04-28 06:31:13.470300 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - manila-share (vhost: /, messages: 0) 2026-04-28 06:31:13.470375 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - manila-share.testbed-node-0@cephfsnative1 (vhost: /, messages: 0) 2026-04-28 06:31:13.470586 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - manila-share.testbed-node-1@cephfsnative1 (vhost: /, messages: 0) 2026-04-28 06:31:13.470664 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - manila-share.testbed-node-2@cephfsnative1 (vhost: /, messages: 0) 2026-04-28 06:31:13.470779 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - manila-share_fanout_2153bd923e74456eb9006f5b46fe799d (vhost: /, messages: 0) 2026-04-28 06:31:13.471007 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - manila-share_fanout_e122b874392d432d8bc5dfa240d6a1eb (vhost: /, messages: 0) 2026-04-28 06:31:13.471079 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - manila-share_fanout_f3bf6c7d6b894b659c9d7983c9314ec3 (vhost: /, messages: 0) 2026-04-28 06:31:13.471211 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - notifications.audit (vhost: /, messages: 0) 2026-04-28 06:31:13.471422 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - notifications.critical (vhost: /, messages: 0) 2026-04-28 06:31:13.471493 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - notifications.debug (vhost: /, messages: 0) 2026-04-28 06:31:13.471852 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - notifications.error (vhost: /, messages: 0) 2026-04-28 06:31:13.471862 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - notifications.info (vhost: /, messages: 0) 2026-04-28 06:31:13.471974 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - notifications.sample (vhost: /, messages: 0) 2026-04-28 06:31:13.472171 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - notifications.warn (vhost: /, messages: 0) 2026-04-28 06:31:13.472317 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - octavia_provisioning_v2 (vhost: /, messages: 0) 2026-04-28 06:31:13.472593 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - octavia_provisioning_v2.testbed-node-0 (vhost: /, messages: 0) 2026-04-28 06:31:13.472604 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - octavia_provisioning_v2.testbed-node-1 (vhost: /, messages: 0) 2026-04-28 06:31:13.472734 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - octavia_provisioning_v2.testbed-node-2 (vhost: /, messages: 0) 2026-04-28 06:31:13.472809 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - octavia_provisioning_v2_fanout_09444579b678447c9637c8776eaf9c14 (vhost: /, messages: 0) 2026-04-28 06:31:13.473183 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - octavia_provisioning_v2_fanout_7365fdd3c8e34460bfe7c4a82f28cedc (vhost: /, messages: 0) 2026-04-28 06:31:13.473194 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - octavia_provisioning_v2_fanout_78751075231f4802bfe7e5d66731186b (vhost: /, messages: 0) 2026-04-28 06:31:13.473315 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - producer (vhost: /, messages: 0) 2026-04-28 06:31:13.473511 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - producer.testbed-node-0 (vhost: /, messages: 0) 2026-04-28 06:31:13.473586 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - producer.testbed-node-1 (vhost: /, messages: 0) 2026-04-28 06:31:13.473838 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - producer.testbed-node-2 (vhost: /, messages: 0) 2026-04-28 06:31:13.473890 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - producer_fanout_0615415e51814691855c19de8b2d0912 (vhost: /, messages: 0) 2026-04-28 06:31:13.474072 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - producer_fanout_4afa4eee41ae4729ae4eeac0148f69c7 (vhost: /, messages: 0) 2026-04-28 06:31:13.474193 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - producer_fanout_d15ec1fb9cf44ceb8dad4eef197e9be3 (vhost: /, messages: 0) 2026-04-28 06:31:13.474282 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - producer_fanout_e52ccce539e941ddaf5c92dd2ccae2a8 (vhost: /, messages: 0) 2026-04-28 06:31:13.474390 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - producer_fanout_e6b63d0316984bc0b0529503cd0392db (vhost: /, messages: 0) 2026-04-28 06:31:13.474624 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - producer_fanout_f3c92510369d4bc39c8c14b1506eacd4 (vhost: /, messages: 0) 2026-04-28 06:31:13.474699 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-plugin (vhost: /, messages: 0) 2026-04-28 06:31:13.474825 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-plugin.testbed-node-0 (vhost: /, messages: 0) 2026-04-28 06:31:13.475100 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-plugin.testbed-node-1 (vhost: /, messages: 0) 2026-04-28 06:31:13.475118 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-plugin.testbed-node-2 (vhost: /, messages: 0) 2026-04-28 06:31:13.475280 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-plugin_fanout_17211cc974014b5cbcb4c8ba2e8f4887 (vhost: /, messages: 0) 2026-04-28 06:31:13.475492 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-plugin_fanout_1ba88f541a7f4ea8b58d88d85c2fb3c9 (vhost: /, messages: 0) 2026-04-28 06:31:13.475789 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-plugin_fanout_1ccaf4fc70554639a13626b0b1c8558f (vhost: /, messages: 0) 2026-04-28 06:31:13.475799 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-plugin_fanout_78c79af6ee1440c98bdc7b759a803fec (vhost: /, messages: 0) 2026-04-28 06:31:13.475865 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-plugin_fanout_a5ee272356044716bfde0e20ae47ccdb (vhost: /, messages: 0) 2026-04-28 06:31:13.475994 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-plugin_fanout_a7cfafddc0f8487d94bbe3e655fca552 (vhost: /, messages: 0) 2026-04-28 06:31:13.476190 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-plugin_fanout_b207aea990634470a09f875fdd401e58 (vhost: /, messages: 0) 2026-04-28 06:31:13.476339 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-plugin_fanout_c3a65e6d87374262885e4a0920bc56f8 (vhost: /, messages: 0) 2026-04-28 06:31:13.476401 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-plugin_fanout_df7be0e240f246a6b47c04e0fc1cdec2 (vhost: /, messages: 0) 2026-04-28 06:31:13.476668 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-reports-plugin (vhost: /, messages: 0) 2026-04-28 06:31:13.476749 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-reports-plugin.testbed-node-0 (vhost: /, messages: 0) 2026-04-28 06:31:13.476868 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-reports-plugin.testbed-node-1 (vhost: /, messages: 0) 2026-04-28 06:31:13.477016 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-reports-plugin.testbed-node-2 (vhost: /, messages: 0) 2026-04-28 06:31:13.477353 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-reports-plugin_fanout_4eea54a9338c4541a59ebfa0d9f30afc (vhost: /, messages: 0) 2026-04-28 06:31:13.477363 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-reports-plugin_fanout_5b613612a2e4465e89113067819f0342 (vhost: /, messages: 0) 2026-04-28 06:31:13.477529 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-reports-plugin_fanout_5bc48bb8521d4c5695a48764867595e3 (vhost: /, messages: 0) 2026-04-28 06:31:13.477635 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-reports-plugin_fanout_5f386b39a235488eb0b19017a21af471 (vhost: /, messages: 0) 2026-04-28 06:31:13.477779 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-reports-plugin_fanout_6c677e348588474bab943c1bda680bc6 (vhost: /, messages: 0) 2026-04-28 06:31:13.477962 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-reports-plugin_fanout_6e889aee99f74db0b35131fcce4ded92 (vhost: /, messages: 0) 2026-04-28 06:31:13.478075 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-reports-plugin_fanout_8df1d8a02e3d49d9bd3e6b010b0f0b09 (vhost: /, messages: 0) 2026-04-28 06:31:13.478327 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-reports-plugin_fanout_ab42846e3ccb4e0180e73ba7f5520b28 (vhost: /, messages: 0) 2026-04-28 06:31:13.478337 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-reports-plugin_fanout_bba8cf88a0f44316b1808971625b85a5 (vhost: /, messages: 0) 2026-04-28 06:31:13.478593 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-reports-plugin_fanout_bc82f3b36394498ebd56e1c4c9aed60f (vhost: /, messages: 0) 2026-04-28 06:31:13.478723 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-reports-plugin_fanout_bec5842868a94399a16664fe3f33ca1c (vhost: /, messages: 0) 2026-04-28 06:31:13.478796 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-reports-plugin_fanout_c362179fe5674d61979282fa811457fc (vhost: /, messages: 0) 2026-04-28 06:31:13.478930 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-reports-plugin_fanout_cfb5fa9c5e254792a1bfed3ee1fdef43 (vhost: /, messages: 0) 2026-04-28 06:31:13.479180 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-reports-plugin_fanout_d1202a21dbb5484b8b8430e8f2fa0761 (vhost: /, messages: 0) 2026-04-28 06:31:13.479244 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-reports-plugin_fanout_f3185c6eef024eae8e1c0f80a6deda7c (vhost: /, messages: 0) 2026-04-28 06:31:13.479368 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-reports-plugin_fanout_f8a281b7a4b74b6ba63d9712c4d81fc0 (vhost: /, messages: 0) 2026-04-28 06:31:13.479583 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-server-resource-versions (vhost: /, messages: 0) 2026-04-28 06:31:13.479771 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-server-resource-versions.testbed-node-0 (vhost: /, messages: 0) 2026-04-28 06:31:13.479941 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-server-resource-versions.testbed-node-1 (vhost: /, messages: 0) 2026-04-28 06:31:13.480031 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-server-resource-versions.testbed-node-2 (vhost: /, messages: 0) 2026-04-28 06:31:13.480226 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-server-resource-versions_fanout_0bf4b0f623074744bcb7828f30a57a10 (vhost: /, messages: 0) 2026-04-28 06:31:13.480379 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-server-resource-versions_fanout_414d828005614423940a98bb5517d68a (vhost: /, messages: 0) 2026-04-28 06:31:13.480948 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-server-resource-versions_fanout_5a4f125468864f639f0c01391b4cbb53 (vhost: /, messages: 0) 2026-04-28 06:31:13.480957 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-server-resource-versions_fanout_5b9ad359109a4877a0eaa499695e11a1 (vhost: /, messages: 0) 2026-04-28 06:31:13.480962 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-server-resource-versions_fanout_65fd3ec2e6244b8e8e5d24344452bcba (vhost: /, messages: 0) 2026-04-28 06:31:13.481098 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-server-resource-versions_fanout_754caf22e91449759008ab3ea3e7e6ce (vhost: /, messages: 0) 2026-04-28 06:31:13.481106 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-server-resource-versions_fanout_aae37efe6d8b443fb63c906c4daa4273 (vhost: /, messages: 0) 2026-04-28 06:31:13.481110 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-server-resource-versions_fanout_ac5da4ca53eb4b2f8a2054ba469cb410 (vhost: /, messages: 0) 2026-04-28 06:31:13.481307 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - q-server-resource-versions_fanout_e49174165f2249cda1e4c83aa7d9c1a1 (vhost: /, messages: 0) 2026-04-28 06:31:13.481690 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - reply_11862500555f4a7da8f2574e303956a1 (vhost: /, messages: 0) 2026-04-28 06:31:13.481698 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - reply_1e10b0954aab44fa90a5c8b31b13bd2d (vhost: /, messages: 0) 2026-04-28 06:31:13.481779 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - reply_22b834026e764bd3af00d50e96f46e5e (vhost: /, messages: 0) 2026-04-28 06:31:13.481900 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - reply_27e01c65f50640c394f4fc310e150274 (vhost: /, messages: 0) 2026-04-28 06:31:13.482011 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - reply_304ba1a6d51e419d803538f4ccbfbf2c (vhost: /, messages: 0) 2026-04-28 06:31:13.482138 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - reply_3410c12bfc9544ed8ee6900e1e05211e (vhost: /, messages: 0) 2026-04-28 06:31:13.482414 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - reply_3ecb0bceb109481996adca3a2fad026d (vhost: /, messages: 0) 2026-04-28 06:31:13.482541 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - reply_49b1f7cbe78742009f49e8926d06c106 (vhost: /, messages: 0) 2026-04-28 06:31:13.482609 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - reply_556501ba270945bfade281260f43bfe0 (vhost: /, messages: 0) 2026-04-28 06:31:13.482905 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - reply_574c816c3f7f4c73ba726dd30c7aed4a (vhost: /, messages: 0) 2026-04-28 06:31:13.482913 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - reply_74e8efb74d3849558576c844076181d0 (vhost: /, messages: 0) 2026-04-28 06:31:13.482985 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - reply_8c6dddb9709d48fa866fc818353a349a (vhost: /, messages: 0) 2026-04-28 06:31:13.483314 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - reply_ad634ad9802a4e719401b396f4fd0f67 (vhost: /, messages: 0) 2026-04-28 06:31:13.483322 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - reply_b6300008d2f44d219636ea77e848a078 (vhost: /, messages: 0) 2026-04-28 06:31:13.483544 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - reply_c3f511d13e544fe39c6df1fbfa8dda42 (vhost: /, messages: 0) 2026-04-28 06:31:13.483552 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - reply_d16ffc9456744594bc1e2c0c693ae8ec (vhost: /, messages: 0) 2026-04-28 06:31:13.483623 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - reply_d2adc6ff0deb4c1bb8893e32f7485d47 (vhost: /, messages: 0) 2026-04-28 06:31:13.483821 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - reply_ebb01270a6e24baa829c11f852ec905b (vhost: /, messages: 0) 2026-04-28 06:31:13.483942 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - reply_fb4e193fb58d4fa2ba5c6e0e37ff27bc (vhost: /, messages: 0) 2026-04-28 06:31:13.484096 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - scheduler (vhost: /, messages: 0) 2026-04-28 06:31:13.484177 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - scheduler.testbed-node-0 (vhost: /, messages: 0) 2026-04-28 06:31:13.484314 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - scheduler.testbed-node-1 (vhost: /, messages: 0) 2026-04-28 06:31:13.484391 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - scheduler.testbed-node-2 (vhost: /, messages: 0) 2026-04-28 06:31:13.484763 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - scheduler_fanout_18e929e625b245fea10f7539f8a67ea1 (vhost: /, messages: 0) 2026-04-28 06:31:13.484771 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - scheduler_fanout_6bcc1d514ce74295be22448446882010 (vhost: /, messages: 0) 2026-04-28 06:31:13.484869 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - scheduler_fanout_af5eac739de44c4c80536576fab94975 (vhost: /, messages: 0) 2026-04-28 06:31:13.485077 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - scheduler_fanout_ba79d9215fbd49d08610e6c76ff5f594 (vhost: /, messages: 0) 2026-04-28 06:31:13.485376 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - scheduler_fanout_cac2ed755cc94b56998b7e89d0f57fb4 (vhost: /, messages: 0) 2026-04-28 06:31:13.485384 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - scheduler_fanout_d5debded412d42a48e58dea1217746dc (vhost: /, messages: 0) 2026-04-28 06:31:13.485389 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - worker (vhost: /, messages: 0) 2026-04-28 06:31:13.485663 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - worker.testbed-node-0 (vhost: /, messages: 0) 2026-04-28 06:31:13.485834 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - worker.testbed-node-1 (vhost: /, messages: 0) 2026-04-28 06:31:13.485915 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - worker.testbed-node-2 (vhost: /, messages: 0) 2026-04-28 06:31:13.486153 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - worker_fanout_08f736f72039449d83ee69d959338555 (vhost: /, messages: 0) 2026-04-28 06:31:13.486241 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - worker_fanout_154f235c30664406ad349d1703214134 (vhost: /, messages: 0) 2026-04-28 06:31:13.486524 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - worker_fanout_3470a305167d4451a90a2c2e1c9699f8 (vhost: /, messages: 0) 2026-04-28 06:31:13.486532 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - worker_fanout_3c3d1433f4f34ed7be0dc6ae2d838617 (vhost: /, messages: 0) 2026-04-28 06:31:13.486686 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - worker_fanout_67cfe2cd2dc6432fb4cf89afd1777866 (vhost: /, messages: 0) 2026-04-28 06:31:13.486750 | orchestrator | 2026-04-28 06:31:13 | INFO  |  - worker_fanout_cc122723c7a54e39a103184cec29b369 (vhost: /, messages: 0) 2026-04-28 06:31:13.799370 | orchestrator | + osism migrate rabbitmq3to4 list-exchanges 2026-04-28 06:31:20.090460 | orchestrator | 2026-04-28 06:31:20 | ERROR  | Unable to get ansible vault password 2026-04-28 06:31:20.090582 | orchestrator | 2026-04-28 06:31:20 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-28 06:31:20.090601 | orchestrator | 2026-04-28 06:31:20 | ERROR  | Dropping encrypted entries 2026-04-28 06:31:20.122908 | orchestrator | 2026-04-28 06:31:20 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-28 06:31:20.149816 | orchestrator | 2026-04-28 06:31:20 | INFO  | Found 46 exchange(s) in vhost '/': 2026-04-28 06:31:20.149900 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - aodh (type: topic, transient) 2026-04-28 06:31:20.149913 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - barbican.workers_fanout (type: fanout, transient) 2026-04-28 06:31:20.149927 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - ceilometer (type: topic, transient) 2026-04-28 06:31:20.149940 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - central_fanout (type: fanout, transient) 2026-04-28 06:31:20.150143 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - cinder (type: topic, transient) 2026-04-28 06:31:20.150173 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - cinder-backup_fanout (type: fanout, transient) 2026-04-28 06:31:20.150198 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - cinder-scheduler_fanout (type: fanout, transient) 2026-04-28 06:31:20.150210 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - cinder-volume.testbed-node-0@rbd-volumes_fanout (type: fanout, transient) 2026-04-28 06:31:20.150423 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - cinder-volume.testbed-node-1@rbd-volumes_fanout (type: fanout, transient) 2026-04-28 06:31:20.150449 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - cinder-volume.testbed-node-2@rbd-volumes_fanout (type: fanout, transient) 2026-04-28 06:31:20.150460 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - cinder-volume_fanout (type: fanout, transient) 2026-04-28 06:31:20.150471 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - compute_fanout (type: fanout, transient) 2026-04-28 06:31:20.150482 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - conductor_fanout (type: fanout, transient) 2026-04-28 06:31:20.150493 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - designate (type: topic, transient) 2026-04-28 06:31:20.150508 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - dns (type: topic, transient) 2026-04-28 06:31:20.151219 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - glance (type: topic, transient) 2026-04-28 06:31:20.151424 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - heat (type: topic, transient) 2026-04-28 06:31:20.151443 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - ironic (type: topic, transient) 2026-04-28 06:31:20.151487 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - keystone (type: topic, transient) 2026-04-28 06:31:20.151499 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - l3_agent_fanout (type: fanout, transient) 2026-04-28 06:31:20.151511 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - magnum (type: topic, transient) 2026-04-28 06:31:20.151522 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - magnum-conductor_fanout (type: fanout, transient) 2026-04-28 06:31:20.151632 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - manila-data_fanout (type: fanout, transient) 2026-04-28 06:31:20.151662 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - manila-scheduler_fanout (type: fanout, transient) 2026-04-28 06:31:20.151674 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - manila-share_fanout (type: fanout, transient) 2026-04-28 06:31:20.151699 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - neutron (type: topic, transient) 2026-04-28 06:31:20.151711 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - neutron-vo-Network-1.1_fanout (type: fanout, transient) 2026-04-28 06:31:20.151722 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - neutron-vo-Port-1.10_fanout (type: fanout, transient) 2026-04-28 06:31:20.151733 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - neutron-vo-SecurityGroup-1.6_fanout (type: fanout, transient) 2026-04-28 06:31:20.152094 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - neutron-vo-SecurityGroupRule-1.3_fanout (type: fanout, transient) 2026-04-28 06:31:20.152119 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - neutron-vo-Subnet-1.2_fanout (type: fanout, transient) 2026-04-28 06:31:20.153146 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - nova (type: topic, transient) 2026-04-28 06:31:20.153169 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - octavia (type: topic, transient) 2026-04-28 06:31:20.153180 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - octavia_provisioning_v2_fanout (type: fanout, transient) 2026-04-28 06:31:20.153191 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - openstack (type: topic, transient) 2026-04-28 06:31:20.153202 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - producer_fanout (type: fanout, transient) 2026-04-28 06:31:20.153213 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - q-agent-notifier-port-update_fanout (type: fanout, transient) 2026-04-28 06:31:20.153224 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - q-agent-notifier-security_group-update_fanout (type: fanout, transient) 2026-04-28 06:31:20.153236 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - q-plugin_fanout (type: fanout, transient) 2026-04-28 06:31:20.153247 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - q-reports-plugin_fanout (type: fanout, transient) 2026-04-28 06:31:20.153257 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - q-server-resource-versions_fanout (type: fanout, transient) 2026-04-28 06:31:20.153302 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - scheduler_fanout (type: fanout, transient) 2026-04-28 06:31:20.153313 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - swift (type: topic, transient) 2026-04-28 06:31:20.153324 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - trove (type: topic, transient) 2026-04-28 06:31:20.153335 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - worker_fanout (type: fanout, transient) 2026-04-28 06:31:20.153346 | orchestrator | 2026-04-28 06:31:20 | INFO  |  - zaqar (type: topic, transient) 2026-04-28 06:31:20.413578 | orchestrator | + osism apply -a upgrade keystone 2026-04-28 06:31:21.735848 | orchestrator | 2026-04-28 06:31:21 | INFO  | Prepare task for execution of keystone. 2026-04-28 06:31:21.801120 | orchestrator | 2026-04-28 06:31:21 | INFO  | Task e7111830-54c4-4ffe-a5d3-bfa5e1622bbe (keystone) was prepared for execution. 2026-04-28 06:31:21.801217 | orchestrator | 2026-04-28 06:31:21 | INFO  | It takes a moment until task e7111830-54c4-4ffe-a5d3-bfa5e1622bbe (keystone) has been started and output is visible here. 2026-04-28 06:31:31.434503 | orchestrator | 2026-04-28 06:31:31.434608 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 06:31:31.434623 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-28 06:31:31.434635 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-28 06:31:31.434656 | orchestrator | 2026-04-28 06:31:31.434666 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 06:31:31.434676 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-28 06:31:31.434686 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-28 06:31:31.434705 | orchestrator | Tuesday 28 April 2026 06:31:26 +0000 (0:00:01.168) 0:00:01.168 ********* 2026-04-28 06:31:31.434715 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:31:31.434726 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:31:31.434736 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:31:31.434745 | orchestrator | 2026-04-28 06:31:31.434755 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 06:31:31.434765 | orchestrator | Tuesday 28 April 2026 06:31:27 +0000 (0:00:00.834) 0:00:02.002 ********* 2026-04-28 06:31:31.434775 | orchestrator | ok: [testbed-node-0] => (item=enable_keystone_True) 2026-04-28 06:31:31.434785 | orchestrator | ok: [testbed-node-1] => (item=enable_keystone_True) 2026-04-28 06:31:31.434795 | orchestrator | ok: [testbed-node-2] => (item=enable_keystone_True) 2026-04-28 06:31:31.434804 | orchestrator | 2026-04-28 06:31:31.434814 | orchestrator | PLAY [Apply role keystone] ***************************************************** 2026-04-28 06:31:31.434823 | orchestrator | 2026-04-28 06:31:31.434833 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-28 06:31:31.434859 | orchestrator | Tuesday 28 April 2026 06:31:27 +0000 (0:00:00.693) 0:00:02.696 ********* 2026-04-28 06:31:31.434870 | orchestrator | included: /ansible/roles/keystone/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 06:31:31.434880 | orchestrator | 2026-04-28 06:31:31.434890 | orchestrator | TASK [keystone : Ensuring config directories exist] **************************** 2026-04-28 06:31:31.434900 | orchestrator | Tuesday 28 April 2026 06:31:28 +0000 (0:00:01.080) 0:00:03.776 ********* 2026-04-28 06:31:31.434914 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-28 06:31:31.434929 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-28 06:31:31.434979 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-28 06:31:31.434998 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 06:31:31.435011 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 06:31:31.435021 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 06:31:31.435038 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 06:31:31.435050 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 06:31:31.435069 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 06:31:37.249398 | orchestrator | 2026-04-28 06:31:37.249504 | orchestrator | TASK [keystone : Check if policies shall be overwritten] *********************** 2026-04-28 06:31:37.249520 | orchestrator | Tuesday 28 April 2026 06:31:31 +0000 (0:00:02.530) 0:00:06.307 ********* 2026-04-28 06:31:37.249532 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:31:37.249544 | orchestrator | 2026-04-28 06:31:37.249555 | orchestrator | TASK [keystone : Set keystone policy file] ************************************* 2026-04-28 06:31:37.249566 | orchestrator | Tuesday 28 April 2026 06:31:31 +0000 (0:00:00.142) 0:00:06.450 ********* 2026-04-28 06:31:37.249577 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:31:37.249588 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:31:37.249599 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:31:37.249610 | orchestrator | 2026-04-28 06:31:37.249621 | orchestrator | TASK [keystone : Check if Keystone domain-specific config is supplied] ********* 2026-04-28 06:31:37.249631 | orchestrator | Tuesday 28 April 2026 06:31:32 +0000 (0:00:00.335) 0:00:06.785 ********* 2026-04-28 06:31:37.249642 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 06:31:37.249653 | orchestrator | 2026-04-28 06:31:37.249663 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-28 06:31:37.249691 | orchestrator | Tuesday 28 April 2026 06:31:33 +0000 (0:00:01.220) 0:00:08.006 ********* 2026-04-28 06:31:37.249703 | orchestrator | included: /ansible/roles/keystone/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 06:31:37.249714 | orchestrator | 2026-04-28 06:31:37.249725 | orchestrator | TASK [service-cert-copy : keystone | Copying over extra CA certificates] ******* 2026-04-28 06:31:37.249736 | orchestrator | Tuesday 28 April 2026 06:31:34 +0000 (0:00:01.002) 0:00:09.008 ********* 2026-04-28 06:31:37.249752 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-28 06:31:37.249791 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-28 06:31:37.249824 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-28 06:31:37.249844 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 06:31:37.249857 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 06:31:37.249877 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 06:31:37.249891 | orchestrator | ok: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 06:31:37.249904 | orchestrator | ok: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 06:31:37.249917 | orchestrator | ok: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 06:31:37.249930 | orchestrator | 2026-04-28 06:31:37.249949 | orchestrator | TASK [service-cert-copy : keystone | Copying over backend internal TLS certificate] *** 2026-04-28 06:31:38.622640 | orchestrator | Tuesday 28 April 2026 06:31:37 +0000 (0:00:03.023) 0:00:12.032 ********* 2026-04-28 06:31:38.622774 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-28 06:31:38.622821 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 06:31:38.622835 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 06:31:38.622848 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:31:38.622861 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-28 06:31:38.622891 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 06:31:38.622904 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 06:31:38.622915 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:31:38.622932 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-28 06:31:38.622952 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 06:31:38.622963 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 06:31:38.622974 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:31:38.622985 | orchestrator | 2026-04-28 06:31:38.622997 | orchestrator | TASK [service-cert-copy : keystone | Copying over backend internal TLS key] **** 2026-04-28 06:31:38.623008 | orchestrator | Tuesday 28 April 2026 06:31:38 +0000 (0:00:01.038) 0:00:13.071 ********* 2026-04-28 06:31:38.623028 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-28 06:31:40.510183 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 06:31:40.510355 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 06:31:40.510375 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:31:40.510390 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-28 06:31:40.510404 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 06:31:40.510416 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 06:31:40.510427 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:31:40.510464 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-28 06:31:40.510485 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 06:31:40.510496 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 06:31:40.510507 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:31:40.510518 | orchestrator | 2026-04-28 06:31:40.510530 | orchestrator | TASK [keystone : Copying over config.json files for services] ****************** 2026-04-28 06:31:40.510542 | orchestrator | Tuesday 28 April 2026 06:31:39 +0000 (0:00:00.853) 0:00:13.924 ********* 2026-04-28 06:31:40.510554 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-28 06:31:40.510575 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-28 06:31:45.332072 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-28 06:31:45.332142 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 06:31:45.332148 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 06:31:45.332152 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 06:31:45.332157 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 06:31:45.332184 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 06:31:45.332192 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 06:31:45.332196 | orchestrator | 2026-04-28 06:31:45.332201 | orchestrator | TASK [keystone : Copying over keystone.conf] *********************************** 2026-04-28 06:31:45.332206 | orchestrator | Tuesday 28 April 2026 06:31:42 +0000 (0:00:03.363) 0:00:17.288 ********* 2026-04-28 06:31:45.332210 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-28 06:31:45.332215 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 06:31:45.332219 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-28 06:31:45.332233 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 06:31:51.130692 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-28 06:31:51.130803 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 06:31:51.130821 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 06:31:51.130834 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 06:31:51.130870 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 06:31:51.130884 | orchestrator | 2026-04-28 06:31:51.130898 | orchestrator | TASK [keystone : Copying keystone-startup script for keystone] ***************** 2026-04-28 06:31:51.130910 | orchestrator | Tuesday 28 April 2026 06:31:47 +0000 (0:00:05.326) 0:00:22.614 ********* 2026-04-28 06:31:51.130921 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:31:51.130933 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:31:51.130944 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:31:51.130954 | orchestrator | 2026-04-28 06:31:51.130980 | orchestrator | TASK [keystone : Create Keystone domain-specific config directory] ************* 2026-04-28 06:31:51.130992 | orchestrator | Tuesday 28 April 2026 06:31:49 +0000 (0:00:01.436) 0:00:24.051 ********* 2026-04-28 06:31:51.131002 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:31:51.131031 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:31:51.131043 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:31:51.131054 | orchestrator | 2026-04-28 06:31:51.131065 | orchestrator | TASK [keystone : Get file list in custom domains folder] *********************** 2026-04-28 06:31:51.131076 | orchestrator | Tuesday 28 April 2026 06:31:49 +0000 (0:00:00.578) 0:00:24.629 ********* 2026-04-28 06:31:51.131086 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:31:51.131097 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:31:51.131108 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:31:51.131118 | orchestrator | 2026-04-28 06:31:51.131129 | orchestrator | TASK [keystone : Copying Keystone Domain specific settings] ******************** 2026-04-28 06:31:51.131140 | orchestrator | Tuesday 28 April 2026 06:31:50 +0000 (0:00:00.321) 0:00:24.951 ********* 2026-04-28 06:31:51.131150 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:31:51.131161 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:31:51.131172 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:31:51.131182 | orchestrator | 2026-04-28 06:31:51.131193 | orchestrator | TASK [keystone : Copying over existing policy file] **************************** 2026-04-28 06:31:51.131204 | orchestrator | Tuesday 28 April 2026 06:31:50 +0000 (0:00:00.538) 0:00:25.490 ********* 2026-04-28 06:31:51.131217 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-28 06:31:51.131233 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 06:31:51.131282 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 06:31:51.131295 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:31:51.131324 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-28 06:32:09.210921 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 06:32:09.211049 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 06:32:09.211075 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:32:09.211094 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-28 06:32:09.211139 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 06:32:09.211155 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 06:32:09.211169 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:32:09.211184 | orchestrator | 2026-04-28 06:32:09.211214 | orchestrator | TASK [keystone : include_tasks] ************************************************ 2026-04-28 06:32:09.211279 | orchestrator | Tuesday 28 April 2026 06:31:51 +0000 (0:00:00.618) 0:00:26.108 ********* 2026-04-28 06:32:09.211297 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:32:09.211311 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:32:09.211324 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:32:09.211337 | orchestrator | 2026-04-28 06:32:09.211351 | orchestrator | TASK [keystone : Copying over wsgi-keystone.conf] ****************************** 2026-04-28 06:32:09.211383 | orchestrator | Tuesday 28 April 2026 06:31:51 +0000 (0:00:00.330) 0:00:26.438 ********* 2026-04-28 06:32:09.211399 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/keystone/templates/wsgi-keystone.conf.j2) 2026-04-28 06:32:09.211414 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/keystone/templates/wsgi-keystone.conf.j2) 2026-04-28 06:32:09.211427 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/keystone/templates/wsgi-keystone.conf.j2) 2026-04-28 06:32:09.211440 | orchestrator | 2026-04-28 06:32:09.211454 | orchestrator | TASK [keystone : Checking whether keystone-paste.ini file exists] ************** 2026-04-28 06:32:09.211468 | orchestrator | Tuesday 28 April 2026 06:31:53 +0000 (0:00:02.060) 0:00:28.498 ********* 2026-04-28 06:32:09.211482 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 06:32:09.211496 | orchestrator | 2026-04-28 06:32:09.211510 | orchestrator | TASK [keystone : Copying over keystone-paste.ini] ****************************** 2026-04-28 06:32:09.211523 | orchestrator | Tuesday 28 April 2026 06:31:54 +0000 (0:00:00.996) 0:00:29.495 ********* 2026-04-28 06:32:09.211537 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:32:09.211552 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:32:09.211567 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:32:09.211591 | orchestrator | 2026-04-28 06:32:09.211605 | orchestrator | TASK [keystone : Generate the required cron jobs for the node] ***************** 2026-04-28 06:32:09.211619 | orchestrator | Tuesday 28 April 2026 06:31:55 +0000 (0:00:00.584) 0:00:30.079 ********* 2026-04-28 06:32:09.211634 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-28 06:32:09.211648 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 06:32:09.211662 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-28 06:32:09.211676 | orchestrator | 2026-04-28 06:32:09.211689 | orchestrator | TASK [keystone : Set fact with the generated cron jobs for building the crontab later] *** 2026-04-28 06:32:09.211703 | orchestrator | Tuesday 28 April 2026 06:31:56 +0000 (0:00:01.106) 0:00:31.186 ********* 2026-04-28 06:32:09.211717 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:32:09.211731 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:32:09.211745 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:32:09.211758 | orchestrator | 2026-04-28 06:32:09.211771 | orchestrator | TASK [keystone : Copying files for keystone-fernet] **************************** 2026-04-28 06:32:09.211784 | orchestrator | Tuesday 28 April 2026 06:31:56 +0000 (0:00:00.312) 0:00:31.499 ********* 2026-04-28 06:32:09.211798 | orchestrator | ok: [testbed-node-0] => (item={'src': 'crontab.j2', 'dest': 'crontab'}) 2026-04-28 06:32:09.211811 | orchestrator | ok: [testbed-node-1] => (item={'src': 'crontab.j2', 'dest': 'crontab'}) 2026-04-28 06:32:09.211824 | orchestrator | ok: [testbed-node-2] => (item={'src': 'crontab.j2', 'dest': 'crontab'}) 2026-04-28 06:32:09.211837 | orchestrator | ok: [testbed-node-0] => (item={'src': 'fernet-rotate.sh.j2', 'dest': 'fernet-rotate.sh'}) 2026-04-28 06:32:09.211852 | orchestrator | ok: [testbed-node-1] => (item={'src': 'fernet-rotate.sh.j2', 'dest': 'fernet-rotate.sh'}) 2026-04-28 06:32:09.211865 | orchestrator | ok: [testbed-node-2] => (item={'src': 'fernet-rotate.sh.j2', 'dest': 'fernet-rotate.sh'}) 2026-04-28 06:32:09.211879 | orchestrator | ok: [testbed-node-0] => (item={'src': 'fernet-node-sync.sh.j2', 'dest': 'fernet-node-sync.sh'}) 2026-04-28 06:32:09.211892 | orchestrator | ok: [testbed-node-1] => (item={'src': 'fernet-node-sync.sh.j2', 'dest': 'fernet-node-sync.sh'}) 2026-04-28 06:32:09.211906 | orchestrator | ok: [testbed-node-2] => (item={'src': 'fernet-node-sync.sh.j2', 'dest': 'fernet-node-sync.sh'}) 2026-04-28 06:32:09.211919 | orchestrator | ok: [testbed-node-0] => (item={'src': 'fernet-push.sh.j2', 'dest': 'fernet-push.sh'}) 2026-04-28 06:32:09.211933 | orchestrator | ok: [testbed-node-1] => (item={'src': 'fernet-push.sh.j2', 'dest': 'fernet-push.sh'}) 2026-04-28 06:32:09.211946 | orchestrator | ok: [testbed-node-0] => (item={'src': 'fernet-healthcheck.sh.j2', 'dest': 'fernet-healthcheck.sh'}) 2026-04-28 06:32:09.211959 | orchestrator | ok: [testbed-node-1] => (item={'src': 'fernet-healthcheck.sh.j2', 'dest': 'fernet-healthcheck.sh'}) 2026-04-28 06:32:09.211972 | orchestrator | ok: [testbed-node-2] => (item={'src': 'fernet-push.sh.j2', 'dest': 'fernet-push.sh'}) 2026-04-28 06:32:09.211986 | orchestrator | ok: [testbed-node-0] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-28 06:32:09.211999 | orchestrator | ok: [testbed-node-1] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-28 06:32:09.212013 | orchestrator | ok: [testbed-node-2] => (item={'src': 'fernet-healthcheck.sh.j2', 'dest': 'fernet-healthcheck.sh'}) 2026-04-28 06:32:09.212027 | orchestrator | ok: [testbed-node-0] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-28 06:32:09.212040 | orchestrator | ok: [testbed-node-1] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-28 06:32:09.212053 | orchestrator | ok: [testbed-node-2] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-28 06:32:09.212066 | orchestrator | ok: [testbed-node-2] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-28 06:32:09.212079 | orchestrator | 2026-04-28 06:32:09.212093 | orchestrator | TASK [keystone : Copying files for keystone-ssh] ******************************* 2026-04-28 06:32:09.212106 | orchestrator | Tuesday 28 April 2026 06:32:06 +0000 (0:00:10.094) 0:00:41.594 ********* 2026-04-28 06:32:09.212126 | orchestrator | ok: [testbed-node-0] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-28 06:32:09.212148 | orchestrator | ok: [testbed-node-1] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-28 06:32:09.212162 | orchestrator | ok: [testbed-node-2] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-28 06:32:09.212175 | orchestrator | ok: [testbed-node-0] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-28 06:32:09.212197 | orchestrator | ok: [testbed-node-1] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-28 06:32:13.911947 | orchestrator | ok: [testbed-node-2] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-28 06:32:13.912057 | orchestrator | 2026-04-28 06:32:13.912073 | orchestrator | TASK [service-check-containers : keystone | Check containers] ****************** 2026-04-28 06:32:13.912086 | orchestrator | Tuesday 28 April 2026 06:32:09 +0000 (0:00:02.971) 0:00:44.565 ********* 2026-04-28 06:32:13.912102 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-28 06:32:13.912120 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-28 06:32:13.912134 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}}) 2026-04-28 06:32:13.912205 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 06:32:13.912219 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 06:32:13.912283 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}}) 2026-04-28 06:32:13.912306 | orchestrator | changed: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 06:32:13.912320 | orchestrator | changed: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 06:32:13.912331 | orchestrator | changed: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}}) 2026-04-28 06:32:13.912352 | orchestrator | 2026-04-28 06:32:13.912363 | orchestrator | TASK [service-check-containers : keystone | Notify handlers to restart containers] *** 2026-04-28 06:32:13.912374 | orchestrator | Tuesday 28 April 2026 06:32:13 +0000 (0:00:03.275) 0:00:47.840 ********* 2026-04-28 06:32:13.912385 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 06:32:13.912396 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 06:32:13.912407 | orchestrator | } 2026-04-28 06:32:13.912418 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 06:32:13.912429 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 06:32:13.912439 | orchestrator | } 2026-04-28 06:32:13.912450 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 06:32:13.912461 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 06:32:13.912544 | orchestrator | } 2026-04-28 06:32:13.912558 | orchestrator | 2026-04-28 06:32:13.912578 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 06:32:13.912591 | orchestrator | Tuesday 28 April 2026 06:32:13 +0000 (0:00:00.574) 0:00:48.415 ********* 2026-04-28 06:32:13.912617 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-28 06:34:12.680003 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 06:34:12.680126 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 06:34:12.680145 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:34:12.680239 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-28 06:34:12.680304 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 06:34:12.680317 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 06:34:12.680329 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:34:12.680362 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone', 'value': {'container_name': 'keystone', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:5000'], 'timeout': '30'}, 'haproxy': {'keystone_internal': {'enabled': True, 'mode': 'http', 'external': False, 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}, 'keystone_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'tls_backend': 'no', 'port': '5000', 'listen_port': '5000', 'backend_http_extra': ['balance roundrobin', 'option httpchk']}}}})  2026-04-28 06:34:12.680375 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-ssh', 'value': {'container_name': 'keystone_ssh', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8023'], 'timeout': '30'}}})  2026-04-28 06:34:12.680402 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'keystone-fernet', 'value': {'container_name': 'keystone_fernet', 'group': 'keystone', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328', 'volumes': ['/etc/kolla/keystone-fernet/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'keystone_fernet_tokens:/etc/keystone/fernet-keys'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', '/usr/bin/fernet-healthcheck.sh'], 'timeout': '30'}}})  2026-04-28 06:34:12.680445 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:34:12.680458 | orchestrator | 2026-04-28 06:34:12.680470 | orchestrator | TASK [keystone : Enable log_bin_trust_function_creators function] ************** 2026-04-28 06:34:12.680482 | orchestrator | Tuesday 28 April 2026 06:32:14 +0000 (0:00:01.206) 0:00:49.622 ********* 2026-04-28 06:34:12.680493 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:34:12.680504 | orchestrator | 2026-04-28 06:34:12.680515 | orchestrator | TASK [keystone : Init keystone database upgrade] ******************************* 2026-04-28 06:34:12.680526 | orchestrator | Tuesday 28 April 2026 06:32:16 +0000 (0:00:02.087) 0:00:51.710 ********* 2026-04-28 06:34:12.680537 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:34:12.680551 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:34:12.680563 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:34:12.680575 | orchestrator | 2026-04-28 06:34:12.680588 | orchestrator | TASK [keystone : Finish keystone database upgrade] ***************************** 2026-04-28 06:34:12.680600 | orchestrator | Tuesday 28 April 2026 06:32:17 +0000 (0:00:00.461) 0:00:52.172 ********* 2026-04-28 06:34:12.680612 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:34:12.680625 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:34:12.680637 | orchestrator | changed: [testbed-node-2] 2026-04-28 06:34:12.680650 | orchestrator | 2026-04-28 06:34:12.680668 | orchestrator | TASK [keystone : Flush handlers] *********************************************** 2026-04-28 06:34:12.680680 | orchestrator | Tuesday 28 April 2026 06:32:18 +0000 (0:00:00.889) 0:00:53.061 ********* 2026-04-28 06:34:12.680693 | orchestrator | 2026-04-28 06:34:12.680705 | orchestrator | TASK [keystone : Flush handlers] *********************************************** 2026-04-28 06:34:12.680717 | orchestrator | Tuesday 28 April 2026 06:32:18 +0000 (0:00:00.077) 0:00:53.138 ********* 2026-04-28 06:34:12.680730 | orchestrator | 2026-04-28 06:34:12.680742 | orchestrator | TASK [keystone : Flush handlers] *********************************************** 2026-04-28 06:34:12.680755 | orchestrator | Tuesday 28 April 2026 06:32:18 +0000 (0:00:00.075) 0:00:53.214 ********* 2026-04-28 06:34:12.680767 | orchestrator | 2026-04-28 06:34:12.680779 | orchestrator | RUNNING HANDLER [keystone : Init keystone database upgrade] ******************** 2026-04-28 06:34:12.680791 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-28 06:34:12.680804 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-28 06:34:12.680829 | orchestrator | Tuesday 28 April 2026 06:32:18 +0000 (0:00:00.089) 0:00:53.304 ********* 2026-04-28 06:34:12.680840 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:34:12.680852 | orchestrator | 2026-04-28 06:34:12.680865 | orchestrator | RUNNING HANDLER [keystone : Restart keystone-ssh container] ******************** 2026-04-28 06:34:12.680877 | orchestrator | Tuesday 28 April 2026 06:33:19 +0000 (0:01:00.486) 0:01:53.791 ********* 2026-04-28 06:34:12.680889 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:34:12.680900 | orchestrator | changed: [testbed-node-1] 2026-04-28 06:34:12.680910 | orchestrator | changed: [testbed-node-2] 2026-04-28 06:34:12.680921 | orchestrator | 2026-04-28 06:34:12.680931 | orchestrator | RUNNING HANDLER [keystone : Restart keystone-fernet container] ***************** 2026-04-28 06:34:12.680950 | orchestrator | Tuesday 28 April 2026 06:34:12 +0000 (0:00:53.661) 0:02:47.453 ********* 2026-04-28 06:34:52.536108 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:34:52.536277 | orchestrator | changed: [testbed-node-1] 2026-04-28 06:34:52.536293 | orchestrator | changed: [testbed-node-2] 2026-04-28 06:34:52.536305 | orchestrator | 2026-04-28 06:34:52.536317 | orchestrator | RUNNING HANDLER [keystone : Restart keystone container] ************************ 2026-04-28 06:34:52.536359 | orchestrator | Tuesday 28 April 2026 06:34:24 +0000 (0:00:11.661) 0:02:59.114 ********* 2026-04-28 06:34:52.536370 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:34:52.536388 | orchestrator | changed: [testbed-node-2] 2026-04-28 06:34:52.536408 | orchestrator | changed: [testbed-node-1] 2026-04-28 06:34:52.536426 | orchestrator | 2026-04-28 06:34:52.536446 | orchestrator | RUNNING HANDLER [keystone : Finish keystone database upgrade] ****************** 2026-04-28 06:34:52.536467 | orchestrator | Tuesday 28 April 2026 06:34:37 +0000 (0:00:12.781) 0:03:11.895 ********* 2026-04-28 06:34:52.536486 | orchestrator | changed: [testbed-node-2] 2026-04-28 06:34:52.536504 | orchestrator | 2026-04-28 06:34:52.536516 | orchestrator | TASK [keystone : Disable log_bin_trust_function_creators function] ************* 2026-04-28 06:34:52.536526 | orchestrator | Tuesday 28 April 2026 06:34:49 +0000 (0:00:12.064) 0:03:23.960 ********* 2026-04-28 06:34:52.536537 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:34:52.536547 | orchestrator | 2026-04-28 06:34:52.536558 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 06:34:52.536569 | orchestrator | testbed-node-0 : ok=25  changed=11  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-28 06:34:52.536582 | orchestrator | testbed-node-1 : ok=19  changed=7  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026-04-28 06:34:52.536593 | orchestrator | testbed-node-2 : ok=21  changed=9  unreachable=0 failed=0 skipped=11  rescued=0 ignored=0 2026-04-28 06:34:52.536603 | orchestrator | 2026-04-28 06:34:52.536614 | orchestrator | 2026-04-28 06:34:52.536625 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 06:34:52.536637 | orchestrator | Tuesday 28 April 2026 06:34:52 +0000 (0:00:02.880) 0:03:26.841 ********* 2026-04-28 06:34:52.536650 | orchestrator | =============================================================================== 2026-04-28 06:34:52.536661 | orchestrator | keystone : Init keystone database upgrade ------------------------------ 60.49s 2026-04-28 06:34:52.536673 | orchestrator | keystone : Restart keystone-ssh container ------------------------------ 53.66s 2026-04-28 06:34:52.536686 | orchestrator | keystone : Restart keystone container ---------------------------------- 12.78s 2026-04-28 06:34:52.536698 | orchestrator | keystone : Finish keystone database upgrade ---------------------------- 12.06s 2026-04-28 06:34:52.536710 | orchestrator | keystone : Restart keystone-fernet container --------------------------- 11.66s 2026-04-28 06:34:52.536722 | orchestrator | keystone : Copying files for keystone-fernet --------------------------- 10.09s 2026-04-28 06:34:52.536736 | orchestrator | keystone : Copying over keystone.conf ----------------------------------- 5.33s 2026-04-28 06:34:52.536748 | orchestrator | keystone : Copying over config.json files for services ------------------ 3.36s 2026-04-28 06:34:52.536760 | orchestrator | service-check-containers : keystone | Check containers ------------------ 3.27s 2026-04-28 06:34:52.536772 | orchestrator | service-cert-copy : keystone | Copying over extra CA certificates ------- 3.02s 2026-04-28 06:34:52.536784 | orchestrator | keystone : Copying files for keystone-ssh ------------------------------- 2.97s 2026-04-28 06:34:52.536797 | orchestrator | keystone : Disable log_bin_trust_function_creators function ------------- 2.88s 2026-04-28 06:34:52.536816 | orchestrator | keystone : Ensuring config directories exist ---------------------------- 2.53s 2026-04-28 06:34:52.536891 | orchestrator | keystone : Enable log_bin_trust_function_creators function -------------- 2.09s 2026-04-28 06:34:52.536912 | orchestrator | keystone : Copying over wsgi-keystone.conf ------------------------------ 2.06s 2026-04-28 06:34:52.536943 | orchestrator | keystone : Copying keystone-startup script for keystone ----------------- 1.44s 2026-04-28 06:34:52.536956 | orchestrator | keystone : Check if Keystone domain-specific config is supplied --------- 1.22s 2026-04-28 06:34:52.536968 | orchestrator | service-check-containers : Include tasks -------------------------------- 1.21s 2026-04-28 06:34:52.536980 | orchestrator | keystone : Generate the required cron jobs for the node ----------------- 1.11s 2026-04-28 06:34:52.537003 | orchestrator | keystone : include_tasks ------------------------------------------------ 1.08s 2026-04-28 06:34:52.775068 | orchestrator | + osism apply -a upgrade placement 2026-04-28 06:34:54.165744 | orchestrator | 2026-04-28 06:34:54 | INFO  | Prepare task for execution of placement. 2026-04-28 06:34:54.248177 | orchestrator | 2026-04-28 06:34:54 | INFO  | Task e7600a33-aa89-4532-9d6a-50572fd9171c (placement) was prepared for execution. 2026-04-28 06:34:54.248270 | orchestrator | 2026-04-28 06:34:54 | INFO  | It takes a moment until task e7600a33-aa89-4532-9d6a-50572fd9171c (placement) has been started and output is visible here. 2026-04-28 06:35:49.830655 | orchestrator | 2026-04-28 06:35:49.830774 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 06:35:49.830791 | orchestrator | 2026-04-28 06:35:49.830803 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 06:35:49.830815 | orchestrator | Tuesday 28 April 2026 06:34:59 +0000 (0:00:01.542) 0:00:01.542 ********* 2026-04-28 06:35:49.830826 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:35:49.830838 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:35:49.830849 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:35:49.830860 | orchestrator | 2026-04-28 06:35:49.830870 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 06:35:49.830881 | orchestrator | Tuesday 28 April 2026 06:35:01 +0000 (0:00:02.119) 0:00:03.661 ********* 2026-04-28 06:35:49.830892 | orchestrator | ok: [testbed-node-0] => (item=enable_placement_True) 2026-04-28 06:35:49.830903 | orchestrator | ok: [testbed-node-1] => (item=enable_placement_True) 2026-04-28 06:35:49.830914 | orchestrator | ok: [testbed-node-2] => (item=enable_placement_True) 2026-04-28 06:35:49.830925 | orchestrator | 2026-04-28 06:35:49.830936 | orchestrator | PLAY [Apply role placement] **************************************************** 2026-04-28 06:35:49.830947 | orchestrator | 2026-04-28 06:35:49.830958 | orchestrator | TASK [placement : include_tasks] *********************************************** 2026-04-28 06:35:49.830968 | orchestrator | Tuesday 28 April 2026 06:35:03 +0000 (0:00:02.572) 0:00:06.233 ********* 2026-04-28 06:35:49.830980 | orchestrator | included: /ansible/roles/placement/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 06:35:49.830991 | orchestrator | 2026-04-28 06:35:49.831002 | orchestrator | TASK [service-ks-register : placement | Creating/deleting services] ************ 2026-04-28 06:35:49.831012 | orchestrator | Tuesday 28 April 2026 06:35:07 +0000 (0:00:03.287) 0:00:09.521 ********* 2026-04-28 06:35:49.831023 | orchestrator | ok: [testbed-node-0] => (item=placement (placement)) 2026-04-28 06:35:49.831034 | orchestrator | 2026-04-28 06:35:49.831044 | orchestrator | TASK [service-ks-register : placement | Creating/deleting endpoints] *********** 2026-04-28 06:35:49.831061 | orchestrator | Tuesday 28 April 2026 06:35:12 +0000 (0:00:05.279) 0:00:14.801 ********* 2026-04-28 06:35:49.831137 | orchestrator | ok: [testbed-node-0] => (item=placement -> https://api-int.testbed.osism.xyz:8780 -> internal) 2026-04-28 06:35:49.831162 | orchestrator | ok: [testbed-node-0] => (item=placement -> https://api.testbed.osism.xyz:8780 -> public) 2026-04-28 06:35:49.831180 | orchestrator | 2026-04-28 06:35:49.831199 | orchestrator | TASK [service-ks-register : placement | Creating projects] ********************* 2026-04-28 06:35:49.831217 | orchestrator | Tuesday 28 April 2026 06:35:20 +0000 (0:00:07.624) 0:00:22.425 ********* 2026-04-28 06:35:49.831237 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-28 06:35:49.831256 | orchestrator | 2026-04-28 06:35:49.831275 | orchestrator | TASK [service-ks-register : placement | Creating users] ************************ 2026-04-28 06:35:49.831287 | orchestrator | Tuesday 28 April 2026 06:35:24 +0000 (0:00:04.422) 0:00:26.848 ********* 2026-04-28 06:35:49.831298 | orchestrator | changed: [testbed-node-0] => (item=placement -> service) 2026-04-28 06:35:49.831309 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-28 06:35:49.831319 | orchestrator | 2026-04-28 06:35:49.831330 | orchestrator | TASK [service-ks-register : placement | Creating roles] ************************ 2026-04-28 06:35:49.831368 | orchestrator | Tuesday 28 April 2026 06:35:30 +0000 (0:00:06.467) 0:00:33.315 ********* 2026-04-28 06:35:49.831380 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-28 06:35:49.831391 | orchestrator | 2026-04-28 06:35:49.831402 | orchestrator | TASK [service-ks-register : placement | Granting/revoking user roles] ********** 2026-04-28 06:35:49.831413 | orchestrator | Tuesday 28 April 2026 06:35:35 +0000 (0:00:04.354) 0:00:37.670 ********* 2026-04-28 06:35:49.831424 | orchestrator | ok: [testbed-node-0] => (item=placement -> service -> admin) 2026-04-28 06:35:49.831434 | orchestrator | 2026-04-28 06:35:49.831445 | orchestrator | TASK [placement : include_tasks] *********************************************** 2026-04-28 06:35:49.831455 | orchestrator | Tuesday 28 April 2026 06:35:40 +0000 (0:00:05.040) 0:00:42.710 ********* 2026-04-28 06:35:49.831466 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:35:49.831477 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:35:49.831487 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:35:49.831498 | orchestrator | 2026-04-28 06:35:49.831508 | orchestrator | TASK [placement : Ensuring config directories exist] *************************** 2026-04-28 06:35:49.831519 | orchestrator | Tuesday 28 April 2026 06:35:42 +0000 (0:00:01.732) 0:00:44.443 ********* 2026-04-28 06:35:49.831570 | orchestrator | ok: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 06:35:49.831588 | orchestrator | ok: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 06:35:49.831601 | orchestrator | ok: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 06:35:49.831622 | orchestrator | 2026-04-28 06:35:49.831633 | orchestrator | TASK [placement : Check if policies shall be overwritten] ********************** 2026-04-28 06:35:49.831644 | orchestrator | Tuesday 28 April 2026 06:35:44 +0000 (0:00:02.251) 0:00:46.695 ********* 2026-04-28 06:35:49.831654 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:35:49.831665 | orchestrator | 2026-04-28 06:35:49.831676 | orchestrator | TASK [placement : Set placement policy file] *********************************** 2026-04-28 06:35:49.831686 | orchestrator | Tuesday 28 April 2026 06:35:45 +0000 (0:00:01.144) 0:00:47.839 ********* 2026-04-28 06:35:49.831697 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:35:49.831708 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:35:49.831718 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:35:49.831729 | orchestrator | 2026-04-28 06:35:49.831740 | orchestrator | TASK [placement : include_tasks] *********************************************** 2026-04-28 06:35:49.831750 | orchestrator | Tuesday 28 April 2026 06:35:46 +0000 (0:00:01.339) 0:00:49.179 ********* 2026-04-28 06:35:49.831761 | orchestrator | included: /ansible/roles/placement/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 06:35:49.831772 | orchestrator | 2026-04-28 06:35:49.831782 | orchestrator | TASK [service-cert-copy : placement | Copying over extra CA certificates] ****** 2026-04-28 06:35:49.831793 | orchestrator | Tuesday 28 April 2026 06:35:48 +0000 (0:00:01.868) 0:00:51.047 ********* 2026-04-28 06:35:49.831815 | orchestrator | ok: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 06:35:53.172456 | orchestrator | ok: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 06:35:53.172562 | orchestrator | ok: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 06:35:53.172608 | orchestrator | 2026-04-28 06:35:53.172622 | orchestrator | TASK [service-cert-copy : placement | Copying over backend internal TLS certificate] *** 2026-04-28 06:35:53.172635 | orchestrator | Tuesday 28 April 2026 06:35:51 +0000 (0:00:02.346) 0:00:53.394 ********* 2026-04-28 06:35:53.172662 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 06:35:53.172677 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:35:53.172722 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 06:35:53.172753 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:35:53.172776 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 06:35:53.172808 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:35:53.172827 | orchestrator | 2026-04-28 06:35:53.172844 | orchestrator | TASK [service-cert-copy : placement | Copying over backend internal TLS key] *** 2026-04-28 06:35:53.172862 | orchestrator | Tuesday 28 April 2026 06:35:52 +0000 (0:00:01.728) 0:00:55.122 ********* 2026-04-28 06:35:53.172881 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 06:35:53.172901 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:35:53.172930 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 06:35:53.172946 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:35:53.172972 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 06:36:08.589902 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:36:08.590118 | orchestrator | 2026-04-28 06:36:08.590143 | orchestrator | TASK [placement : Copying over config.json files for services] ***************** 2026-04-28 06:36:08.590158 | orchestrator | Tuesday 28 April 2026 06:35:54 +0000 (0:00:01.524) 0:00:56.647 ********* 2026-04-28 06:36:08.590174 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 06:36:08.590191 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 06:36:08.590220 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 06:36:08.590234 | orchestrator | 2026-04-28 06:36:08.590245 | orchestrator | TASK [placement : Copying over placement.conf] ********************************* 2026-04-28 06:36:08.590256 | orchestrator | Tuesday 28 April 2026 06:35:56 +0000 (0:00:02.438) 0:00:59.086 ********* 2026-04-28 06:36:08.590287 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 06:36:08.590323 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 06:36:08.590342 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 06:36:08.590354 | orchestrator | 2026-04-28 06:36:08.590365 | orchestrator | TASK [placement : Copying over placement-api wsgi configuration] *************** 2026-04-28 06:36:08.590376 | orchestrator | Tuesday 28 April 2026 06:36:00 +0000 (0:00:03.782) 0:01:02.868 ********* 2026-04-28 06:36:08.590387 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/placement/templates/placement-api-wsgi.conf.j2)  2026-04-28 06:36:08.590399 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:36:08.590410 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/placement/templates/placement-api-wsgi.conf.j2)  2026-04-28 06:36:08.590421 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:36:08.590432 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/placement/templates/placement-api-wsgi.conf.j2)  2026-04-28 06:36:08.590445 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:36:08.590466 | orchestrator | 2026-04-28 06:36:08.590479 | orchestrator | TASK [Configure uWSGI for Placement] ******************************************* 2026-04-28 06:36:08.590492 | orchestrator | Tuesday 28 April 2026 06:36:02 +0000 (0:00:01.659) 0:01:04.527 ********* 2026-04-28 06:36:08.590505 | orchestrator | included: service-uwsgi-config for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 06:36:08.590519 | orchestrator | 2026-04-28 06:36:08.590531 | orchestrator | TASK [service-uwsgi-config : Copying over placement-api uWSGI config] ********** 2026-04-28 06:36:08.590543 | orchestrator | Tuesday 28 April 2026 06:36:04 +0000 (0:00:02.006) 0:01:06.534 ********* 2026-04-28 06:36:08.590556 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:36:08.590569 | orchestrator | changed: [testbed-node-1] 2026-04-28 06:36:08.590582 | orchestrator | changed: [testbed-node-2] 2026-04-28 06:36:08.590594 | orchestrator | 2026-04-28 06:36:08.590608 | orchestrator | TASK [placement : Copying over migrate-db.rc.j2 configuration] ***************** 2026-04-28 06:36:08.590627 | orchestrator | Tuesday 28 April 2026 06:36:07 +0000 (0:00:03.022) 0:01:09.556 ********* 2026-04-28 06:36:08.590644 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:36:08.590661 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:36:08.590680 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:36:08.590698 | orchestrator | 2026-04-28 06:36:08.590726 | orchestrator | TASK [placement : Copying over existing policy file] *************************** 2026-04-28 06:36:15.961560 | orchestrator | Tuesday 28 April 2026 06:36:09 +0000 (0:00:02.468) 0:01:12.025 ********* 2026-04-28 06:36:15.961673 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 06:36:15.961695 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:36:15.961709 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 06:36:15.961721 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:36:15.961749 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 06:36:15.961784 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:36:15.961797 | orchestrator | 2026-04-28 06:36:15.961808 | orchestrator | TASK [service-check-containers : placement | Check containers] ***************** 2026-04-28 06:36:15.961819 | orchestrator | Tuesday 28 April 2026 06:36:11 +0000 (0:00:02.197) 0:01:14.223 ********* 2026-04-28 06:36:15.961850 | orchestrator | changed: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 06:36:15.961864 | orchestrator | changed: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 06:36:15.961882 | orchestrator | changed: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 06:36:15.961905 | orchestrator | 2026-04-28 06:36:15.961916 | orchestrator | TASK [service-check-containers : placement | Notify handlers to restart containers] *** 2026-04-28 06:36:15.961928 | orchestrator | Tuesday 28 April 2026 06:36:14 +0000 (0:00:02.415) 0:01:16.639 ********* 2026-04-28 06:36:15.961940 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 06:36:15.961951 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 06:36:15.961962 | orchestrator | } 2026-04-28 06:36:15.961973 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 06:36:15.961984 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 06:36:15.961994 | orchestrator | } 2026-04-28 06:36:15.962005 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 06:36:15.962101 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 06:36:15.962116 | orchestrator | } 2026-04-28 06:36:15.962130 | orchestrator | 2026-04-28 06:36:15.962143 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 06:36:15.962155 | orchestrator | Tuesday 28 April 2026 06:36:15 +0000 (0:00:01.478) 0:01:18.117 ********* 2026-04-28 06:36:15.962179 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 06:37:05.935751 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:37:05.935875 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 06:37:05.935896 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:37:05.935926 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'placement-api', 'value': {'container_name': 'placement_api', 'group': 'placement-api', 'image': 'registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328', 'enabled': True, 'volumes': ['/etc/kolla/placement-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8780'], 'timeout': '30'}, 'wsgi': 'placement.wsgi.api:application', 'haproxy': {'placement_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'placement_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8780', 'listen_port': '8780', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 06:37:05.935961 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:37:05.935974 | orchestrator | 2026-04-28 06:37:05.935985 | orchestrator | TASK [placement : Creating placement databases] ******************************** 2026-04-28 06:37:05.935997 | orchestrator | Tuesday 28 April 2026 06:36:17 +0000 (0:00:02.174) 0:01:20.292 ********* 2026-04-28 06:37:05.936008 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:37:05.936019 | orchestrator | 2026-04-28 06:37:05.936101 | orchestrator | TASK [placement : Creating placement databases user and setting permissions] *** 2026-04-28 06:37:05.936115 | orchestrator | Tuesday 28 April 2026 06:36:20 +0000 (0:00:02.966) 0:01:23.259 ********* 2026-04-28 06:37:05.936126 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:37:05.936136 | orchestrator | 2026-04-28 06:37:05.936147 | orchestrator | TASK [placement : Running placement bootstrap container] *********************** 2026-04-28 06:37:05.936158 | orchestrator | Tuesday 28 April 2026 06:36:24 +0000 (0:00:03.635) 0:01:26.895 ********* 2026-04-28 06:37:05.936169 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:37:05.936180 | orchestrator | 2026-04-28 06:37:05.936191 | orchestrator | TASK [placement : Flush handlers] ********************************************** 2026-04-28 06:37:05.936202 | orchestrator | Tuesday 28 April 2026 06:36:39 +0000 (0:00:14.803) 0:01:41.698 ********* 2026-04-28 06:37:05.936213 | orchestrator | 2026-04-28 06:37:05.936223 | orchestrator | TASK [placement : Flush handlers] ********************************************** 2026-04-28 06:37:05.936234 | orchestrator | Tuesday 28 April 2026 06:36:39 +0000 (0:00:00.497) 0:01:42.195 ********* 2026-04-28 06:37:05.936244 | orchestrator | 2026-04-28 06:37:05.936255 | orchestrator | TASK [placement : Flush handlers] ********************************************** 2026-04-28 06:37:05.936266 | orchestrator | Tuesday 28 April 2026 06:36:40 +0000 (0:00:00.520) 0:01:42.716 ********* 2026-04-28 06:37:05.936276 | orchestrator | 2026-04-28 06:37:05.936287 | orchestrator | RUNNING HANDLER [placement : Restart placement-api container] ****************** 2026-04-28 06:37:05.936300 | orchestrator | Tuesday 28 April 2026 06:36:41 +0000 (0:00:00.790) 0:01:43.507 ********* 2026-04-28 06:37:05.936312 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:37:05.936325 | orchestrator | changed: [testbed-node-1] 2026-04-28 06:37:05.936337 | orchestrator | changed: [testbed-node-2] 2026-04-28 06:37:05.936350 | orchestrator | 2026-04-28 06:37:05.936362 | orchestrator | TASK [placement : Perform Placement online data migration] ********************* 2026-04-28 06:37:05.936375 | orchestrator | Tuesday 28 April 2026 06:36:53 +0000 (0:00:12.779) 0:01:56.287 ********* 2026-04-28 06:37:05.936388 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:37:05.936401 | orchestrator | 2026-04-28 06:37:05.936413 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 06:37:05.936427 | orchestrator | testbed-node-0 : ok=24  changed=9  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2026-04-28 06:37:05.936460 | orchestrator | testbed-node-1 : ok=14  changed=6  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-28 06:37:05.936473 | orchestrator | testbed-node-2 : ok=14  changed=6  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-28 06:37:05.936486 | orchestrator | 2026-04-28 06:37:05.936498 | orchestrator | 2026-04-28 06:37:05.936510 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 06:37:05.936522 | orchestrator | Tuesday 28 April 2026 06:37:05 +0000 (0:00:11.709) 0:02:07.996 ********* 2026-04-28 06:37:05.936544 | orchestrator | =============================================================================== 2026-04-28 06:37:05.936557 | orchestrator | placement : Running placement bootstrap container ---------------------- 14.80s 2026-04-28 06:37:05.936569 | orchestrator | placement : Restart placement-api container ---------------------------- 12.78s 2026-04-28 06:37:05.936582 | orchestrator | placement : Perform Placement online data migration -------------------- 11.71s 2026-04-28 06:37:05.936594 | orchestrator | service-ks-register : placement | Creating/deleting endpoints ----------- 7.62s 2026-04-28 06:37:05.936607 | orchestrator | service-ks-register : placement | Creating users ------------------------ 6.47s 2026-04-28 06:37:05.936619 | orchestrator | service-ks-register : placement | Creating/deleting services ------------ 5.28s 2026-04-28 06:37:05.936632 | orchestrator | service-ks-register : placement | Granting/revoking user roles ---------- 5.04s 2026-04-28 06:37:05.936645 | orchestrator | service-ks-register : placement | Creating projects --------------------- 4.42s 2026-04-28 06:37:05.936656 | orchestrator | service-ks-register : placement | Creating roles ------------------------ 4.35s 2026-04-28 06:37:05.936667 | orchestrator | placement : Copying over placement.conf --------------------------------- 3.78s 2026-04-28 06:37:05.936677 | orchestrator | placement : Creating placement databases user and setting permissions --- 3.64s 2026-04-28 06:37:05.936688 | orchestrator | placement : include_tasks ----------------------------------------------- 3.29s 2026-04-28 06:37:05.936698 | orchestrator | service-uwsgi-config : Copying over placement-api uWSGI config ---------- 3.02s 2026-04-28 06:37:05.936709 | orchestrator | placement : Creating placement databases -------------------------------- 2.97s 2026-04-28 06:37:05.936720 | orchestrator | Group hosts based on enabled services ----------------------------------- 2.57s 2026-04-28 06:37:05.936730 | orchestrator | placement : Copying over migrate-db.rc.j2 configuration ----------------- 2.47s 2026-04-28 06:37:05.936741 | orchestrator | placement : Copying over config.json files for services ----------------- 2.44s 2026-04-28 06:37:05.936751 | orchestrator | service-check-containers : placement | Check containers ----------------- 2.42s 2026-04-28 06:37:05.936762 | orchestrator | service-cert-copy : placement | Copying over extra CA certificates ------ 2.35s 2026-04-28 06:37:05.936773 | orchestrator | placement : Ensuring config directories exist --------------------------- 2.25s 2026-04-28 06:37:06.151301 | orchestrator | + osism apply -a upgrade neutron 2026-04-28 06:37:07.436329 | orchestrator | 2026-04-28 06:37:07 | INFO  | Prepare task for execution of neutron. 2026-04-28 06:37:07.498171 | orchestrator | 2026-04-28 06:37:07 | INFO  | Task 0c3db3c9-563f-456b-b2bc-fade16261bc9 (neutron) was prepared for execution. 2026-04-28 06:37:07.498265 | orchestrator | 2026-04-28 06:37:07 | INFO  | It takes a moment until task 0c3db3c9-563f-456b-b2bc-fade16261bc9 (neutron) has been started and output is visible here. 2026-04-28 06:37:46.614294 | orchestrator | 2026-04-28 06:37:46.614396 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 06:37:46.614410 | orchestrator | 2026-04-28 06:37:46.614420 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 06:37:46.614429 | orchestrator | Tuesday 28 April 2026 06:37:12 +0000 (0:00:01.662) 0:00:01.662 ********* 2026-04-28 06:37:46.614438 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:37:46.614447 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:37:46.614456 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:37:46.614465 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:37:46.614473 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:37:46.614482 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:37:46.614490 | orchestrator | 2026-04-28 06:37:46.614499 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 06:37:46.614508 | orchestrator | Tuesday 28 April 2026 06:37:14 +0000 (0:00:02.435) 0:00:04.097 ********* 2026-04-28 06:37:46.614516 | orchestrator | ok: [testbed-node-0] => (item=enable_neutron_True) 2026-04-28 06:37:46.614526 | orchestrator | ok: [testbed-node-1] => (item=enable_neutron_True) 2026-04-28 06:37:46.614557 | orchestrator | ok: [testbed-node-2] => (item=enable_neutron_True) 2026-04-28 06:37:46.614566 | orchestrator | ok: [testbed-node-3] => (item=enable_neutron_True) 2026-04-28 06:37:46.614574 | orchestrator | ok: [testbed-node-4] => (item=enable_neutron_True) 2026-04-28 06:37:46.614583 | orchestrator | ok: [testbed-node-5] => (item=enable_neutron_True) 2026-04-28 06:37:46.614591 | orchestrator | 2026-04-28 06:37:46.614600 | orchestrator | PLAY [Apply role neutron] ****************************************************** 2026-04-28 06:37:46.614608 | orchestrator | 2026-04-28 06:37:46.614617 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-28 06:37:46.614626 | orchestrator | Tuesday 28 April 2026 06:37:17 +0000 (0:00:02.430) 0:00:06.527 ********* 2026-04-28 06:37:46.614635 | orchestrator | included: /ansible/roles/neutron/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 06:37:46.614645 | orchestrator | 2026-04-28 06:37:46.614653 | orchestrator | TASK [neutron : Get container facts] ******************************************* 2026-04-28 06:37:46.614662 | orchestrator | Tuesday 28 April 2026 06:37:22 +0000 (0:00:04.713) 0:00:11.241 ********* 2026-04-28 06:37:46.614670 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:37:46.614679 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:37:46.614687 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:37:46.614696 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:37:46.614705 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:37:46.614713 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:37:46.614722 | orchestrator | 2026-04-28 06:37:46.614730 | orchestrator | TASK [neutron : Get container volume facts] ************************************ 2026-04-28 06:37:46.614739 | orchestrator | Tuesday 28 April 2026 06:37:25 +0000 (0:00:03.021) 0:00:14.262 ********* 2026-04-28 06:37:46.614747 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:37:46.614756 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:37:46.614764 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:37:46.614772 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:37:46.614781 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:37:46.614789 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:37:46.614797 | orchestrator | 2026-04-28 06:37:46.614806 | orchestrator | TASK [neutron : Check for ML2/OVN presence] ************************************ 2026-04-28 06:37:46.614814 | orchestrator | Tuesday 28 April 2026 06:37:27 +0000 (0:00:02.478) 0:00:16.741 ********* 2026-04-28 06:37:46.614837 | orchestrator | ok: [testbed-node-0] => { 2026-04-28 06:37:46.614856 | orchestrator |  "changed": false, 2026-04-28 06:37:46.614867 | orchestrator |  "msg": "All assertions passed" 2026-04-28 06:37:46.614877 | orchestrator | } 2026-04-28 06:37:46.614888 | orchestrator | ok: [testbed-node-1] => { 2026-04-28 06:37:46.614898 | orchestrator |  "changed": false, 2026-04-28 06:37:46.614908 | orchestrator |  "msg": "All assertions passed" 2026-04-28 06:37:46.614917 | orchestrator | } 2026-04-28 06:37:46.614927 | orchestrator | ok: [testbed-node-2] => { 2026-04-28 06:37:46.614937 | orchestrator |  "changed": false, 2026-04-28 06:37:46.614946 | orchestrator |  "msg": "All assertions passed" 2026-04-28 06:37:46.614956 | orchestrator | } 2026-04-28 06:37:46.614966 | orchestrator | ok: [testbed-node-3] => { 2026-04-28 06:37:46.614976 | orchestrator |  "changed": false, 2026-04-28 06:37:46.614986 | orchestrator |  "msg": "All assertions passed" 2026-04-28 06:37:46.614996 | orchestrator | } 2026-04-28 06:37:46.615034 | orchestrator | ok: [testbed-node-4] => { 2026-04-28 06:37:46.615044 | orchestrator |  "changed": false, 2026-04-28 06:37:46.615054 | orchestrator |  "msg": "All assertions passed" 2026-04-28 06:37:46.615064 | orchestrator | } 2026-04-28 06:37:46.615073 | orchestrator | ok: [testbed-node-5] => { 2026-04-28 06:37:46.615084 | orchestrator |  "changed": false, 2026-04-28 06:37:46.615094 | orchestrator |  "msg": "All assertions passed" 2026-04-28 06:37:46.615104 | orchestrator | } 2026-04-28 06:37:46.615113 | orchestrator | 2026-04-28 06:37:46.615123 | orchestrator | TASK [neutron : Check for ML2/OVS presence] ************************************ 2026-04-28 06:37:46.615133 | orchestrator | Tuesday 28 April 2026 06:37:29 +0000 (0:00:01.794) 0:00:18.536 ********* 2026-04-28 06:37:46.615151 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:37:46.615160 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:37:46.615170 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:37:46.615180 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:37:46.615189 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:37:46.615197 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:37:46.615205 | orchestrator | 2026-04-28 06:37:46.615214 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-28 06:37:46.615223 | orchestrator | Tuesday 28 April 2026 06:37:31 +0000 (0:00:02.116) 0:00:20.652 ********* 2026-04-28 06:37:46.615244 | orchestrator | included: /ansible/roles/neutron/tasks/rolling_upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 06:37:46.615254 | orchestrator | 2026-04-28 06:37:46.615263 | orchestrator | TASK [Load and persist kernel modules] ***************************************** 2026-04-28 06:37:46.615272 | orchestrator | Tuesday 28 April 2026 06:37:34 +0000 (0:00:02.557) 0:00:23.210 ********* 2026-04-28 06:37:46.615280 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:37:46.615288 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:37:46.615297 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:37:46.615306 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:37:46.615328 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:37:46.615337 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:37:46.615346 | orchestrator | 2026-04-28 06:37:46.615355 | orchestrator | TASK [neutron : Check IPv6 support] ******************************************** 2026-04-28 06:37:46.615363 | orchestrator | Tuesday 28 April 2026 06:37:37 +0000 (0:00:03.500) 0:00:26.710 ********* 2026-04-28 06:37:46.615372 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:37:46.615380 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:37:46.615389 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:37:46.615397 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:37:46.615405 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:37:46.615413 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:37:46.615422 | orchestrator | 2026-04-28 06:37:46.615431 | orchestrator | TASK [Setting sysctl values] *************************************************** 2026-04-28 06:37:46.615439 | orchestrator | Tuesday 28 April 2026 06:37:40 +0000 (0:00:02.968) 0:00:29.679 ********* 2026-04-28 06:37:46.615448 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:37:46.615456 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:37:46.615465 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:37:46.615473 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:37:46.615481 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:37:46.615490 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:37:46.615498 | orchestrator | 2026-04-28 06:37:46.615507 | orchestrator | TASK [neutron : Ensuring config directories exist] ***************************** 2026-04-28 06:37:46.615515 | orchestrator | Tuesday 28 April 2026 06:37:44 +0000 (0:00:03.734) 0:00:33.414 ********* 2026-04-28 06:37:46.615528 | orchestrator | ok: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:37:46.615547 | orchestrator | ok: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:37:46.615563 | orchestrator | ok: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 06:37:46.615582 | orchestrator | ok: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 06:37:56.285633 | orchestrator | ok: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:37:56.285771 | orchestrator | ok: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 06:37:56.285831 | orchestrator | 2026-04-28 06:37:56.285854 | orchestrator | TASK [neutron : Check if extra ml2 plugins exists] ***************************** 2026-04-28 06:37:56.285874 | orchestrator | Tuesday 28 April 2026 06:37:48 +0000 (0:00:04.213) 0:00:37.627 ********* 2026-04-28 06:37:56.285892 | orchestrator | [WARNING]: Skipped 2026-04-28 06:37:56.285912 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/neutron/plugins/' path 2026-04-28 06:37:56.285933 | orchestrator | due to this access issue: 2026-04-28 06:37:56.285953 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/neutron/plugins/' is not 2026-04-28 06:37:56.285971 | orchestrator | a directory 2026-04-28 06:37:56.285989 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 06:37:56.286115 | orchestrator | 2026-04-28 06:37:56.286136 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-28 06:37:56.286155 | orchestrator | Tuesday 28 April 2026 06:37:50 +0000 (0:00:02.253) 0:00:39.880 ********* 2026-04-28 06:37:56.286176 | orchestrator | included: /ansible/roles/neutron/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 06:37:56.286196 | orchestrator | 2026-04-28 06:37:56.286215 | orchestrator | TASK [service-cert-copy : neutron | Copying over extra CA certificates] ******** 2026-04-28 06:37:56.286233 | orchestrator | Tuesday 28 April 2026 06:37:53 +0000 (0:00:02.750) 0:00:42.631 ********* 2026-04-28 06:37:56.286272 | orchestrator | ok: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:37:56.286322 | orchestrator | ok: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:37:56.286345 | orchestrator | ok: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:37:56.286381 | orchestrator | ok: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 06:37:56.286401 | orchestrator | ok: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 06:37:56.286426 | orchestrator | ok: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 06:37:56.286445 | orchestrator | 2026-04-28 06:37:56.286474 | orchestrator | TASK [service-cert-copy : neutron | Copying over backend internal TLS certificate] *** 2026-04-28 06:38:02.708773 | orchestrator | Tuesday 28 April 2026 06:37:57 +0000 (0:00:03.762) 0:00:46.393 ********* 2026-04-28 06:38:02.708916 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:38:02.708969 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:38:02.708985 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:38:02.709047 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:38:02.709062 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:38:02.709076 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:38:02.709103 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:38:02.709116 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:38:02.709148 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:38:02.709170 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:38:02.709181 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:38:02.709193 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:38:02.709204 | orchestrator | 2026-04-28 06:38:02.709216 | orchestrator | TASK [service-cert-copy : neutron | Copying over backend internal TLS key] ***** 2026-04-28 06:38:02.709227 | orchestrator | Tuesday 28 April 2026 06:38:00 +0000 (0:00:03.730) 0:00:50.124 ********* 2026-04-28 06:38:02.709239 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:38:02.709251 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:38:02.709268 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:38:02.709282 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:38:02.709304 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:38:13.426432 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:38:13.426550 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:38:13.426570 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:38:13.426583 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:38:13.426595 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:38:13.426624 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:38:13.426636 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:38:13.426647 | orchestrator | 2026-04-28 06:38:13.426659 | orchestrator | TASK [neutron : Creating TLS backend PEM File] ********************************* 2026-04-28 06:38:13.426671 | orchestrator | Tuesday 28 April 2026 06:38:04 +0000 (0:00:03.779) 0:00:53.904 ********* 2026-04-28 06:38:13.426682 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:38:13.426693 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:38:13.426703 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:38:13.426714 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:38:13.426725 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:38:13.426758 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:38:13.426769 | orchestrator | 2026-04-28 06:38:13.426780 | orchestrator | TASK [neutron : Check if policies shall be overwritten] ************************ 2026-04-28 06:38:13.426791 | orchestrator | Tuesday 28 April 2026 06:38:08 +0000 (0:00:03.388) 0:00:57.292 ********* 2026-04-28 06:38:13.426802 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:38:13.426812 | orchestrator | 2026-04-28 06:38:13.426823 | orchestrator | TASK [neutron : Set neutron policy file] *************************************** 2026-04-28 06:38:13.426834 | orchestrator | Tuesday 28 April 2026 06:38:09 +0000 (0:00:01.101) 0:00:58.395 ********* 2026-04-28 06:38:13.426844 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:38:13.426855 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:38:13.426866 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:38:13.426876 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:38:13.426887 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:38:13.426897 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:38:13.426908 | orchestrator | 2026-04-28 06:38:13.426918 | orchestrator | TASK [neutron : Copying over existing policy file] ***************************** 2026-04-28 06:38:13.426929 | orchestrator | Tuesday 28 April 2026 06:38:11 +0000 (0:00:01.982) 0:01:00.377 ********* 2026-04-28 06:38:13.426959 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:38:13.426975 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:38:13.427015 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:38:13.427036 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:38:13.427061 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:38:13.427099 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:38:13.427122 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:38:13.427141 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:38:13.427174 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:38:23.237365 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:38:23.237429 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:38:23.237440 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:38:23.237446 | orchestrator | 2026-04-28 06:38:23.237453 | orchestrator | TASK [neutron : Copying over config.json files for services] ******************* 2026-04-28 06:38:23.237459 | orchestrator | Tuesday 28 April 2026 06:38:14 +0000 (0:00:03.382) 0:01:03.760 ********* 2026-04-28 06:38:23.237467 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:38:23.237498 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:38:23.237506 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:38:23.237524 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 06:38:23.237531 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 06:38:23.237545 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 06:38:23.237551 | orchestrator | 2026-04-28 06:38:23.237557 | orchestrator | TASK [neutron : Copying over neutron.conf] ************************************* 2026-04-28 06:38:23.237563 | orchestrator | Tuesday 28 April 2026 06:38:18 +0000 (0:00:04.187) 0:01:07.947 ********* 2026-04-28 06:38:23.237569 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 06:38:23.237580 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:38:27.052524 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:38:27.052637 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:38:27.052684 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 06:38:27.052699 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 06:38:27.052712 | orchestrator | 2026-04-28 06:38:27.052725 | orchestrator | TASK [neutron : Copying over neutron_vpnaas.conf] ****************************** 2026-04-28 06:38:27.052738 | orchestrator | Tuesday 28 April 2026 06:38:25 +0000 (0:00:06.367) 0:01:14.315 ********* 2026-04-28 06:38:27.052768 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:38:27.052782 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:38:27.052834 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:38:27.052855 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:38:27.052873 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:38:27.052884 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:38:27.052897 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:38:27.052917 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:38:27.052949 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:38:47.430763 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:38:47.430883 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:38:47.430928 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:38:47.430945 | orchestrator | 2026-04-28 06:38:47.430965 | orchestrator | TASK [neutron : Copying over ssh key] ****************************************** 2026-04-28 06:38:47.431032 | orchestrator | Tuesday 28 April 2026 06:38:28 +0000 (0:00:03.026) 0:01:17.341 ********* 2026-04-28 06:38:47.431052 | orchestrator | ok: [testbed-node-1] 2026-04-28 06:38:47.431070 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:38:47.431089 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:38:47.431108 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:38:47.431126 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:38:47.431137 | orchestrator | ok: [testbed-node-2] 2026-04-28 06:38:47.431148 | orchestrator | 2026-04-28 06:38:47.431159 | orchestrator | TASK [neutron : Copying over ml2_conf.ini] ************************************* 2026-04-28 06:38:47.431171 | orchestrator | Tuesday 28 April 2026 06:38:32 +0000 (0:00:03.885) 0:01:21.227 ********* 2026-04-28 06:38:47.431200 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:38:47.431212 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:38:47.431224 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:38:47.431235 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:38:47.431246 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:38:47.431267 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:38:47.431301 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:38:47.431325 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:38:47.431342 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:38:47.431355 | orchestrator | 2026-04-28 06:38:47.431368 | orchestrator | TASK [neutron : Copying over openvswitch_agent.ini] **************************** 2026-04-28 06:38:47.431380 | orchestrator | Tuesday 28 April 2026 06:38:37 +0000 (0:00:04.989) 0:01:26.216 ********* 2026-04-28 06:38:47.431393 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:38:47.431406 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:38:47.431418 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:38:47.431431 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:38:47.431443 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:38:47.431455 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:38:47.431467 | orchestrator | 2026-04-28 06:38:47.431479 | orchestrator | TASK [neutron : Copying over sriov_agent.ini] ********************************** 2026-04-28 06:38:47.431491 | orchestrator | Tuesday 28 April 2026 06:38:40 +0000 (0:00:03.542) 0:01:29.759 ********* 2026-04-28 06:38:47.431511 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:38:47.431523 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:38:47.431535 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:38:47.431547 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:38:47.431560 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:38:47.431572 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:38:47.431584 | orchestrator | 2026-04-28 06:38:47.431597 | orchestrator | TASK [neutron : Copying over mlnx_agent.ini] *********************************** 2026-04-28 06:38:47.431609 | orchestrator | Tuesday 28 April 2026 06:38:43 +0000 (0:00:03.195) 0:01:32.955 ********* 2026-04-28 06:38:47.431622 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:38:47.431634 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:38:47.431647 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:38:47.431660 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:38:47.431671 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:38:47.431682 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:38:47.431693 | orchestrator | 2026-04-28 06:38:47.431704 | orchestrator | TASK [neutron : Copying over eswitchd.conf] ************************************ 2026-04-28 06:38:47.431723 | orchestrator | Tuesday 28 April 2026 06:38:47 +0000 (0:00:03.631) 0:01:36.586 ********* 2026-04-28 06:39:01.365044 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:39:01.365138 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:39:01.365153 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:39:01.365164 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:39:01.365175 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:39:01.365185 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:39:01.365196 | orchestrator | 2026-04-28 06:39:01.365208 | orchestrator | TASK [neutron : Copying over dhcp_agent.ini] *********************************** 2026-04-28 06:39:01.365220 | orchestrator | Tuesday 28 April 2026 06:38:50 +0000 (0:00:03.480) 0:01:40.066 ********* 2026-04-28 06:39:01.365231 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:39:01.365241 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:39:01.365252 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:39:01.365263 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:39:01.365273 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:39:01.365284 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:39:01.365295 | orchestrator | 2026-04-28 06:39:01.365306 | orchestrator | TASK [neutron : Copying over dnsmasq.conf] ************************************* 2026-04-28 06:39:01.365316 | orchestrator | Tuesday 28 April 2026 06:38:54 +0000 (0:00:03.378) 0:01:43.445 ********* 2026-04-28 06:39:01.365327 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-28 06:39:01.365339 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:39:01.365350 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-28 06:39:01.365360 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:39:01.365371 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-28 06:39:01.365382 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-28 06:39:01.365393 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:39:01.365403 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:39:01.365414 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-28 06:39:01.365425 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:39:01.365450 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/neutron/templates/dnsmasq.conf.j2)  2026-04-28 06:39:01.365461 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:39:01.365471 | orchestrator | 2026-04-28 06:39:01.365482 | orchestrator | TASK [neutron : Copying over l3_agent.ini] ************************************* 2026-04-28 06:39:01.365493 | orchestrator | Tuesday 28 April 2026 06:38:57 +0000 (0:00:03.374) 0:01:46.820 ********* 2026-04-28 06:39:01.365509 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:39:01.365545 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:39:01.365561 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:39:01.365575 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:39:01.365608 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:39:01.365623 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:39:01.365642 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:39:01.365664 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:39:01.365677 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:39:01.365690 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:39:01.365704 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:39:01.365717 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:39:01.365730 | orchestrator | 2026-04-28 06:39:01.365742 | orchestrator | TASK [neutron : Copying over fwaas_driver.ini] ********************************* 2026-04-28 06:39:01.365753 | orchestrator | Tuesday 28 April 2026 06:39:00 +0000 (0:00:02.863) 0:01:49.683 ********* 2026-04-28 06:39:01.365772 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:39:34.423401 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:39:34.423496 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:39:34.423530 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:39:34.423550 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:39:34.423557 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:39:34.423565 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:39:34.423572 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:39:34.423579 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:39:34.423585 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:39:34.423604 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:39:34.423611 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:39:34.423618 | orchestrator | 2026-04-28 06:39:34.423625 | orchestrator | TASK [neutron : Copying over metadata_agent.ini] ******************************* 2026-04-28 06:39:34.423638 | orchestrator | Tuesday 28 April 2026 06:39:03 +0000 (0:00:02.884) 0:01:52.568 ********* 2026-04-28 06:39:34.423644 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:39:34.423650 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:39:34.423656 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:39:34.423662 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:39:34.423669 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:39:34.423675 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:39:34.423681 | orchestrator | 2026-04-28 06:39:34.423687 | orchestrator | TASK [neutron : Copying over neutron_ovn_metadata_agent.ini] ******************* 2026-04-28 06:39:34.423693 | orchestrator | Tuesday 28 April 2026 06:39:06 +0000 (0:00:03.143) 0:01:55.712 ********* 2026-04-28 06:39:34.423699 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:39:34.423705 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:39:34.423714 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:39:34.423721 | orchestrator | changed: [testbed-node-3] 2026-04-28 06:39:34.423727 | orchestrator | changed: [testbed-node-5] 2026-04-28 06:39:34.423733 | orchestrator | changed: [testbed-node-4] 2026-04-28 06:39:34.423739 | orchestrator | 2026-04-28 06:39:34.423745 | orchestrator | TASK [neutron : Copying over metering_agent.ini] ******************************* 2026-04-28 06:39:34.423751 | orchestrator | Tuesday 28 April 2026 06:39:11 +0000 (0:00:05.391) 0:02:01.103 ********* 2026-04-28 06:39:34.423758 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:39:34.423764 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:39:34.423770 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:39:34.423776 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:39:34.423782 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:39:34.423788 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:39:34.423794 | orchestrator | 2026-04-28 06:39:34.423800 | orchestrator | TASK [neutron : Copying over ironic_neutron_agent.ini] ************************* 2026-04-28 06:39:34.423806 | orchestrator | Tuesday 28 April 2026 06:39:15 +0000 (0:00:03.274) 0:02:04.378 ********* 2026-04-28 06:39:34.423812 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:39:34.423818 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:39:34.423824 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:39:34.423830 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:39:34.423836 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:39:34.423842 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:39:34.423848 | orchestrator | 2026-04-28 06:39:34.423854 | orchestrator | TASK [neutron : Copying over bgp_dragent.ini] ********************************** 2026-04-28 06:39:34.423860 | orchestrator | Tuesday 28 April 2026 06:39:18 +0000 (0:00:03.445) 0:02:07.823 ********* 2026-04-28 06:39:34.423866 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:39:34.423872 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:39:34.423878 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:39:34.423884 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:39:34.423890 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:39:34.423896 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:39:34.423902 | orchestrator | 2026-04-28 06:39:34.423908 | orchestrator | TASK [neutron : Copying over ovn_agent.ini] ************************************ 2026-04-28 06:39:34.423914 | orchestrator | Tuesday 28 April 2026 06:39:21 +0000 (0:00:02.911) 0:02:10.735 ********* 2026-04-28 06:39:34.423920 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:39:34.423926 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:39:34.423932 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:39:34.423938 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:39:34.423944 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:39:34.424000 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:39:34.424008 | orchestrator | 2026-04-28 06:39:34.424016 | orchestrator | TASK [neutron : Copying over nsx.ini] ****************************************** 2026-04-28 06:39:34.424023 | orchestrator | Tuesday 28 April 2026 06:39:25 +0000 (0:00:03.498) 0:02:14.234 ********* 2026-04-28 06:39:34.424030 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:39:34.424042 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:39:34.424049 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:39:34.424056 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:39:34.424063 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:39:34.424070 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:39:34.424076 | orchestrator | 2026-04-28 06:39:34.424082 | orchestrator | TASK [neutron : Copy neutron-l3-agent-wrapper script] ************************** 2026-04-28 06:39:34.424088 | orchestrator | Tuesday 28 April 2026 06:39:28 +0000 (0:00:03.275) 0:02:17.509 ********* 2026-04-28 06:39:34.424094 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:39:34.424101 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:39:34.424107 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:39:34.424113 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:39:34.424119 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:39:34.424125 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:39:34.424131 | orchestrator | 2026-04-28 06:39:34.424138 | orchestrator | TASK [neutron : Copying over extra ml2 plugins] ******************************** 2026-04-28 06:39:34.424144 | orchestrator | Tuesday 28 April 2026 06:39:32 +0000 (0:00:03.717) 0:02:21.227 ********* 2026-04-28 06:39:34.424150 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:39:34.424156 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:39:34.424162 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:39:34.424168 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:39:34.424174 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:39:34.424180 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:39:34.424186 | orchestrator | 2026-04-28 06:39:34.424198 | orchestrator | TASK [neutron : Copying over neutron-tls-proxy.cfg] **************************** 2026-04-28 06:39:45.222609 | orchestrator | Tuesday 28 April 2026 06:39:35 +0000 (0:00:03.548) 0:02:24.775 ********* 2026-04-28 06:39:45.222747 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-28 06:39:45.222782 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:39:45.222806 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-28 06:39:45.222825 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:39:45.222843 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-28 06:39:45.222861 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:39:45.222878 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-28 06:39:45.222898 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:39:45.222917 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-28 06:39:45.222936 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:39:45.223005 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/neutron/templates/neutron-tls-proxy.cfg.j2)  2026-04-28 06:39:45.223023 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:39:45.223042 | orchestrator | 2026-04-28 06:39:45.223063 | orchestrator | TASK [neutron : Copying over neutron_taas.conf] ******************************** 2026-04-28 06:39:45.223081 | orchestrator | Tuesday 28 April 2026 06:39:38 +0000 (0:00:03.372) 0:02:28.148 ********* 2026-04-28 06:39:45.223128 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:39:45.223170 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:39:45.223183 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:39:45.223195 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:39:45.223228 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:39:45.223241 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:39:45.223253 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:39:45.223265 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:39:45.223282 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:39:45.223302 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:39:45.223313 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:39:45.223324 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:39:45.223335 | orchestrator | 2026-04-28 06:39:45.223346 | orchestrator | TASK [service-check-containers : neutron | Check containers] ******************* 2026-04-28 06:39:45.223357 | orchestrator | Tuesday 28 April 2026 06:39:42 +0000 (0:00:03.731) 0:02:31.879 ********* 2026-04-28 06:39:45.223369 | orchestrator | changed: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:39:45.223391 | orchestrator | changed: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:39:50.664127 | orchestrator | changed: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:39:50.664252 | orchestrator | changed: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 06:39:50.664269 | orchestrator | changed: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 06:39:50.664280 | orchestrator | changed: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}}) 2026-04-28 06:39:50.664291 | orchestrator | 2026-04-28 06:39:50.664302 | orchestrator | TASK [service-check-containers : neutron | Notify handlers to restart containers] *** 2026-04-28 06:39:50.664314 | orchestrator | Tuesday 28 April 2026 06:39:46 +0000 (0:00:04.027) 0:02:35.907 ********* 2026-04-28 06:39:50.664324 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 06:39:50.664335 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 06:39:50.664345 | orchestrator | } 2026-04-28 06:39:50.664355 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 06:39:50.664364 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 06:39:50.664374 | orchestrator | } 2026-04-28 06:39:50.664383 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 06:39:50.664393 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 06:39:50.664402 | orchestrator | } 2026-04-28 06:39:50.664412 | orchestrator | changed: [testbed-node-3] => { 2026-04-28 06:39:50.664421 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 06:39:50.664430 | orchestrator | } 2026-04-28 06:39:50.664440 | orchestrator | changed: [testbed-node-4] => { 2026-04-28 06:39:50.664449 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 06:39:50.664459 | orchestrator | } 2026-04-28 06:39:50.664469 | orchestrator | changed: [testbed-node-5] => { 2026-04-28 06:39:50.664527 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 06:39:50.664538 | orchestrator | } 2026-04-28 06:39:50.664548 | orchestrator | 2026-04-28 06:39:50.664558 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 06:39:50.664569 | orchestrator | Tuesday 28 April 2026 06:39:48 +0000 (0:00:01.851) 0:02:37.758 ********* 2026-04-28 06:39:50.664587 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:39:50.664600 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:39:50.664613 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:39:50.664625 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:39:50.664637 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:39:50.664648 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:39:50.664660 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:39:50.664678 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:39:50.664703 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'neutron-server', 'value': {'container_name': 'neutron_server', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328', 'enabled': True, 'group': 'neutron-server', 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9696'], 'timeout': '30'}, 'haproxy': {'neutron_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}, 'neutron_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9696', 'listen_port': '9696', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:42:53.075202 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:42:53.075320 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'neutron-ovn-metadata-agent', 'value': {'container_name': 'neutron_ovn_metadata_agent', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'privileged': True, 'enabled': True, 'host_in_groups': True, 'volumes': ['/etc/kolla/neutron-ovn-metadata-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', 'neutron_metadata_socket:/var/lib/neutron/kolla/', '/run/openvswitch:/run/openvswitch:shared', '/run/netns:/run/netns:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port neutron-ovn-metadata-agent 6640'], 'timeout': '30'}}})  2026-04-28 06:42:53.075339 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:42:53.075351 | orchestrator | 2026-04-28 06:42:53.075364 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-28 06:42:53.075376 | orchestrator | Tuesday 28 April 2026 06:39:52 +0000 (0:00:03.928) 0:02:41.687 ********* 2026-04-28 06:42:53.075386 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:42:53.075397 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:42:53.075408 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:42:53.075419 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:42:53.075429 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:42:53.075440 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:42:53.075451 | orchestrator | 2026-04-28 06:42:53.075462 | orchestrator | TASK [neutron : Running Neutron database expand container] ********************* 2026-04-28 06:42:53.075473 | orchestrator | Tuesday 28 April 2026 06:39:54 +0000 (0:00:01.768) 0:02:43.455 ********* 2026-04-28 06:42:53.075484 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:42:53.075494 | orchestrator | 2026-04-28 06:42:53.075505 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-28 06:42:53.075516 | orchestrator | Tuesday 28 April 2026 06:40:28 +0000 (0:00:33.774) 0:03:17.230 ********* 2026-04-28 06:42:53.075527 | orchestrator | 2026-04-28 06:42:53.075538 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-28 06:42:53.075548 | orchestrator | Tuesday 28 April 2026 06:40:28 +0000 (0:00:00.449) 0:03:17.679 ********* 2026-04-28 06:42:53.075559 | orchestrator | 2026-04-28 06:42:53.075570 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-28 06:42:53.075581 | orchestrator | Tuesday 28 April 2026 06:40:28 +0000 (0:00:00.421) 0:03:18.101 ********* 2026-04-28 06:42:53.075591 | orchestrator | 2026-04-28 06:42:53.075602 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-28 06:42:53.075639 | orchestrator | Tuesday 28 April 2026 06:40:29 +0000 (0:00:00.660) 0:03:18.761 ********* 2026-04-28 06:42:53.075651 | orchestrator | 2026-04-28 06:42:53.075662 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-28 06:42:53.075673 | orchestrator | Tuesday 28 April 2026 06:40:30 +0000 (0:00:00.452) 0:03:19.214 ********* 2026-04-28 06:42:53.075685 | orchestrator | 2026-04-28 06:42:53.075695 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-28 06:42:53.075706 | orchestrator | Tuesday 28 April 2026 06:40:30 +0000 (0:00:00.461) 0:03:19.675 ********* 2026-04-28 06:42:53.075717 | orchestrator | 2026-04-28 06:42:53.075727 | orchestrator | RUNNING HANDLER [neutron : Restart neutron-server container] ******************* 2026-04-28 06:42:53.075738 | orchestrator | Tuesday 28 April 2026 06:40:31 +0000 (0:00:00.808) 0:03:20.483 ********* 2026-04-28 06:42:53.075749 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:42:53.075760 | orchestrator | changed: [testbed-node-1] 2026-04-28 06:42:53.075771 | orchestrator | changed: [testbed-node-2] 2026-04-28 06:42:53.075781 | orchestrator | 2026-04-28 06:42:53.075792 | orchestrator | RUNNING HANDLER [neutron : Restart neutron-ovn-metadata-agent container] ******* 2026-04-28 06:42:53.075803 | orchestrator | Tuesday 28 April 2026 06:41:15 +0000 (0:00:44.090) 0:04:04.574 ********* 2026-04-28 06:42:53.075814 | orchestrator | changed: [testbed-node-4] 2026-04-28 06:42:53.075824 | orchestrator | changed: [testbed-node-3] 2026-04-28 06:42:53.075835 | orchestrator | changed: [testbed-node-5] 2026-04-28 06:42:53.075846 | orchestrator | 2026-04-28 06:42:53.075856 | orchestrator | TASK [neutron : Checking neutron pending contract scripts] ********************* 2026-04-28 06:42:53.075890 | orchestrator | Tuesday 28 April 2026 06:42:24 +0000 (0:01:08.667) 0:05:13.242 ********* 2026-04-28 06:42:53.075901 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:42:53.075912 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:42:53.075923 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:42:53.075933 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:42:53.075944 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:42:53.075954 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:42:53.075965 | orchestrator | 2026-04-28 06:42:53.075976 | orchestrator | TASK [neutron : Stopping all neutron-server for contract db] ******************* 2026-04-28 06:42:53.075986 | orchestrator | Tuesday 28 April 2026 06:42:25 +0000 (0:00:01.913) 0:05:15.156 ********* 2026-04-28 06:42:53.075997 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:42:53.076023 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:42:53.076034 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:42:53.076045 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:42:53.076055 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:42:53.076066 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:42:53.076077 | orchestrator | 2026-04-28 06:42:53.076087 | orchestrator | TASK [neutron : Running Neutron database contract container] ******************* 2026-04-28 06:42:53.076098 | orchestrator | Tuesday 28 April 2026 06:42:31 +0000 (0:00:05.083) 0:05:20.239 ********* 2026-04-28 06:42:53.076109 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:42:53.076121 | orchestrator | 2026-04-28 06:42:53.076141 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-28 06:42:53.076181 | orchestrator | Tuesday 28 April 2026 06:42:47 +0000 (0:00:15.997) 0:05:36.237 ********* 2026-04-28 06:42:53.076202 | orchestrator | 2026-04-28 06:42:53.076222 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-28 06:42:53.076241 | orchestrator | Tuesday 28 April 2026 06:42:47 +0000 (0:00:00.452) 0:05:36.690 ********* 2026-04-28 06:42:53.076257 | orchestrator | 2026-04-28 06:42:53.076275 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-28 06:42:53.076295 | orchestrator | Tuesday 28 April 2026 06:42:47 +0000 (0:00:00.441) 0:05:37.132 ********* 2026-04-28 06:42:53.076315 | orchestrator | 2026-04-28 06:42:53.076335 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-28 06:42:53.076371 | orchestrator | Tuesday 28 April 2026 06:42:48 +0000 (0:00:00.428) 0:05:37.561 ********* 2026-04-28 06:42:53.076386 | orchestrator | 2026-04-28 06:42:53.076396 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-28 06:42:53.076408 | orchestrator | Tuesday 28 April 2026 06:42:48 +0000 (0:00:00.427) 0:05:37.989 ********* 2026-04-28 06:42:53.076418 | orchestrator | 2026-04-28 06:42:53.076429 | orchestrator | TASK [neutron : Flush Handlers] ************************************************ 2026-04-28 06:42:53.076440 | orchestrator | Tuesday 28 April 2026 06:42:49 +0000 (0:00:00.425) 0:05:38.414 ********* 2026-04-28 06:42:53.076451 | orchestrator | 2026-04-28 06:42:53.076461 | orchestrator | TASK [neutron : include_tasks] ************************************************* 2026-04-28 06:42:53.076472 | orchestrator | Tuesday 28 April 2026 06:42:50 +0000 (0:00:00.810) 0:05:39.225 ********* 2026-04-28 06:42:53.076483 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:42:53.076494 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:42:53.076505 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:42:53.076515 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:42:53.076526 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:42:53.076537 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:42:53.076547 | orchestrator | 2026-04-28 06:42:53.076558 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 06:42:53.076570 | orchestrator | testbed-node-0 : ok=21  changed=8  unreachable=0 failed=0 skipped=34  rescued=0 ignored=0 2026-04-28 06:42:53.076582 | orchestrator | testbed-node-1 : ok=18  changed=6  unreachable=0 failed=0 skipped=33  rescued=0 ignored=0 2026-04-28 06:42:53.076593 | orchestrator | testbed-node-2 : ok=18  changed=6  unreachable=0 failed=0 skipped=33  rescued=0 ignored=0 2026-04-28 06:42:53.076604 | orchestrator | testbed-node-3 : ok=17  changed=6  unreachable=0 failed=0 skipped=34  rescued=0 ignored=0 2026-04-28 06:42:53.076615 | orchestrator | testbed-node-4 : ok=17  changed=6  unreachable=0 failed=0 skipped=34  rescued=0 ignored=0 2026-04-28 06:42:53.076625 | orchestrator | testbed-node-5 : ok=17  changed=6  unreachable=0 failed=0 skipped=34  rescued=0 ignored=0 2026-04-28 06:42:53.076636 | orchestrator | 2026-04-28 06:42:53.076647 | orchestrator | 2026-04-28 06:42:53.076658 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 06:42:53.076669 | orchestrator | Tuesday 28 April 2026 06:42:53 +0000 (0:00:02.988) 0:05:42.213 ********* 2026-04-28 06:42:53.076680 | orchestrator | =============================================================================== 2026-04-28 06:42:53.076691 | orchestrator | neutron : Restart neutron-ovn-metadata-agent container ----------------- 68.67s 2026-04-28 06:42:53.076702 | orchestrator | neutron : Restart neutron-server container ----------------------------- 44.09s 2026-04-28 06:42:53.076712 | orchestrator | neutron : Running Neutron database expand container -------------------- 33.77s 2026-04-28 06:42:53.076723 | orchestrator | neutron : Running Neutron database contract container ------------------ 16.00s 2026-04-28 06:42:53.076734 | orchestrator | neutron : Copying over neutron.conf ------------------------------------- 6.37s 2026-04-28 06:42:53.076744 | orchestrator | neutron : Copying over neutron_ovn_metadata_agent.ini ------------------- 5.39s 2026-04-28 06:42:53.076755 | orchestrator | neutron : Stopping all neutron-server for contract db ------------------- 5.08s 2026-04-28 06:42:53.076766 | orchestrator | neutron : Copying over ml2_conf.ini ------------------------------------- 4.99s 2026-04-28 06:42:53.076777 | orchestrator | neutron : include_tasks ------------------------------------------------- 4.71s 2026-04-28 06:42:53.076788 | orchestrator | neutron : Ensuring config directories exist ----------------------------- 4.21s 2026-04-28 06:42:53.076798 | orchestrator | neutron : Copying over config.json files for services ------------------- 4.19s 2026-04-28 06:42:53.076816 | orchestrator | service-check-containers : neutron | Check containers ------------------- 4.03s 2026-04-28 06:42:53.076827 | orchestrator | service-check-containers : Include tasks -------------------------------- 3.93s 2026-04-28 06:42:53.076844 | orchestrator | neutron : Copying over ssh key ------------------------------------------ 3.88s 2026-04-28 06:42:53.076855 | orchestrator | service-cert-copy : neutron | Copying over backend internal TLS key ----- 3.78s 2026-04-28 06:42:53.076909 | orchestrator | service-cert-copy : neutron | Copying over extra CA certificates -------- 3.76s 2026-04-28 06:42:53.076924 | orchestrator | Setting sysctl values --------------------------------------------------- 3.74s 2026-04-28 06:42:53.076935 | orchestrator | neutron : Copying over neutron_taas.conf -------------------------------- 3.73s 2026-04-28 06:42:53.076946 | orchestrator | service-cert-copy : neutron | Copying over backend internal TLS certificate --- 3.73s 2026-04-28 06:42:53.076967 | orchestrator | neutron : Copy neutron-l3-agent-wrapper script -------------------------- 3.72s 2026-04-28 06:42:53.720170 | orchestrator | + [[ true == \t\r\u\e ]] 2026-04-28 06:42:53.720290 | orchestrator | + osism apply -a reconfigure nova 2026-04-28 06:42:55.003684 | orchestrator | 2026-04-28 06:42:55 | INFO  | Prepare task for execution of nova. 2026-04-28 06:42:55.072366 | orchestrator | 2026-04-28 06:42:55 | INFO  | Task 90f49895-a7b0-46f0-b056-5b756f0be7fd (nova) was prepared for execution. 2026-04-28 06:42:55.072453 | orchestrator | 2026-04-28 06:42:55 | INFO  | It takes a moment until task 90f49895-a7b0-46f0-b056-5b756f0be7fd (nova) has been started and output is visible here. 2026-04-28 06:45:13.428944 | orchestrator | 2026-04-28 06:45:13.429068 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 06:45:13.429097 | orchestrator | 2026-04-28 06:45:13.429118 | orchestrator | TASK [Group hosts based on OpenStack release] ********************************** 2026-04-28 06:45:13.429139 | orchestrator | Tuesday 28 April 2026 06:43:00 +0000 (0:00:02.269) 0:00:02.269 ********* 2026-04-28 06:45:13.429159 | orchestrator | changed: [testbed-manager] 2026-04-28 06:45:13.429181 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:45:13.429199 | orchestrator | changed: [testbed-node-1] 2026-04-28 06:45:13.429217 | orchestrator | changed: [testbed-node-2] 2026-04-28 06:45:13.429229 | orchestrator | changed: [testbed-node-3] 2026-04-28 06:45:13.429239 | orchestrator | changed: [testbed-node-4] 2026-04-28 06:45:13.429250 | orchestrator | changed: [testbed-node-5] 2026-04-28 06:45:13.429261 | orchestrator | 2026-04-28 06:45:13.429272 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 06:45:13.429282 | orchestrator | Tuesday 28 April 2026 06:43:04 +0000 (0:00:04.210) 0:00:06.480 ********* 2026-04-28 06:45:13.429293 | orchestrator | changed: [testbed-manager] 2026-04-28 06:45:13.429305 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:45:13.429315 | orchestrator | changed: [testbed-node-1] 2026-04-28 06:45:13.429326 | orchestrator | changed: [testbed-node-2] 2026-04-28 06:45:13.429337 | orchestrator | changed: [testbed-node-3] 2026-04-28 06:45:13.429350 | orchestrator | changed: [testbed-node-4] 2026-04-28 06:45:13.429363 | orchestrator | changed: [testbed-node-5] 2026-04-28 06:45:13.429375 | orchestrator | 2026-04-28 06:45:13.429388 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 06:45:13.429401 | orchestrator | Tuesday 28 April 2026 06:43:07 +0000 (0:00:02.180) 0:00:08.660 ********* 2026-04-28 06:45:13.429415 | orchestrator | changed: [testbed-manager] => (item=enable_nova_True) 2026-04-28 06:45:13.429428 | orchestrator | changed: [testbed-node-0] => (item=enable_nova_True) 2026-04-28 06:45:13.429441 | orchestrator | changed: [testbed-node-1] => (item=enable_nova_True) 2026-04-28 06:45:13.429453 | orchestrator | changed: [testbed-node-2] => (item=enable_nova_True) 2026-04-28 06:45:13.429465 | orchestrator | changed: [testbed-node-3] => (item=enable_nova_True) 2026-04-28 06:45:13.429478 | orchestrator | changed: [testbed-node-4] => (item=enable_nova_True) 2026-04-28 06:45:13.429490 | orchestrator | changed: [testbed-node-5] => (item=enable_nova_True) 2026-04-28 06:45:13.429525 | orchestrator | 2026-04-28 06:45:13.429538 | orchestrator | PLAY [Bootstrap nova API databases] ******************************************** 2026-04-28 06:45:13.429551 | orchestrator | 2026-04-28 06:45:13.429563 | orchestrator | TASK [Bootstrap deploy] ******************************************************** 2026-04-28 06:45:13.429575 | orchestrator | Tuesday 28 April 2026 06:43:10 +0000 (0:00:03.644) 0:00:12.305 ********* 2026-04-28 06:45:13.429588 | orchestrator | included: nova for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 06:45:13.429600 | orchestrator | 2026-04-28 06:45:13.429613 | orchestrator | TASK [nova : Creating Nova databases] ****************************************** 2026-04-28 06:45:13.429627 | orchestrator | Tuesday 28 April 2026 06:43:12 +0000 (0:00:01.997) 0:00:14.302 ********* 2026-04-28 06:45:13.429639 | orchestrator | ok: [testbed-node-0] => (item=nova_cell0) 2026-04-28 06:45:13.429652 | orchestrator | ok: [testbed-node-0] => (item=nova_api) 2026-04-28 06:45:13.429664 | orchestrator | 2026-04-28 06:45:13.429677 | orchestrator | TASK [nova : Creating Nova databases user and setting permissions] ************* 2026-04-28 06:45:13.429690 | orchestrator | Tuesday 28 April 2026 06:43:18 +0000 (0:00:05.301) 0:00:19.604 ********* 2026-04-28 06:45:13.429703 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-28 06:45:13.429715 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-28 06:45:13.429728 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:45:13.429739 | orchestrator | 2026-04-28 06:45:13.429749 | orchestrator | TASK [nova : Ensuring config directories exist] ******************************** 2026-04-28 06:45:13.429760 | orchestrator | Tuesday 28 April 2026 06:43:23 +0000 (0:00:05.174) 0:00:24.778 ********* 2026-04-28 06:45:13.429771 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:45:13.429782 | orchestrator | 2026-04-28 06:45:13.429792 | orchestrator | TASK [nova : Copying over config.json files for nova-api-bootstrap] ************ 2026-04-28 06:45:13.429803 | orchestrator | Tuesday 28 April 2026 06:43:24 +0000 (0:00:01.580) 0:00:26.358 ********* 2026-04-28 06:45:13.429834 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:45:13.429845 | orchestrator | 2026-04-28 06:45:13.429856 | orchestrator | TASK [nova : Copying over nova.conf for nova-api-bootstrap] ******************** 2026-04-28 06:45:13.429867 | orchestrator | Tuesday 28 April 2026 06:43:26 +0000 (0:00:02.134) 0:00:28.492 ********* 2026-04-28 06:45:13.429877 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:45:13.429888 | orchestrator | 2026-04-28 06:45:13.429911 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-28 06:45:13.429922 | orchestrator | Tuesday 28 April 2026 06:43:30 +0000 (0:00:03.761) 0:00:32.254 ********* 2026-04-28 06:45:13.429933 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:45:13.429944 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:45:13.429955 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:45:13.429966 | orchestrator | 2026-04-28 06:45:13.429977 | orchestrator | TASK [nova : Running Nova API bootstrap container] ***************************** 2026-04-28 06:45:13.429988 | orchestrator | Tuesday 28 April 2026 06:43:32 +0000 (0:00:01.762) 0:00:34.017 ********* 2026-04-28 06:45:13.429998 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:45:13.430009 | orchestrator | 2026-04-28 06:45:13.430092 | orchestrator | TASK [nova : Create cell0 mappings] ******************************************** 2026-04-28 06:45:13.430105 | orchestrator | Tuesday 28 April 2026 06:44:06 +0000 (0:00:33.954) 0:01:07.971 ********* 2026-04-28 06:45:13.430116 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:45:13.430127 | orchestrator | 2026-04-28 06:45:13.430137 | orchestrator | TASK [nova-cell : Get a list of existing cells] ******************************** 2026-04-28 06:45:13.430148 | orchestrator | Tuesday 28 April 2026 06:44:22 +0000 (0:00:15.543) 0:01:23.514 ********* 2026-04-28 06:45:13.430159 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:45:13.430170 | orchestrator | 2026-04-28 06:45:13.430181 | orchestrator | TASK [nova-cell : Extract current cell settings from list] ********************* 2026-04-28 06:45:13.430192 | orchestrator | Tuesday 28 April 2026 06:44:36 +0000 (0:00:14.262) 0:01:37.776 ********* 2026-04-28 06:45:13.430204 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:45:13.430214 | orchestrator | 2026-04-28 06:45:13.430246 | orchestrator | TASK [nova : Update cell0 mappings] ******************************************** 2026-04-28 06:45:13.430267 | orchestrator | Tuesday 28 April 2026 06:44:38 +0000 (0:00:01.934) 0:01:39.711 ********* 2026-04-28 06:45:13.430279 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:45:13.430290 | orchestrator | 2026-04-28 06:45:13.430300 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-28 06:45:13.430311 | orchestrator | Tuesday 28 April 2026 06:44:39 +0000 (0:00:01.575) 0:01:41.286 ********* 2026-04-28 06:45:13.430322 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:45:13.430333 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:45:13.430344 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:45:13.430355 | orchestrator | 2026-04-28 06:45:13.430366 | orchestrator | TASK [Bootstrap upgrade] ******************************************************* 2026-04-28 06:45:13.430376 | orchestrator | Tuesday 28 April 2026 06:44:41 +0000 (0:00:01.366) 0:01:42.653 ********* 2026-04-28 06:45:13.430387 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:45:13.430398 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:45:13.430408 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:45:13.430419 | orchestrator | 2026-04-28 06:45:13.430430 | orchestrator | PLAY [Bootstrap nova cell databases] ******************************************* 2026-04-28 06:45:13.430441 | orchestrator | 2026-04-28 06:45:13.430451 | orchestrator | TASK [Bootstrap deploy] ******************************************************** 2026-04-28 06:45:13.430462 | orchestrator | Tuesday 28 April 2026 06:44:42 +0000 (0:00:01.649) 0:01:44.302 ********* 2026-04-28 06:45:13.430473 | orchestrator | included: nova-cell for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 06:45:13.430484 | orchestrator | 2026-04-28 06:45:13.430495 | orchestrator | TASK [nova-cell : Creating Nova cell database] ********************************* 2026-04-28 06:45:13.430506 | orchestrator | Tuesday 28 April 2026 06:44:44 +0000 (0:00:01.700) 0:01:46.003 ********* 2026-04-28 06:45:13.430517 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:45:13.430527 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:45:13.430538 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:45:13.430549 | orchestrator | 2026-04-28 06:45:13.430560 | orchestrator | TASK [nova-cell : Creating Nova cell database user and setting permissions] **** 2026-04-28 06:45:13.430571 | orchestrator | Tuesday 28 April 2026 06:44:47 +0000 (0:00:02.958) 0:01:48.962 ********* 2026-04-28 06:45:13.430582 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:45:13.430593 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:45:13.430603 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:45:13.430614 | orchestrator | 2026-04-28 06:45:13.430625 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ vhosts exist] ****************** 2026-04-28 06:45:13.430636 | orchestrator | Tuesday 28 April 2026 06:44:50 +0000 (0:00:03.258) 0:01:52.221 ********* 2026-04-28 06:45:13.430647 | orchestrator | skipping: [testbed-node-1] => (item=openstack)  2026-04-28 06:45:13.430657 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:45:13.430668 | orchestrator | skipping: [testbed-node-2] => (item=openstack)  2026-04-28 06:45:13.430679 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:45:13.430690 | orchestrator | ok: [testbed-node-0] => (item=openstack) 2026-04-28 06:45:13.430700 | orchestrator | 2026-04-28 06:45:13.430711 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ users exist] ******************* 2026-04-28 06:45:13.430722 | orchestrator | Tuesday 28 April 2026 06:44:55 +0000 (0:00:04.694) 0:01:56.916 ********* 2026-04-28 06:45:13.430733 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-28 06:45:13.430744 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:45:13.430755 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-28 06:45:13.430766 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:45:13.430776 | orchestrator | ok: [testbed-node-0] => (item=None) 2026-04-28 06:45:13.430787 | orchestrator | ok: [testbed-node-0 -> {{ service_rabbitmq_delegate_host }}] 2026-04-28 06:45:13.430798 | orchestrator | 2026-04-28 06:45:13.430841 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ vhosts exist] ****************** 2026-04-28 06:45:13.430854 | orchestrator | Tuesday 28 April 2026 06:45:06 +0000 (0:00:11.126) 0:02:08.042 ********* 2026-04-28 06:45:13.430872 | orchestrator | skipping: [testbed-node-0] => (item=openstack)  2026-04-28 06:45:13.430882 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:45:13.430893 | orchestrator | skipping: [testbed-node-1] => (item=openstack)  2026-04-28 06:45:13.430904 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:45:13.430915 | orchestrator | skipping: [testbed-node-2] => (item=openstack)  2026-04-28 06:45:13.430925 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:45:13.430936 | orchestrator | 2026-04-28 06:45:13.430947 | orchestrator | TASK [service-rabbitmq : nova | Ensure RabbitMQ users exist] ******************* 2026-04-28 06:45:13.430963 | orchestrator | Tuesday 28 April 2026 06:45:07 +0000 (0:00:01.440) 0:02:09.482 ********* 2026-04-28 06:45:13.430974 | orchestrator | skipping: [testbed-node-0] => (item=None)  2026-04-28 06:45:13.430985 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:45:13.430996 | orchestrator | skipping: [testbed-node-1] => (item=None)  2026-04-28 06:45:13.431006 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:45:13.431017 | orchestrator | skipping: [testbed-node-2] => (item=None)  2026-04-28 06:45:13.431028 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:45:13.431038 | orchestrator | 2026-04-28 06:45:13.431049 | orchestrator | TASK [nova-cell : Ensuring config directories exist] *************************** 2026-04-28 06:45:13.431060 | orchestrator | Tuesday 28 April 2026 06:45:09 +0000 (0:00:01.804) 0:02:11.287 ********* 2026-04-28 06:45:13.431071 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:45:13.431081 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:45:13.431092 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:45:13.431103 | orchestrator | 2026-04-28 06:45:13.431114 | orchestrator | TASK [nova-cell : Copying over config.json files for nova-cell-bootstrap] ****** 2026-04-28 06:45:13.431124 | orchestrator | Tuesday 28 April 2026 06:45:11 +0000 (0:00:01.521) 0:02:12.808 ********* 2026-04-28 06:45:13.431135 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:45:13.431146 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:45:13.431156 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:45:13.431167 | orchestrator | 2026-04-28 06:45:13.431178 | orchestrator | TASK [nova-cell : Copying over nova.conf for nova-cell-bootstrap] ************** 2026-04-28 06:45:13.431189 | orchestrator | Tuesday 28 April 2026 06:45:13 +0000 (0:00:01.938) 0:02:14.747 ********* 2026-04-28 06:45:13.431206 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:46:38.823220 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:46:38.823336 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:46:38.823351 | orchestrator | 2026-04-28 06:46:38.823364 | orchestrator | TASK [nova-cell : Running Nova cell bootstrap container] *********************** 2026-04-28 06:46:38.823377 | orchestrator | Tuesday 28 April 2026 06:45:16 +0000 (0:00:03.465) 0:02:18.213 ********* 2026-04-28 06:46:38.823388 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:46:38.823399 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:46:38.823410 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:46:38.823422 | orchestrator | 2026-04-28 06:46:38.823433 | orchestrator | TASK [nova-cell : Get a list of existing cells] ******************************** 2026-04-28 06:46:38.823443 | orchestrator | Tuesday 28 April 2026 06:45:29 +0000 (0:00:12.382) 0:02:30.595 ********* 2026-04-28 06:46:38.823454 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:46:38.823465 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:46:38.823476 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:46:38.823487 | orchestrator | 2026-04-28 06:46:38.823498 | orchestrator | TASK [nova-cell : Extract current cell settings from list] ********************* 2026-04-28 06:46:38.823508 | orchestrator | Tuesday 28 April 2026 06:45:41 +0000 (0:00:12.698) 0:02:43.293 ********* 2026-04-28 06:46:38.823519 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:46:38.823530 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:46:38.823541 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:46:38.823552 | orchestrator | 2026-04-28 06:46:38.823562 | orchestrator | TASK [nova-cell : Create cell] ************************************************* 2026-04-28 06:46:38.823573 | orchestrator | Tuesday 28 April 2026 06:45:44 +0000 (0:00:02.253) 0:02:45.547 ********* 2026-04-28 06:46:38.823608 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:46:38.823620 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:46:38.823630 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:46:38.823641 | orchestrator | 2026-04-28 06:46:38.823652 | orchestrator | TASK [nova-cell : Update cell] ************************************************* 2026-04-28 06:46:38.823663 | orchestrator | Tuesday 28 April 2026 06:45:46 +0000 (0:00:02.083) 0:02:47.630 ********* 2026-04-28 06:46:38.823673 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:46:38.823684 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:46:38.823695 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:46:38.823705 | orchestrator | 2026-04-28 06:46:38.823717 | orchestrator | TASK [Bootstrap upgrade] ******************************************************* 2026-04-28 06:46:38.823727 | orchestrator | Tuesday 28 April 2026 06:45:59 +0000 (0:00:13.517) 0:03:01.148 ********* 2026-04-28 06:46:38.823738 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:46:38.823749 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:46:38.823760 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:46:38.823772 | orchestrator | 2026-04-28 06:46:38.823810 | orchestrator | PLAY [Apply role nova] ********************************************************* 2026-04-28 06:46:38.823823 | orchestrator | 2026-04-28 06:46:38.823835 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-28 06:46:38.823848 | orchestrator | Tuesday 28 April 2026 06:46:01 +0000 (0:00:01.716) 0:03:02.865 ********* 2026-04-28 06:46:38.823861 | orchestrator | included: /ansible/roles/nova/tasks/reconfigure.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 06:46:38.823874 | orchestrator | 2026-04-28 06:46:38.823886 | orchestrator | TASK [service-ks-register : nova | Creating/deleting services] ***************** 2026-04-28 06:46:38.823898 | orchestrator | Tuesday 28 April 2026 06:46:03 +0000 (0:00:01.923) 0:03:04.788 ********* 2026-04-28 06:46:38.823910 | orchestrator | skipping: [testbed-node-0] => (item=nova_legacy (compute_legacy))  2026-04-28 06:46:38.823923 | orchestrator | ok: [testbed-node-0] => (item=nova (compute)) 2026-04-28 06:46:38.823936 | orchestrator | 2026-04-28 06:46:38.823948 | orchestrator | TASK [service-ks-register : nova | Creating/deleting endpoints] **************** 2026-04-28 06:46:38.823960 | orchestrator | Tuesday 28 April 2026 06:46:07 +0000 (0:00:04.146) 0:03:08.935 ********* 2026-04-28 06:46:38.823973 | orchestrator | skipping: [testbed-node-0] => (item=nova_legacy -> https://api-int.testbed.osism.xyz:8774/v2/%(tenant_id)s -> internal)  2026-04-28 06:46:38.823987 | orchestrator | skipping: [testbed-node-0] => (item=nova_legacy -> https://api.testbed.osism.xyz:8774/v2/%(tenant_id)s -> public)  2026-04-28 06:46:38.823998 | orchestrator | ok: [testbed-node-0] => (item=nova -> https://api-int.testbed.osism.xyz:8774/v2.1 -> internal) 2026-04-28 06:46:38.824009 | orchestrator | ok: [testbed-node-0] => (item=nova -> https://api.testbed.osism.xyz:8774/v2.1 -> public) 2026-04-28 06:46:38.824019 | orchestrator | 2026-04-28 06:46:38.824044 | orchestrator | TASK [service-ks-register : nova | Creating projects] ************************** 2026-04-28 06:46:38.824055 | orchestrator | Tuesday 28 April 2026 06:46:14 +0000 (0:00:07.198) 0:03:16.133 ********* 2026-04-28 06:46:38.824066 | orchestrator | ok: [testbed-node-0] => (item=service) 2026-04-28 06:46:38.824077 | orchestrator | 2026-04-28 06:46:38.824087 | orchestrator | TASK [service-ks-register : nova | Creating users] ***************************** 2026-04-28 06:46:38.824098 | orchestrator | Tuesday 28 April 2026 06:46:18 +0000 (0:00:04.289) 0:03:20.423 ********* 2026-04-28 06:46:38.824109 | orchestrator | changed: [testbed-node-0] => (item=nova -> service) 2026-04-28 06:46:38.824119 | orchestrator | [WARNING]: Module did not set no_log for update_password 2026-04-28 06:46:38.824131 | orchestrator | 2026-04-28 06:46:38.824142 | orchestrator | TASK [service-ks-register : nova | Creating roles] ***************************** 2026-04-28 06:46:38.824152 | orchestrator | Tuesday 28 April 2026 06:46:24 +0000 (0:00:05.886) 0:03:26.309 ********* 2026-04-28 06:46:38.824163 | orchestrator | ok: [testbed-node-0] => (item=admin) 2026-04-28 06:46:38.824174 | orchestrator | 2026-04-28 06:46:38.824185 | orchestrator | TASK [service-ks-register : nova | Granting/revoking user roles] *************** 2026-04-28 06:46:38.824204 | orchestrator | Tuesday 28 April 2026 06:46:29 +0000 (0:00:04.243) 0:03:30.553 ********* 2026-04-28 06:46:38.824215 | orchestrator | ok: [testbed-node-0] => (item=nova -> service -> admin) 2026-04-28 06:46:38.824225 | orchestrator | ok: [testbed-node-0] => (item=nova -> service -> service) 2026-04-28 06:46:38.824236 | orchestrator | 2026-04-28 06:46:38.824264 | orchestrator | TASK [nova : Ensuring config directories exist] ******************************** 2026-04-28 06:46:38.824276 | orchestrator | Tuesday 28 April 2026 06:46:37 +0000 (0:00:08.077) 0:03:38.631 ********* 2026-04-28 06:46:38.824293 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:46:38.824310 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:46:38.824329 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:46:38.824350 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:46:50.072202 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 06:46:50.072354 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:46:50.072385 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:46:50.072427 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 06:46:50.072483 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 06:46:50.072506 | orchestrator | 2026-04-28 06:46:50.072528 | orchestrator | TASK [nova : Check if policies shall be overwritten] *************************** 2026-04-28 06:46:50.072551 | orchestrator | Tuesday 28 April 2026 06:46:40 +0000 (0:00:03.592) 0:03:42.224 ********* 2026-04-28 06:46:50.072594 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:46:50.072618 | orchestrator | 2026-04-28 06:46:50.072639 | orchestrator | TASK [nova : Set nova policy file] ********************************************* 2026-04-28 06:46:50.072660 | orchestrator | Tuesday 28 April 2026 06:46:41 +0000 (0:00:01.143) 0:03:43.368 ********* 2026-04-28 06:46:50.072679 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:46:50.072696 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:46:50.072707 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:46:50.072719 | orchestrator | 2026-04-28 06:46:50.072733 | orchestrator | TASK [nova : Check for vendordata file] **************************************** 2026-04-28 06:46:50.072745 | orchestrator | Tuesday 28 April 2026 06:46:43 +0000 (0:00:01.344) 0:03:44.712 ********* 2026-04-28 06:46:50.072758 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 06:46:50.072832 | orchestrator | 2026-04-28 06:46:50.072849 | orchestrator | TASK [nova : Set vendordata file path] ***************************************** 2026-04-28 06:46:50.072862 | orchestrator | Tuesday 28 April 2026 06:46:45 +0000 (0:00:02.074) 0:03:46.787 ********* 2026-04-28 06:46:50.072875 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:46:50.072887 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:46:50.072900 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:46:50.072913 | orchestrator | 2026-04-28 06:46:50.072926 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-28 06:46:50.072945 | orchestrator | Tuesday 28 April 2026 06:46:46 +0000 (0:00:01.416) 0:03:48.203 ********* 2026-04-28 06:46:50.072970 | orchestrator | included: /ansible/roles/nova/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 06:46:50.073000 | orchestrator | 2026-04-28 06:46:50.073016 | orchestrator | TASK [service-cert-copy : nova | Copying over extra CA certificates] *********** 2026-04-28 06:46:50.073034 | orchestrator | Tuesday 28 April 2026 06:46:48 +0000 (0:00:01.921) 0:03:50.124 ********* 2026-04-28 06:46:50.073054 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:46:50.073101 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:46:50.073142 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:46:53.648759 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:46:53.648864 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:46:53.648912 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:46:53.648922 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 06:46:53.648939 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 06:46:53.648944 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 06:46:53.648948 | orchestrator | 2026-04-28 06:46:53.648953 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS certificate] *** 2026-04-28 06:46:53.648958 | orchestrator | Tuesday 28 April 2026 06:46:52 +0000 (0:00:04.232) 0:03:54.357 ********* 2026-04-28 06:46:53.648963 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:46:53.648976 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:46:53.648983 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 06:46:53.648989 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:46:53.649004 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:46:55.508215 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:46:55.508360 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 06:46:55.508378 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:46:55.508393 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:46:55.508406 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:46:55.508436 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 06:46:55.508457 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:46:55.508468 | orchestrator | 2026-04-28 06:46:55.508481 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS key] ******** 2026-04-28 06:46:55.508493 | orchestrator | Tuesday 28 April 2026 06:46:54 +0000 (0:00:02.076) 0:03:56.434 ********* 2026-04-28 06:46:55.508510 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:46:55.508523 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:46:55.508535 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 06:46:55.508546 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:46:55.508565 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:46:58.902341 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:46:58.902426 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 06:46:58.902435 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:46:58.902442 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:46:58.902449 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:46:58.902482 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 06:46:58.902488 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:46:58.902493 | orchestrator | 2026-04-28 06:46:58.902498 | orchestrator | TASK [nova : Copying over config.json files for services] ********************** 2026-04-28 06:46:58.902504 | orchestrator | Tuesday 28 April 2026 06:46:56 +0000 (0:00:01.834) 0:03:58.268 ********* 2026-04-28 06:46:58.902512 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:46:58.902518 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:46:58.902524 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:46:58.902537 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:47:07.659982 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:47:07.660102 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:47:07.660121 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 06:47:07.660156 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 06:47:07.660169 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 06:47:07.660181 | orchestrator | 2026-04-28 06:47:07.660194 | orchestrator | TASK [nova : Copying over nova.conf] ******************************************* 2026-04-28 06:47:07.660223 | orchestrator | Tuesday 28 April 2026 06:47:01 +0000 (0:00:04.699) 0:04:02.968 ********* 2026-04-28 06:47:07.660242 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:47:07.660256 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:47:07.660269 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:47:07.660299 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:47:12.370789 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:47:12.370898 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:47:12.370941 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 06:47:12.370955 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 06:47:12.370967 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 06:47:12.370979 | orchestrator | 2026-04-28 06:47:12.370992 | orchestrator | TASK [nova : Copying over existing policy file] ******************************** 2026-04-28 06:47:12.371022 | orchestrator | Tuesday 28 April 2026 06:47:11 +0000 (0:00:10.344) 0:04:13.312 ********* 2026-04-28 06:47:12.371042 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:47:12.371055 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:47:12.371075 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 06:47:12.371087 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:47:12.371100 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:47:12.371127 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:47:30.427751 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 06:47:30.427907 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:47:30.427967 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:47:30.427990 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:47:30.428026 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 06:47:30.428044 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:47:30.428058 | orchestrator | 2026-04-28 06:47:30.428069 | orchestrator | TASK [nova : Copying over nova-api-wsgi.conf] ********************************** 2026-04-28 06:47:30.428080 | orchestrator | Tuesday 28 April 2026 06:47:13 +0000 (0:00:01.883) 0:04:15.195 ********* 2026-04-28 06:47:30.428089 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:47:30.428099 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:47:30.428108 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:47:30.428117 | orchestrator | 2026-04-28 06:47:30.428127 | orchestrator | TASK [nova : Copying over nova-metadata-wsgi.conf] ***************************** 2026-04-28 06:47:30.428136 | orchestrator | Tuesday 28 April 2026 06:47:15 +0000 (0:00:01.840) 0:04:17.035 ********* 2026-04-28 06:47:30.428146 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:47:30.428155 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:47:30.428165 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:47:30.428174 | orchestrator | 2026-04-28 06:47:30.428184 | orchestrator | TASK [nova : Copying over vendordata file for nova services] ******************* 2026-04-28 06:47:30.428211 | orchestrator | Tuesday 28 April 2026 06:47:17 +0000 (0:00:02.090) 0:04:19.126 ********* 2026-04-28 06:47:30.428231 | orchestrator | skipping: [testbed-node-0] => (item=nova-metadata)  2026-04-28 06:47:30.428241 | orchestrator | skipping: [testbed-node-0] => (item=nova-api)  2026-04-28 06:47:30.428251 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:47:30.428260 | orchestrator | skipping: [testbed-node-1] => (item=nova-metadata)  2026-04-28 06:47:30.428270 | orchestrator | skipping: [testbed-node-1] => (item=nova-api)  2026-04-28 06:47:30.428279 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:47:30.428290 | orchestrator | skipping: [testbed-node-2] => (item=nova-metadata)  2026-04-28 06:47:30.428301 | orchestrator | skipping: [testbed-node-2] => (item=nova-api)  2026-04-28 06:47:30.428312 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:47:30.428323 | orchestrator | 2026-04-28 06:47:30.428334 | orchestrator | TASK [Configure uWSGI for Nova] ************************************************ 2026-04-28 06:47:30.428345 | orchestrator | Tuesday 28 April 2026 06:47:19 +0000 (0:00:01.545) 0:04:20.671 ********* 2026-04-28 06:47:30.428356 | orchestrator | included: service-uwsgi-config for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'nova-api', 'port': '8774', 'workers': '2'}) 2026-04-28 06:47:30.428369 | orchestrator | included: service-uwsgi-config for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'nova-metadata', 'port': '8775', 'workers': '2'}) 2026-04-28 06:47:30.428381 | orchestrator | 2026-04-28 06:47:30.428392 | orchestrator | TASK [service-uwsgi-config : Copying over nova-api uWSGI config] *************** 2026-04-28 06:47:30.428403 | orchestrator | Tuesday 28 April 2026 06:47:21 +0000 (0:00:02.603) 0:04:23.275 ********* 2026-04-28 06:47:30.428414 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:47:30.428425 | orchestrator | changed: [testbed-node-1] 2026-04-28 06:47:30.428436 | orchestrator | changed: [testbed-node-2] 2026-04-28 06:47:30.428448 | orchestrator | 2026-04-28 06:47:30.428459 | orchestrator | TASK [service-uwsgi-config : Copying over nova-metadata uWSGI config] ********** 2026-04-28 06:47:30.428469 | orchestrator | Tuesday 28 April 2026 06:47:25 +0000 (0:00:03.368) 0:04:26.644 ********* 2026-04-28 06:47:30.428480 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:47:30.428491 | orchestrator | changed: [testbed-node-1] 2026-04-28 06:47:30.428502 | orchestrator | changed: [testbed-node-2] 2026-04-28 06:47:30.428513 | orchestrator | 2026-04-28 06:47:30.428525 | orchestrator | TASK [service-check-containers : nova | Check containers] ********************** 2026-04-28 06:47:30.428536 | orchestrator | Tuesday 28 April 2026 06:47:28 +0000 (0:00:03.466) 0:04:30.110 ********* 2026-04-28 06:47:30.428548 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:47:30.428568 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:47:30.428596 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:47:34.894849 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:47:34.894955 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:47:34.894984 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 06:47:34.895013 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 06:47:34.895039 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 06:47:34.895047 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 06:47:34.895055 | orchestrator | 2026-04-28 06:47:34.895064 | orchestrator | TASK [service-check-containers : nova | Notify handlers to restart containers] *** 2026-04-28 06:47:34.895073 | orchestrator | Tuesday 28 April 2026 06:47:33 +0000 (0:00:04.403) 0:04:34.514 ********* 2026-04-28 06:47:34.895081 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 06:47:34.895089 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 06:47:34.895097 | orchestrator | } 2026-04-28 06:47:34.895104 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 06:47:34.895112 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 06:47:34.895119 | orchestrator | } 2026-04-28 06:47:34.895126 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 06:47:34.895133 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 06:47:34.895140 | orchestrator | } 2026-04-28 06:47:34.895148 | orchestrator | 2026-04-28 06:47:34.895155 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 06:47:34.895163 | orchestrator | Tuesday 28 April 2026 06:47:34 +0000 (0:00:01.410) 0:04:35.925 ********* 2026-04-28 06:47:34.895175 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:47:34.895190 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:47:34.895204 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 06:49:11.832382 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:49:11.832503 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:49:11.832525 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:49:11.832577 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 06:49:11.832590 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:49:11.832603 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:49:11.832634 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 06:49:11.832648 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 06:49:11.832667 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:49:11.832679 | orchestrator | 2026-04-28 06:49:11.832690 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-28 06:49:11.832702 | orchestrator | Tuesday 28 April 2026 06:47:36 +0000 (0:00:02.314) 0:04:38.239 ********* 2026-04-28 06:49:11.832713 | orchestrator | 2026-04-28 06:49:11.832811 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-28 06:49:11.832830 | orchestrator | Tuesday 28 April 2026 06:47:37 +0000 (0:00:00.756) 0:04:38.996 ********* 2026-04-28 06:49:11.832842 | orchestrator | 2026-04-28 06:49:11.832853 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-28 06:49:11.832864 | orchestrator | Tuesday 28 April 2026 06:47:38 +0000 (0:00:00.526) 0:04:39.523 ********* 2026-04-28 06:49:11.832874 | orchestrator | 2026-04-28 06:49:11.832885 | orchestrator | RUNNING HANDLER [nova : Restart nova-scheduler container] ********************** 2026-04-28 06:49:11.832895 | orchestrator | Tuesday 28 April 2026 06:47:38 +0000 (0:00:00.873) 0:04:40.396 ********* 2026-04-28 06:49:11.832906 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:49:11.832923 | orchestrator | changed: [testbed-node-1] 2026-04-28 06:49:11.832935 | orchestrator | changed: [testbed-node-2] 2026-04-28 06:49:11.832945 | orchestrator | 2026-04-28 06:49:11.832956 | orchestrator | RUNNING HANDLER [nova : Restart nova-api container] **************************** 2026-04-28 06:49:11.832966 | orchestrator | Tuesday 28 April 2026 06:48:05 +0000 (0:00:26.789) 0:05:07.186 ********* 2026-04-28 06:49:11.832977 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:49:11.832988 | orchestrator | changed: [testbed-node-1] 2026-04-28 06:49:11.832998 | orchestrator | changed: [testbed-node-2] 2026-04-28 06:49:11.833009 | orchestrator | 2026-04-28 06:49:11.833020 | orchestrator | RUNNING HANDLER [nova : Restart nova-metadata container] *********************** 2026-04-28 06:49:11.833030 | orchestrator | Tuesday 28 April 2026 06:48:19 +0000 (0:00:13.982) 0:05:21.168 ********* 2026-04-28 06:49:11.833041 | orchestrator | changed: [testbed-node-1] 2026-04-28 06:49:11.833051 | orchestrator | changed: [testbed-node-2] 2026-04-28 06:49:11.833062 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:49:11.833073 | orchestrator | 2026-04-28 06:49:11.833083 | orchestrator | PLAY [Apply role nova-cell] **************************************************** 2026-04-28 06:49:11.833094 | orchestrator | 2026-04-28 06:49:11.833104 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-28 06:49:11.833115 | orchestrator | Tuesday 28 April 2026 06:48:30 +0000 (0:00:10.906) 0:05:32.075 ********* 2026-04-28 06:49:11.833126 | orchestrator | included: /ansible/roles/nova-cell/tasks/reconfigure.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 06:49:11.833138 | orchestrator | 2026-04-28 06:49:11.833149 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-28 06:49:11.833160 | orchestrator | Tuesday 28 April 2026 06:48:33 +0000 (0:00:02.489) 0:05:34.565 ********* 2026-04-28 06:49:11.833170 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:49:11.833192 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:49:11.833204 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:49:11.833215 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:49:11.833225 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:49:11.833236 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:49:11.833246 | orchestrator | 2026-04-28 06:49:11.833257 | orchestrator | TASK [nova-cell : Get new Libvirt version] ************************************* 2026-04-28 06:49:11.833268 | orchestrator | Tuesday 28 April 2026 06:48:35 +0000 (0:00:02.566) 0:05:37.131 ********* 2026-04-28 06:49:11.833278 | orchestrator | changed: [testbed-node-3] 2026-04-28 06:49:11.833289 | orchestrator | 2026-04-28 06:49:11.833300 | orchestrator | TASK [nova-cell : Cache new Libvirt version] *********************************** 2026-04-28 06:49:11.833319 | orchestrator | Tuesday 28 April 2026 06:49:10 +0000 (0:00:34.711) 0:06:11.843 ********* 2026-04-28 06:49:11.833330 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:49:11.833342 | orchestrator | 2026-04-28 06:49:11.833362 | orchestrator | TASK [Get nova_libvirt image info] ********************************************* 2026-04-28 06:50:02.278548 | orchestrator | Tuesday 28 April 2026 06:49:12 +0000 (0:00:02.460) 0:06:14.303 ********* 2026-04-28 06:50:02.278666 | orchestrator | included: service-image-info for testbed-node-3 2026-04-28 06:50:02.278682 | orchestrator | 2026-04-28 06:50:02.278694 | orchestrator | TASK [service-image-info : community.docker.docker_image_info] ***************** 2026-04-28 06:50:02.278753 | orchestrator | Tuesday 28 April 2026 06:49:14 +0000 (0:00:02.037) 0:06:16.341 ********* 2026-04-28 06:50:02.278764 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:50:02.278775 | orchestrator | 2026-04-28 06:50:02.278786 | orchestrator | TASK [service-image-info : set_fact] ******************************************* 2026-04-28 06:50:02.278797 | orchestrator | Tuesday 28 April 2026 06:49:19 +0000 (0:00:04.543) 0:06:20.884 ********* 2026-04-28 06:50:02.278808 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:50:02.278819 | orchestrator | 2026-04-28 06:50:02.278830 | orchestrator | TASK [service-image-info : containers.podman.podman_image_info] **************** 2026-04-28 06:50:02.278841 | orchestrator | Tuesday 28 April 2026 06:49:22 +0000 (0:00:03.072) 0:06:23.956 ********* 2026-04-28 06:50:02.278852 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:50:02.278863 | orchestrator | 2026-04-28 06:50:02.278874 | orchestrator | TASK [service-image-info : set_fact] ******************************************* 2026-04-28 06:50:02.278885 | orchestrator | Tuesday 28 April 2026 06:49:25 +0000 (0:00:03.213) 0:06:27.170 ********* 2026-04-28 06:50:02.278895 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:50:02.278906 | orchestrator | 2026-04-28 06:50:02.278917 | orchestrator | TASK [nova-cell : Get container facts] ***************************************** 2026-04-28 06:50:02.278928 | orchestrator | Tuesday 28 April 2026 06:49:28 +0000 (0:00:03.033) 0:06:30.203 ********* 2026-04-28 06:50:02.278938 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:50:02.278949 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:50:02.278960 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:50:02.278971 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:50:02.278981 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:50:02.278992 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:50:02.279003 | orchestrator | 2026-04-28 06:50:02.279014 | orchestrator | TASK [nova-cell : Get current Libvirt version] ********************************* 2026-04-28 06:50:02.279024 | orchestrator | Tuesday 28 April 2026 06:49:33 +0000 (0:00:05.178) 0:06:35.382 ********* 2026-04-28 06:50:02.279035 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:50:02.279046 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:50:02.279057 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:50:02.279068 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:50:02.279078 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:50:02.279092 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:50:02.279104 | orchestrator | 2026-04-28 06:50:02.279117 | orchestrator | TASK [nova-cell : Check that the new Libvirt version is >= current] ************ 2026-04-28 06:50:02.279130 | orchestrator | Tuesday 28 April 2026 06:49:39 +0000 (0:00:05.856) 0:06:41.238 ********* 2026-04-28 06:50:02.279142 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:50:02.279154 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:50:02.279167 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:50:02.279180 | orchestrator | ok: [testbed-node-4] => { 2026-04-28 06:50:02.279192 | orchestrator |  "changed": false, 2026-04-28 06:50:02.279204 | orchestrator |  "msg": "Libvirt version check successful: target 10.0.0 >= current 10.0.0.\n" 2026-04-28 06:50:02.279217 | orchestrator | } 2026-04-28 06:50:02.279231 | orchestrator | ok: [testbed-node-5] => { 2026-04-28 06:50:02.279244 | orchestrator |  "changed": false, 2026-04-28 06:50:02.279272 | orchestrator |  "msg": "Libvirt version check successful: target 10.0.0 >= current 10.0.0.\n" 2026-04-28 06:50:02.279286 | orchestrator | } 2026-04-28 06:50:02.279322 | orchestrator | ok: [testbed-node-3] => { 2026-04-28 06:50:02.279335 | orchestrator |  "changed": false, 2026-04-28 06:50:02.279348 | orchestrator |  "msg": "Libvirt version check successful: target 10.0.0 >= current 10.0.0.\n" 2026-04-28 06:50:02.279360 | orchestrator | } 2026-04-28 06:50:02.279372 | orchestrator | 2026-04-28 06:50:02.279384 | orchestrator | TASK [Load and persist br_netfilter module] ************************************ 2026-04-28 06:50:02.279398 | orchestrator | Tuesday 28 April 2026 06:49:46 +0000 (0:00:06.808) 0:06:48.046 ********* 2026-04-28 06:50:02.279410 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:50:02.279423 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:50:02.279435 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:50:02.279447 | orchestrator | included: module-load for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 06:50:02.279457 | orchestrator | 2026-04-28 06:50:02.279468 | orchestrator | TASK [module-load : Load modules] ********************************************** 2026-04-28 06:50:02.279479 | orchestrator | Tuesday 28 April 2026 06:49:48 +0000 (0:00:02.066) 0:06:50.113 ********* 2026-04-28 06:50:02.279490 | orchestrator | ok: [testbed-node-4] => (item=br_netfilter) 2026-04-28 06:50:02.279500 | orchestrator | ok: [testbed-node-3] => (item=br_netfilter) 2026-04-28 06:50:02.279511 | orchestrator | ok: [testbed-node-5] => (item=br_netfilter) 2026-04-28 06:50:02.279522 | orchestrator | 2026-04-28 06:50:02.279533 | orchestrator | TASK [module-load : Persist modules via modules-load.d] ************************ 2026-04-28 06:50:02.279543 | orchestrator | Tuesday 28 April 2026 06:49:50 +0000 (0:00:01.677) 0:06:51.791 ********* 2026-04-28 06:50:02.279554 | orchestrator | ok: [testbed-node-3] => (item=br_netfilter) 2026-04-28 06:50:02.279565 | orchestrator | ok: [testbed-node-4] => (item=br_netfilter) 2026-04-28 06:50:02.279575 | orchestrator | ok: [testbed-node-5] => (item=br_netfilter) 2026-04-28 06:50:02.279586 | orchestrator | 2026-04-28 06:50:02.279597 | orchestrator | TASK [module-load : Drop module persistence] *********************************** 2026-04-28 06:50:02.279607 | orchestrator | Tuesday 28 April 2026 06:49:52 +0000 (0:00:02.108) 0:06:53.899 ********* 2026-04-28 06:50:02.279618 | orchestrator | skipping: [testbed-node-3] => (item=br_netfilter)  2026-04-28 06:50:02.279628 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:50:02.279639 | orchestrator | skipping: [testbed-node-4] => (item=br_netfilter)  2026-04-28 06:50:02.279650 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:50:02.279661 | orchestrator | skipping: [testbed-node-5] => (item=br_netfilter)  2026-04-28 06:50:02.279672 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:50:02.279682 | orchestrator | 2026-04-28 06:50:02.279693 | orchestrator | TASK [nova-cell : Enable bridge-nf-call sysctl variables] ********************** 2026-04-28 06:50:02.279741 | orchestrator | Tuesday 28 April 2026 06:49:53 +0000 (0:00:01.362) 0:06:55.262 ********* 2026-04-28 06:50:02.279754 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-28 06:50:02.279765 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-28 06:50:02.279775 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:50:02.279786 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-28 06:50:02.279797 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-28 06:50:02.279807 | orchestrator | ok: [testbed-node-3] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-28 06:50:02.279820 | orchestrator | ok: [testbed-node-4] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-28 06:50:02.279839 | orchestrator | ok: [testbed-node-5] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-28 06:50:02.279857 | orchestrator | ok: [testbed-node-3] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-28 06:50:02.279877 | orchestrator | ok: [testbed-node-5] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-28 06:50:02.279916 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:50:02.279937 | orchestrator | ok: [testbed-node-4] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-28 06:50:02.279965 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-28 06:50:02.279986 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-28 06:50:02.279997 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:50:02.280007 | orchestrator | 2026-04-28 06:50:02.280018 | orchestrator | TASK [nova-cell : Install udev kolla kvm rules] ******************************** 2026-04-28 06:50:02.280028 | orchestrator | Tuesday 28 April 2026 06:49:56 +0000 (0:00:02.426) 0:06:57.689 ********* 2026-04-28 06:50:02.280039 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:50:02.280050 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:50:02.280060 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:50:02.280071 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:50:02.280082 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:50:02.280092 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:50:02.280103 | orchestrator | 2026-04-28 06:50:02.280113 | orchestrator | TASK [nova-cell : Mask qemu-kvm service] *************************************** 2026-04-28 06:50:02.280124 | orchestrator | Tuesday 28 April 2026 06:49:58 +0000 (0:00:02.191) 0:06:59.881 ********* 2026-04-28 06:50:02.280134 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:50:02.280145 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:50:02.280156 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:50:02.280166 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:50:02.280177 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:50:02.280187 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:50:02.280198 | orchestrator | 2026-04-28 06:50:02.280208 | orchestrator | TASK [nova-cell : Ensuring config directories exist] *************************** 2026-04-28 06:50:02.280219 | orchestrator | Tuesday 28 April 2026 06:50:01 +0000 (0:00:02.715) 0:07:02.596 ********* 2026-04-28 06:50:02.280240 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 06:50:02.280255 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 06:50:02.280277 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 06:50:06.671122 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 06:50:06.671211 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 06:50:06.671241 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 06:50:06.671254 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 06:50:06.671266 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 06:50:06.671279 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 06:50:06.671328 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 06:50:06.671342 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 06:50:06.671358 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 06:50:06.671371 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 06:50:06.671382 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 06:50:06.671393 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 06:50:06.671413 | orchestrator | 2026-04-28 06:50:06.671426 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-28 06:50:06.671439 | orchestrator | Tuesday 28 April 2026 06:50:05 +0000 (0:00:04.365) 0:07:06.962 ********* 2026-04-28 06:50:06.671457 | orchestrator | included: /ansible/roles/nova-cell/tasks/copy-certs.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 06:50:10.768360 | orchestrator | 2026-04-28 06:50:10.768477 | orchestrator | TASK [service-cert-copy : nova | Copying over extra CA certificates] *********** 2026-04-28 06:50:10.768502 | orchestrator | Tuesday 28 April 2026 06:50:07 +0000 (0:00:02.085) 0:07:09.048 ********* 2026-04-28 06:50:10.768525 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 06:50:10.768565 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 06:50:10.768588 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 06:50:10.768610 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 06:50:10.768679 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 06:50:10.768753 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 06:50:10.768766 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 06:50:10.768782 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 06:50:10.768792 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 06:50:10.768802 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 06:50:10.768820 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 06:50:10.768839 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 06:50:15.319065 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 06:50:15.319162 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 06:50:15.319174 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 06:50:15.319181 | orchestrator | 2026-04-28 06:50:15.319189 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS certificate] *** 2026-04-28 06:50:15.319215 | orchestrator | Tuesday 28 April 2026 06:50:13 +0000 (0:00:05.824) 0:07:14.873 ********* 2026-04-28 06:50:15.319223 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 06:50:15.319232 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 06:50:15.319253 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 06:50:15.319261 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:50:15.319272 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 06:50:15.319279 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 06:50:15.319290 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 06:50:15.319297 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 06:50:15.319304 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:50:15.319316 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 06:50:18.790252 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 06:50:18.790392 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:50:18.790440 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 06:50:18.790457 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 06:50:18.790492 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 06:50:18.790505 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:50:18.790517 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 06:50:18.790528 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:50:18.790559 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 06:50:18.790571 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 06:50:18.790582 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:50:18.790593 | orchestrator | 2026-04-28 06:50:18.790606 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS key] ******** 2026-04-28 06:50:18.790619 | orchestrator | Tuesday 28 April 2026 06:50:17 +0000 (0:00:04.097) 0:07:18.971 ********* 2026-04-28 06:50:18.790636 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 06:50:18.790657 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 06:50:18.790669 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 06:50:18.790680 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 06:50:18.790739 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 06:50:26.995068 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 06:50:26.995177 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:50:26.995189 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:50:26.995198 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 06:50:26.995208 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 06:50:26.995217 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 06:50:26.995224 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:50:26.995233 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 06:50:26.995260 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 06:50:26.995275 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 06:50:26.995283 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:50:26.995291 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 06:50:26.995298 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:50:26.995305 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 06:50:26.995313 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 06:50:26.995320 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:50:26.995328 | orchestrator | 2026-04-28 06:50:26.995336 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-28 06:50:26.995344 | orchestrator | Tuesday 28 April 2026 06:50:21 +0000 (0:00:03.922) 0:07:22.893 ********* 2026-04-28 06:50:26.995352 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:50:26.995359 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:50:26.995366 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:50:26.995374 | orchestrator | included: /ansible/roles/nova-cell/tasks/external_ceph.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 06:50:26.995381 | orchestrator | 2026-04-28 06:50:26.995389 | orchestrator | TASK [nova-cell : Check nova keyring file] ************************************* 2026-04-28 06:50:26.995397 | orchestrator | Tuesday 28 April 2026 06:50:23 +0000 (0:00:02.239) 0:07:25.132 ********* 2026-04-28 06:50:26.995404 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 06:50:26.995411 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 06:50:26.995418 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 06:50:26.995431 | orchestrator | 2026-04-28 06:50:26.995439 | orchestrator | TASK [nova-cell : Check cinder keyring file] *********************************** 2026-04-28 06:50:26.995446 | orchestrator | Tuesday 28 April 2026 06:50:25 +0000 (0:00:02.314) 0:07:27.447 ********* 2026-04-28 06:50:26.995453 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 06:50:26.995460 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 06:50:26.995468 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 06:50:26.995475 | orchestrator | 2026-04-28 06:50:26.995487 | orchestrator | TASK [nova-cell : Extract nova key from file] ********************************** 2026-04-28 06:51:10.833088 | orchestrator | Tuesday 28 April 2026 06:50:28 +0000 (0:00:02.071) 0:07:29.518 ********* 2026-04-28 06:51:10.833233 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:51:10.833263 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:51:10.833285 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:51:10.833305 | orchestrator | 2026-04-28 06:51:10.833326 | orchestrator | TASK [nova-cell : Extract cinder key from file] ******************************** 2026-04-28 06:51:10.833345 | orchestrator | Tuesday 28 April 2026 06:50:29 +0000 (0:00:01.552) 0:07:31.070 ********* 2026-04-28 06:51:10.833385 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:51:10.833406 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:51:10.833417 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:51:10.833428 | orchestrator | 2026-04-28 06:51:10.833440 | orchestrator | TASK [nova-cell : Copy over ceph nova keyring file] **************************** 2026-04-28 06:51:10.833451 | orchestrator | Tuesday 28 April 2026 06:50:31 +0000 (0:00:01.815) 0:07:32.886 ********* 2026-04-28 06:51:10.833462 | orchestrator | ok: [testbed-node-3] => (item=nova-compute) 2026-04-28 06:51:10.833474 | orchestrator | ok: [testbed-node-4] => (item=nova-compute) 2026-04-28 06:51:10.833485 | orchestrator | ok: [testbed-node-5] => (item=nova-compute) 2026-04-28 06:51:10.833495 | orchestrator | 2026-04-28 06:51:10.833506 | orchestrator | TASK [nova-cell : Copy over ceph cinder keyring file] ************************** 2026-04-28 06:51:10.833517 | orchestrator | Tuesday 28 April 2026 06:50:33 +0000 (0:00:02.223) 0:07:35.110 ********* 2026-04-28 06:51:10.833529 | orchestrator | ok: [testbed-node-3] => (item=nova-compute) 2026-04-28 06:51:10.833540 | orchestrator | ok: [testbed-node-4] => (item=nova-compute) 2026-04-28 06:51:10.833551 | orchestrator | ok: [testbed-node-5] => (item=nova-compute) 2026-04-28 06:51:10.833562 | orchestrator | 2026-04-28 06:51:10.833573 | orchestrator | TASK [nova-cell : Copy over ceph.conf] ***************************************** 2026-04-28 06:51:10.833584 | orchestrator | Tuesday 28 April 2026 06:50:35 +0000 (0:00:02.275) 0:07:37.386 ********* 2026-04-28 06:51:10.833598 | orchestrator | ok: [testbed-node-3] => (item=nova-compute) 2026-04-28 06:51:10.833612 | orchestrator | ok: [testbed-node-4] => (item=nova-compute) 2026-04-28 06:51:10.833624 | orchestrator | ok: [testbed-node-5] => (item=nova-compute) 2026-04-28 06:51:10.833637 | orchestrator | ok: [testbed-node-3] => (item=nova-libvirt) 2026-04-28 06:51:10.833649 | orchestrator | ok: [testbed-node-4] => (item=nova-libvirt) 2026-04-28 06:51:10.833662 | orchestrator | ok: [testbed-node-5] => (item=nova-libvirt) 2026-04-28 06:51:10.833705 | orchestrator | 2026-04-28 06:51:10.833725 | orchestrator | TASK [nova-cell : Ensure /etc/ceph directory exists (host libvirt)] ************ 2026-04-28 06:51:10.833739 | orchestrator | Tuesday 28 April 2026 06:50:40 +0000 (0:00:04.995) 0:07:42.382 ********* 2026-04-28 06:51:10.833751 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:51:10.833764 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:51:10.833776 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:51:10.833789 | orchestrator | 2026-04-28 06:51:10.833801 | orchestrator | TASK [nova-cell : Copy over ceph.conf (host libvirt)] ************************** 2026-04-28 06:51:10.833814 | orchestrator | Tuesday 28 April 2026 06:50:42 +0000 (0:00:01.531) 0:07:43.913 ********* 2026-04-28 06:51:10.833826 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:51:10.833839 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:51:10.833851 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:51:10.833863 | orchestrator | 2026-04-28 06:51:10.833875 | orchestrator | TASK [nova-cell : Ensuring libvirt secrets directory exists] ******************* 2026-04-28 06:51:10.833912 | orchestrator | Tuesday 28 April 2026 06:50:43 +0000 (0:00:01.385) 0:07:45.298 ********* 2026-04-28 06:51:10.833925 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:51:10.833938 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:51:10.833951 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:51:10.833961 | orchestrator | 2026-04-28 06:51:10.833972 | orchestrator | TASK [nova-cell : Pushing nova secret xml for libvirt] ************************* 2026-04-28 06:51:10.833983 | orchestrator | Tuesday 28 April 2026 06:50:46 +0000 (0:00:02.269) 0:07:47.568 ********* 2026-04-28 06:51:10.833996 | orchestrator | changed: [testbed-node-3] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'ceph-ephemeral-nova', 'desc': 'Ceph Client Secret for Ephemeral Storage (Nova)', 'enabled': True}) 2026-04-28 06:51:10.834009 | orchestrator | changed: [testbed-node-4] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'ceph-ephemeral-nova', 'desc': 'Ceph Client Secret for Ephemeral Storage (Nova)', 'enabled': True}) 2026-04-28 06:51:10.834070 | orchestrator | changed: [testbed-node-5] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'ceph-ephemeral-nova', 'desc': 'Ceph Client Secret for Ephemeral Storage (Nova)', 'enabled': True}) 2026-04-28 06:51:10.834083 | orchestrator | changed: [testbed-node-3] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'ceph-persistent-cinder', 'desc': 'Ceph Client Secret for Persistent Storage (Cinder)', 'enabled': 'yes'}) 2026-04-28 06:51:10.834095 | orchestrator | changed: [testbed-node-4] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'ceph-persistent-cinder', 'desc': 'Ceph Client Secret for Persistent Storage (Cinder)', 'enabled': 'yes'}) 2026-04-28 06:51:10.834106 | orchestrator | changed: [testbed-node-5] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'ceph-persistent-cinder', 'desc': 'Ceph Client Secret for Persistent Storage (Cinder)', 'enabled': 'yes'}) 2026-04-28 06:51:10.834117 | orchestrator | 2026-04-28 06:51:10.834127 | orchestrator | TASK [nova-cell : Pushing secrets key for libvirt] ***************************** 2026-04-28 06:51:10.834138 | orchestrator | Tuesday 28 April 2026 06:50:50 +0000 (0:00:04.535) 0:07:52.103 ********* 2026-04-28 06:51:10.834149 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-28 06:51:10.834160 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-28 06:51:10.834191 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-28 06:51:10.834203 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-28 06:51:10.834214 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:51:10.834225 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-28 06:51:10.834246 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:51:10.834257 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-28 06:51:10.834268 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:51:10.834279 | orchestrator | 2026-04-28 06:51:10.834290 | orchestrator | TASK [nova-cell : Include tasks from qemu_wrapper.yml] ************************* 2026-04-28 06:51:10.834307 | orchestrator | Tuesday 28 April 2026 06:50:55 +0000 (0:00:04.635) 0:07:56.739 ********* 2026-04-28 06:51:10.834318 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:51:10.834329 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:51:10.834340 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:51:10.834352 | orchestrator | included: /ansible/roles/nova-cell/tasks/qemu_wrapper.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 06:51:10.834363 | orchestrator | 2026-04-28 06:51:10.834373 | orchestrator | TASK [nova-cell : Check qemu wrapper file] ************************************* 2026-04-28 06:51:10.834384 | orchestrator | Tuesday 28 April 2026 06:50:58 +0000 (0:00:03.436) 0:08:00.175 ********* 2026-04-28 06:51:10.834395 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 06:51:10.834406 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 06:51:10.834416 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 06:51:10.834427 | orchestrator | 2026-04-28 06:51:10.834438 | orchestrator | TASK [nova-cell : Copy qemu wrapper] ******************************************* 2026-04-28 06:51:10.834458 | orchestrator | Tuesday 28 April 2026 06:51:00 +0000 (0:00:02.138) 0:08:02.313 ********* 2026-04-28 06:51:10.834469 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:51:10.834479 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:51:10.834490 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:51:10.834500 | orchestrator | 2026-04-28 06:51:10.834511 | orchestrator | TASK [nova-cell : Check if policies shall be overwritten] ********************** 2026-04-28 06:51:10.834522 | orchestrator | Tuesday 28 April 2026 06:51:02 +0000 (0:00:01.322) 0:08:03.636 ********* 2026-04-28 06:51:10.834533 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:51:10.834543 | orchestrator | 2026-04-28 06:51:10.834554 | orchestrator | TASK [nova-cell : Set nova policy file] **************************************** 2026-04-28 06:51:10.834565 | orchestrator | Tuesday 28 April 2026 06:51:03 +0000 (0:00:01.161) 0:08:04.798 ********* 2026-04-28 06:51:10.834575 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:51:10.834586 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:51:10.834597 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:51:10.834607 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:51:10.834618 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:51:10.834628 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:51:10.834639 | orchestrator | 2026-04-28 06:51:10.834649 | orchestrator | TASK [nova-cell : Check for vendordata file] *********************************** 2026-04-28 06:51:10.834660 | orchestrator | Tuesday 28 April 2026 06:51:05 +0000 (0:00:02.016) 0:08:06.815 ********* 2026-04-28 06:51:10.834717 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 06:51:10.834731 | orchestrator | 2026-04-28 06:51:10.834742 | orchestrator | TASK [nova-cell : Set vendordata file path] ************************************ 2026-04-28 06:51:10.834753 | orchestrator | Tuesday 28 April 2026 06:51:07 +0000 (0:00:01.744) 0:08:08.559 ********* 2026-04-28 06:51:10.834764 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:51:10.834774 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:51:10.834785 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:51:10.834795 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:51:10.834806 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:51:10.834817 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:51:10.834828 | orchestrator | 2026-04-28 06:51:10.834839 | orchestrator | TASK [nova-cell : Copying over config.json files for services] ***************** 2026-04-28 06:51:10.834850 | orchestrator | Tuesday 28 April 2026 06:51:08 +0000 (0:00:01.766) 0:08:10.326 ********* 2026-04-28 06:51:10.834865 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 06:51:10.834891 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 06:51:13.704097 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 06:51:13.704202 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 06:51:13.704219 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 06:51:13.704232 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 06:51:13.704245 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 06:51:13.704256 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 06:51:13.704320 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 06:51:13.704335 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 06:51:13.704348 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 06:51:13.704360 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 06:51:13.704372 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 06:51:13.704391 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 06:51:19.665217 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 06:51:19.665330 | orchestrator | 2026-04-28 06:51:19.665347 | orchestrator | TASK [nova-cell : Copying over nova.conf] ************************************** 2026-04-28 06:51:19.665360 | orchestrator | Tuesday 28 April 2026 06:51:15 +0000 (0:00:06.906) 0:08:17.233 ********* 2026-04-28 06:51:19.665374 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 06:51:19.665388 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 06:51:19.665400 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 06:51:19.665412 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 06:51:19.665471 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 06:51:19.665485 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 06:51:19.665498 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 06:51:19.665511 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 06:51:19.665523 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 06:51:19.665557 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 06:51:43.653715 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 06:51:43.653837 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 06:51:43.653868 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 06:51:43.653892 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 06:51:43.653905 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 06:51:43.653942 | orchestrator | 2026-04-28 06:51:43.653956 | orchestrator | TASK [nova-cell : Copying over Nova compute provider config] ******************* 2026-04-28 06:51:43.653968 | orchestrator | Tuesday 28 April 2026 06:51:25 +0000 (0:00:09.683) 0:08:26.916 ********* 2026-04-28 06:51:43.653980 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:51:43.653992 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:51:43.654003 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:51:43.654073 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:51:43.654086 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:51:43.654097 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:51:43.654108 | orchestrator | 2026-04-28 06:51:43.654119 | orchestrator | TASK [nova-cell : Copying over libvirt configuration] ************************** 2026-04-28 06:51:43.654131 | orchestrator | Tuesday 28 April 2026 06:51:28 +0000 (0:00:03.066) 0:08:29.983 ********* 2026-04-28 06:51:43.654141 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-28 06:51:43.654153 | orchestrator | ok: [testbed-node-3] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-28 06:51:43.654164 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-28 06:51:43.654191 | orchestrator | ok: [testbed-node-4] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-28 06:51:43.654222 | orchestrator | ok: [testbed-node-5] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-28 06:51:43.654235 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-28 06:51:43.654249 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:51:43.654262 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-28 06:51:43.654274 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:51:43.654286 | orchestrator | ok: [testbed-node-3] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-28 06:51:43.654299 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-28 06:51:43.654311 | orchestrator | ok: [testbed-node-4] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-28 06:51:43.654323 | orchestrator | ok: [testbed-node-5] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-28 06:51:43.654335 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-28 06:51:43.654348 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:51:43.654360 | orchestrator | 2026-04-28 06:51:43.654372 | orchestrator | TASK [nova-cell : Copying over libvirt TLS keys] ******************************* 2026-04-28 06:51:43.654385 | orchestrator | Tuesday 28 April 2026 06:51:33 +0000 (0:00:05.021) 0:08:35.004 ********* 2026-04-28 06:51:43.654397 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:51:43.654409 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:51:43.654422 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:51:43.654434 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:51:43.654447 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:51:43.654459 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:51:43.654471 | orchestrator | 2026-04-28 06:51:43.654484 | orchestrator | TASK [nova-cell : Copying over libvirt SASL configuration] ********************* 2026-04-28 06:51:43.654496 | orchestrator | Tuesday 28 April 2026 06:51:35 +0000 (0:00:01.946) 0:08:36.951 ********* 2026-04-28 06:51:43.654509 | orchestrator | ok: [testbed-node-3] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-28 06:51:43.654522 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-28 06:51:43.654544 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-28 06:51:43.654557 | orchestrator | ok: [testbed-node-4] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-28 06:51:43.654567 | orchestrator | ok: [testbed-node-5] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-28 06:51:43.654578 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-28 06:51:43.654589 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-28 06:51:43.654600 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-28 06:51:43.654610 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:51:43.654622 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-28 06:51:43.654632 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:51:43.654643 | orchestrator | ok: [testbed-node-3] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-28 06:51:43.654654 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-28 06:51:43.654726 | orchestrator | ok: [testbed-node-5] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-28 06:51:43.654737 | orchestrator | ok: [testbed-node-4] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-28 06:51:43.654748 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-28 06:51:43.654758 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-28 06:51:43.654769 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:51:43.654780 | orchestrator | ok: [testbed-node-3] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-28 06:51:43.654791 | orchestrator | ok: [testbed-node-5] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-28 06:51:43.654801 | orchestrator | ok: [testbed-node-4] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-28 06:51:43.654812 | orchestrator | 2026-04-28 06:51:43.654823 | orchestrator | TASK [nova-cell : Copying files for nova-ssh] ********************************** 2026-04-28 06:51:43.654833 | orchestrator | Tuesday 28 April 2026 06:51:41 +0000 (0:00:06.238) 0:08:43.190 ********* 2026-04-28 06:51:43.654844 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-28 06:51:43.654855 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-28 06:51:43.654872 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-28 06:51:43.654891 | orchestrator | ok: [testbed-node-4] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-28 06:52:01.258149 | orchestrator | ok: [testbed-node-5] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-28 06:52:01.258266 | orchestrator | ok: [testbed-node-3] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-28 06:52:01.258282 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-28 06:52:01.258294 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-28 06:52:01.258305 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-28 06:52:01.258317 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-28 06:52:01.258328 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:52:01.258366 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-28 06:52:01.258379 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:52:01.258389 | orchestrator | ok: [testbed-node-5] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-28 06:52:01.258401 | orchestrator | ok: [testbed-node-3] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-28 06:52:01.258411 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-28 06:52:01.258422 | orchestrator | ok: [testbed-node-4] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-28 06:52:01.258433 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-28 06:52:01.258443 | orchestrator | ok: [testbed-node-5] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-28 06:52:01.258454 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-28 06:52:01.258465 | orchestrator | ok: [testbed-node-3] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-28 06:52:01.258475 | orchestrator | ok: [testbed-node-4] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-28 06:52:01.258486 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-28 06:52:01.258496 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:52:01.258507 | orchestrator | ok: [testbed-node-5] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-28 06:52:01.258519 | orchestrator | ok: [testbed-node-3] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-28 06:52:01.258530 | orchestrator | ok: [testbed-node-4] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-28 06:52:01.258541 | orchestrator | 2026-04-28 06:52:01.258552 | orchestrator | TASK [nova-cell : Copying VMware vCenter CA file] ****************************** 2026-04-28 06:52:01.258563 | orchestrator | Tuesday 28 April 2026 06:51:49 +0000 (0:00:08.175) 0:08:51.365 ********* 2026-04-28 06:52:01.258574 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:52:01.258585 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:52:01.258596 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:52:01.258606 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:52:01.258617 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:52:01.258629 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:52:01.258642 | orchestrator | 2026-04-28 06:52:01.258680 | orchestrator | TASK [nova-cell : Copying 'release' file for nova_compute] ********************* 2026-04-28 06:52:01.258694 | orchestrator | Tuesday 28 April 2026 06:51:51 +0000 (0:00:01.938) 0:08:53.304 ********* 2026-04-28 06:52:01.258706 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:52:01.258719 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:52:01.258732 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:52:01.258744 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:52:01.258756 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:52:01.258768 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:52:01.258781 | orchestrator | 2026-04-28 06:52:01.258794 | orchestrator | TASK [nova-cell : Generating 'hostnqn' file for nova_compute] ****************** 2026-04-28 06:52:01.258808 | orchestrator | Tuesday 28 April 2026 06:51:53 +0000 (0:00:01.719) 0:08:55.024 ********* 2026-04-28 06:52:01.258820 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:52:01.258832 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:52:01.258843 | orchestrator | ok: [testbed-node-3] 2026-04-28 06:52:01.258855 | orchestrator | ok: [testbed-node-4] 2026-04-28 06:52:01.258866 | orchestrator | ok: [testbed-node-5] 2026-04-28 06:52:01.258877 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:52:01.258887 | orchestrator | 2026-04-28 06:52:01.258898 | orchestrator | TASK [nova-cell : Generating 'hostid' file for nova_compute] ******************* 2026-04-28 06:52:01.258909 | orchestrator | Tuesday 28 April 2026 06:51:56 +0000 (0:00:03.394) 0:08:58.418 ********* 2026-04-28 06:52:01.258920 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:52:01.258931 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:52:01.258950 | orchestrator | changed: [testbed-node-3] 2026-04-28 06:52:01.258961 | orchestrator | changed: [testbed-node-4] 2026-04-28 06:52:01.258972 | orchestrator | changed: [testbed-node-5] 2026-04-28 06:52:01.258982 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:52:01.258993 | orchestrator | 2026-04-28 06:52:01.259004 | orchestrator | TASK [nova-cell : Copying over existing policy file] *************************** 2026-04-28 06:52:01.259015 | orchestrator | Tuesday 28 April 2026 06:51:59 +0000 (0:00:03.008) 0:09:01.427 ********* 2026-04-28 06:52:01.259062 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 06:52:01.259080 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 06:52:01.259093 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 06:52:01.259106 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:52:01.259118 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 06:52:01.259129 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 06:52:01.259160 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 06:52:06.854644 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:52:06.854810 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 06:52:06.854842 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 06:52:06.854865 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:52:06.854888 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 06:52:06.854912 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 06:52:06.854958 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 06:52:06.854971 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:52:06.855018 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 06:52:06.855031 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 06:52:06.855043 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:52:06.855054 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 06:52:06.855066 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 06:52:06.855076 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:52:06.855088 | orchestrator | 2026-04-28 06:52:06.855099 | orchestrator | TASK [nova-cell : Copying over vendordata file to containers] ****************** 2026-04-28 06:52:06.855112 | orchestrator | Tuesday 28 April 2026 06:52:03 +0000 (0:00:03.103) 0:09:04.531 ********* 2026-04-28 06:52:06.855132 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute)  2026-04-28 06:52:06.855143 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute-ironic)  2026-04-28 06:52:06.855154 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:52:06.855166 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute)  2026-04-28 06:52:06.855179 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute-ironic)  2026-04-28 06:52:06.855191 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:52:06.855203 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute)  2026-04-28 06:52:06.855215 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute-ironic)  2026-04-28 06:52:06.855228 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:52:06.855240 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute)  2026-04-28 06:52:06.855252 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute-ironic)  2026-04-28 06:52:06.855265 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:52:06.855277 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute)  2026-04-28 06:52:06.855290 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute-ironic)  2026-04-28 06:52:06.855302 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:52:06.855315 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute)  2026-04-28 06:52:06.855327 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute-ironic)  2026-04-28 06:52:06.855339 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:52:06.855351 | orchestrator | 2026-04-28 06:52:06.855365 | orchestrator | TASK [service-check-containers : nova_cell | Check containers] ***************** 2026-04-28 06:52:06.855378 | orchestrator | Tuesday 28 April 2026 06:52:04 +0000 (0:00:01.769) 0:09:06.300 ********* 2026-04-28 06:52:06.855406 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 06:52:08.386415 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 06:52:08.386518 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 06:52:08.386559 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 06:52:08.386573 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 06:52:08.386600 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 06:52:08.386631 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 06:52:08.386643 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 06:52:08.386742 | orchestrator | changed: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 06:52:08.386764 | orchestrator | changed: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 06:52:08.386776 | orchestrator | changed: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 06:52:08.386794 | orchestrator | changed: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 06:52:08.386816 | orchestrator | changed: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 06:52:14.555948 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 06:52:14.556066 | orchestrator | changed: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 06:52:14.556123 | orchestrator | 2026-04-28 06:52:14.556147 | orchestrator | TASK [service-check-containers : nova_cell | Notify handlers to restart containers] *** 2026-04-28 06:52:14.556169 | orchestrator | Tuesday 28 April 2026 06:52:11 +0000 (0:00:06.600) 0:09:12.901 ********* 2026-04-28 06:52:14.556189 | orchestrator | changed: [testbed-node-3] => { 2026-04-28 06:52:14.556209 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 06:52:14.556226 | orchestrator | } 2026-04-28 06:52:14.556244 | orchestrator | changed: [testbed-node-4] => { 2026-04-28 06:52:14.556263 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 06:52:14.556283 | orchestrator | } 2026-04-28 06:52:14.556300 | orchestrator | changed: [testbed-node-5] => { 2026-04-28 06:52:14.556319 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 06:52:14.556338 | orchestrator | } 2026-04-28 06:52:14.556358 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 06:52:14.556377 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 06:52:14.556398 | orchestrator | } 2026-04-28 06:52:14.556419 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 06:52:14.556440 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 06:52:14.556456 | orchestrator | } 2026-04-28 06:52:14.556466 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 06:52:14.556478 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 06:52:14.556488 | orchestrator | } 2026-04-28 06:52:14.556500 | orchestrator | 2026-04-28 06:52:14.556511 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 06:52:14.556522 | orchestrator | Tuesday 28 April 2026 06:52:13 +0000 (0:00:01.897) 0:09:14.798 ********* 2026-04-28 06:52:14.556535 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 06:52:14.556566 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 06:52:14.556603 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 06:52:14.556629 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:52:14.556641 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 06:52:14.556685 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 06:52:14.556696 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 06:52:14.556707 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:52:14.556725 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 06:52:14.556744 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 06:56:55.478244 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 06:56:55.478343 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:56:55.478355 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 06:56:55.478365 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 06:56:55.478373 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:56:55.478405 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 06:56:55.478427 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 06:56:55.478451 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:56:55.478459 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 06:56:55.478479 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 06:56:55.478486 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:56:55.478493 | orchestrator | 2026-04-28 06:56:55.478501 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-28 06:56:55.478509 | orchestrator | Tuesday 28 April 2026 06:52:16 +0000 (0:00:03.530) 0:09:18.329 ********* 2026-04-28 06:56:55.478557 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:56:55.478565 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:56:55.478572 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:56:55.478579 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:56:55.478586 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:56:55.478592 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:56:55.478599 | orchestrator | 2026-04-28 06:56:55.478606 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-28 06:56:55.478613 | orchestrator | Tuesday 28 April 2026 06:52:18 +0000 (0:00:01.790) 0:09:20.120 ********* 2026-04-28 06:56:55.478620 | orchestrator | 2026-04-28 06:56:55.478627 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-28 06:56:55.478634 | orchestrator | Tuesday 28 April 2026 06:52:19 +0000 (0:00:00.513) 0:09:20.634 ********* 2026-04-28 06:56:55.478641 | orchestrator | 2026-04-28 06:56:55.478648 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-28 06:56:55.478654 | orchestrator | Tuesday 28 April 2026 06:52:19 +0000 (0:00:00.802) 0:09:21.436 ********* 2026-04-28 06:56:55.478661 | orchestrator | 2026-04-28 06:56:55.478668 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-28 06:56:55.478675 | orchestrator | Tuesday 28 April 2026 06:52:20 +0000 (0:00:00.526) 0:09:21.963 ********* 2026-04-28 06:56:55.478682 | orchestrator | 2026-04-28 06:56:55.478689 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-28 06:56:55.478696 | orchestrator | Tuesday 28 April 2026 06:52:21 +0000 (0:00:00.590) 0:09:22.553 ********* 2026-04-28 06:56:55.478703 | orchestrator | 2026-04-28 06:56:55.478709 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-28 06:56:55.478716 | orchestrator | Tuesday 28 April 2026 06:52:21 +0000 (0:00:00.547) 0:09:23.101 ********* 2026-04-28 06:56:55.478723 | orchestrator | 2026-04-28 06:56:55.478730 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-conductor container] ***************** 2026-04-28 06:56:55.478736 | orchestrator | Tuesday 28 April 2026 06:52:22 +0000 (0:00:00.887) 0:09:23.989 ********* 2026-04-28 06:56:55.478743 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:56:55.478750 | orchestrator | changed: [testbed-node-2] 2026-04-28 06:56:55.478757 | orchestrator | changed: [testbed-node-1] 2026-04-28 06:56:55.478763 | orchestrator | 2026-04-28 06:56:55.478776 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-novncproxy container] **************** 2026-04-28 06:56:55.478783 | orchestrator | Tuesday 28 April 2026 06:54:38 +0000 (0:02:15.539) 0:11:39.529 ********* 2026-04-28 06:56:55.478790 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:56:55.478797 | orchestrator | changed: [testbed-node-1] 2026-04-28 06:56:55.478807 | orchestrator | changed: [testbed-node-2] 2026-04-28 06:56:55.478817 | orchestrator | 2026-04-28 06:56:55.478826 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-ssh container] *********************** 2026-04-28 06:56:55.478837 | orchestrator | Tuesday 28 April 2026 06:55:00 +0000 (0:00:22.348) 0:12:01.878 ********* 2026-04-28 06:56:55.478848 | orchestrator | changed: [testbed-node-3] 2026-04-28 06:56:55.478858 | orchestrator | changed: [testbed-node-4] 2026-04-28 06:56:55.478866 | orchestrator | changed: [testbed-node-5] 2026-04-28 06:56:55.478876 | orchestrator | 2026-04-28 06:56:55.478886 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-libvirt container] ******************* 2026-04-28 06:56:55.478894 | orchestrator | Tuesday 28 April 2026 06:55:27 +0000 (0:00:26.638) 0:12:28.516 ********* 2026-04-28 06:56:55.478904 | orchestrator | changed: [testbed-node-3] 2026-04-28 06:56:55.478913 | orchestrator | changed: [testbed-node-4] 2026-04-28 06:56:55.478923 | orchestrator | changed: [testbed-node-5] 2026-04-28 06:56:55.478933 | orchestrator | 2026-04-28 06:56:55.478946 | orchestrator | RUNNING HANDLER [nova-cell : Checking libvirt container is ready] ************** 2026-04-28 06:56:55.478955 | orchestrator | Tuesday 28 April 2026 06:56:11 +0000 (0:00:44.470) 0:13:12.987 ********* 2026-04-28 06:56:55.478965 | orchestrator | changed: [testbed-node-3] 2026-04-28 06:56:55.478975 | orchestrator | changed: [testbed-node-4] 2026-04-28 06:56:55.478985 | orchestrator | FAILED - RETRYING: [testbed-node-5]: Checking libvirt container is ready (10 retries left). 2026-04-28 06:56:55.478996 | orchestrator | changed: [testbed-node-5] 2026-04-28 06:56:55.479005 | orchestrator | 2026-04-28 06:56:55.479015 | orchestrator | RUNNING HANDLER [nova-cell : Create libvirt SASL user] ************************* 2026-04-28 06:56:55.479024 | orchestrator | Tuesday 28 April 2026 06:56:18 +0000 (0:00:07.399) 0:13:20.387 ********* 2026-04-28 06:56:55.479034 | orchestrator | changed: [testbed-node-3] 2026-04-28 06:56:55.479044 | orchestrator | changed: [testbed-node-4] 2026-04-28 06:56:55.479053 | orchestrator | changed: [testbed-node-5] 2026-04-28 06:56:55.479061 | orchestrator | 2026-04-28 06:56:55.479067 | orchestrator | RUNNING HANDLER [nova-cell : Restart nova-compute container] ******************* 2026-04-28 06:56:55.479074 | orchestrator | Tuesday 28 April 2026 06:56:20 +0000 (0:00:01.796) 0:13:22.184 ********* 2026-04-28 06:56:55.479080 | orchestrator | changed: [testbed-node-4] 2026-04-28 06:56:55.479085 | orchestrator | changed: [testbed-node-3] 2026-04-28 06:56:55.479093 | orchestrator | changed: [testbed-node-5] 2026-04-28 06:56:55.479102 | orchestrator | 2026-04-28 06:56:55.479118 | orchestrator | RUNNING HANDLER [nova-cell : Wait for nova-compute services to update service versions] *** 2026-04-28 06:58:09.831855 | orchestrator | Tuesday 28 April 2026 06:56:56 +0000 (0:00:35.768) 0:13:57.952 ********* 2026-04-28 06:58:09.831988 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:58:09.832001 | orchestrator | 2026-04-28 06:58:09.832011 | orchestrator | TASK [nova-cell : Waiting for nova-compute services to register themselves] **** 2026-04-28 06:58:09.832020 | orchestrator | Tuesday 28 April 2026 06:56:57 +0000 (0:00:01.455) 0:13:59.408 ********* 2026-04-28 06:58:09.832028 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:58:09.832036 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:58:09.832044 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:58:09.832052 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:58:09.832060 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:58:09.832068 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-28 06:58:09.832076 | orchestrator | 2026-04-28 06:58:09.832085 | orchestrator | TASK [nova-cell : Fail if nova-compute service failed to register] ************* 2026-04-28 06:58:09.832093 | orchestrator | Tuesday 28 April 2026 06:57:07 +0000 (0:00:09.382) 0:14:08.791 ********* 2026-04-28 06:58:09.832101 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:58:09.832133 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:58:09.832141 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:58:09.832149 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:58:09.832157 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:58:09.832164 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:58:09.832172 | orchestrator | 2026-04-28 06:58:09.832180 | orchestrator | TASK [nova-cell : Include discover_computes.yml] ******************************* 2026-04-28 06:58:09.832188 | orchestrator | Tuesday 28 April 2026 06:57:21 +0000 (0:00:13.845) 0:14:22.637 ********* 2026-04-28 06:58:09.832195 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:58:09.832203 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:58:09.832211 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:58:09.832218 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:58:09.832226 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:58:09.832234 | orchestrator | included: /ansible/roles/nova-cell/tasks/discover_computes.yml for testbed-node-4 2026-04-28 06:58:09.832243 | orchestrator | 2026-04-28 06:58:09.832251 | orchestrator | TASK [nova-cell : Get a list of existing cells] ******************************** 2026-04-28 06:58:09.832259 | orchestrator | Tuesday 28 April 2026 06:57:27 +0000 (0:00:06.846) 0:14:29.484 ********* 2026-04-28 06:58:09.832266 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-28 06:58:09.832274 | orchestrator | 2026-04-28 06:58:09.832282 | orchestrator | TASK [nova-cell : Extract current cell settings from list] ********************* 2026-04-28 06:58:09.832290 | orchestrator | Tuesday 28 April 2026 06:57:41 +0000 (0:00:13.522) 0:14:43.006 ********* 2026-04-28 06:58:09.832298 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-28 06:58:09.832306 | orchestrator | 2026-04-28 06:58:09.832314 | orchestrator | TASK [nova-cell : Fail if cell settings not found] ***************************** 2026-04-28 06:58:09.832321 | orchestrator | Tuesday 28 April 2026 06:57:44 +0000 (0:00:02.824) 0:14:45.831 ********* 2026-04-28 06:58:09.832329 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:58:09.832336 | orchestrator | 2026-04-28 06:58:09.832344 | orchestrator | TASK [nova-cell : Discover nova hosts] ***************************************** 2026-04-28 06:58:09.832352 | orchestrator | Tuesday 28 April 2026 06:57:46 +0000 (0:00:02.614) 0:14:48.445 ********* 2026-04-28 06:58:09.832360 | orchestrator | ok: [testbed-node-4 -> testbed-node-0(192.168.16.10)] 2026-04-28 06:58:09.832367 | orchestrator | 2026-04-28 06:58:09.832376 | orchestrator | PLAY [Refresh nova scheduler cell cache] *************************************** 2026-04-28 06:58:09.832385 | orchestrator | 2026-04-28 06:58:09.832394 | orchestrator | TASK [nova : Refresh cell cache in nova scheduler] ***************************** 2026-04-28 06:58:09.832403 | orchestrator | Tuesday 28 April 2026 06:57:58 +0000 (0:00:11.662) 0:15:00.108 ********* 2026-04-28 06:58:09.832412 | orchestrator | changed: [testbed-node-0] 2026-04-28 06:58:09.832422 | orchestrator | changed: [testbed-node-1] 2026-04-28 06:58:09.832431 | orchestrator | changed: [testbed-node-2] 2026-04-28 06:58:09.832440 | orchestrator | 2026-04-28 06:58:09.832449 | orchestrator | PLAY [Reload global Nova super conductor services] ***************************** 2026-04-28 06:58:09.832458 | orchestrator | 2026-04-28 06:58:09.832467 | orchestrator | TASK [nova : Reload nova super conductor services to remove RPC version pin] *** 2026-04-28 06:58:09.832475 | orchestrator | Tuesday 28 April 2026 06:58:00 +0000 (0:00:02.136) 0:15:02.244 ********* 2026-04-28 06:58:09.832485 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:58:09.832520 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:58:09.832529 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:58:09.832539 | orchestrator | 2026-04-28 06:58:09.832548 | orchestrator | PLAY [Reload Nova cell services] *********************************************** 2026-04-28 06:58:09.832557 | orchestrator | 2026-04-28 06:58:09.832582 | orchestrator | TASK [nova-cell : Reload nova cell services to remove RPC version cap] ********* 2026-04-28 06:58:09.832591 | orchestrator | Tuesday 28 April 2026 06:58:02 +0000 (0:00:01.961) 0:15:04.205 ********* 2026-04-28 06:58:09.832601 | orchestrator | skipping: [testbed-node-3] => (item=nova-conductor)  2026-04-28 06:58:09.832612 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute)  2026-04-28 06:58:09.832629 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute-ironic)  2026-04-28 06:58:09.832638 | orchestrator | skipping: [testbed-node-3] => (item=nova-novncproxy)  2026-04-28 06:58:09.832647 | orchestrator | skipping: [testbed-node-3] => (item=nova-serialproxy)  2026-04-28 06:58:09.832656 | orchestrator | skipping: [testbed-node-3] => (item=nova-spicehtml5proxy)  2026-04-28 06:58:09.832665 | orchestrator | skipping: [testbed-node-3] 2026-04-28 06:58:09.832674 | orchestrator | skipping: [testbed-node-4] => (item=nova-conductor)  2026-04-28 06:58:09.832683 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute)  2026-04-28 06:58:09.832692 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute-ironic)  2026-04-28 06:58:09.832701 | orchestrator | skipping: [testbed-node-4] => (item=nova-novncproxy)  2026-04-28 06:58:09.832710 | orchestrator | skipping: [testbed-node-4] => (item=nova-serialproxy)  2026-04-28 06:58:09.832719 | orchestrator | skipping: [testbed-node-4] => (item=nova-spicehtml5proxy)  2026-04-28 06:58:09.832728 | orchestrator | skipping: [testbed-node-4] 2026-04-28 06:58:09.832752 | orchestrator | skipping: [testbed-node-5] => (item=nova-conductor)  2026-04-28 06:58:09.832761 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute)  2026-04-28 06:58:09.832768 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute-ironic)  2026-04-28 06:58:09.832776 | orchestrator | skipping: [testbed-node-5] => (item=nova-novncproxy)  2026-04-28 06:58:09.832784 | orchestrator | skipping: [testbed-node-5] => (item=nova-serialproxy)  2026-04-28 06:58:09.832792 | orchestrator | skipping: [testbed-node-5] => (item=nova-spicehtml5proxy)  2026-04-28 06:58:09.832800 | orchestrator | skipping: [testbed-node-5] 2026-04-28 06:58:09.832808 | orchestrator | skipping: [testbed-node-0] => (item=nova-conductor)  2026-04-28 06:58:09.832815 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute)  2026-04-28 06:58:09.832823 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute-ironic)  2026-04-28 06:58:09.832831 | orchestrator | skipping: [testbed-node-0] => (item=nova-novncproxy)  2026-04-28 06:58:09.832838 | orchestrator | skipping: [testbed-node-0] => (item=nova-serialproxy)  2026-04-28 06:58:09.832846 | orchestrator | skipping: [testbed-node-0] => (item=nova-spicehtml5proxy)  2026-04-28 06:58:09.832854 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:58:09.832862 | orchestrator | skipping: [testbed-node-1] => (item=nova-conductor)  2026-04-28 06:58:09.832869 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute)  2026-04-28 06:58:09.832877 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute-ironic)  2026-04-28 06:58:09.832885 | orchestrator | skipping: [testbed-node-1] => (item=nova-novncproxy)  2026-04-28 06:58:09.832892 | orchestrator | skipping: [testbed-node-1] => (item=nova-serialproxy)  2026-04-28 06:58:09.832900 | orchestrator | skipping: [testbed-node-1] => (item=nova-spicehtml5proxy)  2026-04-28 06:58:09.832908 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:58:09.832915 | orchestrator | skipping: [testbed-node-2] => (item=nova-conductor)  2026-04-28 06:58:09.832923 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute)  2026-04-28 06:58:09.832931 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute-ironic)  2026-04-28 06:58:09.832938 | orchestrator | skipping: [testbed-node-2] => (item=nova-novncproxy)  2026-04-28 06:58:09.832946 | orchestrator | skipping: [testbed-node-2] => (item=nova-serialproxy)  2026-04-28 06:58:09.832954 | orchestrator | skipping: [testbed-node-2] => (item=nova-spicehtml5proxy)  2026-04-28 06:58:09.832961 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:58:09.832969 | orchestrator | 2026-04-28 06:58:09.832977 | orchestrator | PLAY [Reload global Nova API services] ***************************************** 2026-04-28 06:58:09.832984 | orchestrator | 2026-04-28 06:58:09.832992 | orchestrator | TASK [nova : Reload nova API services to remove RPC version pin] *************** 2026-04-28 06:58:09.833000 | orchestrator | Tuesday 28 April 2026 06:58:05 +0000 (0:00:02.598) 0:15:06.804 ********* 2026-04-28 06:58:09.833014 | orchestrator | skipping: [testbed-node-0] => (item=nova-scheduler)  2026-04-28 06:58:09.833022 | orchestrator | skipping: [testbed-node-0] => (item=nova-api)  2026-04-28 06:58:09.833030 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:58:09.833038 | orchestrator | skipping: [testbed-node-1] => (item=nova-scheduler)  2026-04-28 06:58:09.833045 | orchestrator | skipping: [testbed-node-1] => (item=nova-api)  2026-04-28 06:58:09.833053 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:58:09.833061 | orchestrator | skipping: [testbed-node-2] => (item=nova-scheduler)  2026-04-28 06:58:09.833069 | orchestrator | skipping: [testbed-node-2] => (item=nova-api)  2026-04-28 06:58:09.833076 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:58:09.833084 | orchestrator | 2026-04-28 06:58:09.833092 | orchestrator | PLAY [Run Nova API online data migrations] ************************************* 2026-04-28 06:58:09.833099 | orchestrator | 2026-04-28 06:58:09.833107 | orchestrator | TASK [nova : Run Nova API online database migrations] ************************** 2026-04-28 06:58:09.833115 | orchestrator | Tuesday 28 April 2026 06:58:07 +0000 (0:00:02.013) 0:15:08.818 ********* 2026-04-28 06:58:09.833123 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:58:09.833130 | orchestrator | 2026-04-28 06:58:09.833138 | orchestrator | PLAY [Run Nova cell online data migrations] ************************************ 2026-04-28 06:58:09.833146 | orchestrator | 2026-04-28 06:58:09.833154 | orchestrator | TASK [nova-cell : Run Nova cell online database migrations] ******************** 2026-04-28 06:58:09.833161 | orchestrator | Tuesday 28 April 2026 06:58:09 +0000 (0:00:02.004) 0:15:10.823 ********* 2026-04-28 06:58:09.833169 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:58:09.833177 | orchestrator | skipping: [testbed-node-1] 2026-04-28 06:58:09.833189 | orchestrator | skipping: [testbed-node-2] 2026-04-28 06:58:09.833197 | orchestrator | 2026-04-28 06:58:09.833205 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 06:58:09.833213 | orchestrator | testbed-manager : ok=3  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 06:58:09.833224 | orchestrator | testbed-node-0 : ok=58  changed=25  unreachable=0 failed=0 skipped=53  rescued=0 ignored=0 2026-04-28 06:58:09.833233 | orchestrator | testbed-node-1 : ok=31  changed=21  unreachable=0 failed=0 skipped=61  rescued=0 ignored=0 2026-04-28 06:58:09.833241 | orchestrator | testbed-node-2 : ok=31  changed=21  unreachable=0 failed=0 skipped=61  rescued=0 ignored=0 2026-04-28 06:58:09.833248 | orchestrator | testbed-node-3 : ok=49  changed=15  unreachable=0 failed=0 skipped=25  rescued=0 ignored=0 2026-04-28 06:58:09.833261 | orchestrator | testbed-node-4 : ok=48  changed=14  unreachable=0 failed=0 skipped=20  rescued=0 ignored=0 2026-04-28 06:58:11.957530 | orchestrator | testbed-node-5 : ok=43  changed=14  unreachable=0 failed=0 skipped=21  rescued=0 ignored=0 2026-04-28 06:58:11.957672 | orchestrator | 2026-04-28 06:58:11.957687 | orchestrator | 2026-04-28 06:58:11.957700 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 06:58:11.957713 | orchestrator | Tuesday 28 April 2026 06:58:11 +0000 (0:00:02.165) 0:15:12.988 ********* 2026-04-28 06:58:11.957724 | orchestrator | =============================================================================== 2026-04-28 06:58:11.957736 | orchestrator | nova-cell : Restart nova-conductor container -------------------------- 135.54s 2026-04-28 06:58:11.957747 | orchestrator | nova-cell : Restart nova-libvirt container ----------------------------- 44.47s 2026-04-28 06:58:11.957758 | orchestrator | nova-cell : Restart nova-compute container ----------------------------- 35.77s 2026-04-28 06:58:11.957769 | orchestrator | nova-cell : Get new Libvirt version ------------------------------------ 34.71s 2026-04-28 06:58:11.957780 | orchestrator | nova : Running Nova API bootstrap container ---------------------------- 33.95s 2026-04-28 06:58:11.957822 | orchestrator | nova : Restart nova-scheduler container -------------------------------- 26.79s 2026-04-28 06:58:11.957834 | orchestrator | nova-cell : Restart nova-ssh container --------------------------------- 26.64s 2026-04-28 06:58:11.957844 | orchestrator | nova-cell : Restart nova-novncproxy container -------------------------- 22.35s 2026-04-28 06:58:11.957855 | orchestrator | nova : Create cell0 mappings ------------------------------------------- 15.54s 2026-04-28 06:58:11.957866 | orchestrator | nova-cell : Get a list of existing cells ------------------------------- 14.26s 2026-04-28 06:58:11.957877 | orchestrator | nova : Restart nova-api container -------------------------------------- 13.98s 2026-04-28 06:58:11.957887 | orchestrator | nova-cell : Fail if nova-compute service failed to register ------------ 13.85s 2026-04-28 06:58:11.957898 | orchestrator | nova-cell : Get a list of existing cells ------------------------------- 13.52s 2026-04-28 06:58:11.957909 | orchestrator | nova-cell : Update cell ------------------------------------------------ 13.52s 2026-04-28 06:58:11.957920 | orchestrator | nova-cell : Get a list of existing cells ------------------------------- 12.70s 2026-04-28 06:58:11.957931 | orchestrator | nova-cell : Running Nova cell bootstrap container ---------------------- 12.38s 2026-04-28 06:58:11.957941 | orchestrator | nova-cell : Discover nova hosts ---------------------------------------- 11.66s 2026-04-28 06:58:11.957952 | orchestrator | service-rabbitmq : nova | Ensure RabbitMQ users exist ------------------ 11.13s 2026-04-28 06:58:11.957962 | orchestrator | nova : Restart nova-metadata container --------------------------------- 10.91s 2026-04-28 06:58:11.957973 | orchestrator | nova : Copying over nova.conf ------------------------------------------ 10.34s 2026-04-28 06:58:12.158236 | orchestrator | + osism apply nova-update-cell-mappings 2026-04-28 06:58:23.586903 | orchestrator | 2026-04-28 06:58:23 | INFO  | Prepare task for execution of nova-update-cell-mappings. 2026-04-28 06:58:23.662262 | orchestrator | 2026-04-28 06:58:23 | INFO  | Task 9816fad3-3801-4a0d-a21c-9aacb0cb4d97 (nova-update-cell-mappings) was prepared for execution. 2026-04-28 06:58:23.662328 | orchestrator | 2026-04-28 06:58:23 | INFO  | It takes a moment until task 9816fad3-3801-4a0d-a21c-9aacb0cb4d97 (nova-update-cell-mappings) has been started and output is visible here. 2026-04-28 06:58:54.311706 | orchestrator | 2026-04-28 06:58:54.311797 | orchestrator | PLAY [Update Nova cell mappings] *********************************************** 2026-04-28 06:58:54.311808 | orchestrator | 2026-04-28 06:58:54.311815 | orchestrator | TASK [Get list of Nova cells] ************************************************** 2026-04-28 06:58:54.311822 | orchestrator | Tuesday 28 April 2026 06:58:28 +0000 (0:00:01.487) 0:00:01.487 ********* 2026-04-28 06:58:54.311829 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:58:54.311837 | orchestrator | 2026-04-28 06:58:54.311843 | orchestrator | TASK [Parse cell information] ************************************************** 2026-04-28 06:58:54.311850 | orchestrator | Tuesday 28 April 2026 06:58:42 +0000 (0:00:13.865) 0:00:15.353 ********* 2026-04-28 06:58:54.311856 | orchestrator | ok: [testbed-node-0] 2026-04-28 06:58:54.311862 | orchestrator | 2026-04-28 06:58:54.311882 | orchestrator | TASK [Display cells to update] ************************************************* 2026-04-28 06:58:54.311889 | orchestrator | Tuesday 28 April 2026 06:58:43 +0000 (0:00:01.222) 0:00:16.576 ********* 2026-04-28 06:58:54.311895 | orchestrator | ok: [testbed-node-0] => { 2026-04-28 06:58:54.311903 | orchestrator |  "msg": "Cells to update: [{'name': '', 'uuid': 'd1448372-7091-46f2-99d0-babaca8757b2'}]" 2026-04-28 06:58:54.311910 | orchestrator | } 2026-04-28 06:58:54.311916 | orchestrator | 2026-04-28 06:58:54.311923 | orchestrator | TASK [Use specified cell UUID if provided] ************************************* 2026-04-28 06:58:54.311929 | orchestrator | Tuesday 28 April 2026 06:58:44 +0000 (0:00:01.128) 0:00:17.705 ********* 2026-04-28 06:58:54.311935 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:58:54.311941 | orchestrator | 2026-04-28 06:58:54.311947 | orchestrator | TASK [Abort if multiple cells found without specific UUID and abort_on_multiple is enabled] *** 2026-04-28 06:58:54.311955 | orchestrator | Tuesday 28 April 2026 06:58:45 +0000 (0:00:01.150) 0:00:18.856 ********* 2026-04-28 06:58:54.311978 | orchestrator | skipping: [testbed-node-0] 2026-04-28 06:58:54.311985 | orchestrator | 2026-04-28 06:58:54.311991 | orchestrator | TASK [Update Nova cell mappings] *********************************************** 2026-04-28 06:58:54.311997 | orchestrator | Tuesday 28 April 2026 06:58:47 +0000 (0:00:01.133) 0:00:19.989 ********* 2026-04-28 06:58:54.312003 | orchestrator | changed: [testbed-node-0] => (item=d1448372-7091-46f2-99d0-babaca8757b2) 2026-04-28 06:58:54.312010 | orchestrator | 2026-04-28 06:58:54.312016 | orchestrator | TASK [Display update results] ************************************************** 2026-04-28 06:58:54.312022 | orchestrator | Tuesday 28 April 2026 06:58:52 +0000 (0:00:05.361) 0:00:25.350 ********* 2026-04-28 06:58:54.312028 | orchestrator | ok: [testbed-node-0] => (item=d1448372-7091-46f2-99d0-babaca8757b2) => { 2026-04-28 06:58:54.312035 | orchestrator |  "msg": "Cell d1448372-7091-46f2-99d0-babaca8757b2 updated successfully" 2026-04-28 06:58:54.312041 | orchestrator | } 2026-04-28 06:58:54.312047 | orchestrator | 2026-04-28 06:58:54.312053 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 06:58:54.312060 | orchestrator | testbed-node-0 : ok=5  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 06:58:54.312067 | orchestrator | 2026-04-28 06:58:54.312074 | orchestrator | 2026-04-28 06:58:54.312080 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 06:58:54.312086 | orchestrator | Tuesday 28 April 2026 06:58:53 +0000 (0:00:01.587) 0:00:26.937 ********* 2026-04-28 06:58:54.312092 | orchestrator | =============================================================================== 2026-04-28 06:58:54.312098 | orchestrator | Get list of Nova cells ------------------------------------------------- 13.87s 2026-04-28 06:58:54.312104 | orchestrator | Update Nova cell mappings ----------------------------------------------- 5.36s 2026-04-28 06:58:54.312110 | orchestrator | Display update results -------------------------------------------------- 1.59s 2026-04-28 06:58:54.312116 | orchestrator | Parse cell information -------------------------------------------------- 1.22s 2026-04-28 06:58:54.312122 | orchestrator | Use specified cell UUID if provided ------------------------------------- 1.15s 2026-04-28 06:58:54.312128 | orchestrator | Abort if multiple cells found without specific UUID and abort_on_multiple is enabled --- 1.13s 2026-04-28 06:58:54.312134 | orchestrator | Display cells to update ------------------------------------------------- 1.13s 2026-04-28 06:58:54.539317 | orchestrator | + osism apply -a upgrade nova 2026-04-28 06:58:55.810374 | orchestrator | 2026-04-28 06:58:55 | INFO  | Prepare task for execution of nova. 2026-04-28 06:58:55.874162 | orchestrator | 2026-04-28 06:58:55 | INFO  | Task 31315151-63d3-460a-b0d2-2746d1a81504 (nova) was prepared for execution. 2026-04-28 06:58:55.874258 | orchestrator | 2026-04-28 06:58:55 | INFO  | It takes a moment until task 31315151-63d3-460a-b0d2-2746d1a81504 (nova) has been started and output is visible here. 2026-04-28 07:00:07.778604 | orchestrator | 2026-04-28 07:00:07.778702 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 07:00:07.778718 | orchestrator | 2026-04-28 07:00:07.778730 | orchestrator | TASK [Group hosts based on OpenStack release] ********************************** 2026-04-28 07:00:07.778742 | orchestrator | Tuesday 28 April 2026 06:59:00 +0000 (0:00:01.257) 0:00:01.257 ********* 2026-04-28 07:00:07.778753 | orchestrator | changed: [testbed-manager] 2026-04-28 07:00:07.778765 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:00:07.778776 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:00:07.778787 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:00:07.778798 | orchestrator | changed: [testbed-node-3] 2026-04-28 07:00:07.778809 | orchestrator | changed: [testbed-node-4] 2026-04-28 07:00:07.778820 | orchestrator | changed: [testbed-node-5] 2026-04-28 07:00:07.778830 | orchestrator | 2026-04-28 07:00:07.778855 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 07:00:07.778866 | orchestrator | Tuesday 28 April 2026 06:59:04 +0000 (0:00:03.750) 0:00:05.007 ********* 2026-04-28 07:00:07.778897 | orchestrator | changed: [testbed-manager] 2026-04-28 07:00:07.778909 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:00:07.778920 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:00:07.778931 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:00:07.778941 | orchestrator | changed: [testbed-node-3] 2026-04-28 07:00:07.778952 | orchestrator | changed: [testbed-node-4] 2026-04-28 07:00:07.778963 | orchestrator | changed: [testbed-node-5] 2026-04-28 07:00:07.778973 | orchestrator | 2026-04-28 07:00:07.778984 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 07:00:07.778995 | orchestrator | Tuesday 28 April 2026 06:59:06 +0000 (0:00:02.012) 0:00:07.019 ********* 2026-04-28 07:00:07.779006 | orchestrator | changed: [testbed-manager] => (item=enable_nova_True) 2026-04-28 07:00:07.779017 | orchestrator | changed: [testbed-node-0] => (item=enable_nova_True) 2026-04-28 07:00:07.779027 | orchestrator | changed: [testbed-node-1] => (item=enable_nova_True) 2026-04-28 07:00:07.779050 | orchestrator | changed: [testbed-node-2] => (item=enable_nova_True) 2026-04-28 07:00:07.779061 | orchestrator | changed: [testbed-node-3] => (item=enable_nova_True) 2026-04-28 07:00:07.779072 | orchestrator | changed: [testbed-node-4] => (item=enable_nova_True) 2026-04-28 07:00:07.779083 | orchestrator | changed: [testbed-node-5] => (item=enable_nova_True) 2026-04-28 07:00:07.779093 | orchestrator | 2026-04-28 07:00:07.779104 | orchestrator | PLAY [Bootstrap nova API databases] ******************************************** 2026-04-28 07:00:07.779114 | orchestrator | 2026-04-28 07:00:07.779125 | orchestrator | TASK [Bootstrap deploy] ******************************************************** 2026-04-28 07:00:07.779136 | orchestrator | Tuesday 28 April 2026 06:59:08 +0000 (0:00:02.660) 0:00:09.679 ********* 2026-04-28 07:00:07.779147 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:00:07.779157 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:00:07.779170 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:00:07.779183 | orchestrator | 2026-04-28 07:00:07.779196 | orchestrator | TASK [Bootstrap upgrade] ******************************************************* 2026-04-28 07:00:07.779209 | orchestrator | Tuesday 28 April 2026 06:59:11 +0000 (0:00:02.696) 0:00:12.376 ********* 2026-04-28 07:00:07.779222 | orchestrator | included: nova for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:00:07.779235 | orchestrator | 2026-04-28 07:00:07.779247 | orchestrator | TASK [nova : Ensuring config directories exist] ******************************** 2026-04-28 07:00:07.779260 | orchestrator | Tuesday 28 April 2026 06:59:14 +0000 (0:00:03.148) 0:00:15.525 ********* 2026-04-28 07:00:07.779273 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:00:07.779287 | orchestrator | 2026-04-28 07:00:07.779300 | orchestrator | TASK [nova : Copying over config.json files for nova-api-bootstrap] ************ 2026-04-28 07:00:07.779314 | orchestrator | Tuesday 28 April 2026 06:59:16 +0000 (0:00:01.947) 0:00:17.472 ********* 2026-04-28 07:00:07.779326 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:00:07.779339 | orchestrator | 2026-04-28 07:00:07.779352 | orchestrator | TASK [nova : Copying over nova.conf for nova-api-bootstrap] ******************** 2026-04-28 07:00:07.779365 | orchestrator | Tuesday 28 April 2026 06:59:18 +0000 (0:00:02.052) 0:00:19.524 ********* 2026-04-28 07:00:07.779377 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:00:07.779389 | orchestrator | 2026-04-28 07:00:07.779402 | orchestrator | TASK [nova : Running Nova API bootstrap container] ***************************** 2026-04-28 07:00:07.779415 | orchestrator | Tuesday 28 April 2026 06:59:22 +0000 (0:00:04.175) 0:00:23.700 ********* 2026-04-28 07:00:07.779428 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:00:07.779441 | orchestrator | 2026-04-28 07:00:07.779483 | orchestrator | PLAY [Bootstrap nova cell databases] ******************************************* 2026-04-28 07:00:07.779496 | orchestrator | 2026-04-28 07:00:07.779509 | orchestrator | TASK [Bootstrap deploy] ******************************************************** 2026-04-28 07:00:07.779523 | orchestrator | Tuesday 28 April 2026 06:59:41 +0000 (0:00:18.521) 0:00:42.222 ********* 2026-04-28 07:00:07.779535 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:00:07.779554 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:00:07.779565 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:00:07.779576 | orchestrator | 2026-04-28 07:00:07.779586 | orchestrator | TASK [Bootstrap upgrade] ******************************************************* 2026-04-28 07:00:07.779597 | orchestrator | Tuesday 28 April 2026 06:59:42 +0000 (0:00:01.354) 0:00:43.576 ********* 2026-04-28 07:00:07.779608 | orchestrator | included: nova-cell for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:00:07.779618 | orchestrator | 2026-04-28 07:00:07.779629 | orchestrator | TASK [nova-cell : Ensuring config directories exist] *************************** 2026-04-28 07:00:07.779640 | orchestrator | Tuesday 28 April 2026 06:59:44 +0000 (0:00:01.693) 0:00:45.270 ********* 2026-04-28 07:00:07.779650 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:00:07.779661 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:00:07.779672 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:00:07.779682 | orchestrator | 2026-04-28 07:00:07.779693 | orchestrator | TASK [nova-cell : Copying over config.json files for nova-cell-bootstrap] ****** 2026-04-28 07:00:07.779703 | orchestrator | Tuesday 28 April 2026 06:59:45 +0000 (0:00:01.464) 0:00:46.734 ********* 2026-04-28 07:00:07.779714 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:00:07.779725 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:00:07.779736 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:00:07.779746 | orchestrator | 2026-04-28 07:00:07.779775 | orchestrator | TASK [nova-cell : Copying over nova.conf for nova-cell-bootstrap] ************** 2026-04-28 07:00:07.779787 | orchestrator | Tuesday 28 April 2026 06:59:47 +0000 (0:00:01.983) 0:00:48.717 ********* 2026-04-28 07:00:07.779798 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:00:07.779808 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:00:07.779819 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:00:07.779830 | orchestrator | 2026-04-28 07:00:07.779841 | orchestrator | TASK [nova-cell : Running Nova cell bootstrap container] *********************** 2026-04-28 07:00:07.779851 | orchestrator | Tuesday 28 April 2026 06:59:51 +0000 (0:00:03.597) 0:00:52.315 ********* 2026-04-28 07:00:07.779862 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:00:07.779873 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:00:07.779883 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:00:07.779894 | orchestrator | 2026-04-28 07:00:07.779905 | orchestrator | PLAY [Apply role nova] ********************************************************* 2026-04-28 07:00:07.779916 | orchestrator | 2026-04-28 07:00:07.779926 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-28 07:00:07.779937 | orchestrator | Tuesday 28 April 2026 07:00:04 +0000 (0:00:12.981) 0:01:05.297 ********* 2026-04-28 07:00:07.779948 | orchestrator | included: /ansible/roles/nova/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:00:07.779959 | orchestrator | 2026-04-28 07:00:07.779970 | orchestrator | TASK [nova : Ensuring config directories exist] ******************************** 2026-04-28 07:00:07.779981 | orchestrator | Tuesday 28 April 2026 07:00:06 +0000 (0:00:02.070) 0:01:07.367 ********* 2026-04-28 07:00:07.780001 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:07.780026 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:07.780048 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:19.317775 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:19.317879 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:00:19.317891 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:19.317915 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:19.317937 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:00:19.317946 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:00:19.317954 | orchestrator | 2026-04-28 07:00:19.317962 | orchestrator | TASK [nova : Check if policies shall be overwritten] *************************** 2026-04-28 07:00:19.317970 | orchestrator | Tuesday 28 April 2026 07:00:09 +0000 (0:00:03.130) 0:01:10.497 ********* 2026-04-28 07:00:19.317977 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:00:19.317985 | orchestrator | 2026-04-28 07:00:19.317996 | orchestrator | TASK [nova : Set nova policy file] ********************************************* 2026-04-28 07:00:19.318002 | orchestrator | Tuesday 28 April 2026 07:00:10 +0000 (0:00:01.092) 0:01:11.590 ********* 2026-04-28 07:00:19.318009 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:00:19.318056 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:00:19.318064 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:00:19.318077 | orchestrator | 2026-04-28 07:00:19.318084 | orchestrator | TASK [nova : Check for vendordata file] **************************************** 2026-04-28 07:00:19.318091 | orchestrator | Tuesday 28 April 2026 07:00:12 +0000 (0:00:01.479) 0:01:13.069 ********* 2026-04-28 07:00:19.318098 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 07:00:19.318105 | orchestrator | 2026-04-28 07:00:19.318111 | orchestrator | TASK [nova : Set vendordata file path] ***************************************** 2026-04-28 07:00:19.318118 | orchestrator | Tuesday 28 April 2026 07:00:14 +0000 (0:00:02.002) 0:01:15.071 ********* 2026-04-28 07:00:19.318125 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:00:19.318131 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:00:19.318138 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:00:19.318145 | orchestrator | 2026-04-28 07:00:19.318152 | orchestrator | TASK [nova : include_tasks] **************************************************** 2026-04-28 07:00:19.318159 | orchestrator | Tuesday 28 April 2026 07:00:15 +0000 (0:00:01.479) 0:01:16.551 ********* 2026-04-28 07:00:19.318166 | orchestrator | included: /ansible/roles/nova/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:00:19.318174 | orchestrator | 2026-04-28 07:00:19.318181 | orchestrator | TASK [service-cert-copy : nova | Copying over extra CA certificates] *********** 2026-04-28 07:00:19.318187 | orchestrator | Tuesday 28 April 2026 07:00:17 +0000 (0:00:02.340) 0:01:18.891 ********* 2026-04-28 07:00:19.318195 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:19.318210 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:22.748296 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:22.748420 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:22.748436 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:22.748516 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:22.748530 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:00:22.748556 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:00:22.748567 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:00:22.748578 | orchestrator | 2026-04-28 07:00:22.748590 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS certificate] *** 2026-04-28 07:00:22.748600 | orchestrator | Tuesday 28 April 2026 07:00:22 +0000 (0:00:04.308) 0:01:23.200 ********* 2026-04-28 07:00:22.748612 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:00:22.748631 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:00:24.643757 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:00:24.643871 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:00:24.643887 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:00:24.643899 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:00:24.643908 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:00:24.643917 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:00:24.643942 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:00:24.643976 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:00:24.643986 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:00:24.643995 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:00:24.644003 | orchestrator | 2026-04-28 07:00:24.644012 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS key] ******** 2026-04-28 07:00:24.644021 | orchestrator | Tuesday 28 April 2026 07:00:24 +0000 (0:00:01.886) 0:01:25.086 ********* 2026-04-28 07:00:24.644030 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:00:24.644046 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:00:27.917080 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:00:27.917175 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:00:27.917194 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:00:27.917209 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:00:27.917222 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:00:27.917262 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:00:27.917337 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:00:27.917353 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:00:27.917365 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:00:27.917403 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:00:27.917415 | orchestrator | 2026-04-28 07:00:27.917428 | orchestrator | TASK [nova : Copying over config.json files for services] ********************** 2026-04-28 07:00:27.917472 | orchestrator | Tuesday 28 April 2026 07:00:26 +0000 (0:00:02.336) 0:01:27.423 ********* 2026-04-28 07:00:27.917485 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:27.917523 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:34.211662 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:34.211763 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:34.211776 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:34.211831 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:34.211842 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:00:34.211850 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:00:34.211858 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:00:34.211867 | orchestrator | 2026-04-28 07:00:34.211876 | orchestrator | TASK [nova : Copying over nova.conf] ******************************************* 2026-04-28 07:00:34.211884 | orchestrator | Tuesday 28 April 2026 07:00:30 +0000 (0:00:04.437) 0:01:31.861 ********* 2026-04-28 07:00:34.211898 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:34.211914 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:41.313971 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:41.314132 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:41.314175 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:41.314222 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:00:41.314239 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:00:41.314252 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:00:41.314264 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:00:41.314284 | orchestrator | 2026-04-28 07:00:41.314298 | orchestrator | TASK [nova : Copying over existing policy file] ******************************** 2026-04-28 07:00:41.314310 | orchestrator | Tuesday 28 April 2026 07:00:40 +0000 (0:00:09.881) 0:01:41.742 ********* 2026-04-28 07:00:41.314322 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:00:41.314347 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:00:53.647721 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:00:53.647867 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:00:53.647896 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:00:53.647954 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:00:53.647975 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:00:53.647994 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:00:53.648057 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:00:53.648079 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:00:53.648110 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:00:53.648129 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:00:53.648147 | orchestrator | 2026-04-28 07:00:53.648167 | orchestrator | TASK [nova : Copying over nova-api-wsgi.conf] ********************************** 2026-04-28 07:00:53.648185 | orchestrator | Tuesday 28 April 2026 07:00:42 +0000 (0:00:02.015) 0:01:43.758 ********* 2026-04-28 07:00:53.648202 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:00:53.648219 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:00:53.648237 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:00:53.648255 | orchestrator | 2026-04-28 07:00:53.648274 | orchestrator | TASK [nova : Copying over nova-metadata-wsgi.conf] ***************************** 2026-04-28 07:00:53.648293 | orchestrator | Tuesday 28 April 2026 07:00:44 +0000 (0:00:02.040) 0:01:45.799 ********* 2026-04-28 07:00:53.648311 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:00:53.648328 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:00:53.648348 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:00:53.648368 | orchestrator | 2026-04-28 07:00:53.648386 | orchestrator | TASK [nova : Copying over vendordata file for nova services] ******************* 2026-04-28 07:00:53.648405 | orchestrator | Tuesday 28 April 2026 07:00:46 +0000 (0:00:01.726) 0:01:47.526 ********* 2026-04-28 07:00:53.648452 | orchestrator | skipping: [testbed-node-0] => (item=nova-metadata)  2026-04-28 07:00:53.648475 | orchestrator | skipping: [testbed-node-0] => (item=nova-api)  2026-04-28 07:00:53.648495 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:00:53.648512 | orchestrator | skipping: [testbed-node-1] => (item=nova-metadata)  2026-04-28 07:00:53.648529 | orchestrator | skipping: [testbed-node-1] => (item=nova-api)  2026-04-28 07:00:53.648546 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:00:53.648564 | orchestrator | skipping: [testbed-node-2] => (item=nova-metadata)  2026-04-28 07:00:53.648582 | orchestrator | skipping: [testbed-node-2] => (item=nova-api)  2026-04-28 07:00:53.648600 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:00:53.648637 | orchestrator | 2026-04-28 07:00:53.648670 | orchestrator | TASK [Configure uWSGI for Nova] ************************************************ 2026-04-28 07:00:53.648689 | orchestrator | Tuesday 28 April 2026 07:00:48 +0000 (0:00:01.707) 0:01:49.233 ********* 2026-04-28 07:00:53.648718 | orchestrator | included: service-uwsgi-config for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'nova-api', 'port': '8774', 'workers': '2'}) 2026-04-28 07:00:53.648739 | orchestrator | included: service-uwsgi-config for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'nova-metadata', 'port': '8775', 'workers': '2'}) 2026-04-28 07:00:53.648757 | orchestrator | 2026-04-28 07:00:53.648775 | orchestrator | TASK [service-uwsgi-config : Copying over nova-api uWSGI config] *************** 2026-04-28 07:00:53.648792 | orchestrator | Tuesday 28 April 2026 07:00:51 +0000 (0:00:03.097) 0:01:52.331 ********* 2026-04-28 07:00:53.648810 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:00:53.648829 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:00:53.648847 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:00:53.648878 | orchestrator | 2026-04-28 07:01:18.529694 | orchestrator | TASK [service-uwsgi-config : Copying over nova-metadata uWSGI config] ********** 2026-04-28 07:01:18.529774 | orchestrator | Tuesday 28 April 2026 07:00:54 +0000 (0:00:02.994) 0:01:55.325 ********* 2026-04-28 07:01:18.529781 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:01:18.529786 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:01:18.529791 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:01:18.529795 | orchestrator | 2026-04-28 07:01:18.529800 | orchestrator | TASK [nova : Run Nova upgrade checks] ****************************************** 2026-04-28 07:01:18.529804 | orchestrator | Tuesday 28 April 2026 07:00:57 +0000 (0:00:03.531) 0:01:58.857 ********* 2026-04-28 07:01:18.529808 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:01:18.529813 | orchestrator | 2026-04-28 07:01:18.529818 | orchestrator | TASK [nova : Upgrade status check result] ************************************** 2026-04-28 07:01:18.529821 | orchestrator | Tuesday 28 April 2026 07:01:16 +0000 (0:00:18.143) 0:02:17.001 ********* 2026-04-28 07:01:18.529825 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:01:18.529829 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:01:18.529833 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:01:18.529837 | orchestrator | 2026-04-28 07:01:18.529841 | orchestrator | TASK [nova : Stopping top level nova services] ********************************* 2026-04-28 07:01:18.529844 | orchestrator | Tuesday 28 April 2026 07:01:17 +0000 (0:00:01.462) 0:02:18.464 ********* 2026-04-28 07:01:18.529852 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:01:18.529858 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:01:18.529875 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:01:18.529894 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:01:18.529909 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:01:18.529914 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:01:18.529918 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:01:18.529922 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:01:18.529926 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:01:18.529942 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:01:23.631571 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:01:23.631686 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:01:23.631708 | orchestrator | 2026-04-28 07:01:23.631737 | orchestrator | TASK [service-check-containers : nova | Check containers] ********************** 2026-04-28 07:01:23.631761 | orchestrator | Tuesday 28 April 2026 07:01:19 +0000 (0:00:02.395) 0:02:20.859 ********* 2026-04-28 07:01:23.631783 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:01:23.631806 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:01:23.631877 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:01:23.631925 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:01:23.631947 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:01:23.631970 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:01:23.632011 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:01:23.632046 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:01:27.538953 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:01:27.539060 | orchestrator | 2026-04-28 07:01:27.539086 | orchestrator | TASK [service-check-containers : nova | Notify handlers to restart containers] *** 2026-04-28 07:01:27.539107 | orchestrator | Tuesday 28 April 2026 07:01:25 +0000 (0:00:05.272) 0:02:26.132 ********* 2026-04-28 07:01:27.539127 | orchestrator | ok: [testbed-node-0] => { 2026-04-28 07:01:27.539146 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:01:27.539166 | orchestrator | } 2026-04-28 07:01:27.539182 | orchestrator | ok: [testbed-node-1] => { 2026-04-28 07:01:27.539193 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:01:27.539203 | orchestrator | } 2026-04-28 07:01:27.539214 | orchestrator | ok: [testbed-node-2] => { 2026-04-28 07:01:27.539225 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:01:27.539235 | orchestrator | } 2026-04-28 07:01:27.539246 | orchestrator | 2026-04-28 07:01:27.539258 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 07:01:27.539287 | orchestrator | Tuesday 28 April 2026 07:01:26 +0000 (0:00:01.407) 0:02:27.539 ********* 2026-04-28 07:01:27.539303 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:01:27.539372 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:01:27.539388 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:01:27.539400 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:01:27.539463 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:01:27.539492 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:01:27.539525 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:01:27.539539 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:01:27.539559 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-api', 'value': {'container_name': 'nova_api', 'group': 'nova-api', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/nova-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8774 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.osapi_compute:application', 'haproxy': {'nova_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8774', 'listen_port': '8774', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:01:27.539585 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-metadata', 'value': {'container_name': 'nova_metadata', 'group': 'nova-metadata', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-metadata/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8775 '], 'timeout': '30'}, 'wsgi': 'nova.wsgi.metadata:application', 'haproxy': {'nova_metadata': {'enabled': True, 'mode': 'http', 'external': False, 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'nova_metadata_external': {'enabled': 'no', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8775', 'listen_port': '8775', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:02:08.602263 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-scheduler', 'value': {'container_name': 'nova_scheduler', 'group': 'nova-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:02:08.602350 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:02:08.602381 | orchestrator | 2026-04-28 07:02:08.602392 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-28 07:02:08.602445 | orchestrator | Tuesday 28 April 2026 07:01:28 +0000 (0:00:02.158) 0:02:29.697 ********* 2026-04-28 07:02:08.602454 | orchestrator | 2026-04-28 07:02:08.602464 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-28 07:02:08.602472 | orchestrator | Tuesday 28 April 2026 07:01:29 +0000 (0:00:00.504) 0:02:30.201 ********* 2026-04-28 07:02:08.602481 | orchestrator | 2026-04-28 07:02:08.602489 | orchestrator | TASK [nova : Flush handlers] *************************************************** 2026-04-28 07:02:08.602498 | orchestrator | Tuesday 28 April 2026 07:01:29 +0000 (0:00:00.489) 0:02:30.691 ********* 2026-04-28 07:02:08.602506 | orchestrator | 2026-04-28 07:02:08.602515 | orchestrator | PLAY [Apply role nova-cell] **************************************************** 2026-04-28 07:02:08.602523 | orchestrator | 2026-04-28 07:02:08.602541 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-28 07:02:08.602549 | orchestrator | Tuesday 28 April 2026 07:01:31 +0000 (0:00:01.500) 0:02:32.191 ********* 2026-04-28 07:02:08.602559 | orchestrator | included: /ansible/roles/nova-cell/tasks/upgrade.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:02:08.602568 | orchestrator | 2026-04-28 07:02:08.602577 | orchestrator | TASK [nova-cell : Get new Libvirt version] ************************************* 2026-04-28 07:02:08.602588 | orchestrator | Tuesday 28 April 2026 07:01:33 +0000 (0:00:02.600) 0:02:34.791 ********* 2026-04-28 07:02:08.602604 | orchestrator | changed: [testbed-node-3] 2026-04-28 07:02:08.602619 | orchestrator | 2026-04-28 07:02:08.602634 | orchestrator | TASK [nova-cell : Cache new Libvirt version] *********************************** 2026-04-28 07:02:08.602649 | orchestrator | Tuesday 28 April 2026 07:01:38 +0000 (0:00:04.419) 0:02:39.211 ********* 2026-04-28 07:02:08.602664 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:02:08.602680 | orchestrator | 2026-04-28 07:02:08.602695 | orchestrator | TASK [Get nova_libvirt image info] ********************************************* 2026-04-28 07:02:08.602705 | orchestrator | Tuesday 28 April 2026 07:01:40 +0000 (0:00:02.286) 0:02:41.498 ********* 2026-04-28 07:02:08.602724 | orchestrator | included: service-image-info for testbed-node-3 2026-04-28 07:02:08.602733 | orchestrator | 2026-04-28 07:02:08.602742 | orchestrator | TASK [service-image-info : community.docker.docker_image_info] ***************** 2026-04-28 07:02:08.602750 | orchestrator | Tuesday 28 April 2026 07:01:42 +0000 (0:00:02.074) 0:02:43.572 ********* 2026-04-28 07:02:08.602759 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:02:08.602767 | orchestrator | 2026-04-28 07:02:08.602776 | orchestrator | TASK [service-image-info : set_fact] ******************************************* 2026-04-28 07:02:08.602784 | orchestrator | Tuesday 28 April 2026 07:01:46 +0000 (0:00:04.266) 0:02:47.838 ********* 2026-04-28 07:02:08.602793 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:02:08.602801 | orchestrator | 2026-04-28 07:02:08.602810 | orchestrator | TASK [service-image-info : containers.podman.podman_image_info] **************** 2026-04-28 07:02:08.602818 | orchestrator | Tuesday 28 April 2026 07:01:49 +0000 (0:00:03.006) 0:02:50.845 ********* 2026-04-28 07:02:08.602829 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:02:08.602839 | orchestrator | 2026-04-28 07:02:08.602850 | orchestrator | TASK [service-image-info : set_fact] ******************************************* 2026-04-28 07:02:08.602860 | orchestrator | Tuesday 28 April 2026 07:01:52 +0000 (0:00:02.985) 0:02:53.831 ********* 2026-04-28 07:02:08.602870 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:02:08.602880 | orchestrator | 2026-04-28 07:02:08.602890 | orchestrator | TASK [nova-cell : Get container facts] ***************************************** 2026-04-28 07:02:08.602900 | orchestrator | Tuesday 28 April 2026 07:01:55 +0000 (0:00:03.012) 0:02:56.843 ********* 2026-04-28 07:02:08.602910 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:02:08.602921 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:02:08.602931 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:02:08.602941 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:02:08.602960 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:02:08.602970 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:02:08.602980 | orchestrator | 2026-04-28 07:02:08.602991 | orchestrator | TASK [nova-cell : Get current Libvirt version] ********************************* 2026-04-28 07:02:08.603001 | orchestrator | Tuesday 28 April 2026 07:02:00 +0000 (0:00:04.831) 0:03:01.675 ********* 2026-04-28 07:02:08.603011 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:02:08.603021 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:02:08.603031 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:02:08.603042 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:02:08.603052 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:02:08.603062 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:02:08.603072 | orchestrator | 2026-04-28 07:02:08.603083 | orchestrator | TASK [nova-cell : Check that the new Libvirt version is >= current] ************ 2026-04-28 07:02:08.603094 | orchestrator | Tuesday 28 April 2026 07:02:05 +0000 (0:00:04.226) 0:03:05.902 ********* 2026-04-28 07:02:08.603104 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:02:08.603114 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:02:08.603125 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:02:08.603134 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:02:08.603145 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:02:08.603169 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:02:08.603181 | orchestrator | 2026-04-28 07:02:08.603190 | orchestrator | TASK [nova-cell : Stopping nova cell services] ********************************* 2026-04-28 07:02:08.603199 | orchestrator | Tuesday 28 April 2026 07:02:07 +0000 (0:00:02.902) 0:03:08.805 ********* 2026-04-28 07:02:08.603210 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 07:02:08.603220 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 07:02:08.603233 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 07:02:08.603243 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 07:02:08.603258 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 07:02:08.603274 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 07:02:19.067532 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:02:19.067666 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:02:19.067685 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 07:02:19.067717 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 07:02:19.067730 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 07:02:19.067801 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:02:19.067815 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 07:02:19.067826 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:02:19.067837 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:02:19.067866 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 07:02:19.067881 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:02:19.067899 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:02:19.067924 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 07:02:19.067955 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:02:19.067973 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:02:19.067991 | orchestrator | 2026-04-28 07:02:19.068011 | orchestrator | TASK [Load and persist br_netfilter module] ************************************ 2026-04-28 07:02:19.068032 | orchestrator | Tuesday 28 April 2026 07:02:11 +0000 (0:00:03.108) 0:03:11.913 ********* 2026-04-28 07:02:19.068051 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:02:19.068068 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:02:19.068085 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:02:19.068105 | orchestrator | included: module-load for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 07:02:19.068124 | orchestrator | 2026-04-28 07:02:19.068143 | orchestrator | TASK [module-load : Load modules] ********************************************** 2026-04-28 07:02:19.068163 | orchestrator | Tuesday 28 April 2026 07:02:12 +0000 (0:00:01.961) 0:03:13.875 ********* 2026-04-28 07:02:19.068177 | orchestrator | ok: [testbed-node-4] => (item=br_netfilter) 2026-04-28 07:02:19.068189 | orchestrator | ok: [testbed-node-3] => (item=br_netfilter) 2026-04-28 07:02:19.068200 | orchestrator | ok: [testbed-node-5] => (item=br_netfilter) 2026-04-28 07:02:19.068212 | orchestrator | 2026-04-28 07:02:19.068223 | orchestrator | TASK [module-load : Persist modules via modules-load.d] ************************ 2026-04-28 07:02:19.068235 | orchestrator | Tuesday 28 April 2026 07:02:14 +0000 (0:00:01.764) 0:03:15.639 ********* 2026-04-28 07:02:19.068246 | orchestrator | ok: [testbed-node-3] => (item=br_netfilter) 2026-04-28 07:02:19.068257 | orchestrator | ok: [testbed-node-4] => (item=br_netfilter) 2026-04-28 07:02:19.068268 | orchestrator | ok: [testbed-node-5] => (item=br_netfilter) 2026-04-28 07:02:19.068279 | orchestrator | 2026-04-28 07:02:19.068290 | orchestrator | TASK [module-load : Drop module persistence] *********************************** 2026-04-28 07:02:19.068302 | orchestrator | Tuesday 28 April 2026 07:02:16 +0000 (0:00:02.200) 0:03:17.840 ********* 2026-04-28 07:02:19.068313 | orchestrator | skipping: [testbed-node-3] => (item=br_netfilter)  2026-04-28 07:02:19.068324 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:02:19.068339 | orchestrator | skipping: [testbed-node-4] => (item=br_netfilter)  2026-04-28 07:02:19.068355 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:02:19.068372 | orchestrator | skipping: [testbed-node-5] => (item=br_netfilter)  2026-04-28 07:02:19.068388 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:02:19.068435 | orchestrator | 2026-04-28 07:02:19.068452 | orchestrator | TASK [nova-cell : Enable bridge-nf-call sysctl variables] ********************** 2026-04-28 07:02:19.068468 | orchestrator | Tuesday 28 April 2026 07:02:18 +0000 (0:00:01.395) 0:03:19.236 ********* 2026-04-28 07:02:19.068486 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-28 07:02:19.068503 | orchestrator | skipping: [testbed-node-0] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-28 07:02:19.068519 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:02:19.068547 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-28 07:02:27.311682 | orchestrator | ok: [testbed-node-4] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-28 07:02:27.311770 | orchestrator | ok: [testbed-node-3] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-28 07:02:27.311799 | orchestrator | skipping: [testbed-node-1] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-28 07:02:27.311807 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:02:27.311814 | orchestrator | ok: [testbed-node-5] => (item=net.bridge.bridge-nf-call-iptables) 2026-04-28 07:02:27.311821 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-iptables)  2026-04-28 07:02:27.311827 | orchestrator | skipping: [testbed-node-2] => (item=net.bridge.bridge-nf-call-ip6tables)  2026-04-28 07:02:27.311833 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:02:27.311839 | orchestrator | ok: [testbed-node-3] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-28 07:02:27.311845 | orchestrator | ok: [testbed-node-4] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-28 07:02:27.311852 | orchestrator | ok: [testbed-node-5] => (item=net.bridge.bridge-nf-call-ip6tables) 2026-04-28 07:02:27.311858 | orchestrator | 2026-04-28 07:02:27.311865 | orchestrator | TASK [nova-cell : Install udev kolla kvm rules] ******************************** 2026-04-28 07:02:27.311871 | orchestrator | Tuesday 28 April 2026 07:02:20 +0000 (0:00:02.404) 0:03:21.640 ********* 2026-04-28 07:02:27.311877 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:02:27.311883 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:02:27.311889 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:02:27.311895 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:02:27.311903 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:02:27.311909 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:02:27.311915 | orchestrator | 2026-04-28 07:02:27.311921 | orchestrator | TASK [nova-cell : Mask qemu-kvm service] *************************************** 2026-04-28 07:02:27.311927 | orchestrator | Tuesday 28 April 2026 07:02:22 +0000 (0:00:02.139) 0:03:23.780 ********* 2026-04-28 07:02:27.311933 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:02:27.311951 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:02:27.311958 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:02:27.311964 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:02:27.311970 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:02:27.311976 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:02:27.311983 | orchestrator | 2026-04-28 07:02:27.311989 | orchestrator | TASK [nova-cell : Ensuring config directories exist] *************************** 2026-04-28 07:02:27.311995 | orchestrator | Tuesday 28 April 2026 07:02:25 +0000 (0:00:02.433) 0:03:26.213 ********* 2026-04-28 07:02:27.312004 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 07:02:27.312014 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 07:02:27.312021 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 07:02:27.312045 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 07:02:27.312056 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 07:02:27.312063 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 07:02:27.312071 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 07:02:27.312078 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 07:02:27.312093 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 07:02:33.309869 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 07:02:33.310091 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 07:02:33.310121 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:02:33.310143 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:02:33.310163 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:02:33.310213 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 07:02:33.310239 | orchestrator | 2026-04-28 07:02:33.310285 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-28 07:02:33.310299 | orchestrator | Tuesday 28 April 2026 07:02:28 +0000 (0:00:03.677) 0:03:29.891 ********* 2026-04-28 07:02:33.310311 | orchestrator | included: /ansible/roles/nova-cell/tasks/copy-certs.yml for testbed-node-3, testbed-node-4, testbed-node-5, testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:02:33.310323 | orchestrator | 2026-04-28 07:02:33.310335 | orchestrator | TASK [service-cert-copy : nova | Copying over extra CA certificates] *********** 2026-04-28 07:02:33.310346 | orchestrator | Tuesday 28 April 2026 07:02:31 +0000 (0:00:02.161) 0:03:32.053 ********* 2026-04-28 07:02:33.310366 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 07:02:33.310379 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 07:02:33.310457 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 07:02:33.310482 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 07:02:33.310506 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 07:02:37.508109 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 07:02:37.508258 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 07:02:37.508277 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 07:02:37.508289 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 07:02:37.508347 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:02:37.508361 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:02:37.508432 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 07:02:37.508453 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 07:02:37.508465 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:02:37.508476 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 07:02:37.508497 | orchestrator | 2026-04-28 07:02:37.508510 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS certificate] *** 2026-04-28 07:02:37.508522 | orchestrator | Tuesday 28 April 2026 07:02:35 +0000 (0:00:04.748) 0:03:36.802 ********* 2026-04-28 07:02:37.508536 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 07:02:37.508557 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 07:02:38.773789 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 07:02:38.773948 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 07:02:38.773979 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 07:02:38.774096 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:02:38.774124 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 07:02:38.774144 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:02:38.774162 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 07:02:38.774206 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 07:02:38.774236 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 07:02:38.774255 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:02:38.774328 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:02:38.774350 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:02:38.774369 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:02:38.774433 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 07:02:38.774463 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 07:02:38.774497 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:02:41.982606 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 07:02:41.982696 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:02:41.982713 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:02:41.982743 | orchestrator | 2026-04-28 07:02:41.982756 | orchestrator | TASK [service-cert-copy : nova | Copying over backend internal TLS key] ******** 2026-04-28 07:02:41.982768 | orchestrator | Tuesday 28 April 2026 07:02:39 +0000 (0:00:04.066) 0:03:40.868 ********* 2026-04-28 07:02:41.982780 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 07:02:41.982793 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 07:02:41.982805 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 07:02:41.982816 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:02:41.982844 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 07:02:41.982863 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 07:02:41.982882 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 07:02:41.982894 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 07:02:41.982905 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:02:41.982917 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 07:02:41.982928 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 07:02:41.982948 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 07:03:12.949808 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:03:12.949923 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:03:12.949938 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:03:12.949948 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 07:03:12.949959 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 07:03:12.949967 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:03:12.949976 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:03:12.949984 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:03:12.949992 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:03:12.950001 | orchestrator | 2026-04-28 07:03:12.950010 | orchestrator | TASK [nova-cell : include_tasks] *********************************************** 2026-04-28 07:03:12.950065 | orchestrator | Tuesday 28 April 2026 07:02:43 +0000 (0:00:03.934) 0:03:44.802 ********* 2026-04-28 07:03:12.950074 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:03:12.950083 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:03:12.950091 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:03:12.950118 | orchestrator | included: /ansible/roles/nova-cell/tasks/external_ceph.yml for testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 07:03:12.950127 | orchestrator | 2026-04-28 07:03:12.950136 | orchestrator | TASK [nova-cell : Check nova keyring file] ************************************* 2026-04-28 07:03:12.950144 | orchestrator | Tuesday 28 April 2026 07:02:46 +0000 (0:00:02.743) 0:03:47.546 ********* 2026-04-28 07:03:12.950152 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 07:03:12.950160 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 07:03:12.950168 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 07:03:12.950176 | orchestrator | 2026-04-28 07:03:12.950184 | orchestrator | TASK [nova-cell : Check cinder keyring file] *********************************** 2026-04-28 07:03:12.950205 | orchestrator | Tuesday 28 April 2026 07:02:48 +0000 (0:00:01.913) 0:03:49.460 ********* 2026-04-28 07:03:12.950213 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 07:03:12.950225 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 07:03:12.950234 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 07:03:12.950241 | orchestrator | 2026-04-28 07:03:12.950249 | orchestrator | TASK [nova-cell : Extract nova key from file] ********************************** 2026-04-28 07:03:12.950257 | orchestrator | Tuesday 28 April 2026 07:02:50 +0000 (0:00:02.128) 0:03:51.588 ********* 2026-04-28 07:03:12.950265 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:03:12.950273 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:03:12.950281 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:03:12.950289 | orchestrator | 2026-04-28 07:03:12.950297 | orchestrator | TASK [nova-cell : Extract cinder key from file] ******************************** 2026-04-28 07:03:12.950305 | orchestrator | Tuesday 28 April 2026 07:02:52 +0000 (0:00:01.862) 0:03:53.451 ********* 2026-04-28 07:03:12.950312 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:03:12.950320 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:03:12.950328 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:03:12.950335 | orchestrator | 2026-04-28 07:03:12.950343 | orchestrator | TASK [nova-cell : Copy over ceph nova keyring file] **************************** 2026-04-28 07:03:12.950351 | orchestrator | Tuesday 28 April 2026 07:02:54 +0000 (0:00:01.618) 0:03:55.069 ********* 2026-04-28 07:03:12.950361 | orchestrator | ok: [testbed-node-3] => (item=nova-compute) 2026-04-28 07:03:12.950370 | orchestrator | ok: [testbed-node-4] => (item=nova-compute) 2026-04-28 07:03:12.950413 | orchestrator | ok: [testbed-node-5] => (item=nova-compute) 2026-04-28 07:03:12.950426 | orchestrator | 2026-04-28 07:03:12.950440 | orchestrator | TASK [nova-cell : Copy over ceph cinder keyring file] ************************** 2026-04-28 07:03:12.950453 | orchestrator | Tuesday 28 April 2026 07:02:56 +0000 (0:00:02.239) 0:03:57.309 ********* 2026-04-28 07:03:12.950466 | orchestrator | ok: [testbed-node-3] => (item=nova-compute) 2026-04-28 07:03:12.950479 | orchestrator | ok: [testbed-node-4] => (item=nova-compute) 2026-04-28 07:03:12.950495 | orchestrator | ok: [testbed-node-5] => (item=nova-compute) 2026-04-28 07:03:12.950505 | orchestrator | 2026-04-28 07:03:12.950514 | orchestrator | TASK [nova-cell : Copy over ceph.conf] ***************************************** 2026-04-28 07:03:12.950524 | orchestrator | Tuesday 28 April 2026 07:02:58 +0000 (0:00:02.168) 0:03:59.478 ********* 2026-04-28 07:03:12.950533 | orchestrator | ok: [testbed-node-5] => (item=nova-compute) 2026-04-28 07:03:12.950543 | orchestrator | ok: [testbed-node-4] => (item=nova-compute) 2026-04-28 07:03:12.950553 | orchestrator | ok: [testbed-node-3] => (item=nova-compute) 2026-04-28 07:03:12.950562 | orchestrator | ok: [testbed-node-5] => (item=nova-libvirt) 2026-04-28 07:03:12.950570 | orchestrator | ok: [testbed-node-3] => (item=nova-libvirt) 2026-04-28 07:03:12.950579 | orchestrator | ok: [testbed-node-4] => (item=nova-libvirt) 2026-04-28 07:03:12.950589 | orchestrator | 2026-04-28 07:03:12.950598 | orchestrator | TASK [nova-cell : Ensure /etc/ceph directory exists (host libvirt)] ************ 2026-04-28 07:03:12.950607 | orchestrator | Tuesday 28 April 2026 07:03:04 +0000 (0:00:05.571) 0:04:05.050 ********* 2026-04-28 07:03:12.950616 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:03:12.950624 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:03:12.950641 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:03:12.950651 | orchestrator | 2026-04-28 07:03:12.950660 | orchestrator | TASK [nova-cell : Copy over ceph.conf (host libvirt)] ************************** 2026-04-28 07:03:12.950669 | orchestrator | Tuesday 28 April 2026 07:03:05 +0000 (0:00:01.561) 0:04:06.611 ********* 2026-04-28 07:03:12.950678 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:03:12.950687 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:03:12.950697 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:03:12.950706 | orchestrator | 2026-04-28 07:03:12.950714 | orchestrator | TASK [nova-cell : Ensuring libvirt secrets directory exists] ******************* 2026-04-28 07:03:12.950722 | orchestrator | Tuesday 28 April 2026 07:03:07 +0000 (0:00:01.407) 0:04:08.019 ********* 2026-04-28 07:03:12.950730 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:03:12.950737 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:03:12.950745 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:03:12.950753 | orchestrator | 2026-04-28 07:03:12.950760 | orchestrator | TASK [nova-cell : Pushing nova secret xml for libvirt] ************************* 2026-04-28 07:03:12.950768 | orchestrator | Tuesday 28 April 2026 07:03:09 +0000 (0:00:02.639) 0:04:10.658 ********* 2026-04-28 07:03:12.950777 | orchestrator | ok: [testbed-node-3] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'ceph-ephemeral-nova', 'desc': 'Ceph Client Secret for Ephemeral Storage (Nova)', 'enabled': True}) 2026-04-28 07:03:12.950787 | orchestrator | ok: [testbed-node-4] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'ceph-ephemeral-nova', 'desc': 'Ceph Client Secret for Ephemeral Storage (Nova)', 'enabled': True}) 2026-04-28 07:03:12.950795 | orchestrator | ok: [testbed-node-5] => (item={'uuid': '5a2bf0bf-e1ab-4a6a-bc32-404bb6ba91fd', 'name': 'ceph-ephemeral-nova', 'desc': 'Ceph Client Secret for Ephemeral Storage (Nova)', 'enabled': True}) 2026-04-28 07:03:12.950803 | orchestrator | ok: [testbed-node-4] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'ceph-persistent-cinder', 'desc': 'Ceph Client Secret for Persistent Storage (Cinder)', 'enabled': 'yes'}) 2026-04-28 07:03:12.950811 | orchestrator | ok: [testbed-node-3] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'ceph-persistent-cinder', 'desc': 'Ceph Client Secret for Persistent Storage (Cinder)', 'enabled': 'yes'}) 2026-04-28 07:03:12.950819 | orchestrator | ok: [testbed-node-5] => (item={'uuid': '63dd366f-e403-41f2-beff-dad9980a1637', 'name': 'ceph-persistent-cinder', 'desc': 'Ceph Client Secret for Persistent Storage (Cinder)', 'enabled': 'yes'}) 2026-04-28 07:03:12.950827 | orchestrator | 2026-04-28 07:03:12.950841 | orchestrator | TASK [nova-cell : Pushing secrets key for libvirt] ***************************** 2026-04-28 07:03:34.526572 | orchestrator | Tuesday 28 April 2026 07:03:13 +0000 (0:00:04.166) 0:04:14.824 ********* 2026-04-28 07:03:34.526706 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-28 07:03:34.526722 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-28 07:03:34.526734 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-28 07:03:34.526745 | orchestrator | ok: [testbed-node-3] => (item=None) 2026-04-28 07:03:34.526756 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:03:34.526768 | orchestrator | ok: [testbed-node-4] => (item=None) 2026-04-28 07:03:34.526779 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:03:34.526789 | orchestrator | ok: [testbed-node-5] => (item=None) 2026-04-28 07:03:34.526800 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:03:34.526811 | orchestrator | 2026-04-28 07:03:34.526823 | orchestrator | TASK [nova-cell : Include tasks from qemu_wrapper.yml] ************************* 2026-04-28 07:03:34.526834 | orchestrator | Tuesday 28 April 2026 07:03:18 +0000 (0:00:04.395) 0:04:19.220 ********* 2026-04-28 07:03:34.526845 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:03:34.526856 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:03:34.526867 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:03:34.526879 | orchestrator | included: /ansible/roles/nova-cell/tasks/qemu_wrapper.yml for testbed-node-4, testbed-node-3, testbed-node-5 2026-04-28 07:03:34.526890 | orchestrator | 2026-04-28 07:03:34.526922 | orchestrator | TASK [nova-cell : Check qemu wrapper file] ************************************* 2026-04-28 07:03:34.526934 | orchestrator | Tuesday 28 April 2026 07:03:21 +0000 (0:00:03.494) 0:04:22.715 ********* 2026-04-28 07:03:34.526945 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 07:03:34.526956 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 07:03:34.526966 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 07:03:34.526977 | orchestrator | 2026-04-28 07:03:34.526988 | orchestrator | TASK [nova-cell : Copy qemu wrapper] ******************************************* 2026-04-28 07:03:34.526999 | orchestrator | Tuesday 28 April 2026 07:03:23 +0000 (0:00:02.011) 0:04:24.727 ********* 2026-04-28 07:03:34.527010 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:03:34.527020 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:03:34.527032 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:03:34.527043 | orchestrator | 2026-04-28 07:03:34.527054 | orchestrator | TASK [nova-cell : Check if policies shall be overwritten] ********************** 2026-04-28 07:03:34.527065 | orchestrator | Tuesday 28 April 2026 07:03:25 +0000 (0:00:01.370) 0:04:26.098 ********* 2026-04-28 07:03:34.527075 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:03:34.527086 | orchestrator | 2026-04-28 07:03:34.527097 | orchestrator | TASK [nova-cell : Set nova policy file] **************************************** 2026-04-28 07:03:34.527110 | orchestrator | Tuesday 28 April 2026 07:03:26 +0000 (0:00:01.136) 0:04:27.234 ********* 2026-04-28 07:03:34.527123 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:03:34.527136 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:03:34.527148 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:03:34.527161 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:03:34.527174 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:03:34.527193 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:03:34.527212 | orchestrator | 2026-04-28 07:03:34.527240 | orchestrator | TASK [nova-cell : Check for vendordata file] *********************************** 2026-04-28 07:03:34.527260 | orchestrator | Tuesday 28 April 2026 07:03:28 +0000 (0:00:01.955) 0:04:29.189 ********* 2026-04-28 07:03:34.527279 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 07:03:34.527297 | orchestrator | 2026-04-28 07:03:34.527315 | orchestrator | TASK [nova-cell : Set vendordata file path] ************************************ 2026-04-28 07:03:34.527333 | orchestrator | Tuesday 28 April 2026 07:03:30 +0000 (0:00:01.764) 0:04:30.954 ********* 2026-04-28 07:03:34.527352 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:03:34.527398 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:03:34.527416 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:03:34.527435 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:03:34.527451 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:03:34.527462 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:03:34.527472 | orchestrator | 2026-04-28 07:03:34.527483 | orchestrator | TASK [nova-cell : Copying over config.json files for services] ***************** 2026-04-28 07:03:34.527493 | orchestrator | Tuesday 28 April 2026 07:03:31 +0000 (0:00:01.911) 0:04:32.865 ********* 2026-04-28 07:03:34.527508 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 07:03:34.527553 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 07:03:34.527578 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 07:03:34.527591 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 07:03:34.527604 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 07:03:34.527615 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 07:03:34.527627 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 07:03:34.527658 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 07:03:38.037818 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 07:03:38.037931 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:03:38.037948 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:03:38.037960 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:03:38.037973 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 07:03:38.038086 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 07:03:38.038122 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 07:03:38.038135 | orchestrator | 2026-04-28 07:03:38.038148 | orchestrator | TASK [nova-cell : Copying over nova.conf] ************************************** 2026-04-28 07:03:38.038160 | orchestrator | Tuesday 28 April 2026 07:03:36 +0000 (0:00:04.626) 0:04:37.492 ********* 2026-04-28 07:03:38.038173 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 07:03:38.038185 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 07:03:38.038198 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 07:03:38.038223 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 07:03:38.038243 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 07:03:49.615889 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 07:03:49.616008 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 07:03:49.616026 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 07:03:49.616063 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 07:03:49.616091 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 07:03:49.616122 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 07:03:49.616135 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 07:03:49.616148 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:03:49.616159 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:03:49.616180 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:03:49.616192 | orchestrator | 2026-04-28 07:03:49.616205 | orchestrator | TASK [nova-cell : Copying over Nova compute provider config] ******************* 2026-04-28 07:03:49.616217 | orchestrator | Tuesday 28 April 2026 07:03:44 +0000 (0:00:07.844) 0:04:45.336 ********* 2026-04-28 07:03:49.616229 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:03:49.616241 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:03:49.616251 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:03:49.616262 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:03:49.616273 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:03:49.616283 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:03:49.616294 | orchestrator | 2026-04-28 07:03:49.616305 | orchestrator | TASK [nova-cell : Copying over libvirt configuration] ************************** 2026-04-28 07:03:49.616321 | orchestrator | Tuesday 28 April 2026 07:03:47 +0000 (0:00:02.903) 0:04:48.240 ********* 2026-04-28 07:03:49.616332 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-28 07:03:49.616343 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-28 07:03:49.616354 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'})  2026-04-28 07:03:49.616400 | orchestrator | ok: [testbed-node-3] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-28 07:03:49.616412 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-28 07:03:49.616426 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:03:49.616440 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-28 07:03:49.616453 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:03:49.616467 | orchestrator | ok: [testbed-node-5] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-28 07:03:49.616480 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'})  2026-04-28 07:03:49.616493 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:03:49.616515 | orchestrator | ok: [testbed-node-4] => (item={'src': 'qemu.conf.j2', 'dest': 'qemu.conf'}) 2026-04-28 07:04:19.160776 | orchestrator | ok: [testbed-node-3] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-28 07:04:19.160894 | orchestrator | ok: [testbed-node-4] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-28 07:04:19.160910 | orchestrator | ok: [testbed-node-5] => (item={'src': 'libvirtd.conf.j2', 'dest': 'libvirtd.conf'}) 2026-04-28 07:04:19.160922 | orchestrator | 2026-04-28 07:04:19.160934 | orchestrator | TASK [nova-cell : Copying over libvirt TLS keys] ******************************* 2026-04-28 07:04:19.160946 | orchestrator | Tuesday 28 April 2026 07:03:52 +0000 (0:00:04.975) 0:04:53.216 ********* 2026-04-28 07:04:19.160957 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:04:19.160968 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:04:19.160979 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:04:19.160990 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:04:19.161000 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:04:19.161011 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:04:19.161021 | orchestrator | 2026-04-28 07:04:19.161058 | orchestrator | TASK [nova-cell : Copying over libvirt SASL configuration] ********************* 2026-04-28 07:04:19.161069 | orchestrator | Tuesday 28 April 2026 07:03:54 +0000 (0:00:01.741) 0:04:54.958 ********* 2026-04-28 07:04:19.161080 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-28 07:04:19.161092 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-28 07:04:19.161102 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'})  2026-04-28 07:04:19.161113 | orchestrator | ok: [testbed-node-3] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-28 07:04:19.161124 | orchestrator | ok: [testbed-node-5] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-28 07:04:19.161135 | orchestrator | ok: [testbed-node-4] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-compute'}) 2026-04-28 07:04:19.161145 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-28 07:04:19.161156 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-28 07:04:19.161166 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'})  2026-04-28 07:04:19.161177 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-28 07:04:19.161188 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:04:19.161198 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-28 07:04:19.161209 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:04:19.161219 | orchestrator | ok: [testbed-node-3] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-28 07:04:19.161230 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'})  2026-04-28 07:04:19.161241 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:04:19.161251 | orchestrator | ok: [testbed-node-4] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-28 07:04:19.161262 | orchestrator | ok: [testbed-node-5] => (item={'src': 'auth.conf.j2', 'dest': 'auth.conf', 'service': 'nova-libvirt'}) 2026-04-28 07:04:19.161272 | orchestrator | ok: [testbed-node-3] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-28 07:04:19.161283 | orchestrator | ok: [testbed-node-4] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-28 07:04:19.161293 | orchestrator | ok: [testbed-node-5] => (item={'src': 'sasl.conf.j2', 'dest': 'sasl.conf', 'service': 'nova-libvirt'}) 2026-04-28 07:04:19.161304 | orchestrator | 2026-04-28 07:04:19.161329 | orchestrator | TASK [nova-cell : Copying files for nova-ssh] ********************************** 2026-04-28 07:04:19.161343 | orchestrator | Tuesday 28 April 2026 07:04:00 +0000 (0:00:06.385) 0:05:01.344 ********* 2026-04-28 07:04:19.161383 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-28 07:04:19.161397 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-28 07:04:19.161408 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'})  2026-04-28 07:04:19.161420 | orchestrator | ok: [testbed-node-4] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-28 07:04:19.161433 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-28 07:04:19.161445 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-28 07:04:19.161458 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'id_rsa', 'dest': 'id_rsa'})  2026-04-28 07:04:19.161479 | orchestrator | ok: [testbed-node-5] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-28 07:04:19.161491 | orchestrator | ok: [testbed-node-3] => (item={'src': 'sshd_config.j2', 'dest': 'sshd_config'}) 2026-04-28 07:04:19.161522 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-28 07:04:19.161536 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-28 07:04:19.161549 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'})  2026-04-28 07:04:19.161560 | orchestrator | skipping: [testbed-node-0] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-28 07:04:19.161571 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:04:19.161582 | orchestrator | skipping: [testbed-node-2] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-28 07:04:19.161592 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:04:19.161603 | orchestrator | ok: [testbed-node-3] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-28 07:04:19.161613 | orchestrator | skipping: [testbed-node-1] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'})  2026-04-28 07:04:19.161624 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:04:19.161634 | orchestrator | ok: [testbed-node-4] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-28 07:04:19.161645 | orchestrator | ok: [testbed-node-5] => (item={'src': 'id_rsa', 'dest': 'id_rsa'}) 2026-04-28 07:04:19.161656 | orchestrator | ok: [testbed-node-3] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-28 07:04:19.161667 | orchestrator | ok: [testbed-node-4] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-28 07:04:19.161677 | orchestrator | ok: [testbed-node-5] => (item={'src': 'id_rsa.pub', 'dest': 'id_rsa.pub'}) 2026-04-28 07:04:19.161688 | orchestrator | ok: [testbed-node-3] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-28 07:04:19.161698 | orchestrator | ok: [testbed-node-4] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-28 07:04:19.161709 | orchestrator | ok: [testbed-node-5] => (item={'src': 'ssh_config.j2', 'dest': 'ssh_config'}) 2026-04-28 07:04:19.161719 | orchestrator | 2026-04-28 07:04:19.161730 | orchestrator | TASK [nova-cell : Copying VMware vCenter CA file] ****************************** 2026-04-28 07:04:19.161741 | orchestrator | Tuesday 28 April 2026 07:04:08 +0000 (0:00:08.097) 0:05:09.442 ********* 2026-04-28 07:04:19.161751 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:04:19.161762 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:04:19.161772 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:04:19.161783 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:04:19.161794 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:04:19.161804 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:04:19.161814 | orchestrator | 2026-04-28 07:04:19.161825 | orchestrator | TASK [nova-cell : Copying 'release' file for nova_compute] ********************* 2026-04-28 07:04:19.161836 | orchestrator | Tuesday 28 April 2026 07:04:10 +0000 (0:00:01.828) 0:05:11.270 ********* 2026-04-28 07:04:19.161846 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:04:19.161857 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:04:19.161867 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:04:19.161879 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:04:19.161889 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:04:19.161900 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:04:19.161911 | orchestrator | 2026-04-28 07:04:19.161921 | orchestrator | TASK [nova-cell : Generating 'hostnqn' file for nova_compute] ****************** 2026-04-28 07:04:19.161932 | orchestrator | Tuesday 28 April 2026 07:04:12 +0000 (0:00:01.914) 0:05:13.185 ********* 2026-04-28 07:04:19.161943 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:04:19.161953 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:04:19.161964 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:04:19.161975 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:04:19.161985 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:04:19.162001 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:04:19.162012 | orchestrator | 2026-04-28 07:04:19.162098 | orchestrator | TASK [nova-cell : Generating 'hostid' file for nova_compute] ******************* 2026-04-28 07:04:19.162109 | orchestrator | Tuesday 28 April 2026 07:04:15 +0000 (0:00:02.838) 0:05:16.023 ********* 2026-04-28 07:04:19.162120 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:04:19.162131 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:04:19.162141 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:04:19.162152 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:04:19.162163 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:04:19.162173 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:04:19.162184 | orchestrator | 2026-04-28 07:04:19.162195 | orchestrator | TASK [nova-cell : Copying over existing policy file] *************************** 2026-04-28 07:04:19.162205 | orchestrator | Tuesday 28 April 2026 07:04:18 +0000 (0:00:03.302) 0:05:19.326 ********* 2026-04-28 07:04:19.162227 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 07:04:19.162252 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 07:04:19.969998 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 07:04:19.970155 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:04:19.970174 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 07:04:19.970215 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 07:04:19.970240 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 07:04:19.970252 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:04:19.970264 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 07:04:19.970293 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 07:04:19.970306 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 07:04:19.970324 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:04:19.970337 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 07:04:19.970423 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 07:04:19.970437 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:04:19.970449 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:04:19.970460 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:04:19.970472 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:04:19.970491 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 07:04:25.839628 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:04:25.839786 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:04:25.839808 | orchestrator | 2026-04-28 07:04:25.839821 | orchestrator | TASK [nova-cell : Copying over vendordata file to containers] ****************** 2026-04-28 07:04:25.839833 | orchestrator | Tuesday 28 April 2026 07:04:21 +0000 (0:00:02.663) 0:05:21.990 ********* 2026-04-28 07:04:25.839845 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute)  2026-04-28 07:04:25.839856 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute-ironic)  2026-04-28 07:04:25.839866 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:04:25.839877 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute)  2026-04-28 07:04:25.839889 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute-ironic)  2026-04-28 07:04:25.839908 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:04:25.839925 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute)  2026-04-28 07:04:25.839943 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute-ironic)  2026-04-28 07:04:25.839963 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:04:25.839981 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute)  2026-04-28 07:04:25.839998 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute-ironic)  2026-04-28 07:04:25.840018 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:04:25.840037 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute)  2026-04-28 07:04:25.840055 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute-ironic)  2026-04-28 07:04:25.840073 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:04:25.840092 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute)  2026-04-28 07:04:25.840110 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute-ironic)  2026-04-28 07:04:25.840137 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:04:25.840158 | orchestrator | 2026-04-28 07:04:25.840177 | orchestrator | TASK [service-check-containers : nova_cell | Check containers] ***************** 2026-04-28 07:04:25.840194 | orchestrator | Tuesday 28 April 2026 07:04:23 +0000 (0:00:02.090) 0:05:24.081 ********* 2026-04-28 07:04:25.840237 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 07:04:25.840261 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 07:04:25.840325 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}}) 2026-04-28 07:04:25.840391 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 07:04:25.840409 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 07:04:25.840430 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 07:04:25.840442 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 07:04:25.840454 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}}) 2026-04-28 07:04:25.840484 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}}) 2026-04-28 07:04:31.040272 | orchestrator | ok: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 07:04:31.040419 | orchestrator | ok: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 07:04:31.040453 | orchestrator | ok: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}}) 2026-04-28 07:04:31.040466 | orchestrator | ok: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:04:31.040480 | orchestrator | ok: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:04:31.040532 | orchestrator | ok: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:04:31.040547 | orchestrator | 2026-04-28 07:04:31.040560 | orchestrator | TASK [service-check-containers : nova_cell | Notify handlers to restart containers] *** 2026-04-28 07:04:31.040573 | orchestrator | Tuesday 28 April 2026 07:04:28 +0000 (0:00:04.949) 0:05:29.030 ********* 2026-04-28 07:04:31.040585 | orchestrator | ok: [testbed-node-3] => { 2026-04-28 07:04:31.040598 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:04:31.040609 | orchestrator | } 2026-04-28 07:04:31.040620 | orchestrator | ok: [testbed-node-4] => { 2026-04-28 07:04:31.040630 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:04:31.040641 | orchestrator | } 2026-04-28 07:04:31.040652 | orchestrator | ok: [testbed-node-5] => { 2026-04-28 07:04:31.040663 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:04:31.040674 | orchestrator | } 2026-04-28 07:04:31.040685 | orchestrator | ok: [testbed-node-0] => { 2026-04-28 07:04:31.040695 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:04:31.040706 | orchestrator | } 2026-04-28 07:04:31.040716 | orchestrator | ok: [testbed-node-1] => { 2026-04-28 07:04:31.040727 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:04:31.040738 | orchestrator | } 2026-04-28 07:04:31.040748 | orchestrator | ok: [testbed-node-2] => { 2026-04-28 07:04:31.040759 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:04:31.040769 | orchestrator | } 2026-04-28 07:04:31.040780 | orchestrator | 2026-04-28 07:04:31.040791 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 07:04:31.040804 | orchestrator | Tuesday 28 April 2026 07:04:30 +0000 (0:00:02.010) 0:05:31.040 ********* 2026-04-28 07:04:31.040825 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 07:04:31.040840 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 07:04:31.040863 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 07:04:31.040877 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:04:31.040900 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 07:04:35.338597 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 07:04:35.338698 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 07:04:35.338714 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:04:35.338747 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-libvirt', 'value': {'container_name': 'nova_libvirt', 'group': 'compute', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'pid_mode': 'host', 'cgroupns_mode': 'host', 'privileged': True, 'volumes': ['/etc/kolla/nova-libvirt/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', '', '/sys/fs/cgroup:/sys/fs/cgroup', 'kolla_logs:/var/log/kolla/', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', 'nova_libvirt_qemu:/etc/libvirt/qemu', ''], 'dimensions': {'ulimits': {'memlock': {'soft': 67108864, 'hard': 67108864}}}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'virsh version --daemon'], 'timeout': '30'}}})  2026-04-28 07:04:35.338784 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-ssh', 'value': {'container_name': 'nova_ssh', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-ssh/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla', 'nova_compute:/var/lib/nova', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen sshd 8022'], 'timeout': '30'}}})  2026-04-28 07:04:35.338796 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'nova-compute', 'value': {'container_name': 'nova_compute', 'group': 'compute', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'environment': {'LIBGUESTFS_BACKEND': 'direct'}, 'privileged': True, 'enabled': True, 'ipc_mode': 'host', 'volumes': ['/etc/kolla/nova-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/lib/modules:/lib/modules:ro', '/run:/run:shared', '/dev:/dev', 'kolla_logs:/var/log/kolla/', '', 'libvirtd:/var/lib/libvirt', 'nova_compute:/var/lib/nova/', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-compute 5672'], 'timeout': '30'}}})  2026-04-28 07:04:35.338808 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:04:35.338838 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 07:04:35.338851 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:04:35.338863 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:04:35.338875 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 07:04:35.338891 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:04:35.338910 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:04:35.338921 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-novncproxy', 'value': {'container_name': 'nova_novncproxy', 'group': 'nova-novncproxy', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328', 'enabled': True, 'volumes': ['/etc/kolla/nova-novncproxy/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:6080/vnc_lite.html'], 'timeout': '30'}}})  2026-04-28 07:04:35.338933 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'nova-conductor', 'value': {'container_name': 'nova_conductor', 'group': 'nova-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328', 'volumes': ['/etc/kolla/nova-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port nova-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:04:35.338944 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:04:35.338956 | orchestrator | 2026-04-28 07:04:35.338968 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-28 07:04:35.338979 | orchestrator | Tuesday 28 April 2026 07:04:33 +0000 (0:00:03.770) 0:05:34.811 ********* 2026-04-28 07:04:35.338991 | orchestrator | 2026-04-28 07:04:35.339002 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-28 07:04:35.339013 | orchestrator | Tuesday 28 April 2026 07:04:34 +0000 (0:00:00.501) 0:05:35.313 ********* 2026-04-28 07:04:35.339023 | orchestrator | 2026-04-28 07:04:35.339035 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-28 07:04:35.339046 | orchestrator | Tuesday 28 April 2026 07:04:34 +0000 (0:00:00.531) 0:05:35.845 ********* 2026-04-28 07:04:35.339057 | orchestrator | 2026-04-28 07:04:35.339074 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-28 07:06:06.284514 | orchestrator | Tuesday 28 April 2026 07:04:35 +0000 (0:00:00.750) 0:05:36.595 ********* 2026-04-28 07:06:06.284619 | orchestrator | 2026-04-28 07:06:06.284632 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-28 07:06:06.284642 | orchestrator | Tuesday 28 April 2026 07:04:36 +0000 (0:00:00.509) 0:05:37.105 ********* 2026-04-28 07:06:06.284650 | orchestrator | 2026-04-28 07:06:06.284660 | orchestrator | TASK [nova-cell : Flush handlers] ********************************************** 2026-04-28 07:06:06.284669 | orchestrator | Tuesday 28 April 2026 07:04:36 +0000 (0:00:00.508) 0:05:37.613 ********* 2026-04-28 07:06:06.284678 | orchestrator | 2026-04-28 07:06:06.284686 | orchestrator | PLAY [Refresh nova scheduler cell cache] *************************************** 2026-04-28 07:06:06.284695 | orchestrator | 2026-04-28 07:06:06.284703 | orchestrator | TASK [nova : Refresh cell cache in nova scheduler] ***************************** 2026-04-28 07:06:06.284712 | orchestrator | Tuesday 28 April 2026 07:04:38 +0000 (0:00:02.073) 0:05:39.687 ********* 2026-04-28 07:06:06.284720 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:06:06.284730 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:06:06.284739 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:06:06.284747 | orchestrator | 2026-04-28 07:06:06.284756 | orchestrator | PLAY [Reload global Nova super conductor services] ***************************** 2026-04-28 07:06:06.284764 | orchestrator | 2026-04-28 07:06:06.284773 | orchestrator | TASK [nova : Reload nova super conductor services to remove RPC version pin] *** 2026-04-28 07:06:06.284803 | orchestrator | Tuesday 28 April 2026 07:04:40 +0000 (0:00:01.703) 0:05:41.390 ********* 2026-04-28 07:06:06.284812 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:06:06.284821 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:06:06.284829 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:06:06.284838 | orchestrator | 2026-04-28 07:06:06.284846 | orchestrator | PLAY [Reload Nova cell services] *********************************************** 2026-04-28 07:06:06.284855 | orchestrator | 2026-04-28 07:06:06.284863 | orchestrator | TASK [nova-cell : Reload nova cell services to remove RPC version cap] ********* 2026-04-28 07:06:06.284872 | orchestrator | Tuesday 28 April 2026 07:04:42 +0000 (0:00:02.494) 0:05:43.885 ********* 2026-04-28 07:06:06.284881 | orchestrator | skipping: [testbed-node-3] => (item=nova-conductor)  2026-04-28 07:06:06.284890 | orchestrator | skipping: [testbed-node-4] => (item=nova-conductor)  2026-04-28 07:06:06.284898 | orchestrator | skipping: [testbed-node-5] => (item=nova-conductor)  2026-04-28 07:06:06.284908 | orchestrator | changed: [testbed-node-0] => (item=nova-conductor) 2026-04-28 07:06:06.284929 | orchestrator | changed: [testbed-node-1] => (item=nova-conductor) 2026-04-28 07:06:06.284938 | orchestrator | changed: [testbed-node-2] => (item=nova-conductor) 2026-04-28 07:06:06.284947 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute)  2026-04-28 07:06:06.284955 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute)  2026-04-28 07:06:06.284964 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute)  2026-04-28 07:06:06.284972 | orchestrator | skipping: [testbed-node-0] => (item=nova-compute-ironic)  2026-04-28 07:06:06.284981 | orchestrator | skipping: [testbed-node-1] => (item=nova-compute-ironic)  2026-04-28 07:06:06.284989 | orchestrator | skipping: [testbed-node-2] => (item=nova-compute-ironic)  2026-04-28 07:06:06.284998 | orchestrator | changed: [testbed-node-4] => (item=nova-compute) 2026-04-28 07:06:06.285006 | orchestrator | changed: [testbed-node-3] => (item=nova-compute) 2026-04-28 07:06:06.285015 | orchestrator | skipping: [testbed-node-4] => (item=nova-compute-ironic)  2026-04-28 07:06:06.285023 | orchestrator | skipping: [testbed-node-3] => (item=nova-compute-ironic)  2026-04-28 07:06:06.285032 | orchestrator | skipping: [testbed-node-4] => (item=nova-novncproxy)  2026-04-28 07:06:06.285041 | orchestrator | skipping: [testbed-node-3] => (item=nova-novncproxy)  2026-04-28 07:06:06.285049 | orchestrator | skipping: [testbed-node-4] => (item=nova-serialproxy)  2026-04-28 07:06:06.285057 | orchestrator | skipping: [testbed-node-3] => (item=nova-serialproxy)  2026-04-28 07:06:06.285066 | orchestrator | skipping: [testbed-node-4] => (item=nova-spicehtml5proxy)  2026-04-28 07:06:06.285074 | orchestrator | skipping: [testbed-node-3] => (item=nova-spicehtml5proxy)  2026-04-28 07:06:06.285083 | orchestrator | changed: [testbed-node-5] => (item=nova-compute) 2026-04-28 07:06:06.285091 | orchestrator | skipping: [testbed-node-5] => (item=nova-compute-ironic)  2026-04-28 07:06:06.285099 | orchestrator | skipping: [testbed-node-5] => (item=nova-novncproxy)  2026-04-28 07:06:06.285108 | orchestrator | skipping: [testbed-node-5] => (item=nova-serialproxy)  2026-04-28 07:06:06.285116 | orchestrator | skipping: [testbed-node-5] => (item=nova-spicehtml5proxy)  2026-04-28 07:06:06.285125 | orchestrator | changed: [testbed-node-0] => (item=nova-novncproxy) 2026-04-28 07:06:06.285133 | orchestrator | changed: [testbed-node-2] => (item=nova-novncproxy) 2026-04-28 07:06:06.285141 | orchestrator | changed: [testbed-node-1] => (item=nova-novncproxy) 2026-04-28 07:06:06.285150 | orchestrator | skipping: [testbed-node-0] => (item=nova-serialproxy)  2026-04-28 07:06:06.285158 | orchestrator | skipping: [testbed-node-2] => (item=nova-serialproxy)  2026-04-28 07:06:06.285167 | orchestrator | skipping: [testbed-node-1] => (item=nova-serialproxy)  2026-04-28 07:06:06.285175 | orchestrator | skipping: [testbed-node-0] => (item=nova-spicehtml5proxy)  2026-04-28 07:06:06.285183 | orchestrator | skipping: [testbed-node-2] => (item=nova-spicehtml5proxy)  2026-04-28 07:06:06.285198 | orchestrator | skipping: [testbed-node-1] => (item=nova-spicehtml5proxy)  2026-04-28 07:06:06.285207 | orchestrator | 2026-04-28 07:06:06.285215 | orchestrator | PLAY [Reload global Nova API services] ***************************************** 2026-04-28 07:06:06.285224 | orchestrator | 2026-04-28 07:06:06.285232 | orchestrator | TASK [nova : Reload nova API services to remove RPC version pin] *************** 2026-04-28 07:06:06.285241 | orchestrator | Tuesday 28 April 2026 07:05:15 +0000 (0:00:32.088) 0:06:15.974 ********* 2026-04-28 07:06:06.285250 | orchestrator | changed: [testbed-node-0] => (item=nova-scheduler) 2026-04-28 07:06:06.285273 | orchestrator | changed: [testbed-node-1] => (item=nova-scheduler) 2026-04-28 07:06:06.285283 | orchestrator | changed: [testbed-node-2] => (item=nova-scheduler) 2026-04-28 07:06:06.285321 | orchestrator | changed: [testbed-node-0] => (item=nova-api) 2026-04-28 07:06:06.285338 | orchestrator | changed: [testbed-node-1] => (item=nova-api) 2026-04-28 07:06:06.285353 | orchestrator | changed: [testbed-node-2] => (item=nova-api) 2026-04-28 07:06:06.285367 | orchestrator | 2026-04-28 07:06:06.285381 | orchestrator | PLAY [Run Nova API online data migrations] ************************************* 2026-04-28 07:06:06.285396 | orchestrator | 2026-04-28 07:06:06.285405 | orchestrator | TASK [nova : Run Nova API online database migrations] ************************** 2026-04-28 07:06:06.285414 | orchestrator | Tuesday 28 April 2026 07:05:34 +0000 (0:00:19.744) 0:06:35.718 ********* 2026-04-28 07:06:06.285422 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:06:06.285434 | orchestrator | 2026-04-28 07:06:06.285451 | orchestrator | PLAY [Run Nova cell online data migrations] ************************************ 2026-04-28 07:06:06.285473 | orchestrator | 2026-04-28 07:06:06.285486 | orchestrator | TASK [nova-cell : Run Nova cell online database migrations] ******************** 2026-04-28 07:06:06.285500 | orchestrator | Tuesday 28 April 2026 07:05:51 +0000 (0:00:16.908) 0:06:52.627 ********* 2026-04-28 07:06:06.285514 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:06:06.285527 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:06:06.285541 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:06:06.285554 | orchestrator | 2026-04-28 07:06:06.285569 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 07:06:06.285582 | orchestrator | testbed-manager : ok=3  changed=3  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 07:06:06.285599 | orchestrator | testbed-node-0 : ok=39  changed=8  unreachable=0 failed=0 skipped=42  rescued=0 ignored=0 2026-04-28 07:06:06.285613 | orchestrator | testbed-node-1 : ok=27  changed=5  unreachable=0 failed=0 skipped=46  rescued=0 ignored=0 2026-04-28 07:06:06.285627 | orchestrator | testbed-node-2 : ok=27  changed=5  unreachable=0 failed=0 skipped=46  rescued=0 ignored=0 2026-04-28 07:06:06.285649 | orchestrator | testbed-node-3 : ok=43  changed=5  unreachable=0 failed=0 skipped=21  rescued=0 ignored=0 2026-04-28 07:06:06.285664 | orchestrator | testbed-node-4 : ok=37  changed=4  unreachable=0 failed=0 skipped=18  rescued=0 ignored=0 2026-04-28 07:06:06.285680 | orchestrator | testbed-node-5 : ok=37  changed=4  unreachable=0 failed=0 skipped=18  rescued=0 ignored=0 2026-04-28 07:06:06.285695 | orchestrator | 2026-04-28 07:06:06.285709 | orchestrator | 2026-04-28 07:06:06.285724 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 07:06:06.285733 | orchestrator | Tuesday 28 April 2026 07:06:05 +0000 (0:00:14.093) 0:07:06.721 ********* 2026-04-28 07:06:06.285741 | orchestrator | =============================================================================== 2026-04-28 07:06:06.285750 | orchestrator | nova-cell : Reload nova cell services to remove RPC version cap -------- 32.09s 2026-04-28 07:06:06.285758 | orchestrator | nova : Reload nova API services to remove RPC version pin -------------- 19.74s 2026-04-28 07:06:06.285775 | orchestrator | nova : Running Nova API bootstrap container ---------------------------- 18.52s 2026-04-28 07:06:06.285784 | orchestrator | nova : Run Nova upgrade checks ----------------------------------------- 18.14s 2026-04-28 07:06:06.285792 | orchestrator | nova : Run Nova API online database migrations ------------------------- 16.91s 2026-04-28 07:06:06.285801 | orchestrator | nova-cell : Run Nova cell online database migrations ------------------- 14.09s 2026-04-28 07:06:06.285809 | orchestrator | nova-cell : Running Nova cell bootstrap container ---------------------- 12.98s 2026-04-28 07:06:06.285817 | orchestrator | nova : Copying over nova.conf ------------------------------------------- 9.88s 2026-04-28 07:06:06.285825 | orchestrator | nova-cell : Copying files for nova-ssh ---------------------------------- 8.10s 2026-04-28 07:06:06.285834 | orchestrator | nova-cell : Copying over nova.conf -------------------------------------- 7.84s 2026-04-28 07:06:06.285843 | orchestrator | nova-cell : Copying over libvirt SASL configuration --------------------- 6.39s 2026-04-28 07:06:06.285851 | orchestrator | nova-cell : Copy over ceph.conf ----------------------------------------- 5.57s 2026-04-28 07:06:06.285859 | orchestrator | service-check-containers : nova | Check containers ---------------------- 5.27s 2026-04-28 07:06:06.285868 | orchestrator | nova-cell : Copying over libvirt configuration -------------------------- 4.98s 2026-04-28 07:06:06.285876 | orchestrator | service-check-containers : nova_cell | Check containers ----------------- 4.95s 2026-04-28 07:06:06.285884 | orchestrator | nova-cell : Flush handlers ---------------------------------------------- 4.88s 2026-04-28 07:06:06.285893 | orchestrator | nova-cell : Get container facts ----------------------------------------- 4.83s 2026-04-28 07:06:06.285901 | orchestrator | service-cert-copy : nova | Copying over extra CA certificates ----------- 4.75s 2026-04-28 07:06:06.285909 | orchestrator | nova-cell : Copying over config.json files for services ----------------- 4.63s 2026-04-28 07:06:06.285918 | orchestrator | nova : Copying over config.json files for services ---------------------- 4.44s 2026-04-28 07:06:06.477775 | orchestrator | + osism apply -a upgrade horizon 2026-04-28 07:06:07.756580 | orchestrator | 2026-04-28 07:06:07 | INFO  | Prepare task for execution of horizon. 2026-04-28 07:06:07.823515 | orchestrator | 2026-04-28 07:06:07 | INFO  | Task f83a8d8e-f847-413a-b264-a50e280f32ad (horizon) was prepared for execution. 2026-04-28 07:06:07.823588 | orchestrator | 2026-04-28 07:06:07 | INFO  | It takes a moment until task f83a8d8e-f847-413a-b264-a50e280f32ad (horizon) has been started and output is visible here. 2026-04-28 07:06:22.732441 | orchestrator | 2026-04-28 07:06:22.732556 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 07:06:22.732572 | orchestrator | 2026-04-28 07:06:22.732584 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 07:06:22.732596 | orchestrator | Tuesday 28 April 2026 07:06:12 +0000 (0:00:01.583) 0:00:01.583 ********* 2026-04-28 07:06:22.732607 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:06:22.732619 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:06:22.732629 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:06:22.732640 | orchestrator | 2026-04-28 07:06:22.732651 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 07:06:22.732662 | orchestrator | Tuesday 28 April 2026 07:06:14 +0000 (0:00:01.710) 0:00:03.293 ********* 2026-04-28 07:06:22.732672 | orchestrator | ok: [testbed-node-0] => (item=enable_horizon_True) 2026-04-28 07:06:22.732684 | orchestrator | ok: [testbed-node-1] => (item=enable_horizon_True) 2026-04-28 07:06:22.732694 | orchestrator | ok: [testbed-node-2] => (item=enable_horizon_True) 2026-04-28 07:06:22.732705 | orchestrator | 2026-04-28 07:06:22.732716 | orchestrator | PLAY [Apply role horizon] ****************************************************** 2026-04-28 07:06:22.732727 | orchestrator | 2026-04-28 07:06:22.732737 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-28 07:06:22.732748 | orchestrator | Tuesday 28 April 2026 07:06:16 +0000 (0:00:01.903) 0:00:05.197 ********* 2026-04-28 07:06:22.732759 | orchestrator | included: /ansible/roles/horizon/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:06:22.732794 | orchestrator | 2026-04-28 07:06:22.732806 | orchestrator | TASK [horizon : Ensuring config directories exist] ***************************** 2026-04-28 07:06:22.732816 | orchestrator | Tuesday 28 April 2026 07:06:19 +0000 (0:00:03.596) 0:00:08.794 ********* 2026-04-28 07:06:22.732849 | orchestrator | ok: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 07:06:22.732894 | orchestrator | ok: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 07:06:22.732918 | orchestrator | ok: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 07:06:22.732933 | orchestrator | 2026-04-28 07:06:22.732946 | orchestrator | TASK [horizon : Set empty custom policy] *************************************** 2026-04-28 07:06:22.732959 | orchestrator | Tuesday 28 April 2026 07:06:22 +0000 (0:00:02.481) 0:00:11.276 ********* 2026-04-28 07:06:22.732973 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:06:22.732992 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:06:22.733010 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:06:22.733028 | orchestrator | 2026-04-28 07:06:22.733057 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-28 07:06:49.383229 | orchestrator | Tuesday 28 April 2026 07:06:24 +0000 (0:00:01.629) 0:00:12.906 ********* 2026-04-28 07:06:49.383343 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'cloudkitty', 'enabled': False})  2026-04-28 07:06:49.383353 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'heat', 'enabled': 'no'})  2026-04-28 07:06:49.383359 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'ironic', 'enabled': False})  2026-04-28 07:06:49.383364 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'masakari', 'enabled': False})  2026-04-28 07:06:49.383386 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'mistral', 'enabled': False})  2026-04-28 07:06:49.383391 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'tacker', 'enabled': False})  2026-04-28 07:06:49.383395 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'trove', 'enabled': False})  2026-04-28 07:06:49.383400 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'watcher', 'enabled': False})  2026-04-28 07:06:49.383404 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'cloudkitty', 'enabled': False})  2026-04-28 07:06:49.383409 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'heat', 'enabled': 'no'})  2026-04-28 07:06:49.383413 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'ironic', 'enabled': False})  2026-04-28 07:06:49.383417 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'masakari', 'enabled': False})  2026-04-28 07:06:49.383421 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'mistral', 'enabled': False})  2026-04-28 07:06:49.383426 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'tacker', 'enabled': False})  2026-04-28 07:06:49.383440 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'trove', 'enabled': False})  2026-04-28 07:06:49.383445 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'watcher', 'enabled': False})  2026-04-28 07:06:49.383449 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'cloudkitty', 'enabled': False})  2026-04-28 07:06:49.383453 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'heat', 'enabled': 'no'})  2026-04-28 07:06:49.383458 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'ironic', 'enabled': False})  2026-04-28 07:06:49.383462 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'masakari', 'enabled': False})  2026-04-28 07:06:49.383466 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'mistral', 'enabled': False})  2026-04-28 07:06:49.383470 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'tacker', 'enabled': False})  2026-04-28 07:06:49.383474 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'trove', 'enabled': False})  2026-04-28 07:06:49.383479 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'watcher', 'enabled': False})  2026-04-28 07:06:49.383484 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'ceilometer', 'enabled': 'yes'}) 2026-04-28 07:06:49.383490 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'cinder', 'enabled': 'yes'}) 2026-04-28 07:06:49.383495 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'designate', 'enabled': True}) 2026-04-28 07:06:49.383499 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'glance', 'enabled': True}) 2026-04-28 07:06:49.383503 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'keystone', 'enabled': True}) 2026-04-28 07:06:49.383508 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'magnum', 'enabled': True}) 2026-04-28 07:06:49.383512 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'manila', 'enabled': True}) 2026-04-28 07:06:49.383516 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'neutron', 'enabled': True}) 2026-04-28 07:06:49.383520 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'nova', 'enabled': True}) 2026-04-28 07:06:49.383530 | orchestrator | included: /ansible/roles/horizon/tasks/policy_item.yml for testbed-node-0, testbed-node-1, testbed-node-2 => (item={'name': 'octavia', 'enabled': True}) 2026-04-28 07:06:49.383535 | orchestrator | 2026-04-28 07:06:49.383540 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-28 07:06:49.383544 | orchestrator | Tuesday 28 April 2026 07:06:26 +0000 (0:00:02.197) 0:00:15.103 ********* 2026-04-28 07:06:49.383549 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:06:49.383554 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:06:49.383559 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:06:49.383563 | orchestrator | 2026-04-28 07:06:49.383579 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-28 07:06:49.383583 | orchestrator | Tuesday 28 April 2026 07:06:27 +0000 (0:00:01.633) 0:00:16.736 ********* 2026-04-28 07:06:49.383588 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:06:49.383593 | orchestrator | 2026-04-28 07:06:49.383597 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-28 07:06:49.383601 | orchestrator | Tuesday 28 April 2026 07:06:28 +0000 (0:00:01.138) 0:00:17.874 ********* 2026-04-28 07:06:49.383606 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:06:49.383610 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:06:49.383614 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:06:49.383619 | orchestrator | 2026-04-28 07:06:49.383623 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-28 07:06:49.383627 | orchestrator | Tuesday 28 April 2026 07:06:30 +0000 (0:00:01.404) 0:00:19.279 ********* 2026-04-28 07:06:49.383631 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:06:49.383636 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:06:49.383640 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:06:49.383644 | orchestrator | 2026-04-28 07:06:49.383648 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-28 07:06:49.383653 | orchestrator | Tuesday 28 April 2026 07:06:31 +0000 (0:00:01.527) 0:00:20.806 ********* 2026-04-28 07:06:49.383657 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:06:49.383661 | orchestrator | 2026-04-28 07:06:49.383665 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-28 07:06:49.383669 | orchestrator | Tuesday 28 April 2026 07:06:33 +0000 (0:00:01.128) 0:00:21.934 ********* 2026-04-28 07:06:49.383674 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:06:49.383678 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:06:49.383682 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:06:49.383686 | orchestrator | 2026-04-28 07:06:49.383690 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-28 07:06:49.383698 | orchestrator | Tuesday 28 April 2026 07:06:34 +0000 (0:00:01.380) 0:00:23.315 ********* 2026-04-28 07:06:49.383702 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:06:49.383706 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:06:49.383711 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:06:49.383715 | orchestrator | 2026-04-28 07:06:49.383719 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-28 07:06:49.383723 | orchestrator | Tuesday 28 April 2026 07:06:35 +0000 (0:00:01.329) 0:00:24.644 ********* 2026-04-28 07:06:49.383727 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:06:49.383732 | orchestrator | 2026-04-28 07:06:49.383736 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-28 07:06:49.383740 | orchestrator | Tuesday 28 April 2026 07:06:36 +0000 (0:00:01.117) 0:00:25.761 ********* 2026-04-28 07:06:49.383744 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:06:49.383749 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:06:49.383753 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:06:49.383757 | orchestrator | 2026-04-28 07:06:49.383761 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-28 07:06:49.383765 | orchestrator | Tuesday 28 April 2026 07:06:38 +0000 (0:00:01.668) 0:00:27.430 ********* 2026-04-28 07:06:49.383770 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:06:49.383778 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:06:49.383784 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:06:49.383789 | orchestrator | 2026-04-28 07:06:49.383794 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-28 07:06:49.383799 | orchestrator | Tuesday 28 April 2026 07:06:39 +0000 (0:00:01.381) 0:00:28.812 ********* 2026-04-28 07:06:49.383804 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:06:49.383808 | orchestrator | 2026-04-28 07:06:49.383813 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-28 07:06:49.383818 | orchestrator | Tuesday 28 April 2026 07:06:41 +0000 (0:00:01.134) 0:00:29.947 ********* 2026-04-28 07:06:49.383823 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:06:49.383828 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:06:49.383833 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:06:49.383838 | orchestrator | 2026-04-28 07:06:49.383843 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-28 07:06:49.383848 | orchestrator | Tuesday 28 April 2026 07:06:42 +0000 (0:00:01.352) 0:00:31.299 ********* 2026-04-28 07:06:49.383853 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:06:49.383858 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:06:49.383863 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:06:49.383868 | orchestrator | 2026-04-28 07:06:49.383873 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-28 07:06:49.383879 | orchestrator | Tuesday 28 April 2026 07:06:43 +0000 (0:00:01.542) 0:00:32.842 ********* 2026-04-28 07:06:49.383883 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:06:49.383888 | orchestrator | 2026-04-28 07:06:49.383893 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-28 07:06:49.383898 | orchestrator | Tuesday 28 April 2026 07:06:45 +0000 (0:00:01.101) 0:00:33.944 ********* 2026-04-28 07:06:49.383903 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:06:49.383908 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:06:49.383912 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:06:49.383917 | orchestrator | 2026-04-28 07:06:49.383922 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-28 07:06:49.383927 | orchestrator | Tuesday 28 April 2026 07:06:46 +0000 (0:00:01.351) 0:00:35.296 ********* 2026-04-28 07:06:49.383931 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:06:49.383936 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:06:49.383941 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:06:49.383947 | orchestrator | 2026-04-28 07:06:49.383951 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-28 07:06:49.383956 | orchestrator | Tuesday 28 April 2026 07:06:47 +0000 (0:00:01.362) 0:00:36.658 ********* 2026-04-28 07:06:49.383961 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:06:49.383966 | orchestrator | 2026-04-28 07:06:49.383971 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-28 07:06:49.383976 | orchestrator | Tuesday 28 April 2026 07:06:48 +0000 (0:00:01.175) 0:00:37.833 ********* 2026-04-28 07:06:49.383981 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:06:49.383987 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:06:49.383995 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:07:23.727223 | orchestrator | 2026-04-28 07:07:23.727403 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-28 07:07:23.727421 | orchestrator | Tuesday 28 April 2026 07:06:50 +0000 (0:00:01.497) 0:00:39.331 ********* 2026-04-28 07:07:23.727433 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:07:23.727446 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:07:23.727457 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:07:23.727468 | orchestrator | 2026-04-28 07:07:23.727479 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-28 07:07:23.727490 | orchestrator | Tuesday 28 April 2026 07:06:51 +0000 (0:00:01.485) 0:00:40.816 ********* 2026-04-28 07:07:23.727502 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:07:23.727539 | orchestrator | 2026-04-28 07:07:23.727551 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-28 07:07:23.727562 | orchestrator | Tuesday 28 April 2026 07:06:53 +0000 (0:00:01.138) 0:00:41.955 ********* 2026-04-28 07:07:23.727573 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:07:23.727584 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:07:23.727595 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:07:23.727606 | orchestrator | 2026-04-28 07:07:23.727616 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-28 07:07:23.727627 | orchestrator | Tuesday 28 April 2026 07:06:54 +0000 (0:00:01.294) 0:00:43.250 ********* 2026-04-28 07:07:23.727638 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:07:23.727648 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:07:23.727659 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:07:23.727670 | orchestrator | 2026-04-28 07:07:23.727680 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-28 07:07:23.727691 | orchestrator | Tuesday 28 April 2026 07:06:55 +0000 (0:00:01.450) 0:00:44.700 ********* 2026-04-28 07:07:23.727702 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:07:23.727713 | orchestrator | 2026-04-28 07:07:23.727723 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-28 07:07:23.727749 | orchestrator | Tuesday 28 April 2026 07:06:57 +0000 (0:00:01.193) 0:00:45.894 ********* 2026-04-28 07:07:23.727760 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:07:23.727771 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:07:23.727782 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:07:23.727792 | orchestrator | 2026-04-28 07:07:23.727803 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-28 07:07:23.727814 | orchestrator | Tuesday 28 April 2026 07:06:58 +0000 (0:00:01.314) 0:00:47.208 ********* 2026-04-28 07:07:23.727825 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:07:23.727839 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:07:23.727858 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:07:23.727875 | orchestrator | 2026-04-28 07:07:23.727893 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-28 07:07:23.727911 | orchestrator | Tuesday 28 April 2026 07:06:59 +0000 (0:00:01.428) 0:00:48.637 ********* 2026-04-28 07:07:23.727926 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:07:23.727942 | orchestrator | 2026-04-28 07:07:23.727957 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-28 07:07:23.727974 | orchestrator | Tuesday 28 April 2026 07:07:00 +0000 (0:00:01.139) 0:00:49.777 ********* 2026-04-28 07:07:23.727989 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:07:23.728006 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:07:23.728024 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:07:23.728041 | orchestrator | 2026-04-28 07:07:23.728059 | orchestrator | TASK [horizon : Update policy file name] *************************************** 2026-04-28 07:07:23.728076 | orchestrator | Tuesday 28 April 2026 07:07:02 +0000 (0:00:01.315) 0:00:51.092 ********* 2026-04-28 07:07:23.728095 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:07:23.728113 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:07:23.728132 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:07:23.728151 | orchestrator | 2026-04-28 07:07:23.728169 | orchestrator | TASK [horizon : Check if policies shall be overwritten] ************************ 2026-04-28 07:07:23.728188 | orchestrator | Tuesday 28 April 2026 07:07:03 +0000 (0:00:01.384) 0:00:52.476 ********* 2026-04-28 07:07:23.728199 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:07:23.728209 | orchestrator | 2026-04-28 07:07:23.728220 | orchestrator | TASK [horizon : Update custom policy file name] ******************************** 2026-04-28 07:07:23.728230 | orchestrator | Tuesday 28 April 2026 07:07:04 +0000 (0:00:01.130) 0:00:53.606 ********* 2026-04-28 07:07:23.728241 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:07:23.728278 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:07:23.728291 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:07:23.728302 | orchestrator | 2026-04-28 07:07:23.728313 | orchestrator | TASK [horizon : Copying over config.json files for services] ******************* 2026-04-28 07:07:23.728335 | orchestrator | Tuesday 28 April 2026 07:07:06 +0000 (0:00:01.364) 0:00:54.971 ********* 2026-04-28 07:07:23.728346 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:07:23.728357 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:07:23.728368 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:07:23.728379 | orchestrator | 2026-04-28 07:07:23.728389 | orchestrator | TASK [horizon : Copying over horizon.conf] ************************************* 2026-04-28 07:07:23.728401 | orchestrator | Tuesday 28 April 2026 07:07:08 +0000 (0:00:02.906) 0:00:57.877 ********* 2026-04-28 07:07:23.728412 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/horizon/templates/horizon.conf.j2) 2026-04-28 07:07:23.728424 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/horizon/templates/horizon.conf.j2) 2026-04-28 07:07:23.728434 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/horizon/templates/horizon.conf.j2) 2026-04-28 07:07:23.728445 | orchestrator | 2026-04-28 07:07:23.728456 | orchestrator | TASK [horizon : Copying over kolla-settings.py] ******************************** 2026-04-28 07:07:23.728466 | orchestrator | Tuesday 28 April 2026 07:07:12 +0000 (0:00:03.035) 0:01:00.912 ********* 2026-04-28 07:07:23.728477 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/horizon/templates/_9998-kolla-settings.py.j2) 2026-04-28 07:07:23.728489 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/horizon/templates/_9998-kolla-settings.py.j2) 2026-04-28 07:07:23.728520 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/horizon/templates/_9998-kolla-settings.py.j2) 2026-04-28 07:07:23.728532 | orchestrator | 2026-04-28 07:07:23.728543 | orchestrator | TASK [horizon : Copying over custom-settings.py] ******************************* 2026-04-28 07:07:23.728554 | orchestrator | Tuesday 28 April 2026 07:07:14 +0000 (0:00:02.943) 0:01:03.856 ********* 2026-04-28 07:07:23.728564 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/horizon/templates/_9999-custom-settings.py.j2) 2026-04-28 07:07:23.728575 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/horizon/templates/_9999-custom-settings.py.j2) 2026-04-28 07:07:23.728586 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/horizon/templates/_9999-custom-settings.py.j2) 2026-04-28 07:07:23.728597 | orchestrator | 2026-04-28 07:07:23.728607 | orchestrator | TASK [horizon : Copying over existing policy file] ***************************** 2026-04-28 07:07:23.728618 | orchestrator | Tuesday 28 April 2026 07:07:17 +0000 (0:00:02.550) 0:01:06.406 ********* 2026-04-28 07:07:23.728629 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:07:23.728640 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:07:23.728650 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:07:23.728661 | orchestrator | 2026-04-28 07:07:23.728672 | orchestrator | TASK [horizon : Copying over custom themes] ************************************ 2026-04-28 07:07:23.728682 | orchestrator | Tuesday 28 April 2026 07:07:18 +0000 (0:00:01.376) 0:01:07.783 ********* 2026-04-28 07:07:23.728693 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:07:23.728704 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:07:23.728714 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:07:23.728725 | orchestrator | 2026-04-28 07:07:23.728735 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-28 07:07:23.728746 | orchestrator | Tuesday 28 April 2026 07:07:20 +0000 (0:00:01.541) 0:01:09.324 ********* 2026-04-28 07:07:23.728764 | orchestrator | included: /ansible/roles/horizon/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:07:23.728776 | orchestrator | 2026-04-28 07:07:23.728786 | orchestrator | TASK [service-cert-copy : horizon | Copying over extra CA certificates] ******** 2026-04-28 07:07:23.728797 | orchestrator | Tuesday 28 April 2026 07:07:22 +0000 (0:00:01.724) 0:01:11.048 ********* 2026-04-28 07:07:23.728814 | orchestrator | ok: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 07:07:23.728856 | orchestrator | ok: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 07:07:25.555717 | orchestrator | ok: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 07:07:25.555804 | orchestrator | 2026-04-28 07:07:25.555815 | orchestrator | TASK [service-cert-copy : horizon | Copying over backend internal TLS certificate] *** 2026-04-28 07:07:25.555824 | orchestrator | Tuesday 28 April 2026 07:07:24 +0000 (0:00:02.789) 0:01:13.838 ********* 2026-04-28 07:07:25.555862 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-28 07:07:25.555890 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:07:25.555900 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-28 07:07:25.555907 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:07:25.555924 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-28 07:07:30.314361 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:07:30.314473 | orchestrator | 2026-04-28 07:07:30.314491 | orchestrator | TASK [service-cert-copy : horizon | Copying over backend internal TLS key] ***** 2026-04-28 07:07:30.314504 | orchestrator | Tuesday 28 April 2026 07:07:26 +0000 (0:00:01.707) 0:01:15.545 ********* 2026-04-28 07:07:30.314519 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-28 07:07:30.314535 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:07:30.314681 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-28 07:07:30.314703 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:07:30.314722 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-28 07:07:30.314744 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:07:30.314756 | orchestrator | 2026-04-28 07:07:30.314767 | orchestrator | TASK [service-check-containers : horizon | Check containers] ******************* 2026-04-28 07:07:30.314778 | orchestrator | Tuesday 28 April 2026 07:07:28 +0000 (0:00:02.030) 0:01:17.576 ********* 2026-04-28 07:07:30.314801 | orchestrator | changed: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 07:07:33.568105 | orchestrator | changed: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 07:07:33.568200 | orchestrator | changed: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}}) 2026-04-28 07:07:33.568207 | orchestrator | 2026-04-28 07:07:33.568212 | orchestrator | TASK [service-check-containers : horizon | Notify handlers to restart containers] *** 2026-04-28 07:07:33.568217 | orchestrator | Tuesday 28 April 2026 07:07:31 +0000 (0:00:02.952) 0:01:20.529 ********* 2026-04-28 07:07:33.568222 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 07:07:33.568227 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:07:33.568230 | orchestrator | } 2026-04-28 07:07:33.568234 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 07:07:33.568238 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:07:33.568277 | orchestrator | } 2026-04-28 07:07:33.568281 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 07:07:33.568285 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:07:33.568288 | orchestrator | } 2026-04-28 07:07:33.568292 | orchestrator | 2026-04-28 07:07:33.568296 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 07:07:33.568300 | orchestrator | Tuesday 28 April 2026 07:07:33 +0000 (0:00:01.420) 0:01:21.950 ********* 2026-04-28 07:07:33.568308 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-28 07:07:33.568313 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:07:33.568323 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-28 07:08:46.354428 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:08:46.354557 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'horizon', 'value': {'container_name': 'horizon', 'group': 'horizon', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328', 'environment': {'ENABLE_BLAZAR': 'no', 'ENABLE_CLOUDKITTY': 'no', 'ENABLE_DESIGNATE': 'yes', 'ENABLE_FWAAS': 'no', 'ENABLE_HEAT': 'no', 'ENABLE_IRONIC': 'no', 'ENABLE_MAGNUM': 'yes', 'ENABLE_MANILA': 'yes', 'ENABLE_MASAKARI': 'no', 'ENABLE_MISTRAL': 'no', 'ENABLE_NEUTRON_VPNAAS': 'no', 'ENABLE_OCTAVIA': 'yes', 'ENABLE_TACKER': 'no', 'ENABLE_TROVE': 'no', 'ENABLE_VENUS': 'no', 'ENABLE_WATCHER': 'no', 'ENABLE_ZUN': 'no', 'FORCE_GENERATE': 'no'}, 'volumes': ['/etc/kolla/horizon/:/var/lib/kolla/config_files/:ro', '', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:80'], 'timeout': '30'}, 'haproxy': {'horizon': {'enabled': True, 'mode': 'http', 'external': False, 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_redirect': {'enabled': True, 'mode': 'redirect', 'external': False, 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'horizon_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '443', 'listen_port': '80', 'frontend_http_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }'], 'backend_http_extra': ['balance roundrobin', 'option httpchk'], 'tls_backend': 'no'}, 'horizon_external_redirect': {'enabled': True, 'mode': 'redirect', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '80', 'listen_port': '80', 'frontend_redirect_extra': ['use_backend acme_client_back if { path_reg ^/.well-known/acme-challenge/.+ }']}, 'acme_client': {'enabled': True, 'with_frontend': False, 'custom_member_list': []}}}})  2026-04-28 07:08:46.354580 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:08:46.354593 | orchestrator | 2026-04-28 07:08:46.354606 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-28 07:08:46.354618 | orchestrator | Tuesday 28 April 2026 07:07:35 +0000 (0:00:02.211) 0:01:24.161 ********* 2026-04-28 07:08:46.354629 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:08:46.354640 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:08:46.354651 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:08:46.354662 | orchestrator | 2026-04-28 07:08:46.354673 | orchestrator | TASK [horizon : include_tasks] ************************************************* 2026-04-28 07:08:46.354684 | orchestrator | Tuesday 28 April 2026 07:07:36 +0000 (0:00:01.558) 0:01:25.720 ********* 2026-04-28 07:08:46.354719 | orchestrator | included: /ansible/roles/horizon/tasks/bootstrap_service.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:08:46.354731 | orchestrator | 2026-04-28 07:08:46.354741 | orchestrator | TASK [horizon : Running Horizon bootstrap container] *************************** 2026-04-28 07:08:46.354752 | orchestrator | Tuesday 28 April 2026 07:07:38 +0000 (0:00:01.679) 0:01:27.399 ********* 2026-04-28 07:08:46.354763 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:08:46.354773 | orchestrator | 2026-04-28 07:08:46.354784 | orchestrator | TASK [horizon : Flush handlers] ************************************************ 2026-04-28 07:08:46.354795 | orchestrator | Tuesday 28 April 2026 07:08:12 +0000 (0:00:34.018) 0:02:01.417 ********* 2026-04-28 07:08:46.354805 | orchestrator | 2026-04-28 07:08:46.354816 | orchestrator | TASK [horizon : Flush handlers] ************************************************ 2026-04-28 07:08:46.354827 | orchestrator | Tuesday 28 April 2026 07:08:13 +0000 (0:00:00.649) 0:02:02.066 ********* 2026-04-28 07:08:46.354837 | orchestrator | 2026-04-28 07:08:46.354848 | orchestrator | TASK [horizon : Flush handlers] ************************************************ 2026-04-28 07:08:46.354861 | orchestrator | Tuesday 28 April 2026 07:08:13 +0000 (0:00:00.446) 0:02:02.513 ********* 2026-04-28 07:08:46.354880 | orchestrator | 2026-04-28 07:08:46.354897 | orchestrator | RUNNING HANDLER [horizon : Restart horizon container] ************************** 2026-04-28 07:08:46.354914 | orchestrator | Tuesday 28 April 2026 07:08:14 +0000 (0:00:00.783) 0:02:03.296 ********* 2026-04-28 07:08:46.354934 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:08:46.354951 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:08:46.354967 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:08:46.354986 | orchestrator | 2026-04-28 07:08:46.355007 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 07:08:46.355041 | orchestrator | testbed-node-0 : ok=36  changed=6  unreachable=0 failed=0 skipped=26  rescued=0 ignored=0 2026-04-28 07:08:46.355075 | orchestrator | testbed-node-1 : ok=35  changed=5  unreachable=0 failed=0 skipped=16  rescued=0 ignored=0 2026-04-28 07:08:46.355088 | orchestrator | testbed-node-2 : ok=35  changed=5  unreachable=0 failed=0 skipped=16  rescued=0 ignored=0 2026-04-28 07:08:46.355191 | orchestrator | 2026-04-28 07:08:46.355288 | orchestrator | 2026-04-28 07:08:46.355312 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 07:08:46.355331 | orchestrator | Tuesday 28 April 2026 07:08:45 +0000 (0:00:31.520) 0:02:34.817 ********* 2026-04-28 07:08:46.355349 | orchestrator | =============================================================================== 2026-04-28 07:08:46.355361 | orchestrator | horizon : Running Horizon bootstrap container -------------------------- 34.02s 2026-04-28 07:08:46.355371 | orchestrator | horizon : Restart horizon container ------------------------------------ 31.52s 2026-04-28 07:08:46.355382 | orchestrator | horizon : include_tasks ------------------------------------------------- 3.60s 2026-04-28 07:08:46.355393 | orchestrator | horizon : Copying over horizon.conf ------------------------------------- 3.04s 2026-04-28 07:08:46.355410 | orchestrator | service-check-containers : horizon | Check containers ------------------- 2.95s 2026-04-28 07:08:46.355428 | orchestrator | horizon : Copying over kolla-settings.py -------------------------------- 2.94s 2026-04-28 07:08:46.355448 | orchestrator | horizon : Copying over config.json files for services ------------------- 2.91s 2026-04-28 07:08:46.355465 | orchestrator | service-cert-copy : horizon | Copying over extra CA certificates -------- 2.79s 2026-04-28 07:08:46.355486 | orchestrator | horizon : Copying over custom-settings.py ------------------------------- 2.55s 2026-04-28 07:08:46.355504 | orchestrator | horizon : Ensuring config directories exist ----------------------------- 2.48s 2026-04-28 07:08:46.355522 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.21s 2026-04-28 07:08:46.355533 | orchestrator | horizon : include_tasks ------------------------------------------------- 2.20s 2026-04-28 07:08:46.355562 | orchestrator | service-cert-copy : horizon | Copying over backend internal TLS key ----- 2.03s 2026-04-28 07:08:46.355578 | orchestrator | Group hosts based on enabled services ----------------------------------- 1.90s 2026-04-28 07:08:46.355604 | orchestrator | horizon : Flush handlers ------------------------------------------------ 1.88s 2026-04-28 07:08:46.355623 | orchestrator | horizon : include_tasks ------------------------------------------------- 1.72s 2026-04-28 07:08:46.355641 | orchestrator | Group hosts based on Kolla action --------------------------------------- 1.71s 2026-04-28 07:08:46.355659 | orchestrator | service-cert-copy : horizon | Copying over backend internal TLS certificate --- 1.71s 2026-04-28 07:08:46.355676 | orchestrator | horizon : include_tasks ------------------------------------------------- 1.68s 2026-04-28 07:08:46.355694 | orchestrator | horizon : Update custom policy file name -------------------------------- 1.67s 2026-04-28 07:08:46.540155 | orchestrator | + osism apply -a upgrade skyline 2026-04-28 07:08:47.820560 | orchestrator | 2026-04-28 07:08:47 | INFO  | Prepare task for execution of skyline. 2026-04-28 07:08:47.890822 | orchestrator | 2026-04-28 07:08:47 | INFO  | Task 75926fe2-783a-43db-87d6-7c9fdf5945a2 (skyline) was prepared for execution. 2026-04-28 07:08:47.890919 | orchestrator | 2026-04-28 07:08:47 | INFO  | It takes a moment until task 75926fe2-783a-43db-87d6-7c9fdf5945a2 (skyline) has been started and output is visible here. 2026-04-28 07:09:04.722121 | orchestrator | 2026-04-28 07:09:04.722256 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 07:09:04.722268 | orchestrator | 2026-04-28 07:09:04.722278 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 07:09:04.722287 | orchestrator | Tuesday 28 April 2026 07:08:52 +0000 (0:00:01.659) 0:00:01.659 ********* 2026-04-28 07:09:04.722295 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:09:04.722305 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:09:04.722314 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:09:04.722322 | orchestrator | 2026-04-28 07:09:04.722330 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 07:09:04.722339 | orchestrator | Tuesday 28 April 2026 07:08:54 +0000 (0:00:01.726) 0:00:03.385 ********* 2026-04-28 07:09:04.722347 | orchestrator | ok: [testbed-node-0] => (item=enable_skyline_True) 2026-04-28 07:09:04.722356 | orchestrator | ok: [testbed-node-1] => (item=enable_skyline_True) 2026-04-28 07:09:04.722364 | orchestrator | ok: [testbed-node-2] => (item=enable_skyline_True) 2026-04-28 07:09:04.722372 | orchestrator | 2026-04-28 07:09:04.722380 | orchestrator | PLAY [Apply role skyline] ****************************************************** 2026-04-28 07:09:04.722388 | orchestrator | 2026-04-28 07:09:04.722396 | orchestrator | TASK [skyline : include_tasks] ************************************************* 2026-04-28 07:09:04.722404 | orchestrator | Tuesday 28 April 2026 07:08:56 +0000 (0:00:01.791) 0:00:05.177 ********* 2026-04-28 07:09:04.722413 | orchestrator | included: /ansible/roles/skyline/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:09:04.722422 | orchestrator | 2026-04-28 07:09:04.722430 | orchestrator | TASK [skyline : Ensuring config directories exist] ***************************** 2026-04-28 07:09:04.722439 | orchestrator | Tuesday 28 April 2026 07:08:58 +0000 (0:00:02.419) 0:00:07.597 ********* 2026-04-28 07:09:04.722466 | orchestrator | ok: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-28 07:09:04.722497 | orchestrator | ok: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-28 07:09:04.722524 | orchestrator | ok: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 07:09:04.722533 | orchestrator | ok: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 07:09:04.722546 | orchestrator | ok: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-28 07:09:04.722561 | orchestrator | ok: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 07:09:04.722570 | orchestrator | 2026-04-28 07:09:04.722578 | orchestrator | TASK [skyline : include_tasks] ************************************************* 2026-04-28 07:09:04.722586 | orchestrator | Tuesday 28 April 2026 07:09:01 +0000 (0:00:03.108) 0:00:10.705 ********* 2026-04-28 07:09:04.722594 | orchestrator | included: /ansible/roles/skyline/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:09:04.722603 | orchestrator | 2026-04-28 07:09:04.722611 | orchestrator | TASK [service-cert-copy : skyline | Copying over extra CA certificates] ******** 2026-04-28 07:09:04.722619 | orchestrator | Tuesday 28 April 2026 07:09:03 +0000 (0:00:01.656) 0:00:12.362 ********* 2026-04-28 07:09:04.722633 | orchestrator | ok: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-28 07:09:07.237575 | orchestrator | ok: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-28 07:09:07.237696 | orchestrator | ok: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-28 07:09:07.237712 | orchestrator | ok: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 07:09:07.237740 | orchestrator | ok: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 07:09:07.237759 | orchestrator | ok: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 07:09:07.237780 | orchestrator | 2026-04-28 07:09:07.237792 | orchestrator | TASK [service-cert-copy : skyline | Copying over backend internal TLS certificate] *** 2026-04-28 07:09:07.237803 | orchestrator | Tuesday 28 April 2026 07:09:06 +0000 (0:00:03.248) 0:00:15.610 ********* 2026-04-28 07:09:07.237815 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-28 07:09:07.237826 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 07:09:07.237837 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:09:07.237855 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-28 07:09:09.103561 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 07:09:09.103694 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:09:09.103706 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-28 07:09:09.103714 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 07:09:09.103722 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:09:09.103729 | orchestrator | 2026-04-28 07:09:09.103736 | orchestrator | TASK [service-cert-copy : skyline | Copying over backend internal TLS key] ***** 2026-04-28 07:09:09.103744 | orchestrator | Tuesday 28 April 2026 07:09:08 +0000 (0:00:01.710) 0:00:17.320 ********* 2026-04-28 07:09:09.103772 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-28 07:09:09.103785 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 07:09:09.103792 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:09:09.103799 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-28 07:09:09.103806 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 07:09:09.103813 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:09:09.103828 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-28 07:09:18.436356 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 07:09:18.436503 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:09:18.436521 | orchestrator | 2026-04-28 07:09:18.436533 | orchestrator | TASK [skyline : Copying over skyline.yaml files for services] ****************** 2026-04-28 07:09:18.436544 | orchestrator | Tuesday 28 April 2026 07:09:10 +0000 (0:00:02.000) 0:00:19.321 ********* 2026-04-28 07:09:18.436556 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-28 07:09:18.436567 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-28 07:09:18.436644 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-28 07:09:18.436658 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 07:09:18.436670 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 07:09:18.436681 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 07:09:18.436701 | orchestrator | 2026-04-28 07:09:18.436711 | orchestrator | TASK [skyline : Copying over gunicorn.py files for services] ******************* 2026-04-28 07:09:18.436722 | orchestrator | Tuesday 28 April 2026 07:09:14 +0000 (0:00:03.652) 0:00:22.973 ********* 2026-04-28 07:09:18.436731 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/skyline/templates/gunicorn.py.j2) 2026-04-28 07:09:18.436742 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/skyline/templates/gunicorn.py.j2) 2026-04-28 07:09:18.436757 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/skyline/templates/gunicorn.py.j2) 2026-04-28 07:09:18.436767 | orchestrator | 2026-04-28 07:09:18.436777 | orchestrator | TASK [skyline : Copying over nginx.conf files for services] ******************** 2026-04-28 07:09:18.436787 | orchestrator | Tuesday 28 April 2026 07:09:16 +0000 (0:00:02.686) 0:00:25.660 ********* 2026-04-28 07:09:18.436803 | orchestrator | changed: [testbed-node-0] => (item=/ansible/roles/skyline/templates/nginx.conf.j2) 2026-04-28 07:09:26.879751 | orchestrator | changed: [testbed-node-1] => (item=/ansible/roles/skyline/templates/nginx.conf.j2) 2026-04-28 07:09:26.879898 | orchestrator | changed: [testbed-node-2] => (item=/ansible/roles/skyline/templates/nginx.conf.j2) 2026-04-28 07:09:26.879914 | orchestrator | 2026-04-28 07:09:26.879927 | orchestrator | TASK [skyline : Copying over config.json files for services] ******************* 2026-04-28 07:09:26.879940 | orchestrator | Tuesday 28 April 2026 07:09:19 +0000 (0:00:03.121) 0:00:28.782 ********* 2026-04-28 07:09:26.879959 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-28 07:09:26.879977 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-28 07:09:26.880022 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-28 07:09:26.880079 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 07:09:26.880094 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 07:09:26.880107 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 07:09:26.880127 | orchestrator | 2026-04-28 07:09:26.880139 | orchestrator | TASK [skyline : Copying over custom logos] ************************************* 2026-04-28 07:09:26.880150 | orchestrator | Tuesday 28 April 2026 07:09:23 +0000 (0:00:03.894) 0:00:32.677 ********* 2026-04-28 07:09:26.880161 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:09:26.880173 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:09:26.880210 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:09:26.880221 | orchestrator | 2026-04-28 07:09:26.880232 | orchestrator | TASK [service-check-containers : skyline | Check containers] ******************* 2026-04-28 07:09:26.880243 | orchestrator | Tuesday 28 April 2026 07:09:25 +0000 (0:00:01.728) 0:00:34.406 ********* 2026-04-28 07:09:26.880263 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-28 07:09:26.880288 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-28 07:09:30.949266 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}}) 2026-04-28 07:09:30.949408 | orchestrator | changed: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 07:09:30.949443 | orchestrator | changed: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 07:09:30.949476 | orchestrator | changed: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}}) 2026-04-28 07:09:30.949490 | orchestrator | 2026-04-28 07:09:30.949536 | orchestrator | TASK [service-check-containers : skyline | Notify handlers to restart containers] *** 2026-04-28 07:09:30.949550 | orchestrator | Tuesday 28 April 2026 07:09:28 +0000 (0:00:03.315) 0:00:37.722 ********* 2026-04-28 07:09:30.949562 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 07:09:30.949574 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:09:30.949585 | orchestrator | } 2026-04-28 07:09:30.949596 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 07:09:30.949606 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:09:30.949617 | orchestrator | } 2026-04-28 07:09:30.949627 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 07:09:30.949638 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:09:30.949648 | orchestrator | } 2026-04-28 07:09:30.949659 | orchestrator | 2026-04-28 07:09:30.949679 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 07:09:30.949693 | orchestrator | Tuesday 28 April 2026 07:09:30 +0000 (0:00:01.585) 0:00:39.307 ********* 2026-04-28 07:09:30.949708 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-28 07:09:30.949723 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 07:09:30.949742 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:09:30.949757 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-28 07:09:30.949783 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 07:10:06.566748 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:10:06.566870 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-apiserver', 'value': {'container_name': 'skyline_apiserver', 'group': 'skyline-apiserver', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-apiserver/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9998/docs'], 'timeout': '30'}, 'haproxy': {'skyline_apiserver': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}, 'skyline_apiserver_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9998', 'listen_port': '9998', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /docs']}}}})  2026-04-28 07:10:06.566909 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'skyline-console', 'value': {'container_name': 'skyline_console', 'group': 'skyline-console', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328', 'volumes': ['/etc/kolla/skyline-console/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9999/docs'], 'timeout': '30'}, 'haproxy': {'skyline_console': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}, 'skyline_console_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9999', 'listen_port': '9999', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk GET /']}}}})  2026-04-28 07:10:06.566923 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:10:06.566936 | orchestrator | 2026-04-28 07:10:06.566948 | orchestrator | TASK [skyline : Flush handlers] ************************************************ 2026-04-28 07:10:06.566960 | orchestrator | Tuesday 28 April 2026 07:09:32 +0000 (0:00:02.078) 0:00:41.386 ********* 2026-04-28 07:10:06.566971 | orchestrator | 2026-04-28 07:10:06.566982 | orchestrator | TASK [skyline : Flush handlers] ************************************************ 2026-04-28 07:10:06.566992 | orchestrator | Tuesday 28 April 2026 07:09:32 +0000 (0:00:00.447) 0:00:41.833 ********* 2026-04-28 07:10:06.567003 | orchestrator | 2026-04-28 07:10:06.567014 | orchestrator | TASK [skyline : Flush handlers] ************************************************ 2026-04-28 07:10:06.567024 | orchestrator | Tuesday 28 April 2026 07:09:33 +0000 (0:00:00.453) 0:00:42.287 ********* 2026-04-28 07:10:06.567035 | orchestrator | 2026-04-28 07:10:06.567046 | orchestrator | RUNNING HANDLER [skyline : Restart skyline-apiserver container] **************** 2026-04-28 07:10:06.567057 | orchestrator | Tuesday 28 April 2026 07:09:34 +0000 (0:00:00.829) 0:00:43.117 ********* 2026-04-28 07:10:06.567068 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:10:06.567079 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:10:06.567089 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:10:06.567100 | orchestrator | 2026-04-28 07:10:06.567111 | orchestrator | RUNNING HANDLER [skyline : Restart skyline-console container] ****************** 2026-04-28 07:10:06.567144 | orchestrator | Tuesday 28 April 2026 07:09:48 +0000 (0:00:14.524) 0:00:57.641 ********* 2026-04-28 07:10:06.567217 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:10:06.567238 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:10:06.567254 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:10:06.567274 | orchestrator | 2026-04-28 07:10:06.567293 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 07:10:06.567313 | orchestrator | testbed-node-0 : ok=14  changed=7  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-28 07:10:06.567328 | orchestrator | testbed-node-1 : ok=14  changed=7  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-28 07:10:06.567340 | orchestrator | testbed-node-2 : ok=14  changed=7  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-28 07:10:06.567353 | orchestrator | 2026-04-28 07:10:06.567366 | orchestrator | 2026-04-28 07:10:06.567379 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 07:10:06.567391 | orchestrator | Tuesday 28 April 2026 07:10:06 +0000 (0:00:17.512) 0:01:15.153 ********* 2026-04-28 07:10:06.567404 | orchestrator | =============================================================================== 2026-04-28 07:10:06.567434 | orchestrator | skyline : Restart skyline-console container ---------------------------- 17.51s 2026-04-28 07:10:06.567446 | orchestrator | skyline : Restart skyline-apiserver container -------------------------- 14.53s 2026-04-28 07:10:06.567457 | orchestrator | skyline : Copying over config.json files for services ------------------- 3.89s 2026-04-28 07:10:06.567467 | orchestrator | skyline : Copying over skyline.yaml files for services ------------------ 3.65s 2026-04-28 07:10:06.567478 | orchestrator | service-check-containers : skyline | Check containers ------------------- 3.32s 2026-04-28 07:10:06.567488 | orchestrator | service-cert-copy : skyline | Copying over extra CA certificates -------- 3.25s 2026-04-28 07:10:06.567499 | orchestrator | skyline : Copying over nginx.conf files for services -------------------- 3.12s 2026-04-28 07:10:06.567509 | orchestrator | skyline : Ensuring config directories exist ----------------------------- 3.11s 2026-04-28 07:10:06.567520 | orchestrator | skyline : Copying over gunicorn.py files for services ------------------- 2.69s 2026-04-28 07:10:06.567531 | orchestrator | skyline : include_tasks ------------------------------------------------- 2.42s 2026-04-28 07:10:06.567541 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.08s 2026-04-28 07:10:06.567552 | orchestrator | service-cert-copy : skyline | Copying over backend internal TLS key ----- 2.00s 2026-04-28 07:10:06.567562 | orchestrator | Group hosts based on enabled services ----------------------------------- 1.79s 2026-04-28 07:10:06.567573 | orchestrator | skyline : Flush handlers ------------------------------------------------ 1.73s 2026-04-28 07:10:06.567583 | orchestrator | skyline : Copying over custom logos ------------------------------------- 1.73s 2026-04-28 07:10:06.567594 | orchestrator | Group hosts based on Kolla action --------------------------------------- 1.73s 2026-04-28 07:10:06.567604 | orchestrator | service-cert-copy : skyline | Copying over backend internal TLS certificate --- 1.71s 2026-04-28 07:10:06.567615 | orchestrator | skyline : include_tasks ------------------------------------------------- 1.66s 2026-04-28 07:10:06.567626 | orchestrator | service-check-containers : skyline | Notify handlers to restart containers --- 1.59s 2026-04-28 07:10:06.703849 | orchestrator | + osism apply -a upgrade glance 2026-04-28 07:10:07.859321 | orchestrator | 2026-04-28 07:10:07 | INFO  | Prepare task for execution of glance. 2026-04-28 07:10:07.916513 | orchestrator | 2026-04-28 07:10:07 | INFO  | Task 28f08ed5-c863-48b7-a0e8-82c29d8efd5c (glance) was prepared for execution. 2026-04-28 07:10:07.916591 | orchestrator | 2026-04-28 07:10:07 | INFO  | It takes a moment until task 28f08ed5-c863-48b7-a0e8-82c29d8efd5c (glance) has been started and output is visible here. 2026-04-28 07:10:53.075200 | orchestrator | 2026-04-28 07:10:53.075356 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 07:10:53.075374 | orchestrator | 2026-04-28 07:10:53.075387 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 07:10:53.075398 | orchestrator | Tuesday 28 April 2026 07:10:12 +0000 (0:00:01.868) 0:00:01.868 ********* 2026-04-28 07:10:53.075409 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:10:53.075422 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:10:53.075432 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:10:53.075443 | orchestrator | 2026-04-28 07:10:53.075454 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 07:10:53.075465 | orchestrator | Tuesday 28 April 2026 07:10:14 +0000 (0:00:01.834) 0:00:03.702 ********* 2026-04-28 07:10:53.075476 | orchestrator | ok: [testbed-node-0] => (item=enable_glance_True) 2026-04-28 07:10:53.075487 | orchestrator | ok: [testbed-node-1] => (item=enable_glance_True) 2026-04-28 07:10:53.075498 | orchestrator | ok: [testbed-node-2] => (item=enable_glance_True) 2026-04-28 07:10:53.075509 | orchestrator | 2026-04-28 07:10:53.075519 | orchestrator | PLAY [Apply role glance] ******************************************************* 2026-04-28 07:10:53.075530 | orchestrator | 2026-04-28 07:10:53.075541 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-28 07:10:53.075551 | orchestrator | Tuesday 28 April 2026 07:10:16 +0000 (0:00:01.923) 0:00:05.626 ********* 2026-04-28 07:10:53.075562 | orchestrator | included: /ansible/roles/glance/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:10:53.075573 | orchestrator | 2026-04-28 07:10:53.075584 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-28 07:10:53.075595 | orchestrator | Tuesday 28 April 2026 07:10:19 +0000 (0:00:03.302) 0:00:08.929 ********* 2026-04-28 07:10:53.075606 | orchestrator | included: /ansible/roles/glance/tasks/rolling_upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:10:53.075617 | orchestrator | 2026-04-28 07:10:53.075627 | orchestrator | TASK [glance : Start Glance upgrade] ******************************************* 2026-04-28 07:10:53.075638 | orchestrator | Tuesday 28 April 2026 07:10:21 +0000 (0:00:01.995) 0:00:10.924 ********* 2026-04-28 07:10:53.075649 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:10:53.075659 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:10:53.075670 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:10:53.075680 | orchestrator | 2026-04-28 07:10:53.075691 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-28 07:10:53.075704 | orchestrator | Tuesday 28 April 2026 07:10:23 +0000 (0:00:01.359) 0:00:12.283 ********* 2026-04-28 07:10:53.075717 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:10:53.075731 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:10:53.075743 | orchestrator | included: /ansible/roles/glance/tasks/config.yml for testbed-node-0 2026-04-28 07:10:53.075756 | orchestrator | 2026-04-28 07:10:53.075768 | orchestrator | TASK [glance : Ensuring config directories exist] ****************************** 2026-04-28 07:10:53.075781 | orchestrator | Tuesday 28 April 2026 07:10:24 +0000 (0:00:01.692) 0:00:13.976 ********* 2026-04-28 07:10:53.075799 | orchestrator | ok: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 07:10:53.075825 | orchestrator | 2026-04-28 07:10:53.075838 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-28 07:10:53.075851 | orchestrator | Tuesday 28 April 2026 07:10:29 +0000 (0:00:04.934) 0:00:18.911 ********* 2026-04-28 07:10:53.075863 | orchestrator | included: /ansible/roles/glance/tasks/external_ceph.yml for testbed-node-0 2026-04-28 07:10:53.075875 | orchestrator | 2026-04-28 07:10:53.075906 | orchestrator | TASK [glance : Ensuring glance service ceph config subdir exists] ************** 2026-04-28 07:10:53.075925 | orchestrator | Tuesday 28 April 2026 07:10:31 +0000 (0:00:01.518) 0:00:20.429 ********* 2026-04-28 07:10:53.075938 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:10:53.075951 | orchestrator | 2026-04-28 07:10:53.075964 | orchestrator | TASK [glance : Copy over multiple ceph configs for Glance] ********************* 2026-04-28 07:10:53.075976 | orchestrator | Tuesday 28 April 2026 07:10:35 +0000 (0:00:04.531) 0:00:24.960 ********* 2026-04-28 07:10:53.075989 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'pool': 'images', 'user': 'glance', 'enabled': True}) 2026-04-28 07:10:53.076003 | orchestrator | 2026-04-28 07:10:53.076016 | orchestrator | TASK [glance : Copy over ceph Glance keyrings] ********************************* 2026-04-28 07:10:53.076028 | orchestrator | Tuesday 28 April 2026 07:10:38 +0000 (0:00:02.512) 0:00:27.473 ********* 2026-04-28 07:10:53.076042 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'pool': 'images', 'user': 'glance', 'enabled': True}) 2026-04-28 07:10:53.076054 | orchestrator | 2026-04-28 07:10:53.076065 | orchestrator | TASK [glance : Ensuring config directory has correct owner and permission] ***** 2026-04-28 07:10:53.076075 | orchestrator | Tuesday 28 April 2026 07:10:40 +0000 (0:00:01.932) 0:00:29.406 ********* 2026-04-28 07:10:53.076086 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:10:53.076097 | orchestrator | 2026-04-28 07:10:53.076107 | orchestrator | TASK [glance : Check if policies shall be overwritten] ************************* 2026-04-28 07:10:53.076118 | orchestrator | Tuesday 28 April 2026 07:10:41 +0000 (0:00:01.464) 0:00:30.870 ********* 2026-04-28 07:10:53.076182 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:10:53.076197 | orchestrator | 2026-04-28 07:10:53.076208 | orchestrator | TASK [glance : Set glance policy file] ***************************************** 2026-04-28 07:10:53.076219 | orchestrator | Tuesday 28 April 2026 07:10:42 +0000 (0:00:01.103) 0:00:31.973 ********* 2026-04-28 07:10:53.076229 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:10:53.076240 | orchestrator | 2026-04-28 07:10:53.076251 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-28 07:10:53.076261 | orchestrator | Tuesday 28 April 2026 07:10:43 +0000 (0:00:01.127) 0:00:33.101 ********* 2026-04-28 07:10:53.076272 | orchestrator | included: /ansible/roles/glance/tasks/copy-certs.yml for testbed-node-0 2026-04-28 07:10:53.076283 | orchestrator | 2026-04-28 07:10:53.076294 | orchestrator | TASK [service-cert-copy : glance | Copying over extra CA certificates] ********* 2026-04-28 07:10:53.076304 | orchestrator | Tuesday 28 April 2026 07:10:45 +0000 (0:00:01.441) 0:00:34.542 ********* 2026-04-28 07:10:53.076317 | orchestrator | ok: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 07:10:53.076337 | orchestrator | 2026-04-28 07:10:53.076348 | orchestrator | TASK [service-cert-copy : glance | Copying over backend internal TLS certificate] *** 2026-04-28 07:10:53.076358 | orchestrator | Tuesday 28 April 2026 07:10:50 +0000 (0:00:04.765) 0:00:39.307 ********* 2026-04-28 07:10:53.076386 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-28 07:12:44.847691 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:12:44.847807 | orchestrator | 2026-04-28 07:12:44.847824 | orchestrator | TASK [service-cert-copy : glance | Copying over backend internal TLS key] ****** 2026-04-28 07:12:44.847837 | orchestrator | Tuesday 28 April 2026 07:10:54 +0000 (0:00:04.006) 0:00:43.314 ********* 2026-04-28 07:12:44.847853 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-28 07:12:44.847893 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:12:44.847906 | orchestrator | 2026-04-28 07:12:44.847917 | orchestrator | TASK [glance : Creating TLS backend PEM File] ********************************** 2026-04-28 07:12:44.847928 | orchestrator | Tuesday 28 April 2026 07:10:58 +0000 (0:00:04.026) 0:00:47.341 ********* 2026-04-28 07:12:44.847938 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:12:44.847949 | orchestrator | 2026-04-28 07:12:44.847959 | orchestrator | TASK [glance : Copying over config.json files for services] ******************** 2026-04-28 07:12:44.847970 | orchestrator | Tuesday 28 April 2026 07:11:02 +0000 (0:00:04.242) 0:00:51.583 ********* 2026-04-28 07:12:44.848014 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 07:12:44.848037 | orchestrator | 2026-04-28 07:12:44.848048 | orchestrator | TASK [glance : Copying over glance-api.conf] *********************************** 2026-04-28 07:12:44.848059 | orchestrator | Tuesday 28 April 2026 07:11:07 +0000 (0:00:05.036) 0:00:56.619 ********* 2026-04-28 07:12:44.848070 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:12:44.848080 | orchestrator | 2026-04-28 07:12:44.848128 | orchestrator | TASK [glance : Copying over glance-cache.conf for glance_api] ****************** 2026-04-28 07:12:44.848140 | orchestrator | Tuesday 28 April 2026 07:11:14 +0000 (0:00:06.694) 0:01:03.314 ********* 2026-04-28 07:12:44.848151 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:12:44.848161 | orchestrator | 2026-04-28 07:12:44.848172 | orchestrator | TASK [glance : Copying over glance-image-import.conf] ************************** 2026-04-28 07:12:44.848183 | orchestrator | Tuesday 28 April 2026 07:11:18 +0000 (0:00:04.181) 0:01:07.495 ********* 2026-04-28 07:12:44.848193 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:12:44.848204 | orchestrator | 2026-04-28 07:12:44.848215 | orchestrator | TASK [glance : Copying over property-protections-rules.conf] ******************* 2026-04-28 07:12:44.848227 | orchestrator | Tuesday 28 April 2026 07:11:22 +0000 (0:00:04.095) 0:01:11.591 ********* 2026-04-28 07:12:44.848239 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:12:44.848251 | orchestrator | 2026-04-28 07:12:44.848264 | orchestrator | TASK [glance : Copying over existing policy file] ****************************** 2026-04-28 07:12:44.848276 | orchestrator | Tuesday 28 April 2026 07:11:26 +0000 (0:00:04.234) 0:01:15.826 ********* 2026-04-28 07:12:44.848288 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:12:44.848301 | orchestrator | 2026-04-28 07:12:44.848313 | orchestrator | TASK [glance : Copying over glance-haproxy-tls.cfg] **************************** 2026-04-28 07:12:44.848325 | orchestrator | Tuesday 28 April 2026 07:11:27 +0000 (0:00:01.135) 0:01:16.962 ********* 2026-04-28 07:12:44.848338 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/glance/templates/glance-tls-proxy.cfg.j2)  2026-04-28 07:12:44.848352 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:12:44.848364 | orchestrator | 2026-04-28 07:12:44.848376 | orchestrator | TASK [glance : Generating 'hostnqn' file for glance_api] *********************** 2026-04-28 07:12:44.848388 | orchestrator | Tuesday 28 April 2026 07:11:32 +0000 (0:00:04.237) 0:01:21.200 ********* 2026-04-28 07:12:44.848399 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:12:44.848412 | orchestrator | 2026-04-28 07:12:44.848423 | orchestrator | TASK [glance : Generating 'hostid' file for glance_api] ************************ 2026-04-28 07:12:44.848436 | orchestrator | Tuesday 28 April 2026 07:11:36 +0000 (0:00:04.233) 0:01:25.433 ********* 2026-04-28 07:12:44.848448 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:12:44.848462 | orchestrator | 2026-04-28 07:12:44.848474 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-28 07:12:44.848487 | orchestrator | Tuesday 28 April 2026 07:11:40 +0000 (0:00:04.325) 0:01:29.758 ********* 2026-04-28 07:12:44.848512 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:12:44.848536 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:12:44.848549 | orchestrator | included: /ansible/roles/glance/tasks/stop_service.yml for testbed-node-0 2026-04-28 07:12:44.848562 | orchestrator | 2026-04-28 07:12:44.848575 | orchestrator | TASK [glance : Stop glance service] ******************************************** 2026-04-28 07:12:44.848586 | orchestrator | Tuesday 28 April 2026 07:11:42 +0000 (0:00:01.810) 0:01:31.569 ********* 2026-04-28 07:12:44.848597 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:12:44.848609 | orchestrator | 2026-04-28 07:12:44.848619 | orchestrator | TASK [glance : Enable log_bin_trust_function_creators function] **************** 2026-04-28 07:12:44.848630 | orchestrator | Tuesday 28 April 2026 07:11:55 +0000 (0:00:12.799) 0:01:44.369 ********* 2026-04-28 07:12:44.848641 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:12:44.848652 | orchestrator | 2026-04-28 07:12:44.848686 | orchestrator | TASK [glance : Running Glance database expand container] *********************** 2026-04-28 07:12:44.848698 | orchestrator | Tuesday 28 April 2026 07:11:58 +0000 (0:00:03.163) 0:01:47.533 ********* 2026-04-28 07:12:44.848709 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:12:44.848726 | orchestrator | 2026-04-28 07:12:44.848738 | orchestrator | TASK [glance : Running Glance database migrate container] ********************** 2026-04-28 07:12:44.848753 | orchestrator | Tuesday 28 April 2026 07:12:23 +0000 (0:00:25.196) 0:02:12.730 ********* 2026-04-28 07:12:44.848764 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:12:44.848775 | orchestrator | 2026-04-28 07:12:44.848786 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-28 07:12:44.848796 | orchestrator | Tuesday 28 April 2026 07:12:39 +0000 (0:00:16.024) 0:02:28.754 ********* 2026-04-28 07:12:44.848807 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:12:44.848818 | orchestrator | included: /ansible/roles/glance/tasks/config.yml for testbed-node-1, testbed-node-2 2026-04-28 07:12:44.848829 | orchestrator | 2026-04-28 07:12:44.848839 | orchestrator | TASK [glance : Ensuring config directories exist] ****************************** 2026-04-28 07:12:44.848850 | orchestrator | Tuesday 28 April 2026 07:12:41 +0000 (0:00:01.518) 0:02:30.273 ********* 2026-04-28 07:12:44.848873 | orchestrator | ok: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 07:13:09.594527 | orchestrator | ok: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 07:13:09.594678 | orchestrator | 2026-04-28 07:13:09.594697 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-28 07:13:09.594724 | orchestrator | Tuesday 28 April 2026 07:12:46 +0000 (0:00:04.898) 0:02:35.171 ********* 2026-04-28 07:13:09.594749 | orchestrator | included: /ansible/roles/glance/tasks/external_ceph.yml for testbed-node-1, testbed-node-2 2026-04-28 07:13:09.594808 | orchestrator | 2026-04-28 07:13:09.594821 | orchestrator | TASK [glance : Ensuring glance service ceph config subdir exists] ************** 2026-04-28 07:13:09.594831 | orchestrator | Tuesday 28 April 2026 07:12:47 +0000 (0:00:01.233) 0:02:36.404 ********* 2026-04-28 07:13:09.594841 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:13:09.594852 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:13:09.594861 | orchestrator | 2026-04-28 07:13:09.594872 | orchestrator | TASK [glance : Copy over multiple ceph configs for Glance] ********************* 2026-04-28 07:13:09.594881 | orchestrator | Tuesday 28 April 2026 07:12:51 +0000 (0:00:04.702) 0:02:41.107 ********* 2026-04-28 07:13:09.594891 | orchestrator | ok: [testbed-node-1] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'pool': 'images', 'user': 'glance', 'enabled': True}) 2026-04-28 07:13:09.594903 | orchestrator | ok: [testbed-node-2] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'pool': 'images', 'user': 'glance', 'enabled': True}) 2026-04-28 07:13:09.594912 | orchestrator | 2026-04-28 07:13:09.594922 | orchestrator | TASK [glance : Copy over ceph Glance keyrings] ********************************* 2026-04-28 07:13:09.594931 | orchestrator | Tuesday 28 April 2026 07:12:54 +0000 (0:00:02.467) 0:02:43.574 ********* 2026-04-28 07:13:09.594941 | orchestrator | ok: [testbed-node-1] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'pool': 'images', 'user': 'glance', 'enabled': True}) 2026-04-28 07:13:09.594951 | orchestrator | ok: [testbed-node-2] => (item={'name': 'rbd', 'type': 'rbd', 'cluster': 'ceph', 'pool': 'images', 'user': 'glance', 'enabled': True}) 2026-04-28 07:13:09.594960 | orchestrator | 2026-04-28 07:13:09.594969 | orchestrator | TASK [glance : Ensuring config directory has correct owner and permission] ***** 2026-04-28 07:13:09.594979 | orchestrator | Tuesday 28 April 2026 07:12:56 +0000 (0:00:02.081) 0:02:45.656 ********* 2026-04-28 07:13:09.594988 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:13:09.594998 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:13:09.595007 | orchestrator | 2026-04-28 07:13:09.595016 | orchestrator | TASK [glance : Check if policies shall be overwritten] ************************* 2026-04-28 07:13:09.595026 | orchestrator | Tuesday 28 April 2026 07:12:58 +0000 (0:00:01.500) 0:02:47.156 ********* 2026-04-28 07:13:09.595036 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:13:09.595046 | orchestrator | 2026-04-28 07:13:09.595055 | orchestrator | TASK [glance : Set glance policy file] ***************************************** 2026-04-28 07:13:09.595068 | orchestrator | Tuesday 28 April 2026 07:12:59 +0000 (0:00:01.080) 0:02:48.237 ********* 2026-04-28 07:13:09.595080 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:13:09.595092 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:13:09.595102 | orchestrator | 2026-04-28 07:13:09.595113 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-28 07:13:09.595124 | orchestrator | Tuesday 28 April 2026 07:13:00 +0000 (0:00:01.227) 0:02:49.465 ********* 2026-04-28 07:13:09.595182 | orchestrator | included: /ansible/roles/glance/tasks/copy-certs.yml for testbed-node-1, testbed-node-2 2026-04-28 07:13:09.595194 | orchestrator | 2026-04-28 07:13:09.595222 | orchestrator | TASK [service-cert-copy : glance | Copying over extra CA certificates] ********* 2026-04-28 07:13:09.595235 | orchestrator | Tuesday 28 April 2026 07:13:01 +0000 (0:00:01.238) 0:02:50.703 ********* 2026-04-28 07:13:09.595263 | orchestrator | ok: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 07:13:09.595278 | orchestrator | ok: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 07:13:09.595291 | orchestrator | 2026-04-28 07:13:09.595302 | orchestrator | TASK [service-cert-copy : glance | Copying over backend internal TLS certificate] *** 2026-04-28 07:13:09.595315 | orchestrator | Tuesday 28 April 2026 07:13:06 +0000 (0:00:04.972) 0:02:55.675 ********* 2026-04-28 07:13:09.595337 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-28 07:13:23.507013 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:13:23.507144 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-28 07:13:23.507187 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:13:23.507197 | orchestrator | 2026-04-28 07:13:23.507207 | orchestrator | TASK [service-cert-copy : glance | Copying over backend internal TLS key] ****** 2026-04-28 07:13:23.507216 | orchestrator | Tuesday 28 April 2026 07:13:10 +0000 (0:00:04.353) 0:03:00.029 ********* 2026-04-28 07:13:23.507226 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-28 07:13:23.507256 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:13:23.507288 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-28 07:13:23.507299 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:13:23.507308 | orchestrator | 2026-04-28 07:13:23.507317 | orchestrator | TASK [glance : Creating TLS backend PEM File] ********************************** 2026-04-28 07:13:23.507326 | orchestrator | Tuesday 28 April 2026 07:13:14 +0000 (0:00:04.072) 0:03:04.102 ********* 2026-04-28 07:13:23.507335 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:13:23.507343 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:13:23.507352 | orchestrator | 2026-04-28 07:13:23.507361 | orchestrator | TASK [glance : Copying over config.json files for services] ******************** 2026-04-28 07:13:23.507370 | orchestrator | Tuesday 28 April 2026 07:13:19 +0000 (0:00:04.535) 0:03:08.637 ********* 2026-04-28 07:13:23.507379 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 07:13:23.507409 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 07:14:08.970714 | orchestrator | 2026-04-28 07:14:08.970813 | orchestrator | TASK [glance : Copying over glance-api.conf] *********************************** 2026-04-28 07:14:08.970825 | orchestrator | Tuesday 28 April 2026 07:13:24 +0000 (0:00:05.117) 0:03:13.755 ********* 2026-04-28 07:14:08.970834 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:14:08.970843 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:14:08.970851 | orchestrator | 2026-04-28 07:14:08.970860 | orchestrator | TASK [glance : Copying over glance-cache.conf for glance_api] ****************** 2026-04-28 07:14:08.970868 | orchestrator | Tuesday 28 April 2026 07:13:31 +0000 (0:00:06.724) 0:03:20.479 ********* 2026-04-28 07:14:08.970876 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:14:08.970903 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:14:08.970912 | orchestrator | 2026-04-28 07:14:08.970920 | orchestrator | TASK [glance : Copying over glance-image-import.conf] ************************** 2026-04-28 07:14:08.970928 | orchestrator | Tuesday 28 April 2026 07:13:35 +0000 (0:00:04.342) 0:03:24.822 ********* 2026-04-28 07:14:08.970935 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:14:08.970943 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:14:08.970951 | orchestrator | 2026-04-28 07:14:08.970958 | orchestrator | TASK [glance : Copying over property-protections-rules.conf] ******************* 2026-04-28 07:14:08.970966 | orchestrator | Tuesday 28 April 2026 07:13:40 +0000 (0:00:04.334) 0:03:29.157 ********* 2026-04-28 07:14:08.970974 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:14:08.970981 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:14:08.970989 | orchestrator | 2026-04-28 07:14:08.970997 | orchestrator | TASK [glance : Copying over existing policy file] ****************************** 2026-04-28 07:14:08.971004 | orchestrator | Tuesday 28 April 2026 07:13:44 +0000 (0:00:04.123) 0:03:33.280 ********* 2026-04-28 07:14:08.971012 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:14:08.971020 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:14:08.971027 | orchestrator | 2026-04-28 07:14:08.971035 | orchestrator | TASK [glance : Copying over glance-haproxy-tls.cfg] **************************** 2026-04-28 07:14:08.971043 | orchestrator | Tuesday 28 April 2026 07:13:45 +0000 (0:00:01.238) 0:03:34.518 ********* 2026-04-28 07:14:08.971051 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/glance/templates/glance-tls-proxy.cfg.j2)  2026-04-28 07:14:08.971060 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:14:08.971068 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/glance/templates/glance-tls-proxy.cfg.j2)  2026-04-28 07:14:08.971075 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:14:08.971083 | orchestrator | 2026-04-28 07:14:08.971091 | orchestrator | TASK [glance : Generating 'hostnqn' file for glance_api] *********************** 2026-04-28 07:14:08.971099 | orchestrator | Tuesday 28 April 2026 07:13:49 +0000 (0:00:04.548) 0:03:39.066 ********* 2026-04-28 07:14:08.971106 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:14:08.971114 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:14:08.971122 | orchestrator | 2026-04-28 07:14:08.971130 | orchestrator | TASK [glance : Generating 'hostid' file for glance_api] ************************ 2026-04-28 07:14:08.971137 | orchestrator | Tuesday 28 April 2026 07:13:54 +0000 (0:00:04.623) 0:03:43.690 ********* 2026-04-28 07:14:08.971145 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:14:08.971152 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:14:08.971160 | orchestrator | 2026-04-28 07:14:08.971168 | orchestrator | TASK [service-check-containers : glance | Check containers] ******************** 2026-04-28 07:14:08.971175 | orchestrator | Tuesday 28 April 2026 07:13:59 +0000 (0:00:04.596) 0:03:48.287 ********* 2026-04-28 07:14:08.971199 | orchestrator | changed: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 07:14:08.971258 | orchestrator | changed: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 07:14:08.971272 | orchestrator | changed: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}}) 2026-04-28 07:14:08.971288 | orchestrator | 2026-04-28 07:14:08.971298 | orchestrator | TASK [service-check-containers : glance | Notify handlers to restart containers] *** 2026-04-28 07:14:08.971308 | orchestrator | Tuesday 28 April 2026 07:14:04 +0000 (0:00:05.308) 0:03:53.595 ********* 2026-04-28 07:14:08.971317 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 07:14:08.971327 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:14:08.971335 | orchestrator | } 2026-04-28 07:14:08.971346 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 07:14:08.971355 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:14:08.971363 | orchestrator | } 2026-04-28 07:14:08.971372 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 07:14:08.971381 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:14:08.971390 | orchestrator | } 2026-04-28 07:14:08.971398 | orchestrator | 2026-04-28 07:14:08.971407 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 07:14:08.971417 | orchestrator | Tuesday 28 April 2026 07:14:05 +0000 (0:00:01.411) 0:03:55.007 ********* 2026-04-28 07:14:08.971433 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-28 07:15:15.367995 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:15:15.368229 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-28 07:15:15.368279 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:15:15.368372 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'glance-api', 'value': {'container_name': 'glance_api', 'group': 'glance-api', 'host_in_groups': True, 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'privileged': True, 'volumes': ['/etc/kolla/glance-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'glance:/var/lib/glance/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9292'], 'timeout': '30'}, 'haproxy': {'glance_api': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}, 'glance_api_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9292', 'frontend_http_extra': ['timeout client 6h'], 'backend_http_extra': ['timeout server 6h', 'option httpchk'], 'custom_member_list': ['server testbed-node-0 192.168.16.10:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-1 192.168.16.11:9292 check inter 2000 rise 2 fall 5', 'server testbed-node-2 192.168.16.12:9292 check inter 2000 rise 2 fall 5', '']}}}})  2026-04-28 07:15:15.368384 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:15:15.368395 | orchestrator | 2026-04-28 07:15:15.368407 | orchestrator | TASK [glance : Flush handlers] ************************************************* 2026-04-28 07:15:15.368419 | orchestrator | Tuesday 28 April 2026 07:14:10 +0000 (0:00:04.608) 0:03:59.616 ********* 2026-04-28 07:15:15.368429 | orchestrator | 2026-04-28 07:15:15.368440 | orchestrator | TASK [glance : Flush handlers] ************************************************* 2026-04-28 07:15:15.368450 | orchestrator | Tuesday 28 April 2026 07:14:10 +0000 (0:00:00.475) 0:04:00.091 ********* 2026-04-28 07:15:15.368461 | orchestrator | 2026-04-28 07:15:15.368471 | orchestrator | TASK [glance : Flush handlers] ************************************************* 2026-04-28 07:15:15.368500 | orchestrator | Tuesday 28 April 2026 07:14:11 +0000 (0:00:00.444) 0:04:00.535 ********* 2026-04-28 07:15:15.368512 | orchestrator | 2026-04-28 07:15:15.368523 | orchestrator | RUNNING HANDLER [glance : Restart glance-api container] ************************ 2026-04-28 07:15:15.368535 | orchestrator | Tuesday 28 April 2026 07:14:12 +0000 (0:00:00.802) 0:04:01.338 ********* 2026-04-28 07:15:15.368548 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:15:15.368561 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:15:15.368572 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:15:15.368584 | orchestrator | 2026-04-28 07:15:15.368596 | orchestrator | TASK [glance : Running Glance database contract container] ********************* 2026-04-28 07:15:15.368609 | orchestrator | Tuesday 28 April 2026 07:14:52 +0000 (0:00:40.186) 0:04:41.525 ********* 2026-04-28 07:15:15.368621 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:15:15.368642 | orchestrator | 2026-04-28 07:15:15.368654 | orchestrator | TASK [glance : Disable log_bin_trust_function_creators function] *************** 2026-04-28 07:15:15.368666 | orchestrator | Tuesday 28 April 2026 07:15:08 +0000 (0:00:16.164) 0:04:57.690 ********* 2026-04-28 07:15:15.368678 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:15:15.368690 | orchestrator | 2026-04-28 07:15:15.368702 | orchestrator | TASK [glance : Finish Glance upgrade] ****************************************** 2026-04-28 07:15:15.368714 | orchestrator | Tuesday 28 April 2026 07:15:11 +0000 (0:00:03.062) 0:05:00.753 ********* 2026-04-28 07:15:15.368726 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:15:15.368739 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:15:15.368751 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:15:15.368763 | orchestrator | 2026-04-28 07:15:15.368776 | orchestrator | TASK [glance : include_tasks] ************************************************** 2026-04-28 07:15:15.368788 | orchestrator | Tuesday 28 April 2026 07:15:12 +0000 (0:00:01.343) 0:05:02.096 ********* 2026-04-28 07:15:15.368799 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:15:15.368812 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:15:15.368824 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:15:15.368835 | orchestrator | 2026-04-28 07:15:15.368847 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 07:15:15.368866 | orchestrator | testbed-node-0 : ok=27  changed=11  unreachable=0 failed=0 skipped=15  rescued=0 ignored=0 2026-04-28 07:15:15.368880 | orchestrator | testbed-node-1 : ok=20  changed=5  unreachable=0 failed=0 skipped=16  rescued=0 ignored=0 2026-04-28 07:15:15.368891 | orchestrator | testbed-node-2 : ok=20  changed=5  unreachable=0 failed=0 skipped=15  rescued=0 ignored=0 2026-04-28 07:15:15.368902 | orchestrator | 2026-04-28 07:15:15.368912 | orchestrator | 2026-04-28 07:15:15.368923 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 07:15:15.368934 | orchestrator | Tuesday 28 April 2026 07:15:14 +0000 (0:00:01.925) 0:05:04.023 ********* 2026-04-28 07:15:15.368945 | orchestrator | =============================================================================== 2026-04-28 07:15:15.368955 | orchestrator | glance : Restart glance-api container ---------------------------------- 40.19s 2026-04-28 07:15:15.368966 | orchestrator | glance : Running Glance database expand container ---------------------- 25.20s 2026-04-28 07:15:15.368977 | orchestrator | glance : Running Glance database contract container -------------------- 16.16s 2026-04-28 07:15:15.368987 | orchestrator | glance : Running Glance database migrate container --------------------- 16.02s 2026-04-28 07:15:15.368997 | orchestrator | glance : Stop glance service ------------------------------------------- 12.80s 2026-04-28 07:15:15.369008 | orchestrator | glance : Copying over glance-api.conf ----------------------------------- 6.72s 2026-04-28 07:15:15.369018 | orchestrator | glance : Copying over glance-api.conf ----------------------------------- 6.69s 2026-04-28 07:15:15.369029 | orchestrator | service-check-containers : glance | Check containers -------------------- 5.31s 2026-04-28 07:15:15.369039 | orchestrator | glance : Copying over config.json files for services -------------------- 5.12s 2026-04-28 07:15:15.369050 | orchestrator | glance : Copying over config.json files for services -------------------- 5.04s 2026-04-28 07:15:15.369060 | orchestrator | service-cert-copy : glance | Copying over extra CA certificates --------- 4.97s 2026-04-28 07:15:15.369071 | orchestrator | glance : Ensuring config directories exist ------------------------------ 4.93s 2026-04-28 07:15:15.369081 | orchestrator | glance : Ensuring config directories exist ------------------------------ 4.90s 2026-04-28 07:15:15.369092 | orchestrator | service-cert-copy : glance | Copying over extra CA certificates --------- 4.77s 2026-04-28 07:15:15.369102 | orchestrator | glance : Ensuring glance service ceph config subdir exists -------------- 4.70s 2026-04-28 07:15:15.369113 | orchestrator | glance : Generating 'hostnqn' file for glance_api ----------------------- 4.62s 2026-04-28 07:15:15.369123 | orchestrator | service-check-containers : Include tasks -------------------------------- 4.61s 2026-04-28 07:15:15.369140 | orchestrator | glance : Generating 'hostid' file for glance_api ------------------------ 4.60s 2026-04-28 07:15:15.369151 | orchestrator | glance : Copying over glance-haproxy-tls.cfg ---------------------------- 4.55s 2026-04-28 07:15:15.369162 | orchestrator | glance : Creating TLS backend PEM File ---------------------------------- 4.53s 2026-04-28 07:15:15.560415 | orchestrator | + osism apply -a upgrade cinder 2026-04-28 07:15:16.835859 | orchestrator | 2026-04-28 07:15:16 | INFO  | Prepare task for execution of cinder. 2026-04-28 07:15:16.899654 | orchestrator | 2026-04-28 07:15:16 | INFO  | Task 22674ff1-12f1-472a-8239-3c04f80f57c9 (cinder) was prepared for execution. 2026-04-28 07:15:16.899746 | orchestrator | 2026-04-28 07:15:16 | INFO  | It takes a moment until task 22674ff1-12f1-472a-8239-3c04f80f57c9 (cinder) has been started and output is visible here. 2026-04-28 07:15:40.068100 | orchestrator | 2026-04-28 07:15:40.068194 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 07:15:40.068208 | orchestrator | 2026-04-28 07:15:40.068218 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 07:15:40.068227 | orchestrator | Tuesday 28 April 2026 07:15:21 +0000 (0:00:01.728) 0:00:01.728 ********* 2026-04-28 07:15:40.068236 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:15:40.068245 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:15:40.068254 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:15:40.068262 | orchestrator | 2026-04-28 07:15:40.068271 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 07:15:40.068280 | orchestrator | Tuesday 28 April 2026 07:15:23 +0000 (0:00:01.737) 0:00:03.465 ********* 2026-04-28 07:15:40.068289 | orchestrator | ok: [testbed-node-0] => (item=enable_cinder_True) 2026-04-28 07:15:40.068298 | orchestrator | ok: [testbed-node-1] => (item=enable_cinder_True) 2026-04-28 07:15:40.068349 | orchestrator | ok: [testbed-node-2] => (item=enable_cinder_True) 2026-04-28 07:15:40.068359 | orchestrator | 2026-04-28 07:15:40.068367 | orchestrator | PLAY [Apply role cinder] ******************************************************* 2026-04-28 07:15:40.068376 | orchestrator | 2026-04-28 07:15:40.068385 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-28 07:15:40.068394 | orchestrator | Tuesday 28 April 2026 07:15:25 +0000 (0:00:01.655) 0:00:05.121 ********* 2026-04-28 07:15:40.068403 | orchestrator | included: /ansible/roles/cinder/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:15:40.068413 | orchestrator | 2026-04-28 07:15:40.068421 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-28 07:15:40.068430 | orchestrator | Tuesday 28 April 2026 07:15:28 +0000 (0:00:03.216) 0:00:08.337 ********* 2026-04-28 07:15:40.068439 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:15:40.068448 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:15:40.068457 | orchestrator | included: /ansible/roles/cinder/tasks/config.yml for testbed-node-0 2026-04-28 07:15:40.068466 | orchestrator | 2026-04-28 07:15:40.068474 | orchestrator | TASK [cinder : Ensuring config directories exist] ****************************** 2026-04-28 07:15:40.068498 | orchestrator | Tuesday 28 April 2026 07:15:30 +0000 (0:00:02.487) 0:00:10.825 ********* 2026-04-28 07:15:40.068512 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:15:40.068546 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:15:40.068557 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:15:40.068584 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:15:40.068594 | orchestrator | 2026-04-28 07:15:40.068603 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-28 07:15:40.068612 | orchestrator | Tuesday 28 April 2026 07:15:34 +0000 (0:00:03.409) 0:00:14.234 ********* 2026-04-28 07:15:40.068620 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:15:40.068629 | orchestrator | 2026-04-28 07:15:40.068638 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-28 07:15:40.068647 | orchestrator | Tuesday 28 April 2026 07:15:35 +0000 (0:00:01.127) 0:00:15.362 ********* 2026-04-28 07:15:40.068657 | orchestrator | included: /ansible/roles/cinder/tasks/external_ceph.yml for testbed-node-0 2026-04-28 07:15:40.068667 | orchestrator | 2026-04-28 07:15:40.068678 | orchestrator | TASK [cinder : Ensuring cinder service ceph config subdirs exists] ************* 2026-04-28 07:15:40.068688 | orchestrator | Tuesday 28 April 2026 07:15:37 +0000 (0:00:01.513) 0:00:16.876 ********* 2026-04-28 07:15:40.068698 | orchestrator | ok: [testbed-node-0] => (item=cinder-volume) 2026-04-28 07:15:40.068708 | orchestrator | ok: [testbed-node-0] => (item=cinder-backup) 2026-04-28 07:15:40.068718 | orchestrator | 2026-04-28 07:15:40.068729 | orchestrator | TASK [cinder : Copying over multiple ceph.conf for cinder services] ************ 2026-04-28 07:15:40.068739 | orchestrator | Tuesday 28 April 2026 07:15:39 +0000 (0:00:02.607) 0:00:19.483 ********* 2026-04-28 07:15:40.068756 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-28 07:15:40.068775 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-28 07:15:40.068795 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-28 07:15:59.783439 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-28 07:15:59.783567 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-28 07:15:59.783608 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-28 07:15:59.783620 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-28 07:15:59.783650 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-28 07:15:59.783662 | orchestrator | 2026-04-28 07:15:59.783675 | orchestrator | TASK [cinder : Copy over Ceph keyring files for cinder-volume] ***************** 2026-04-28 07:15:59.783686 | orchestrator | Tuesday 28 April 2026 07:15:45 +0000 (0:00:06.062) 0:00:25.546 ********* 2026-04-28 07:15:59.783696 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-28 07:15:59.783708 | orchestrator | 2026-04-28 07:15:59.783718 | orchestrator | TASK [cinder : Copy over Ceph keyring files for cinder-backup] ***************** 2026-04-28 07:15:59.783728 | orchestrator | Tuesday 28 April 2026 07:15:47 +0000 (0:00:02.283) 0:00:27.830 ********* 2026-04-28 07:15:59.783738 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-28 07:15:59.783749 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}) 2026-04-28 07:15:59.783768 | orchestrator | 2026-04-28 07:15:59.783778 | orchestrator | TASK [cinder : Ensuring config directory has correct owner and permission] ***** 2026-04-28 07:15:59.783787 | orchestrator | Tuesday 28 April 2026 07:15:51 +0000 (0:00:03.401) 0:00:31.231 ********* 2026-04-28 07:15:59.783802 | orchestrator | ok: [testbed-node-0] => (item=cinder-volume) 2026-04-28 07:15:59.783813 | orchestrator | ok: [testbed-node-0] => (item=cinder-backup) 2026-04-28 07:15:59.783823 | orchestrator | 2026-04-28 07:15:59.783832 | orchestrator | TASK [cinder : Check if policies shall be overwritten] ************************* 2026-04-28 07:15:59.783842 | orchestrator | Tuesday 28 April 2026 07:15:53 +0000 (0:00:01.897) 0:00:33.129 ********* 2026-04-28 07:15:59.783852 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:15:59.783861 | orchestrator | 2026-04-28 07:15:59.783871 | orchestrator | TASK [cinder : Set cinder policy file] ***************************************** 2026-04-28 07:15:59.783881 | orchestrator | Tuesday 28 April 2026 07:15:54 +0000 (0:00:01.126) 0:00:34.255 ********* 2026-04-28 07:15:59.783890 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:15:59.783900 | orchestrator | 2026-04-28 07:15:59.783909 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-28 07:15:59.783921 | orchestrator | Tuesday 28 April 2026 07:15:55 +0000 (0:00:01.105) 0:00:35.361 ********* 2026-04-28 07:15:59.783932 | orchestrator | included: /ansible/roles/cinder/tasks/copy-certs.yml for testbed-node-0 2026-04-28 07:15:59.783943 | orchestrator | 2026-04-28 07:15:59.783954 | orchestrator | TASK [service-cert-copy : cinder | Copying over extra CA certificates] ********* 2026-04-28 07:15:59.783964 | orchestrator | Tuesday 28 April 2026 07:15:56 +0000 (0:00:01.440) 0:00:36.802 ********* 2026-04-28 07:15:59.783978 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:15:59.783993 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:15:59.784014 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:16:06.586184 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:16:06.586300 | orchestrator | 2026-04-28 07:16:06.586399 | orchestrator | TASK [service-cert-copy : cinder | Copying over backend internal TLS certificate] *** 2026-04-28 07:16:06.586417 | orchestrator | Tuesday 28 April 2026 07:16:01 +0000 (0:00:04.723) 0:00:41.526 ********* 2026-04-28 07:16:06.586434 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:16:06.586451 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:16:06.586473 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 07:16:06.586492 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 07:16:06.586540 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:16:06.586563 | orchestrator | 2026-04-28 07:16:06.586609 | orchestrator | TASK [service-cert-copy : cinder | Copying over backend internal TLS key] ****** 2026-04-28 07:16:06.586623 | orchestrator | Tuesday 28 April 2026 07:16:03 +0000 (0:00:01.732) 0:00:43.259 ********* 2026-04-28 07:16:06.586643 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:16:06.586657 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:16:06.586672 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 07:16:06.586686 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 07:16:06.586700 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:16:06.586719 | orchestrator | 2026-04-28 07:16:06.586738 | orchestrator | TASK [cinder : Copying over config.json files for services] ******************** 2026-04-28 07:16:06.586755 | orchestrator | Tuesday 28 April 2026 07:16:05 +0000 (0:00:01.704) 0:00:44.963 ********* 2026-04-28 07:16:06.586801 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:16:34.859873 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:16:34.859985 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:16:34.860003 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:16:34.860016 | orchestrator | 2026-04-28 07:16:34.860029 | orchestrator | TASK [cinder : Copying over cinder-wsgi.conf] ********************************** 2026-04-28 07:16:34.860041 | orchestrator | Tuesday 28 April 2026 07:16:10 +0000 (0:00:05.292) 0:00:50.256 ********* 2026-04-28 07:16:34.860052 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/cinder/templates/cinder-wsgi.conf.j2)  2026-04-28 07:16:34.860064 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:16:34.860076 | orchestrator | 2026-04-28 07:16:34.860087 | orchestrator | TASK [Configure uWSGI for Cinder] ********************************************** 2026-04-28 07:16:34.860098 | orchestrator | Tuesday 28 April 2026 07:16:11 +0000 (0:00:01.473) 0:00:51.729 ********* 2026-04-28 07:16:34.860110 | orchestrator | included: service-uwsgi-config for testbed-node-0 2026-04-28 07:16:34.860144 | orchestrator | 2026-04-28 07:16:34.860155 | orchestrator | TASK [service-uwsgi-config : Copying over cinder-api uWSGI config] ************* 2026-04-28 07:16:34.860166 | orchestrator | Tuesday 28 April 2026 07:16:13 +0000 (0:00:01.834) 0:00:53.564 ********* 2026-04-28 07:16:34.860177 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:16:34.860187 | orchestrator | 2026-04-28 07:16:34.860198 | orchestrator | TASK [cinder : Copying over cinder.conf] *************************************** 2026-04-28 07:16:34.860209 | orchestrator | Tuesday 28 April 2026 07:16:16 +0000 (0:00:02.570) 0:00:56.135 ********* 2026-04-28 07:16:34.860221 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:16:34.860259 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:16:34.860274 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:16:34.860285 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:16:34.860296 | orchestrator | 2026-04-28 07:16:34.860307 | orchestrator | TASK [cinder : Generating 'hostnqn' file for cinder_volume] ******************** 2026-04-28 07:16:34.860318 | orchestrator | Tuesday 28 April 2026 07:16:29 +0000 (0:00:12.814) 0:01:08.949 ********* 2026-04-28 07:16:34.860329 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:16:34.860350 | orchestrator | 2026-04-28 07:16:34.860390 | orchestrator | TASK [cinder : Generating 'hostid' file for cinder_volume] ********************* 2026-04-28 07:16:34.860404 | orchestrator | Tuesday 28 April 2026 07:16:31 +0000 (0:00:02.454) 0:01:11.404 ********* 2026-04-28 07:16:34.860417 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:16:34.860428 | orchestrator | 2026-04-28 07:16:34.860441 | orchestrator | TASK [cinder : Copying over existing policy file] ****************************** 2026-04-28 07:16:34.860454 | orchestrator | Tuesday 28 April 2026 07:16:34 +0000 (0:00:02.660) 0:01:14.064 ********* 2026-04-28 07:16:34.860469 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:16:34.860492 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:17:14.818637 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 07:17:14.818786 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 07:17:14.818815 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:17:14.818838 | orchestrator | 2026-04-28 07:17:14.818859 | orchestrator | TASK [cinder : Copying over nfs_shares files for cinder_volume] **************** 2026-04-28 07:17:14.818880 | orchestrator | Tuesday 28 April 2026 07:16:35 +0000 (0:00:01.757) 0:01:15.822 ********* 2026-04-28 07:17:14.818930 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:17:14.818950 | orchestrator | 2026-04-28 07:17:14.818970 | orchestrator | TASK [cinder : Running Cinder bootstrap container] ***************************** 2026-04-28 07:17:14.818991 | orchestrator | Tuesday 28 April 2026 07:16:37 +0000 (0:00:01.568) 0:01:17.391 ********* 2026-04-28 07:17:14.819015 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:17:14.819033 | orchestrator | 2026-04-28 07:17:14.819056 | orchestrator | TASK [cinder : Ensuring config directories exist] ****************************** 2026-04-28 07:17:14.819073 | orchestrator | Tuesday 28 April 2026 07:17:13 +0000 (0:00:35.523) 0:01:52.914 ********* 2026-04-28 07:17:14.819097 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:17:14.819122 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:17:14.819183 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:17:14.819210 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:17:14.819247 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:17:14.819268 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:17:14.819283 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:17:14.819312 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:17:22.593855 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:17:22.593969 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:17:22.594007 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:17:22.594082 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:17:22.594095 | orchestrator | 2026-04-28 07:17:22.594109 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-28 07:17:22.594121 | orchestrator | Tuesday 28 April 2026 07:17:16 +0000 (0:00:03.339) 0:01:56.253 ********* 2026-04-28 07:17:22.594132 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:17:22.594144 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:17:22.594155 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:17:22.594165 | orchestrator | 2026-04-28 07:17:22.594176 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-28 07:17:22.594187 | orchestrator | Tuesday 28 April 2026 07:17:17 +0000 (0:00:01.368) 0:01:57.622 ********* 2026-04-28 07:17:22.594198 | orchestrator | included: /ansible/roles/cinder/tasks/external_ceph.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:17:22.594209 | orchestrator | 2026-04-28 07:17:22.594219 | orchestrator | TASK [cinder : Ensuring cinder service ceph config subdirs exists] ************* 2026-04-28 07:17:22.594230 | orchestrator | Tuesday 28 April 2026 07:17:19 +0000 (0:00:01.539) 0:01:59.161 ********* 2026-04-28 07:17:22.594242 | orchestrator | ok: [testbed-node-0] => (item=cinder-volume) 2026-04-28 07:17:22.594253 | orchestrator | ok: [testbed-node-1] => (item=cinder-volume) 2026-04-28 07:17:22.594263 | orchestrator | ok: [testbed-node-2] => (item=cinder-volume) 2026-04-28 07:17:22.594274 | orchestrator | ok: [testbed-node-0] => (item=cinder-backup) 2026-04-28 07:17:22.594284 | orchestrator | ok: [testbed-node-1] => (item=cinder-backup) 2026-04-28 07:17:22.594295 | orchestrator | ok: [testbed-node-2] => (item=cinder-backup) 2026-04-28 07:17:22.594305 | orchestrator | 2026-04-28 07:17:22.594331 | orchestrator | TASK [cinder : Copying over multiple ceph.conf for cinder services] ************ 2026-04-28 07:17:22.594361 | orchestrator | Tuesday 28 April 2026 07:17:22 +0000 (0:00:02.754) 0:02:01.916 ********* 2026-04-28 07:17:22.594378 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-28 07:17:22.594432 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-28 07:17:22.594449 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-28 07:17:22.594464 | orchestrator | skipping: [testbed-node-0] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-28 07:17:22.594494 | orchestrator | skipping: [testbed-node-1] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-28 07:17:23.949709 | orchestrator | skipping: [testbed-node-1] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-28 07:17:23.949795 | orchestrator | skipping: [testbed-node-1] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-28 07:17:23.949807 | orchestrator | skipping: [testbed-node-1] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-28 07:17:23.949831 | orchestrator | skipping: [testbed-node-2] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-28 07:17:23.949873 | orchestrator | skipping: [testbed-node-2] => (item=[{'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-28 07:17:23.949883 | orchestrator | skipping: [testbed-node-2] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}])  2026-04-28 07:17:23.949890 | orchestrator | skipping: [testbed-node-2] => (item=[{'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}])  2026-04-28 07:17:23.949902 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-28 07:17:23.949921 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-28 07:17:27.515780 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-28 07:17:27.515985 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-28 07:17:27.516002 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-28 07:17:27.516025 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-28 07:17:27.516069 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-28 07:17:27.516081 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-28 07:17:27.516089 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}]) 2026-04-28 07:17:27.516098 | orchestrator | ok: [testbed-node-0] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-28 07:17:27.516115 | orchestrator | ok: [testbed-node-1] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-28 07:17:27.516130 | orchestrator | ok: [testbed-node-2] => (item=[{'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}, {'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}]) 2026-04-28 07:17:44.409949 | orchestrator | 2026-04-28 07:17:44.410117 | orchestrator | TASK [cinder : Copy over Ceph keyring files for cinder-volume] ***************** 2026-04-28 07:17:44.410138 | orchestrator | Tuesday 28 April 2026 07:17:28 +0000 (0:00:06.652) 0:02:08.569 ********* 2026-04-28 07:17:44.410150 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-28 07:17:44.410163 | orchestrator | ok: [testbed-node-1] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-28 07:17:44.410174 | orchestrator | ok: [testbed-node-2] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-28 07:17:44.410185 | orchestrator | 2026-04-28 07:17:44.410196 | orchestrator | TASK [cinder : Copy over Ceph keyring files for cinder-backup] ***************** 2026-04-28 07:17:44.410208 | orchestrator | Tuesday 28 April 2026 07:17:31 +0000 (0:00:02.863) 0:02:11.433 ********* 2026-04-28 07:17:44.410219 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-28 07:17:44.410230 | orchestrator | ok: [testbed-node-1] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-28 07:17:44.410241 | orchestrator | ok: [testbed-node-2] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder', 'pool': 'volumes', 'enabled': True}) 2026-04-28 07:17:44.410253 | orchestrator | ok: [testbed-node-0] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}) 2026-04-28 07:17:44.410266 | orchestrator | ok: [testbed-node-1] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}) 2026-04-28 07:17:44.410277 | orchestrator | ok: [testbed-node-2] => (item={'name': 'rbd-1', 'backend_name': 'rbd-1', 'cluster': 'ceph', 'user': 'cinder-backup', 'pool': 'backups', 'enabled': True}) 2026-04-28 07:17:44.410288 | orchestrator | 2026-04-28 07:17:44.410350 | orchestrator | TASK [cinder : Ensuring config directory has correct owner and permission] ***** 2026-04-28 07:17:44.410363 | orchestrator | Tuesday 28 April 2026 07:17:35 +0000 (0:00:03.756) 0:02:15.190 ********* 2026-04-28 07:17:44.410374 | orchestrator | ok: [testbed-node-0] => (item=cinder-volume) 2026-04-28 07:17:44.410386 | orchestrator | ok: [testbed-node-1] => (item=cinder-volume) 2026-04-28 07:17:44.410396 | orchestrator | ok: [testbed-node-2] => (item=cinder-volume) 2026-04-28 07:17:44.410407 | orchestrator | ok: [testbed-node-0] => (item=cinder-backup) 2026-04-28 07:17:44.410418 | orchestrator | ok: [testbed-node-1] => (item=cinder-backup) 2026-04-28 07:17:44.410457 | orchestrator | ok: [testbed-node-2] => (item=cinder-backup) 2026-04-28 07:17:44.410468 | orchestrator | 2026-04-28 07:17:44.410478 | orchestrator | TASK [cinder : Check if policies shall be overwritten] ************************* 2026-04-28 07:17:44.410491 | orchestrator | Tuesday 28 April 2026 07:17:37 +0000 (0:00:02.179) 0:02:17.369 ********* 2026-04-28 07:17:44.410504 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:17:44.410517 | orchestrator | 2026-04-28 07:17:44.410530 | orchestrator | TASK [cinder : Set cinder policy file] ***************************************** 2026-04-28 07:17:44.410542 | orchestrator | Tuesday 28 April 2026 07:17:38 +0000 (0:00:01.175) 0:02:18.545 ********* 2026-04-28 07:17:44.410554 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:17:44.410566 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:17:44.410594 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:17:44.410606 | orchestrator | 2026-04-28 07:17:44.410619 | orchestrator | TASK [cinder : include_tasks] ************************************************** 2026-04-28 07:17:44.410631 | orchestrator | Tuesday 28 April 2026 07:17:40 +0000 (0:00:01.368) 0:02:19.913 ********* 2026-04-28 07:17:44.410643 | orchestrator | included: /ansible/roles/cinder/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:17:44.410656 | orchestrator | 2026-04-28 07:17:44.410668 | orchestrator | TASK [service-cert-copy : cinder | Copying over extra CA certificates] ********* 2026-04-28 07:17:44.410681 | orchestrator | Tuesday 28 April 2026 07:17:41 +0000 (0:00:01.559) 0:02:21.473 ********* 2026-04-28 07:17:44.410722 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:17:44.410750 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:17:44.410785 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:17:44.410814 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:17:44.410833 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:17:44.410850 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:17:44.410880 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:17:47.464011 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:17:47.464134 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:17:47.464162 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:17:47.464173 | orchestrator | ok: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:17:47.464182 | orchestrator | ok: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:17:47.464191 | orchestrator | 2026-04-28 07:17:47.464202 | orchestrator | TASK [service-cert-copy : cinder | Copying over backend internal TLS certificate] *** 2026-04-28 07:17:47.464213 | orchestrator | Tuesday 28 April 2026 07:17:46 +0000 (0:00:05.100) 0:02:26.573 ********* 2026-04-28 07:17:47.464240 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:17:47.464260 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:17:47.464276 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 07:17:47.464286 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 07:17:47.464296 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:17:47.464306 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:17:47.464329 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:17:49.173661 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 07:17:49.173797 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 07:17:49.173833 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:17:49.173880 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:17:49.174806 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:17:49.174938 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 07:17:49.174986 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 07:17:49.175008 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:17:49.175030 | orchestrator | 2026-04-28 07:17:49.175050 | orchestrator | TASK [service-cert-copy : cinder | Copying over backend internal TLS key] ****** 2026-04-28 07:17:49.175068 | orchestrator | Tuesday 28 April 2026 07:17:48 +0000 (0:00:01.923) 0:02:28.497 ********* 2026-04-28 07:17:49.175095 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:17:49.175109 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:17:49.175122 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 07:17:49.175156 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 07:17:49.175175 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:17:49.175208 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:17:52.073812 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:17:52.073936 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 07:17:52.073957 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 07:17:52.073995 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:17:52.074012 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:17:52.074091 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:17:52.074125 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 07:17:52.074151 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 07:17:52.074163 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:17:52.074175 | orchestrator | 2026-04-28 07:17:52.074187 | orchestrator | TASK [cinder : Copying over config.json files for services] ******************** 2026-04-28 07:17:52.074199 | orchestrator | Tuesday 28 April 2026 07:17:50 +0000 (0:00:01.709) 0:02:30.207 ********* 2026-04-28 07:17:52.074212 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:17:52.074236 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:17:52.074257 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:18:05.779249 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:05.779391 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:05.779434 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:05.779489 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:05.779503 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:05.779534 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:05.779554 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:05.779566 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:05.779590 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:05.779602 | orchestrator | 2026-04-28 07:18:05.779615 | orchestrator | TASK [cinder : Copying over cinder-wsgi.conf] ********************************** 2026-04-28 07:18:05.779627 | orchestrator | Tuesday 28 April 2026 07:17:55 +0000 (0:00:05.582) 0:02:35.789 ********* 2026-04-28 07:18:05.779639 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/cinder/templates/cinder-wsgi.conf.j2)  2026-04-28 07:18:05.779650 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:18:05.779662 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/cinder/templates/cinder-wsgi.conf.j2)  2026-04-28 07:18:05.779673 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:18:05.779684 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/cinder/templates/cinder-wsgi.conf.j2)  2026-04-28 07:18:05.779694 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:18:05.779705 | orchestrator | 2026-04-28 07:18:05.779716 | orchestrator | TASK [Configure uWSGI for Cinder] ********************************************** 2026-04-28 07:18:05.779727 | orchestrator | Tuesday 28 April 2026 07:17:57 +0000 (0:00:01.749) 0:02:37.539 ********* 2026-04-28 07:18:05.779738 | orchestrator | included: service-uwsgi-config for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:18:05.779750 | orchestrator | 2026-04-28 07:18:05.779761 | orchestrator | TASK [service-uwsgi-config : Copying over cinder-api uWSGI config] ************* 2026-04-28 07:18:05.779774 | orchestrator | Tuesday 28 April 2026 07:17:59 +0000 (0:00:01.676) 0:02:39.215 ********* 2026-04-28 07:18:05.779787 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:18:05.779800 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:18:05.779813 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:18:05.779826 | orchestrator | 2026-04-28 07:18:05.779839 | orchestrator | TASK [cinder : Copying over cinder.conf] *************************************** 2026-04-28 07:18:05.779851 | orchestrator | Tuesday 28 April 2026 07:18:02 +0000 (0:00:03.105) 0:02:42.321 ********* 2026-04-28 07:18:05.779880 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:18:14.497181 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:18:14.497291 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:18:14.497308 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:14.497321 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:14.497333 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:14.497399 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:14.497415 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:14.497428 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:14.497439 | orchestrator | ok: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:14.497538 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:14.497579 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:22.001858 | orchestrator | 2026-04-28 07:18:22.001966 | orchestrator | TASK [cinder : Generating 'hostnqn' file for cinder_volume] ******************** 2026-04-28 07:18:22.001984 | orchestrator | Tuesday 28 April 2026 07:18:15 +0000 (0:00:13.165) 0:02:55.486 ********* 2026-04-28 07:18:22.001996 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:18:22.002008 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:18:22.002090 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:18:22.002104 | orchestrator | 2026-04-28 07:18:22.002116 | orchestrator | TASK [cinder : Generating 'hostid' file for cinder_volume] ********************* 2026-04-28 07:18:22.002127 | orchestrator | Tuesday 28 April 2026 07:18:18 +0000 (0:00:02.890) 0:02:58.376 ********* 2026-04-28 07:18:22.002138 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:18:22.002150 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:18:22.002162 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:18:22.002173 | orchestrator | 2026-04-28 07:18:22.002184 | orchestrator | TASK [cinder : Copying over existing policy file] ****************************** 2026-04-28 07:18:22.002195 | orchestrator | Tuesday 28 April 2026 07:18:21 +0000 (0:00:02.850) 0:03:01.227 ********* 2026-04-28 07:18:22.002212 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:18:22.002229 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:18:22.002242 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 07:18:22.002278 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 07:18:22.002291 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:18:22.002340 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:18:22.002354 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:18:22.002366 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 07:18:22.002380 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 07:18:22.002402 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:18:22.002422 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:18:22.002445 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:18:28.174511 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 07:18:28.174620 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 07:18:28.174638 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:18:28.174652 | orchestrator | 2026-04-28 07:18:28.174664 | orchestrator | TASK [cinder : Copying over nfs_shares files for cinder_volume] **************** 2026-04-28 07:18:28.174676 | orchestrator | Tuesday 28 April 2026 07:18:23 +0000 (0:00:01.741) 0:03:02.969 ********* 2026-04-28 07:18:28.174687 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:18:28.174697 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:18:28.174708 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:18:28.174718 | orchestrator | 2026-04-28 07:18:28.174730 | orchestrator | TASK [service-check-containers : cinder | Check containers] ******************** 2026-04-28 07:18:28.174765 | orchestrator | Tuesday 28 April 2026 07:18:24 +0000 (0:00:01.695) 0:03:04.664 ********* 2026-04-28 07:18:28.174780 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:18:28.174810 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:18:28.174841 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:18:28.174856 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:28.174868 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:28.174887 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:28.174904 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:28.174925 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:32.202613 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:32.202724 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:32.202765 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:32.202775 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:18:32.202785 | orchestrator | 2026-04-28 07:18:32.202796 | orchestrator | TASK [service-check-containers : cinder | Notify handlers to restart containers] *** 2026-04-28 07:18:32.202807 | orchestrator | Tuesday 28 April 2026 07:18:30 +0000 (0:00:05.455) 0:03:10.120 ********* 2026-04-28 07:18:32.202830 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 07:18:32.202893 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:18:32.202906 | orchestrator | } 2026-04-28 07:18:32.202916 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 07:18:32.202926 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:18:32.202936 | orchestrator | } 2026-04-28 07:18:32.202946 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 07:18:32.202954 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:18:32.202964 | orchestrator | } 2026-04-28 07:18:32.202973 | orchestrator | 2026-04-28 07:18:32.202982 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 07:18:32.202991 | orchestrator | Tuesday 28 April 2026 07:18:31 +0000 (0:00:01.433) 0:03:11.554 ********* 2026-04-28 07:18:32.203021 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:18:32.203035 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:18:32.203053 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 07:18:32.203063 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 07:18:32.203072 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:18:32.203087 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:18:32.203107 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:20:58.968019 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 07:20:58.968154 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 07:20:58.968176 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:20:58.968195 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:20:58.968228 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:20:58.968242 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}})  2026-04-28 07:20:58.968275 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}})  2026-04-28 07:20:58.968298 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:20:58.968310 | orchestrator | 2026-04-28 07:20:58.968322 | orchestrator | TASK [cinder : Flush handlers] ************************************************* 2026-04-28 07:20:58.968335 | orchestrator | Tuesday 28 April 2026 07:18:33 +0000 (0:00:01.708) 0:03:13.262 ********* 2026-04-28 07:20:58.968347 | orchestrator | 2026-04-28 07:20:58.968359 | orchestrator | TASK [cinder : Flush handlers] ************************************************* 2026-04-28 07:20:58.968369 | orchestrator | Tuesday 28 April 2026 07:18:33 +0000 (0:00:00.496) 0:03:13.759 ********* 2026-04-28 07:20:58.968379 | orchestrator | 2026-04-28 07:20:58.968391 | orchestrator | TASK [cinder : Flush handlers] ************************************************* 2026-04-28 07:20:58.968403 | orchestrator | Tuesday 28 April 2026 07:18:34 +0000 (0:00:00.652) 0:03:14.412 ********* 2026-04-28 07:20:58.968415 | orchestrator | 2026-04-28 07:20:58.968426 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-api container] ************************ 2026-04-28 07:20:58.968438 | orchestrator | Tuesday 28 April 2026 07:18:35 +0000 (0:00:00.831) 0:03:15.243 ********* 2026-04-28 07:20:58.968450 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:20:58.968462 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:20:58.968473 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:20:58.968485 | orchestrator | 2026-04-28 07:20:58.968498 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-scheduler container] ****************** 2026-04-28 07:20:58.968509 | orchestrator | Tuesday 28 April 2026 07:19:09 +0000 (0:00:34.023) 0:03:49.266 ********* 2026-04-28 07:20:58.968520 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:20:58.968531 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:20:58.968543 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:20:58.968596 | orchestrator | 2026-04-28 07:20:58.968609 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-volume container] ********************* 2026-04-28 07:20:58.968620 | orchestrator | Tuesday 28 April 2026 07:19:22 +0000 (0:00:13.374) 0:04:02.641 ********* 2026-04-28 07:20:58.968631 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:20:58.968642 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:20:58.968652 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:20:58.968663 | orchestrator | 2026-04-28 07:20:58.968675 | orchestrator | RUNNING HANDLER [cinder : Restart cinder-backup container] ********************* 2026-04-28 07:20:58.968688 | orchestrator | Tuesday 28 April 2026 07:20:01 +0000 (0:00:39.185) 0:04:41.826 ********* 2026-04-28 07:20:58.968700 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:20:58.968712 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:20:58.968723 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:20:58.968733 | orchestrator | 2026-04-28 07:20:58.968744 | orchestrator | RUNNING HANDLER [cinder : Wait for cinder services to update service versions] *** 2026-04-28 07:20:58.968756 | orchestrator | Tuesday 28 April 2026 07:20:21 +0000 (0:00:19.197) 0:05:01.024 ********* 2026-04-28 07:20:58.968767 | orchestrator | Pausing for 30 seconds 2026-04-28 07:20:58.968780 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:20:58.968791 | orchestrator | 2026-04-28 07:20:58.968803 | orchestrator | TASK [cinder : Reload cinder services to remove RPC version pin] *************** 2026-04-28 07:20:58.968813 | orchestrator | Tuesday 28 April 2026 07:20:52 +0000 (0:00:31.517) 0:05:32.542 ********* 2026-04-28 07:20:58.968836 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:20:58.968875 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:21:41.809990 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-api', 'value': {'container_name': 'cinder_api', 'group': 'cinder-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8776'], 'timeout': '30'}, 'wsgi': 'cinder.wsgi.api:application', 'haproxy': {'cinder_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'cinder_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8776', 'listen_port': '8776', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:21:41.810182 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:21:41.810200 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:21:41.810228 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-scheduler', 'value': {'container_name': 'cinder_scheduler', 'group': 'cinder-scheduler', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328', 'volumes': ['/etc/kolla/cinder-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:21:41.810264 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:21:41.810297 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:21:41.810310 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-volume', 'value': {'container_name': 'cinder_volume', 'group': 'cinder-volume', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328', 'privileged': True, 'ipc_mode': 'host', 'tmpfs': [''], 'volumes': ['/etc/kolla/cinder-volume/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-volume 5672'], 'timeout': '30'}}}) 2026-04-28 07:21:41.810321 | orchestrator | changed: [testbed-node-0] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:21:41.810339 | orchestrator | changed: [testbed-node-2] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:21:41.810358 | orchestrator | changed: [testbed-node-1] => (item={'key': 'cinder-backup', 'value': {'container_name': 'cinder_backup', 'group': 'cinder-backup', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328', 'privileged': True, 'volumes': ['/etc/kolla/cinder-backup/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/lib/modules:/lib/modules:ro', '/run:/run:shared', 'cinder:/var/lib/cinder', '', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port cinder-backup 5672'], 'timeout': '30'}}}) 2026-04-28 07:21:41.810370 | orchestrator | 2026-04-28 07:21:41.810384 | orchestrator | TASK [cinder : Running Cinder online schema migration] ************************* 2026-04-28 07:21:41.810396 | orchestrator | Tuesday 28 April 2026 07:21:27 +0000 (0:00:34.437) 0:06:06.980 ********* 2026-04-28 07:21:41.810407 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:21:41.810419 | orchestrator | 2026-04-28 07:21:41.810430 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 07:21:41.810442 | orchestrator | testbed-node-0 : ok=44  changed=13  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-28 07:21:41.810454 | orchestrator | testbed-node-1 : ok=25  changed=11  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-28 07:21:41.810465 | orchestrator | testbed-node-2 : ok=25  changed=11  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-28 07:21:41.810476 | orchestrator | 2026-04-28 07:21:41.810487 | orchestrator | 2026-04-28 07:21:41.810498 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 07:21:41.810516 | orchestrator | Tuesday 28 April 2026 07:21:41 +0000 (0:00:14.668) 0:06:21.649 ********* 2026-04-28 07:21:42.286664 | orchestrator | =============================================================================== 2026-04-28 07:21:42.286771 | orchestrator | cinder : Restart cinder-volume container ------------------------------- 39.18s 2026-04-28 07:21:42.286795 | orchestrator | cinder : Running Cinder bootstrap container ---------------------------- 35.52s 2026-04-28 07:21:42.286825 | orchestrator | cinder : Reload cinder services to remove RPC version pin -------------- 34.44s 2026-04-28 07:21:42.286846 | orchestrator | cinder : Restart cinder-api container ---------------------------------- 34.02s 2026-04-28 07:21:42.286865 | orchestrator | cinder : Wait for cinder services to update service versions ----------- 31.52s 2026-04-28 07:21:42.286883 | orchestrator | cinder : Restart cinder-backup container ------------------------------- 19.20s 2026-04-28 07:21:42.286901 | orchestrator | cinder : Running Cinder online schema migration ------------------------ 14.67s 2026-04-28 07:21:42.286920 | orchestrator | cinder : Restart cinder-scheduler container ---------------------------- 13.38s 2026-04-28 07:21:42.286938 | orchestrator | cinder : Copying over cinder.conf -------------------------------------- 13.17s 2026-04-28 07:21:42.286957 | orchestrator | cinder : Copying over cinder.conf -------------------------------------- 12.82s 2026-04-28 07:21:42.286977 | orchestrator | cinder : Copying over multiple ceph.conf for cinder services ------------ 6.65s 2026-04-28 07:21:42.286997 | orchestrator | cinder : Copying over multiple ceph.conf for cinder services ------------ 6.06s 2026-04-28 07:21:42.287016 | orchestrator | cinder : Copying over config.json files for services -------------------- 5.58s 2026-04-28 07:21:42.287035 | orchestrator | service-check-containers : cinder | Check containers -------------------- 5.46s 2026-04-28 07:21:42.287055 | orchestrator | cinder : Copying over config.json files for services -------------------- 5.29s 2026-04-28 07:21:42.287110 | orchestrator | service-cert-copy : cinder | Copying over extra CA certificates --------- 5.10s 2026-04-28 07:21:42.287124 | orchestrator | service-cert-copy : cinder | Copying over extra CA certificates --------- 4.72s 2026-04-28 07:21:42.287135 | orchestrator | cinder : Copy over Ceph keyring files for cinder-backup ----------------- 3.76s 2026-04-28 07:21:42.287146 | orchestrator | cinder : Ensuring config directories exist ------------------------------ 3.41s 2026-04-28 07:21:42.287160 | orchestrator | cinder : Copy over Ceph keyring files for cinder-backup ----------------- 3.40s 2026-04-28 07:21:42.529988 | orchestrator | + osism apply -a upgrade barbican 2026-04-28 07:21:43.807460 | orchestrator | 2026-04-28 07:21:43 | INFO  | Prepare task for execution of barbican. 2026-04-28 07:21:43.874756 | orchestrator | 2026-04-28 07:21:43 | INFO  | Task 9f644a10-258d-4ac4-adf8-3f1245cb336e (barbican) was prepared for execution. 2026-04-28 07:21:43.874857 | orchestrator | 2026-04-28 07:21:43 | INFO  | It takes a moment until task 9f644a10-258d-4ac4-adf8-3f1245cb336e (barbican) has been started and output is visible here. 2026-04-28 07:21:53.394240 | orchestrator | 2026-04-28 07:21:53.394352 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 07:21:53.394369 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-28 07:21:53.394397 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-28 07:21:53.394418 | orchestrator | 2026-04-28 07:21:53.394428 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 07:21:53.394438 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-28 07:21:53.394448 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-28 07:21:53.394467 | orchestrator | Tuesday 28 April 2026 07:21:48 +0000 (0:00:01.169) 0:00:01.169 ********* 2026-04-28 07:21:53.394476 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:21:53.394487 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:21:53.394497 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:21:53.394507 | orchestrator | 2026-04-28 07:21:53.394517 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 07:21:53.394526 | orchestrator | Tuesday 28 April 2026 07:21:49 +0000 (0:00:00.764) 0:00:01.934 ********* 2026-04-28 07:21:53.394536 | orchestrator | ok: [testbed-node-0] => (item=enable_barbican_True) 2026-04-28 07:21:53.394546 | orchestrator | ok: [testbed-node-1] => (item=enable_barbican_True) 2026-04-28 07:21:53.394556 | orchestrator | ok: [testbed-node-2] => (item=enable_barbican_True) 2026-04-28 07:21:53.394565 | orchestrator | 2026-04-28 07:21:53.394633 | orchestrator | PLAY [Apply role barbican] ***************************************************** 2026-04-28 07:21:53.394652 | orchestrator | 2026-04-28 07:21:53.394669 | orchestrator | TASK [barbican : include_tasks] ************************************************ 2026-04-28 07:21:53.394686 | orchestrator | Tuesday 28 April 2026 07:21:49 +0000 (0:00:00.787) 0:00:02.721 ********* 2026-04-28 07:21:53.394702 | orchestrator | included: /ansible/roles/barbican/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:21:53.394719 | orchestrator | 2026-04-28 07:21:53.394735 | orchestrator | TASK [barbican : Ensuring config directories exist] **************************** 2026-04-28 07:21:53.394749 | orchestrator | Tuesday 28 April 2026 07:21:51 +0000 (0:00:01.448) 0:00:04.169 ********* 2026-04-28 07:21:53.394771 | orchestrator | ok: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:21:53.394824 | orchestrator | ok: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:21:53.394880 | orchestrator | ok: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:21:53.394900 | orchestrator | ok: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:21:53.394914 | orchestrator | ok: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:21:53.394935 | orchestrator | ok: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:21:53.394948 | orchestrator | ok: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:21:53.394960 | orchestrator | ok: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:21:53.394984 | orchestrator | ok: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:21:59.349492 | orchestrator | 2026-04-28 07:21:59.349693 | orchestrator | TASK [barbican : Ensuring vassals config directories exist] ******************** 2026-04-28 07:21:59.349714 | orchestrator | Tuesday 28 April 2026 07:21:53 +0000 (0:00:02.191) 0:00:06.361 ********* 2026-04-28 07:21:59.349726 | orchestrator | ok: [testbed-node-0] => (item=barbican-api/vassals) 2026-04-28 07:21:59.349738 | orchestrator | ok: [testbed-node-1] => (item=barbican-api/vassals) 2026-04-28 07:21:59.349749 | orchestrator | ok: [testbed-node-2] => (item=barbican-api/vassals) 2026-04-28 07:21:59.349759 | orchestrator | 2026-04-28 07:21:59.349770 | orchestrator | TASK [barbican : Check if policies shall be overwritten] *********************** 2026-04-28 07:21:59.349781 | orchestrator | Tuesday 28 April 2026 07:21:54 +0000 (0:00:01.243) 0:00:07.604 ********* 2026-04-28 07:21:59.349792 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:21:59.349804 | orchestrator | 2026-04-28 07:21:59.349815 | orchestrator | TASK [barbican : Set barbican policy file] ************************************* 2026-04-28 07:21:59.349826 | orchestrator | Tuesday 28 April 2026 07:21:54 +0000 (0:00:00.132) 0:00:07.737 ********* 2026-04-28 07:21:59.349836 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:21:59.349847 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:21:59.349858 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:21:59.349895 | orchestrator | 2026-04-28 07:21:59.349906 | orchestrator | TASK [barbican : include_tasks] ************************************************ 2026-04-28 07:21:59.349917 | orchestrator | Tuesday 28 April 2026 07:21:55 +0000 (0:00:00.603) 0:00:08.341 ********* 2026-04-28 07:21:59.349928 | orchestrator | included: /ansible/roles/barbican/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:21:59.349939 | orchestrator | 2026-04-28 07:21:59.349950 | orchestrator | TASK [service-cert-copy : barbican | Copying over extra CA certificates] ******* 2026-04-28 07:21:59.349961 | orchestrator | Tuesday 28 April 2026 07:21:56 +0000 (0:00:00.970) 0:00:09.311 ********* 2026-04-28 07:21:59.349976 | orchestrator | ok: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:21:59.349993 | orchestrator | ok: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:21:59.350101 | orchestrator | ok: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:21:59.350120 | orchestrator | ok: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:21:59.350144 | orchestrator | ok: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:21:59.350157 | orchestrator | ok: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:21:59.350171 | orchestrator | ok: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:21:59.350183 | orchestrator | ok: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:21:59.350211 | orchestrator | ok: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:22:00.672354 | orchestrator | 2026-04-28 07:22:00.672463 | orchestrator | TASK [service-cert-copy : barbican | Copying over backend internal TLS certificate] *** 2026-04-28 07:22:00.672484 | orchestrator | Tuesday 28 April 2026 07:21:59 +0000 (0:00:03.037) 0:00:12.348 ********* 2026-04-28 07:22:00.672531 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:22:00.672551 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:22:00.672565 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:22:00.672606 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:22:00.672639 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:22:00.672675 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:22:00.672699 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:22:00.672712 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:22:00.672725 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:22:00.672737 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:22:00.672750 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:22:00.672763 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:22:00.672775 | orchestrator | 2026-04-28 07:22:00.672787 | orchestrator | TASK [service-cert-copy : barbican | Copying over backend internal TLS key] **** 2026-04-28 07:22:00.672800 | orchestrator | Tuesday 28 April 2026 07:22:00 +0000 (0:00:00.891) 0:00:13.240 ********* 2026-04-28 07:22:00.672829 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:22:02.532159 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:22:02.532262 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:22:02.532279 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:22:02.532295 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:22:02.532309 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:22:02.532338 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:22:02.532371 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:22:02.532403 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:22:02.532416 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:22:02.532428 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:22:02.532439 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:22:02.532450 | orchestrator | 2026-04-28 07:22:02.532462 | orchestrator | TASK [barbican : Copying over config.json files for services] ****************** 2026-04-28 07:22:02.532474 | orchestrator | Tuesday 28 April 2026 07:22:01 +0000 (0:00:00.880) 0:00:14.121 ********* 2026-04-28 07:22:02.532492 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:22:02.532520 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:22:11.179762 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:22:11.179884 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:22:11.179904 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:22:11.179934 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:22:11.179971 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:22:11.180016 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:22:11.180038 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:22:11.180058 | orchestrator | 2026-04-28 07:22:11.180080 | orchestrator | TASK [barbican : Copying over barbican-api.ini] ******************************** 2026-04-28 07:22:11.180100 | orchestrator | Tuesday 28 April 2026 07:22:05 +0000 (0:00:03.853) 0:00:17.975 ********* 2026-04-28 07:22:11.180119 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:22:11.180138 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:22:11.180158 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:22:11.180177 | orchestrator | 2026-04-28 07:22:11.180197 | orchestrator | TASK [barbican : Checking whether barbican-api-paste.ini file exists] ********** 2026-04-28 07:22:11.180216 | orchestrator | Tuesday 28 April 2026 07:22:06 +0000 (0:00:01.563) 0:00:19.538 ********* 2026-04-28 07:22:11.180236 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 07:22:11.180257 | orchestrator | 2026-04-28 07:22:11.180277 | orchestrator | TASK [barbican : Copying over barbican-api-paste.ini] ************************** 2026-04-28 07:22:11.180298 | orchestrator | Tuesday 28 April 2026 07:22:07 +0000 (0:00:01.290) 0:00:20.828 ********* 2026-04-28 07:22:11.180318 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:22:11.180338 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:22:11.180356 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:22:11.180368 | orchestrator | 2026-04-28 07:22:11.180382 | orchestrator | TASK [barbican : Copying over barbican.conf] *********************************** 2026-04-28 07:22:11.180394 | orchestrator | Tuesday 28 April 2026 07:22:08 +0000 (0:00:00.621) 0:00:21.450 ********* 2026-04-28 07:22:11.180409 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:22:11.180444 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:22:11.180473 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:22:16.138972 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:22:16.139078 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:22:16.139139 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:22:16.139154 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:22:16.139165 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:22:16.139176 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:22:16.139187 | orchestrator | 2026-04-28 07:22:16.139201 | orchestrator | TASK [barbican : Copying over existing policy file] **************************** 2026-04-28 07:22:16.139232 | orchestrator | Tuesday 28 April 2026 07:22:15 +0000 (0:00:06.867) 0:00:28.317 ********* 2026-04-28 07:22:16.139246 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:22:16.139268 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:22:16.139286 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:22:16.139297 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:22:16.139309 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:22:16.139328 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:22:18.824615 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:22:18.824781 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:22:18.824819 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:22:18.824856 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:22:18.824877 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:22:18.824894 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:22:18.824914 | orchestrator | 2026-04-28 07:22:18.824931 | orchestrator | TASK [service-check-containers : barbican | Check containers] ****************** 2026-04-28 07:22:18.824943 | orchestrator | Tuesday 28 April 2026 07:22:16 +0000 (0:00:01.298) 0:00:29.616 ********* 2026-04-28 07:22:18.824975 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:22:18.824999 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:22:18.825018 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:22:18.825031 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:22:18.825044 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:22:18.825064 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:22:20.886708 | orchestrator | changed: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:22:20.886821 | orchestrator | changed: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:22:20.886853 | orchestrator | changed: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:22:20.886865 | orchestrator | 2026-04-28 07:22:20.886877 | orchestrator | TASK [service-check-containers : barbican | Notify handlers to restart containers] *** 2026-04-28 07:22:20.886889 | orchestrator | Tuesday 28 April 2026 07:22:19 +0000 (0:00:03.013) 0:00:32.629 ********* 2026-04-28 07:22:20.886900 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 07:22:20.886911 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:22:20.886921 | orchestrator | } 2026-04-28 07:22:20.886931 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 07:22:20.886941 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:22:20.886951 | orchestrator | } 2026-04-28 07:22:20.886960 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 07:22:20.886970 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:22:20.886980 | orchestrator | } 2026-04-28 07:22:20.886990 | orchestrator | 2026-04-28 07:22:20.887000 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 07:22:20.887010 | orchestrator | Tuesday 28 April 2026 07:22:20 +0000 (0:00:00.360) 0:00:32.989 ********* 2026-04-28 07:22:20.887023 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:22:20.887072 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:22:20.887086 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:22:20.887096 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:22:20.887112 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:22:20.887123 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:22:20.887134 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:22:20.887152 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:22:20.887170 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-api', 'value': {'container_name': 'barbican_api', 'group': 'barbican-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'barbican:/var/lib/barbican/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9311'], 'timeout': '30'}, 'haproxy': {'barbican_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}, 'barbican_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9311', 'listen_port': '9311', 'tls_backend': 'no', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:25:21.793478 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-keystone-listener', 'value': {'container_name': 'barbican_keystone_listener', 'group': 'barbican-keystone-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-keystone-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-keystone-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:25:21.793599 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'barbican-worker', 'value': {'container_name': 'barbican_worker', 'group': 'barbican-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/barbican-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port barbican-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:25:21.793618 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:25:21.793632 | orchestrator | 2026-04-28 07:25:21.793644 | orchestrator | TASK [barbican : Running barbican bootstrap container] ************************* 2026-04-28 07:25:21.793741 | orchestrator | Tuesday 28 April 2026 07:22:21 +0000 (0:00:01.732) 0:00:34.722 ********* 2026-04-28 07:25:21.793758 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:25:21.793770 | orchestrator | 2026-04-28 07:25:21.793781 | orchestrator | TASK [barbican : Flush handlers] *********************************************** 2026-04-28 07:25:21.793793 | orchestrator | Tuesday 28 April 2026 07:22:33 +0000 (0:00:12.064) 0:00:46.786 ********* 2026-04-28 07:25:21.793803 | orchestrator | 2026-04-28 07:25:21.793815 | orchestrator | TASK [barbican : Flush handlers] *********************************************** 2026-04-28 07:25:21.793826 | orchestrator | Tuesday 28 April 2026 07:22:33 +0000 (0:00:00.086) 0:00:46.873 ********* 2026-04-28 07:25:21.793837 | orchestrator | 2026-04-28 07:25:21.793847 | orchestrator | TASK [barbican : Flush handlers] *********************************************** 2026-04-28 07:25:21.793858 | orchestrator | Tuesday 28 April 2026 07:22:34 +0000 (0:00:00.088) 0:00:46.961 ********* 2026-04-28 07:25:21.793868 | orchestrator | 2026-04-28 07:25:21.793879 | orchestrator | RUNNING HANDLER [barbican : Restart barbican-api container] ******************** 2026-04-28 07:25:21.793890 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-28 07:25:21.793902 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-28 07:25:21.793946 | orchestrator | Tuesday 28 April 2026 07:22:34 +0000 (0:00:00.079) 0:00:47.041 ********* 2026-04-28 07:25:21.793957 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:25:21.793968 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:25:21.793978 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:25:21.793989 | orchestrator | 2026-04-28 07:25:21.794000 | orchestrator | RUNNING HANDLER [barbican : Restart barbican-keystone-listener container] ****** 2026-04-28 07:25:21.794013 | orchestrator | Tuesday 28 April 2026 07:24:47 +0000 (0:02:13.232) 0:03:00.273 ********* 2026-04-28 07:25:21.794085 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:25:21.794099 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:25:21.794111 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:25:21.794125 | orchestrator | 2026-04-28 07:25:21.794138 | orchestrator | RUNNING HANDLER [barbican : Restart barbican-worker container] ***************** 2026-04-28 07:25:21.794150 | orchestrator | Tuesday 28 April 2026 07:25:03 +0000 (0:00:16.557) 0:03:16.830 ********* 2026-04-28 07:25:21.794162 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:25:21.794174 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:25:21.794186 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:25:21.794199 | orchestrator | 2026-04-28 07:25:21.794211 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 07:25:21.794225 | orchestrator | testbed-node-0 : ok=17  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-28 07:25:21.794238 | orchestrator | testbed-node-1 : ok=15  changed=7  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 07:25:21.794251 | orchestrator | testbed-node-2 : ok=15  changed=7  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 07:25:21.794263 | orchestrator | 2026-04-28 07:25:21.794275 | orchestrator | 2026-04-28 07:25:21.794287 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 07:25:21.794300 | orchestrator | Tuesday 28 April 2026 07:25:21 +0000 (0:00:17.428) 0:03:34.258 ********* 2026-04-28 07:25:21.794312 | orchestrator | =============================================================================== 2026-04-28 07:25:21.794324 | orchestrator | barbican : Restart barbican-api container ----------------------------- 133.23s 2026-04-28 07:25:21.794336 | orchestrator | barbican : Restart barbican-worker container --------------------------- 17.43s 2026-04-28 07:25:21.794368 | orchestrator | barbican : Restart barbican-keystone-listener container ---------------- 16.56s 2026-04-28 07:25:21.794426 | orchestrator | barbican : Running barbican bootstrap container ------------------------ 12.06s 2026-04-28 07:25:21.794437 | orchestrator | barbican : Copying over barbican.conf ----------------------------------- 6.87s 2026-04-28 07:25:21.794448 | orchestrator | barbican : Copying over config.json files for services ------------------ 3.85s 2026-04-28 07:25:21.794458 | orchestrator | service-cert-copy : barbican | Copying over extra CA certificates ------- 3.04s 2026-04-28 07:25:21.794469 | orchestrator | service-check-containers : barbican | Check containers ------------------ 3.01s 2026-04-28 07:25:21.794479 | orchestrator | barbican : Ensuring config directories exist ---------------------------- 2.19s 2026-04-28 07:25:21.794490 | orchestrator | service-check-containers : Include tasks -------------------------------- 1.73s 2026-04-28 07:25:21.794500 | orchestrator | barbican : Copying over barbican-api.ini -------------------------------- 1.56s 2026-04-28 07:25:21.794511 | orchestrator | barbican : include_tasks ------------------------------------------------ 1.45s 2026-04-28 07:25:21.794521 | orchestrator | barbican : Copying over existing policy file ---------------------------- 1.30s 2026-04-28 07:25:21.794532 | orchestrator | barbican : Checking whether barbican-api-paste.ini file exists ---------- 1.29s 2026-04-28 07:25:21.794543 | orchestrator | barbican : Ensuring vassals config directories exist -------------------- 1.24s 2026-04-28 07:25:21.794564 | orchestrator | barbican : include_tasks ------------------------------------------------ 0.97s 2026-04-28 07:25:21.794575 | orchestrator | service-cert-copy : barbican | Copying over backend internal TLS certificate --- 0.89s 2026-04-28 07:25:21.794586 | orchestrator | service-cert-copy : barbican | Copying over backend internal TLS key ---- 0.88s 2026-04-28 07:25:21.794597 | orchestrator | Group hosts based on enabled services ----------------------------------- 0.79s 2026-04-28 07:25:21.794607 | orchestrator | Group hosts based on Kolla action --------------------------------------- 0.76s 2026-04-28 07:25:22.058842 | orchestrator | + osism apply -a upgrade designate 2026-04-28 07:25:23.431579 | orchestrator | 2026-04-28 07:25:23 | INFO  | Prepare task for execution of designate. 2026-04-28 07:25:23.500049 | orchestrator | 2026-04-28 07:25:23 | INFO  | Task db49f681-fcf0-48bb-a1bd-d00f3cc50319 (designate) was prepared for execution. 2026-04-28 07:25:23.500130 | orchestrator | 2026-04-28 07:25:23 | INFO  | It takes a moment until task db49f681-fcf0-48bb-a1bd-d00f3cc50319 (designate) has been started and output is visible here. 2026-04-28 07:25:37.472457 | orchestrator | 2026-04-28 07:25:37.472628 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 07:25:37.472647 | orchestrator | 2026-04-28 07:25:37.472711 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 07:25:37.472724 | orchestrator | Tuesday 28 April 2026 07:25:28 +0000 (0:00:01.681) 0:00:01.681 ********* 2026-04-28 07:25:37.472735 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:25:37.472747 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:25:37.472758 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:25:37.472769 | orchestrator | 2026-04-28 07:25:37.472780 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 07:25:37.472791 | orchestrator | Tuesday 28 April 2026 07:25:30 +0000 (0:00:01.725) 0:00:03.406 ********* 2026-04-28 07:25:37.472803 | orchestrator | ok: [testbed-node-0] => (item=enable_designate_True) 2026-04-28 07:25:37.472814 | orchestrator | ok: [testbed-node-1] => (item=enable_designate_True) 2026-04-28 07:25:37.472825 | orchestrator | ok: [testbed-node-2] => (item=enable_designate_True) 2026-04-28 07:25:37.472836 | orchestrator | 2026-04-28 07:25:37.472847 | orchestrator | PLAY [Apply role designate] **************************************************** 2026-04-28 07:25:37.472858 | orchestrator | 2026-04-28 07:25:37.472869 | orchestrator | TASK [designate : include_tasks] *********************************************** 2026-04-28 07:25:37.472880 | orchestrator | Tuesday 28 April 2026 07:25:32 +0000 (0:00:01.959) 0:00:05.365 ********* 2026-04-28 07:25:37.472891 | orchestrator | included: /ansible/roles/designate/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:25:37.472902 | orchestrator | 2026-04-28 07:25:37.472913 | orchestrator | TASK [designate : Ensuring config directories exist] *************************** 2026-04-28 07:25:37.472924 | orchestrator | Tuesday 28 April 2026 07:25:34 +0000 (0:00:02.688) 0:00:08.054 ********* 2026-04-28 07:25:37.472939 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:25:37.472958 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:25:37.473028 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:25:37.473045 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 07:25:37.473059 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 07:25:37.473072 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 07:25:37.473093 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:37.473105 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:37.473123 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:37.473143 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:45.506113 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:45.506228 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:45.506245 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:45.506282 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:45.506298 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:45.506335 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:45.506378 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:45.506392 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:45.506404 | orchestrator | 2026-04-28 07:25:45.506417 | orchestrator | TASK [designate : Check if policies shall be overwritten] ********************** 2026-04-28 07:25:45.506429 | orchestrator | Tuesday 28 April 2026 07:25:39 +0000 (0:00:04.545) 0:00:12.600 ********* 2026-04-28 07:25:45.506440 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:25:45.506463 | orchestrator | 2026-04-28 07:25:45.506474 | orchestrator | TASK [designate : Set designate policy file] *********************************** 2026-04-28 07:25:45.506485 | orchestrator | Tuesday 28 April 2026 07:25:40 +0000 (0:00:01.127) 0:00:13.728 ********* 2026-04-28 07:25:45.506496 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:25:45.506507 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:25:45.506518 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:25:45.506528 | orchestrator | 2026-04-28 07:25:45.506539 | orchestrator | TASK [designate : include_tasks] *********************************************** 2026-04-28 07:25:45.506550 | orchestrator | Tuesday 28 April 2026 07:25:42 +0000 (0:00:01.386) 0:00:15.114 ********* 2026-04-28 07:25:45.506561 | orchestrator | included: /ansible/roles/designate/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:25:45.506572 | orchestrator | 2026-04-28 07:25:45.506585 | orchestrator | TASK [service-cert-copy : designate | Copying over extra CA certificates] ****** 2026-04-28 07:25:45.506598 | orchestrator | Tuesday 28 April 2026 07:25:44 +0000 (0:00:02.016) 0:00:17.131 ********* 2026-04-28 07:25:45.506612 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:25:45.506636 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:25:45.506688 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:25:49.452855 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 07:25:49.452960 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 07:25:49.452976 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 07:25:49.453007 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:49.453019 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:49.453031 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:49.453082 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:49.453097 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:49.453108 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:49.453120 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:49.453137 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:49.453149 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:49.453167 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:51.722562 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:51.722718 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:25:51.722738 | orchestrator | 2026-04-28 07:25:51.722752 | orchestrator | TASK [service-cert-copy : designate | Copying over backend internal TLS certificate] *** 2026-04-28 07:25:51.722765 | orchestrator | Tuesday 28 April 2026 07:25:50 +0000 (0:00:06.628) 0:00:23.760 ********* 2026-04-28 07:25:51.722795 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:25:51.722813 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 07:25:51.722826 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:25:51.722875 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 07:25:51.722889 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 07:25:51.722906 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:25:51.722918 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 07:25:51.722930 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 07:25:51.722957 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 07:25:54.131852 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 07:25:54.131957 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 07:25:54.131972 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 07:25:54.132002 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:25:54.132014 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:25:54.132026 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 07:25:54.132059 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 07:25:54.132088 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:25:54.132099 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:25:54.132109 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 07:25:54.132120 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:25:54.132130 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:25:54.132140 | orchestrator | 2026-04-28 07:25:54.132151 | orchestrator | TASK [service-cert-copy : designate | Copying over backend internal TLS key] *** 2026-04-28 07:25:54.132162 | orchestrator | Tuesday 28 April 2026 07:25:53 +0000 (0:00:02.582) 0:00:26.343 ********* 2026-04-28 07:25:54.132178 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:25:54.132200 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 07:25:54.132220 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:25:54.576555 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 07:25:54.576756 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 07:25:54.576808 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 07:25:54.576855 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:25:54.576877 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 07:25:54.576919 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 07:25:54.576938 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 07:25:54.576954 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 07:25:54.576978 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:25:54.577007 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:25:54.577027 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 07:25:54.577043 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 07:25:54.577059 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 07:25:54.577089 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:26:00.049389 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:26:00.049505 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 07:26:00.049541 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:26:00.049578 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:26:00.049591 | orchestrator | 2026-04-28 07:26:00.049603 | orchestrator | TASK [designate : Copying over config.json files for services] ***************** 2026-04-28 07:26:00.049615 | orchestrator | Tuesday 28 April 2026 07:25:55 +0000 (0:00:02.576) 0:00:28.920 ********* 2026-04-28 07:26:00.049627 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:26:00.049643 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:26:00.049733 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:26:00.049749 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 07:26:00.049777 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 07:26:00.049789 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:00.049801 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:00.049812 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 07:26:00.049832 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:07.254527 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:07.254736 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:07.254762 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:07.254782 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:07.254812 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:07.254833 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:07.254877 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:07.254921 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:07.254939 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:07.254958 | orchestrator | 2026-04-28 07:26:07.254981 | orchestrator | TASK [designate : Copying over designate.conf] ********************************* 2026-04-28 07:26:07.255001 | orchestrator | Tuesday 28 April 2026 07:26:03 +0000 (0:00:08.022) 0:00:36.942 ********* 2026-04-28 07:26:07.255023 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:26:07.255042 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:26:07.255068 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:26:18.664245 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 07:26:18.664380 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 07:26:18.664407 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 07:26:18.664431 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:18.664455 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:18.664558 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:18.664605 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:18.664619 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:18.664630 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:18.664642 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:18.664653 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:18.664696 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:18.664718 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:30.690538 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:30.690722 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:30.690743 | orchestrator | 2026-04-28 07:26:30.690757 | orchestrator | TASK [designate : Copying over pools.yaml] ************************************* 2026-04-28 07:26:30.690770 | orchestrator | Tuesday 28 April 2026 07:26:20 +0000 (0:00:16.730) 0:00:53.673 ********* 2026-04-28 07:26:30.690780 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/designate/templates/pools.yaml.j2) 2026-04-28 07:26:30.690792 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/designate/templates/pools.yaml.j2) 2026-04-28 07:26:30.690803 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/designate/templates/pools.yaml.j2) 2026-04-28 07:26:30.690813 | orchestrator | 2026-04-28 07:26:30.690824 | orchestrator | TASK [designate : Copying over named.conf] ************************************* 2026-04-28 07:26:30.690835 | orchestrator | Tuesday 28 April 2026 07:26:25 +0000 (0:00:04.841) 0:00:58.514 ********* 2026-04-28 07:26:30.690846 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/designate/templates/named.conf.j2) 2026-04-28 07:26:30.690856 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/designate/templates/named.conf.j2) 2026-04-28 07:26:30.690867 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/designate/templates/named.conf.j2) 2026-04-28 07:26:30.690878 | orchestrator | 2026-04-28 07:26:30.690888 | orchestrator | TASK [designate : Copying over rndc.conf] ************************************** 2026-04-28 07:26:30.690899 | orchestrator | Tuesday 28 April 2026 07:26:28 +0000 (0:00:03.560) 0:01:02.074 ********* 2026-04-28 07:26:30.690932 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:26:30.690973 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:26:30.690987 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:26:30.691000 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 07:26:30.691013 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 07:26:30.691032 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 07:26:30.691044 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 07:26:30.691067 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 07:26:33.774611 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 07:26:33.774778 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 07:26:33.774795 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 07:26:33.774834 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 07:26:33.774847 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 07:26:33.774876 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 07:26:33.774907 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 07:26:33.774919 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:33.774931 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:33.774950 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:33.774962 | orchestrator | 2026-04-28 07:26:33.774975 | orchestrator | TASK [designate : Copying over rndc.key] *************************************** 2026-04-28 07:26:33.774987 | orchestrator | Tuesday 28 April 2026 07:26:32 +0000 (0:00:03.976) 0:01:06.051 ********* 2026-04-28 07:26:33.775000 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:26:33.775030 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:26:34.758779 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:26:34.758936 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 07:26:34.758967 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 07:26:34.758987 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 07:26:34.759022 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 07:26:34.759057 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 07:26:34.759078 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 07:26:34.759110 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 07:26:34.759130 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 07:26:34.759142 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 07:26:34.759153 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 07:26:34.759170 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 07:26:34.759191 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 07:26:38.590290 | orchestrator | ok: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:38.590410 | orchestrator | ok: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:38.590427 | orchestrator | ok: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:38.590440 | orchestrator | 2026-04-28 07:26:38.590453 | orchestrator | TASK [designate : include_tasks] *********************************************** 2026-04-28 07:26:38.590465 | orchestrator | Tuesday 28 April 2026 07:26:36 +0000 (0:00:03.725) 0:01:09.777 ********* 2026-04-28 07:26:38.590476 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:26:38.590489 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:26:38.590499 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:26:38.590510 | orchestrator | 2026-04-28 07:26:38.590521 | orchestrator | TASK [designate : Copying over existing policy file] *************************** 2026-04-28 07:26:38.590532 | orchestrator | Tuesday 28 April 2026 07:26:38 +0000 (0:00:01.342) 0:01:11.119 ********* 2026-04-28 07:26:38.590574 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:26:38.590602 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 07:26:38.590713 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 07:26:38.590730 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 07:26:38.590742 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 07:26:38.590754 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:26:38.590765 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:26:38.590783 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:26:38.590817 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 07:26:41.967984 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 07:26:41.968131 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 07:26:41.968156 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 07:26:41.968169 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:26:41.968182 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:26:41.968214 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:26:41.968276 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 07:26:41.968291 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 07:26:41.968302 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 07:26:41.968313 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 07:26:41.968324 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:26:41.968335 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:26:41.968346 | orchestrator | 2026-04-28 07:26:41.968358 | orchestrator | TASK [service-check-containers : designate | Check containers] ***************** 2026-04-28 07:26:41.968375 | orchestrator | Tuesday 28 April 2026 07:26:40 +0000 (0:00:02.210) 0:01:13.330 ********* 2026-04-28 07:26:41.968387 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:26:41.968416 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:26:45.537463 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:26:45.537579 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 07:26:45.537614 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 07:26:45.537649 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}}) 2026-04-28 07:26:45.537662 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:45.537749 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:45.537762 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:45.537774 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:45.537791 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:45.537811 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:45.537823 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:45.537834 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:45.537853 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:49.525009 | orchestrator | changed: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:49.525149 | orchestrator | changed: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:49.525207 | orchestrator | changed: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:26:49.525221 | orchestrator | 2026-04-28 07:26:49.525235 | orchestrator | TASK [service-check-containers : designate | Notify handlers to restart containers] *** 2026-04-28 07:26:49.525248 | orchestrator | Tuesday 28 April 2026 07:26:47 +0000 (0:00:07.358) 0:01:20.688 ********* 2026-04-28 07:26:49.525259 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 07:26:49.525271 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:26:49.525283 | orchestrator | } 2026-04-28 07:26:49.525294 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 07:26:49.525305 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:26:49.525315 | orchestrator | } 2026-04-28 07:26:49.525326 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 07:26:49.525336 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:26:49.525347 | orchestrator | } 2026-04-28 07:26:49.525357 | orchestrator | 2026-04-28 07:26:49.525369 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 07:26:49.525379 | orchestrator | Tuesday 28 April 2026 07:26:48 +0000 (0:00:01.358) 0:01:22.046 ********* 2026-04-28 07:26:49.525392 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:26:49.525425 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 07:26:49.525439 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 07:26:49.525459 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 07:26:49.525475 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 07:26:49.525488 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:26:49.525499 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:26:49.525511 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:26:49.525532 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 07:27:36.606378 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 07:27:36.606532 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 07:27:36.606549 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 07:27:36.606562 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:27:36.606574 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:27:36.606589 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-api', 'value': {'container_name': 'designate_api', 'group': 'designate-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9001'], 'timeout': '30'}, 'haproxy': {'designate_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}, 'designate_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9001', 'listen_port': '9001', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:27:36.606621 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-backend-bind9', 'value': {'container_name': 'designate_backend_bind9', 'group': 'designate-backend-bind9', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-backend-bind9/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'designate_backend_bind9:/var/lib/named/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_listen named 53'], 'timeout': '30'}}})  2026-04-28 07:27:36.606644 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-central', 'value': {'container_name': 'designate_central', 'group': 'designate-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-central 5672'], 'timeout': '30'}}})  2026-04-28 07:27:36.606706 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-mdns', 'value': {'container_name': 'designate_mdns', 'group': 'designate-mdns', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-mdns/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-mdns 5672'], 'timeout': '30'}}})  2026-04-28 07:27:36.606719 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-producer', 'value': {'container_name': 'designate_producer', 'group': 'designate-producer', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-producer/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-producer 5672'], 'timeout': '30'}}})  2026-04-28 07:27:36.606730 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'designate-worker', 'value': {'container_name': 'designate_worker', 'group': 'designate-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328', 'volumes': ['/etc/kolla/designate-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port designate-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:27:36.606742 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:27:36.606753 | orchestrator | 2026-04-28 07:27:36.606765 | orchestrator | TASK [designate : Running Designate bootstrap container] *********************** 2026-04-28 07:27:36.606777 | orchestrator | Tuesday 28 April 2026 07:26:51 +0000 (0:00:02.116) 0:01:24.163 ********* 2026-04-28 07:27:36.606788 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:27:36.606799 | orchestrator | 2026-04-28 07:27:36.606810 | orchestrator | TASK [designate : Flush handlers] ********************************************** 2026-04-28 07:27:36.606821 | orchestrator | Tuesday 28 April 2026 07:27:06 +0000 (0:00:15.090) 0:01:39.254 ********* 2026-04-28 07:27:36.606832 | orchestrator | 2026-04-28 07:27:36.606843 | orchestrator | TASK [designate : Flush handlers] ********************************************** 2026-04-28 07:27:36.606854 | orchestrator | Tuesday 28 April 2026 07:27:06 +0000 (0:00:00.648) 0:01:39.903 ********* 2026-04-28 07:27:36.606865 | orchestrator | 2026-04-28 07:27:36.606876 | orchestrator | TASK [designate : Flush handlers] ********************************************** 2026-04-28 07:27:36.606887 | orchestrator | Tuesday 28 April 2026 07:27:07 +0000 (0:00:00.458) 0:01:40.361 ********* 2026-04-28 07:27:36.606898 | orchestrator | 2026-04-28 07:27:36.606909 | orchestrator | RUNNING HANDLER [designate : Restart designate-backend-bind9 container] ******** 2026-04-28 07:27:36.606926 | orchestrator | Tuesday 28 April 2026 07:27:08 +0000 (0:00:00.817) 0:01:41.179 ********* 2026-04-28 07:27:36.606937 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:27:36.606948 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:27:36.606959 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:27:36.606970 | orchestrator | 2026-04-28 07:27:36.606981 | orchestrator | RUNNING HANDLER [designate : Restart designate-api container] ****************** 2026-04-28 07:27:36.606992 | orchestrator | Tuesday 28 April 2026 07:27:23 +0000 (0:00:14.983) 0:01:56.162 ********* 2026-04-28 07:27:36.607003 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:27:36.607014 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:27:36.607025 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:27:36.607036 | orchestrator | 2026-04-28 07:27:36.607047 | orchestrator | RUNNING HANDLER [designate : Restart designate-central container] ************** 2026-04-28 07:27:36.607066 | orchestrator | Tuesday 28 April 2026 07:27:36 +0000 (0:00:13.538) 0:02:09.701 ********* 2026-04-28 07:29:24.385721 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:29:24.385844 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:29:24.385860 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:29:24.385874 | orchestrator | 2026-04-28 07:29:24.385887 | orchestrator | RUNNING HANDLER [designate : Restart designate-producer container] ************* 2026-04-28 07:29:24.385899 | orchestrator | Tuesday 28 April 2026 07:27:50 +0000 (0:00:13.557) 0:02:23.259 ********* 2026-04-28 07:29:24.385910 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:29:24.385922 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:29:24.385933 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:29:24.385945 | orchestrator | 2026-04-28 07:29:24.385957 | orchestrator | RUNNING HANDLER [designate : Restart designate-mdns container] ***************** 2026-04-28 07:29:24.385969 | orchestrator | Tuesday 28 April 2026 07:28:48 +0000 (0:00:58.075) 0:03:21.334 ********* 2026-04-28 07:29:24.385981 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:29:24.385994 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:29:24.386006 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:29:24.386080 | orchestrator | 2026-04-28 07:29:24.386094 | orchestrator | RUNNING HANDLER [designate : Restart designate-worker container] *************** 2026-04-28 07:29:24.386106 | orchestrator | Tuesday 28 April 2026 07:29:01 +0000 (0:00:13.497) 0:03:34.831 ********* 2026-04-28 07:29:24.386118 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:29:24.386129 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:29:24.386141 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:29:24.386152 | orchestrator | 2026-04-28 07:29:24.386163 | orchestrator | TASK [designate : Non-destructive DNS pools update] **************************** 2026-04-28 07:29:24.386174 | orchestrator | Tuesday 28 April 2026 07:29:15 +0000 (0:00:14.125) 0:03:48.956 ********* 2026-04-28 07:29:24.386185 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:29:24.386196 | orchestrator | 2026-04-28 07:29:24.386227 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 07:29:24.386240 | orchestrator | testbed-node-0 : ok=22  changed=12  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026-04-28 07:29:24.386253 | orchestrator | testbed-node-1 : ok=20  changed=10  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 07:29:24.386266 | orchestrator | testbed-node-2 : ok=20  changed=10  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 07:29:24.386277 | orchestrator | 2026-04-28 07:29:24.386289 | orchestrator | 2026-04-28 07:29:24.386302 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 07:29:24.386314 | orchestrator | Tuesday 28 April 2026 07:29:23 +0000 (0:00:08.123) 0:03:57.080 ********* 2026-04-28 07:29:24.386326 | orchestrator | =============================================================================== 2026-04-28 07:29:24.386338 | orchestrator | designate : Restart designate-producer container ----------------------- 58.08s 2026-04-28 07:29:24.386377 | orchestrator | designate : Copying over designate.conf -------------------------------- 16.73s 2026-04-28 07:29:24.386392 | orchestrator | designate : Running Designate bootstrap container ---------------------- 15.09s 2026-04-28 07:29:24.386405 | orchestrator | designate : Restart designate-backend-bind9 container ------------------ 14.98s 2026-04-28 07:29:24.386417 | orchestrator | designate : Restart designate-worker container ------------------------- 14.13s 2026-04-28 07:29:24.386429 | orchestrator | designate : Restart designate-central container ------------------------ 13.56s 2026-04-28 07:29:24.386441 | orchestrator | designate : Restart designate-api container ---------------------------- 13.54s 2026-04-28 07:29:24.386453 | orchestrator | designate : Restart designate-mdns container --------------------------- 13.50s 2026-04-28 07:29:24.386465 | orchestrator | designate : Non-destructive DNS pools update ---------------------------- 8.12s 2026-04-28 07:29:24.386477 | orchestrator | designate : Copying over config.json files for services ----------------- 8.02s 2026-04-28 07:29:24.386489 | orchestrator | service-check-containers : designate | Check containers ----------------- 7.36s 2026-04-28 07:29:24.386502 | orchestrator | service-cert-copy : designate | Copying over extra CA certificates ------ 6.63s 2026-04-28 07:29:24.386515 | orchestrator | designate : Copying over pools.yaml ------------------------------------- 4.84s 2026-04-28 07:29:24.386528 | orchestrator | designate : Ensuring config directories exist --------------------------- 4.55s 2026-04-28 07:29:24.386541 | orchestrator | designate : Copying over rndc.conf -------------------------------------- 3.98s 2026-04-28 07:29:24.386554 | orchestrator | designate : Copying over rndc.key --------------------------------------- 3.73s 2026-04-28 07:29:24.386566 | orchestrator | designate : Copying over named.conf ------------------------------------- 3.56s 2026-04-28 07:29:24.386579 | orchestrator | designate : include_tasks ----------------------------------------------- 2.69s 2026-04-28 07:29:24.386590 | orchestrator | service-cert-copy : designate | Copying over backend internal TLS certificate --- 2.58s 2026-04-28 07:29:24.386602 | orchestrator | service-cert-copy : designate | Copying over backend internal TLS key --- 2.58s 2026-04-28 07:29:24.598321 | orchestrator | + osism apply -a upgrade ceilometer 2026-04-28 07:29:25.900954 | orchestrator | 2026-04-28 07:29:25 | INFO  | Prepare task for execution of ceilometer. 2026-04-28 07:29:25.967629 | orchestrator | 2026-04-28 07:29:25 | INFO  | Task 946959a1-646e-43a2-bd0d-01287429e292 (ceilometer) was prepared for execution. 2026-04-28 07:29:25.967751 | orchestrator | 2026-04-28 07:29:25 | INFO  | It takes a moment until task 946959a1-646e-43a2-bd0d-01287429e292 (ceilometer) has been started and output is visible here. 2026-04-28 07:29:46.291859 | orchestrator | 2026-04-28 07:29:46.291971 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 07:29:46.291988 | orchestrator | 2026-04-28 07:29:46.292000 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 07:29:46.292011 | orchestrator | Tuesday 28 April 2026 07:29:30 +0000 (0:00:01.613) 0:00:01.613 ********* 2026-04-28 07:29:46.292023 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:29:46.292035 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:29:46.292046 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:29:46.292057 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:29:46.292068 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:29:46.292078 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:29:46.292089 | orchestrator | 2026-04-28 07:29:46.292100 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 07:29:46.292111 | orchestrator | Tuesday 28 April 2026 07:29:33 +0000 (0:00:02.561) 0:00:04.174 ********* 2026-04-28 07:29:46.292122 | orchestrator | ok: [testbed-node-0] => (item=enable_ceilometer_True) 2026-04-28 07:29:46.292133 | orchestrator | ok: [testbed-node-1] => (item=enable_ceilometer_True) 2026-04-28 07:29:46.292144 | orchestrator | ok: [testbed-node-2] => (item=enable_ceilometer_True) 2026-04-28 07:29:46.292155 | orchestrator | ok: [testbed-node-3] => (item=enable_ceilometer_True) 2026-04-28 07:29:46.292166 | orchestrator | ok: [testbed-node-4] => (item=enable_ceilometer_True) 2026-04-28 07:29:46.292200 | orchestrator | ok: [testbed-node-5] => (item=enable_ceilometer_True) 2026-04-28 07:29:46.292211 | orchestrator | 2026-04-28 07:29:46.292222 | orchestrator | PLAY [Apply role ceilometer] *************************************************** 2026-04-28 07:29:46.292233 | orchestrator | 2026-04-28 07:29:46.292243 | orchestrator | TASK [ceilometer : include_tasks] ********************************************** 2026-04-28 07:29:46.292254 | orchestrator | Tuesday 28 April 2026 07:29:35 +0000 (0:00:02.453) 0:00:06.628 ********* 2026-04-28 07:29:46.292280 | orchestrator | included: /ansible/roles/ceilometer/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 07:29:46.292292 | orchestrator | 2026-04-28 07:29:46.292303 | orchestrator | TASK [ceilometer : Ensuring config directories exist] ************************** 2026-04-28 07:29:46.292314 | orchestrator | Tuesday 28 April 2026 07:29:39 +0000 (0:00:03.996) 0:00:10.624 ********* 2026-04-28 07:29:46.292328 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 07:29:46.292344 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 07:29:46.292356 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 07:29:46.292385 | orchestrator | ok: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:29:46.292400 | orchestrator | ok: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:29:46.292427 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:29:46.292441 | orchestrator | ok: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:29:46.292455 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:29:46.292468 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:29:46.292480 | orchestrator | 2026-04-28 07:29:46.292493 | orchestrator | TASK [ceilometer : Check if the folder for custom meter definitions exist] ***** 2026-04-28 07:29:46.292505 | orchestrator | Tuesday 28 April 2026 07:29:42 +0000 (0:00:02.904) 0:00:13.528 ********* 2026-04-28 07:29:46.292518 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-28 07:29:46.292531 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 07:29:46.292543 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-28 07:29:46.292555 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 07:29:46.292567 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 07:29:46.292579 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 07:29:46.292591 | orchestrator | 2026-04-28 07:29:46.292604 | orchestrator | TASK [ceilometer : Set variable that indicates if we have a folder for custom meter YAML files] *** 2026-04-28 07:29:46.292618 | orchestrator | Tuesday 28 April 2026 07:29:46 +0000 (0:00:03.278) 0:00:16.807 ********* 2026-04-28 07:29:46.292638 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:29:46.292685 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:29:54.127371 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:29:54.127470 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:29:54.127484 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:29:54.127494 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:29:54.127503 | orchestrator | 2026-04-28 07:29:54.127514 | orchestrator | TASK [ceilometer : Find all *.yaml files in custom meter definitions folder (if the folder exist)] *** 2026-04-28 07:29:54.127525 | orchestrator | Tuesday 28 April 2026 07:29:47 +0000 (0:00:01.759) 0:00:18.567 ********* 2026-04-28 07:29:54.127534 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:29:54.127544 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:29:54.127553 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:29:54.127561 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:29:54.127570 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:29:54.127579 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:29:54.127587 | orchestrator | 2026-04-28 07:29:54.127596 | orchestrator | TASK [ceilometer : Set the variable that control the copy of custom meter definitions] *** 2026-04-28 07:29:54.127606 | orchestrator | Tuesday 28 April 2026 07:29:49 +0000 (0:00:01.987) 0:00:20.554 ********* 2026-04-28 07:29:54.127615 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:29:54.127623 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:29:54.127632 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:29:54.127640 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:29:54.127699 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:29:54.127709 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:29:54.127717 | orchestrator | 2026-04-28 07:29:54.127726 | orchestrator | TASK [ceilometer : Create default folder for custom meter definitions] ********* 2026-04-28 07:29:54.127735 | orchestrator | Tuesday 28 April 2026 07:29:51 +0000 (0:00:01.986) 0:00:22.541 ********* 2026-04-28 07:29:54.127763 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:29:54.127776 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:29:54.127787 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:29:54.127796 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:29:54.127806 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:29:54.127851 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:29:54.127862 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:29:54.127871 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:29:54.127884 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:29:54.127894 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:29:54.127903 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:29:54.127912 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:29:54.127923 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:29:54.127933 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:29:54.127950 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:29:54.127960 | orchestrator | 2026-04-28 07:29:54.127971 | orchestrator | TASK [ceilometer : Copying custom meter definitions to Ceilometer] ************* 2026-04-28 07:29:54.127981 | orchestrator | Tuesday 28 April 2026 07:29:53 +0000 (0:00:02.052) 0:00:24.593 ********* 2026-04-28 07:29:54.127991 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:29:54.128010 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:09.258690 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:30:09.258784 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:30:09.258802 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:09.258814 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:30:09.258856 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:30:09.258886 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:09.258897 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:09.258908 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:30:09.258918 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:30:09.258943 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:09.258954 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:30:09.258968 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:09.258978 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:30:09.258988 | orchestrator | 2026-04-28 07:30:09.258999 | orchestrator | TASK [ceilometer : Check if the folder ["/opt/configuration/environments/kolla/files/overlays/ceilometer/pollsters.d"] for dynamic pollsters definitions exist] *** 2026-04-28 07:30:09.259010 | orchestrator | Tuesday 28 April 2026 07:29:56 +0000 (0:00:02.412) 0:00:27.006 ********* 2026-04-28 07:30:09.259020 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 07:30:09.259030 | orchestrator | 2026-04-28 07:30:09.259040 | orchestrator | TASK [ceilometer : Set the variable that control the copy of dynamic pollsters definitions] *** 2026-04-28 07:30:09.259050 | orchestrator | Tuesday 28 April 2026 07:29:58 +0000 (0:00:01.808) 0:00:28.815 ********* 2026-04-28 07:30:09.259060 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:30:09.259070 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:30:09.259079 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:30:09.259096 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:30:09.259105 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:30:09.259115 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:30:09.259124 | orchestrator | 2026-04-28 07:30:09.259134 | orchestrator | TASK [ceilometer : Clean default folder for dynamic pollsters definitions] ***** 2026-04-28 07:30:09.259144 | orchestrator | Tuesday 28 April 2026 07:29:59 +0000 (0:00:01.907) 0:00:30.723 ********* 2026-04-28 07:30:09.259153 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:30:09.259163 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:30:09.259172 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:30:09.259181 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:30:09.259191 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:30:09.259200 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:30:09.259210 | orchestrator | 2026-04-28 07:30:09.259219 | orchestrator | TASK [ceilometer : Create default folder for dynamic pollsters definitions] **** 2026-04-28 07:30:09.259229 | orchestrator | Tuesday 28 April 2026 07:30:02 +0000 (0:00:02.345) 0:00:33.068 ********* 2026-04-28 07:30:09.259239 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:30:09.259251 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:30:09.259263 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:30:09.259275 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:30:09.259287 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:30:09.259298 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:30:09.259310 | orchestrator | 2026-04-28 07:30:09.259320 | orchestrator | TASK [ceilometer : Copying dynamic pollsters definitions] ********************** 2026-04-28 07:30:09.259330 | orchestrator | Tuesday 28 April 2026 07:30:04 +0000 (0:00:01.791) 0:00:34.860 ********* 2026-04-28 07:30:09.259339 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:30:09.259349 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:30:09.259358 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:30:09.259368 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:30:09.259377 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:30:09.259387 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:30:09.259396 | orchestrator | 2026-04-28 07:30:09.259406 | orchestrator | TASK [ceilometer : Check if custom polling.yaml exists] ************************ 2026-04-28 07:30:09.259416 | orchestrator | Tuesday 28 April 2026 07:30:06 +0000 (0:00:02.074) 0:00:36.935 ********* 2026-04-28 07:30:09.259425 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-28 07:30:09.259435 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-28 07:30:09.259444 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 07:30:09.259454 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 07:30:09.259463 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 07:30:09.259473 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 07:30:09.259482 | orchestrator | 2026-04-28 07:30:09.259492 | orchestrator | TASK [ceilometer : Copying over polling.yaml] ********************************** 2026-04-28 07:30:09.259501 | orchestrator | Tuesday 28 April 2026 07:30:08 +0000 (0:00:02.670) 0:00:39.605 ********* 2026-04-28 07:30:09.259512 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:30:09.259530 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:16.403574 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:30:16.403758 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:30:16.403782 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:16.403794 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:30:16.403806 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:30:16.403818 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:16.403830 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:16.403842 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:30:16.403853 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:30:16.403882 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:16.403916 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:30:16.403933 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:16.403945 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:30:16.403956 | orchestrator | 2026-04-28 07:30:16.403968 | orchestrator | TASK [ceilometer : Set ceilometer polling file's path] ************************* 2026-04-28 07:30:16.403980 | orchestrator | Tuesday 28 April 2026 07:30:10 +0000 (0:00:02.057) 0:00:41.662 ********* 2026-04-28 07:30:16.403991 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:30:16.404002 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:30:16.404012 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:30:16.404023 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:30:16.404034 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:30:16.404044 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:30:16.404055 | orchestrator | 2026-04-28 07:30:16.404067 | orchestrator | TASK [ceilometer : Check custom gnocchi_resources.yaml exists] ***************** 2026-04-28 07:30:16.404077 | orchestrator | Tuesday 28 April 2026 07:30:12 +0000 (0:00:01.878) 0:00:43.541 ********* 2026-04-28 07:30:16.404088 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-28 07:30:16.404099 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-28 07:30:16.404111 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 07:30:16.404131 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 07:30:16.404151 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 07:30:16.404170 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 07:30:16.404187 | orchestrator | 2026-04-28 07:30:16.404206 | orchestrator | TASK [ceilometer : Copying over gnocchi_resources.yaml] ************************ 2026-04-28 07:30:16.404225 | orchestrator | Tuesday 28 April 2026 07:30:16 +0000 (0:00:03.213) 0:00:46.755 ********* 2026-04-28 07:30:16.404244 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:30:16.404265 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:16.404294 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:30:16.404312 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:30:16.404354 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:27.334782 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:30:27.334913 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:30:27.334933 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:27.334946 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:27.334959 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:27.334995 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:30:27.335007 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:30:27.335018 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:30:27.335065 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:27.335079 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:30:27.335090 | orchestrator | 2026-04-28 07:30:27.335102 | orchestrator | TASK [ceilometer : Set ceilometer gnocchi_resources file's path] *************** 2026-04-28 07:30:27.335114 | orchestrator | Tuesday 28 April 2026 07:30:18 +0000 (0:00:02.232) 0:00:48.988 ********* 2026-04-28 07:30:27.335125 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:30:27.335136 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:30:27.335147 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:30:27.335173 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:30:27.335184 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:30:27.335195 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:30:27.335205 | orchestrator | 2026-04-28 07:30:27.335216 | orchestrator | TASK [ceilometer : Check if policies shall be overwritten] ********************* 2026-04-28 07:30:27.335245 | orchestrator | Tuesday 28 April 2026 07:30:19 +0000 (0:00:01.746) 0:00:50.734 ********* 2026-04-28 07:30:27.335257 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:30:27.335270 | orchestrator | 2026-04-28 07:30:27.335282 | orchestrator | TASK [ceilometer : Set ceilometer policy file] ********************************* 2026-04-28 07:30:27.335294 | orchestrator | Tuesday 28 April 2026 07:30:21 +0000 (0:00:01.111) 0:00:51.846 ********* 2026-04-28 07:30:27.335306 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:30:27.335320 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:30:27.335332 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:30:27.335344 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:30:27.335356 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:30:27.335368 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:30:27.335379 | orchestrator | 2026-04-28 07:30:27.335390 | orchestrator | TASK [ceilometer : include_tasks] ********************************************** 2026-04-28 07:30:27.335417 | orchestrator | Tuesday 28 April 2026 07:30:23 +0000 (0:00:02.035) 0:00:53.881 ********* 2026-04-28 07:30:27.335440 | orchestrator | included: /ansible/roles/ceilometer/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 07:30:27.335452 | orchestrator | 2026-04-28 07:30:27.335463 | orchestrator | TASK [service-cert-copy : ceilometer | Copying over extra CA certificates] ***** 2026-04-28 07:30:27.335474 | orchestrator | Tuesday 28 April 2026 07:30:25 +0000 (0:00:02.645) 0:00:56.527 ********* 2026-04-28 07:30:27.335486 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 07:30:27.335507 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 07:30:27.335519 | orchestrator | ok: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:30:27.335530 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 07:30:27.335560 | orchestrator | ok: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:30:30.574991 | orchestrator | ok: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:30:30.575119 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:30:30.575136 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:30:30.575149 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:30:30.575161 | orchestrator | 2026-04-28 07:30:30.575175 | orchestrator | TASK [service-cert-copy : ceilometer | Copying over backend internal TLS certificate] *** 2026-04-28 07:30:30.575188 | orchestrator | Tuesday 28 April 2026 07:30:29 +0000 (0:00:03.435) 0:00:59.962 ********* 2026-04-28 07:30:30.575200 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:30:30.575227 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:30.575257 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:30:30.575277 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:30:30.575291 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:30.575302 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:30:30.575313 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:30:30.575324 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:30.575335 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:30:30.575347 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:30.575358 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:30:30.575381 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:36.149754 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:30:36.149884 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:36.149935 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:30:36.149949 | orchestrator | 2026-04-28 07:30:36.149961 | orchestrator | TASK [service-cert-copy : ceilometer | Copying over backend internal TLS key] *** 2026-04-28 07:30:36.149973 | orchestrator | Tuesday 28 April 2026 07:30:31 +0000 (0:00:02.597) 0:01:02.560 ********* 2026-04-28 07:30:36.149986 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:30:36.149999 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:36.150011 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:30:36.150075 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:30:36.150102 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:30:36.150136 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:36.150160 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:36.150171 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:30:36.150182 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:30:36.150194 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:36.150205 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:30:36.150216 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:36.150227 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:30:36.150238 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:30:36.150249 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:30:36.150260 | orchestrator | 2026-04-28 07:30:36.150272 | orchestrator | TASK [ceilometer : Copying over config.json files for services] **************** 2026-04-28 07:30:36.150283 | orchestrator | Tuesday 28 April 2026 07:30:34 +0000 (0:00:02.956) 0:01:05.516 ********* 2026-04-28 07:30:36.150300 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 07:30:36.150328 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 07:30:42.743228 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 07:30:42.743355 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:30:42.743385 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:30:42.743399 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:30:42.743431 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:30:42.743467 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:30:42.743500 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:30:42.743513 | orchestrator | 2026-04-28 07:30:42.743526 | orchestrator | TASK [ceilometer : Copying over ceilometer.conf] ******************************* 2026-04-28 07:30:42.743539 | orchestrator | Tuesday 28 April 2026 07:30:39 +0000 (0:00:04.608) 0:01:10.125 ********* 2026-04-28 07:30:42.743551 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 07:30:42.743563 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:30:42.743574 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 07:30:42.743602 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:30:42.743626 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 07:31:00.118354 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:31:00.118468 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:31:00.118482 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:31:00.118491 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:31:00.118520 | orchestrator | 2026-04-28 07:31:00.118530 | orchestrator | TASK [ceilometer : Check custom event_definitions.yaml exists] ***************** 2026-04-28 07:31:00.118539 | orchestrator | Tuesday 28 April 2026 07:30:45 +0000 (0:00:06.480) 0:01:16.605 ********* 2026-04-28 07:31:00.118547 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 07:31:00.118557 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-28 07:31:00.118565 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-28 07:31:00.118572 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 07:31:00.118580 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 07:31:00.118601 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 07:31:00.118609 | orchestrator | 2026-04-28 07:31:00.118617 | orchestrator | TASK [ceilometer : Copying over event_definitions.yaml] ************************ 2026-04-28 07:31:00.118625 | orchestrator | Tuesday 28 April 2026 07:30:48 +0000 (0:00:02.844) 0:01:19.450 ********* 2026-04-28 07:31:00.118633 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:31:00.118641 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:31:00.118704 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:31:00.118714 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:31:00.118722 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:31:00.118730 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:31:00.118737 | orchestrator | 2026-04-28 07:31:00.118745 | orchestrator | TASK [ceilometer : Copying over event_definitions.yaml for notification service] *** 2026-04-28 07:31:00.118754 | orchestrator | Tuesday 28 April 2026 07:30:50 +0000 (0:00:01.777) 0:01:21.227 ********* 2026-04-28 07:31:00.118762 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:31:00.118770 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:31:00.118778 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:31:00.118785 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:31:00.118794 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:31:00.118802 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:31:00.118810 | orchestrator | 2026-04-28 07:31:00.118818 | orchestrator | TASK [ceilometer : Copying over event_pipeline.yaml] *************************** 2026-04-28 07:31:00.118826 | orchestrator | Tuesday 28 April 2026 07:30:52 +0000 (0:00:02.438) 0:01:23.666 ********* 2026-04-28 07:31:00.118833 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:31:00.118841 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:31:00.118849 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:31:00.118857 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:31:00.118879 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:31:00.118887 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:31:00.118895 | orchestrator | 2026-04-28 07:31:00.118905 | orchestrator | TASK [ceilometer : Check custom pipeline.yaml exists] ************************** 2026-04-28 07:31:00.118914 | orchestrator | Tuesday 28 April 2026 07:30:55 +0000 (0:00:02.491) 0:01:26.158 ********* 2026-04-28 07:31:00.118923 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-28 07:31:00.118932 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 07:31:00.118940 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 07:31:00.118949 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-28 07:31:00.118959 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 07:31:00.118969 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 07:31:00.118977 | orchestrator | 2026-04-28 07:31:00.118987 | orchestrator | TASK [ceilometer : Copying over custom pipeline.yaml file] ********************* 2026-04-28 07:31:00.118996 | orchestrator | Tuesday 28 April 2026 07:30:58 +0000 (0:00:03.081) 0:01:29.239 ********* 2026-04-28 07:31:00.119006 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 07:31:00.119024 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 07:31:00.119034 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 07:31:00.119049 | orchestrator | ok: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:31:00.119059 | orchestrator | ok: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:31:00.119075 | orchestrator | ok: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:31:02.956845 | orchestrator | ok: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:31:02.956975 | orchestrator | ok: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:31:02.956993 | orchestrator | ok: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:31:02.957006 | orchestrator | 2026-04-28 07:31:02.957017 | orchestrator | TASK [ceilometer : Copying over pipeline.yaml file] **************************** 2026-04-28 07:31:02.957029 | orchestrator | Tuesday 28 April 2026 07:31:01 +0000 (0:00:03.259) 0:01:32.499 ********* 2026-04-28 07:31:02.957056 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:31:02.957069 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:31:02.957079 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:31:02.957091 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:31:02.957129 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:31:02.957141 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:31:02.957151 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:31:02.957161 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:31:02.957178 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:31:02.957188 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:31:02.957198 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:31:02.957209 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:31:02.957220 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:31:02.957240 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:31:09.582716 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:31:09.582827 | orchestrator | 2026-04-28 07:31:09.582844 | orchestrator | TASK [ceilometer : Copying VMware vCenter CA file] ***************************** 2026-04-28 07:31:09.582856 | orchestrator | Tuesday 28 April 2026 07:31:04 +0000 (0:00:02.307) 0:01:34.806 ********* 2026-04-28 07:31:09.582867 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:31:09.582878 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:31:09.582889 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:31:09.582900 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:31:09.582910 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:31:09.582921 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:31:09.582931 | orchestrator | 2026-04-28 07:31:09.582943 | orchestrator | TASK [ceilometer : Copying over existing policy file] ************************** 2026-04-28 07:31:09.582953 | orchestrator | Tuesday 28 April 2026 07:31:05 +0000 (0:00:01.786) 0:01:36.593 ********* 2026-04-28 07:31:09.582967 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:31:09.582982 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:31:09.582994 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:31:09.583021 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:31:09.583033 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:31:09.583069 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:31:09.583100 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:31:09.583112 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:31:09.583123 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:31:09.583135 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:31:09.583145 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:31:09.583156 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:31:09.583167 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:31:09.583184 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:31:09.583195 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:31:09.583214 | orchestrator | 2026-04-28 07:31:09.583227 | orchestrator | TASK [service-check-containers : ceilometer | Check containers] **************** 2026-04-28 07:31:09.583241 | orchestrator | Tuesday 28 April 2026 07:31:08 +0000 (0:00:02.549) 0:01:39.142 ********* 2026-04-28 07:31:09.583255 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 07:31:09.583277 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 07:31:13.928398 | orchestrator | changed: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:31:13.928522 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}}) 2026-04-28 07:31:13.928540 | orchestrator | changed: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:31:13.928570 | orchestrator | changed: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:31:13.928606 | orchestrator | changed: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:31:13.928619 | orchestrator | changed: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:31:13.928710 | orchestrator | changed: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}}) 2026-04-28 07:31:13.928726 | orchestrator | 2026-04-28 07:31:13.928740 | orchestrator | TASK [service-check-containers : ceilometer | Notify handlers to restart containers] *** 2026-04-28 07:31:13.928752 | orchestrator | Tuesday 28 April 2026 07:31:11 +0000 (0:00:03.287) 0:01:42.430 ********* 2026-04-28 07:31:13.928764 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 07:31:13.928775 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:31:13.928786 | orchestrator | } 2026-04-28 07:31:13.928797 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 07:31:13.928808 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:31:13.928819 | orchestrator | } 2026-04-28 07:31:13.928829 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 07:31:13.928840 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:31:13.928850 | orchestrator | } 2026-04-28 07:31:13.928861 | orchestrator | changed: [testbed-node-3] => { 2026-04-28 07:31:13.928872 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:31:13.928883 | orchestrator | } 2026-04-28 07:31:13.928894 | orchestrator | changed: [testbed-node-4] => { 2026-04-28 07:31:13.928905 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:31:13.928915 | orchestrator | } 2026-04-28 07:31:13.928928 | orchestrator | changed: [testbed-node-5] => { 2026-04-28 07:31:13.928940 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:31:13.928953 | orchestrator | } 2026-04-28 07:31:13.928965 | orchestrator | 2026-04-28 07:31:13.928978 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 07:31:13.928990 | orchestrator | Tuesday 28 April 2026 07:31:13 +0000 (0:00:01.836) 0:01:44.266 ********* 2026-04-28 07:31:13.929011 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:31:13.929033 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:31:13.929047 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:31:13.929061 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:31:13.929083 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:32:07.770178 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-notification', 'value': {'container_name': 'ceilometer_notification', 'group': 'ceilometer-notification', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-notification/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port ceilometer-agent-notification 5672'], 'timeout': '30'}}})  2026-04-28 07:32:07.770324 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'ceilometer-central', 'value': {'container_name': 'ceilometer_central', 'group': 'ceilometer-central', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-central/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:32:07.770372 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:32:07.770388 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:32:07.770416 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:32:07.770428 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:32:07.770440 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:32:07.770451 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:32:07.770462 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'ceilometer-compute', 'value': {'container_name': 'ceilometer_compute', 'group': 'ceilometer-compute', 'enabled': True, 'privileged': True, 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'volumes': ['/etc/kolla/ceilometer-compute/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'ceilometer:/var/lib/ceilometer/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', 'nova_libvirt:/var/lib/libvirt', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': 'NONE', 'timeout': '30'}}})  2026-04-28 07:32:07.770473 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:32:07.770483 | orchestrator | 2026-04-28 07:32:07.770495 | orchestrator | TASK [ceilometer : Running Ceilometer bootstrap container] ********************* 2026-04-28 07:32:07.770507 | orchestrator | Tuesday 28 April 2026 07:31:16 +0000 (0:00:02.997) 0:01:47.264 ********* 2026-04-28 07:32:07.770517 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:32:07.770528 | orchestrator | 2026-04-28 07:32:07.770539 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-28 07:32:07.770550 | orchestrator | Tuesday 28 April 2026 07:31:25 +0000 (0:00:08.857) 0:01:56.121 ********* 2026-04-28 07:32:07.770561 | orchestrator | 2026-04-28 07:32:07.770572 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-28 07:32:07.770601 | orchestrator | Tuesday 28 April 2026 07:31:25 +0000 (0:00:00.455) 0:01:56.577 ********* 2026-04-28 07:32:07.770612 | orchestrator | 2026-04-28 07:32:07.770623 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-28 07:32:07.770633 | orchestrator | Tuesday 28 April 2026 07:31:26 +0000 (0:00:00.771) 0:01:57.349 ********* 2026-04-28 07:32:07.770645 | orchestrator | 2026-04-28 07:32:07.770693 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-28 07:32:07.770706 | orchestrator | Tuesday 28 April 2026 07:31:27 +0000 (0:00:00.454) 0:01:57.803 ********* 2026-04-28 07:32:07.770718 | orchestrator | 2026-04-28 07:32:07.770730 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-28 07:32:07.770742 | orchestrator | Tuesday 28 April 2026 07:31:27 +0000 (0:00:00.452) 0:01:58.256 ********* 2026-04-28 07:32:07.770764 | orchestrator | 2026-04-28 07:32:07.770777 | orchestrator | TASK [ceilometer : Flush handlers] ********************************************* 2026-04-28 07:32:07.770790 | orchestrator | Tuesday 28 April 2026 07:31:27 +0000 (0:00:00.434) 0:01:58.690 ********* 2026-04-28 07:32:07.770802 | orchestrator | 2026-04-28 07:32:07.770814 | orchestrator | RUNNING HANDLER [ceilometer : Restart ceilometer-notification container] ******* 2026-04-28 07:32:07.770826 | orchestrator | Tuesday 28 April 2026 07:31:28 +0000 (0:00:00.845) 0:01:59.535 ********* 2026-04-28 07:32:07.770839 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:32:07.770851 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:32:07.770864 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:32:07.770876 | orchestrator | 2026-04-28 07:32:07.770889 | orchestrator | RUNNING HANDLER [ceilometer : Restart ceilometer-central container] ************ 2026-04-28 07:32:07.770901 | orchestrator | Tuesday 28 April 2026 07:31:41 +0000 (0:00:13.087) 0:02:12.622 ********* 2026-04-28 07:32:07.770914 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:32:07.770927 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:32:07.770940 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:32:07.770952 | orchestrator | 2026-04-28 07:32:07.770964 | orchestrator | RUNNING HANDLER [ceilometer : Restart ceilometer-compute container] ************ 2026-04-28 07:32:07.770977 | orchestrator | Tuesday 28 April 2026 07:31:54 +0000 (0:00:12.362) 0:02:24.985 ********* 2026-04-28 07:32:07.770990 | orchestrator | changed: [testbed-node-4] 2026-04-28 07:32:07.771002 | orchestrator | changed: [testbed-node-5] 2026-04-28 07:32:07.771012 | orchestrator | changed: [testbed-node-3] 2026-04-28 07:32:07.771023 | orchestrator | 2026-04-28 07:32:07.771034 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 07:32:07.771046 | orchestrator | testbed-node-0 : ok=26  changed=7  unreachable=0 failed=0 skipped=18  rescued=0 ignored=0 2026-04-28 07:32:07.771058 | orchestrator | testbed-node-1 : ok=24  changed=6  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-28 07:32:07.771069 | orchestrator | testbed-node-2 : ok=24  changed=6  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-28 07:32:07.771085 | orchestrator | testbed-node-3 : ok=21  changed=5  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-28 07:32:07.771096 | orchestrator | testbed-node-4 : ok=21  changed=5  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-28 07:32:07.771107 | orchestrator | testbed-node-5 : ok=21  changed=5  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026-04-28 07:32:07.771117 | orchestrator | 2026-04-28 07:32:07.771128 | orchestrator | 2026-04-28 07:32:07.771139 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 07:32:07.771149 | orchestrator | Tuesday 28 April 2026 07:32:07 +0000 (0:00:13.505) 0:02:38.491 ********* 2026-04-28 07:32:07.771160 | orchestrator | =============================================================================== 2026-04-28 07:32:07.771170 | orchestrator | ceilometer : Restart ceilometer-compute container ---------------------- 13.51s 2026-04-28 07:32:07.771181 | orchestrator | ceilometer : Restart ceilometer-notification container ----------------- 13.09s 2026-04-28 07:32:07.771191 | orchestrator | ceilometer : Restart ceilometer-central container ---------------------- 12.36s 2026-04-28 07:32:07.771202 | orchestrator | ceilometer : Running Ceilometer bootstrap container --------------------- 8.86s 2026-04-28 07:32:07.771212 | orchestrator | ceilometer : Copying over ceilometer.conf ------------------------------- 6.48s 2026-04-28 07:32:07.771223 | orchestrator | ceilometer : Copying over config.json files for services ---------------- 4.61s 2026-04-28 07:32:07.771237 | orchestrator | ceilometer : include_tasks ---------------------------------------------- 4.00s 2026-04-28 07:32:07.771256 | orchestrator | service-cert-copy : ceilometer | Copying over extra CA certificates ----- 3.44s 2026-04-28 07:32:07.771285 | orchestrator | ceilometer : Flush handlers --------------------------------------------- 3.41s 2026-04-28 07:32:07.771305 | orchestrator | service-check-containers : ceilometer | Check containers ---------------- 3.29s 2026-04-28 07:32:07.771325 | orchestrator | ceilometer : Check if the folder for custom meter definitions exist ----- 3.28s 2026-04-28 07:32:07.771343 | orchestrator | ceilometer : Copying over custom pipeline.yaml file --------------------- 3.26s 2026-04-28 07:32:07.771362 | orchestrator | ceilometer : Check custom gnocchi_resources.yaml exists ----------------- 3.21s 2026-04-28 07:32:07.771373 | orchestrator | ceilometer : Check custom pipeline.yaml exists -------------------------- 3.08s 2026-04-28 07:32:07.771383 | orchestrator | service-check-containers : Include tasks -------------------------------- 3.00s 2026-04-28 07:32:07.771394 | orchestrator | service-cert-copy : ceilometer | Copying over backend internal TLS key --- 2.96s 2026-04-28 07:32:07.771414 | orchestrator | ceilometer : Ensuring config directories exist -------------------------- 2.90s 2026-04-28 07:32:08.231800 | orchestrator | ceilometer : Check custom event_definitions.yaml exists ----------------- 2.85s 2026-04-28 07:32:08.231903 | orchestrator | ceilometer : Check if custom polling.yaml exists ------------------------ 2.67s 2026-04-28 07:32:08.231924 | orchestrator | ceilometer : include_tasks ---------------------------------------------- 2.65s 2026-04-28 07:32:08.425446 | orchestrator | + osism apply -a upgrade aodh 2026-04-28 07:32:09.738507 | orchestrator | 2026-04-28 07:32:09 | INFO  | Prepare task for execution of aodh. 2026-04-28 07:32:09.827141 | orchestrator | 2026-04-28 07:32:09 | INFO  | Task 1388f245-22c1-4eab-ac68-17a42262446c (aodh) was prepared for execution. 2026-04-28 07:32:09.827240 | orchestrator | 2026-04-28 07:32:09 | INFO  | It takes a moment until task 1388f245-22c1-4eab-ac68-17a42262446c (aodh) has been started and output is visible here. 2026-04-28 07:32:24.221114 | orchestrator | 2026-04-28 07:32:24.221213 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 07:32:24.221224 | orchestrator | 2026-04-28 07:32:24.221231 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 07:32:24.221238 | orchestrator | Tuesday 28 April 2026 07:32:14 +0000 (0:00:01.748) 0:00:01.748 ********* 2026-04-28 07:32:24.221244 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:32:24.221253 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:32:24.221259 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:32:24.221265 | orchestrator | 2026-04-28 07:32:24.221271 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 07:32:24.221277 | orchestrator | Tuesday 28 April 2026 07:32:16 +0000 (0:00:01.892) 0:00:03.640 ********* 2026-04-28 07:32:24.221284 | orchestrator | ok: [testbed-node-0] => (item=enable_aodh_True) 2026-04-28 07:32:24.221291 | orchestrator | ok: [testbed-node-1] => (item=enable_aodh_True) 2026-04-28 07:32:24.221298 | orchestrator | ok: [testbed-node-2] => (item=enable_aodh_True) 2026-04-28 07:32:24.221305 | orchestrator | 2026-04-28 07:32:24.221312 | orchestrator | PLAY [Apply role aodh] ********************************************************* 2026-04-28 07:32:24.221318 | orchestrator | 2026-04-28 07:32:24.221325 | orchestrator | TASK [aodh : include_tasks] **************************************************** 2026-04-28 07:32:24.221331 | orchestrator | Tuesday 28 April 2026 07:32:18 +0000 (0:00:01.953) 0:00:05.594 ********* 2026-04-28 07:32:24.221337 | orchestrator | included: /ansible/roles/aodh/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:32:24.221345 | orchestrator | 2026-04-28 07:32:24.221351 | orchestrator | TASK [aodh : Ensuring config directories exist] ******************************** 2026-04-28 07:32:24.221358 | orchestrator | Tuesday 28 April 2026 07:32:21 +0000 (0:00:03.244) 0:00:08.838 ********* 2026-04-28 07:32:24.221382 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:32:24.221414 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:32:24.221436 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:32:24.221444 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 07:32:24.221451 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 07:32:24.221461 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 07:32:24.221472 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:32:24.221479 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:32:24.221486 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:32:24.221498 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 07:32:28.685634 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 07:32:28.685818 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 07:32:28.685868 | orchestrator | 2026-04-28 07:32:28.685894 | orchestrator | TASK [aodh : Check if policies shall be overwritten] *************************** 2026-04-28 07:32:28.685915 | orchestrator | Tuesday 28 April 2026 07:32:25 +0000 (0:00:03.367) 0:00:12.205 ********* 2026-04-28 07:32:28.685931 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:32:28.685943 | orchestrator | 2026-04-28 07:32:28.685955 | orchestrator | TASK [aodh : Set aodh policy file] ********************************************* 2026-04-28 07:32:28.685965 | orchestrator | Tuesday 28 April 2026 07:32:26 +0000 (0:00:01.115) 0:00:13.321 ********* 2026-04-28 07:32:28.685983 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:32:28.686002 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:32:28.686100 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:32:28.686128 | orchestrator | 2026-04-28 07:32:28.686147 | orchestrator | TASK [aodh : Copying over existing policy file] ******************************** 2026-04-28 07:32:28.686166 | orchestrator | Tuesday 28 April 2026 07:32:27 +0000 (0:00:01.359) 0:00:14.681 ********* 2026-04-28 07:32:28.686190 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:32:28.686218 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 07:32:28.686240 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:32:28.686285 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 07:32:28.686322 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:32:28.686352 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:32:28.686373 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 07:32:28.686394 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:32:28.686417 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 07:32:28.686437 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:32:28.686470 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:32:34.998586 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 07:32:34.998774 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:32:34.998796 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 07:32:34.998810 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:32:34.998824 | orchestrator | 2026-04-28 07:32:34.998837 | orchestrator | TASK [aodh : include_tasks] **************************************************** 2026-04-28 07:32:34.998850 | orchestrator | Tuesday 28 April 2026 07:32:29 +0000 (0:00:01.952) 0:00:16.633 ********* 2026-04-28 07:32:34.998862 | orchestrator | included: /ansible/roles/aodh/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:32:34.998874 | orchestrator | 2026-04-28 07:32:34.998885 | orchestrator | TASK [service-cert-copy : aodh | Copying over extra CA certificates] *********** 2026-04-28 07:32:34.998896 | orchestrator | Tuesday 28 April 2026 07:32:31 +0000 (0:00:01.770) 0:00:18.404 ********* 2026-04-28 07:32:34.998908 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:32:34.998942 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:32:34.998985 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:32:34.998999 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 07:32:34.999010 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 07:32:34.999022 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:32:34.999033 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 07:32:34.999059 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:32:38.515189 | orchestrator | ok: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 07:32:38.515342 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:32:38.515376 | orchestrator | ok: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 07:32:38.515396 | orchestrator | ok: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 07:32:38.515409 | orchestrator | 2026-04-28 07:32:38.515423 | orchestrator | TASK [service-cert-copy : aodh | Copying over backend internal TLS certificate] *** 2026-04-28 07:32:38.515435 | orchestrator | Tuesday 28 April 2026 07:32:37 +0000 (0:00:05.941) 0:00:24.346 ********* 2026-04-28 07:32:38.515448 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:32:38.515509 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 07:32:38.515529 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:32:38.515541 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:32:38.515554 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 07:32:38.515566 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:32:38.515581 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:32:38.515613 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 07:32:38.515646 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 07:32:40.661720 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:32:40.661832 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:32:40.661849 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 07:32:40.661864 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:32:40.661878 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 07:32:40.661913 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:32:40.661925 | orchestrator | 2026-04-28 07:32:40.661937 | orchestrator | TASK [service-cert-copy : aodh | Copying over backend internal TLS key] ******** 2026-04-28 07:32:40.661950 | orchestrator | Tuesday 28 April 2026 07:32:39 +0000 (0:00:02.347) 0:00:26.693 ********* 2026-04-28 07:32:40.661962 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:32:40.661996 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 07:32:40.662068 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:32:40.662083 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:32:40.662095 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 07:32:40.662115 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 07:32:40.662126 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:32:40.662147 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:32:40.662175 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:32:45.259103 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 07:32:45.259239 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 07:32:45.259257 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:32:45.259297 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:32:45.259310 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 07:32:45.259322 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:32:45.259353 | orchestrator | 2026-04-28 07:32:45.260336 | orchestrator | TASK [aodh : Copying over config.json files for services] ********************** 2026-04-28 07:32:45.260362 | orchestrator | Tuesday 28 April 2026 07:32:42 +0000 (0:00:02.214) 0:00:28.908 ********* 2026-04-28 07:32:45.260377 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:32:45.260431 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:32:45.260445 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:32:45.260471 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 07:32:45.260483 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 07:32:45.260495 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 07:32:45.260511 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:32:45.260532 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:32:54.108720 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:32:54.108861 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 07:32:54.108879 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 07:32:54.108891 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 07:32:54.108903 | orchestrator | 2026-04-28 07:32:54.108917 | orchestrator | TASK [aodh : Copying over aodh.conf] ******************************************* 2026-04-28 07:32:54.108929 | orchestrator | Tuesday 28 April 2026 07:32:47 +0000 (0:00:05.300) 0:00:34.208 ********* 2026-04-28 07:32:54.108957 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:32:54.108993 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:32:54.109016 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:32:54.109029 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 07:32:54.109041 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 07:32:54.109059 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 07:32:54.109100 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:32:54.109122 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:33:02.941076 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:33:02.941203 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 07:33:02.941221 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 07:33:02.941234 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 07:33:02.941246 | orchestrator | 2026-04-28 07:33:02.941261 | orchestrator | TASK [aodh : Copying over wsgi-aodh files for services] ************************ 2026-04-28 07:33:02.941274 | orchestrator | Tuesday 28 April 2026 07:32:57 +0000 (0:00:09.952) 0:00:44.160 ********* 2026-04-28 07:33:02.941285 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:33:02.941297 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:33:02.941308 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:33:02.941319 | orchestrator | 2026-04-28 07:33:02.941330 | orchestrator | TASK [service-check-containers : aodh | Check containers] ********************** 2026-04-28 07:33:02.941358 | orchestrator | Tuesday 28 April 2026 07:33:00 +0000 (0:00:02.824) 0:00:46.984 ********* 2026-04-28 07:33:02.941371 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:33:02.941431 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:33:02.941446 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:33:02.941459 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 07:33:02.941476 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 07:33:02.941488 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}}) 2026-04-28 07:33:02.941516 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:33:07.235074 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:33:07.235166 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}}) 2026-04-28 07:33:07.235178 | orchestrator | changed: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 07:33:07.235187 | orchestrator | changed: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 07:33:07.235212 | orchestrator | changed: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}}) 2026-04-28 07:33:07.235241 | orchestrator | 2026-04-28 07:33:07.235252 | orchestrator | TASK [service-check-containers : aodh | Notify handlers to restart containers] *** 2026-04-28 07:33:07.235262 | orchestrator | Tuesday 28 April 2026 07:33:05 +0000 (0:00:05.005) 0:00:51.990 ********* 2026-04-28 07:33:07.235270 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 07:33:07.235280 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:33:07.235288 | orchestrator | } 2026-04-28 07:33:07.235296 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 07:33:07.235304 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:33:07.235311 | orchestrator | } 2026-04-28 07:33:07.235319 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 07:33:07.235327 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:33:07.235335 | orchestrator | } 2026-04-28 07:33:07.235343 | orchestrator | 2026-04-28 07:33:07.235351 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 07:33:07.235359 | orchestrator | Tuesday 28 April 2026 07:33:06 +0000 (0:00:01.633) 0:00:53.623 ********* 2026-04-28 07:33:07.235384 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:33:07.235397 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 07:33:07.235406 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:33:07.235415 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 07:33:07.235429 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:33:07.235443 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:33:07.235452 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 07:33:07.235467 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:34:19.320531 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 07:34:19.320697 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:34:19.320729 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-api', 'value': {'container_name': 'aodh_api', 'group': 'aodh-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'aodh:/var/lib/aodh/', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8042'], 'timeout': '30'}, 'haproxy': {'aodh_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}, 'aodh_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8042', 'listen_port': '8042', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:34:19.320796 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-evaluator', 'value': {'container_name': 'aodh_evaluator', 'group': 'aodh-evaluator', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-evaluator/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-evaluator 3306'], 'timeout': '30'}}})  2026-04-28 07:34:19.320813 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-listener', 'value': {'container_name': 'aodh_listener', 'group': 'aodh-listener', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-listener/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-listener 5672'], 'timeout': '30'}}})  2026-04-28 07:34:19.320828 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'aodh-notifier', 'value': {'container_name': 'aodh_notifier', 'group': 'aodh-notifier', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328', 'volumes': ['/etc/kolla/aodh-notifier/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port aodh-notifier 5672'], 'timeout': '30'}}})  2026-04-28 07:34:19.320843 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:34:19.320858 | orchestrator | 2026-04-28 07:34:19.320874 | orchestrator | TASK [aodh : Running aodh bootstrap container] ********************************* 2026-04-28 07:34:19.320890 | orchestrator | Tuesday 28 April 2026 07:33:08 +0000 (0:00:02.081) 0:00:55.704 ********* 2026-04-28 07:34:19.320905 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:34:19.320920 | orchestrator | 2026-04-28 07:34:19.320936 | orchestrator | TASK [aodh : Flush handlers] *************************************************** 2026-04-28 07:34:19.320946 | orchestrator | Tuesday 28 April 2026 07:33:24 +0000 (0:00:15.898) 0:01:11.603 ********* 2026-04-28 07:34:19.320954 | orchestrator | 2026-04-28 07:34:19.320963 | orchestrator | TASK [aodh : Flush handlers] *************************************************** 2026-04-28 07:34:19.320971 | orchestrator | Tuesday 28 April 2026 07:33:25 +0000 (0:00:00.584) 0:01:12.187 ********* 2026-04-28 07:34:19.320980 | orchestrator | 2026-04-28 07:34:19.321006 | orchestrator | TASK [aodh : Flush handlers] *************************************************** 2026-04-28 07:34:19.321015 | orchestrator | Tuesday 28 April 2026 07:33:25 +0000 (0:00:00.463) 0:01:12.651 ********* 2026-04-28 07:34:19.321023 | orchestrator | 2026-04-28 07:34:19.321032 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-api container] **************************** 2026-04-28 07:34:19.321040 | orchestrator | Tuesday 28 April 2026 07:33:26 +0000 (0:00:01.065) 0:01:13.716 ********* 2026-04-28 07:34:19.321049 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:34:19.321060 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:34:19.321070 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:34:19.321080 | orchestrator | 2026-04-28 07:34:19.321089 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-evaluator container] ********************** 2026-04-28 07:34:19.321099 | orchestrator | Tuesday 28 April 2026 07:33:39 +0000 (0:00:13.073) 0:01:26.790 ********* 2026-04-28 07:34:19.321109 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:34:19.321118 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:34:19.321128 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:34:19.321147 | orchestrator | 2026-04-28 07:34:19.321157 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-listener container] *********************** 2026-04-28 07:34:19.321167 | orchestrator | Tuesday 28 April 2026 07:33:52 +0000 (0:00:13.003) 0:01:39.793 ********* 2026-04-28 07:34:19.321177 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:34:19.321187 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:34:19.321198 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:34:19.321207 | orchestrator | 2026-04-28 07:34:19.321217 | orchestrator | RUNNING HANDLER [aodh : Restart aodh-notifier container] *********************** 2026-04-28 07:34:19.321227 | orchestrator | Tuesday 28 April 2026 07:34:05 +0000 (0:00:12.843) 0:01:52.637 ********* 2026-04-28 07:34:19.321238 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:34:19.321247 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:34:19.321258 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:34:19.321267 | orchestrator | 2026-04-28 07:34:19.321278 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 07:34:19.321288 | orchestrator | testbed-node-0 : ok=16  changed=9  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 07:34:19.321300 | orchestrator | testbed-node-1 : ok=15  changed=8  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 07:34:19.321310 | orchestrator | testbed-node-2 : ok=15  changed=8  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 07:34:19.321319 | orchestrator | 2026-04-28 07:34:19.321329 | orchestrator | 2026-04-28 07:34:19.321339 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 07:34:19.321349 | orchestrator | Tuesday 28 April 2026 07:34:18 +0000 (0:00:13.195) 0:02:05.833 ********* 2026-04-28 07:34:19.321359 | orchestrator | =============================================================================== 2026-04-28 07:34:19.321369 | orchestrator | aodh : Running aodh bootstrap container -------------------------------- 15.90s 2026-04-28 07:34:19.321379 | orchestrator | aodh : Restart aodh-notifier container --------------------------------- 13.19s 2026-04-28 07:34:19.321393 | orchestrator | aodh : Restart aodh-api container -------------------------------------- 13.07s 2026-04-28 07:34:19.321404 | orchestrator | aodh : Restart aodh-evaluator container -------------------------------- 13.00s 2026-04-28 07:34:19.321413 | orchestrator | aodh : Restart aodh-listener container --------------------------------- 12.84s 2026-04-28 07:34:19.321422 | orchestrator | aodh : Copying over aodh.conf ------------------------------------------- 9.95s 2026-04-28 07:34:19.321430 | orchestrator | service-cert-copy : aodh | Copying over extra CA certificates ----------- 5.94s 2026-04-28 07:34:19.321439 | orchestrator | aodh : Copying over config.json files for services ---------------------- 5.30s 2026-04-28 07:34:19.321447 | orchestrator | service-check-containers : aodh | Check containers ---------------------- 5.01s 2026-04-28 07:34:19.321455 | orchestrator | aodh : Ensuring config directories exist -------------------------------- 3.37s 2026-04-28 07:34:19.321464 | orchestrator | aodh : include_tasks ---------------------------------------------------- 3.24s 2026-04-28 07:34:19.321472 | orchestrator | aodh : Copying over wsgi-aodh files for services ------------------------ 2.82s 2026-04-28 07:34:19.321480 | orchestrator | service-cert-copy : aodh | Copying over backend internal TLS certificate --- 2.35s 2026-04-28 07:34:19.321489 | orchestrator | service-cert-copy : aodh | Copying over backend internal TLS key -------- 2.21s 2026-04-28 07:34:19.321498 | orchestrator | aodh : Flush handlers --------------------------------------------------- 2.11s 2026-04-28 07:34:19.321506 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.08s 2026-04-28 07:34:19.321514 | orchestrator | Group hosts based on enabled services ----------------------------------- 1.95s 2026-04-28 07:34:19.321527 | orchestrator | aodh : Copying over existing policy file -------------------------------- 1.95s 2026-04-28 07:34:19.321542 | orchestrator | Group hosts based on Kolla action --------------------------------------- 1.89s 2026-04-28 07:34:19.321570 | orchestrator | aodh : include_tasks ---------------------------------------------------- 1.77s 2026-04-28 07:34:19.515039 | orchestrator | ++ semver 10.0.0 7.0.0 2026-04-28 07:34:19.567186 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-28 07:34:19.567257 | orchestrator | + osism apply -a bootstrap octavia 2026-04-28 07:34:20.929814 | orchestrator | 2026-04-28 07:34:20 | INFO  | Prepare task for execution of octavia. 2026-04-28 07:34:20.999843 | orchestrator | 2026-04-28 07:34:21 | INFO  | Task 80579abd-41fb-424d-99aa-e2e7c2181909 (octavia) was prepared for execution. 2026-04-28 07:34:20.999933 | orchestrator | 2026-04-28 07:34:21 | INFO  | It takes a moment until task 80579abd-41fb-424d-99aa-e2e7c2181909 (octavia) has been started and output is visible here. 2026-04-28 07:35:07.147975 | orchestrator | 2026-04-28 07:35:07.148075 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 07:35:07.148092 | orchestrator | 2026-04-28 07:35:07.148104 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 07:35:07.148115 | orchestrator | Tuesday 28 April 2026 07:34:25 +0000 (0:00:01.555) 0:00:01.555 ********* 2026-04-28 07:35:07.148126 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:35:07.148138 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:35:07.148150 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:35:07.148160 | orchestrator | 2026-04-28 07:35:07.148171 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 07:35:07.148182 | orchestrator | Tuesday 28 April 2026 07:34:27 +0000 (0:00:01.779) 0:00:03.335 ********* 2026-04-28 07:35:07.148193 | orchestrator | ok: [testbed-node-0] => (item=enable_octavia_True) 2026-04-28 07:35:07.148204 | orchestrator | ok: [testbed-node-1] => (item=enable_octavia_True) 2026-04-28 07:35:07.148215 | orchestrator | ok: [testbed-node-2] => (item=enable_octavia_True) 2026-04-28 07:35:07.148226 | orchestrator | 2026-04-28 07:35:07.148237 | orchestrator | PLAY [Apply role octavia] ****************************************************** 2026-04-28 07:35:07.148248 | orchestrator | 2026-04-28 07:35:07.148259 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-28 07:35:07.148270 | orchestrator | Tuesday 28 April 2026 07:34:29 +0000 (0:00:01.738) 0:00:05.073 ********* 2026-04-28 07:35:07.148281 | orchestrator | included: /ansible/roles/octavia/tasks/bootstrap.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:35:07.148292 | orchestrator | 2026-04-28 07:35:07.148302 | orchestrator | TASK [octavia : Creating Octavia database] ************************************* 2026-04-28 07:35:07.148313 | orchestrator | Tuesday 28 April 2026 07:34:32 +0000 (0:00:02.973) 0:00:08.047 ********* 2026-04-28 07:35:07.148324 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:35:07.148335 | orchestrator | 2026-04-28 07:35:07.148346 | orchestrator | TASK [octavia : Creating Octavia persistence database] ************************* 2026-04-28 07:35:07.148357 | orchestrator | Tuesday 28 April 2026 07:34:35 +0000 (0:00:03.331) 0:00:11.379 ********* 2026-04-28 07:35:07.148367 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:35:07.148378 | orchestrator | 2026-04-28 07:35:07.148389 | orchestrator | TASK [octavia : Creating Octavia database user and setting permissions] ******** 2026-04-28 07:35:07.148400 | orchestrator | Tuesday 28 April 2026 07:34:38 +0000 (0:00:03.060) 0:00:14.439 ********* 2026-04-28 07:35:07.148410 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:35:07.148421 | orchestrator | 2026-04-28 07:35:07.148432 | orchestrator | TASK [octavia : Creating Octavia persistence database user and setting permissions] *** 2026-04-28 07:35:07.148443 | orchestrator | Tuesday 28 April 2026 07:34:41 +0000 (0:00:03.016) 0:00:17.456 ********* 2026-04-28 07:35:07.148453 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:35:07.148464 | orchestrator | 2026-04-28 07:35:07.148475 | orchestrator | TASK [octavia : Running Octavia bootstrap container] *************************** 2026-04-28 07:35:07.148486 | orchestrator | Tuesday 28 April 2026 07:34:45 +0000 (0:00:03.528) 0:00:20.984 ********* 2026-04-28 07:35:07.148497 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:35:07.148508 | orchestrator | 2026-04-28 07:35:07.148519 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 07:35:07.148566 | orchestrator | testbed-node-0 : ok=8  changed=1  unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 07:35:07.148581 | orchestrator | testbed-node-1 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 07:35:07.148595 | orchestrator | testbed-node-2 : ok=3  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 07:35:07.148609 | orchestrator | 2026-04-28 07:35:07.148621 | orchestrator | 2026-04-28 07:35:07.148634 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 07:35:07.148647 | orchestrator | Tuesday 28 April 2026 07:35:06 +0000 (0:00:21.580) 0:00:42.565 ********* 2026-04-28 07:35:07.148660 | orchestrator | =============================================================================== 2026-04-28 07:35:07.148699 | orchestrator | octavia : Running Octavia bootstrap container -------------------------- 21.58s 2026-04-28 07:35:07.148712 | orchestrator | octavia : Creating Octavia persistence database user and setting permissions --- 3.53s 2026-04-28 07:35:07.148725 | orchestrator | octavia : Creating Octavia database ------------------------------------- 3.33s 2026-04-28 07:35:07.148737 | orchestrator | octavia : Creating Octavia persistence database ------------------------- 3.06s 2026-04-28 07:35:07.148749 | orchestrator | octavia : Creating Octavia database user and setting permissions -------- 3.02s 2026-04-28 07:35:07.148762 | orchestrator | octavia : include_tasks ------------------------------------------------- 2.97s 2026-04-28 07:35:07.148775 | orchestrator | Group hosts based on Kolla action --------------------------------------- 1.78s 2026-04-28 07:35:07.148787 | orchestrator | Group hosts based on enabled services ----------------------------------- 1.74s 2026-04-28 07:35:07.295155 | orchestrator | + osism apply -a upgrade octavia 2026-04-28 07:35:08.447368 | orchestrator | 2026-04-28 07:35:08 | INFO  | Prepare task for execution of octavia. 2026-04-28 07:35:08.504916 | orchestrator | 2026-04-28 07:35:08 | INFO  | Task 36ee3c73-4cf3-4969-853e-741bf4c28a95 (octavia) was prepared for execution. 2026-04-28 07:35:08.505004 | orchestrator | 2026-04-28 07:35:08 | INFO  | It takes a moment until task 36ee3c73-4cf3-4969-853e-741bf4c28a95 (octavia) has been started and output is visible here. 2026-04-28 07:35:48.247769 | orchestrator | 2026-04-28 07:35:48.247889 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 07:35:48.247906 | orchestrator | 2026-04-28 07:35:48.247919 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 07:35:48.247930 | orchestrator | Tuesday 28 April 2026 07:35:13 +0000 (0:00:02.129) 0:00:02.129 ********* 2026-04-28 07:35:48.247941 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:35:48.247953 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:35:48.247964 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:35:48.247975 | orchestrator | 2026-04-28 07:35:48.247986 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 07:35:48.247997 | orchestrator | Tuesday 28 April 2026 07:35:15 +0000 (0:00:01.972) 0:00:04.102 ********* 2026-04-28 07:35:48.248008 | orchestrator | ok: [testbed-node-0] => (item=enable_octavia_True) 2026-04-28 07:35:48.248019 | orchestrator | ok: [testbed-node-1] => (item=enable_octavia_True) 2026-04-28 07:35:48.248030 | orchestrator | ok: [testbed-node-2] => (item=enable_octavia_True) 2026-04-28 07:35:48.248041 | orchestrator | 2026-04-28 07:35:48.248053 | orchestrator | PLAY [Apply role octavia] ****************************************************** 2026-04-28 07:35:48.248064 | orchestrator | 2026-04-28 07:35:48.248075 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-28 07:35:48.248086 | orchestrator | Tuesday 28 April 2026 07:35:17 +0000 (0:00:01.646) 0:00:05.749 ********* 2026-04-28 07:35:48.248097 | orchestrator | included: /ansible/roles/octavia/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:35:48.248109 | orchestrator | 2026-04-28 07:35:48.248120 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-28 07:35:48.248154 | orchestrator | Tuesday 28 April 2026 07:35:21 +0000 (0:00:03.736) 0:00:09.485 ********* 2026-04-28 07:35:48.248166 | orchestrator | included: /ansible/roles/octavia/tasks/get_resources_info.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:35:48.248177 | orchestrator | 2026-04-28 07:35:48.248187 | orchestrator | TASK [octavia : Get amphora flavor info] *************************************** 2026-04-28 07:35:48.248198 | orchestrator | Tuesday 28 April 2026 07:35:22 +0000 (0:00:01.710) 0:00:11.196 ********* 2026-04-28 07:35:48.248209 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:35:48.248219 | orchestrator | 2026-04-28 07:35:48.248230 | orchestrator | TASK [octavia : Get service project id] **************************************** 2026-04-28 07:35:48.248241 | orchestrator | Tuesday 28 April 2026 07:35:28 +0000 (0:00:05.167) 0:00:16.363 ********* 2026-04-28 07:35:48.248252 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:35:48.248264 | orchestrator | 2026-04-28 07:35:48.248276 | orchestrator | TASK [octavia : Get security groups for octavia] ******************************* 2026-04-28 07:35:48.248288 | orchestrator | Tuesday 28 April 2026 07:35:32 +0000 (0:00:04.286) 0:00:20.650 ********* 2026-04-28 07:35:48.248301 | orchestrator | ok: [testbed-node-0] => (item=lb-mgmt-sec-grp) 2026-04-28 07:35:48.248314 | orchestrator | ok: [testbed-node-0] => (item=lb-health-mgr-sec-grp) 2026-04-28 07:35:48.248326 | orchestrator | 2026-04-28 07:35:48.248338 | orchestrator | TASK [octavia : Get loadbalancer management network] *************************** 2026-04-28 07:35:48.248350 | orchestrator | Tuesday 28 April 2026 07:35:40 +0000 (0:00:07.985) 0:00:28.636 ********* 2026-04-28 07:35:48.248362 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:35:48.248375 | orchestrator | 2026-04-28 07:35:48.248387 | orchestrator | TASK [octavia : Set octavia resources facts] *********************************** 2026-04-28 07:35:48.248399 | orchestrator | Tuesday 28 April 2026 07:35:44 +0000 (0:00:04.494) 0:00:33.130 ********* 2026-04-28 07:35:48.248425 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:35:48.248438 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:35:48.248450 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:35:48.248463 | orchestrator | 2026-04-28 07:35:48.248475 | orchestrator | TASK [octavia : Ensuring config directories exist] ***************************** 2026-04-28 07:35:48.248487 | orchestrator | Tuesday 28 April 2026 07:35:46 +0000 (0:00:01.390) 0:00:34.521 ********* 2026-04-28 07:35:48.248504 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 07:35:48.248537 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 07:35:48.248552 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 07:35:48.248574 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 07:35:48.248592 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 07:35:48.248606 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 07:35:48.248620 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 07:35:48.248644 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 07:35:52.944138 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 07:35:52.944277 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 07:35:52.944296 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:35:52.944326 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 07:35:52.944339 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 07:35:52.944350 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:35:52.944404 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:35:52.944418 | orchestrator | 2026-04-28 07:35:52.944432 | orchestrator | TASK [octavia : Check if policies shall be overwritten] ************************ 2026-04-28 07:35:52.944444 | orchestrator | Tuesday 28 April 2026 07:35:50 +0000 (0:00:03.766) 0:00:38.287 ********* 2026-04-28 07:35:52.944455 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:35:52.944467 | orchestrator | 2026-04-28 07:35:52.944478 | orchestrator | TASK [octavia : Set octavia policy file] *************************************** 2026-04-28 07:35:52.944489 | orchestrator | Tuesday 28 April 2026 07:35:51 +0000 (0:00:01.163) 0:00:39.451 ********* 2026-04-28 07:35:52.944500 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:35:52.944511 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:35:52.944523 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:35:52.944535 | orchestrator | 2026-04-28 07:35:52.944547 | orchestrator | TASK [octavia : Copying over existing policy file] ***************************** 2026-04-28 07:35:52.944560 | orchestrator | Tuesday 28 April 2026 07:35:52 +0000 (0:00:01.328) 0:00:40.779 ********* 2026-04-28 07:35:52.944574 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 07:35:52.944598 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 07:35:52.944613 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 07:35:52.944626 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 07:35:52.944655 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:35:57.520474 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:35:57.520581 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 07:35:57.520598 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 07:35:57.520621 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 07:35:57.520631 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 07:35:57.520710 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:35:57.520720 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:35:57.520743 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 07:35:57.520752 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 07:35:57.520760 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 07:35:57.520772 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 07:35:57.520780 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:35:57.520794 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:35:57.520802 | orchestrator | 2026-04-28 07:35:57.520810 | orchestrator | TASK [octavia : include_tasks] ************************************************* 2026-04-28 07:35:57.520819 | orchestrator | Tuesday 28 April 2026 07:35:54 +0000 (0:00:01.710) 0:00:42.489 ********* 2026-04-28 07:35:57.520827 | orchestrator | included: /ansible/roles/octavia/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:35:57.520835 | orchestrator | 2026-04-28 07:35:57.520842 | orchestrator | TASK [service-cert-copy : octavia | Copying over extra CA certificates] ******** 2026-04-28 07:35:57.520849 | orchestrator | Tuesday 28 April 2026 07:35:55 +0000 (0:00:01.734) 0:00:44.224 ********* 2026-04-28 07:35:57.520863 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 07:36:00.791187 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 07:36:00.791315 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 07:36:00.791358 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 07:36:00.791394 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 07:36:00.791406 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 07:36:00.791448 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 07:36:00.791462 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 07:36:00.791474 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 07:36:00.791491 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 07:36:00.791512 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 07:36:00.791523 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 07:36:00.791535 | orchestrator | ok: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:36:00.791556 | orchestrator | ok: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:36:02.647072 | orchestrator | ok: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:36:02.647184 | orchestrator | 2026-04-28 07:36:02.647203 | orchestrator | TASK [service-cert-copy : octavia | Copying over backend internal TLS certificate] *** 2026-04-28 07:36:02.647217 | orchestrator | Tuesday 28 April 2026 07:36:02 +0000 (0:00:06.067) 0:00:50.292 ********* 2026-04-28 07:36:02.647247 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 07:36:02.647286 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 07:36:02.647300 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 07:36:02.647313 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 07:36:02.647342 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:36:02.647355 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:36:02.647373 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 07:36:02.647394 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 07:36:02.647406 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 07:36:02.647417 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 07:36:02.647429 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:36:02.647440 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:36:02.647460 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 07:36:04.245286 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 07:36:04.245385 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 07:36:04.245402 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 07:36:04.245415 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:36:04.245428 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:36:04.245441 | orchestrator | 2026-04-28 07:36:04.245453 | orchestrator | TASK [service-cert-copy : octavia | Copying over backend internal TLS key] ***** 2026-04-28 07:36:04.245465 | orchestrator | Tuesday 28 April 2026 07:36:03 +0000 (0:00:01.672) 0:00:51.964 ********* 2026-04-28 07:36:04.245477 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 07:36:04.245510 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 07:36:04.245553 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 07:36:04.245567 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 07:36:04.245579 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:36:04.245590 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:36:04.245603 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 07:36:04.245616 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 07:36:04.245636 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 07:36:08.069506 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 07:36:08.069658 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:36:08.069754 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:36:08.069779 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 07:36:08.069803 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 07:36:08.069825 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 07:36:08.069898 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 07:36:08.069922 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:36:08.069934 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:36:08.069946 | orchestrator | 2026-04-28 07:36:08.069958 | orchestrator | TASK [octavia : Copying over config.json files for services] ******************* 2026-04-28 07:36:08.069970 | orchestrator | Tuesday 28 April 2026 07:36:05 +0000 (0:00:01.741) 0:00:53.706 ********* 2026-04-28 07:36:08.069982 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 07:36:08.069997 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 07:36:08.070011 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 07:36:08.070105 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 07:36:18.616802 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 07:36:18.616922 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 07:36:18.616938 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 07:36:18.616949 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 07:36:18.616957 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 07:36:18.616985 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 07:36:18.617057 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 07:36:18.617066 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 07:36:18.617071 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:36:18.617076 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:36:18.617081 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:36:18.617092 | orchestrator | 2026-04-28 07:36:18.617098 | orchestrator | TASK [octavia : Copying over octavia-wsgi.conf] ******************************** 2026-04-28 07:36:18.617104 | orchestrator | Tuesday 28 April 2026 07:36:12 +0000 (0:00:06.538) 0:01:00.245 ********* 2026-04-28 07:36:18.617109 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/octavia/templates/octavia-wsgi.conf.j2) 2026-04-28 07:36:18.617115 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/octavia/templates/octavia-wsgi.conf.j2) 2026-04-28 07:36:18.617119 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/octavia/templates/octavia-wsgi.conf.j2) 2026-04-28 07:36:18.617124 | orchestrator | 2026-04-28 07:36:18.617129 | orchestrator | TASK [octavia : Copying over octavia.conf] ************************************* 2026-04-28 07:36:18.617133 | orchestrator | Tuesday 28 April 2026 07:36:14 +0000 (0:00:02.696) 0:01:02.941 ********* 2026-04-28 07:36:18.617145 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 07:36:32.259629 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 07:36:32.259798 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 07:36:32.259841 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 07:36:32.259856 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 07:36:32.259867 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 07:36:32.259912 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 07:36:32.259926 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 07:36:32.259938 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 07:36:32.259949 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 07:36:32.259969 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 07:36:32.259980 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 07:36:32.259996 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:36:32.260016 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:36:57.400965 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:36:57.401079 | orchestrator | 2026-04-28 07:36:57.401096 | orchestrator | TASK [octavia : Copying over Octavia SSH key] ********************************** 2026-04-28 07:36:57.401110 | orchestrator | Tuesday 28 April 2026 07:36:33 +0000 (0:00:18.729) 0:01:21.671 ********* 2026-04-28 07:36:57.401145 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:36:57.401159 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:36:57.401169 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:36:57.401180 | orchestrator | 2026-04-28 07:36:57.401191 | orchestrator | TASK [octavia : Copying certificate files for octavia-worker] ****************** 2026-04-28 07:36:57.401202 | orchestrator | Tuesday 28 April 2026 07:36:36 +0000 (0:00:02.768) 0:01:24.440 ********* 2026-04-28 07:36:57.401214 | orchestrator | ok: [testbed-node-0] => (item=client.cert-and-key.pem) 2026-04-28 07:36:57.401225 | orchestrator | ok: [testbed-node-2] => (item=client.cert-and-key.pem) 2026-04-28 07:36:57.401236 | orchestrator | ok: [testbed-node-1] => (item=client.cert-and-key.pem) 2026-04-28 07:36:57.401247 | orchestrator | ok: [testbed-node-0] => (item=client_ca.cert.pem) 2026-04-28 07:36:57.401258 | orchestrator | ok: [testbed-node-1] => (item=client_ca.cert.pem) 2026-04-28 07:36:57.401269 | orchestrator | ok: [testbed-node-2] => (item=client_ca.cert.pem) 2026-04-28 07:36:57.401280 | orchestrator | ok: [testbed-node-0] => (item=server_ca.cert.pem) 2026-04-28 07:36:57.401291 | orchestrator | ok: [testbed-node-1] => (item=server_ca.cert.pem) 2026-04-28 07:36:57.401301 | orchestrator | ok: [testbed-node-2] => (item=server_ca.cert.pem) 2026-04-28 07:36:57.401312 | orchestrator | ok: [testbed-node-0] => (item=server_ca.key.pem) 2026-04-28 07:36:57.401323 | orchestrator | ok: [testbed-node-1] => (item=server_ca.key.pem) 2026-04-28 07:36:57.401334 | orchestrator | ok: [testbed-node-2] => (item=server_ca.key.pem) 2026-04-28 07:36:57.401344 | orchestrator | 2026-04-28 07:36:57.401356 | orchestrator | TASK [octavia : Copying certificate files for octavia-housekeeping] ************ 2026-04-28 07:36:57.401366 | orchestrator | Tuesday 28 April 2026 07:36:42 +0000 (0:00:05.852) 0:01:30.293 ********* 2026-04-28 07:36:57.401377 | orchestrator | ok: [testbed-node-0] => (item=client.cert-and-key.pem) 2026-04-28 07:36:57.401388 | orchestrator | ok: [testbed-node-1] => (item=client.cert-and-key.pem) 2026-04-28 07:36:57.401399 | orchestrator | ok: [testbed-node-2] => (item=client.cert-and-key.pem) 2026-04-28 07:36:57.401410 | orchestrator | ok: [testbed-node-0] => (item=client_ca.cert.pem) 2026-04-28 07:36:57.401420 | orchestrator | ok: [testbed-node-1] => (item=client_ca.cert.pem) 2026-04-28 07:36:57.401431 | orchestrator | ok: [testbed-node-2] => (item=client_ca.cert.pem) 2026-04-28 07:36:57.401442 | orchestrator | ok: [testbed-node-0] => (item=server_ca.cert.pem) 2026-04-28 07:36:57.401452 | orchestrator | ok: [testbed-node-1] => (item=server_ca.cert.pem) 2026-04-28 07:36:57.401463 | orchestrator | ok: [testbed-node-2] => (item=server_ca.cert.pem) 2026-04-28 07:36:57.401474 | orchestrator | ok: [testbed-node-0] => (item=server_ca.key.pem) 2026-04-28 07:36:57.401485 | orchestrator | ok: [testbed-node-1] => (item=server_ca.key.pem) 2026-04-28 07:36:57.401496 | orchestrator | ok: [testbed-node-2] => (item=server_ca.key.pem) 2026-04-28 07:36:57.401508 | orchestrator | 2026-04-28 07:36:57.401520 | orchestrator | TASK [octavia : Copying certificate files for octavia-health-manager] ********** 2026-04-28 07:36:57.401533 | orchestrator | Tuesday 28 April 2026 07:36:48 +0000 (0:00:06.270) 0:01:36.563 ********* 2026-04-28 07:36:57.401546 | orchestrator | ok: [testbed-node-0] => (item=client.cert-and-key.pem) 2026-04-28 07:36:57.401558 | orchestrator | ok: [testbed-node-1] => (item=client.cert-and-key.pem) 2026-04-28 07:36:57.401571 | orchestrator | ok: [testbed-node-2] => (item=client.cert-and-key.pem) 2026-04-28 07:36:57.401583 | orchestrator | ok: [testbed-node-0] => (item=client_ca.cert.pem) 2026-04-28 07:36:57.401596 | orchestrator | ok: [testbed-node-1] => (item=client_ca.cert.pem) 2026-04-28 07:36:57.401608 | orchestrator | ok: [testbed-node-2] => (item=client_ca.cert.pem) 2026-04-28 07:36:57.401635 | orchestrator | ok: [testbed-node-0] => (item=server_ca.cert.pem) 2026-04-28 07:36:57.401648 | orchestrator | ok: [testbed-node-1] => (item=server_ca.cert.pem) 2026-04-28 07:36:57.401660 | orchestrator | ok: [testbed-node-2] => (item=server_ca.cert.pem) 2026-04-28 07:36:57.401707 | orchestrator | ok: [testbed-node-0] => (item=server_ca.key.pem) 2026-04-28 07:36:57.401719 | orchestrator | ok: [testbed-node-1] => (item=server_ca.key.pem) 2026-04-28 07:36:57.401740 | orchestrator | ok: [testbed-node-2] => (item=server_ca.key.pem) 2026-04-28 07:36:57.401752 | orchestrator | 2026-04-28 07:36:57.401765 | orchestrator | TASK [service-check-containers : octavia | Check containers] ******************* 2026-04-28 07:36:57.401778 | orchestrator | Tuesday 28 April 2026 07:36:54 +0000 (0:00:06.537) 0:01:43.101 ********* 2026-04-28 07:36:57.401811 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 07:36:57.401830 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 07:36:57.401843 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}}) 2026-04-28 07:36:57.401858 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 07:36:57.401878 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 07:36:57.401905 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}}) 2026-04-28 07:37:02.846713 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 07:37:02.846811 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 07:37:02.846824 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}}) 2026-04-28 07:37:02.846835 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 07:37:02.846860 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 07:37:02.846891 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}}) 2026-04-28 07:37:02.846917 | orchestrator | changed: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:37:02.846927 | orchestrator | changed: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:37:02.846937 | orchestrator | changed: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}}) 2026-04-28 07:37:02.846946 | orchestrator | 2026-04-28 07:37:02.846956 | orchestrator | TASK [service-check-containers : octavia | Notify handlers to restart containers] *** 2026-04-28 07:37:02.846973 | orchestrator | Tuesday 28 April 2026 07:37:01 +0000 (0:00:06.152) 0:01:49.254 ********* 2026-04-28 07:37:02.846989 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 07:37:02.847004 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:37:02.847019 | orchestrator | } 2026-04-28 07:37:02.847034 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 07:37:02.847048 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:37:02.847062 | orchestrator | } 2026-04-28 07:37:02.847074 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 07:37:02.847088 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:37:02.847102 | orchestrator | } 2026-04-28 07:37:02.847117 | orchestrator | 2026-04-28 07:37:02.847131 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 07:37:02.847146 | orchestrator | Tuesday 28 April 2026 07:37:02 +0000 (0:00:01.438) 0:01:50.692 ********* 2026-04-28 07:37:02.847171 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 07:37:02.847204 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 07:37:02.847229 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 07:37:03.067910 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 07:37:03.068015 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:37:03.068031 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:37:03.068047 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 07:37:03.068102 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 07:37:03.068115 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 07:37:03.068147 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 07:37:03.068159 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:37:03.068171 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:37:03.068183 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-api', 'value': {'container_name': 'octavia_api', 'group': 'octavia-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9876'], 'timeout': '30'}, 'haproxy': {'octavia_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}, 'octavia_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9876', 'listen_port': '9876', 'tls_backend': 'no'}}}})  2026-04-28 07:37:03.068203 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-driver-agent', 'value': {'container_name': 'octavia_driver_agent', 'group': 'octavia-driver-agent', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-driver-agent/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '', 'octavia_driver_agent:/var/run/octavia/'], 'dimensions': {}}})  2026-04-28 07:37:03.068220 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-health-manager', 'value': {'container_name': 'octavia_health_manager', 'group': 'octavia-health-manager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-health-manager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-health-manager 3306'], 'timeout': '30'}}})  2026-04-28 07:37:03.068231 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-housekeeping', 'value': {'container_name': 'octavia_housekeeping', 'group': 'octavia-housekeeping', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-housekeeping/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-housekeeping 3306'], 'timeout': '30'}}})  2026-04-28 07:37:03.068250 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'octavia-worker', 'value': {'container_name': 'octavia_worker', 'group': 'octavia-worker', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328', 'volumes': ['/etc/kolla/octavia-worker/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port octavia-worker 5672'], 'timeout': '30'}}})  2026-04-28 07:38:37.573542 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:38:37.573720 | orchestrator | 2026-04-28 07:38:37.573751 | orchestrator | TASK [octavia : Running Octavia bootstrap container] *************************** 2026-04-28 07:38:37.573765 | orchestrator | Tuesday 28 April 2026 07:37:04 +0000 (0:00:02.200) 0:01:52.892 ********* 2026-04-28 07:38:37.573777 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:38:37.573788 | orchestrator | 2026-04-28 07:38:37.573799 | orchestrator | TASK [octavia : Flush handlers] ************************************************ 2026-04-28 07:38:37.573810 | orchestrator | Tuesday 28 April 2026 07:37:17 +0000 (0:00:12.814) 0:02:05.707 ********* 2026-04-28 07:38:37.573822 | orchestrator | 2026-04-28 07:38:37.573833 | orchestrator | TASK [octavia : Flush handlers] ************************************************ 2026-04-28 07:38:37.573844 | orchestrator | Tuesday 28 April 2026 07:37:17 +0000 (0:00:00.485) 0:02:06.193 ********* 2026-04-28 07:38:37.573854 | orchestrator | 2026-04-28 07:38:37.573865 | orchestrator | TASK [octavia : Flush handlers] ************************************************ 2026-04-28 07:38:37.573876 | orchestrator | Tuesday 28 April 2026 07:37:18 +0000 (0:00:00.447) 0:02:06.640 ********* 2026-04-28 07:38:37.573887 | orchestrator | 2026-04-28 07:38:37.573898 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-api container] ********************** 2026-04-28 07:38:37.573909 | orchestrator | Tuesday 28 April 2026 07:37:19 +0000 (0:00:00.781) 0:02:07.422 ********* 2026-04-28 07:38:37.573946 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:38:37.573958 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:38:37.573969 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:38:37.573979 | orchestrator | 2026-04-28 07:38:37.573990 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-driver-agent container] ************* 2026-04-28 07:38:37.574001 | orchestrator | Tuesday 28 April 2026 07:37:38 +0000 (0:00:19.115) 0:02:26.537 ********* 2026-04-28 07:38:37.574012 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:38:37.574086 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:38:37.574099 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:38:37.574112 | orchestrator | 2026-04-28 07:38:37.574124 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-health-manager container] *********** 2026-04-28 07:38:37.574136 | orchestrator | Tuesday 28 April 2026 07:37:52 +0000 (0:00:14.116) 0:02:40.654 ********* 2026-04-28 07:38:37.574148 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:38:37.574161 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:38:37.574173 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:38:37.574185 | orchestrator | 2026-04-28 07:38:37.574198 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-housekeeping container] ************* 2026-04-28 07:38:37.574211 | orchestrator | Tuesday 28 April 2026 07:38:05 +0000 (0:00:13.055) 0:02:53.709 ********* 2026-04-28 07:38:37.574223 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:38:37.574235 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:38:37.574247 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:38:37.574259 | orchestrator | 2026-04-28 07:38:37.574271 | orchestrator | RUNNING HANDLER [octavia : Restart octavia-worker container] ******************* 2026-04-28 07:38:37.574284 | orchestrator | Tuesday 28 April 2026 07:38:18 +0000 (0:00:12.959) 0:03:06.669 ********* 2026-04-28 07:38:37.574297 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:38:37.574310 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:38:37.574322 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:38:37.574335 | orchestrator | 2026-04-28 07:38:37.574348 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 07:38:37.574362 | orchestrator | testbed-node-0 : ok=27  changed=10  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 07:38:37.574376 | orchestrator | testbed-node-1 : ok=22  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 07:38:37.574404 | orchestrator | testbed-node-2 : ok=22  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 07:38:37.574417 | orchestrator | 2026-04-28 07:38:37.574430 | orchestrator | 2026-04-28 07:38:37.574442 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 07:38:37.574453 | orchestrator | Tuesday 28 April 2026 07:38:37 +0000 (0:00:18.661) 0:03:25.330 ********* 2026-04-28 07:38:37.574464 | orchestrator | =============================================================================== 2026-04-28 07:38:37.574474 | orchestrator | octavia : Restart octavia-api container -------------------------------- 19.12s 2026-04-28 07:38:37.574485 | orchestrator | octavia : Copying over octavia.conf ------------------------------------ 18.73s 2026-04-28 07:38:37.574496 | orchestrator | octavia : Restart octavia-worker container ----------------------------- 18.66s 2026-04-28 07:38:37.574507 | orchestrator | octavia : Restart octavia-driver-agent container ----------------------- 14.12s 2026-04-28 07:38:37.574517 | orchestrator | octavia : Restart octavia-health-manager container --------------------- 13.05s 2026-04-28 07:38:37.574528 | orchestrator | octavia : Restart octavia-housekeeping container ----------------------- 12.96s 2026-04-28 07:38:37.574539 | orchestrator | octavia : Running Octavia bootstrap container -------------------------- 12.82s 2026-04-28 07:38:37.574550 | orchestrator | octavia : Get security groups for octavia ------------------------------- 7.99s 2026-04-28 07:38:37.574560 | orchestrator | octavia : Copying over config.json files for services ------------------- 6.54s 2026-04-28 07:38:37.574571 | orchestrator | octavia : Copying certificate files for octavia-health-manager ---------- 6.54s 2026-04-28 07:38:37.574591 | orchestrator | octavia : Copying certificate files for octavia-housekeeping ------------ 6.27s 2026-04-28 07:38:37.574602 | orchestrator | service-check-containers : octavia | Check containers ------------------- 6.15s 2026-04-28 07:38:37.574613 | orchestrator | service-cert-copy : octavia | Copying over extra CA certificates -------- 6.07s 2026-04-28 07:38:37.574624 | orchestrator | octavia : Copying certificate files for octavia-worker ------------------ 5.85s 2026-04-28 07:38:37.574655 | orchestrator | octavia : Get amphora flavor info --------------------------------------- 5.17s 2026-04-28 07:38:37.574709 | orchestrator | octavia : Get loadbalancer management network --------------------------- 4.49s 2026-04-28 07:38:37.574721 | orchestrator | octavia : Get service project id ---------------------------------------- 4.29s 2026-04-28 07:38:37.574731 | orchestrator | octavia : Ensuring config directories exist ----------------------------- 3.77s 2026-04-28 07:38:37.574742 | orchestrator | octavia : include_tasks ------------------------------------------------- 3.74s 2026-04-28 07:38:37.574753 | orchestrator | octavia : Copying over Octavia SSH key ---------------------------------- 2.77s 2026-04-28 07:38:37.802737 | orchestrator | + [[ false == \f\a\l\s\e ]] 2026-04-28 07:38:37.802827 | orchestrator | + sh -c /opt/configuration/scripts/upgrade/310-openstack-extended.sh 2026-04-28 07:38:39.129256 | orchestrator | 2026-04-28 07:38:39 | INFO  | Prepare task for execution of gnocchi. 2026-04-28 07:38:39.195644 | orchestrator | 2026-04-28 07:38:39 | INFO  | Task 04d88b9f-7216-4711-8ded-346820e529c7 (gnocchi) was prepared for execution. 2026-04-28 07:38:39.195799 | orchestrator | 2026-04-28 07:38:39 | INFO  | It takes a moment until task 04d88b9f-7216-4711-8ded-346820e529c7 (gnocchi) has been started and output is visible here. 2026-04-28 07:38:51.656870 | orchestrator | 2026-04-28 07:38:51.657000 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 07:38:51.657017 | orchestrator | 2026-04-28 07:38:51.657029 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 07:38:51.657041 | orchestrator | Tuesday 28 April 2026 07:38:44 +0000 (0:00:01.949) 0:00:01.949 ********* 2026-04-28 07:38:51.657052 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:38:51.657064 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:38:51.657075 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:38:51.657085 | orchestrator | 2026-04-28 07:38:51.657096 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 07:38:51.657107 | orchestrator | Tuesday 28 April 2026 07:38:46 +0000 (0:00:01.729) 0:00:03.679 ********* 2026-04-28 07:38:51.657118 | orchestrator | ok: [testbed-node-0] => (item=enable_gnocchi_False) 2026-04-28 07:38:51.657129 | orchestrator | ok: [testbed-node-1] => (item=enable_gnocchi_False) 2026-04-28 07:38:51.657140 | orchestrator | ok: [testbed-node-2] => (item=enable_gnocchi_False) 2026-04-28 07:38:51.657151 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: enable_gnocchi_True 2026-04-28 07:38:51.657162 | orchestrator | 2026-04-28 07:38:51.657173 | orchestrator | PLAY [Apply role gnocchi] ****************************************************** 2026-04-28 07:38:51.657184 | orchestrator | skipping: no hosts matched 2026-04-28 07:38:51.657196 | orchestrator | 2026-04-28 07:38:51.657207 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 07:38:51.657218 | orchestrator | testbed-node-0 : ok=2  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 07:38:51.657231 | orchestrator | testbed-node-1 : ok=2  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 07:38:51.657242 | orchestrator | testbed-node-2 : ok=2  changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-28 07:38:51.657253 | orchestrator | 2026-04-28 07:38:51.657264 | orchestrator | 2026-04-28 07:38:51.657275 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 07:38:51.657286 | orchestrator | Tuesday 28 April 2026 07:38:51 +0000 (0:00:05.126) 0:00:08.805 ********* 2026-04-28 07:38:51.657325 | orchestrator | =============================================================================== 2026-04-28 07:38:51.657353 | orchestrator | Group hosts based on enabled services ----------------------------------- 5.13s 2026-04-28 07:38:51.657365 | orchestrator | Group hosts based on Kolla action --------------------------------------- 1.73s 2026-04-28 07:38:53.123047 | orchestrator | 2026-04-28 07:38:53 | INFO  | Prepare task for execution of manila. 2026-04-28 07:38:53.187965 | orchestrator | 2026-04-28 07:38:53 | INFO  | Task 6703a12e-2085-49f4-ae8c-d386cb92800e (manila) was prepared for execution. 2026-04-28 07:38:53.188064 | orchestrator | 2026-04-28 07:38:53 | INFO  | It takes a moment until task 6703a12e-2085-49f4-ae8c-d386cb92800e (manila) has been started and output is visible here. 2026-04-28 07:39:06.446645 | orchestrator | 2026-04-28 07:39:06.446812 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 07:39:06.446829 | orchestrator | 2026-04-28 07:39:06.446841 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 07:39:06.446853 | orchestrator | Tuesday 28 April 2026 07:38:58 +0000 (0:00:01.600) 0:00:01.600 ********* 2026-04-28 07:39:06.446865 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:39:06.446876 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:39:06.446887 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:39:06.446898 | orchestrator | 2026-04-28 07:39:06.446909 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 07:39:06.446921 | orchestrator | Tuesday 28 April 2026 07:38:59 +0000 (0:00:01.761) 0:00:03.362 ********* 2026-04-28 07:39:06.446934 | orchestrator | ok: [testbed-node-0] => (item=enable_manila_True) 2026-04-28 07:39:06.446945 | orchestrator | ok: [testbed-node-1] => (item=enable_manila_True) 2026-04-28 07:39:06.446955 | orchestrator | ok: [testbed-node-2] => (item=enable_manila_True) 2026-04-28 07:39:06.446966 | orchestrator | 2026-04-28 07:39:06.446976 | orchestrator | PLAY [Apply role manila] ******************************************************* 2026-04-28 07:39:06.446987 | orchestrator | 2026-04-28 07:39:06.446998 | orchestrator | TASK [manila : include_tasks] ************************************************** 2026-04-28 07:39:06.447010 | orchestrator | Tuesday 28 April 2026 07:39:01 +0000 (0:00:01.894) 0:00:05.257 ********* 2026-04-28 07:39:06.447023 | orchestrator | included: /ansible/roles/manila/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:39:06.447036 | orchestrator | 2026-04-28 07:39:06.447048 | orchestrator | TASK [manila : Ensuring config directories exist] ****************************** 2026-04-28 07:39:06.447060 | orchestrator | Tuesday 28 April 2026 07:39:03 +0000 (0:00:02.158) 0:00:07.416 ********* 2026-04-28 07:39:06.447074 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:39:06.447094 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:39:06.447147 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:39:06.447179 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:06.447186 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:06.447194 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:06.447202 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:06.447219 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:06.447230 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:06.447244 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:24.443062 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:24.443194 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:24.443218 | orchestrator | 2026-04-28 07:39:24.443239 | orchestrator | TASK [manila : include_tasks] ************************************************** 2026-04-28 07:39:24.443254 | orchestrator | Tuesday 28 April 2026 07:39:07 +0000 (0:00:04.006) 0:00:11.423 ********* 2026-04-28 07:39:24.443269 | orchestrator | included: /ansible/roles/manila/tasks/external_ceph.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:39:24.443284 | orchestrator | 2026-04-28 07:39:24.443299 | orchestrator | TASK [manila : Ensuring manila service ceph config subdir exists] ************** 2026-04-28 07:39:24.443342 | orchestrator | Tuesday 28 April 2026 07:39:09 +0000 (0:00:01.859) 0:00:13.282 ********* 2026-04-28 07:39:24.443357 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:39:24.443374 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:39:24.443388 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:39:24.443401 | orchestrator | 2026-04-28 07:39:24.443414 | orchestrator | TASK [manila : Copy over multiple ceph configs for Manila] ********************* 2026-04-28 07:39:24.443426 | orchestrator | Tuesday 28 April 2026 07:39:11 +0000 (0:00:02.118) 0:00:15.400 ********* 2026-04-28 07:39:24.443440 | orchestrator | ok: [testbed-node-0] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-28 07:39:24.443455 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-28 07:39:24.443468 | orchestrator | ok: [testbed-node-1] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-28 07:39:24.443482 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-28 07:39:24.443495 | orchestrator | ok: [testbed-node-2] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-28 07:39:24.443508 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-28 07:39:24.443521 | orchestrator | 2026-04-28 07:39:24.443535 | orchestrator | TASK [manila : Copy over ceph Manila keyrings] ********************************* 2026-04-28 07:39:24.443565 | orchestrator | Tuesday 28 April 2026 07:39:14 +0000 (0:00:02.491) 0:00:17.891 ********* 2026-04-28 07:39:24.443580 | orchestrator | ok: [testbed-node-0] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-28 07:39:24.443593 | orchestrator | skipping: [testbed-node-0] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-28 07:39:24.443606 | orchestrator | ok: [testbed-node-1] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-28 07:39:24.443619 | orchestrator | skipping: [testbed-node-1] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-28 07:39:24.443683 | orchestrator | ok: [testbed-node-2] => (item={'name': 'cephfsnative1', 'share_name': 'CEPHFS1', 'driver': 'cephfsnative', 'cluster': 'ceph', 'enabled': True, 'protocols': ['CEPHFS']}) 2026-04-28 07:39:24.443700 | orchestrator | skipping: [testbed-node-2] => (item={'name': 'cephfsnfs1', 'share_name': 'CEPHFSNFS1', 'driver': 'cephfsnfs', 'cluster': 'ceph', 'enabled': False, 'protocols': ['NFS', 'CIFS']})  2026-04-28 07:39:24.443714 | orchestrator | 2026-04-28 07:39:24.443728 | orchestrator | TASK [manila : Ensuring config directory has correct owner and permission] ***** 2026-04-28 07:39:24.443741 | orchestrator | Tuesday 28 April 2026 07:39:16 +0000 (0:00:02.349) 0:00:20.241 ********* 2026-04-28 07:39:24.443755 | orchestrator | ok: [testbed-node-0] => (item=manila-share) 2026-04-28 07:39:24.443768 | orchestrator | ok: [testbed-node-1] => (item=manila-share) 2026-04-28 07:39:24.443780 | orchestrator | ok: [testbed-node-2] => (item=manila-share) 2026-04-28 07:39:24.443790 | orchestrator | 2026-04-28 07:39:24.443799 | orchestrator | TASK [manila : Check if policies shall be overwritten] ************************* 2026-04-28 07:39:24.443808 | orchestrator | Tuesday 28 April 2026 07:39:18 +0000 (0:00:01.950) 0:00:22.192 ********* 2026-04-28 07:39:24.443829 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:39:24.443840 | orchestrator | 2026-04-28 07:39:24.443852 | orchestrator | TASK [manila : Set manila policy file] ***************************************** 2026-04-28 07:39:24.443865 | orchestrator | Tuesday 28 April 2026 07:39:19 +0000 (0:00:01.136) 0:00:23.329 ********* 2026-04-28 07:39:24.443878 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:39:24.443892 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:39:24.443904 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:39:24.443918 | orchestrator | 2026-04-28 07:39:24.443930 | orchestrator | TASK [manila : include_tasks] ************************************************** 2026-04-28 07:39:24.443943 | orchestrator | Tuesday 28 April 2026 07:39:21 +0000 (0:00:01.354) 0:00:24.684 ********* 2026-04-28 07:39:24.443957 | orchestrator | included: /ansible/roles/manila/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:39:24.443970 | orchestrator | 2026-04-28 07:39:24.443983 | orchestrator | TASK [service-cert-copy : manila | Copying over extra CA certificates] ********* 2026-04-28 07:39:24.443996 | orchestrator | Tuesday 28 April 2026 07:39:23 +0000 (0:00:01.862) 0:00:26.546 ********* 2026-04-28 07:39:24.444012 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:39:24.444038 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:39:24.444065 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:39:28.511807 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:28.511940 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:28.511966 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:28.511986 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:28.512026 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:28.512043 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:28.512109 | orchestrator | ok: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:28.512129 | orchestrator | ok: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:28.512146 | orchestrator | ok: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:28.512164 | orchestrator | 2026-04-28 07:39:28.512184 | orchestrator | TASK [service-cert-copy : manila | Copying over backend internal TLS certificate] *** 2026-04-28 07:39:28.512203 | orchestrator | Tuesday 28 April 2026 07:39:27 +0000 (0:00:04.914) 0:00:31.461 ********* 2026-04-28 07:39:28.512222 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:39:28.512247 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:39:28.512291 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 07:39:30.734814 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:39:30.734927 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 07:39:30.734945 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:39:30.734959 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:39:30.734987 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:39:30.735002 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:39:30.735055 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 07:39:30.735069 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 07:39:30.735080 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 07:39:30.735096 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:39:30.735108 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 07:39:30.735119 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:39:30.735130 | orchestrator | 2026-04-28 07:39:30.735142 | orchestrator | TASK [service-cert-copy : manila | Copying over backend internal TLS key] ****** 2026-04-28 07:39:30.735154 | orchestrator | Tuesday 28 April 2026 07:39:30 +0000 (0:00:02.282) 0:00:33.743 ********* 2026-04-28 07:39:30.735171 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:39:30.735200 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:39:34.084159 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:39:34.084290 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 07:39:34.084316 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 07:39:34.084336 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:39:34.084381 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:39:34.084431 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:39:34.084478 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 07:39:34.084500 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:39:34.084521 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 07:39:34.084540 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:39:34.084560 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 07:39:34.084587 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 07:39:34.084618 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:39:34.084638 | orchestrator | 2026-04-28 07:39:34.084689 | orchestrator | TASK [manila : Copying over config.json files for services] ******************** 2026-04-28 07:39:34.084712 | orchestrator | Tuesday 28 April 2026 07:39:32 +0000 (0:00:02.377) 0:00:36.120 ********* 2026-04-28 07:39:34.084745 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:39:40.597575 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:39:40.597750 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:39:40.597787 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:40.597823 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:40.597836 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:40.597867 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:40.597881 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:40.597892 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:40.597904 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:40.597929 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:40.597940 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:40.597953 | orchestrator | 2026-04-28 07:39:40.597966 | orchestrator | TASK [manila : Copying over manila.conf] *************************************** 2026-04-28 07:39:40.597978 | orchestrator | Tuesday 28 April 2026 07:39:38 +0000 (0:00:05.550) 0:00:41.671 ********* 2026-04-28 07:39:40.597998 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:39:50.870989 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:39:50.871126 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:39:50.871168 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:50.871183 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 07:39:50.871196 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:50.871226 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 07:39:50.871239 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:50.871259 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 07:39:50.871276 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:50.871289 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:50.871300 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:50.871312 | orchestrator | 2026-04-28 07:39:50.871326 | orchestrator | TASK [manila : Copying over manila-share.conf] ********************************* 2026-04-28 07:39:50.871340 | orchestrator | Tuesday 28 April 2026 07:39:46 +0000 (0:00:07.847) 0:00:49.519 ********* 2026-04-28 07:39:50.871359 | orchestrator | changed: [testbed-node-0] => (item=manila-share) 2026-04-28 07:39:50.871378 | orchestrator | changed: [testbed-node-1] => (item=manila-share) 2026-04-28 07:39:50.871398 | orchestrator | changed: [testbed-node-2] => (item=manila-share) 2026-04-28 07:39:50.871418 | orchestrator | 2026-04-28 07:39:50.871434 | orchestrator | TASK [manila : Copying over existing policy file] ****************************** 2026-04-28 07:39:50.871460 | orchestrator | Tuesday 28 April 2026 07:39:50 +0000 (0:00:04.859) 0:00:54.378 ********* 2026-04-28 07:39:51.700348 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:39:51.700449 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:39:51.700473 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 07:39:51.700482 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 07:39:51.700491 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:39:51.700500 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:39:51.700522 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:39:51.700535 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 07:39:51.700546 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 07:39:51.700553 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:39:51.700560 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:39:51.700567 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:39:51.700577 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 07:39:51.700602 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 07:39:57.302976 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:39:57.303088 | orchestrator | 2026-04-28 07:39:57.303106 | orchestrator | TASK [service-check-containers : manila | Check containers] ******************** 2026-04-28 07:39:57.303119 | orchestrator | Tuesday 28 April 2026 07:39:53 +0000 (0:00:02.511) 0:00:56.890 ********* 2026-04-28 07:39:57.303149 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:39:57.303166 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:39:57.303179 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:39:57.303191 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:57.303243 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:57.303256 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:57.303274 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:57.303286 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:57.303297 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:57.303309 | orchestrator | changed: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 07:39:57.303336 | orchestrator | changed: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 07:40:00.664104 | orchestrator | changed: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}}) 2026-04-28 07:40:00.664199 | orchestrator | 2026-04-28 07:40:00.664212 | orchestrator | TASK [service-check-containers : manila | Notify handlers to restart containers] *** 2026-04-28 07:40:00.664222 | orchestrator | Tuesday 28 April 2026 07:39:58 +0000 (0:00:05.049) 0:01:01.940 ********* 2026-04-28 07:40:00.664231 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 07:40:00.664240 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:40:00.664248 | orchestrator | } 2026-04-28 07:40:00.664257 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 07:40:00.664280 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:40:00.664288 | orchestrator | } 2026-04-28 07:40:00.664296 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 07:40:00.664304 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:40:00.664311 | orchestrator | } 2026-04-28 07:40:00.664319 | orchestrator | 2026-04-28 07:40:00.664327 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 07:40:00.664335 | orchestrator | Tuesday 28 April 2026 07:39:59 +0000 (0:00:01.381) 0:01:03.322 ********* 2026-04-28 07:40:00.664345 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:40:00.664355 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:40:00.664383 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 07:40:00.664407 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 07:40:00.664417 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:40:00.664430 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:40:00.664439 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:40:00.664447 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 07:40:00.664461 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 07:40:00.664469 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:40:00.664477 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-api', 'value': {'container_name': 'manila_api', 'group': 'manila-api', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:8786'], 'timeout': '30'}, 'haproxy': {'manila_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}, 'manila_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '8786', 'listen_port': '8786', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:40:00.664493 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-scheduler', 'value': {'container_name': 'manila_scheduler', 'group': 'manila-scheduler', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328', 'enabled': True, 'volumes': ['/etc/kolla/manila-scheduler/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-scheduler 5672'], 'timeout': '30'}}})  2026-04-28 07:43:29.123479 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-share', 'value': {'container_name': 'manila_share', 'group': 'manila-share', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-share/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm', '/lib/modules:/lib/modules:ro', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-share 5672'], 'timeout': '30'}}})  2026-04-28 07:43:29.123598 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'manila-data', 'value': {'container_name': 'manila_data', 'group': 'manila-data', 'image': 'registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328', 'enabled': True, 'privileged': True, 'volumes': ['/etc/kolla/manila-data/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/dev/:/dev/', '/run:/run:shared', 'kolla_logs:/var/log/kolla/', ''], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port manila-data 5672'], 'timeout': '30'}}})  2026-04-28 07:43:29.123620 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:43:29.123715 | orchestrator | 2026-04-28 07:43:29.123732 | orchestrator | TASK [manila : Running Manila bootstrap container] ***************************** 2026-04-28 07:43:29.123769 | orchestrator | Tuesday 28 April 2026 07:40:02 +0000 (0:00:02.533) 0:01:05.855 ********* 2026-04-28 07:43:29.123781 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:43:29.123792 | orchestrator | 2026-04-28 07:43:29.123803 | orchestrator | TASK [manila : Flush handlers] ************************************************* 2026-04-28 07:43:29.123814 | orchestrator | Tuesday 28 April 2026 07:40:20 +0000 (0:00:18.159) 0:01:24.015 ********* 2026-04-28 07:43:29.123825 | orchestrator | 2026-04-28 07:43:29.123836 | orchestrator | TASK [manila : Flush handlers] ************************************************* 2026-04-28 07:43:29.123847 | orchestrator | Tuesday 28 April 2026 07:40:20 +0000 (0:00:00.474) 0:01:24.489 ********* 2026-04-28 07:43:29.123858 | orchestrator | 2026-04-28 07:43:29.123868 | orchestrator | TASK [manila : Flush handlers] ************************************************* 2026-04-28 07:43:29.123879 | orchestrator | Tuesday 28 April 2026 07:40:21 +0000 (0:00:00.464) 0:01:24.954 ********* 2026-04-28 07:43:29.123889 | orchestrator | 2026-04-28 07:43:29.123900 | orchestrator | RUNNING HANDLER [manila : Restart manila-api container] ************************ 2026-04-28 07:43:29.123911 | orchestrator | Tuesday 28 April 2026 07:40:22 +0000 (0:00:00.823) 0:01:25.777 ********* 2026-04-28 07:43:29.123921 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:43:29.123932 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:43:29.123943 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:43:29.123953 | orchestrator | 2026-04-28 07:43:29.123964 | orchestrator | RUNNING HANDLER [manila : Restart manila-data container] *********************** 2026-04-28 07:43:29.123975 | orchestrator | Tuesday 28 April 2026 07:40:39 +0000 (0:00:17.608) 0:01:43.385 ********* 2026-04-28 07:43:29.123985 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:43:29.123998 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:43:29.124011 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:43:29.124023 | orchestrator | 2026-04-28 07:43:29.124035 | orchestrator | RUNNING HANDLER [manila : Restart manila-scheduler container] ****************** 2026-04-28 07:43:29.124048 | orchestrator | Tuesday 28 April 2026 07:40:53 +0000 (0:00:13.842) 0:01:57.228 ********* 2026-04-28 07:43:29.124059 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:43:29.124071 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:43:29.124084 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:43:29.124097 | orchestrator | 2026-04-28 07:43:29.124108 | orchestrator | RUNNING HANDLER [manila : Restart manila-share container] ********************** 2026-04-28 07:43:29.124121 | orchestrator | Tuesday 28 April 2026 07:41:07 +0000 (0:00:13.320) 0:02:10.548 ********* 2026-04-28 07:43:29.124133 | orchestrator | 2026-04-28 07:43:29.124145 | orchestrator | STILL ALIVE [task 'manila : Restart manila-share container' is running] ******** 2026-04-28 07:43:29.124157 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:43:29.124169 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:43:29.124182 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:43:29.124194 | orchestrator | 2026-04-28 07:43:29.124206 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 07:43:29.124220 | orchestrator | testbed-node-0 : ok=21  changed=10  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 07:43:29.124233 | orchestrator | testbed-node-1 : ok=20  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 07:43:29.124246 | orchestrator | testbed-node-2 : ok=20  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 07:43:29.124258 | orchestrator | 2026-04-28 07:43:29.124270 | orchestrator | 2026-04-28 07:43:29.124282 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 07:43:29.124294 | orchestrator | Tuesday 28 April 2026 07:43:28 +0000 (0:02:21.554) 0:04:32.103 ********* 2026-04-28 07:43:29.124306 | orchestrator | =============================================================================== 2026-04-28 07:43:29.124334 | orchestrator | manila : Restart manila-share container ------------------------------- 141.55s 2026-04-28 07:43:29.124354 | orchestrator | manila : Running Manila bootstrap container ---------------------------- 18.16s 2026-04-28 07:43:29.124365 | orchestrator | manila : Restart manila-api container ---------------------------------- 17.61s 2026-04-28 07:43:29.124376 | orchestrator | manila : Restart manila-data container --------------------------------- 13.84s 2026-04-28 07:43:29.124387 | orchestrator | manila : Restart manila-scheduler container ---------------------------- 13.32s 2026-04-28 07:43:29.124404 | orchestrator | manila : Copying over manila.conf --------------------------------------- 7.85s 2026-04-28 07:43:29.124416 | orchestrator | manila : Copying over config.json files for services -------------------- 5.55s 2026-04-28 07:43:29.124426 | orchestrator | service-check-containers : manila | Check containers -------------------- 5.05s 2026-04-28 07:43:29.124437 | orchestrator | service-cert-copy : manila | Copying over extra CA certificates --------- 4.91s 2026-04-28 07:43:29.124448 | orchestrator | manila : Copying over manila-share.conf --------------------------------- 4.86s 2026-04-28 07:43:29.124458 | orchestrator | manila : Ensuring config directories exist ------------------------------ 4.01s 2026-04-28 07:43:29.124469 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.53s 2026-04-28 07:43:29.124479 | orchestrator | manila : Copying over existing policy file ------------------------------ 2.51s 2026-04-28 07:43:29.124490 | orchestrator | manila : Copy over multiple ceph configs for Manila --------------------- 2.49s 2026-04-28 07:43:29.124501 | orchestrator | service-cert-copy : manila | Copying over backend internal TLS key ------ 2.38s 2026-04-28 07:43:29.124511 | orchestrator | manila : Copy over ceph Manila keyrings --------------------------------- 2.35s 2026-04-28 07:43:29.124522 | orchestrator | service-cert-copy : manila | Copying over backend internal TLS certificate --- 2.28s 2026-04-28 07:43:29.124534 | orchestrator | manila : include_tasks -------------------------------------------------- 2.16s 2026-04-28 07:43:29.124545 | orchestrator | manila : Ensuring manila service ceph config subdir exists -------------- 2.12s 2026-04-28 07:43:29.124555 | orchestrator | manila : Ensuring config directory has correct owner and permission ----- 1.95s 2026-04-28 07:43:29.339342 | orchestrator | + [[ true == \t\r\u\e ]] 2026-04-28 07:43:29.339442 | orchestrator | + osism migrate rabbitmq3to4 delete 2026-04-28 07:43:35.829766 | orchestrator | 2026-04-28 07:43:35 | ERROR  | Unable to get ansible vault password 2026-04-28 07:43:35.829869 | orchestrator | 2026-04-28 07:43:35 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-28 07:43:35.829885 | orchestrator | 2026-04-28 07:43:35 | ERROR  | Dropping encrypted entries 2026-04-28 07:43:35.862999 | orchestrator | 2026-04-28 07:43:35 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-28 07:43:36.090138 | orchestrator | 2026-04-28 07:43:36 | INFO  | Found 129 classic queue(s) in vhost '/' 2026-04-28 07:43:36.147266 | orchestrator | 2026-04-28 07:43:36 | INFO  | Deleted queue: alarm.all.sample 2026-04-28 07:43:36.200265 | orchestrator | 2026-04-28 07:43:36 | INFO  | Deleted queue: alarming.sample 2026-04-28 07:43:36.248316 | orchestrator | 2026-04-28 07:43:36 | INFO  | Deleted queue: barbican.workers 2026-04-28 07:43:36.305125 | orchestrator | 2026-04-28 07:43:36 | INFO  | Deleted queue: barbican.workers.barbican.queue 2026-04-28 07:43:36.345441 | orchestrator | 2026-04-28 07:43:36 | INFO  | Deleted queue: barbican.workers_fanout_257befa41c8e49f09fae4afa2836a6f8 2026-04-28 07:43:36.392422 | orchestrator | 2026-04-28 07:43:36 | INFO  | Deleted queue: barbican.workers_fanout_4b10364e7a8146d19d800a6f26722212 2026-04-28 07:43:36.442810 | orchestrator | 2026-04-28 07:43:36 | INFO  | Deleted queue: barbican.workers_fanout_a2aad0d41e3b4d0e9cb2959979dc221b 2026-04-28 07:43:36.496730 | orchestrator | 2026-04-28 07:43:36 | INFO  | Deleted queue: barbican_notifications.info 2026-04-28 07:43:36.554110 | orchestrator | 2026-04-28 07:43:36 | INFO  | Deleted queue: central 2026-04-28 07:43:36.595479 | orchestrator | 2026-04-28 07:43:36 | INFO  | Deleted queue: central.testbed-node-0 2026-04-28 07:43:36.642493 | orchestrator | 2026-04-28 07:43:36 | INFO  | Deleted queue: central.testbed-node-1 2026-04-28 07:43:36.684853 | orchestrator | 2026-04-28 07:43:36 | INFO  | Deleted queue: central.testbed-node-2 2026-04-28 07:43:36.724258 | orchestrator | 2026-04-28 07:43:36 | INFO  | Deleted queue: central_fanout_1746274fc9fd4b1b975552a22477ea4f 2026-04-28 07:43:36.757693 | orchestrator | 2026-04-28 07:43:36 | INFO  | Deleted queue: central_fanout_2b73462715644146b960a568f88b712a 2026-04-28 07:43:36.799989 | orchestrator | 2026-04-28 07:43:36 | INFO  | Deleted queue: central_fanout_654af88a92224ca4a7fa54abfc64ca11 2026-04-28 07:43:36.834613 | orchestrator | 2026-04-28 07:43:36 | INFO  | Deleted queue: central_fanout_694677d4d2414e6cb895b2fca0f03868 2026-04-28 07:43:36.868896 | orchestrator | 2026-04-28 07:43:36 | INFO  | Deleted queue: central_fanout_a7ff3d4d97974639a40cb9352e4d8b24 2026-04-28 07:43:36.905781 | orchestrator | 2026-04-28 07:43:36 | INFO  | Deleted queue: central_fanout_f16ff3095f2748d2ac8fc39dab707205 2026-04-28 07:43:36.948355 | orchestrator | 2026-04-28 07:43:36 | INFO  | Deleted queue: cinder-backup 2026-04-28 07:43:36.992844 | orchestrator | 2026-04-28 07:43:36 | INFO  | Deleted queue: cinder-backup.testbed-node-0 2026-04-28 07:43:37.043400 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: cinder-backup.testbed-node-1 2026-04-28 07:43:37.093008 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: cinder-backup.testbed-node-2 2026-04-28 07:43:37.137439 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: cinder-scheduler 2026-04-28 07:43:37.184783 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: cinder-scheduler.testbed-node-0 2026-04-28 07:43:37.233556 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: cinder-scheduler.testbed-node-1 2026-04-28 07:43:37.288161 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: cinder-scheduler.testbed-node-2 2026-04-28 07:43:37.330513 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: cinder-volume 2026-04-28 07:43:37.373975 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: cinder-volume.testbed-node-0@rbd-volumes 2026-04-28 07:43:37.418444 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: cinder-volume.testbed-node-0@rbd-volumes.testbed-node-0 2026-04-28 07:43:37.458815 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: cinder-volume.testbed-node-1@rbd-volumes 2026-04-28 07:43:37.498906 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: cinder-volume.testbed-node-1@rbd-volumes.testbed-node-1 2026-04-28 07:43:37.535418 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: cinder-volume.testbed-node-2@rbd-volumes 2026-04-28 07:43:37.588056 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: cinder-volume.testbed-node-2@rbd-volumes.testbed-node-2 2026-04-28 07:43:37.632019 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: compute 2026-04-28 07:43:37.680167 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: compute.testbed-node-3 2026-04-28 07:43:37.720138 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: compute.testbed-node-4 2026-04-28 07:43:37.757909 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: compute.testbed-node-5 2026-04-28 07:43:37.792210 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: conductor 2026-04-28 07:43:37.840792 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: conductor.testbed-node-0 2026-04-28 07:43:37.898808 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: conductor.testbed-node-1 2026-04-28 07:43:37.939913 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: conductor.testbed-node-2 2026-04-28 07:43:37.987933 | orchestrator | 2026-04-28 07:43:37 | INFO  | Deleted queue: event.sample 2026-04-28 07:43:38.018059 | orchestrator | 2026-04-28 07:43:38 | INFO  | Closed connection: 192.168.16.11:43658 -> 192.168.16.11:5672 2026-04-28 07:43:38.034168 | orchestrator | 2026-04-28 07:43:38 | INFO  | Closed connection: 192.168.16.10:46286 -> 192.168.16.11:5672 2026-04-28 07:43:38.054968 | orchestrator | 2026-04-28 07:43:38 | INFO  | Closed connection: 192.168.16.12:55638 -> 192.168.16.10:5672 2026-04-28 07:43:38.074192 | orchestrator | 2026-04-28 07:43:38 | INFO  | Closed connection: 192.168.16.12:43800 -> 192.168.16.11:5672 2026-04-28 07:43:38.089410 | orchestrator | 2026-04-28 07:43:38 | INFO  | Closed connection: 192.168.16.10:52414 -> 192.168.16.10:5672 2026-04-28 07:43:38.104510 | orchestrator | 2026-04-28 07:43:38 | INFO  | Closed connection: 192.168.16.11:53866 -> 192.168.16.10:5672 2026-04-28 07:43:38.118940 | orchestrator | 2026-04-28 07:43:38 | INFO  | Closed connection: 192.168.16.11:38172 -> 192.168.16.10:5672 2026-04-28 07:43:38.129765 | orchestrator | 2026-04-28 07:43:38 | INFO  | Closed connection: 192.168.16.12:55632 -> 192.168.16.10:5672 2026-04-28 07:43:38.145550 | orchestrator | 2026-04-28 07:43:38 | INFO  | Closed connection: 192.168.16.10:52394 -> 192.168.16.10:5672 2026-04-28 07:43:38.145805 | orchestrator | 2026-04-28 07:43:38 | INFO  | Closed 9 connection(s) for queue: magnum-conductor 2026-04-28 07:43:38.183182 | orchestrator | 2026-04-28 07:43:38 | INFO  | Deleted queue: magnum-conductor 2026-04-28 07:43:38.222358 | orchestrator | 2026-04-28 07:43:38 | INFO  | Deleted queue: magnum-conductor.23kkdtj7kbpm 2026-04-28 07:43:38.267993 | orchestrator | 2026-04-28 07:43:38 | INFO  | Deleted queue: magnum-conductor.muqkm72ic6fj 2026-04-28 07:43:38.320151 | orchestrator | 2026-04-28 07:43:38 | INFO  | Deleted queue: magnum-conductor.qunrydm2gv3l 2026-04-28 07:43:38.359634 | orchestrator | 2026-04-28 07:43:38 | INFO  | Deleted queue: magnum-conductor_fanout_41b4e1df1fc74cdfbb272b2aa0c9e317 2026-04-28 07:43:38.397876 | orchestrator | 2026-04-28 07:43:38 | INFO  | Deleted queue: magnum-conductor_fanout_6c2a82c0a6e44417b411a4b92f1e0521 2026-04-28 07:43:38.441878 | orchestrator | 2026-04-28 07:43:38 | INFO  | Deleted queue: magnum-conductor_fanout_715ca76c0c934524a7eca1241992ad3c 2026-04-28 07:43:38.481945 | orchestrator | 2026-04-28 07:43:38 | INFO  | Deleted queue: magnum-conductor_fanout_795a296cfe344d8c9374c3a7a5b6916d 2026-04-28 07:43:38.521072 | orchestrator | 2026-04-28 07:43:38 | INFO  | Deleted queue: magnum-conductor_fanout_8aafe37959e3460ca46a034f98e9aa91 2026-04-28 07:43:38.562840 | orchestrator | 2026-04-28 07:43:38 | INFO  | Deleted queue: magnum-conductor_fanout_999a9c0a490c4a53bebb71262b81af4f 2026-04-28 07:43:38.599464 | orchestrator | 2026-04-28 07:43:38 | INFO  | Deleted queue: magnum-conductor_fanout_ab63e6713e5b47758e8155046faa7e89 2026-04-28 07:43:38.637550 | orchestrator | 2026-04-28 07:43:38 | INFO  | Deleted queue: magnum-conductor_fanout_b390359272bd4aa98103a57a9a65a2a8 2026-04-28 07:43:38.682856 | orchestrator | 2026-04-28 07:43:38 | INFO  | Deleted queue: magnum-conductor_fanout_cfbbd35d982f4bde89e50cf974c58485 2026-04-28 07:43:38.732064 | orchestrator | 2026-04-28 07:43:38 | INFO  | Deleted queue: manila-data 2026-04-28 07:43:38.781696 | orchestrator | 2026-04-28 07:43:38 | INFO  | Deleted queue: manila-data.testbed-node-0 2026-04-28 07:43:38.826997 | orchestrator | 2026-04-28 07:43:38 | INFO  | Deleted queue: manila-data.testbed-node-1 2026-04-28 07:43:38.885475 | orchestrator | 2026-04-28 07:43:38 | INFO  | Deleted queue: manila-data.testbed-node-2 2026-04-28 07:43:38.937144 | orchestrator | 2026-04-28 07:43:38 | INFO  | Deleted queue: manila-scheduler 2026-04-28 07:43:38.982586 | orchestrator | 2026-04-28 07:43:38 | INFO  | Deleted queue: manila-scheduler.testbed-node-0 2026-04-28 07:43:39.040107 | orchestrator | 2026-04-28 07:43:39 | INFO  | Deleted queue: manila-scheduler.testbed-node-1 2026-04-28 07:43:39.100889 | orchestrator | 2026-04-28 07:43:39 | INFO  | Deleted queue: manila-scheduler.testbed-node-2 2026-04-28 07:43:39.153195 | orchestrator | 2026-04-28 07:43:39 | INFO  | Deleted queue: manila-share 2026-04-28 07:43:39.200095 | orchestrator | 2026-04-28 07:43:39 | INFO  | Deleted queue: manila-share.testbed-node-0@cephfsnative1 2026-04-28 07:43:39.237681 | orchestrator | 2026-04-28 07:43:39 | INFO  | Deleted queue: manila-share.testbed-node-1@cephfsnative1 2026-04-28 07:43:39.283907 | orchestrator | 2026-04-28 07:43:39 | INFO  | Deleted queue: manila-share.testbed-node-2@cephfsnative1 2026-04-28 07:43:39.324136 | orchestrator | 2026-04-28 07:43:39 | INFO  | Deleted queue: manila-share_fanout_2153bd923e74456eb9006f5b46fe799d 2026-04-28 07:43:39.364089 | orchestrator | 2026-04-28 07:43:39 | INFO  | Deleted queue: manila-share_fanout_e122b874392d432d8bc5dfa240d6a1eb 2026-04-28 07:43:39.414613 | orchestrator | 2026-04-28 07:43:39 | INFO  | Deleted queue: manila-share_fanout_f3bf6c7d6b894b659c9d7983c9314ec3 2026-04-28 07:43:39.569267 | orchestrator | 2026-04-28 07:43:39 | INFO  | Deleted queue: notifications.audit 2026-04-28 07:43:39.721799 | orchestrator | 2026-04-28 07:43:39 | INFO  | Deleted queue: notifications.critical 2026-04-28 07:43:39.868984 | orchestrator | 2026-04-28 07:43:39 | INFO  | Deleted queue: notifications.debug 2026-04-28 07:43:40.001098 | orchestrator | 2026-04-28 07:43:40 | INFO  | Deleted queue: notifications.error 2026-04-28 07:43:40.161889 | orchestrator | 2026-04-28 07:43:40 | INFO  | Deleted queue: notifications.info 2026-04-28 07:43:40.316220 | orchestrator | 2026-04-28 07:43:40 | INFO  | Deleted queue: notifications.sample 2026-04-28 07:43:40.502210 | orchestrator | 2026-04-28 07:43:40 | INFO  | Deleted queue: notifications.warn 2026-04-28 07:43:40.549366 | orchestrator | 2026-04-28 07:43:40 | INFO  | Deleted queue: octavia_provisioning_v2 2026-04-28 07:43:40.591591 | orchestrator | 2026-04-28 07:43:40 | INFO  | Deleted queue: octavia_provisioning_v2.testbed-node-0 2026-04-28 07:43:40.642413 | orchestrator | 2026-04-28 07:43:40 | INFO  | Deleted queue: octavia_provisioning_v2.testbed-node-1 2026-04-28 07:43:40.697154 | orchestrator | 2026-04-28 07:43:40 | INFO  | Deleted queue: octavia_provisioning_v2.testbed-node-2 2026-04-28 07:43:40.735123 | orchestrator | 2026-04-28 07:43:40 | INFO  | Deleted queue: producer 2026-04-28 07:43:40.788154 | orchestrator | 2026-04-28 07:43:40 | INFO  | Deleted queue: producer.testbed-node-0 2026-04-28 07:43:40.829452 | orchestrator | 2026-04-28 07:43:40 | INFO  | Deleted queue: producer.testbed-node-1 2026-04-28 07:43:40.870112 | orchestrator | 2026-04-28 07:43:40 | INFO  | Deleted queue: producer.testbed-node-2 2026-04-28 07:43:40.905199 | orchestrator | 2026-04-28 07:43:40 | INFO  | Deleted queue: producer_fanout_0615415e51814691855c19de8b2d0912 2026-04-28 07:43:40.947536 | orchestrator | 2026-04-28 07:43:40 | INFO  | Deleted queue: producer_fanout_4afa4eee41ae4729ae4eeac0148f69c7 2026-04-28 07:43:40.990006 | orchestrator | 2026-04-28 07:43:40 | INFO  | Deleted queue: producer_fanout_d15ec1fb9cf44ceb8dad4eef197e9be3 2026-04-28 07:43:41.031628 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: producer_fanout_e52ccce539e941ddaf5c92dd2ccae2a8 2026-04-28 07:43:41.067594 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: producer_fanout_e6b63d0316984bc0b0529503cd0392db 2026-04-28 07:43:41.106970 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: producer_fanout_f3c92510369d4bc39c8c14b1506eacd4 2026-04-28 07:43:41.143054 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: q-plugin 2026-04-28 07:43:41.184558 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: q-plugin.testbed-node-0 2026-04-28 07:43:41.224989 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: q-plugin.testbed-node-1 2026-04-28 07:43:41.268986 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: q-plugin.testbed-node-2 2026-04-28 07:43:41.303192 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: q-reports-plugin 2026-04-28 07:43:41.349233 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: q-reports-plugin.testbed-node-0 2026-04-28 07:43:41.393864 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: q-reports-plugin.testbed-node-1 2026-04-28 07:43:41.447804 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: q-reports-plugin.testbed-node-2 2026-04-28 07:43:41.487190 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: q-server-resource-versions 2026-04-28 07:43:41.550630 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: q-server-resource-versions.testbed-node-0 2026-04-28 07:43:41.603683 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: q-server-resource-versions.testbed-node-1 2026-04-28 07:43:41.656073 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: q-server-resource-versions.testbed-node-2 2026-04-28 07:43:41.691263 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: reply_11862500555f4a7da8f2574e303956a1 2026-04-28 07:43:41.725984 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: reply_22b834026e764bd3af00d50e96f46e5e 2026-04-28 07:43:41.771603 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: reply_304ba1a6d51e419d803538f4ccbfbf2c 2026-04-28 07:43:41.808043 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: reply_3410c12bfc9544ed8ee6900e1e05211e 2026-04-28 07:43:41.842938 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: reply_49b1f7cbe78742009f49e8926d06c106 2026-04-28 07:43:41.876476 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: reply_556501ba270945bfade281260f43bfe0 2026-04-28 07:43:41.909098 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: reply_574c816c3f7f4c73ba726dd30c7aed4a 2026-04-28 07:43:41.940405 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: reply_8c6dddb9709d48fa866fc818353a349a 2026-04-28 07:43:41.976505 | orchestrator | 2026-04-28 07:43:41 | INFO  | Deleted queue: reply_ad634ad9802a4e719401b396f4fd0f67 2026-04-28 07:43:42.017835 | orchestrator | 2026-04-28 07:43:42 | INFO  | Deleted queue: reply_b6300008d2f44d219636ea77e848a078 2026-04-28 07:43:42.053052 | orchestrator | 2026-04-28 07:43:42 | INFO  | Deleted queue: reply_c3f511d13e544fe39c6df1fbfa8dda42 2026-04-28 07:43:42.090362 | orchestrator | 2026-04-28 07:43:42 | INFO  | Deleted queue: reply_fb4e193fb58d4fa2ba5c6e0e37ff27bc 2026-04-28 07:43:42.122739 | orchestrator | 2026-04-28 07:43:42 | INFO  | Deleted queue: scheduler 2026-04-28 07:43:42.166866 | orchestrator | 2026-04-28 07:43:42 | INFO  | Deleted queue: scheduler.testbed-node-0 2026-04-28 07:43:42.212587 | orchestrator | 2026-04-28 07:43:42 | INFO  | Deleted queue: scheduler.testbed-node-1 2026-04-28 07:43:42.253551 | orchestrator | 2026-04-28 07:43:42 | INFO  | Deleted queue: scheduler.testbed-node-2 2026-04-28 07:43:42.293244 | orchestrator | 2026-04-28 07:43:42 | INFO  | Deleted queue: worker 2026-04-28 07:43:42.336367 | orchestrator | 2026-04-28 07:43:42 | INFO  | Deleted queue: worker.testbed-node-0 2026-04-28 07:43:42.378768 | orchestrator | 2026-04-28 07:43:42 | INFO  | Deleted queue: worker.testbed-node-1 2026-04-28 07:43:42.424589 | orchestrator | 2026-04-28 07:43:42 | INFO  | Deleted queue: worker.testbed-node-2 2026-04-28 07:43:42.460281 | orchestrator | 2026-04-28 07:43:42 | INFO  | Deleted queue: worker_fanout_08f736f72039449d83ee69d959338555 2026-04-28 07:43:42.493831 | orchestrator | 2026-04-28 07:43:42 | INFO  | Deleted queue: worker_fanout_154f235c30664406ad349d1703214134 2026-04-28 07:43:42.530394 | orchestrator | 2026-04-28 07:43:42 | INFO  | Deleted queue: worker_fanout_3470a305167d4451a90a2c2e1c9699f8 2026-04-28 07:43:42.572378 | orchestrator | 2026-04-28 07:43:42 | INFO  | Deleted queue: worker_fanout_3c3d1433f4f34ed7be0dc6ae2d838617 2026-04-28 07:43:42.613889 | orchestrator | 2026-04-28 07:43:42 | INFO  | Deleted queue: worker_fanout_67cfe2cd2dc6432fb4cf89afd1777866 2026-04-28 07:43:42.657591 | orchestrator | 2026-04-28 07:43:42 | INFO  | Deleted queue: worker_fanout_cc122723c7a54e39a103184cec29b369 2026-04-28 07:43:42.657714 | orchestrator | 2026-04-28 07:43:42 | INFO  | Successfully deleted 129 queue(s) in vhost '/' 2026-04-28 07:43:42.974698 | orchestrator | + osism migrate rabbitmq3to4 list 2026-04-28 07:43:49.390688 | orchestrator | 2026-04-28 07:43:49 | ERROR  | Unable to get ansible vault password 2026-04-28 07:43:49.390803 | orchestrator | 2026-04-28 07:43:49 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-28 07:43:49.390830 | orchestrator | 2026-04-28 07:43:49 | ERROR  | Dropping encrypted entries 2026-04-28 07:43:49.440014 | orchestrator | 2026-04-28 07:43:49 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-28 07:43:49.620722 | orchestrator | 2026-04-28 07:43:49 | INFO  | Found 13 classic queue(s) in vhost '/': 2026-04-28 07:43:49.620838 | orchestrator | 2026-04-28 07:43:49 | INFO  |  - magnum-conductor (vhost: /, messages: 0) 2026-04-28 07:43:49.620853 | orchestrator | 2026-04-28 07:43:49 | INFO  |  - magnum-conductor.23kkdtj7kbpm (vhost: /, messages: 0) 2026-04-28 07:43:49.620864 | orchestrator | 2026-04-28 07:43:49 | INFO  |  - magnum-conductor.muqkm72ic6fj (vhost: /, messages: 0) 2026-04-28 07:43:49.620875 | orchestrator | 2026-04-28 07:43:49 | INFO  |  - magnum-conductor.qunrydm2gv3l (vhost: /, messages: 0) 2026-04-28 07:43:49.620886 | orchestrator | 2026-04-28 07:43:49 | INFO  |  - magnum-conductor_fanout_41b4e1df1fc74cdfbb272b2aa0c9e317 (vhost: /, messages: 0) 2026-04-28 07:43:49.620930 | orchestrator | 2026-04-28 07:43:49 | INFO  |  - magnum-conductor_fanout_6c2a82c0a6e44417b411a4b92f1e0521 (vhost: /, messages: 0) 2026-04-28 07:43:49.620941 | orchestrator | 2026-04-28 07:43:49 | INFO  |  - magnum-conductor_fanout_715ca76c0c934524a7eca1241992ad3c (vhost: /, messages: 0) 2026-04-28 07:43:49.621026 | orchestrator | 2026-04-28 07:43:49 | INFO  |  - magnum-conductor_fanout_795a296cfe344d8c9374c3a7a5b6916d (vhost: /, messages: 0) 2026-04-28 07:43:49.621072 | orchestrator | 2026-04-28 07:43:49 | INFO  |  - magnum-conductor_fanout_8aafe37959e3460ca46a034f98e9aa91 (vhost: /, messages: 0) 2026-04-28 07:43:49.621120 | orchestrator | 2026-04-28 07:43:49 | INFO  |  - magnum-conductor_fanout_999a9c0a490c4a53bebb71262b81af4f (vhost: /, messages: 0) 2026-04-28 07:43:49.621250 | orchestrator | 2026-04-28 07:43:49 | INFO  |  - magnum-conductor_fanout_ab63e6713e5b47758e8155046faa7e89 (vhost: /, messages: 0) 2026-04-28 07:43:49.621528 | orchestrator | 2026-04-28 07:43:49 | INFO  |  - magnum-conductor_fanout_b390359272bd4aa98103a57a9a65a2a8 (vhost: /, messages: 0) 2026-04-28 07:43:49.621558 | orchestrator | 2026-04-28 07:43:49 | INFO  |  - magnum-conductor_fanout_cfbbd35d982f4bde89e50cf974c58485 (vhost: /, messages: 0) 2026-04-28 07:43:49.945428 | orchestrator | + osism migrate rabbitmq3to4 list --vhost openstack --quorum 2026-04-28 07:43:56.218292 | orchestrator | 2026-04-28 07:43:56 | ERROR  | Unable to get ansible vault password 2026-04-28 07:43:56.218390 | orchestrator | 2026-04-28 07:43:56 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-28 07:43:56.218404 | orchestrator | 2026-04-28 07:43:56 | ERROR  | Dropping encrypted entries 2026-04-28 07:43:56.251263 | orchestrator | 2026-04-28 07:43:56 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-28 07:43:56.396439 | orchestrator | 2026-04-28 07:43:56 | INFO  | Found 192 quorum queue(s) in vhost 'openstack': 2026-04-28 07:43:56.396535 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - alarm.all.sample (vhost: openstack, messages: 0) 2026-04-28 07:43:56.396550 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - alarming.sample (vhost: openstack, messages: 0) 2026-04-28 07:43:56.396562 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - barbican.workers (vhost: openstack, messages: 0) 2026-04-28 07:43:56.396574 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - barbican.workers.barbican.queue (vhost: openstack, messages: 0) 2026-04-28 07:43:56.396606 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - barbican.workers_fanout_testbed-node-0:barbican-worker:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.396619 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - barbican.workers_fanout_testbed-node-1:barbican-worker:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.396630 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - barbican.workers_fanout_testbed-node-2:barbican-worker:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.396739 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - barbican_notifications.info (vhost: openstack, messages: 0) 2026-04-28 07:43:56.396752 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - central (vhost: openstack, messages: 0) 2026-04-28 07:43:56.396763 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - central.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.396774 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - central.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.396785 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - central.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.396796 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - central_fanout_testbed-node-0:designate-central:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.396808 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - central_fanout_testbed-node-0:designate-central:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.396819 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - central_fanout_testbed-node-1:designate-central:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.396830 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - central_fanout_testbed-node-1:designate-central:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.396932 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - central_fanout_testbed-node-2:designate-central:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.396948 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - central_fanout_testbed-node-2:designate-central:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.396986 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-backup (vhost: openstack, messages: 0) 2026-04-28 07:43:56.397034 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-backup.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.397101 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-backup.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.397115 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-backup.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.397126 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-backup_fanout_testbed-node-0:cinder-backup:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.397237 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-backup_fanout_testbed-node-1:cinder-backup:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.397544 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-backup_fanout_testbed-node-2:cinder-backup:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.397567 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-scheduler (vhost: openstack, messages: 0) 2026-04-28 07:43:56.397578 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-scheduler.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.398892 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-scheduler.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399027 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-scheduler.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399045 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-scheduler_fanout_testbed-node-0:cinder-scheduler:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399057 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-scheduler_fanout_testbed-node-1:cinder-scheduler:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399068 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-scheduler_fanout_testbed-node-2:cinder-scheduler:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399080 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-volume (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399106 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-volume.testbed-node-0@rbd-volumes (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399134 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-volume.testbed-node-0@rbd-volumes.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399146 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-volume.testbed-node-0@rbd-volumes_fanout_testbed-node-0:cinder-volume:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399158 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-volume.testbed-node-1@rbd-volumes (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399169 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-volume.testbed-node-1@rbd-volumes.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399179 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-volume.testbed-node-1@rbd-volumes_fanout_testbed-node-1:cinder-volume:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399190 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-volume.testbed-node-2@rbd-volumes (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399200 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-volume.testbed-node-2@rbd-volumes.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399211 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-volume.testbed-node-2@rbd-volumes_fanout_testbed-node-2:cinder-volume:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399242 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-volume_fanout_testbed-node-0:cinder-volume:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399418 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-volume_fanout_testbed-node-1:cinder-volume:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399438 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - cinder-volume_fanout_testbed-node-2:cinder-volume:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399449 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - compute (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399460 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - compute.testbed-node-3 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399471 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - compute.testbed-node-4 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399481 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - compute.testbed-node-5 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399492 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - compute_fanout_testbed-node-3:nova-compute:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399505 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - compute_fanout_testbed-node-4:nova-compute:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399754 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - compute_fanout_testbed-node-5:nova-compute:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399776 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - conductor (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399787 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - conductor.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.399798 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - conductor.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.400088 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - conductor.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.400111 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - conductor_fanout_testbed-node-0:nova-conductor:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.400122 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - conductor_fanout_testbed-node-0:nova-conductor:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.400133 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - conductor_fanout_testbed-node-1:nova-conductor:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.400549 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - conductor_fanout_testbed-node-1:nova-conductor:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.400572 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - conductor_fanout_testbed-node-2:nova-conductor:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.400583 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - conductor_fanout_testbed-node-2:nova-conductor:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.400593 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - event.sample (vhost: openstack, messages: 9) 2026-04-28 07:43:56.400604 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - manila-data (vhost: openstack, messages: 0) 2026-04-28 07:43:56.400615 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - manila-data.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.400762 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - manila-data.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.400782 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - manila-data.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.400794 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - manila-data_fanout_testbed-node-0:manila-data:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.401122 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - manila-data_fanout_testbed-node-1:manila-data:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.401161 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - manila-data_fanout_testbed-node-2:manila-data:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.401172 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - manila-scheduler (vhost: openstack, messages: 0) 2026-04-28 07:43:56.401183 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - manila-scheduler.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.401270 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - manila-scheduler.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.401286 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - manila-scheduler.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.401534 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - manila-scheduler_fanout_testbed-node-0:manila-scheduler:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.401555 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - manila-scheduler_fanout_testbed-node-1:manila-scheduler:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.401737 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - manila-scheduler_fanout_testbed-node-2:manila-scheduler:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.401760 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - manila-share (vhost: openstack, messages: 0) 2026-04-28 07:43:56.401788 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - manila-share.testbed-node-0@cephfsnative1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.401800 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - manila-share.testbed-node-1@cephfsnative1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.401811 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - manila-share.testbed-node-2@cephfsnative1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.401897 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - manila-share_fanout_testbed-node-0:manila-share:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.401914 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - manila-share_fanout_testbed-node-1:manila-share:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.402183 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - manila-share_fanout_testbed-node-2:manila-share:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.402207 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - notifications.audit (vhost: openstack, messages: 0) 2026-04-28 07:43:56.402666 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - notifications.critical (vhost: openstack, messages: 0) 2026-04-28 07:43:56.402725 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - notifications.debug (vhost: openstack, messages: 0) 2026-04-28 07:43:56.402741 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - notifications.error (vhost: openstack, messages: 0) 2026-04-28 07:43:56.402754 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - notifications.info (vhost: openstack, messages: 0) 2026-04-28 07:43:56.402764 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - notifications.sample (vhost: openstack, messages: 0) 2026-04-28 07:43:56.402775 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - notifications.warn (vhost: openstack, messages: 0) 2026-04-28 07:43:56.403274 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - octavia_provisioning_v2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.403298 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - octavia_provisioning_v2.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.403310 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - octavia_provisioning_v2.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.403341 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - octavia_provisioning_v2.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.403352 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - octavia_provisioning_v2_fanout_testbed-node-0:octavia-worker:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.403375 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - octavia_provisioning_v2_fanout_testbed-node-1:octavia-worker:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.403574 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - octavia_provisioning_v2_fanout_testbed-node-2:octavia-worker:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.403593 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - osism-listener-cinder (vhost: openstack, messages: 0) 2026-04-28 07:43:56.403604 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - osism-listener-glance (vhost: openstack, messages: 0) 2026-04-28 07:43:56.403630 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - osism-listener-ironic (vhost: openstack, messages: 0) 2026-04-28 07:43:56.403666 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - osism-listener-keystone (vhost: openstack, messages: 0) 2026-04-28 07:43:56.403678 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - osism-listener-neutron (vhost: openstack, messages: 0) 2026-04-28 07:43:56.403690 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - osism-listener-nova (vhost: openstack, messages: 0) 2026-04-28 07:43:56.403769 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - producer (vhost: openstack, messages: 0) 2026-04-28 07:43:56.404003 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - producer.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.404039 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - producer.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.404051 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - producer.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.404129 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - producer_fanout_testbed-node-0:designate-producer:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.404144 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - producer_fanout_testbed-node-0:designate-producer:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.404371 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - producer_fanout_testbed-node-1:designate-producer:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.404391 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - producer_fanout_testbed-node-1:designate-producer:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.404403 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - producer_fanout_testbed-node-2:designate-producer:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.404654 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - producer_fanout_testbed-node-2:designate-producer:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.404675 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-plugin (vhost: openstack, messages: 0) 2026-04-28 07:43:56.404699 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-plugin.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.404768 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-plugin.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.404781 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-plugin.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.405001 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-plugin_fanout_testbed-node-0:neutron-server:4 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.405019 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-plugin_fanout_testbed-node-0:neutron-server:5 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.405191 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-plugin_fanout_testbed-node-0:neutron-server:6 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.405208 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-plugin_fanout_testbed-node-1:neutron-server:4 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.405444 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-plugin_fanout_testbed-node-1:neutron-server:5 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.405462 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-plugin_fanout_testbed-node-1:neutron-server:6 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.405472 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-plugin_fanout_testbed-node-2:neutron-server:4 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.405541 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-plugin_fanout_testbed-node-2:neutron-server:5 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.405693 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-plugin_fanout_testbed-node-2:neutron-server:6 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.405745 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin (vhost: openstack, messages: 0) 2026-04-28 07:43:56.405757 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.405830 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.406145 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.406166 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin_fanout_testbed-node-0:neutron-server:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.406282 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin_fanout_testbed-node-0:neutron-server:10 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.406432 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin_fanout_testbed-node-0:neutron-server:11 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.406449 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin_fanout_testbed-node-0:neutron-server:12 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.406460 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin_fanout_testbed-node-0:neutron-server:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.406470 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin_fanout_testbed-node-0:neutron-server:3 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.406595 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin_fanout_testbed-node-1:neutron-server:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.406624 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin_fanout_testbed-node-1:neutron-server:10 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.406762 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin_fanout_testbed-node-1:neutron-server:11 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.406777 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin_fanout_testbed-node-1:neutron-server:12 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.406916 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin_fanout_testbed-node-1:neutron-server:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.407181 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin_fanout_testbed-node-1:neutron-server:3 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.407209 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin_fanout_testbed-node-2:neutron-server:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.407219 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin_fanout_testbed-node-2:neutron-server:10 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.407229 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin_fanout_testbed-node-2:neutron-server:11 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.407311 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin_fanout_testbed-node-2:neutron-server:12 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.407431 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin_fanout_testbed-node-2:neutron-server:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.407569 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-reports-plugin_fanout_testbed-node-2:neutron-server:3 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.407585 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-server-resource-versions (vhost: openstack, messages: 0) 2026-04-28 07:43:56.407596 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-server-resource-versions.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.407760 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-server-resource-versions.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.407777 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-server-resource-versions.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.408380 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-server-resource-versions_fanout_testbed-node-0:neutron-server:7 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.408452 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-server-resource-versions_fanout_testbed-node-0:neutron-server:8 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.408475 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-server-resource-versions_fanout_testbed-node-0:neutron-server:9 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.408487 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-server-resource-versions_fanout_testbed-node-1:neutron-server:7 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.408497 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-server-resource-versions_fanout_testbed-node-1:neutron-server:8 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.408508 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-server-resource-versions_fanout_testbed-node-1:neutron-server:9 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.408627 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-server-resource-versions_fanout_testbed-node-2:neutron-server:7 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.408687 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-server-resource-versions_fanout_testbed-node-2:neutron-server:8 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.408698 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - q-server-resource-versions_fanout_testbed-node-2:neutron-server:9 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.408710 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - reply_testbed-node-0:designate-manage:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.408816 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - reply_testbed-node-0:designate-producer:3 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.408833 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - reply_testbed-node-0:designate-producer:4 (vhost: openstack, messages: 1) 2026-04-28 07:43:56.409164 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - reply_testbed-node-1:designate-producer:3 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.409210 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - reply_testbed-node-1:designate-producer:4 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.409222 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - reply_testbed-node-2:designate-producer:3 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.409351 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - reply_testbed-node-2:designate-producer:4 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.409363 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - reply_testbed-node-3:nova-compute:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.409372 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - reply_testbed-node-4:nova-compute:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.409574 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - reply_testbed-node-5:nova-compute:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.409588 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - scheduler (vhost: openstack, messages: 0) 2026-04-28 07:43:56.409597 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - scheduler.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.409679 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - scheduler.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.409766 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - scheduler.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.409777 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - scheduler_fanout_testbed-node-0:nova-scheduler:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.409992 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - scheduler_fanout_testbed-node-0:nova-scheduler:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.410121 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - scheduler_fanout_testbed-node-1:nova-scheduler:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.410135 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - scheduler_fanout_testbed-node-1:nova-scheduler:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.410143 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - scheduler_fanout_testbed-node-2:nova-scheduler:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.410237 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - scheduler_fanout_testbed-node-2:nova-scheduler:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.410606 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - worker (vhost: openstack, messages: 0) 2026-04-28 07:43:56.410630 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - worker.testbed-node-0 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.410720 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - worker.testbed-node-1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.410732 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - worker.testbed-node-2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.410749 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - worker_fanout_testbed-node-0:designate-worker:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.410971 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - worker_fanout_testbed-node-0:designate-worker:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.411046 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - worker_fanout_testbed-node-1:designate-worker:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.411059 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - worker_fanout_testbed-node-1:designate-worker:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.411067 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - worker_fanout_testbed-node-2:designate-worker:1 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.411172 | orchestrator | 2026-04-28 07:43:56 | INFO  |  - worker_fanout_testbed-node-2:designate-worker:2 (vhost: openstack, messages: 0) 2026-04-28 07:43:56.677587 | orchestrator | + osism migrate rabbitmq3to4 delete-exchanges 2026-04-28 07:44:02.954451 | orchestrator | 2026-04-28 07:44:02 | ERROR  | Unable to get ansible vault password 2026-04-28 07:44:02.954556 | orchestrator | 2026-04-28 07:44:02 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-28 07:44:02.954574 | orchestrator | 2026-04-28 07:44:02 | ERROR  | Dropping encrypted entries 2026-04-28 07:44:02.987800 | orchestrator | 2026-04-28 07:44:02 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-28 07:44:03.003119 | orchestrator | 2026-04-28 07:44:03 | INFO  | Found 27 exchange(s) in vhost '/' 2026-04-28 07:44:03.034587 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: aodh 2026-04-28 07:44:03.073226 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: ceilometer 2026-04-28 07:44:03.114805 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: cinder 2026-04-28 07:44:03.153911 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: designate 2026-04-28 07:44:03.188283 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: dns 2026-04-28 07:44:03.222956 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: glance 2026-04-28 07:44:03.264739 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: heat 2026-04-28 07:44:03.316071 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: ironic 2026-04-28 07:44:03.359296 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: keystone 2026-04-28 07:44:03.400022 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: l3_agent_fanout 2026-04-28 07:44:03.459898 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: magnum 2026-04-28 07:44:03.516059 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: magnum-conductor_fanout 2026-04-28 07:44:03.549029 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: neutron 2026-04-28 07:44:03.584993 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: neutron-vo-Network-1.1_fanout 2026-04-28 07:44:03.625628 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: neutron-vo-Port-1.10_fanout 2026-04-28 07:44:03.652857 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: neutron-vo-SecurityGroup-1.6_fanout 2026-04-28 07:44:03.681578 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: neutron-vo-SecurityGroupRule-1.3_fanout 2026-04-28 07:44:03.725327 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: neutron-vo-Subnet-1.2_fanout 2026-04-28 07:44:03.756953 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: nova 2026-04-28 07:44:03.797836 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: octavia 2026-04-28 07:44:03.837768 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: openstack 2026-04-28 07:44:03.872773 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: q-agent-notifier-port-update_fanout 2026-04-28 07:44:03.904777 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: q-agent-notifier-security_group-update_fanout 2026-04-28 07:44:03.935766 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: scheduler_fanout 2026-04-28 07:44:03.978545 | orchestrator | 2026-04-28 07:44:03 | INFO  | Deleted exchange: swift 2026-04-28 07:44:04.036131 | orchestrator | 2026-04-28 07:44:04 | INFO  | Deleted exchange: trove 2026-04-28 07:44:04.090485 | orchestrator | 2026-04-28 07:44:04 | INFO  | Deleted exchange: zaqar 2026-04-28 07:44:04.091165 | orchestrator | 2026-04-28 07:44:04 | INFO  | Successfully deleted 27 exchange(s) in vhost '/' 2026-04-28 07:44:04.424491 | orchestrator | + osism migrate rabbitmq3to4 list-exchanges 2026-04-28 07:44:10.740335 | orchestrator | 2026-04-28 07:44:10 | ERROR  | Unable to get ansible vault password 2026-04-28 07:44:10.740426 | orchestrator | 2026-04-28 07:44:10 | ERROR  | Unable to get vault secret: [Errno 2] No such file or directory: '/share/ansible_vault_password.key' 2026-04-28 07:44:10.740438 | orchestrator | 2026-04-28 07:44:10 | ERROR  | Dropping encrypted entries 2026-04-28 07:44:10.774108 | orchestrator | 2026-04-28 07:44:10 | INFO  | Connecting to RabbitMQ Management API at 192.168.16.10:15672 (node: testbed-node-0) as openstack... 2026-04-28 07:44:10.788451 | orchestrator | 2026-04-28 07:44:10 | INFO  | No exchanges found in vhost '/' 2026-04-28 07:44:11.065810 | orchestrator | + [[ false == \f\a\l\s\e ]] 2026-04-28 07:44:11.065908 | orchestrator | + sh -c /opt/configuration/scripts/upgrade/400-monitoring.sh 2026-04-28 07:44:12.403012 | orchestrator | 2026-04-28 07:44:12 | INFO  | Prepare task for execution of prometheus. 2026-04-28 07:44:12.469503 | orchestrator | 2026-04-28 07:44:12 | INFO  | Task 5900ae67-7f8c-4205-8358-55510dd7be90 (prometheus) was prepared for execution. 2026-04-28 07:44:12.469617 | orchestrator | 2026-04-28 07:44:12 | INFO  | It takes a moment until task 5900ae67-7f8c-4205-8358-55510dd7be90 (prometheus) has been started and output is visible here. 2026-04-28 07:44:25.627715 | orchestrator | 2026-04-28 07:44:25.627813 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 07:44:25.627830 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-28 07:44:25.627843 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-28 07:44:25.627865 | orchestrator | 2026-04-28 07:44:25.627876 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 07:44:25.627886 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-28 07:44:25.627897 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-28 07:44:25.627918 | orchestrator | Tuesday 28 April 2026 07:44:17 +0000 (0:00:01.571) 0:00:01.571 ********* 2026-04-28 07:44:25.627929 | orchestrator | ok: [testbed-manager] 2026-04-28 07:44:25.627941 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:44:25.627952 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:44:25.627963 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:44:25.627973 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:44:25.627984 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:44:25.627994 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:44:25.628005 | orchestrator | 2026-04-28 07:44:25.628016 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 07:44:25.628027 | orchestrator | Tuesday 28 April 2026 07:44:18 +0000 (0:00:01.228) 0:00:02.802 ********* 2026-04-28 07:44:25.628037 | orchestrator | ok: [testbed-manager] => (item=enable_prometheus_True) 2026-04-28 07:44:25.628049 | orchestrator | ok: [testbed-node-0] => (item=enable_prometheus_True) 2026-04-28 07:44:25.628059 | orchestrator | ok: [testbed-node-1] => (item=enable_prometheus_True) 2026-04-28 07:44:25.628070 | orchestrator | ok: [testbed-node-2] => (item=enable_prometheus_True) 2026-04-28 07:44:25.628080 | orchestrator | ok: [testbed-node-3] => (item=enable_prometheus_True) 2026-04-28 07:44:25.628091 | orchestrator | ok: [testbed-node-4] => (item=enable_prometheus_True) 2026-04-28 07:44:25.628102 | orchestrator | ok: [testbed-node-5] => (item=enable_prometheus_True) 2026-04-28 07:44:25.628112 | orchestrator | 2026-04-28 07:44:25.628145 | orchestrator | PLAY [Apply role prometheus] *************************************************** 2026-04-28 07:44:25.628157 | orchestrator | 2026-04-28 07:44:25.628167 | orchestrator | TASK [prometheus : include_tasks] ********************************************** 2026-04-28 07:44:25.628178 | orchestrator | Tuesday 28 April 2026 07:44:20 +0000 (0:00:01.397) 0:00:04.200 ********* 2026-04-28 07:44:25.628189 | orchestrator | included: /ansible/roles/prometheus/tasks/upgrade.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 07:44:25.628201 | orchestrator | 2026-04-28 07:44:25.628212 | orchestrator | TASK [prometheus : Ensuring config directories exist] ************************** 2026-04-28 07:44:25.628223 | orchestrator | Tuesday 28 April 2026 07:44:22 +0000 (0:00:02.031) 0:00:06.231 ********* 2026-04-28 07:44:25.628237 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:44:25.628267 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}}) 2026-04-28 07:44:25.628301 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:25.628316 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:44:25.628329 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:44:25.628350 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:25.628363 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:25.628376 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:44:25.628394 | orchestrator | ok: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:44:25.628407 | orchestrator | ok: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:44:25.628429 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:44:26.256816 | orchestrator | ok: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:44:26.256902 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:26.256938 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:44:26.256950 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:26.256978 | orchestrator | ok: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:44:26.256998 | orchestrator | ok: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:44:26.257043 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:44:26.257062 | orchestrator | ok: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:44:26.257082 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:26.257093 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:44:26.257105 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:26.257121 | orchestrator | ok: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 07:44:26.257133 | orchestrator | ok: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 07:44:26.257144 | orchestrator | ok: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 07:44:26.257163 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:31.300502 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:31.300583 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:44:31.300597 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:31.300607 | orchestrator | 2026-04-28 07:44:31.300618 | orchestrator | TASK [prometheus : include_tasks] ********************************************** 2026-04-28 07:44:31.300627 | orchestrator | Tuesday 28 April 2026 07:44:26 +0000 (0:00:04.636) 0:00:10.868 ********* 2026-04-28 07:44:31.300665 | orchestrator | included: /ansible/roles/prometheus/tasks/copy-certs.yml for testbed-manager, testbed-node-0, testbed-node-1, testbed-node-2, testbed-node-3, testbed-node-4, testbed-node-5 2026-04-28 07:44:31.300679 | orchestrator | 2026-04-28 07:44:31.300693 | orchestrator | TASK [service-cert-copy : prometheus | Copying over extra CA certificates] ***** 2026-04-28 07:44:31.300706 | orchestrator | Tuesday 28 April 2026 07:44:28 +0000 (0:00:01.777) 0:00:12.646 ********* 2026-04-28 07:44:31.300735 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}}) 2026-04-28 07:44:31.300753 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:44:31.300806 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:44:31.300818 | orchestrator | ok: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:44:31.300826 | orchestrator | ok: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:44:31.300834 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:44:31.300847 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:44:31.300856 | orchestrator | ok: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:44:31.300864 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:31.300879 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:31.300894 | orchestrator | ok: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:44:33.169488 | orchestrator | ok: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:44:33.169609 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:44:33.169629 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:33.169730 | orchestrator | ok: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:44:33.169744 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:33.169757 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:33.169791 | orchestrator | ok: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 07:44:33.169822 | orchestrator | ok: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 07:44:33.169838 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:44:33.169852 | orchestrator | ok: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 07:44:33.169869 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:33.169880 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:44:33.169900 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:44:33.169911 | orchestrator | ok: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:33.169933 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:44:35.537999 | orchestrator | ok: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:35.538166 | orchestrator | ok: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:35.538182 | orchestrator | ok: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:35.538194 | orchestrator | 2026-04-28 07:44:35.538207 | orchestrator | TASK [service-cert-copy : prometheus | Copying over backend internal TLS certificate] *** 2026-04-28 07:44:35.538219 | orchestrator | Tuesday 28 April 2026 07:44:34 +0000 (0:00:05.524) 0:00:18.171 ********* 2026-04-28 07:44:35.538276 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}})  2026-04-28 07:44:35.538314 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 07:44:35.538326 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 07:44:35.538357 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 07:44:35.538370 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:44:35.538387 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:44:35.538399 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:44:35.538419 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 07:44:35.538433 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:44:35.538446 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 07:44:35.538495 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 07:44:36.143075 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 07:44:36.143181 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:44:36.143200 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:44:36.143235 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:44:36.143272 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 07:44:36.143285 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:44:36.143296 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:44:36.143308 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:44:36.143338 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 07:44:36.143351 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:44:36.143368 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 07:44:36.143388 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:44:36.143408 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:44:36.143427 | orchestrator | skipping: [testbed-manager] 2026-04-28 07:44:36.143448 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 07:44:36.143468 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:44:36.143488 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:44:36.143508 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 07:44:36.143540 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 07:44:37.716785 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 07:44:37.716896 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 07:44:37.716928 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 07:44:37.716940 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:44:37.716952 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 07:44:37.716961 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:44:37.716970 | orchestrator | 2026-04-28 07:44:37.716980 | orchestrator | TASK [service-cert-copy : prometheus | Copying over backend internal TLS key] *** 2026-04-28 07:44:37.716990 | orchestrator | Tuesday 28 April 2026 07:44:36 +0000 (0:00:02.338) 0:00:20.509 ********* 2026-04-28 07:44:37.717001 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}})  2026-04-28 07:44:37.717027 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 07:44:37.717038 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 07:44:37.717055 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:44:37.717068 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:44:37.717078 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 07:44:37.717088 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 07:44:37.717097 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:44:37.717106 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:44:37.717121 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 07:44:38.467984 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 07:44:38.468150 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 07:44:38.468183 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:44:38.468209 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:44:38.468229 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 07:44:38.468250 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:44:38.468271 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:44:38.468320 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:44:38.468344 | orchestrator | skipping: [testbed-manager] 2026-04-28 07:44:38.468356 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 07:44:38.468374 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:44:38.468386 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:44:38.468398 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 07:44:38.468409 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:44:38.468420 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:44:38.468432 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 07:44:38.468443 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 07:44:38.468470 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 07:44:42.658450 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 07:44:42.658572 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:44:42.658591 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:44:42.658606 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 07:44:42.658618 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:44:42.658681 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 07:44:42.658696 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 07:44:42.658707 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:44:42.658718 | orchestrator | 2026-04-28 07:44:42.658730 | orchestrator | TASK [prometheus : Copying over config.json files] ***************************** 2026-04-28 07:44:42.658743 | orchestrator | Tuesday 28 April 2026 07:44:39 +0000 (0:00:03.101) 0:00:23.611 ********* 2026-04-28 07:44:42.658757 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}}) 2026-04-28 07:44:42.658814 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:44:42.658834 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:44:42.658846 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:44:42.658857 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:44:42.658869 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:44:42.658880 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:44:42.658900 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:44:42.658920 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:44.686846 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:44.686970 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:44:44.686989 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:44:44.687001 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:44.687012 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:44:44.687047 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:44:44.687059 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:44.687089 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:44.687107 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 07:44:44.687119 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 07:44:44.687130 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:44:44.687141 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 07:44:44.687155 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:44:44.687176 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:44:44.687194 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:45:10.212768 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:45:10.212868 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:45:10.212885 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:45:10.212898 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:45:10.212930 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:45:10.212944 | orchestrator | 2026-04-28 07:45:10.212957 | orchestrator | TASK [prometheus : Find custom prometheus alert rules files] ******************* 2026-04-28 07:45:10.212969 | orchestrator | Tuesday 28 April 2026 07:44:46 +0000 (0:00:06.763) 0:00:30.374 ********* 2026-04-28 07:45:10.212980 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-28 07:45:10.212992 | orchestrator | 2026-04-28 07:45:10.213004 | orchestrator | TASK [prometheus : Copying over custom prometheus alert rules files] *********** 2026-04-28 07:45:10.213014 | orchestrator | Tuesday 28 April 2026 07:44:47 +0000 (0:00:01.278) 0:00:31.653 ********* 2026-04-28 07:45:10.213025 | orchestrator | skipping: [testbed-manager] 2026-04-28 07:45:10.213036 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:45:10.213048 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:45:10.213058 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:45:10.213069 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:45:10.213080 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:45:10.213090 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:45:10.213101 | orchestrator | 2026-04-28 07:45:10.213112 | orchestrator | TASK [prometheus : Find prometheus common config overrides] ******************** 2026-04-28 07:45:10.213123 | orchestrator | Tuesday 28 April 2026 07:44:48 +0000 (0:00:00.945) 0:00:32.598 ********* 2026-04-28 07:45:10.213134 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-28 07:45:10.213145 | orchestrator | 2026-04-28 07:45:10.213156 | orchestrator | TASK [prometheus : Find prometheus host config overrides] ********************** 2026-04-28 07:45:10.213167 | orchestrator | Tuesday 28 April 2026 07:44:49 +0000 (0:00:00.865) 0:00:33.464 ********* 2026-04-28 07:45:10.213178 | orchestrator | [WARNING]: Skipped 2026-04-28 07:45:10.213190 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 07:45:10.213202 | orchestrator | manager/prometheus.yml.d' path due to this access issue: 2026-04-28 07:45:10.213213 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 07:45:10.213224 | orchestrator | manager/prometheus.yml.d' is not a directory 2026-04-28 07:45:10.213250 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-28 07:45:10.213269 | orchestrator | [WARNING]: Skipped 2026-04-28 07:45:10.213289 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 07:45:10.213316 | orchestrator | node-0/prometheus.yml.d' path due to this access issue: 2026-04-28 07:45:10.213335 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 07:45:10.213354 | orchestrator | node-0/prometheus.yml.d' is not a directory 2026-04-28 07:45:10.213375 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 07:45:10.213396 | orchestrator | [WARNING]: Skipped 2026-04-28 07:45:10.213416 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 07:45:10.213432 | orchestrator | node-1/prometheus.yml.d' path due to this access issue: 2026-04-28 07:45:10.213445 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 07:45:10.213466 | orchestrator | node-1/prometheus.yml.d' is not a directory 2026-04-28 07:45:10.213477 | orchestrator | ok: [testbed-node-1 -> localhost] 2026-04-28 07:45:10.213488 | orchestrator | [WARNING]: Skipped 2026-04-28 07:45:10.213499 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 07:45:10.213510 | orchestrator | node-3/prometheus.yml.d' path due to this access issue: 2026-04-28 07:45:10.213521 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 07:45:10.213531 | orchestrator | node-3/prometheus.yml.d' is not a directory 2026-04-28 07:45:10.213542 | orchestrator | ok: [testbed-node-3 -> localhost] 2026-04-28 07:45:10.213553 | orchestrator | [WARNING]: Skipped 2026-04-28 07:45:10.213564 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 07:45:10.213574 | orchestrator | node-4/prometheus.yml.d' path due to this access issue: 2026-04-28 07:45:10.213585 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 07:45:10.213596 | orchestrator | node-4/prometheus.yml.d' is not a directory 2026-04-28 07:45:10.213607 | orchestrator | ok: [testbed-node-4 -> localhost] 2026-04-28 07:45:10.213617 | orchestrator | [WARNING]: Skipped 2026-04-28 07:45:10.213650 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 07:45:10.213661 | orchestrator | node-2/prometheus.yml.d' path due to this access issue: 2026-04-28 07:45:10.213672 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 07:45:10.213683 | orchestrator | node-2/prometheus.yml.d' is not a directory 2026-04-28 07:45:10.213693 | orchestrator | ok: [testbed-node-2 -> localhost] 2026-04-28 07:45:10.213704 | orchestrator | [WARNING]: Skipped 2026-04-28 07:45:10.213715 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 07:45:10.213725 | orchestrator | node-5/prometheus.yml.d' path due to this access issue: 2026-04-28 07:45:10.213736 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/testbed- 2026-04-28 07:45:10.213746 | orchestrator | node-5/prometheus.yml.d' is not a directory 2026-04-28 07:45:10.213757 | orchestrator | ok: [testbed-node-5 -> localhost] 2026-04-28 07:45:10.213767 | orchestrator | 2026-04-28 07:45:10.213778 | orchestrator | TASK [prometheus : Copying over prometheus config file] ************************ 2026-04-28 07:45:10.213789 | orchestrator | Tuesday 28 April 2026 07:44:51 +0000 (0:00:01.983) 0:00:35.448 ********* 2026-04-28 07:45:10.213800 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-28 07:45:10.213811 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:45:10.213822 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-28 07:45:10.213833 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:45:10.213843 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-28 07:45:10.213854 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:45:10.213864 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-28 07:45:10.213875 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:45:10.213886 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-28 07:45:10.213896 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:45:10.213907 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2)  2026-04-28 07:45:10.213917 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:45:10.213928 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/prometheus/templates/prometheus.yml.j2) 2026-04-28 07:45:10.213939 | orchestrator | 2026-04-28 07:45:10.213950 | orchestrator | TASK [prometheus : Copying over prometheus web config file] ******************** 2026-04-28 07:45:10.213968 | orchestrator | Tuesday 28 April 2026 07:45:09 +0000 (0:00:17.669) 0:00:53.117 ********* 2026-04-28 07:45:10.213979 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-28 07:45:10.213989 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:45:10.214000 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-28 07:45:10.214099 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:45:10.214112 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-28 07:45:10.214123 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:45:10.214134 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-28 07:45:10.214145 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:45:10.214164 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-28 07:45:35.014598 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:45:35.014777 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2)  2026-04-28 07:45:35.014797 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:45:35.014810 | orchestrator | changed: [testbed-manager] => (item=/ansible/roles/prometheus/templates/prometheus-web.yml.j2) 2026-04-28 07:45:35.014821 | orchestrator | 2026-04-28 07:45:35.014833 | orchestrator | TASK [prometheus : Copying over prometheus alertmanager config file] *********** 2026-04-28 07:45:35.014845 | orchestrator | Tuesday 28 April 2026 07:45:11 +0000 (0:00:02.765) 0:00:55.883 ********* 2026-04-28 07:45:35.014856 | orchestrator | skipping: [testbed-node-0] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-28 07:45:35.014868 | orchestrator | skipping: [testbed-node-1] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-28 07:45:35.014879 | orchestrator | skipping: [testbed-node-2] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-28 07:45:35.014890 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:45:35.014900 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:45:35.014911 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:45:35.014922 | orchestrator | skipping: [testbed-node-3] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-28 07:45:35.014934 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:45:35.014945 | orchestrator | skipping: [testbed-node-4] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-28 07:45:35.014955 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:45:35.014966 | orchestrator | ok: [testbed-manager] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml) 2026-04-28 07:45:35.014977 | orchestrator | skipping: [testbed-node-5] => (item=/opt/configuration/environments/kolla/files/overlays/prometheus/prometheus-alertmanager.yml)  2026-04-28 07:45:35.014987 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:45:35.014998 | orchestrator | 2026-04-28 07:45:35.015009 | orchestrator | TASK [prometheus : Find custom Alertmanager alert notification templates] ****** 2026-04-28 07:45:35.015020 | orchestrator | Tuesday 28 April 2026 07:45:13 +0000 (0:00:01.596) 0:00:57.480 ********* 2026-04-28 07:45:35.015055 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-28 07:45:35.015067 | orchestrator | 2026-04-28 07:45:35.015078 | orchestrator | TASK [prometheus : Copying over custom Alertmanager alert notification templates] *** 2026-04-28 07:45:35.015091 | orchestrator | Tuesday 28 April 2026 07:45:14 +0000 (0:00:00.877) 0:00:58.358 ********* 2026-04-28 07:45:35.015101 | orchestrator | skipping: [testbed-manager] 2026-04-28 07:45:35.015112 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:45:35.015123 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:45:35.015158 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:45:35.015171 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:45:35.015184 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:45:35.015196 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:45:35.015208 | orchestrator | 2026-04-28 07:45:35.015221 | orchestrator | TASK [prometheus : Copying over my.cnf for mysqld_exporter] ******************** 2026-04-28 07:45:35.015233 | orchestrator | Tuesday 28 April 2026 07:45:15 +0000 (0:00:00.825) 0:00:59.183 ********* 2026-04-28 07:45:35.015246 | orchestrator | skipping: [testbed-manager] 2026-04-28 07:45:35.015258 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:45:35.015271 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:45:35.015283 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:45:35.015295 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:45:35.015309 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:45:35.015321 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:45:35.015334 | orchestrator | 2026-04-28 07:45:35.015346 | orchestrator | TASK [prometheus : Copying cloud config file for openstack exporter] *********** 2026-04-28 07:45:35.015359 | orchestrator | Tuesday 28 April 2026 07:45:17 +0000 (0:00:02.585) 0:01:01.768 ********* 2026-04-28 07:45:35.015371 | orchestrator | skipping: [testbed-manager] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-28 07:45:35.015384 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-28 07:45:35.015396 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-28 07:45:35.015408 | orchestrator | skipping: [testbed-manager] 2026-04-28 07:45:35.015421 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-28 07:45:35.015433 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:45:35.015445 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:45:35.015457 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:45:35.015470 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-28 07:45:35.015483 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:45:35.015495 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-28 07:45:35.015507 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:45:35.015518 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/clouds.yml.j2)  2026-04-28 07:45:35.015528 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:45:35.015539 | orchestrator | 2026-04-28 07:45:35.015550 | orchestrator | TASK [prometheus : Copying config file for blackbox exporter] ****************** 2026-04-28 07:45:35.015560 | orchestrator | Tuesday 28 April 2026 07:45:19 +0000 (0:00:01.617) 0:01:03.385 ********* 2026-04-28 07:45:35.015588 | orchestrator | skipping: [testbed-node-1] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-28 07:45:35.015607 | orchestrator | skipping: [testbed-node-0] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-28 07:45:35.015618 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:45:35.015648 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:45:35.015660 | orchestrator | skipping: [testbed-node-2] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-28 07:45:35.015671 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:45:35.015682 | orchestrator | skipping: [testbed-node-3] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-28 07:45:35.015693 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:45:35.015703 | orchestrator | skipping: [testbed-node-4] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-28 07:45:35.015714 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:45:35.015725 | orchestrator | skipping: [testbed-node-5] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2)  2026-04-28 07:45:35.015736 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:45:35.015754 | orchestrator | ok: [testbed-manager] => (item=/ansible/roles/prometheus/templates/prometheus-blackbox-exporter.yml.j2) 2026-04-28 07:45:35.015765 | orchestrator | 2026-04-28 07:45:35.015776 | orchestrator | TASK [prometheus : Find extra prometheus server config files] ****************** 2026-04-28 07:45:35.015787 | orchestrator | Tuesday 28 April 2026 07:45:20 +0000 (0:00:01.549) 0:01:04.934 ********* 2026-04-28 07:45:35.015798 | orchestrator | [WARNING]: Skipped 2026-04-28 07:45:35.015809 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/extras/' path 2026-04-28 07:45:35.015820 | orchestrator | due to this access issue: 2026-04-28 07:45:35.015831 | orchestrator | '/opt/configuration/environments/kolla/files/overlays/prometheus/extras/' is 2026-04-28 07:45:35.015841 | orchestrator | not a directory 2026-04-28 07:45:35.015852 | orchestrator | ok: [testbed-manager -> localhost] 2026-04-28 07:45:35.015862 | orchestrator | 2026-04-28 07:45:35.015873 | orchestrator | TASK [prometheus : Create subdirectories for extra config files] *************** 2026-04-28 07:45:35.015884 | orchestrator | Tuesday 28 April 2026 07:45:22 +0000 (0:00:01.640) 0:01:06.574 ********* 2026-04-28 07:45:35.015894 | orchestrator | skipping: [testbed-manager] 2026-04-28 07:45:35.015905 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:45:35.015916 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:45:35.015926 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:45:35.015937 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:45:35.015947 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:45:35.015958 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:45:35.015968 | orchestrator | 2026-04-28 07:45:35.015979 | orchestrator | TASK [prometheus : Template extra prometheus server config files] ************** 2026-04-28 07:45:35.015990 | orchestrator | Tuesday 28 April 2026 07:45:23 +0000 (0:00:00.808) 0:01:07.383 ********* 2026-04-28 07:45:35.016000 | orchestrator | skipping: [testbed-manager] 2026-04-28 07:45:35.016011 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:45:35.016022 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:45:35.016032 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:45:35.016043 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:45:35.016053 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:45:35.016064 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:45:35.016074 | orchestrator | 2026-04-28 07:45:35.016085 | orchestrator | TASK [prometheus : Check for the existence of Prometheus v2 container volume] *** 2026-04-28 07:45:35.016096 | orchestrator | Tuesday 28 April 2026 07:45:24 +0000 (0:00:01.357) 0:01:08.741 ********* 2026-04-28 07:45:35.016106 | orchestrator | ok: [testbed-manager] 2026-04-28 07:45:35.016117 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:45:35.016128 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:45:35.016138 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:45:35.016149 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:45:35.016159 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:45:35.016170 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:45:35.016180 | orchestrator | 2026-04-28 07:45:35.016191 | orchestrator | TASK [prometheus : Gracefully stop Prometheus] ********************************* 2026-04-28 07:45:35.016202 | orchestrator | Tuesday 28 April 2026 07:45:26 +0000 (0:00:01.351) 0:01:10.093 ********* 2026-04-28 07:45:35.016212 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:45:35.016223 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:45:35.016234 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:45:35.016244 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:45:35.016255 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:45:35.016265 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:45:35.016276 | orchestrator | changed: [testbed-manager] 2026-04-28 07:45:35.016286 | orchestrator | 2026-04-28 07:45:35.016297 | orchestrator | TASK [prometheus : Create new Prometheus v3 volume] **************************** 2026-04-28 07:45:35.016308 | orchestrator | Tuesday 28 April 2026 07:45:33 +0000 (0:00:07.013) 0:01:17.106 ********* 2026-04-28 07:45:35.016319 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:45:35.016329 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:45:35.016346 | orchestrator | changed: [testbed-manager] 2026-04-28 07:45:35.016356 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:45:35.016366 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:45:35.016377 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:45:35.016387 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:45:35.016398 | orchestrator | 2026-04-28 07:45:35.016409 | orchestrator | TASK [prometheus : Move _data from old to new volume] ************************** 2026-04-28 07:45:35.016419 | orchestrator | Tuesday 28 April 2026 07:45:34 +0000 (0:00:00.999) 0:01:18.105 ********* 2026-04-28 07:45:35.016430 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:45:35.016440 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:45:35.016451 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:45:35.016461 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:45:35.016472 | orchestrator | changed: [testbed-manager] 2026-04-28 07:45:35.016482 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:45:35.016493 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:45:35.016503 | orchestrator | 2026-04-28 07:45:35.016514 | orchestrator | TASK [prometheus : Remove old Prometheus v2 volume] **************************** 2026-04-28 07:45:35.016532 | orchestrator | Tuesday 28 April 2026 07:45:35 +0000 (0:00:00.977) 0:01:19.083 ********* 2026-04-28 07:45:39.078998 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:45:39.079093 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:45:39.079106 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:45:39.079117 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:45:39.079126 | orchestrator | changed: [testbed-manager] 2026-04-28 07:45:39.079134 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:45:39.079143 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:45:39.079151 | orchestrator | 2026-04-28 07:45:39.079162 | orchestrator | TASK [service-check-containers : prometheus | Check containers] **************** 2026-04-28 07:45:39.079171 | orchestrator | Tuesday 28 April 2026 07:45:36 +0000 (0:00:01.214) 0:01:20.297 ********* 2026-04-28 07:45:39.079185 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}}) 2026-04-28 07:45:39.079199 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:45:39.079209 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:45:39.079238 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:45:39.079248 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:45:39.079277 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:45:39.079288 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:45:39.079297 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}}) 2026-04-28 07:45:39.079306 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:45:39.079316 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:45:39.079334 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:45:39.079344 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:45:39.079353 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:45:39.079374 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:45:41.648273 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:45:41.648371 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:45:41.648404 | orchestrator | changed: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 07:45:41.648413 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:45:41.648421 | orchestrator | changed: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 07:45:41.648428 | orchestrator | changed: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}}) 2026-04-28 07:45:41.648460 | orchestrator | changed: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:45:41.648469 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:45:41.648476 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:45:41.648483 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:45:41.648497 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:45:41.648504 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}}) 2026-04-28 07:45:41.648511 | orchestrator | changed: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:45:41.648523 | orchestrator | changed: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:45:41.648536 | orchestrator | changed: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}}) 2026-04-28 07:45:43.611247 | orchestrator | 2026-04-28 07:45:43.611379 | orchestrator | TASK [service-check-containers : prometheus | Notify handlers to restart containers] *** 2026-04-28 07:45:43.611406 | orchestrator | Tuesday 28 April 2026 07:45:41 +0000 (0:00:05.575) 0:01:25.873 ********* 2026-04-28 07:45:43.611426 | orchestrator | changed: [testbed-manager] => { 2026-04-28 07:45:43.611445 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:45:43.611466 | orchestrator | } 2026-04-28 07:45:43.611485 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 07:45:43.611503 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:45:43.611516 | orchestrator | } 2026-04-28 07:45:43.611527 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 07:45:43.611538 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:45:43.611549 | orchestrator | } 2026-04-28 07:45:43.611588 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 07:45:43.611599 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:45:43.611610 | orchestrator | } 2026-04-28 07:45:43.611620 | orchestrator | changed: [testbed-node-3] => { 2026-04-28 07:45:43.611670 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:45:43.611682 | orchestrator | } 2026-04-28 07:45:43.611693 | orchestrator | changed: [testbed-node-4] => { 2026-04-28 07:45:43.611703 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:45:43.611714 | orchestrator | } 2026-04-28 07:45:43.611724 | orchestrator | changed: [testbed-node-5] => { 2026-04-28 07:45:43.611735 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:45:43.611748 | orchestrator | } 2026-04-28 07:45:43.611760 | orchestrator | 2026-04-28 07:45:43.611773 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 07:45:43.611785 | orchestrator | Tuesday 28 April 2026 07:45:42 +0000 (0:00:01.114) 0:01:26.987 ********* 2026-04-28 07:45:43.611801 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 07:45:43.611822 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-server', 'value': {'container_name': 'prometheus_server', 'group': 'prometheus', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328', 'volumes': ['/etc/kolla/prometheus-server/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'prometheus_server:/var/lib/prometheus', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'prometheus_server': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}, 'prometheus_server_external': {'enabled': False, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9091', 'listen_port': '9091', 'active_passive': True, 'backend_http_extra': ['option httpchk GET /-/ready HTTP/1.0', "http-check send hdr Authorization 'Basic aGFwcm94eTptdWVNaWV4aWUzYW5nb28wZnVjaGFod2VlUXVhaEpvbw=='"]}}}})  2026-04-28 07:45:43.611838 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:45:43.611868 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 07:45:43.611906 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:45:43.611932 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 07:45:43.611945 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 07:45:43.611959 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:45:43.611973 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-alertmanager', 'value': {'container_name': 'prometheus_alertmanager', 'group': 'prometheus-alertmanager', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328', 'volumes': ['/etc/kolla/prometheus-alertmanager/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', 'prometheus:/var/lib/prometheus'], 'dimensions': {}, 'haproxy': {'prometheus_alertmanager': {'enabled': True, 'mode': 'http', 'external': False, 'port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}, 'prometheus_alertmanager_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9093', 'listen_port': '9093', 'auth_user': 'admin', 'auth_pass': 'BXo64rLqmF7bTbWLDOnNJlD0qJ4BSTWocNHVNKU2', 'active_passive': True, 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:45:43.611991 | orchestrator | skipping: [testbed-manager] => (item={'key': 'prometheus-blackbox-exporter', 'value': {'cap_add': ['CAP_NET_RAW'], 'container_name': 'prometheus_blackbox_exporter', 'group': 'prometheus-blackbox-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328', 'volumes': ['/etc/kolla/prometheus-blackbox-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:45:43.612002 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 07:45:43.612029 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:45:44.183702 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:45:44.183783 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 07:45:44.183794 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:45:44.183804 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:45:44.183812 | orchestrator | skipping: [testbed-manager] 2026-04-28 07:45:44.183820 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:45:44.183827 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 07:45:44.183835 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-mysqld-exporter', 'value': {'container_name': 'prometheus_mysqld_exporter', 'group': 'prometheus-mysqld-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328', 'volumes': ['/etc/kolla/prometheus-mysqld-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:45:44.183864 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-memcached-exporter', 'value': {'container_name': 'prometheus_memcached_exporter', 'group': 'prometheus-memcached-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328', 'volumes': ['/etc/kolla/prometheus-memcached-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:45:44.183890 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 07:45:44.183911 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'prometheus-elasticsearch-exporter', 'value': {'container_name': 'prometheus_elasticsearch_exporter', 'group': 'prometheus-elasticsearch-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328', 'volumes': ['/etc/kolla/prometheus-elasticsearch-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}}})  2026-04-28 07:45:44.183920 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:45:44.183927 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 07:45:44.183935 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 07:45:44.183942 | orchestrator | skipping: [testbed-node-3] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 07:45:44.184002 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:45:44.184010 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 07:45:44.184045 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 07:45:44.184060 | orchestrator | skipping: [testbed-node-4] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 07:45:44.184068 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:45:44.184082 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-node-exporter', 'value': {'container_name': 'prometheus_node_exporter', 'group': 'prometheus-node-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'pid_mode': 'host', 'volumes': ['/etc/kolla/prometheus-node-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/host:ro,rslave'], 'dimensions': {}}})  2026-04-28 07:47:56.137803 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-cadvisor', 'value': {'container_name': 'prometheus_cadvisor', 'group': 'prometheus-cadvisor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'volumes': ['/etc/kolla/prometheus-cadvisor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/', '/:/rootfs:ro', '/var/run:/var/run:rw', '/sys:/sys:ro', '/var/lib/docker/:/var/lib/docker:ro', '/dev/disk/:/dev/disk:ro'], 'dimensions': {}}})  2026-04-28 07:47:56.137947 | orchestrator | skipping: [testbed-node-5] => (item={'key': 'prometheus-libvirt-exporter', 'value': {'container_name': 'prometheus_libvirt_exporter', 'group': 'prometheus-libvirt-exporter', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'volumes': ['/etc/kolla/prometheus-libvirt-exporter/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '/run/libvirt:/run/libvirt:ro'], 'dimensions': {}}})  2026-04-28 07:47:56.137964 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:47:56.137978 | orchestrator | 2026-04-28 07:47:56.137991 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-28 07:47:56.138003 | orchestrator | Tuesday 28 April 2026 07:45:45 +0000 (0:00:02.195) 0:01:29.183 ********* 2026-04-28 07:47:56.138052 | orchestrator | 2026-04-28 07:47:56.138066 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-28 07:47:56.138077 | orchestrator | Tuesday 28 April 2026 07:45:45 +0000 (0:00:00.073) 0:01:29.257 ********* 2026-04-28 07:47:56.138088 | orchestrator | 2026-04-28 07:47:56.138099 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-28 07:47:56.138110 | orchestrator | Tuesday 28 April 2026 07:45:45 +0000 (0:00:00.078) 0:01:29.335 ********* 2026-04-28 07:47:56.138120 | orchestrator | 2026-04-28 07:47:56.138131 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-28 07:47:56.138142 | orchestrator | Tuesday 28 April 2026 07:45:45 +0000 (0:00:00.084) 0:01:29.419 ********* 2026-04-28 07:47:56.138152 | orchestrator | 2026-04-28 07:47:56.138163 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-28 07:47:56.138173 | orchestrator | Tuesday 28 April 2026 07:45:45 +0000 (0:00:00.081) 0:01:29.501 ********* 2026-04-28 07:47:56.138185 | orchestrator | 2026-04-28 07:47:56.138196 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-28 07:47:56.138231 | orchestrator | Tuesday 28 April 2026 07:45:45 +0000 (0:00:00.082) 0:01:29.584 ********* 2026-04-28 07:47:56.138243 | orchestrator | 2026-04-28 07:47:56.138254 | orchestrator | TASK [prometheus : Flush handlers] ********************************************* 2026-04-28 07:47:56.138264 | orchestrator | Tuesday 28 April 2026 07:45:45 +0000 (0:00:00.358) 0:01:29.943 ********* 2026-04-28 07:47:56.138275 | orchestrator | 2026-04-28 07:47:56.138286 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-server container] ************* 2026-04-28 07:47:56.138296 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-28 07:47:56.138308 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-28 07:47:56.138329 | orchestrator | Tuesday 28 April 2026 07:45:45 +0000 (0:00:00.103) 0:01:30.046 ********* 2026-04-28 07:47:56.138352 | orchestrator | changed: [testbed-manager] 2026-04-28 07:47:56.138366 | orchestrator | 2026-04-28 07:47:56.138379 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-node-exporter container] ****** 2026-04-28 07:47:56.138390 | orchestrator | Tuesday 28 April 2026 07:46:08 +0000 (0:00:22.390) 0:01:52.436 ********* 2026-04-28 07:47:56.138403 | orchestrator | changed: [testbed-manager] 2026-04-28 07:47:56.138415 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:47:56.138428 | orchestrator | changed: [testbed-node-3] 2026-04-28 07:47:56.138440 | orchestrator | changed: [testbed-node-4] 2026-04-28 07:47:56.138452 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:47:56.138464 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:47:56.138476 | orchestrator | changed: [testbed-node-5] 2026-04-28 07:47:56.138487 | orchestrator | 2026-04-28 07:47:56.138500 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-mysqld-exporter container] **** 2026-04-28 07:47:56.138512 | orchestrator | Tuesday 28 April 2026 07:46:25 +0000 (0:00:17.333) 0:02:09.769 ********* 2026-04-28 07:47:56.138524 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:47:56.138536 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:47:56.138548 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:47:56.138560 | orchestrator | 2026-04-28 07:47:56.138573 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-memcached-exporter container] *** 2026-04-28 07:47:56.138585 | orchestrator | Tuesday 28 April 2026 07:46:37 +0000 (0:00:12.185) 0:02:21.955 ********* 2026-04-28 07:47:56.138597 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:47:56.138609 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:47:56.138623 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:47:56.138635 | orchestrator | 2026-04-28 07:47:56.138647 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-cadvisor container] *********** 2026-04-28 07:47:56.138659 | orchestrator | Tuesday 28 April 2026 07:46:49 +0000 (0:00:11.753) 0:02:33.708 ********* 2026-04-28 07:47:56.138671 | orchestrator | changed: [testbed-manager] 2026-04-28 07:47:56.138683 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:47:56.138696 | orchestrator | changed: [testbed-node-4] 2026-04-28 07:47:56.138708 | orchestrator | changed: [testbed-node-3] 2026-04-28 07:47:56.138720 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:47:56.138732 | orchestrator | changed: [testbed-node-5] 2026-04-28 07:47:56.138761 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:47:56.138772 | orchestrator | 2026-04-28 07:47:56.138784 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-alertmanager container] ******* 2026-04-28 07:47:56.138794 | orchestrator | Tuesday 28 April 2026 07:47:05 +0000 (0:00:15.927) 0:02:49.636 ********* 2026-04-28 07:47:56.138805 | orchestrator | changed: [testbed-manager] 2026-04-28 07:47:56.138816 | orchestrator | 2026-04-28 07:47:56.138827 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-elasticsearch-exporter container] *** 2026-04-28 07:47:56.138837 | orchestrator | Tuesday 28 April 2026 07:47:19 +0000 (0:00:14.185) 0:03:03.822 ********* 2026-04-28 07:47:56.138848 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:47:56.138859 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:47:56.138895 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:47:56.138907 | orchestrator | 2026-04-28 07:47:56.138918 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-blackbox-exporter container] *** 2026-04-28 07:47:56.138929 | orchestrator | Tuesday 28 April 2026 07:47:31 +0000 (0:00:11.895) 0:03:15.718 ********* 2026-04-28 07:47:56.138939 | orchestrator | changed: [testbed-manager] 2026-04-28 07:47:56.138950 | orchestrator | 2026-04-28 07:47:56.138961 | orchestrator | RUNNING HANDLER [prometheus : Restart prometheus-libvirt-exporter container] *** 2026-04-28 07:47:56.138972 | orchestrator | Tuesday 28 April 2026 07:47:43 +0000 (0:00:11.425) 0:03:27.143 ********* 2026-04-28 07:47:56.138982 | orchestrator | changed: [testbed-node-3] 2026-04-28 07:47:56.138993 | orchestrator | changed: [testbed-node-4] 2026-04-28 07:47:56.139004 | orchestrator | changed: [testbed-node-5] 2026-04-28 07:47:56.139014 | orchestrator | 2026-04-28 07:47:56.139025 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 07:47:56.139036 | orchestrator | testbed-manager : ok=28  changed=14  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-28 07:47:56.139049 | orchestrator | testbed-node-0 : ok=17  changed=8  unreachable=0 failed=0 skipped=16  rescued=0 ignored=0 2026-04-28 07:47:56.139060 | orchestrator | testbed-node-1 : ok=17  changed=8  unreachable=0 failed=0 skipped=16  rescued=0 ignored=0 2026-04-28 07:47:56.139070 | orchestrator | testbed-node-2 : ok=17  changed=8  unreachable=0 failed=0 skipped=16  rescued=0 ignored=0 2026-04-28 07:47:56.139081 | orchestrator | testbed-node-3 : ok=14  changed=6  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-28 07:47:56.139092 | orchestrator | testbed-node-4 : ok=14  changed=6  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-28 07:47:56.139102 | orchestrator | testbed-node-5 : ok=14  changed=6  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-28 07:47:56.139113 | orchestrator | 2026-04-28 07:47:56.139124 | orchestrator | 2026-04-28 07:47:56.139135 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 07:47:56.139146 | orchestrator | Tuesday 28 April 2026 07:47:55 +0000 (0:00:12.627) 0:03:39.770 ********* 2026-04-28 07:47:56.139157 | orchestrator | =============================================================================== 2026-04-28 07:47:56.139168 | orchestrator | prometheus : Restart prometheus-server container ----------------------- 22.39s 2026-04-28 07:47:56.139179 | orchestrator | prometheus : Copying over prometheus config file ----------------------- 17.67s 2026-04-28 07:47:56.139189 | orchestrator | prometheus : Restart prometheus-node-exporter container ---------------- 17.33s 2026-04-28 07:47:56.139205 | orchestrator | prometheus : Restart prometheus-cadvisor container --------------------- 15.93s 2026-04-28 07:47:56.139216 | orchestrator | prometheus : Restart prometheus-alertmanager container ----------------- 14.19s 2026-04-28 07:47:56.139226 | orchestrator | prometheus : Restart prometheus-libvirt-exporter container ------------- 12.63s 2026-04-28 07:47:56.139237 | orchestrator | prometheus : Restart prometheus-mysqld-exporter container -------------- 12.19s 2026-04-28 07:47:56.139248 | orchestrator | prometheus : Restart prometheus-elasticsearch-exporter container ------- 11.90s 2026-04-28 07:47:56.139259 | orchestrator | prometheus : Restart prometheus-memcached-exporter container ----------- 11.75s 2026-04-28 07:47:56.139269 | orchestrator | prometheus : Restart prometheus-blackbox-exporter container ------------ 11.43s 2026-04-28 07:47:56.139280 | orchestrator | prometheus : Gracefully stop Prometheus --------------------------------- 7.01s 2026-04-28 07:47:56.139291 | orchestrator | prometheus : Copying over config.json files ----------------------------- 6.76s 2026-04-28 07:47:56.139302 | orchestrator | service-check-containers : prometheus | Check containers ---------------- 5.58s 2026-04-28 07:47:56.139319 | orchestrator | service-cert-copy : prometheus | Copying over extra CA certificates ----- 5.52s 2026-04-28 07:47:56.139330 | orchestrator | prometheus : Ensuring config directories exist -------------------------- 4.64s 2026-04-28 07:47:56.139340 | orchestrator | service-cert-copy : prometheus | Copying over backend internal TLS key --- 3.10s 2026-04-28 07:47:56.139351 | orchestrator | prometheus : Copying over prometheus web config file -------------------- 2.77s 2026-04-28 07:47:56.139362 | orchestrator | prometheus : Copying over my.cnf for mysqld_exporter -------------------- 2.59s 2026-04-28 07:47:56.139373 | orchestrator | service-cert-copy : prometheus | Copying over backend internal TLS certificate --- 2.34s 2026-04-28 07:47:56.139384 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.20s 2026-04-28 07:47:57.651850 | orchestrator | 2026-04-28 07:47:57 | INFO  | Prepare task for execution of grafana. 2026-04-28 07:47:57.725396 | orchestrator | 2026-04-28 07:47:57 | INFO  | Task 73ce6cd1-6dd5-49fd-a528-043fdcf433ac (grafana) was prepared for execution. 2026-04-28 07:47:57.725486 | orchestrator | 2026-04-28 07:47:57 | INFO  | It takes a moment until task 73ce6cd1-6dd5-49fd-a528-043fdcf433ac (grafana) has been started and output is visible here. 2026-04-28 07:48:20.958190 | orchestrator | 2026-04-28 07:48:20.958307 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 07:48:20.958324 | orchestrator | 2026-04-28 07:48:20.958337 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 07:48:20.958348 | orchestrator | Tuesday 28 April 2026 07:48:02 +0000 (0:00:01.533) 0:00:01.533 ********* 2026-04-28 07:48:20.958359 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:48:20.958371 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:48:20.958382 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:48:20.958393 | orchestrator | 2026-04-28 07:48:20.958404 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 07:48:20.958414 | orchestrator | Tuesday 28 April 2026 07:48:04 +0000 (0:00:01.755) 0:00:03.288 ********* 2026-04-28 07:48:20.958425 | orchestrator | ok: [testbed-node-0] => (item=enable_grafana_True) 2026-04-28 07:48:20.958436 | orchestrator | ok: [testbed-node-1] => (item=enable_grafana_True) 2026-04-28 07:48:20.958447 | orchestrator | ok: [testbed-node-2] => (item=enable_grafana_True) 2026-04-28 07:48:20.958458 | orchestrator | 2026-04-28 07:48:20.958468 | orchestrator | PLAY [Apply role grafana] ****************************************************** 2026-04-28 07:48:20.958479 | orchestrator | 2026-04-28 07:48:20.958490 | orchestrator | TASK [grafana : include_tasks] ************************************************* 2026-04-28 07:48:20.958501 | orchestrator | Tuesday 28 April 2026 07:48:06 +0000 (0:00:01.963) 0:00:05.252 ********* 2026-04-28 07:48:20.958512 | orchestrator | included: /ansible/roles/grafana/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:48:20.958523 | orchestrator | 2026-04-28 07:48:20.958534 | orchestrator | TASK [grafana : Checking if Grafana container needs upgrading] ***************** 2026-04-28 07:48:20.958544 | orchestrator | Tuesday 28 April 2026 07:48:09 +0000 (0:00:03.125) 0:00:08.377 ********* 2026-04-28 07:48:20.958555 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:48:20.958566 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:48:20.958576 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:48:20.958587 | orchestrator | 2026-04-28 07:48:20.958597 | orchestrator | TASK [grafana : Ensuring config directories exist] ***************************** 2026-04-28 07:48:20.958608 | orchestrator | Tuesday 28 April 2026 07:48:12 +0000 (0:00:02.770) 0:00:11.148 ********* 2026-04-28 07:48:20.958622 | orchestrator | ok: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:48:20.958675 | orchestrator | ok: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:48:20.958691 | orchestrator | ok: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:48:20.958704 | orchestrator | 2026-04-28 07:48:20.958716 | orchestrator | TASK [grafana : Check if extra configuration file exists] ********************** 2026-04-28 07:48:20.958730 | orchestrator | Tuesday 28 April 2026 07:48:13 +0000 (0:00:01.775) 0:00:12.924 ********* 2026-04-28 07:48:20.958743 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 07:48:20.958756 | orchestrator | 2026-04-28 07:48:20.958770 | orchestrator | TASK [grafana : include_tasks] ************************************************* 2026-04-28 07:48:20.958800 | orchestrator | Tuesday 28 April 2026 07:48:16 +0000 (0:00:02.406) 0:00:15.331 ********* 2026-04-28 07:48:20.958814 | orchestrator | included: /ansible/roles/grafana/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:48:20.958826 | orchestrator | 2026-04-28 07:48:20.958839 | orchestrator | TASK [service-cert-copy : grafana | Copying over extra CA certificates] ******** 2026-04-28 07:48:20.958850 | orchestrator | Tuesday 28 April 2026 07:48:18 +0000 (0:00:01.933) 0:00:17.264 ********* 2026-04-28 07:48:20.958863 | orchestrator | ok: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:48:20.958877 | orchestrator | ok: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:48:20.958903 | orchestrator | ok: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:48:20.958916 | orchestrator | 2026-04-28 07:48:20.958928 | orchestrator | TASK [service-cert-copy : grafana | Copying over backend internal TLS certificate] *** 2026-04-28 07:48:20.958978 | orchestrator | Tuesday 28 April 2026 07:48:20 +0000 (0:00:02.310) 0:00:19.574 ********* 2026-04-28 07:48:20.958992 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:48:20.959005 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:48:20.959030 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:48:27.714397 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:48:27.714504 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:48:27.714522 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:48:27.714534 | orchestrator | 2026-04-28 07:48:27.714570 | orchestrator | TASK [service-cert-copy : grafana | Copying over backend internal TLS key] ***** 2026-04-28 07:48:27.714583 | orchestrator | Tuesday 28 April 2026 07:48:22 +0000 (0:00:01.494) 0:00:21.069 ********* 2026-04-28 07:48:27.714594 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:48:27.714606 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:48:27.714631 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:48:27.714644 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:48:27.714655 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:48:27.714666 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:48:27.714676 | orchestrator | 2026-04-28 07:48:27.714688 | orchestrator | TASK [grafana : Copying over config.json files] ******************************** 2026-04-28 07:48:27.714699 | orchestrator | Tuesday 28 April 2026 07:48:23 +0000 (0:00:01.735) 0:00:22.804 ********* 2026-04-28 07:48:27.714729 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:48:27.714742 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:48:27.714762 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:48:27.714774 | orchestrator | 2026-04-28 07:48:27.714785 | orchestrator | TASK [grafana : Copying over grafana.ini] ************************************** 2026-04-28 07:48:27.714800 | orchestrator | Tuesday 28 April 2026 07:48:26 +0000 (0:00:02.377) 0:00:25.181 ********* 2026-04-28 07:48:27.714812 | orchestrator | ok: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:48:27.714825 | orchestrator | ok: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:48:27.714845 | orchestrator | ok: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:48:54.000470 | orchestrator | 2026-04-28 07:48:54.000621 | orchestrator | TASK [grafana : Copying over extra configuration file] ************************* 2026-04-28 07:48:54.000640 | orchestrator | Tuesday 28 April 2026 07:48:28 +0000 (0:00:02.573) 0:00:27.755 ********* 2026-04-28 07:48:54.000652 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:48:54.000665 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:48:54.000676 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:48:54.000687 | orchestrator | 2026-04-28 07:48:54.000699 | orchestrator | TASK [grafana : Configuring Prometheus as data source for Grafana] ************* 2026-04-28 07:48:54.000710 | orchestrator | Tuesday 28 April 2026 07:48:30 +0000 (0:00:01.353) 0:00:29.108 ********* 2026-04-28 07:48:54.000721 | orchestrator | ok: [testbed-node-0] => (item=/ansible/roles/grafana/templates/prometheus.yaml.j2) 2026-04-28 07:48:54.000732 | orchestrator | ok: [testbed-node-1] => (item=/ansible/roles/grafana/templates/prometheus.yaml.j2) 2026-04-28 07:48:54.000743 | orchestrator | ok: [testbed-node-2] => (item=/ansible/roles/grafana/templates/prometheus.yaml.j2) 2026-04-28 07:48:54.000754 | orchestrator | 2026-04-28 07:48:54.000765 | orchestrator | TASK [grafana : Configuring dashboards provisioning] *************************** 2026-04-28 07:48:54.000775 | orchestrator | Tuesday 28 April 2026 07:48:32 +0000 (0:00:02.265) 0:00:31.374 ********* 2026-04-28 07:48:54.000786 | orchestrator | ok: [testbed-node-0] => (item=/opt/configuration/environments/kolla/files/overlays/grafana/provisioning.yaml) 2026-04-28 07:48:54.000797 | orchestrator | ok: [testbed-node-1] => (item=/opt/configuration/environments/kolla/files/overlays/grafana/provisioning.yaml) 2026-04-28 07:48:54.000808 | orchestrator | ok: [testbed-node-2] => (item=/opt/configuration/environments/kolla/files/overlays/grafana/provisioning.yaml) 2026-04-28 07:48:54.000819 | orchestrator | 2026-04-28 07:48:54.000830 | orchestrator | TASK [grafana : Check if the folder for custom grafana dashboards exists] ****** 2026-04-28 07:48:54.000841 | orchestrator | Tuesday 28 April 2026 07:48:34 +0000 (0:00:02.312) 0:00:33.686 ********* 2026-04-28 07:48:54.000851 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 07:48:54.000862 | orchestrator | 2026-04-28 07:48:54.000873 | orchestrator | TASK [grafana : Remove templated Grafana dashboards] *************************** 2026-04-28 07:48:54.000884 | orchestrator | Tuesday 28 April 2026 07:48:36 +0000 (0:00:01.773) 0:00:35.460 ********* 2026-04-28 07:48:54.000894 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:48:54.000905 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:48:54.000916 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:48:54.000927 | orchestrator | 2026-04-28 07:48:54.000953 | orchestrator | TASK [grafana : Copying over custom dashboards] ******************************** 2026-04-28 07:48:54.000967 | orchestrator | Tuesday 28 April 2026 07:48:38 +0000 (0:00:02.014) 0:00:37.475 ********* 2026-04-28 07:48:54.000980 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:48:54.000993 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:48:54.001006 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:48:54.001019 | orchestrator | 2026-04-28 07:48:54.001059 | orchestrator | TASK [service-check-containers : grafana | Check containers] ******************* 2026-04-28 07:48:54.001073 | orchestrator | Tuesday 28 April 2026 07:48:41 +0000 (0:00:02.585) 0:00:40.061 ********* 2026-04-28 07:48:54.001089 | orchestrator | changed: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:48:54.001107 | orchestrator | changed: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:48:54.001152 | orchestrator | changed: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:48:54.001165 | orchestrator | 2026-04-28 07:48:54.001176 | orchestrator | TASK [service-check-containers : grafana | Notify handlers to restart containers] *** 2026-04-28 07:48:54.001187 | orchestrator | Tuesday 28 April 2026 07:48:43 +0000 (0:00:02.300) 0:00:42.361 ********* 2026-04-28 07:48:54.001198 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 07:48:54.001208 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:48:54.001220 | orchestrator | } 2026-04-28 07:48:54.001231 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 07:48:54.001241 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:48:54.001252 | orchestrator | } 2026-04-28 07:48:54.001263 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 07:48:54.001273 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:48:54.001284 | orchestrator | } 2026-04-28 07:48:54.001295 | orchestrator | 2026-04-28 07:48:54.001306 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 07:48:54.001316 | orchestrator | Tuesday 28 April 2026 07:48:44 +0000 (0:00:01.388) 0:00:43.749 ********* 2026-04-28 07:48:54.001333 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:48:54.001345 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:48:54.001356 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:48:54.001375 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:48:54.001386 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'grafana', 'value': {'container_name': 'grafana', 'group': 'grafana', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328', 'volumes': ['/etc/kolla/grafana/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'haproxy': {'grafana_server': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}, 'grafana_server_external': {'enabled': True, 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '3000', 'listen_port': '3000', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:48:54.001397 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:48:54.001408 | orchestrator | 2026-04-28 07:48:54.001419 | orchestrator | TASK [grafana : Stopping all Grafana instances but the first node] ************* 2026-04-28 07:48:54.001430 | orchestrator | Tuesday 28 April 2026 07:48:46 +0000 (0:00:01.453) 0:00:45.202 ********* 2026-04-28 07:48:54.001440 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:48:54.001451 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:48:54.001462 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:48:54.001473 | orchestrator | 2026-04-28 07:48:54.001483 | orchestrator | TASK [grafana : Flush handlers] ************************************************ 2026-04-28 07:48:54.001494 | orchestrator | Tuesday 28 April 2026 07:48:53 +0000 (0:00:07.037) 0:00:52.240 ********* 2026-04-28 07:48:54.001505 | orchestrator | 2026-04-28 07:48:54.001515 | orchestrator | TASK [grafana : Flush handlers] ************************************************ 2026-04-28 07:48:54.001526 | orchestrator | Tuesday 28 April 2026 07:48:53 +0000 (0:00:00.420) 0:00:52.661 ********* 2026-04-28 07:48:54.001537 | orchestrator | 2026-04-28 07:48:54.001673 | orchestrator | TASK [grafana : Flush handlers] ************************************************ 2026-04-28 07:50:37.999095 | orchestrator | Tuesday 28 April 2026 07:48:54 +0000 (0:00:00.656) 0:00:53.317 ********* 2026-04-28 07:50:37.999211 | orchestrator | 2026-04-28 07:50:37.999228 | orchestrator | RUNNING HANDLER [grafana : Restart first grafana container] ******************** 2026-04-28 07:50:37.999240 | orchestrator | Tuesday 28 April 2026 07:48:55 +0000 (0:00:00.771) 0:00:54.088 ********* 2026-04-28 07:50:37.999251 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:50:37.999264 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:50:37.999373 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:50:37.999388 | orchestrator | 2026-04-28 07:50:37.999400 | orchestrator | RUNNING HANDLER [grafana : Waiting for grafana to start on first node] ********* 2026-04-28 07:50:37.999411 | orchestrator | Tuesday 28 April 2026 07:49:32 +0000 (0:00:37.560) 0:01:31.649 ********* 2026-04-28 07:50:37.999422 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:50:37.999433 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:50:37.999445 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Waiting for grafana to start on first node (12 retries left). 2026-04-28 07:50:37.999457 | orchestrator | FAILED - RETRYING: [testbed-node-0]: Waiting for grafana to start on first node (11 retries left). 2026-04-28 07:50:37.999468 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:50:37.999480 | orchestrator | 2026-04-28 07:50:37.999491 | orchestrator | RUNNING HANDLER [grafana : Restart remaining grafana containers] *************** 2026-04-28 07:50:37.999503 | orchestrator | Tuesday 28 April 2026 07:49:59 +0000 (0:00:27.200) 0:01:58.849 ********* 2026-04-28 07:50:37.999513 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:50:37.999525 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:50:37.999536 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:50:37.999546 | orchestrator | 2026-04-28 07:50:37.999557 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 07:50:37.999569 | orchestrator | testbed-node-0 : ok=19  changed=6  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 07:50:37.999609 | orchestrator | testbed-node-1 : ok=17  changed=7  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 07:50:37.999621 | orchestrator | testbed-node-2 : ok=17  changed=7  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 07:50:37.999632 | orchestrator | 2026-04-28 07:50:37.999643 | orchestrator | 2026-04-28 07:50:37.999670 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 07:50:37.999683 | orchestrator | Tuesday 28 April 2026 07:50:37 +0000 (0:00:37.774) 0:02:36.623 ********* 2026-04-28 07:50:37.999695 | orchestrator | =============================================================================== 2026-04-28 07:50:37.999707 | orchestrator | grafana : Restart remaining grafana containers ------------------------- 37.77s 2026-04-28 07:50:37.999720 | orchestrator | grafana : Restart first grafana container ------------------------------ 37.56s 2026-04-28 07:50:37.999732 | orchestrator | grafana : Waiting for grafana to start on first node ------------------- 27.20s 2026-04-28 07:50:37.999744 | orchestrator | grafana : Stopping all Grafana instances but the first node ------------- 7.04s 2026-04-28 07:50:37.999756 | orchestrator | grafana : include_tasks ------------------------------------------------- 3.13s 2026-04-28 07:50:37.999768 | orchestrator | grafana : Checking if Grafana container needs upgrading ----------------- 2.77s 2026-04-28 07:50:37.999780 | orchestrator | grafana : Copying over custom dashboards -------------------------------- 2.59s 2026-04-28 07:50:37.999790 | orchestrator | grafana : Copying over grafana.ini -------------------------------------- 2.57s 2026-04-28 07:50:37.999801 | orchestrator | grafana : Check if extra configuration file exists ---------------------- 2.41s 2026-04-28 07:50:37.999811 | orchestrator | grafana : Copying over config.json files -------------------------------- 2.38s 2026-04-28 07:50:37.999822 | orchestrator | grafana : Configuring dashboards provisioning --------------------------- 2.31s 2026-04-28 07:50:37.999832 | orchestrator | service-cert-copy : grafana | Copying over extra CA certificates -------- 2.31s 2026-04-28 07:50:37.999843 | orchestrator | service-check-containers : grafana | Check containers ------------------- 2.30s 2026-04-28 07:50:37.999853 | orchestrator | grafana : Configuring Prometheus as data source for Grafana ------------- 2.26s 2026-04-28 07:50:37.999864 | orchestrator | grafana : Remove templated Grafana dashboards --------------------------- 2.02s 2026-04-28 07:50:37.999875 | orchestrator | Group hosts based on enabled services ----------------------------------- 1.96s 2026-04-28 07:50:37.999885 | orchestrator | grafana : include_tasks ------------------------------------------------- 1.93s 2026-04-28 07:50:37.999896 | orchestrator | grafana : Flush handlers ------------------------------------------------ 1.85s 2026-04-28 07:50:37.999907 | orchestrator | grafana : Ensuring config directories exist ----------------------------- 1.78s 2026-04-28 07:50:37.999917 | orchestrator | grafana : Check if the folder for custom grafana dashboards exists ------ 1.77s 2026-04-28 07:50:38.191546 | orchestrator | + sh -c /opt/configuration/scripts/upgrade/510-clusterapi.sh 2026-04-28 07:50:38.199626 | orchestrator | + set -e 2026-04-28 07:50:38.199685 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-28 07:50:38.199700 | orchestrator | ++ export INTERACTIVE=false 2026-04-28 07:50:38.199712 | orchestrator | ++ INTERACTIVE=false 2026-04-28 07:50:38.200802 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-28 07:50:38.200823 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-28 07:50:38.200834 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-28 07:50:38.201435 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-28 07:50:38.208048 | orchestrator | ++ export MANAGER_VERSION=10.0.0 2026-04-28 07:50:38.208095 | orchestrator | ++ MANAGER_VERSION=10.0.0 2026-04-28 07:50:38.209316 | orchestrator | ++ semver 10.0.0 8.0.0 2026-04-28 07:50:38.273494 | orchestrator | + [[ 1 -ge 0 ]] 2026-04-28 07:50:38.273574 | orchestrator | + osism apply clusterapi 2026-04-28 07:50:39.626978 | orchestrator | 2026-04-28 07:50:39 | INFO  | Prepare task for execution of clusterapi. 2026-04-28 07:50:39.694740 | orchestrator | 2026-04-28 07:50:39 | INFO  | Task 2b314c76-b363-4103-8c7c-6a408ea7c724 (clusterapi) was prepared for execution. 2026-04-28 07:50:39.694830 | orchestrator | 2026-04-28 07:50:39 | INFO  | It takes a moment until task 2b314c76-b363-4103-8c7c-6a408ea7c724 (clusterapi) has been started and output is visible here. 2026-04-28 07:51:34.908648 | orchestrator | 2026-04-28 07:51:34.908739 | orchestrator | PLAY [Apply cert_manager role] ************************************************* 2026-04-28 07:51:34.908749 | orchestrator | 2026-04-28 07:51:34.908757 | orchestrator | TASK [Include cert_manager role] *********************************************** 2026-04-28 07:51:34.908764 | orchestrator | Tuesday 28 April 2026 07:50:44 +0000 (0:00:01.447) 0:00:01.447 ********* 2026-04-28 07:51:34.908771 | orchestrator | included: cert_manager for testbed-manager 2026-04-28 07:51:34.908778 | orchestrator | 2026-04-28 07:51:34.908785 | orchestrator | TASK [cert_manager : Deploy cert-manager crds] ********************************* 2026-04-28 07:51:34.908792 | orchestrator | Tuesday 28 April 2026 07:50:46 +0000 (0:00:01.842) 0:00:03.290 ********* 2026-04-28 07:51:34.908798 | orchestrator | ok: [testbed-manager] 2026-04-28 07:51:34.908805 | orchestrator | 2026-04-28 07:51:34.908812 | orchestrator | TASK [cert_manager : Deploy cert-manager] ************************************** 2026-04-28 07:51:34.908818 | orchestrator | Tuesday 28 April 2026 07:50:51 +0000 (0:00:04.668) 0:00:07.959 ********* 2026-04-28 07:51:34.908825 | orchestrator | ok: [testbed-manager] 2026-04-28 07:51:34.908831 | orchestrator | 2026-04-28 07:51:34.908839 | orchestrator | PLAY [Initialize or upgrade the CAPI management cluster] *********************** 2026-04-28 07:51:34.908845 | orchestrator | 2026-04-28 07:51:34.908852 | orchestrator | TASK [Get capi-system namespace phase] ***************************************** 2026-04-28 07:51:34.908858 | orchestrator | Tuesday 28 April 2026 07:50:55 +0000 (0:00:04.543) 0:00:12.503 ********* 2026-04-28 07:51:34.908865 | orchestrator | ok: [testbed-manager] 2026-04-28 07:51:34.908871 | orchestrator | 2026-04-28 07:51:34.908878 | orchestrator | TASK [Set capi-system-phase fact] ********************************************** 2026-04-28 07:51:34.908884 | orchestrator | Tuesday 28 April 2026 07:50:57 +0000 (0:00:02.212) 0:00:14.715 ********* 2026-04-28 07:51:34.908891 | orchestrator | ok: [testbed-manager] 2026-04-28 07:51:34.908897 | orchestrator | 2026-04-28 07:51:34.908903 | orchestrator | TASK [Initialize the CAPI management cluster] ********************************** 2026-04-28 07:51:34.908910 | orchestrator | Tuesday 28 April 2026 07:50:59 +0000 (0:00:01.363) 0:00:16.078 ********* 2026-04-28 07:51:34.908932 | orchestrator | skipping: [testbed-manager] 2026-04-28 07:51:34.908940 | orchestrator | 2026-04-28 07:51:34.908947 | orchestrator | TASK [Upgrade the CAPI management cluster] ************************************* 2026-04-28 07:51:34.908953 | orchestrator | Tuesday 28 April 2026 07:51:00 +0000 (0:00:01.123) 0:00:17.202 ********* 2026-04-28 07:51:34.908960 | orchestrator | ok: [testbed-manager] 2026-04-28 07:51:34.908966 | orchestrator | 2026-04-28 07:51:34.908973 | orchestrator | TASK [Install openstack-resource-controller] *********************************** 2026-04-28 07:51:34.908979 | orchestrator | Tuesday 28 April 2026 07:51:30 +0000 (0:00:29.977) 0:00:47.179 ********* 2026-04-28 07:51:34.908986 | orchestrator | changed: [testbed-manager] 2026-04-28 07:51:34.908992 | orchestrator | 2026-04-28 07:51:34.908999 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 07:51:34.909006 | orchestrator | testbed-manager : ok=7  changed=1  unreachable=0 failed=0 skipped=1  rescued=0 ignored=0 2026-04-28 07:51:34.909012 | orchestrator | 2026-04-28 07:51:34.909019 | orchestrator | 2026-04-28 07:51:34.909026 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 07:51:34.909032 | orchestrator | Tuesday 28 April 2026 07:51:34 +0000 (0:00:04.217) 0:00:51.397 ********* 2026-04-28 07:51:34.909038 | orchestrator | =============================================================================== 2026-04-28 07:51:34.909045 | orchestrator | Upgrade the CAPI management cluster ------------------------------------ 29.98s 2026-04-28 07:51:34.909070 | orchestrator | cert_manager : Deploy cert-manager crds --------------------------------- 4.67s 2026-04-28 07:51:34.909076 | orchestrator | cert_manager : Deploy cert-manager -------------------------------------- 4.54s 2026-04-28 07:51:34.909083 | orchestrator | Install openstack-resource-controller ----------------------------------- 4.22s 2026-04-28 07:51:34.909089 | orchestrator | Get capi-system namespace phase ----------------------------------------- 2.21s 2026-04-28 07:51:34.909096 | orchestrator | Include cert_manager role ----------------------------------------------- 1.84s 2026-04-28 07:51:34.909102 | orchestrator | Set capi-system-phase fact ---------------------------------------------- 1.36s 2026-04-28 07:51:34.909109 | orchestrator | Initialize the CAPI management cluster ---------------------------------- 1.12s 2026-04-28 07:51:35.100211 | orchestrator | + osism apply -a upgrade magnum 2026-04-28 07:51:36.490777 | orchestrator | 2026-04-28 07:51:36 | INFO  | Prepare task for execution of magnum. 2026-04-28 07:51:36.558726 | orchestrator | 2026-04-28 07:51:36 | INFO  | Task 4ec2c5d6-d2ac-44b5-88c4-cd38bd537611 (magnum) was prepared for execution. 2026-04-28 07:51:36.558807 | orchestrator | 2026-04-28 07:51:36 | INFO  | It takes a moment until task 4ec2c5d6-d2ac-44b5-88c4-cd38bd537611 (magnum) has been started and output is visible here. 2026-04-28 07:51:57.135484 | orchestrator | 2026-04-28 07:51:57.135576 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 07:51:57.135594 | orchestrator | 2026-04-28 07:51:57.135601 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 07:51:57.135608 | orchestrator | Tuesday 28 April 2026 07:51:41 +0000 (0:00:01.485) 0:00:01.485 ********* 2026-04-28 07:51:57.135615 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:51:57.135623 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:51:57.135629 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:51:57.135636 | orchestrator | 2026-04-28 07:51:57.135642 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 07:51:57.135649 | orchestrator | Tuesday 28 April 2026 07:51:43 +0000 (0:00:01.956) 0:00:03.441 ********* 2026-04-28 07:51:57.135656 | orchestrator | ok: [testbed-node-0] => (item=enable_magnum_True) 2026-04-28 07:51:57.135662 | orchestrator | ok: [testbed-node-1] => (item=enable_magnum_True) 2026-04-28 07:51:57.135669 | orchestrator | ok: [testbed-node-2] => (item=enable_magnum_True) 2026-04-28 07:51:57.135675 | orchestrator | 2026-04-28 07:51:57.135682 | orchestrator | PLAY [Apply role magnum] ******************************************************* 2026-04-28 07:51:57.135688 | orchestrator | 2026-04-28 07:51:57.135694 | orchestrator | TASK [magnum : include_tasks] ************************************************** 2026-04-28 07:51:57.135700 | orchestrator | Tuesday 28 April 2026 07:51:45 +0000 (0:00:02.213) 0:00:05.655 ********* 2026-04-28 07:51:57.135707 | orchestrator | included: /ansible/roles/magnum/tasks/upgrade.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:51:57.135714 | orchestrator | 2026-04-28 07:51:57.135720 | orchestrator | TASK [magnum : Ensuring config directories exist] ****************************** 2026-04-28 07:51:57.135726 | orchestrator | Tuesday 28 April 2026 07:51:48 +0000 (0:00:02.642) 0:00:08.297 ********* 2026-04-28 07:51:57.135751 | orchestrator | ok: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:51:57.135778 | orchestrator | ok: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:51:57.135798 | orchestrator | ok: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:51:57.135806 | orchestrator | ok: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:51:57.135815 | orchestrator | ok: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:51:57.135825 | orchestrator | ok: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:51:57.135838 | orchestrator | 2026-04-28 07:51:57.135844 | orchestrator | TASK [magnum : Check if policies shall be overwritten] ************************* 2026-04-28 07:51:57.135851 | orchestrator | Tuesday 28 April 2026 07:51:50 +0000 (0:00:02.791) 0:00:11.088 ********* 2026-04-28 07:51:57.135857 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:51:57.135864 | orchestrator | 2026-04-28 07:51:57.135870 | orchestrator | TASK [magnum : Set magnum policy file] ***************************************** 2026-04-28 07:51:57.135876 | orchestrator | Tuesday 28 April 2026 07:51:52 +0000 (0:00:01.138) 0:00:12.226 ********* 2026-04-28 07:51:57.135882 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:51:57.135889 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:51:57.135895 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:51:57.135901 | orchestrator | 2026-04-28 07:51:57.135907 | orchestrator | TASK [magnum : Check if kubeconfig file is supplied] *************************** 2026-04-28 07:51:57.135913 | orchestrator | Tuesday 28 April 2026 07:51:53 +0000 (0:00:01.316) 0:00:13.543 ********* 2026-04-28 07:51:57.135919 | orchestrator | ok: [testbed-node-0 -> localhost] 2026-04-28 07:51:57.135925 | orchestrator | 2026-04-28 07:51:57.135931 | orchestrator | TASK [magnum : Copying over kubeconfig file] *********************************** 2026-04-28 07:51:57.135937 | orchestrator | Tuesday 28 April 2026 07:51:55 +0000 (0:00:02.282) 0:00:15.826 ********* 2026-04-28 07:51:57.135949 | orchestrator | ok: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:52:04.722116 | orchestrator | ok: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:52:04.722306 | orchestrator | ok: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:52:04.722362 | orchestrator | ok: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:52:04.722376 | orchestrator | ok: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:52:04.722411 | orchestrator | ok: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:52:04.722423 | orchestrator | 2026-04-28 07:52:04.722435 | orchestrator | TASK [magnum : Set magnum kubeconfig file's path] ****************************** 2026-04-28 07:52:04.722476 | orchestrator | Tuesday 28 April 2026 07:51:59 +0000 (0:00:03.762) 0:00:19.590 ********* 2026-04-28 07:52:04.722489 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:52:04.722501 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:52:04.722510 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:52:04.722520 | orchestrator | 2026-04-28 07:52:04.722530 | orchestrator | TASK [magnum : include_tasks] ************************************************** 2026-04-28 07:52:04.722539 | orchestrator | Tuesday 28 April 2026 07:52:00 +0000 (0:00:01.387) 0:00:20.978 ********* 2026-04-28 07:52:04.722550 | orchestrator | included: /ansible/roles/magnum/tasks/copy-certs.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 07:52:04.722571 | orchestrator | 2026-04-28 07:52:04.722582 | orchestrator | TASK [service-cert-copy : magnum | Copying over extra CA certificates] ********* 2026-04-28 07:52:04.722593 | orchestrator | Tuesday 28 April 2026 07:52:02 +0000 (0:00:01.944) 0:00:22.923 ********* 2026-04-28 07:52:04.722613 | orchestrator | ok: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:52:04.722627 | orchestrator | ok: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:52:04.722640 | orchestrator | ok: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:52:04.722662 | orchestrator | ok: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:52:08.549007 | orchestrator | ok: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:52:08.549157 | orchestrator | ok: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:52:08.549168 | orchestrator | 2026-04-28 07:52:08.549179 | orchestrator | TASK [service-cert-copy : magnum | Copying over backend internal TLS certificate] *** 2026-04-28 07:52:08.549188 | orchestrator | Tuesday 28 April 2026 07:52:06 +0000 (0:00:03.503) 0:00:26.427 ********* 2026-04-28 07:52:08.549200 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:52:08.549211 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:52:08.549219 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:52:08.549246 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:52:08.549283 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:52:08.549291 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:52:08.549299 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:52:08.549307 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:52:08.549314 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:52:08.549322 | orchestrator | 2026-04-28 07:52:08.549330 | orchestrator | TASK [service-cert-copy : magnum | Copying over backend internal TLS key] ****** 2026-04-28 07:52:08.549337 | orchestrator | Tuesday 28 April 2026 07:52:08 +0000 (0:00:01.854) 0:00:28.281 ********* 2026-04-28 07:52:08.549350 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:52:12.553818 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:52:12.553935 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:52:12.553973 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:52:12.553989 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:52:12.554002 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:52:12.554014 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:52:12.554134 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:52:12.554148 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:52:12.554160 | orchestrator | 2026-04-28 07:52:12.554173 | orchestrator | TASK [magnum : Copying over config.json files for services] ******************** 2026-04-28 07:52:12.554186 | orchestrator | Tuesday 28 April 2026 07:52:10 +0000 (0:00:02.183) 0:00:30.465 ********* 2026-04-28 07:52:12.554205 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:52:12.554219 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:52:12.554231 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:52:12.554261 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:52:20.808930 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:52:20.809045 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:52:20.809063 | orchestrator | 2026-04-28 07:52:20.809078 | orchestrator | TASK [magnum : Copying over magnum.conf] *************************************** 2026-04-28 07:52:20.809091 | orchestrator | Tuesday 28 April 2026 07:52:13 +0000 (0:00:03.561) 0:00:34.026 ********* 2026-04-28 07:52:20.809105 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:52:20.809144 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:52:20.809183 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:52:20.809197 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:52:20.809209 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:52:20.809229 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:52:20.809241 | orchestrator | 2026-04-28 07:52:20.809252 | orchestrator | TASK [magnum : Copying over existing policy file] ****************************** 2026-04-28 07:52:20.809263 | orchestrator | Tuesday 28 April 2026 07:52:20 +0000 (0:00:06.612) 0:00:40.639 ********* 2026-04-28 07:52:20.809283 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:52:25.219216 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:52:25.219319 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:52:25.219337 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:52:25.219373 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:52:25.219384 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:52:25.219394 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:52:25.219422 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:52:25.219433 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:52:25.219443 | orchestrator | 2026-04-28 07:52:25.219454 | orchestrator | TASK [service-check-containers : magnum | Check containers] ******************** 2026-04-28 07:52:25.219472 | orchestrator | Tuesday 28 April 2026 07:52:22 +0000 (0:00:02.303) 0:00:42.942 ********* 2026-04-28 07:52:25.219483 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:52:25.219564 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:52:25.219577 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}}) 2026-04-28 07:52:25.219597 | orchestrator | changed: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:52:52.203682 | orchestrator | changed: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:52:52.203789 | orchestrator | changed: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}}) 2026-04-28 07:52:52.203818 | orchestrator | 2026-04-28 07:52:52.203827 | orchestrator | TASK [service-check-containers : magnum | Notify handlers to restart containers] *** 2026-04-28 07:52:52.203835 | orchestrator | Tuesday 28 April 2026 07:52:26 +0000 (0:00:03.698) 0:00:46.641 ********* 2026-04-28 07:52:52.203843 | orchestrator | changed: [testbed-node-0] => { 2026-04-28 07:52:52.203850 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:52:52.203857 | orchestrator | } 2026-04-28 07:52:52.203864 | orchestrator | changed: [testbed-node-1] => { 2026-04-28 07:52:52.203870 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:52:52.203876 | orchestrator | } 2026-04-28 07:52:52.203882 | orchestrator | changed: [testbed-node-2] => { 2026-04-28 07:52:52.203888 | orchestrator |  "msg": "Notifying handlers" 2026-04-28 07:52:52.203894 | orchestrator | } 2026-04-28 07:52:52.203900 | orchestrator | 2026-04-28 07:52:52.203907 | orchestrator | TASK [service-check-containers : Include tasks] ******************************** 2026-04-28 07:52:52.203913 | orchestrator | Tuesday 28 April 2026 07:52:27 +0000 (0:00:01.376) 0:00:48.017 ********* 2026-04-28 07:52:52.203922 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.10:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:52:52.203930 | orchestrator | skipping: [testbed-node-0] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.10,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:52:52.203936 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:52:52.203963 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.11:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:52:52.203977 | orchestrator | skipping: [testbed-node-1] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.11,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:52:52.203984 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:52:52.203991 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-api', 'value': {'container_name': 'magnum_api', 'group': 'magnum-api', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328', 'environment': {'DUMMY_ENVIRONMENT': 'kolla_useless_env'}, 'volumes': ['/etc/kolla/magnum-api/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_curl http://192.168.16.12:9511'], 'timeout': '30'}, 'haproxy': {'magnum_api': {'enabled': 'yes', 'mode': 'http', 'external': False, 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}, 'magnum_api_external': {'enabled': 'yes', 'mode': 'http', 'external': True, 'external_fqdn': 'api.testbed.osism.xyz', 'port': '9511', 'listen_port': '9511', 'backend_http_extra': ['option httpchk']}}}})  2026-04-28 07:52:52.203998 | orchestrator | skipping: [testbed-node-2] => (item={'key': 'magnum-conductor', 'value': {'container_name': 'magnum_conductor', 'group': 'magnum-conductor', 'enabled': True, 'image': 'registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328', 'environment': {'http_proxy': '', 'https_proxy': '', 'no_proxy': 'localhost,127.0.0.1,192.168.16.12,192.168.16.9'}, 'volumes': ['/etc/kolla/magnum-conductor/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'magnum:/var/lib/magnum/', '', 'kolla_logs:/var/log/kolla/', '/dev/shm:/dev/shm'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_port magnum-conductor 5672'], 'timeout': '30'}}})  2026-04-28 07:52:52.204005 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:52:52.204016 | orchestrator | 2026-04-28 07:52:52.204026 | orchestrator | TASK [magnum : Running Magnum bootstrap container] ***************************** 2026-04-28 07:52:52.204081 | orchestrator | Tuesday 28 April 2026 07:52:30 +0000 (0:00:02.162) 0:00:50.180 ********* 2026-04-28 07:52:52.204094 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:52:52.204105 | orchestrator | 2026-04-28 07:52:52.204116 | orchestrator | TASK [magnum : Flush handlers] ************************************************* 2026-04-28 07:52:52.204126 | orchestrator | Tuesday 28 April 2026 07:52:51 +0000 (0:00:21.727) 0:01:11.907 ********* 2026-04-28 07:52:52.204137 | orchestrator | 2026-04-28 07:52:52.204148 | orchestrator | TASK [magnum : Flush handlers] ************************************************* 2026-04-28 07:52:52.204169 | orchestrator | Tuesday 28 April 2026 07:52:52 +0000 (0:00:00.466) 0:01:12.374 ********* 2026-04-28 07:53:39.653716 | orchestrator | 2026-04-28 07:53:39.653870 | orchestrator | TASK [magnum : Flush handlers] ************************************************* 2026-04-28 07:53:39.653936 | orchestrator | Tuesday 28 April 2026 07:52:52 +0000 (0:00:00.446) 0:01:12.820 ********* 2026-04-28 07:53:39.653958 | orchestrator | 2026-04-28 07:53:39.653996 | orchestrator | RUNNING HANDLER [magnum : Restart magnum-api container] ************************ 2026-04-28 07:53:39.654015 | orchestrator | Tuesday 28 April 2026 07:52:53 +0000 (0:00:00.760) 0:01:13.581 ********* 2026-04-28 07:53:39.654129 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:53:39.654147 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:53:39.654158 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:53:39.654168 | orchestrator | 2026-04-28 07:53:39.654179 | orchestrator | RUNNING HANDLER [magnum : Restart magnum-conductor container] ****************** 2026-04-28 07:53:39.654190 | orchestrator | Tuesday 28 April 2026 07:53:15 +0000 (0:00:21.884) 0:01:35.466 ********* 2026-04-28 07:53:39.654202 | orchestrator | changed: [testbed-node-1] 2026-04-28 07:53:39.654215 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:53:39.654228 | orchestrator | changed: [testbed-node-2] 2026-04-28 07:53:39.654240 | orchestrator | 2026-04-28 07:53:39.654253 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 07:53:39.654266 | orchestrator | testbed-node-0 : ok=16  changed=7  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026-04-28 07:53:39.654279 | orchestrator | testbed-node-1 : ok=14  changed=6  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 07:53:39.654291 | orchestrator | testbed-node-2 : ok=14  changed=6  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026-04-28 07:53:39.654304 | orchestrator | 2026-04-28 07:53:39.654317 | orchestrator | 2026-04-28 07:53:39.654329 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 07:53:39.654341 | orchestrator | Tuesday 28 April 2026 07:53:39 +0000 (0:00:24.054) 0:01:59.520 ********* 2026-04-28 07:53:39.654370 | orchestrator | =============================================================================== 2026-04-28 07:53:39.654393 | orchestrator | magnum : Restart magnum-conductor container ---------------------------- 24.05s 2026-04-28 07:53:39.654406 | orchestrator | magnum : Restart magnum-api container ---------------------------------- 21.89s 2026-04-28 07:53:39.654418 | orchestrator | magnum : Running Magnum bootstrap container ---------------------------- 21.73s 2026-04-28 07:53:39.654430 | orchestrator | magnum : Copying over magnum.conf --------------------------------------- 6.61s 2026-04-28 07:53:39.654443 | orchestrator | magnum : Copying over kubeconfig file ----------------------------------- 3.76s 2026-04-28 07:53:39.654455 | orchestrator | service-check-containers : magnum | Check containers -------------------- 3.70s 2026-04-28 07:53:39.654468 | orchestrator | magnum : Copying over config.json files for services -------------------- 3.56s 2026-04-28 07:53:39.654480 | orchestrator | service-cert-copy : magnum | Copying over extra CA certificates --------- 3.50s 2026-04-28 07:53:39.654492 | orchestrator | magnum : Ensuring config directories exist ------------------------------ 2.79s 2026-04-28 07:53:39.654505 | orchestrator | magnum : include_tasks -------------------------------------------------- 2.64s 2026-04-28 07:53:39.654518 | orchestrator | magnum : Copying over existing policy file ------------------------------ 2.30s 2026-04-28 07:53:39.654529 | orchestrator | magnum : Check if kubeconfig file is supplied --------------------------- 2.28s 2026-04-28 07:53:39.654542 | orchestrator | Group hosts based on enabled services ----------------------------------- 2.21s 2026-04-28 07:53:39.654554 | orchestrator | service-cert-copy : magnum | Copying over backend internal TLS key ------ 2.18s 2026-04-28 07:53:39.654566 | orchestrator | service-check-containers : Include tasks -------------------------------- 2.16s 2026-04-28 07:53:39.654578 | orchestrator | Group hosts based on Kolla action --------------------------------------- 1.96s 2026-04-28 07:53:39.654590 | orchestrator | magnum : include_tasks -------------------------------------------------- 1.94s 2026-04-28 07:53:39.654601 | orchestrator | service-cert-copy : magnum | Copying over backend internal TLS certificate --- 1.86s 2026-04-28 07:53:39.654695 | orchestrator | magnum : Flush handlers ------------------------------------------------- 1.67s 2026-04-28 07:53:39.654709 | orchestrator | magnum : Set magnum kubeconfig file's path ------------------------------ 1.39s 2026-04-28 07:53:40.433308 | orchestrator | ok: Runtime: 3:24:18.545889 2026-04-28 07:53:40.840700 | 2026-04-28 07:53:40.840841 | TASK [Bootstrap services] 2026-04-28 07:53:41.377901 | orchestrator | skipping: Conditional result was False 2026-04-28 07:53:41.408941 | 2026-04-28 07:53:41.409352 | TASK [Run checks after the upgrade] 2026-04-28 07:53:42.106444 | orchestrator | + set -e 2026-04-28 07:53:42.106562 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-28 07:53:42.106573 | orchestrator | ++ export INTERACTIVE=false 2026-04-28 07:53:42.106582 | orchestrator | ++ INTERACTIVE=false 2026-04-28 07:53:42.106587 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-28 07:53:42.106592 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-28 07:53:42.106598 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-28 07:53:42.107608 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-28 07:53:42.113948 | orchestrator | 2026-04-28 07:53:42.113970 | orchestrator | # CHECK 2026-04-28 07:53:42.113974 | orchestrator | 2026-04-28 07:53:42.113979 | orchestrator | ++ export MANAGER_VERSION=10.0.0 2026-04-28 07:53:42.113985 | orchestrator | ++ MANAGER_VERSION=10.0.0 2026-04-28 07:53:42.113990 | orchestrator | + echo 2026-04-28 07:53:42.113994 | orchestrator | + echo '# CHECK' 2026-04-28 07:53:42.113998 | orchestrator | + echo 2026-04-28 07:53:42.114005 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-28 07:53:42.114978 | orchestrator | ++ semver 10.0.0 5.0.0 2026-04-28 07:53:42.173000 | orchestrator | 2026-04-28 07:53:42.173098 | orchestrator | ## Containers @ testbed-manager 2026-04-28 07:53:42.173105 | orchestrator | 2026-04-28 07:53:42.173112 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-28 07:53:42.173117 | orchestrator | + echo 2026-04-28 07:53:42.173121 | orchestrator | + echo '## Containers @ testbed-manager' 2026-04-28 07:53:42.173126 | orchestrator | + echo 2026-04-28 07:53:42.173130 | orchestrator | + osism container testbed-manager ps 2026-04-28 07:53:43.779918 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-28 07:53:43.780006 | orchestrator | 80087393268e registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter:0.25.0.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_blackbox_exporter 2026-04-28 07:53:43.780016 | orchestrator | 6509a15a2207 registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager:0.28.1.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_alertmanager 2026-04-28 07:53:43.780021 | orchestrator | b79b06949d0c registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_cadvisor 2026-04-28 07:53:43.780025 | orchestrator | 5f206d35e3fe registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_node_exporter 2026-04-28 07:53:43.780029 | orchestrator | b1ed14b12038 registry.osism.tech/kolla/release/2025.1/prometheus-server:3.2.1.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_server 2026-04-28 07:53:43.780033 | orchestrator | 033a6341f9a8 registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours cron 2026-04-28 07:53:43.780041 | orchestrator | 4d4db8d7b32c registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours kolla_toolbox 2026-04-28 07:53:43.780045 | orchestrator | 4bc7cfa80963 registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours fluentd 2026-04-28 07:53:43.780065 | orchestrator | a1d96da1e5ba registry.osism.tech/osism/openstackclient:2025.1 "/usr/bin/dumb-init …" 3 hours ago Up 3 hours openstackclient 2026-04-28 07:53:43.780069 | orchestrator | 7ae777f93c49 registry.osism.tech/osism/inventory-reconciler:0.20260322.0 "/sbin/tini -- /entr…" 3 hours ago Up 3 hours (healthy) manager-inventory_reconciler-1 2026-04-28 07:53:43.780073 | orchestrator | 0a921c43778c registry.osism.tech/osism/ceph-ansible:0.20260322.0 "/entrypoint.sh osis…" 3 hours ago Up 3 hours (healthy) ceph-ansible 2026-04-28 07:53:43.780077 | orchestrator | 315f670b39f2 registry.osism.tech/osism/kolla-ansible:0.20260328.0 "/entrypoint.sh osis…" 3 hours ago Up 3 hours (healthy) kolla-ansible 2026-04-28 07:53:43.780081 | orchestrator | 7349be4a7ea6 registry.osism.tech/osism/osism-ansible:0.20260322.0 "/entrypoint.sh osis…" 3 hours ago Up 3 hours (healthy) osism-ansible 2026-04-28 07:53:43.780101 | orchestrator | 3e0542fadbab registry.osism.tech/osism/osism-kubernetes:0.20260322.0 "/entrypoint.sh osis…" 3 hours ago Up 3 hours (healthy) osism-kubernetes 2026-04-28 07:53:43.780105 | orchestrator | 2db1a67f762a registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- sleep…" 3 hours ago Up 3 hours (healthy) osismclient 2026-04-28 07:53:43.780109 | orchestrator | fedf37241b77 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" 3 hours ago Up 3 hours (healthy) manager-openstack-1 2026-04-28 07:53:43.780113 | orchestrator | ed4bca2b6198 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" 3 hours ago Up About an hour (healthy) manager-listener-1 2026-04-28 07:53:43.780117 | orchestrator | b49fbef53c18 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" 3 hours ago Up 3 hours (healthy) 192.168.16.5:8000->8000/tcp manager-api-1 2026-04-28 07:53:43.780121 | orchestrator | 839dea060663 registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" 3 hours ago Up 3 hours (healthy) manager-flower-1 2026-04-28 07:53:43.780125 | orchestrator | 0169b15bea1f registry.osism.tech/osism/osism:0.20260320.0 "/sbin/tini -- osism…" 3 hours ago Up 3 hours (healthy) manager-beat-1 2026-04-28 07:53:43.780128 | orchestrator | 851e8ea92a3f registry.osism.tech/osism/osism-frontend:0.20260320.0 "docker-entrypoint.s…" 3 hours ago Up 3 hours 192.168.16.5:3000->3000/tcp osism-frontend 2026-04-28 07:53:43.780132 | orchestrator | 93662d7e2df3 registry.osism.tech/osism/cephclient:18.2.7 "/usr/bin/dumb-init …" 5 hours ago Up 5 hours cephclient 2026-04-28 07:53:43.780140 | orchestrator | 4d601f170cd5 phpmyadmin/phpmyadmin:5.2 "/docker-entrypoint.…" 5 hours ago Up 5 hours (healthy) 80/tcp phpmyadmin 2026-04-28 07:53:43.780144 | orchestrator | 4c795f03ad96 registry.osism.tech/osism/homer:v25.10.1 "/bin/sh /entrypoint…" 5 hours ago Up 5 hours (healthy) 8080/tcp homer 2026-04-28 07:53:43.780148 | orchestrator | 303bf550d9e5 registry.osism.tech/osism/cgit:1.2.3 "httpd-foreground" 5 hours ago Up 5 hours 80/tcp cgit 2026-04-28 07:53:43.780152 | orchestrator | 39308879d123 registry.osism.tech/dockerhub/ubuntu/squid:6.1-23.10_beta "entrypoint.sh -f /e…" 6 hours ago Up 6 hours (healthy) 192.168.16.5:3128->3128/tcp squid 2026-04-28 07:53:43.780158 | orchestrator | e388e46cef8d registry.osism.tech/osism/ara-server:1.7.3 "sh -c '/wait && /ru…" 6 hours ago Up 3 hours (healthy) 8000/tcp manager-ara-server-1 2026-04-28 07:53:43.780162 | orchestrator | 4e2c787be401 registry.osism.tech/dockerhub/library/redis:7.4.7-alpine "docker-entrypoint.s…" 6 hours ago Up 3 hours (healthy) 6379/tcp manager-redis-1 2026-04-28 07:53:43.780166 | orchestrator | 032068142f52 registry.osism.tech/dockerhub/library/mariadb:11.8.4 "docker-entrypoint.s…" 6 hours ago Up 3 hours (healthy) 3306/tcp manager-mariadb-1 2026-04-28 07:53:43.780173 | orchestrator | 1f789320b934 registry.osism.tech/dockerhub/library/traefik:v3.5.0 "/entrypoint.sh trae…" 6 hours ago Up 6 hours (healthy) 192.168.16.5:80->80/tcp, 192.168.16.5:443->443/tcp, 192.168.16.5:8122->8080/tcp traefik 2026-04-28 07:53:43.944190 | orchestrator | 2026-04-28 07:53:43.944260 | orchestrator | ## Images @ testbed-manager 2026-04-28 07:53:43.944268 | orchestrator | 2026-04-28 07:53:43.944272 | orchestrator | + echo 2026-04-28 07:53:43.944277 | orchestrator | + echo '## Images @ testbed-manager' 2026-04-28 07:53:43.944282 | orchestrator | + echo 2026-04-28 07:53:43.944286 | orchestrator | + osism container testbed-manager images 2026-04-28 07:53:45.459489 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-28 07:53:45.459567 | orchestrator | registry.osism.tech/osism/openstackclient 2025.1 c2bf726847da 4 hours ago 212MB 2026-04-28 07:53:45.459574 | orchestrator | registry.osism.tech/osism/openstackclient 2024.2 ce33602ef9c5 20 hours ago 238MB 2026-04-28 07:53:45.459578 | orchestrator | registry.osism.tech/osism/kolla-ansible 0.20260328.0 38f6ca42e9a0 4 weeks ago 635MB 2026-04-28 07:53:45.459582 | orchestrator | registry.osism.tech/kolla/release/2025.1/fluentd 5.0.9.20260328 e1596a0c11a4 4 weeks ago 590MB 2026-04-28 07:53:45.459586 | orchestrator | registry.osism.tech/kolla/release/2025.1/kolla-toolbox 20.3.1.20260328 28c0d33bbf93 4 weeks ago 683MB 2026-04-28 07:53:45.459590 | orchestrator | registry.osism.tech/kolla/release/2025.1/cron 3.0.20260328 83ceba86723e 4 weeks ago 277MB 2026-04-28 07:53:45.459594 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-blackbox-exporter 0.25.0.20260328 1bf017fd7bf3 4 weeks ago 319MB 2026-04-28 07:53:45.459614 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-alertmanager 0.28.1.20260328 d1986023a383 4 weeks ago 415MB 2026-04-28 07:53:45.459632 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor 0.49.2.20260328 f7140e8a13d8 4 weeks ago 368MB 2026-04-28 07:53:45.459638 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-server 3.2.1.20260328 4f5732d5eb69 4 weeks ago 860MB 2026-04-28 07:53:45.459642 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter 1.8.2.20260328 4d11b36c2bda 4 weeks ago 317MB 2026-04-28 07:53:45.459646 | orchestrator | registry.osism.tech/osism/osism-ansible 0.20260322.0 3e18c5de9bc5 5 weeks ago 634MB 2026-04-28 07:53:45.459650 | orchestrator | registry.osism.tech/osism/osism-kubernetes 0.20260322.0 c68c1f5728ae 5 weeks ago 1.24GB 2026-04-28 07:53:45.459654 | orchestrator | registry.osism.tech/osism/ceph-ansible 0.20260322.0 f6e7e0d58bb1 5 weeks ago 585MB 2026-04-28 07:53:45.459658 | orchestrator | registry.osism.tech/osism/inventory-reconciler 0.20260322.0 9806642932fd 5 weeks ago 357MB 2026-04-28 07:53:45.459662 | orchestrator | registry.osism.tech/osism/osism 0.20260320.0 5d0420989a40 5 weeks ago 408MB 2026-04-28 07:53:45.459665 | orchestrator | registry.osism.tech/osism/osism-frontend 0.20260320.0 80b833af5991 5 weeks ago 232MB 2026-04-28 07:53:45.459669 | orchestrator | registry.osism.tech/dockerhub/library/redis 7.4.7-alpine e08bd8d5a677 3 months ago 41.4MB 2026-04-28 07:53:45.459689 | orchestrator | registry.osism.tech/osism/homer v25.10.1 ea34b371c716 4 months ago 11.5MB 2026-04-28 07:53:45.459693 | orchestrator | registry.osism.tech/osism/kolla-ansible 0.20251130.0 0f140ec71e5f 4 months ago 608MB 2026-04-28 07:53:45.459702 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-28 07:53:45.459706 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-28 07:53:45.459710 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-28 07:53:45.459714 | orchestrator | registry.osism.tech/kolla/release/prometheus-blackbox-exporter 0.25.0.20251130 7bbb4f6f4831 4 months ago 308MB 2026-04-28 07:53:45.459718 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-28 07:53:45.459721 | orchestrator | registry.osism.tech/kolla/release/prometheus-alertmanager 0.28.0.20251130 ba994ea4acda 4 months ago 404MB 2026-04-28 07:53:45.459726 | orchestrator | registry.osism.tech/kolla/release/prometheus-v2-server 2.55.1.20251130 56b43d5c716a 4 months ago 839MB 2026-04-28 07:53:45.459729 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-28 07:53:45.459733 | orchestrator | registry.osism.tech/osism/inventory-reconciler 0.20251130.0 1bfc1dadeee1 4 months ago 330MB 2026-04-28 07:53:45.459737 | orchestrator | registry.osism.tech/osism/osism-ansible 0.20251130.0 42988b2d229c 4 months ago 613MB 2026-04-28 07:53:45.459741 | orchestrator | registry.osism.tech/osism/ceph-ansible 0.20251130.0 a212d8ca4a50 4 months ago 560MB 2026-04-28 07:53:45.459744 | orchestrator | registry.osism.tech/osism/osism-kubernetes 0.20251130.0 9beff03cb77b 4 months ago 1.23GB 2026-04-28 07:53:45.459748 | orchestrator | registry.osism.tech/osism/osism 0.20251130.1 95213af683ec 4 months ago 383MB 2026-04-28 07:53:45.459752 | orchestrator | registry.osism.tech/osism/osism-frontend 0.20251130.1 2cb6e7609620 4 months ago 238MB 2026-04-28 07:53:45.459764 | orchestrator | registry.osism.tech/dockerhub/library/mariadb 11.8.4 70745dd8f1d0 5 months ago 334MB 2026-04-28 07:53:45.459767 | orchestrator | phpmyadmin/phpmyadmin 5.2 e66b1f5a8c58 6 months ago 742MB 2026-04-28 07:53:45.459771 | orchestrator | registry.osism.tech/osism/ara-server 1.7.3 d1b687333f2f 8 months ago 275MB 2026-04-28 07:53:45.459775 | orchestrator | registry.osism.tech/dockerhub/library/traefik v3.5.0 11cc59587f6a 9 months ago 226MB 2026-04-28 07:53:45.459779 | orchestrator | registry.osism.tech/osism/cephclient 18.2.7 ae977aa79826 11 months ago 453MB 2026-04-28 07:53:45.459783 | orchestrator | registry.osism.tech/dockerhub/ubuntu/squid 6.1-23.10_beta 34b6bbbcf74b 22 months ago 146MB 2026-04-28 07:53:45.459879 | orchestrator | registry.osism.tech/osism/cgit 1.2.3 16e7285642b1 2 years ago 545MB 2026-04-28 07:53:45.630482 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-28 07:53:45.631213 | orchestrator | ++ semver 10.0.0 5.0.0 2026-04-28 07:53:45.684671 | orchestrator | 2026-04-28 07:53:45.684724 | orchestrator | ## Containers @ testbed-node-0 2026-04-28 07:53:45.684730 | orchestrator | 2026-04-28 07:53:45.684734 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-28 07:53:45.684739 | orchestrator | + echo 2026-04-28 07:53:45.684743 | orchestrator | + echo '## Containers @ testbed-node-0' 2026-04-28 07:53:45.684748 | orchestrator | + echo 2026-04-28 07:53:45.684752 | orchestrator | + osism container testbed-node-0 ps 2026-04-28 07:53:47.176949 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-28 07:53:47.177047 | orchestrator | 7983dfa5a4ba registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328 "dumb-init --single-…" 11 seconds ago Up 9 seconds (health: starting) magnum_conductor 2026-04-28 07:53:47.177075 | orchestrator | ebe54855a76f registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328 "dumb-init --single-…" 44 seconds ago Up 42 seconds (healthy) magnum_api 2026-04-28 07:53:47.177081 | orchestrator | c370bd9029b4 registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328 "dumb-init --single-…" 4 minutes ago Up 4 minutes grafana 2026-04-28 07:53:47.177087 | orchestrator | 92d7b2941a0d registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_elasticsearch_exporter 2026-04-28 07:53:47.177095 | orchestrator | 39f336535cbe registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_cadvisor 2026-04-28 07:53:47.177100 | orchestrator | ea51bc6ef1c3 registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_memcached_exporter 2026-04-28 07:53:47.177106 | orchestrator | 404cc7217018 registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_mysqld_exporter 2026-04-28 07:53:47.177112 | orchestrator | 9313b0e73e67 registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_node_exporter 2026-04-28 07:53:47.177117 | orchestrator | 2b0e1f82e7c9 registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328 "dumb-init --single-…" 10 minutes ago Up 10 minutes (healthy) manila_share 2026-04-28 07:53:47.177143 | orchestrator | 7f7f40d2ba30 registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328 "dumb-init --single-…" 12 minutes ago Up 12 minutes (healthy) manila_scheduler 2026-04-28 07:53:47.177171 | orchestrator | d7ae606d8b7e registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328 "dumb-init --single-…" 12 minutes ago Up 12 minutes (healthy) manila_data 2026-04-28 07:53:47.177178 | orchestrator | 64312a8be36b registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_api 2026-04-28 07:53:47.177182 | orchestrator | 8da00f2f2300 registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) octavia_worker 2026-04-28 07:53:47.177186 | orchestrator | d20f3231bed5 registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) octavia_housekeeping 2026-04-28 07:53:47.177190 | orchestrator | ebddcb35663a registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) octavia_health_manager 2026-04-28 07:53:47.177194 | orchestrator | 3962228377f7 registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328 "dumb-init --single-…" 15 minutes ago Up 15 minutes octavia_driver_agent 2026-04-28 07:53:47.177198 | orchestrator | 4cab7aa5b5de registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes (healthy) octavia_api 2026-04-28 07:53:47.177216 | orchestrator | a318bb199f5f registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328 "dumb-init --single-…" 19 minutes ago Up 19 minutes (healthy) aodh_notifier 2026-04-28 07:53:47.177220 | orchestrator | 92ef36235669 registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328 "dumb-init --single-…" 19 minutes ago Up 19 minutes (healthy) aodh_listener 2026-04-28 07:53:47.177224 | orchestrator | f3c2bdb370e9 registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328 "dumb-init --single-…" 19 minutes ago Up 19 minutes (healthy) aodh_evaluator 2026-04-28 07:53:47.177228 | orchestrator | e1b28863aac0 registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) aodh_api 2026-04-28 07:53:47.177242 | orchestrator | 2890bdaa1352 registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328 "dumb-init --single-…" 21 minutes ago Up 21 minutes ceilometer_central 2026-04-28 07:53:47.177248 | orchestrator | e5faa7d3bd4d registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328 "dumb-init --single-…" 22 minutes ago Up 22 minutes (healthy) ceilometer_notification 2026-04-28 07:53:47.177253 | orchestrator | a925927544dd registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328 "dumb-init --single-…" 24 minutes ago Up 24 minutes (healthy) designate_worker 2026-04-28 07:53:47.177258 | orchestrator | 039c93dbf2a9 registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328 "dumb-init --single-…" 24 minutes ago Up 24 minutes (healthy) designate_mdns 2026-04-28 07:53:47.177264 | orchestrator | 4a4331538153 registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328 "dumb-init --single-…" 25 minutes ago Up 24 minutes (healthy) designate_producer 2026-04-28 07:53:47.177275 | orchestrator | 8d584b2e9c6c registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_central 2026-04-28 07:53:47.177281 | orchestrator | a2b124112ef1 registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_api 2026-04-28 07:53:47.177288 | orchestrator | 6e2dd6d48aa9 registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_backend_bind9 2026-04-28 07:53:47.177294 | orchestrator | 907aafe97d29 registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_worker 2026-04-28 07:53:47.177300 | orchestrator | 0b2dce058cef registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_keystone_listener 2026-04-28 07:53:47.177306 | orchestrator | add9245707e1 registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328 "dumb-init --single-…" 29 minutes ago Up 29 minutes (healthy) barbican_api 2026-04-28 07:53:47.177312 | orchestrator | df61654eca4c registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328 "dumb-init --single-…" 33 minutes ago Up 32 minutes (healthy) cinder_backup 2026-04-28 07:53:47.177319 | orchestrator | 368a907c8998 registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328 "dumb-init --single-…" 33 minutes ago Up 32 minutes (healthy) cinder_volume 2026-04-28 07:53:47.177326 | orchestrator | 11d702e6911c registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328 "dumb-init --single-…" 34 minutes ago Up 32 minutes (healthy) cinder_scheduler 2026-04-28 07:53:47.177332 | orchestrator | 19fcdf40f85e registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328 "dumb-init --single-…" 35 minutes ago Up 32 minutes (healthy) cinder_api 2026-04-28 07:53:47.177337 | orchestrator | 09684131593e registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328 "dumb-init --single-…" 39 minutes ago Up 39 minutes (healthy) glance_api 2026-04-28 07:53:47.177346 | orchestrator | 79ba3e6b58d3 registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328 "dumb-init --single-…" 43 minutes ago Up 43 minutes (healthy) skyline_console 2026-04-28 07:53:47.177352 | orchestrator | 61c90d8e7ef7 registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328 "dumb-init --single-…" 44 minutes ago Up 44 minutes (healthy) skyline_apiserver 2026-04-28 07:53:47.177357 | orchestrator | 5c57e10dfe81 registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328 "dumb-init --single-…" 45 minutes ago Up 45 minutes (healthy) horizon 2026-04-28 07:53:47.177362 | orchestrator | 5d836f744bdf registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328 "dumb-init --single-…" 58 minutes ago Up 48 minutes (healthy) nova_novncproxy 2026-04-28 07:53:47.177368 | orchestrator | adeb60b9b7bd registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 48 minutes (healthy) nova_conductor 2026-04-28 07:53:47.177374 | orchestrator | b169ef416f6e registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) nova_metadata 2026-04-28 07:53:47.177385 | orchestrator | 62849c00c905 registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 48 minutes (healthy) nova_api 2026-04-28 07:53:47.177391 | orchestrator | 27db090a5586 registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 48 minutes (healthy) nova_scheduler 2026-04-28 07:53:47.177397 | orchestrator | f6b02d6c8e87 registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) neutron_server 2026-04-28 07:53:47.177403 | orchestrator | 0cea18347129 registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) placement_api 2026-04-28 07:53:47.177412 | orchestrator | 76cc0ea6a649 registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone 2026-04-28 07:53:47.177418 | orchestrator | 6e78df05f95e registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone_fernet 2026-04-28 07:53:47.177424 | orchestrator | 213ace7fd8c3 registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone_ssh 2026-04-28 07:53:47.177429 | orchestrator | 598257ed471c registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-crash" About an hour ago Up About an hour ceph-crash-testbed-node-0 2026-04-28 07:53:47.177434 | orchestrator | b0ef7428c347 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mgr -…" 2 hours ago Up 2 hours ceph-mgr-testbed-node-0 2026-04-28 07:53:47.177439 | orchestrator | e79a9ee6c12b registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mon -…" 2 hours ago Up 2 hours ceph-mon-testbed-node-0 2026-04-28 07:53:47.177444 | orchestrator | 885b56696220 registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_northd 2026-04-28 07:53:47.177450 | orchestrator | 0520397fbda1 registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_sb_db_relay_1 2026-04-28 07:53:47.177455 | orchestrator | 34bf7f87fe57 registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_sb_db 2026-04-28 07:53:47.177465 | orchestrator | 118d96f96d0e registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_nb_db 2026-04-28 07:53:47.177471 | orchestrator | 1d4857ce8b89 registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_controller 2026-04-28 07:53:47.177478 | orchestrator | 2ae4c71dc4b0 registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) openvswitch_vswitchd 2026-04-28 07:53:47.177483 | orchestrator | 73fa419208f9 registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) openvswitch_db 2026-04-28 07:53:47.177492 | orchestrator | 9173fa55a591 registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) rabbitmq 2026-04-28 07:53:47.177498 | orchestrator | e0a6e78a2fec registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328 "dumb-init -- kolla_…" 3 hours ago Up 3 hours (healthy) mariadb 2026-04-28 07:53:47.177506 | orchestrator | 29b24a6689dd registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) redis_sentinel 2026-04-28 07:53:47.177512 | orchestrator | 699aa0dc5d7c registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) redis 2026-04-28 07:53:47.177518 | orchestrator | e65b4633135b registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) memcached 2026-04-28 07:53:47.177524 | orchestrator | 9b0e1bfe6724 registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) opensearch_dashboards 2026-04-28 07:53:47.177530 | orchestrator | 46b699d27512 registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) opensearch 2026-04-28 07:53:47.177536 | orchestrator | 65fb50ab6548 registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours keepalived 2026-04-28 07:53:47.177542 | orchestrator | ef44f572b315 registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) proxysql 2026-04-28 07:53:47.177550 | orchestrator | e278d0a08629 registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) haproxy 2026-04-28 07:53:47.177555 | orchestrator | f2304db2f0e8 registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours cron 2026-04-28 07:53:47.177560 | orchestrator | 5485b09dd777 registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours kolla_toolbox 2026-04-28 07:53:47.177565 | orchestrator | 65680fa8ac1c registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours fluentd 2026-04-28 07:53:47.343453 | orchestrator | 2026-04-28 07:53:47.343607 | orchestrator | ## Images @ testbed-node-0 2026-04-28 07:53:47.343661 | orchestrator | 2026-04-28 07:53:47.343675 | orchestrator | + echo 2026-04-28 07:53:47.343687 | orchestrator | + echo '## Images @ testbed-node-0' 2026-04-28 07:53:47.343699 | orchestrator | + echo 2026-04-28 07:53:47.343710 | orchestrator | + osism container testbed-node-0 images 2026-04-28 07:53:48.876970 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-28 07:53:48.877051 | orchestrator | registry.osism.tech/kolla/release/2025.1/keepalived 2.2.8.20260328 cc29bd9a85e4 4 weeks ago 288MB 2026-04-28 07:53:48.877057 | orchestrator | registry.osism.tech/kolla/release/2025.1/opensearch-dashboards 2.19.5.20260328 f834ead10f11 4 weeks ago 1.54GB 2026-04-28 07:53:48.877085 | orchestrator | registry.osism.tech/kolla/release/2025.1/opensearch 2.19.5.20260328 d36ae5f707fb 4 weeks ago 1.57GB 2026-04-28 07:53:48.877090 | orchestrator | registry.osism.tech/kolla/release/2025.1/fluentd 5.0.9.20260328 e1596a0c11a4 4 weeks ago 590MB 2026-04-28 07:53:48.877094 | orchestrator | registry.osism.tech/kolla/release/2025.1/memcached 1.6.24.20260328 09b41eff0fc1 4 weeks ago 277MB 2026-04-28 07:53:48.877098 | orchestrator | registry.osism.tech/kolla/release/2025.1/grafana 12.4.2.20260328 3842b7ef2d0c 4 weeks ago 1.04GB 2026-04-28 07:53:48.877102 | orchestrator | registry.osism.tech/kolla/release/2025.1/proxysql 3.0.6.20260328 ccffdf9574f0 4 weeks ago 427MB 2026-04-28 07:53:48.877105 | orchestrator | registry.osism.tech/kolla/release/2025.1/rabbitmq 4.1.8.20260328 c6408fdc6cf4 4 weeks ago 350MB 2026-04-28 07:53:48.877109 | orchestrator | registry.osism.tech/kolla/release/2025.1/kolla-toolbox 20.3.1.20260328 28c0d33bbf93 4 weeks ago 683MB 2026-04-28 07:53:48.877125 | orchestrator | registry.osism.tech/kolla/release/2025.1/cron 3.0.20260328 83ceba86723e 4 weeks ago 277MB 2026-04-28 07:53:48.877129 | orchestrator | registry.osism.tech/kolla/release/2025.1/haproxy 2.8.16.20260328 cf24d3343dd6 4 weeks ago 285MB 2026-04-28 07:53:48.877133 | orchestrator | registry.osism.tech/kolla/release/2025.1/openvswitch-db-server 3.5.1.20260328 2df964b9b6ef 4 weeks ago 293MB 2026-04-28 07:53:48.877137 | orchestrator | registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd 3.5.1.20260328 d56dc4fd4981 4 weeks ago 293MB 2026-04-28 07:53:48.877140 | orchestrator | registry.osism.tech/kolla/release/2025.1/redis-sentinel 7.0.15.20260328 c513d0722dfc 4 weeks ago 284MB 2026-04-28 07:53:48.877144 | orchestrator | registry.osism.tech/kolla/release/2025.1/redis 7.0.15.20260328 0640729e8c26 4 weeks ago 284MB 2026-04-28 07:53:48.877148 | orchestrator | registry.osism.tech/kolla/release/2025.1/horizon 25.3.3.20260328 ee0ad6e2185e 4 weeks ago 1.2GB 2026-04-28 07:53:48.877152 | orchestrator | registry.osism.tech/kolla/release/2025.1/mariadb-server 10.11.16.20260328 886dcd3e3f53 4 weeks ago 463MB 2026-04-28 07:53:48.877155 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter 0.15.0.20260328 995036f125d2 4 weeks ago 309MB 2026-04-28 07:53:48.877159 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor 0.49.2.20260328 f7140e8a13d8 4 weeks ago 368MB 2026-04-28 07:53:48.877163 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter 1.8.0.20260328 c9ee75870dff 4 weeks ago 303MB 2026-04-28 07:53:48.877167 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter 0.16.0.20260328 117acc95a5ad 4 weeks ago 312MB 2026-04-28 07:53:48.877170 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter 1.8.2.20260328 4d11b36c2bda 4 weeks ago 317MB 2026-04-28 07:53:48.877174 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server 25.3.1.20260328 859fd9ce89d9 4 weeks ago 301MB 2026-04-28 07:53:48.877178 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server 25.3.1.20260328 fb0f3707730d 4 weeks ago 301MB 2026-04-28 07:53:48.877181 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-controller 25.3.1.20260328 3228ba87088e 4 weeks ago 301MB 2026-04-28 07:53:48.877185 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-northd 25.3.1.20260328 65c0953e4c39 4 weeks ago 301MB 2026-04-28 07:53:48.877189 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone 27.0.1.20260328 b31ea490ee2a 4 weeks ago 1.09GB 2026-04-28 07:53:48.877196 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone-ssh 27.0.1.20260328 40f5d9a677d1 4 weeks ago 1.06GB 2026-04-28 07:53:48.877200 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone-fernet 27.0.1.20260328 f133afc9d53b 4 weeks ago 1.05GB 2026-04-28 07:53:48.877216 | orchestrator | registry.osism.tech/kolla/release/2025.1/ceilometer-central 24.0.1.20260328 d407dd61fee1 4 weeks ago 997MB 2026-04-28 07:53:48.877220 | orchestrator | registry.osism.tech/kolla/release/2025.1/ceilometer-notification 24.0.1.20260328 a0d400ce4fdd 4 weeks ago 996MB 2026-04-28 07:53:48.877224 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-driver-agent 16.0.2.20260328 f07869d78758 4 weeks ago 1.07GB 2026-04-28 07:53:48.877228 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-api 16.0.2.20260328 7118289a0d17 4 weeks ago 1.07GB 2026-04-28 07:53:48.877231 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-worker 16.0.2.20260328 1065bc696018 4 weeks ago 1.05GB 2026-04-28 07:53:48.877235 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-health-manager 16.0.2.20260328 0adbcb202c49 4 weeks ago 1.05GB 2026-04-28 07:53:48.877239 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-housekeeping 16.0.2.20260328 1e4a4601f94f 4 weeks ago 1.05GB 2026-04-28 07:53:48.877243 | orchestrator | registry.osism.tech/kolla/release/2025.1/placement-api 13.0.0.20260328 b52f42ecbb4d 4 weeks ago 996MB 2026-04-28 07:53:48.877247 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-listener 20.0.0.20260328 afbc43250d60 4 weeks ago 995MB 2026-04-28 07:53:48.877250 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-evaluator 20.0.0.20260328 26d81adaeaae 4 weeks ago 995MB 2026-04-28 07:53:48.877258 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-notifier 20.0.0.20260328 aa74bb4c136d 4 weeks ago 995MB 2026-04-28 07:53:48.877262 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-api 20.0.0.20260328 bb920611ad39 4 weeks ago 994MB 2026-04-28 07:53:48.877265 | orchestrator | registry.osism.tech/kolla/release/2025.1/glance-api 30.1.1.20260328 525bb863082d 4 weeks ago 1.12GB 2026-04-28 07:53:48.877269 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-volume 26.2.1.20260328 78cc3d4efb57 4 weeks ago 1.79GB 2026-04-28 07:53:48.877275 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-scheduler 26.2.1.20260328 b72d2e7568f8 4 weeks ago 1.43GB 2026-04-28 07:53:48.877279 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-api 26.2.1.20260328 2583a0d99734 4 weeks ago 1.43GB 2026-04-28 07:53:48.877283 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-backup 26.2.1.20260328 a970df3ae580 4 weeks ago 1.44GB 2026-04-28 07:53:48.877287 | orchestrator | registry.osism.tech/kolla/release/2025.1/neutron-server 26.0.3.20260328 b084449c71f7 4 weeks ago 1.24GB 2026-04-28 07:53:48.877291 | orchestrator | registry.osism.tech/kolla/release/2025.1/skyline-console 6.0.1.20260328 cf9981ab1a70 4 weeks ago 1.07GB 2026-04-28 07:53:48.877295 | orchestrator | registry.osism.tech/kolla/release/2025.1/skyline-apiserver 6.0.1.20260328 d52b28f7bdf2 4 weeks ago 1.02GB 2026-04-28 07:53:48.877298 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-worker 20.0.1.20260328 10c316f8a88d 4 weeks ago 1GB 2026-04-28 07:53:48.877302 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener 20.0.1.20260328 f1c21f7912dc 4 weeks ago 1GB 2026-04-28 07:53:48.877306 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-api 20.0.1.20260328 43f0933a84ab 4 weeks ago 1GB 2026-04-28 07:53:48.877313 | orchestrator | registry.osism.tech/kolla/release/2025.1/magnum-conductor 20.0.2.20260328 8cf236db44c6 4 weeks ago 1.27GB 2026-04-28 07:53:48.877317 | orchestrator | registry.osism.tech/kolla/release/2025.1/magnum-api 20.0.2.20260328 9a37ca6883b8 4 weeks ago 1.15GB 2026-04-28 07:53:48.877321 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-backend-bind9 20.0.1.20260328 bc68ee83deb0 4 weeks ago 1.01GB 2026-04-28 07:53:48.877324 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-api 20.0.1.20260328 c0c239664d22 4 weeks ago 1GB 2026-04-28 07:53:48.877331 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-mdns 20.0.1.20260328 c268b1854421 4 weeks ago 1GB 2026-04-28 07:53:48.877335 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-worker 20.0.1.20260328 3ce3202d2f8d 4 weeks ago 1.01GB 2026-04-28 07:53:48.877338 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-central 20.0.1.20260328 50fabfae16b4 4 weeks ago 1GB 2026-04-28 07:53:48.877342 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-producer 20.0.1.20260328 23baf4bae3a6 4 weeks ago 1GB 2026-04-28 07:53:48.877346 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-api 31.2.1.20260328 7100cf172da2 4 weeks ago 1.23GB 2026-04-28 07:53:48.877350 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-novncproxy 31.2.1.20260328 003749dfd921 4 weeks ago 1.39GB 2026-04-28 07:53:48.877354 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-scheduler 31.2.1.20260328 0b8714cecfd8 4 weeks ago 1.23GB 2026-04-28 07:53:48.877358 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-conductor 31.2.1.20260328 d35210169004 4 weeks ago 1.23GB 2026-04-28 07:53:48.877361 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-data 20.0.2.20260328 5c1ce4fd1849 4 weeks ago 1.07GB 2026-04-28 07:53:48.877365 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-scheduler 20.0.2.20260328 29e4081372f9 4 weeks ago 1.07GB 2026-04-28 07:53:48.877369 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-api 20.0.2.20260328 949d0dfdab5b 4 weeks ago 1.07GB 2026-04-28 07:53:48.877373 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-share 20.0.2.20260328 d5693cb24e6d 4 weeks ago 1.24GB 2026-04-28 07:53:48.877376 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay 25.3.1.20260328 08ae9a102f53 4 weeks ago 301MB 2026-04-28 07:53:48.877380 | orchestrator | registry.osism.tech/kolla/release/rabbitmq 3.13.7.20251130 618df24dfbf4 4 months ago 322MB 2026-04-28 07:53:48.877384 | orchestrator | registry.osism.tech/kolla/release/memcached 1.6.24.20251130 8a9865997707 4 months ago 266MB 2026-04-28 07:53:48.877388 | orchestrator | registry.osism.tech/kolla/release/opensearch 2.19.4.20251130 dc62f23331d2 4 months ago 1.56GB 2026-04-28 07:53:48.877391 | orchestrator | registry.osism.tech/kolla/release/opensearch-dashboards 2.19.4.20251130 3b3613dd9b1a 4 months ago 1.53GB 2026-04-28 07:53:48.877401 | orchestrator | registry.osism.tech/kolla/release/keepalived 2.2.8.20251130 94862d07fc5a 4 months ago 276MB 2026-04-28 07:53:48.877405 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-28 07:53:48.877409 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-28 07:53:48.877413 | orchestrator | registry.osism.tech/kolla/release/grafana 12.3.0.20251130 6eb3b7b1dbf2 4 months ago 1.02GB 2026-04-28 07:53:48.877417 | orchestrator | registry.osism.tech/kolla/release/proxysql 3.0.3.20251130 2c7177938c0e 4 months ago 412MB 2026-04-28 07:53:48.877423 | orchestrator | registry.osism.tech/kolla/release/haproxy 2.8.15.20251130 6d4c583df983 4 months ago 274MB 2026-04-28 07:53:48.877427 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-28 07:53:48.877431 | orchestrator | registry.osism.tech/kolla/release/redis 7.0.15.20251130 5548a8ce5b5c 4 months ago 273MB 2026-04-28 07:53:48.877435 | orchestrator | registry.osism.tech/kolla/release/redis-sentinel 7.0.15.20251130 62d0b016058f 4 months ago 273MB 2026-04-28 07:53:48.877438 | orchestrator | registry.osism.tech/kolla/release/mariadb-server 10.11.15.20251130 77db67eebcc3 4 months ago 452MB 2026-04-28 07:53:48.877442 | orchestrator | registry.osism.tech/kolla/release/horizon 25.1.2.20251130 d7257ed845e9 4 months ago 1.15GB 2026-04-28 07:53:48.877446 | orchestrator | registry.osism.tech/kolla/release/prometheus-mysqld-exporter 0.16.0.20251130 aedc672fb472 4 months ago 301MB 2026-04-28 07:53:48.877450 | orchestrator | registry.osism.tech/kolla/release/prometheus-memcached-exporter 0.15.0.20251130 7b077076926d 4 months ago 298MB 2026-04-28 07:53:48.877453 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-28 07:53:48.877457 | orchestrator | registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter 1.8.0.20251130 bcaaf5d64345 4 months ago 292MB 2026-04-28 07:53:48.877461 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-28 07:53:48.877465 | orchestrator | registry.osism.tech/kolla/release/openvswitch-db-server 3.4.3.20251130 3e6f3fe8823c 4 months ago 279MB 2026-04-28 07:53:48.877468 | orchestrator | registry.osism.tech/kolla/release/openvswitch-vswitchd 3.4.3.20251130 ad8bb4636454 4 months ago 279MB 2026-04-28 07:53:48.877472 | orchestrator | registry.osism.tech/kolla/release/placement-api 12.0.1.20251130 20317ff6dfb9 4 months ago 975MB 2026-04-28 07:53:48.877476 | orchestrator | registry.osism.tech/kolla/release/nova-novncproxy 30.2.1.20251130 99323056afa4 4 months ago 1.37GB 2026-04-28 07:53:48.877480 | orchestrator | registry.osism.tech/kolla/release/nova-conductor 30.2.1.20251130 92609e648215 4 months ago 1.21GB 2026-04-28 07:53:48.877484 | orchestrator | registry.osism.tech/kolla/release/nova-api 30.2.1.20251130 2d78e7fdfb9a 4 months ago 1.21GB 2026-04-28 07:53:48.877487 | orchestrator | registry.osism.tech/kolla/release/nova-scheduler 30.2.1.20251130 4c3c59730530 4 months ago 1.21GB 2026-04-28 07:53:48.877491 | orchestrator | registry.osism.tech/kolla/release/ceilometer-central 23.0.2.20251130 37cb6975d4a5 4 months ago 976MB 2026-04-28 07:53:48.877495 | orchestrator | registry.osism.tech/kolla/release/ceilometer-notification 23.0.2.20251130 bb2927b293dc 4 months ago 976MB 2026-04-28 07:53:48.877499 | orchestrator | registry.osism.tech/kolla/release/magnum-api 19.0.1.20251130 a85fdbb4bbba 4 months ago 1.13GB 2026-04-28 07:53:48.877503 | orchestrator | registry.osism.tech/kolla/release/magnum-conductor 19.0.1.20251130 a98ee1099aad 4 months ago 1.24GB 2026-04-28 07:53:48.877506 | orchestrator | registry.osism.tech/kolla/release/manila-share 19.1.1.20251130 df44f491f2c1 4 months ago 1.22GB 2026-04-28 07:53:48.877510 | orchestrator | registry.osism.tech/kolla/release/manila-data 19.1.1.20251130 cd8b74c8a47a 4 months ago 1.06GB 2026-04-28 07:53:48.877514 | orchestrator | registry.osism.tech/kolla/release/manila-api 19.1.1.20251130 654f9bd3c940 4 months ago 1.05GB 2026-04-28 07:53:48.877521 | orchestrator | registry.osism.tech/kolla/release/manila-scheduler 19.1.1.20251130 e0864fa03a78 4 months ago 1.05GB 2026-04-28 07:53:48.877527 | orchestrator | registry.osism.tech/kolla/release/aodh-listener 19.0.0.20251130 1e68c23a9d38 4 months ago 974MB 2026-04-28 07:53:48.877531 | orchestrator | registry.osism.tech/kolla/release/aodh-evaluator 19.0.0.20251130 1726a7592f93 4 months ago 974MB 2026-04-28 07:53:48.877534 | orchestrator | registry.osism.tech/kolla/release/aodh-notifier 19.0.0.20251130 abbd6e9f87e2 4 months ago 974MB 2026-04-28 07:53:48.877538 | orchestrator | registry.osism.tech/kolla/release/aodh-api 19.0.0.20251130 82a64f1d056d 4 months ago 973MB 2026-04-28 07:53:48.877542 | orchestrator | registry.osism.tech/kolla/release/barbican-worker 19.0.1.20251130 2cef5d51872b 4 months ago 991MB 2026-04-28 07:53:48.877546 | orchestrator | registry.osism.tech/kolla/release/barbican-keystone-listener 19.0.1.20251130 bfcd8631a126 4 months ago 991MB 2026-04-28 07:53:48.877549 | orchestrator | registry.osism.tech/kolla/release/barbican-api 19.0.1.20251130 9195ddc3e4c5 4 months ago 990MB 2026-04-28 07:53:48.877556 | orchestrator | registry.osism.tech/kolla/release/keystone 26.0.1.20251130 6c1543e94c06 4 months ago 1.09GB 2026-04-28 07:53:48.877559 | orchestrator | registry.osism.tech/kolla/release/keystone-fernet 26.0.1.20251130 36669c355898 4 months ago 1.04GB 2026-04-28 07:53:48.877563 | orchestrator | registry.osism.tech/kolla/release/keystone-ssh 26.0.1.20251130 e002cffc8eb8 4 months ago 1.04GB 2026-04-28 07:53:48.877569 | orchestrator | registry.osism.tech/kolla/release/octavia-health-manager 15.0.2.20251130 059dc6d4a159 4 months ago 1.03GB 2026-04-28 07:53:48.877573 | orchestrator | registry.osism.tech/kolla/release/octavia-housekeeping 15.0.2.20251130 c9059accdc4a 4 months ago 1.03GB 2026-04-28 07:53:48.877577 | orchestrator | registry.osism.tech/kolla/release/octavia-api 15.0.2.20251130 9375641bed7a 4 months ago 1.05GB 2026-04-28 07:53:48.877581 | orchestrator | registry.osism.tech/kolla/release/octavia-worker 15.0.2.20251130 708f50e37fa7 4 months ago 1.03GB 2026-04-28 07:53:48.877585 | orchestrator | registry.osism.tech/kolla/release/octavia-driver-agent 15.0.2.20251130 045f928baedc 4 months ago 1.05GB 2026-04-28 07:53:48.877588 | orchestrator | registry.osism.tech/kolla/release/neutron-server 25.2.2.20251130 fa71fe0a109e 4 months ago 1.16GB 2026-04-28 07:53:48.877592 | orchestrator | registry.osism.tech/kolla/release/glance-api 29.0.1.20251130 b1fcfbc49057 4 months ago 1.1GB 2026-04-28 07:53:48.877596 | orchestrator | registry.osism.tech/kolla/release/designate-central 19.0.1.20251130 00b6af03994a 4 months ago 983MB 2026-04-28 07:53:48.877600 | orchestrator | registry.osism.tech/kolla/release/designate-worker 19.0.1.20251130 18bc80370e46 4 months ago 989MB 2026-04-28 07:53:48.877603 | orchestrator | registry.osism.tech/kolla/release/designate-producer 19.0.1.20251130 eac4506bf51f 4 months ago 984MB 2026-04-28 07:53:48.877607 | orchestrator | registry.osism.tech/kolla/release/designate-api 19.0.1.20251130 ad5d5cd1392a 4 months ago 984MB 2026-04-28 07:53:48.877611 | orchestrator | registry.osism.tech/kolla/release/designate-backend-bind9 19.0.1.20251130 4e19a1dc9c8a 4 months ago 989MB 2026-04-28 07:53:48.877615 | orchestrator | registry.osism.tech/kolla/release/designate-mdns 19.0.1.20251130 4ad9e0017d6e 4 months ago 984MB 2026-04-28 07:53:48.877619 | orchestrator | registry.osism.tech/kolla/release/skyline-console 5.0.1.20251130 20430a0acd38 4 months ago 1.05GB 2026-04-28 07:53:48.877643 | orchestrator | registry.osism.tech/kolla/release/skyline-apiserver 5.0.1.20251130 20bbe1600b66 4 months ago 990MB 2026-04-28 07:53:48.877647 | orchestrator | registry.osism.tech/kolla/release/cinder-volume 25.3.1.20251130 ab7ee3c06214 4 months ago 1.72GB 2026-04-28 07:53:48.877651 | orchestrator | registry.osism.tech/kolla/release/cinder-scheduler 25.3.1.20251130 47d31cd2c25d 4 months ago 1.4GB 2026-04-28 07:53:48.877654 | orchestrator | registry.osism.tech/kolla/release/cinder-backup 25.3.1.20251130 c09074b62f18 4 months ago 1.41GB 2026-04-28 07:53:48.877658 | orchestrator | registry.osism.tech/kolla/release/cinder-api 25.3.1.20251130 ceaaac81e8af 4 months ago 1.4GB 2026-04-28 07:53:48.877662 | orchestrator | registry.osism.tech/kolla/release/ovn-controller 24.9.3.20251130 fcd09e53d925 4 months ago 840MB 2026-04-28 07:53:48.877667 | orchestrator | registry.osism.tech/kolla/release/ovn-nb-db-server 24.9.3.20251130 e52b6499881a 4 months ago 840MB 2026-04-28 07:53:48.877671 | orchestrator | registry.osism.tech/kolla/release/ovn-sb-db-server 24.9.3.20251130 2fcefdb5b030 4 months ago 840MB 2026-04-28 07:53:48.877675 | orchestrator | registry.osism.tech/kolla/release/ovn-northd 24.9.3.20251130 948e5d22de86 4 months ago 840MB 2026-04-28 07:53:48.877679 | orchestrator | registry.osism.tech/osism/ceph-daemon 18.2.7 5f92363b1f93 11 months ago 1.27GB 2026-04-28 07:53:49.026897 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-28 07:53:49.027044 | orchestrator | ++ semver 10.0.0 5.0.0 2026-04-28 07:53:49.079062 | orchestrator | 2026-04-28 07:53:49.079130 | orchestrator | ## Containers @ testbed-node-1 2026-04-28 07:53:49.079137 | orchestrator | 2026-04-28 07:53:49.079142 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-28 07:53:49.079147 | orchestrator | + echo 2026-04-28 07:53:49.079153 | orchestrator | + echo '## Containers @ testbed-node-1' 2026-04-28 07:53:49.079159 | orchestrator | + echo 2026-04-28 07:53:49.079163 | orchestrator | + osism container testbed-node-1 ps 2026-04-28 07:53:50.616032 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-28 07:53:50.616132 | orchestrator | 3956d4d407dc registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328 "dumb-init --single-…" 14 seconds ago Up 13 seconds (health: starting) magnum_conductor 2026-04-28 07:53:50.616151 | orchestrator | fbaa60352143 registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328 "dumb-init --single-…" 38 seconds ago Up 36 seconds (healthy) magnum_api 2026-04-28 07:53:50.616164 | orchestrator | 51096dfdbe02 registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328 "dumb-init --single-…" 3 minutes ago Up 3 minutes grafana 2026-04-28 07:53:50.616175 | orchestrator | 3ab94f3d7066 registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_elasticsearch_exporter 2026-04-28 07:53:50.616189 | orchestrator | fbbc8f6a2456 registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_cadvisor 2026-04-28 07:53:50.616201 | orchestrator | 0bc722c85210 registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_memcached_exporter 2026-04-28 07:53:50.616212 | orchestrator | 45a5a50aff40 registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_mysqld_exporter 2026-04-28 07:53:50.616248 | orchestrator | 01235f4fa0ce registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_node_exporter 2026-04-28 07:53:50.616278 | orchestrator | a22130719c18 registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328 "dumb-init --single-…" 10 minutes ago Up 10 minutes (healthy) manila_share 2026-04-28 07:53:50.616290 | orchestrator | 5534a9d018ef registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328 "dumb-init --single-…" 12 minutes ago Up 12 minutes (healthy) manila_scheduler 2026-04-28 07:53:50.616301 | orchestrator | 885ce00f599c registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328 "dumb-init --single-…" 12 minutes ago Up 12 minutes (healthy) manila_data 2026-04-28 07:53:50.616311 | orchestrator | 15cd09039745 registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_api 2026-04-28 07:53:50.616323 | orchestrator | c04f25ae2be0 registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) octavia_worker 2026-04-28 07:53:50.616333 | orchestrator | 63a7c803db4a registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) octavia_housekeeping 2026-04-28 07:53:50.616344 | orchestrator | a656259c28e2 registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) octavia_health_manager 2026-04-28 07:53:50.616355 | orchestrator | fac76b4b25ab registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 15 minutes octavia_driver_agent 2026-04-28 07:53:50.616366 | orchestrator | 8213ec4011d0 registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes (healthy) octavia_api 2026-04-28 07:53:50.616393 | orchestrator | bc35f0bf899b registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328 "dumb-init --single-…" 19 minutes ago Up 19 minutes (healthy) aodh_notifier 2026-04-28 07:53:50.616405 | orchestrator | 3dfecc29979d registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328 "dumb-init --single-…" 19 minutes ago Up 19 minutes (healthy) aodh_listener 2026-04-28 07:53:50.616416 | orchestrator | f411b55edf75 registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328 "dumb-init --single-…" 20 minutes ago Up 19 minutes (healthy) aodh_evaluator 2026-04-28 07:53:50.616427 | orchestrator | d046c0af7e2e registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) aodh_api 2026-04-28 07:53:50.616438 | orchestrator | d6db3c6aa783 registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328 "dumb-init --single-…" 21 minutes ago Up 21 minutes ceilometer_central 2026-04-28 07:53:50.616449 | orchestrator | ba10b18efb1d registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328 "dumb-init --single-…" 22 minutes ago Up 22 minutes (healthy) ceilometer_notification 2026-04-28 07:53:50.616460 | orchestrator | 0b11b69fdead registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328 "dumb-init --single-…" 24 minutes ago Up 24 minutes (healthy) designate_worker 2026-04-28 07:53:50.616479 | orchestrator | 138a0e421afd registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328 "dumb-init --single-…" 24 minutes ago Up 24 minutes (healthy) designate_mdns 2026-04-28 07:53:50.616489 | orchestrator | 6bcb61ce46ec registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328 "dumb-init --single-…" 25 minutes ago Up 25 minutes (healthy) designate_producer 2026-04-28 07:53:50.616506 | orchestrator | 980a50a0c1b5 registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_central 2026-04-28 07:53:50.616524 | orchestrator | be37627f7c0d registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_api 2026-04-28 07:53:50.616543 | orchestrator | 5171718ba336 registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_backend_bind9 2026-04-28 07:53:50.616624 | orchestrator | 8a0eb7706b7c registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_worker 2026-04-28 07:53:50.616673 | orchestrator | e9c9c264a019 registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_keystone_listener 2026-04-28 07:53:50.616694 | orchestrator | 85d5cc0db647 registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328 "dumb-init --single-…" 29 minutes ago Up 29 minutes (healthy) barbican_api 2026-04-28 07:53:50.616714 | orchestrator | 272b8528cec2 registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328 "dumb-init --single-…" 33 minutes ago Up 32 minutes (healthy) cinder_backup 2026-04-28 07:53:50.616734 | orchestrator | 5b700359e7e4 registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328 "dumb-init --single-…" 33 minutes ago Up 32 minutes (healthy) cinder_volume 2026-04-28 07:53:50.616753 | orchestrator | 54f167fc593d registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328 "dumb-init --single-…" 34 minutes ago Up 32 minutes (healthy) cinder_scheduler 2026-04-28 07:53:50.616767 | orchestrator | 024568fa980f registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328 "dumb-init --single-…" 34 minutes ago Up 32 minutes (healthy) cinder_api 2026-04-28 07:53:50.616790 | orchestrator | 08df7c568387 registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328 "dumb-init --single-…" 39 minutes ago Up 38 minutes (healthy) glance_api 2026-04-28 07:53:50.616803 | orchestrator | 0f55b62510e2 registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328 "dumb-init --single-…" 43 minutes ago Up 43 minutes (healthy) skyline_console 2026-04-28 07:53:50.616816 | orchestrator | e140f3a5c470 registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328 "dumb-init --single-…" 44 minutes ago Up 44 minutes (healthy) skyline_apiserver 2026-04-28 07:53:50.616842 | orchestrator | c4166f026440 registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328 "dumb-init --single-…" 45 minutes ago Up 45 minutes (healthy) horizon 2026-04-28 07:53:50.616864 | orchestrator | e461ec083422 registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328 "dumb-init --single-…" 58 minutes ago Up 48 minutes (healthy) nova_novncproxy 2026-04-28 07:53:50.616877 | orchestrator | c48b92b6a7d1 registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328 "dumb-init --single-…" 59 minutes ago Up 48 minutes (healthy) nova_conductor 2026-04-28 07:53:50.616890 | orchestrator | 19d08aa96df8 registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) nova_metadata 2026-04-28 07:53:50.616903 | orchestrator | 394c80041b58 registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 48 minutes (healthy) nova_api 2026-04-28 07:53:50.617033 | orchestrator | 17b69d848d65 registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 48 minutes (healthy) nova_scheduler 2026-04-28 07:53:50.617048 | orchestrator | 95cb72f7111d registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) neutron_server 2026-04-28 07:53:50.617059 | orchestrator | 137a444ef3c2 registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) placement_api 2026-04-28 07:53:50.617070 | orchestrator | 71728f5adf7c registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone 2026-04-28 07:53:50.617081 | orchestrator | 59a9818fcc79 registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone_fernet 2026-04-28 07:53:50.617093 | orchestrator | 1b7b6f62c8e2 registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone_ssh 2026-04-28 07:53:50.617104 | orchestrator | b0c9a5a3ab7c registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-crash" About an hour ago Up About an hour ceph-crash-testbed-node-1 2026-04-28 07:53:50.617114 | orchestrator | f632119eef3f registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mgr -…" 2 hours ago Up 2 hours ceph-mgr-testbed-node-1 2026-04-28 07:53:50.617125 | orchestrator | 00fb93644bb9 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mon -…" 2 hours ago Up 2 hours ceph-mon-testbed-node-1 2026-04-28 07:53:50.617136 | orchestrator | dbafab95cb7c registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_northd 2026-04-28 07:53:50.617147 | orchestrator | dd9e8cad4ac2 registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_sb_db_relay_1 2026-04-28 07:53:50.617157 | orchestrator | 6f671b750ca5 registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_sb_db 2026-04-28 07:53:50.617168 | orchestrator | edaf2315d703 registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_nb_db 2026-04-28 07:53:50.617186 | orchestrator | c514e7fb4b73 registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_controller 2026-04-28 07:53:50.617197 | orchestrator | dcc3b9d7b4b4 registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) openvswitch_vswitchd 2026-04-28 07:53:50.617208 | orchestrator | d5521945269b registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) openvswitch_db 2026-04-28 07:53:50.617218 | orchestrator | 5a4099530e0a registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) rabbitmq 2026-04-28 07:53:50.617229 | orchestrator | a415abcd6fd8 registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328 "dumb-init -- kolla_…" 3 hours ago Up 3 hours (healthy) mariadb 2026-04-28 07:53:50.617240 | orchestrator | 3e72d160b746 registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) redis_sentinel 2026-04-28 07:53:50.617257 | orchestrator | 8914927f7629 registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) redis 2026-04-28 07:53:50.617269 | orchestrator | 1e559ffd680a registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) memcached 2026-04-28 07:53:50.617280 | orchestrator | e51c6ff2ba06 registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) opensearch_dashboards 2026-04-28 07:53:50.617290 | orchestrator | e596da796216 registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) opensearch 2026-04-28 07:53:50.617301 | orchestrator | a7ed197ee787 registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours keepalived 2026-04-28 07:53:50.617312 | orchestrator | f7918a753543 registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) proxysql 2026-04-28 07:53:50.617323 | orchestrator | b4c3d00dc773 registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) haproxy 2026-04-28 07:53:50.617334 | orchestrator | 0d6049234526 registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours cron 2026-04-28 07:53:50.617345 | orchestrator | fda4ea7aa905 registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours kolla_toolbox 2026-04-28 07:53:50.617356 | orchestrator | 5efced1b86ec registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours fluentd 2026-04-28 07:53:50.805750 | orchestrator | 2026-04-28 07:53:50.805843 | orchestrator | ## Images @ testbed-node-1 2026-04-28 07:53:50.805859 | orchestrator | 2026-04-28 07:53:50.805871 | orchestrator | + echo 2026-04-28 07:53:50.805883 | orchestrator | + echo '## Images @ testbed-node-1' 2026-04-28 07:53:50.805921 | orchestrator | + echo 2026-04-28 07:53:50.805933 | orchestrator | + osism container testbed-node-1 images 2026-04-28 07:53:52.366690 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-28 07:53:52.366820 | orchestrator | registry.osism.tech/kolla/release/2025.1/keepalived 2.2.8.20260328 cc29bd9a85e4 4 weeks ago 288MB 2026-04-28 07:53:52.366838 | orchestrator | registry.osism.tech/kolla/release/2025.1/opensearch-dashboards 2.19.5.20260328 f834ead10f11 4 weeks ago 1.54GB 2026-04-28 07:53:52.366850 | orchestrator | registry.osism.tech/kolla/release/2025.1/opensearch 2.19.5.20260328 d36ae5f707fb 4 weeks ago 1.57GB 2026-04-28 07:53:52.366861 | orchestrator | registry.osism.tech/kolla/release/2025.1/fluentd 5.0.9.20260328 e1596a0c11a4 4 weeks ago 590MB 2026-04-28 07:53:52.366920 | orchestrator | registry.osism.tech/kolla/release/2025.1/memcached 1.6.24.20260328 09b41eff0fc1 4 weeks ago 277MB 2026-04-28 07:53:52.366934 | orchestrator | registry.osism.tech/kolla/release/2025.1/grafana 12.4.2.20260328 3842b7ef2d0c 4 weeks ago 1.04GB 2026-04-28 07:53:52.366958 | orchestrator | registry.osism.tech/kolla/release/2025.1/proxysql 3.0.6.20260328 ccffdf9574f0 4 weeks ago 427MB 2026-04-28 07:53:52.366970 | orchestrator | registry.osism.tech/kolla/release/2025.1/rabbitmq 4.1.8.20260328 c6408fdc6cf4 4 weeks ago 350MB 2026-04-28 07:53:52.366981 | orchestrator | registry.osism.tech/kolla/release/2025.1/kolla-toolbox 20.3.1.20260328 28c0d33bbf93 4 weeks ago 683MB 2026-04-28 07:53:52.366993 | orchestrator | registry.osism.tech/kolla/release/2025.1/cron 3.0.20260328 83ceba86723e 4 weeks ago 277MB 2026-04-28 07:53:52.367003 | orchestrator | registry.osism.tech/kolla/release/2025.1/haproxy 2.8.16.20260328 cf24d3343dd6 4 weeks ago 285MB 2026-04-28 07:53:52.367014 | orchestrator | registry.osism.tech/kolla/release/2025.1/openvswitch-db-server 3.5.1.20260328 2df964b9b6ef 4 weeks ago 293MB 2026-04-28 07:53:52.367026 | orchestrator | registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd 3.5.1.20260328 d56dc4fd4981 4 weeks ago 293MB 2026-04-28 07:53:52.367037 | orchestrator | registry.osism.tech/kolla/release/2025.1/redis-sentinel 7.0.15.20260328 c513d0722dfc 4 weeks ago 284MB 2026-04-28 07:53:52.367048 | orchestrator | registry.osism.tech/kolla/release/2025.1/redis 7.0.15.20260328 0640729e8c26 4 weeks ago 284MB 2026-04-28 07:53:52.367059 | orchestrator | registry.osism.tech/kolla/release/2025.1/horizon 25.3.3.20260328 ee0ad6e2185e 4 weeks ago 1.2GB 2026-04-28 07:53:52.367070 | orchestrator | registry.osism.tech/kolla/release/2025.1/mariadb-server 10.11.16.20260328 886dcd3e3f53 4 weeks ago 463MB 2026-04-28 07:53:52.367081 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter 0.15.0.20260328 995036f125d2 4 weeks ago 309MB 2026-04-28 07:53:52.367092 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor 0.49.2.20260328 f7140e8a13d8 4 weeks ago 368MB 2026-04-28 07:53:52.367103 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter 1.8.0.20260328 c9ee75870dff 4 weeks ago 303MB 2026-04-28 07:53:52.367114 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter 0.16.0.20260328 117acc95a5ad 4 weeks ago 312MB 2026-04-28 07:53:52.367125 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter 1.8.2.20260328 4d11b36c2bda 4 weeks ago 317MB 2026-04-28 07:53:52.367136 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server 25.3.1.20260328 859fd9ce89d9 4 weeks ago 301MB 2026-04-28 07:53:52.367149 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server 25.3.1.20260328 fb0f3707730d 4 weeks ago 301MB 2026-04-28 07:53:52.367182 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-northd 25.3.1.20260328 65c0953e4c39 4 weeks ago 301MB 2026-04-28 07:53:52.367196 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-controller 25.3.1.20260328 3228ba87088e 4 weeks ago 301MB 2026-04-28 07:53:52.367208 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone 27.0.1.20260328 b31ea490ee2a 4 weeks ago 1.09GB 2026-04-28 07:53:52.367221 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone-ssh 27.0.1.20260328 40f5d9a677d1 4 weeks ago 1.06GB 2026-04-28 07:53:52.367233 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone-fernet 27.0.1.20260328 f133afc9d53b 4 weeks ago 1.05GB 2026-04-28 07:53:52.367266 | orchestrator | registry.osism.tech/kolla/release/2025.1/ceilometer-central 24.0.1.20260328 d407dd61fee1 4 weeks ago 997MB 2026-04-28 07:53:52.367280 | orchestrator | registry.osism.tech/kolla/release/2025.1/ceilometer-notification 24.0.1.20260328 a0d400ce4fdd 4 weeks ago 996MB 2026-04-28 07:53:52.367293 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-driver-agent 16.0.2.20260328 f07869d78758 4 weeks ago 1.07GB 2026-04-28 07:53:52.367306 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-api 16.0.2.20260328 7118289a0d17 4 weeks ago 1.07GB 2026-04-28 07:53:52.367318 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-worker 16.0.2.20260328 1065bc696018 4 weeks ago 1.05GB 2026-04-28 07:53:52.367332 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-health-manager 16.0.2.20260328 0adbcb202c49 4 weeks ago 1.05GB 2026-04-28 07:53:52.367345 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-housekeeping 16.0.2.20260328 1e4a4601f94f 4 weeks ago 1.05GB 2026-04-28 07:53:52.367358 | orchestrator | registry.osism.tech/kolla/release/2025.1/placement-api 13.0.0.20260328 b52f42ecbb4d 4 weeks ago 996MB 2026-04-28 07:53:52.367371 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-listener 20.0.0.20260328 afbc43250d60 4 weeks ago 995MB 2026-04-28 07:53:52.367383 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-evaluator 20.0.0.20260328 26d81adaeaae 4 weeks ago 995MB 2026-04-28 07:53:52.367396 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-notifier 20.0.0.20260328 aa74bb4c136d 4 weeks ago 995MB 2026-04-28 07:53:52.367409 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-api 20.0.0.20260328 bb920611ad39 4 weeks ago 994MB 2026-04-28 07:53:52.367421 | orchestrator | registry.osism.tech/kolla/release/2025.1/glance-api 30.1.1.20260328 525bb863082d 4 weeks ago 1.12GB 2026-04-28 07:53:52.367435 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-volume 26.2.1.20260328 78cc3d4efb57 4 weeks ago 1.79GB 2026-04-28 07:53:52.367447 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-scheduler 26.2.1.20260328 b72d2e7568f8 4 weeks ago 1.43GB 2026-04-28 07:53:52.367460 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-api 26.2.1.20260328 2583a0d99734 4 weeks ago 1.43GB 2026-04-28 07:53:52.367474 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-backup 26.2.1.20260328 a970df3ae580 4 weeks ago 1.44GB 2026-04-28 07:53:52.367486 | orchestrator | registry.osism.tech/kolla/release/2025.1/neutron-server 26.0.3.20260328 b084449c71f7 4 weeks ago 1.24GB 2026-04-28 07:53:52.367499 | orchestrator | registry.osism.tech/kolla/release/2025.1/skyline-console 6.0.1.20260328 cf9981ab1a70 4 weeks ago 1.07GB 2026-04-28 07:53:52.367512 | orchestrator | registry.osism.tech/kolla/release/2025.1/skyline-apiserver 6.0.1.20260328 d52b28f7bdf2 4 weeks ago 1.02GB 2026-04-28 07:53:52.367532 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-worker 20.0.1.20260328 10c316f8a88d 4 weeks ago 1GB 2026-04-28 07:53:52.367544 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener 20.0.1.20260328 f1c21f7912dc 4 weeks ago 1GB 2026-04-28 07:53:52.367555 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-api 20.0.1.20260328 43f0933a84ab 4 weeks ago 1GB 2026-04-28 07:53:52.367566 | orchestrator | registry.osism.tech/kolla/release/2025.1/magnum-conductor 20.0.2.20260328 8cf236db44c6 4 weeks ago 1.27GB 2026-04-28 07:53:52.367577 | orchestrator | registry.osism.tech/kolla/release/2025.1/magnum-api 20.0.2.20260328 9a37ca6883b8 4 weeks ago 1.15GB 2026-04-28 07:53:52.367588 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-backend-bind9 20.0.1.20260328 bc68ee83deb0 4 weeks ago 1.01GB 2026-04-28 07:53:52.367599 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-api 20.0.1.20260328 c0c239664d22 4 weeks ago 1GB 2026-04-28 07:53:52.367610 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-mdns 20.0.1.20260328 c268b1854421 4 weeks ago 1GB 2026-04-28 07:53:52.367621 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-worker 20.0.1.20260328 3ce3202d2f8d 4 weeks ago 1.01GB 2026-04-28 07:53:52.367674 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-central 20.0.1.20260328 50fabfae16b4 4 weeks ago 1GB 2026-04-28 07:53:52.367688 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-producer 20.0.1.20260328 23baf4bae3a6 4 weeks ago 1GB 2026-04-28 07:53:52.367706 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-api 31.2.1.20260328 7100cf172da2 4 weeks ago 1.23GB 2026-04-28 07:53:52.367718 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-novncproxy 31.2.1.20260328 003749dfd921 4 weeks ago 1.39GB 2026-04-28 07:53:52.367735 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-scheduler 31.2.1.20260328 0b8714cecfd8 4 weeks ago 1.23GB 2026-04-28 07:53:52.367747 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-conductor 31.2.1.20260328 d35210169004 4 weeks ago 1.23GB 2026-04-28 07:53:52.367758 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-data 20.0.2.20260328 5c1ce4fd1849 4 weeks ago 1.07GB 2026-04-28 07:53:52.367769 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-scheduler 20.0.2.20260328 29e4081372f9 4 weeks ago 1.07GB 2026-04-28 07:53:52.367780 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-api 20.0.2.20260328 949d0dfdab5b 4 weeks ago 1.07GB 2026-04-28 07:53:52.367795 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-share 20.0.2.20260328 d5693cb24e6d 4 weeks ago 1.24GB 2026-04-28 07:53:52.367813 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay 25.3.1.20260328 08ae9a102f53 4 weeks ago 301MB 2026-04-28 07:53:52.367831 | orchestrator | registry.osism.tech/kolla/release/rabbitmq 3.13.7.20251130 618df24dfbf4 4 months ago 322MB 2026-04-28 07:53:52.367849 | orchestrator | registry.osism.tech/kolla/release/memcached 1.6.24.20251130 8a9865997707 4 months ago 266MB 2026-04-28 07:53:52.367866 | orchestrator | registry.osism.tech/kolla/release/opensearch 2.19.4.20251130 dc62f23331d2 4 months ago 1.56GB 2026-04-28 07:53:52.367884 | orchestrator | registry.osism.tech/kolla/release/keepalived 2.2.8.20251130 94862d07fc5a 4 months ago 276MB 2026-04-28 07:53:52.367902 | orchestrator | registry.osism.tech/kolla/release/opensearch-dashboards 2.19.4.20251130 3b3613dd9b1a 4 months ago 1.53GB 2026-04-28 07:53:52.367932 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-28 07:53:52.367952 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-28 07:53:52.367971 | orchestrator | registry.osism.tech/kolla/release/grafana 12.3.0.20251130 6eb3b7b1dbf2 4 months ago 1.02GB 2026-04-28 07:53:52.367990 | orchestrator | registry.osism.tech/kolla/release/proxysql 3.0.3.20251130 2c7177938c0e 4 months ago 412MB 2026-04-28 07:53:52.368008 | orchestrator | registry.osism.tech/kolla/release/haproxy 2.8.15.20251130 6d4c583df983 4 months ago 274MB 2026-04-28 07:53:52.368026 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-28 07:53:52.368038 | orchestrator | registry.osism.tech/kolla/release/redis 7.0.15.20251130 5548a8ce5b5c 4 months ago 273MB 2026-04-28 07:53:52.368054 | orchestrator | registry.osism.tech/kolla/release/redis-sentinel 7.0.15.20251130 62d0b016058f 4 months ago 273MB 2026-04-28 07:53:52.368065 | orchestrator | registry.osism.tech/kolla/release/mariadb-server 10.11.15.20251130 77db67eebcc3 4 months ago 452MB 2026-04-28 07:53:52.368077 | orchestrator | registry.osism.tech/kolla/release/horizon 25.1.2.20251130 d7257ed845e9 4 months ago 1.15GB 2026-04-28 07:53:52.368096 | orchestrator | registry.osism.tech/kolla/release/prometheus-mysqld-exporter 0.16.0.20251130 aedc672fb472 4 months ago 301MB 2026-04-28 07:53:52.368108 | orchestrator | registry.osism.tech/kolla/release/prometheus-memcached-exporter 0.15.0.20251130 7b077076926d 4 months ago 298MB 2026-04-28 07:53:52.368119 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-28 07:53:52.368130 | orchestrator | registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter 1.8.0.20251130 bcaaf5d64345 4 months ago 292MB 2026-04-28 07:53:52.368141 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-28 07:53:52.368152 | orchestrator | registry.osism.tech/kolla/release/openvswitch-db-server 3.4.3.20251130 3e6f3fe8823c 4 months ago 279MB 2026-04-28 07:53:52.368171 | orchestrator | registry.osism.tech/kolla/release/placement-api 12.0.1.20251130 20317ff6dfb9 4 months ago 975MB 2026-04-28 07:53:52.368182 | orchestrator | registry.osism.tech/kolla/release/openvswitch-vswitchd 3.4.3.20251130 ad8bb4636454 4 months ago 279MB 2026-04-28 07:53:52.368193 | orchestrator | registry.osism.tech/kolla/release/nova-novncproxy 30.2.1.20251130 99323056afa4 4 months ago 1.37GB 2026-04-28 07:53:52.368204 | orchestrator | registry.osism.tech/kolla/release/nova-conductor 30.2.1.20251130 92609e648215 4 months ago 1.21GB 2026-04-28 07:53:52.368215 | orchestrator | registry.osism.tech/kolla/release/nova-api 30.2.1.20251130 2d78e7fdfb9a 4 months ago 1.21GB 2026-04-28 07:53:52.368226 | orchestrator | registry.osism.tech/kolla/release/nova-scheduler 30.2.1.20251130 4c3c59730530 4 months ago 1.21GB 2026-04-28 07:53:52.368237 | orchestrator | registry.osism.tech/kolla/release/ceilometer-central 23.0.2.20251130 37cb6975d4a5 4 months ago 976MB 2026-04-28 07:53:52.368247 | orchestrator | registry.osism.tech/kolla/release/ceilometer-notification 23.0.2.20251130 bb2927b293dc 4 months ago 976MB 2026-04-28 07:53:52.368265 | orchestrator | registry.osism.tech/kolla/release/magnum-api 19.0.1.20251130 a85fdbb4bbba 4 months ago 1.13GB 2026-04-28 07:53:52.368284 | orchestrator | registry.osism.tech/kolla/release/magnum-conductor 19.0.1.20251130 a98ee1099aad 4 months ago 1.24GB 2026-04-28 07:53:52.368295 | orchestrator | registry.osism.tech/kolla/release/manila-share 19.1.1.20251130 df44f491f2c1 4 months ago 1.22GB 2026-04-28 07:53:52.368306 | orchestrator | registry.osism.tech/kolla/release/manila-data 19.1.1.20251130 cd8b74c8a47a 4 months ago 1.06GB 2026-04-28 07:53:52.368317 | orchestrator | registry.osism.tech/kolla/release/manila-api 19.1.1.20251130 654f9bd3c940 4 months ago 1.05GB 2026-04-28 07:53:52.368328 | orchestrator | registry.osism.tech/kolla/release/manila-scheduler 19.1.1.20251130 e0864fa03a78 4 months ago 1.05GB 2026-04-28 07:53:52.368339 | orchestrator | registry.osism.tech/kolla/release/aodh-listener 19.0.0.20251130 1e68c23a9d38 4 months ago 974MB 2026-04-28 07:53:52.368350 | orchestrator | registry.osism.tech/kolla/release/aodh-evaluator 19.0.0.20251130 1726a7592f93 4 months ago 974MB 2026-04-28 07:53:52.368361 | orchestrator | registry.osism.tech/kolla/release/aodh-notifier 19.0.0.20251130 abbd6e9f87e2 4 months ago 974MB 2026-04-28 07:53:52.368372 | orchestrator | registry.osism.tech/kolla/release/aodh-api 19.0.0.20251130 82a64f1d056d 4 months ago 973MB 2026-04-28 07:53:52.368383 | orchestrator | registry.osism.tech/kolla/release/barbican-worker 19.0.1.20251130 2cef5d51872b 4 months ago 991MB 2026-04-28 07:53:52.368394 | orchestrator | registry.osism.tech/kolla/release/barbican-keystone-listener 19.0.1.20251130 bfcd8631a126 4 months ago 991MB 2026-04-28 07:53:52.368405 | orchestrator | registry.osism.tech/kolla/release/barbican-api 19.0.1.20251130 9195ddc3e4c5 4 months ago 990MB 2026-04-28 07:53:52.368416 | orchestrator | registry.osism.tech/kolla/release/keystone 26.0.1.20251130 6c1543e94c06 4 months ago 1.09GB 2026-04-28 07:53:52.368427 | orchestrator | registry.osism.tech/kolla/release/keystone-fernet 26.0.1.20251130 36669c355898 4 months ago 1.04GB 2026-04-28 07:53:52.368438 | orchestrator | registry.osism.tech/kolla/release/keystone-ssh 26.0.1.20251130 e002cffc8eb8 4 months ago 1.04GB 2026-04-28 07:53:52.368449 | orchestrator | registry.osism.tech/kolla/release/octavia-health-manager 15.0.2.20251130 059dc6d4a159 4 months ago 1.03GB 2026-04-28 07:53:52.368459 | orchestrator | registry.osism.tech/kolla/release/octavia-housekeeping 15.0.2.20251130 c9059accdc4a 4 months ago 1.03GB 2026-04-28 07:53:52.368470 | orchestrator | registry.osism.tech/kolla/release/octavia-api 15.0.2.20251130 9375641bed7a 4 months ago 1.05GB 2026-04-28 07:53:52.368481 | orchestrator | registry.osism.tech/kolla/release/octavia-worker 15.0.2.20251130 708f50e37fa7 4 months ago 1.03GB 2026-04-28 07:53:52.368491 | orchestrator | registry.osism.tech/kolla/release/octavia-driver-agent 15.0.2.20251130 045f928baedc 4 months ago 1.05GB 2026-04-28 07:53:52.368502 | orchestrator | registry.osism.tech/kolla/release/neutron-server 25.2.2.20251130 fa71fe0a109e 4 months ago 1.16GB 2026-04-28 07:53:52.368519 | orchestrator | registry.osism.tech/kolla/release/glance-api 29.0.1.20251130 b1fcfbc49057 4 months ago 1.1GB 2026-04-28 07:53:52.368531 | orchestrator | registry.osism.tech/kolla/release/designate-central 19.0.1.20251130 00b6af03994a 4 months ago 983MB 2026-04-28 07:53:52.368542 | orchestrator | registry.osism.tech/kolla/release/designate-worker 19.0.1.20251130 18bc80370e46 4 months ago 989MB 2026-04-28 07:53:52.368552 | orchestrator | registry.osism.tech/kolla/release/designate-producer 19.0.1.20251130 eac4506bf51f 4 months ago 984MB 2026-04-28 07:53:52.368570 | orchestrator | registry.osism.tech/kolla/release/designate-api 19.0.1.20251130 ad5d5cd1392a 4 months ago 984MB 2026-04-28 07:53:52.368581 | orchestrator | registry.osism.tech/kolla/release/designate-backend-bind9 19.0.1.20251130 4e19a1dc9c8a 4 months ago 989MB 2026-04-28 07:53:52.368592 | orchestrator | registry.osism.tech/kolla/release/designate-mdns 19.0.1.20251130 4ad9e0017d6e 4 months ago 984MB 2026-04-28 07:53:52.368603 | orchestrator | registry.osism.tech/kolla/release/skyline-console 5.0.1.20251130 20430a0acd38 4 months ago 1.05GB 2026-04-28 07:53:52.368614 | orchestrator | registry.osism.tech/kolla/release/skyline-apiserver 5.0.1.20251130 20bbe1600b66 4 months ago 990MB 2026-04-28 07:53:52.368624 | orchestrator | registry.osism.tech/kolla/release/cinder-volume 25.3.1.20251130 ab7ee3c06214 4 months ago 1.72GB 2026-04-28 07:53:52.368655 | orchestrator | registry.osism.tech/kolla/release/cinder-scheduler 25.3.1.20251130 47d31cd2c25d 4 months ago 1.4GB 2026-04-28 07:53:52.368672 | orchestrator | registry.osism.tech/kolla/release/cinder-backup 25.3.1.20251130 c09074b62f18 4 months ago 1.41GB 2026-04-28 07:53:52.368683 | orchestrator | registry.osism.tech/kolla/release/cinder-api 25.3.1.20251130 ceaaac81e8af 4 months ago 1.4GB 2026-04-28 07:53:52.368694 | orchestrator | registry.osism.tech/kolla/release/ovn-controller 24.9.3.20251130 fcd09e53d925 4 months ago 840MB 2026-04-28 07:53:52.368704 | orchestrator | registry.osism.tech/kolla/release/ovn-nb-db-server 24.9.3.20251130 e52b6499881a 4 months ago 840MB 2026-04-28 07:53:52.368715 | orchestrator | registry.osism.tech/kolla/release/ovn-sb-db-server 24.9.3.20251130 2fcefdb5b030 4 months ago 840MB 2026-04-28 07:53:52.368726 | orchestrator | registry.osism.tech/kolla/release/ovn-northd 24.9.3.20251130 948e5d22de86 4 months ago 840MB 2026-04-28 07:53:52.368737 | orchestrator | registry.osism.tech/osism/ceph-daemon 18.2.7 5f92363b1f93 11 months ago 1.27GB 2026-04-28 07:53:52.526984 | orchestrator | + for node in testbed-manager testbed-node-0 testbed-node-1 testbed-node-2 2026-04-28 07:53:52.527533 | orchestrator | ++ semver 10.0.0 5.0.0 2026-04-28 07:53:52.578228 | orchestrator | 2026-04-28 07:53:52.578347 | orchestrator | ## Containers @ testbed-node-2 2026-04-28 07:53:52.578375 | orchestrator | 2026-04-28 07:53:52.578394 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-28 07:53:52.578412 | orchestrator | + echo 2026-04-28 07:53:52.578431 | orchestrator | + echo '## Containers @ testbed-node-2' 2026-04-28 07:53:52.578452 | orchestrator | + echo 2026-04-28 07:53:52.578471 | orchestrator | + osism container testbed-node-2 ps 2026-04-28 07:53:54.138150 | orchestrator | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2026-04-28 07:53:54.138244 | orchestrator | 3db917dba251 registry.osism.tech/kolla/release/2025.1/magnum-conductor:20.0.2.20260328 "dumb-init --single-…" 18 seconds ago Up 16 seconds (health: starting) magnum_conductor 2026-04-28 07:53:54.138261 | orchestrator | 5cfc73caab4a registry.osism.tech/kolla/release/2025.1/magnum-api:20.0.2.20260328 "dumb-init --single-…" 41 seconds ago Up 39 seconds (healthy) magnum_api 2026-04-28 07:53:54.138272 | orchestrator | b4ddb193f592 registry.osism.tech/kolla/release/2025.1/grafana:12.4.2.20260328 "dumb-init --single-…" 3 minutes ago Up 3 minutes grafana 2026-04-28 07:53:54.138283 | orchestrator | eb14e2166b5f registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter:1.8.0.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_elasticsearch_exporter 2026-04-28 07:53:54.138322 | orchestrator | 2a02b2beaf43 registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328 "dumb-init --single-…" 6 minutes ago Up 6 minutes prometheus_cadvisor 2026-04-28 07:53:54.138334 | orchestrator | 2581488157c8 registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter:0.15.0.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_memcached_exporter 2026-04-28 07:53:54.138344 | orchestrator | b2e3e61396b0 registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter:0.16.0.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_mysqld_exporter 2026-04-28 07:53:54.138354 | orchestrator | 085e79203b29 registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328 "dumb-init --single-…" 7 minutes ago Up 7 minutes prometheus_node_exporter 2026-04-28 07:53:54.138365 | orchestrator | 3629fcc9fac0 registry.osism.tech/kolla/release/2025.1/manila-share:20.0.2.20260328 "dumb-init --single-…" 10 minutes ago Up 10 minutes (healthy) manila_share 2026-04-28 07:53:54.138374 | orchestrator | 2564341d96d9 registry.osism.tech/kolla/release/2025.1/manila-scheduler:20.0.2.20260328 "dumb-init --single-…" 12 minutes ago Up 12 minutes (healthy) manila_scheduler 2026-04-28 07:53:54.138384 | orchestrator | 664f7c445522 registry.osism.tech/kolla/release/2025.1/manila-data:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_data 2026-04-28 07:53:54.138409 | orchestrator | 41837b6c8e10 registry.osism.tech/kolla/release/2025.1/manila-api:20.0.2.20260328 "dumb-init --single-…" 13 minutes ago Up 13 minutes (healthy) manila_api 2026-04-28 07:53:54.138419 | orchestrator | 2b22c4185f8c registry.osism.tech/kolla/release/2025.1/octavia-worker:16.0.2.20260328 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) octavia_worker 2026-04-28 07:53:54.138429 | orchestrator | ee396444847c registry.osism.tech/kolla/release/2025.1/octavia-housekeeping:16.0.2.20260328 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) octavia_housekeeping 2026-04-28 07:53:54.138439 | orchestrator | f3f5b420c8fd registry.osism.tech/kolla/release/2025.1/octavia-health-manager:16.0.2.20260328 "dumb-init --single-…" 15 minutes ago Up 15 minutes (healthy) octavia_health_manager 2026-04-28 07:53:54.138448 | orchestrator | 9143efa07b23 registry.osism.tech/kolla/release/2025.1/octavia-driver-agent:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes octavia_driver_agent 2026-04-28 07:53:54.138458 | orchestrator | 98f31a8c98b5 registry.osism.tech/kolla/release/2025.1/octavia-api:16.0.2.20260328 "dumb-init --single-…" 16 minutes ago Up 16 minutes (healthy) octavia_api 2026-04-28 07:53:54.138484 | orchestrator | 0f76c7cb40a4 registry.osism.tech/kolla/release/2025.1/aodh-notifier:20.0.0.20260328 "dumb-init --single-…" 19 minutes ago Up 19 minutes (healthy) aodh_notifier 2026-04-28 07:53:54.138496 | orchestrator | bba7d940e01a registry.osism.tech/kolla/release/2025.1/aodh-listener:20.0.0.20260328 "dumb-init --single-…" 19 minutes ago Up 19 minutes (healthy) aodh_listener 2026-04-28 07:53:54.138506 | orchestrator | 0083809d0a3d registry.osism.tech/kolla/release/2025.1/aodh-evaluator:20.0.0.20260328 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) aodh_evaluator 2026-04-28 07:53:54.138516 | orchestrator | 4eaef203ef51 registry.osism.tech/kolla/release/2025.1/aodh-api:20.0.0.20260328 "dumb-init --single-…" 20 minutes ago Up 20 minutes (healthy) aodh_api 2026-04-28 07:53:54.138533 | orchestrator | 537f51a89ab1 registry.osism.tech/kolla/release/2025.1/ceilometer-central:24.0.1.20260328 "dumb-init --single-…" 22 minutes ago Up 22 minutes ceilometer_central 2026-04-28 07:53:54.138542 | orchestrator | 1a89d19ca582 registry.osism.tech/kolla/release/2025.1/ceilometer-notification:24.0.1.20260328 "dumb-init --single-…" 22 minutes ago Up 22 minutes (healthy) ceilometer_notification 2026-04-28 07:53:54.138552 | orchestrator | 47fe23bd66de registry.osism.tech/kolla/release/2025.1/designate-worker:20.0.1.20260328 "dumb-init --single-…" 24 minutes ago Up 24 minutes (healthy) designate_worker 2026-04-28 07:53:54.138562 | orchestrator | 60882bf17022 registry.osism.tech/kolla/release/2025.1/designate-mdns:20.0.1.20260328 "dumb-init --single-…" 24 minutes ago Up 24 minutes (healthy) designate_mdns 2026-04-28 07:53:54.138572 | orchestrator | 4ca219d07595 registry.osism.tech/kolla/release/2025.1/designate-producer:20.0.1.20260328 "dumb-init --single-…" 25 minutes ago Up 25 minutes (healthy) designate_producer 2026-04-28 07:53:54.138582 | orchestrator | b5d44b01ef75 registry.osism.tech/kolla/release/2025.1/designate-central:20.0.1.20260328 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_central 2026-04-28 07:53:54.138591 | orchestrator | 29e5207b6d53 registry.osism.tech/kolla/release/2025.1/designate-api:20.0.1.20260328 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_api 2026-04-28 07:53:54.138601 | orchestrator | 734bef0d5b19 registry.osism.tech/kolla/release/2025.1/designate-backend-bind9:20.0.1.20260328 "dumb-init --single-…" 26 minutes ago Up 26 minutes (healthy) designate_backend_bind9 2026-04-28 07:53:54.138611 | orchestrator | 1b65f66bfd77 registry.osism.tech/kolla/release/2025.1/barbican-worker:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_worker 2026-04-28 07:53:54.138621 | orchestrator | 776d1a99889a registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener:20.0.1.20260328 "dumb-init --single-…" 28 minutes ago Up 28 minutes (healthy) barbican_keystone_listener 2026-04-28 07:53:54.138681 | orchestrator | 059ac655405e registry.osism.tech/kolla/release/2025.1/barbican-api:20.0.1.20260328 "dumb-init --single-…" 29 minutes ago Up 29 minutes (healthy) barbican_api 2026-04-28 07:53:54.138694 | orchestrator | b2e75caf0c1b registry.osism.tech/kolla/release/2025.1/cinder-backup:26.2.1.20260328 "dumb-init --single-…" 33 minutes ago Up 32 minutes (healthy) cinder_backup 2026-04-28 07:53:54.138705 | orchestrator | 008d506e96e3 registry.osism.tech/kolla/release/2025.1/cinder-volume:26.2.1.20260328 "dumb-init --single-…" 34 minutes ago Up 32 minutes (healthy) cinder_volume 2026-04-28 07:53:54.138717 | orchestrator | c607b1fbd304 registry.osism.tech/kolla/release/2025.1/cinder-scheduler:26.2.1.20260328 "dumb-init --single-…" 34 minutes ago Up 32 minutes (healthy) cinder_scheduler 2026-04-28 07:53:54.138729 | orchestrator | b8d8d7ff2f67 registry.osism.tech/kolla/release/2025.1/cinder-api:26.2.1.20260328 "dumb-init --single-…" 34 minutes ago Up 32 minutes (healthy) cinder_api 2026-04-28 07:53:54.138757 | orchestrator | 7a8f3d556c30 registry.osism.tech/kolla/release/2025.1/glance-api:30.1.1.20260328 "dumb-init --single-…" 39 minutes ago Up 39 minutes (healthy) glance_api 2026-04-28 07:53:54.138770 | orchestrator | cff5b2cf1167 registry.osism.tech/kolla/release/2025.1/skyline-console:6.0.1.20260328 "dumb-init --single-…" 43 minutes ago Up 43 minutes (healthy) skyline_console 2026-04-28 07:53:54.138787 | orchestrator | 80a7eaa9d693 registry.osism.tech/kolla/release/2025.1/skyline-apiserver:6.0.1.20260328 "dumb-init --single-…" 44 minutes ago Up 44 minutes (healthy) skyline_apiserver 2026-04-28 07:53:54.138797 | orchestrator | 704729ab36fa registry.osism.tech/kolla/release/2025.1/horizon:25.3.3.20260328 "dumb-init --single-…" 45 minutes ago Up 45 minutes (healthy) horizon 2026-04-28 07:53:54.138807 | orchestrator | 7095c08be9af registry.osism.tech/kolla/release/2025.1/nova-novncproxy:31.2.1.20260328 "dumb-init --single-…" 58 minutes ago Up 48 minutes (healthy) nova_novncproxy 2026-04-28 07:53:54.138817 | orchestrator | 07a5a01963f6 registry.osism.tech/kolla/release/2025.1/nova-conductor:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 48 minutes (healthy) nova_conductor 2026-04-28 07:53:54.138834 | orchestrator | e2897e2ce895 registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) nova_metadata 2026-04-28 07:53:54.138844 | orchestrator | 6cb3c5ae4040 registry.osism.tech/kolla/release/2025.1/nova-api:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 48 minutes (healthy) nova_api 2026-04-28 07:53:54.138854 | orchestrator | 3b9ae2eaf1c1 registry.osism.tech/kolla/release/2025.1/nova-scheduler:31.2.1.20260328 "dumb-init --single-…" About an hour ago Up 48 minutes (healthy) nova_scheduler 2026-04-28 07:53:54.138864 | orchestrator | 008ad7a876b8 registry.osism.tech/kolla/release/2025.1/neutron-server:26.0.3.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) neutron_server 2026-04-28 07:53:54.138874 | orchestrator | 5130c62805f0 registry.osism.tech/kolla/release/2025.1/placement-api:13.0.0.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) placement_api 2026-04-28 07:53:54.138884 | orchestrator | af2db893eb5b registry.osism.tech/kolla/release/2025.1/keystone:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone 2026-04-28 07:53:54.138894 | orchestrator | b7e9b8ff14b5 registry.osism.tech/kolla/release/2025.1/keystone-fernet:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone_fernet 2026-04-28 07:53:54.138908 | orchestrator | ce363bb063a2 registry.osism.tech/kolla/release/2025.1/keystone-ssh:27.0.1.20260328 "dumb-init --single-…" About an hour ago Up About an hour (healthy) keystone_ssh 2026-04-28 07:53:54.138918 | orchestrator | 6a6069d5d219 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-crash" About an hour ago Up About an hour ceph-crash-testbed-node-2 2026-04-28 07:53:54.138928 | orchestrator | f7cc761805dc registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mgr -…" 2 hours ago Up 2 hours ceph-mgr-testbed-node-2 2026-04-28 07:53:54.138938 | orchestrator | 92b926b7d044 registry.osism.tech/osism/ceph-daemon:18.2.7 "/usr/bin/ceph-mon -…" 2 hours ago Up 2 hours ceph-mon-testbed-node-2 2026-04-28 07:53:54.138947 | orchestrator | d10887e81421 registry.osism.tech/kolla/release/2025.1/ovn-northd:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_northd 2026-04-28 07:53:54.138957 | orchestrator | 5344e596f823 registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_sb_db_relay_1 2026-04-28 07:53:54.138974 | orchestrator | 4ba416fa22e6 registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_sb_db 2026-04-28 07:53:54.138989 | orchestrator | 1e04f3e40098 registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_nb_db 2026-04-28 07:53:54.139000 | orchestrator | 5e92729b0080 registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours ovn_controller 2026-04-28 07:53:54.139010 | orchestrator | cc2bd316a27b registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) openvswitch_vswitchd 2026-04-28 07:53:54.139019 | orchestrator | d6be2ea3f8cd registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) openvswitch_db 2026-04-28 07:53:54.139029 | orchestrator | e5be4924cdc7 registry.osism.tech/kolla/release/2025.1/rabbitmq:4.1.8.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) rabbitmq 2026-04-28 07:53:54.139039 | orchestrator | 5169e65e483c registry.osism.tech/kolla/release/2025.1/mariadb-server:10.11.16.20260328 "dumb-init -- kolla_…" 3 hours ago Up 3 hours (healthy) mariadb 2026-04-28 07:53:54.139049 | orchestrator | eb37a9a770cc registry.osism.tech/kolla/release/2025.1/redis-sentinel:7.0.15.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) redis_sentinel 2026-04-28 07:53:54.139058 | orchestrator | de8ffe405520 registry.osism.tech/kolla/release/2025.1/redis:7.0.15.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) redis 2026-04-28 07:53:54.139068 | orchestrator | 1cdf724b0d12 registry.osism.tech/kolla/release/2025.1/memcached:1.6.24.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) memcached 2026-04-28 07:53:54.139078 | orchestrator | 4856eb9c68c0 registry.osism.tech/kolla/release/2025.1/opensearch-dashboards:2.19.5.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) opensearch_dashboards 2026-04-28 07:53:54.139087 | orchestrator | 751ea14a7a68 registry.osism.tech/kolla/release/2025.1/opensearch:2.19.5.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) opensearch 2026-04-28 07:53:54.139097 | orchestrator | 4ba89d372cae registry.osism.tech/kolla/release/2025.1/keepalived:2.2.8.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours keepalived 2026-04-28 07:53:54.139112 | orchestrator | 7a40e94fcd70 registry.osism.tech/kolla/release/2025.1/proxysql:3.0.6.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) proxysql 2026-04-28 07:53:54.139122 | orchestrator | 13adb8186a82 registry.osism.tech/kolla/release/2025.1/haproxy:2.8.16.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours (healthy) haproxy 2026-04-28 07:53:54.139132 | orchestrator | 1117ea63e1af registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours cron 2026-04-28 07:53:54.139142 | orchestrator | 2aff2763b6ab registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours kolla_toolbox 2026-04-28 07:53:54.139158 | orchestrator | cd74ebccbad3 registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328 "dumb-init --single-…" 3 hours ago Up 3 hours fluentd 2026-04-28 07:53:54.301001 | orchestrator | 2026-04-28 07:53:54.301095 | orchestrator | ## Images @ testbed-node-2 2026-04-28 07:53:54.301111 | orchestrator | 2026-04-28 07:53:54.301123 | orchestrator | + echo 2026-04-28 07:53:54.301135 | orchestrator | + echo '## Images @ testbed-node-2' 2026-04-28 07:53:54.301148 | orchestrator | + echo 2026-04-28 07:53:54.301158 | orchestrator | + osism container testbed-node-2 images 2026-04-28 07:53:55.951518 | orchestrator | REPOSITORY TAG IMAGE ID CREATED SIZE 2026-04-28 07:53:55.951615 | orchestrator | registry.osism.tech/kolla/release/2025.1/keepalived 2.2.8.20260328 cc29bd9a85e4 4 weeks ago 288MB 2026-04-28 07:53:55.951631 | orchestrator | registry.osism.tech/kolla/release/2025.1/opensearch-dashboards 2.19.5.20260328 f834ead10f11 4 weeks ago 1.54GB 2026-04-28 07:53:55.951691 | orchestrator | registry.osism.tech/kolla/release/2025.1/opensearch 2.19.5.20260328 d36ae5f707fb 4 weeks ago 1.57GB 2026-04-28 07:53:55.951704 | orchestrator | registry.osism.tech/kolla/release/2025.1/fluentd 5.0.9.20260328 e1596a0c11a4 4 weeks ago 590MB 2026-04-28 07:53:55.951715 | orchestrator | registry.osism.tech/kolla/release/2025.1/memcached 1.6.24.20260328 09b41eff0fc1 4 weeks ago 277MB 2026-04-28 07:53:55.951726 | orchestrator | registry.osism.tech/kolla/release/2025.1/grafana 12.4.2.20260328 3842b7ef2d0c 4 weeks ago 1.04GB 2026-04-28 07:53:55.951737 | orchestrator | registry.osism.tech/kolla/release/2025.1/rabbitmq 4.1.8.20260328 c6408fdc6cf4 4 weeks ago 350MB 2026-04-28 07:53:55.951748 | orchestrator | registry.osism.tech/kolla/release/2025.1/proxysql 3.0.6.20260328 ccffdf9574f0 4 weeks ago 427MB 2026-04-28 07:53:55.951759 | orchestrator | registry.osism.tech/kolla/release/2025.1/kolla-toolbox 20.3.1.20260328 28c0d33bbf93 4 weeks ago 683MB 2026-04-28 07:53:55.951770 | orchestrator | registry.osism.tech/kolla/release/2025.1/cron 3.0.20260328 83ceba86723e 4 weeks ago 277MB 2026-04-28 07:53:55.951781 | orchestrator | registry.osism.tech/kolla/release/2025.1/haproxy 2.8.16.20260328 cf24d3343dd6 4 weeks ago 285MB 2026-04-28 07:53:55.951792 | orchestrator | registry.osism.tech/kolla/release/2025.1/openvswitch-db-server 3.5.1.20260328 2df964b9b6ef 4 weeks ago 293MB 2026-04-28 07:53:55.951803 | orchestrator | registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd 3.5.1.20260328 d56dc4fd4981 4 weeks ago 293MB 2026-04-28 07:53:55.951814 | orchestrator | registry.osism.tech/kolla/release/2025.1/redis-sentinel 7.0.15.20260328 c513d0722dfc 4 weeks ago 284MB 2026-04-28 07:53:55.951825 | orchestrator | registry.osism.tech/kolla/release/2025.1/redis 7.0.15.20260328 0640729e8c26 4 weeks ago 284MB 2026-04-28 07:53:55.951836 | orchestrator | registry.osism.tech/kolla/release/2025.1/horizon 25.3.3.20260328 ee0ad6e2185e 4 weeks ago 1.2GB 2026-04-28 07:53:55.951847 | orchestrator | registry.osism.tech/kolla/release/2025.1/mariadb-server 10.11.16.20260328 886dcd3e3f53 4 weeks ago 463MB 2026-04-28 07:53:55.951858 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-memcached-exporter 0.15.0.20260328 995036f125d2 4 weeks ago 309MB 2026-04-28 07:53:55.951869 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor 0.49.2.20260328 f7140e8a13d8 4 weeks ago 368MB 2026-04-28 07:53:55.951883 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-elasticsearch-exporter 1.8.0.20260328 c9ee75870dff 4 weeks ago 303MB 2026-04-28 07:53:55.951932 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-mysqld-exporter 0.16.0.20260328 117acc95a5ad 4 weeks ago 312MB 2026-04-28 07:53:55.951966 | orchestrator | registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter 1.8.2.20260328 4d11b36c2bda 4 weeks ago 317MB 2026-04-28 07:53:55.951985 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-sb-db-server 25.3.1.20260328 859fd9ce89d9 4 weeks ago 301MB 2026-04-28 07:53:55.952003 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-nb-db-server 25.3.1.20260328 fb0f3707730d 4 weeks ago 301MB 2026-04-28 07:53:55.952020 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-controller 25.3.1.20260328 3228ba87088e 4 weeks ago 301MB 2026-04-28 07:53:55.952140 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-northd 25.3.1.20260328 65c0953e4c39 4 weeks ago 301MB 2026-04-28 07:53:55.952167 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone 27.0.1.20260328 b31ea490ee2a 4 weeks ago 1.09GB 2026-04-28 07:53:55.952188 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone-ssh 27.0.1.20260328 40f5d9a677d1 4 weeks ago 1.06GB 2026-04-28 07:53:55.952203 | orchestrator | registry.osism.tech/kolla/release/2025.1/keystone-fernet 27.0.1.20260328 f133afc9d53b 4 weeks ago 1.05GB 2026-04-28 07:53:55.952236 | orchestrator | registry.osism.tech/kolla/release/2025.1/ceilometer-central 24.0.1.20260328 d407dd61fee1 4 weeks ago 997MB 2026-04-28 07:53:55.952249 | orchestrator | registry.osism.tech/kolla/release/2025.1/ceilometer-notification 24.0.1.20260328 a0d400ce4fdd 4 weeks ago 996MB 2026-04-28 07:53:55.952261 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-driver-agent 16.0.2.20260328 f07869d78758 4 weeks ago 1.07GB 2026-04-28 07:53:55.952273 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-api 16.0.2.20260328 7118289a0d17 4 weeks ago 1.07GB 2026-04-28 07:53:55.952286 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-worker 16.0.2.20260328 1065bc696018 4 weeks ago 1.05GB 2026-04-28 07:53:55.952299 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-health-manager 16.0.2.20260328 0adbcb202c49 4 weeks ago 1.05GB 2026-04-28 07:53:55.952311 | orchestrator | registry.osism.tech/kolla/release/2025.1/octavia-housekeeping 16.0.2.20260328 1e4a4601f94f 4 weeks ago 1.05GB 2026-04-28 07:53:55.952324 | orchestrator | registry.osism.tech/kolla/release/2025.1/placement-api 13.0.0.20260328 b52f42ecbb4d 4 weeks ago 996MB 2026-04-28 07:53:55.952337 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-listener 20.0.0.20260328 afbc43250d60 4 weeks ago 995MB 2026-04-28 07:53:55.952368 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-evaluator 20.0.0.20260328 26d81adaeaae 4 weeks ago 995MB 2026-04-28 07:53:55.952381 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-notifier 20.0.0.20260328 aa74bb4c136d 4 weeks ago 995MB 2026-04-28 07:53:55.952395 | orchestrator | registry.osism.tech/kolla/release/2025.1/aodh-api 20.0.0.20260328 bb920611ad39 4 weeks ago 994MB 2026-04-28 07:53:55.952407 | orchestrator | registry.osism.tech/kolla/release/2025.1/glance-api 30.1.1.20260328 525bb863082d 4 weeks ago 1.12GB 2026-04-28 07:53:55.952419 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-volume 26.2.1.20260328 78cc3d4efb57 4 weeks ago 1.79GB 2026-04-28 07:53:55.952431 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-scheduler 26.2.1.20260328 b72d2e7568f8 4 weeks ago 1.43GB 2026-04-28 07:53:55.952442 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-api 26.2.1.20260328 2583a0d99734 4 weeks ago 1.43GB 2026-04-28 07:53:55.952464 | orchestrator | registry.osism.tech/kolla/release/2025.1/cinder-backup 26.2.1.20260328 a970df3ae580 4 weeks ago 1.44GB 2026-04-28 07:53:55.952475 | orchestrator | registry.osism.tech/kolla/release/2025.1/neutron-server 26.0.3.20260328 b084449c71f7 4 weeks ago 1.24GB 2026-04-28 07:53:55.952487 | orchestrator | registry.osism.tech/kolla/release/2025.1/skyline-console 6.0.1.20260328 cf9981ab1a70 4 weeks ago 1.07GB 2026-04-28 07:53:55.952498 | orchestrator | registry.osism.tech/kolla/release/2025.1/skyline-apiserver 6.0.1.20260328 d52b28f7bdf2 4 weeks ago 1.02GB 2026-04-28 07:53:55.952509 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-worker 20.0.1.20260328 10c316f8a88d 4 weeks ago 1GB 2026-04-28 07:53:55.952520 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-keystone-listener 20.0.1.20260328 f1c21f7912dc 4 weeks ago 1GB 2026-04-28 07:53:55.952531 | orchestrator | registry.osism.tech/kolla/release/2025.1/barbican-api 20.0.1.20260328 43f0933a84ab 4 weeks ago 1GB 2026-04-28 07:53:55.952547 | orchestrator | registry.osism.tech/kolla/release/2025.1/magnum-conductor 20.0.2.20260328 8cf236db44c6 4 weeks ago 1.27GB 2026-04-28 07:53:55.952558 | orchestrator | registry.osism.tech/kolla/release/2025.1/magnum-api 20.0.2.20260328 9a37ca6883b8 4 weeks ago 1.15GB 2026-04-28 07:53:55.952569 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-backend-bind9 20.0.1.20260328 bc68ee83deb0 4 weeks ago 1.01GB 2026-04-28 07:53:55.952580 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-api 20.0.1.20260328 c0c239664d22 4 weeks ago 1GB 2026-04-28 07:53:55.952591 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-mdns 20.0.1.20260328 c268b1854421 4 weeks ago 1GB 2026-04-28 07:53:55.952602 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-worker 20.0.1.20260328 3ce3202d2f8d 4 weeks ago 1.01GB 2026-04-28 07:53:55.952613 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-central 20.0.1.20260328 50fabfae16b4 4 weeks ago 1GB 2026-04-28 07:53:55.952624 | orchestrator | registry.osism.tech/kolla/release/2025.1/designate-producer 20.0.1.20260328 23baf4bae3a6 4 weeks ago 1GB 2026-04-28 07:53:55.952845 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-api 31.2.1.20260328 7100cf172da2 4 weeks ago 1.23GB 2026-04-28 07:53:55.952863 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-novncproxy 31.2.1.20260328 003749dfd921 4 weeks ago 1.39GB 2026-04-28 07:53:55.952875 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-scheduler 31.2.1.20260328 0b8714cecfd8 4 weeks ago 1.23GB 2026-04-28 07:53:55.952886 | orchestrator | registry.osism.tech/kolla/release/2025.1/nova-conductor 31.2.1.20260328 d35210169004 4 weeks ago 1.23GB 2026-04-28 07:53:55.952896 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-data 20.0.2.20260328 5c1ce4fd1849 4 weeks ago 1.07GB 2026-04-28 07:53:55.952907 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-scheduler 20.0.2.20260328 29e4081372f9 4 weeks ago 1.07GB 2026-04-28 07:53:55.952918 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-api 20.0.2.20260328 949d0dfdab5b 4 weeks ago 1.07GB 2026-04-28 07:53:55.952929 | orchestrator | registry.osism.tech/kolla/release/2025.1/manila-share 20.0.2.20260328 d5693cb24e6d 4 weeks ago 1.24GB 2026-04-28 07:53:55.952940 | orchestrator | registry.osism.tech/kolla/release/2025.1/ovn-sb-db-relay 25.3.1.20260328 08ae9a102f53 4 weeks ago 301MB 2026-04-28 07:53:55.952950 | orchestrator | registry.osism.tech/kolla/release/rabbitmq 3.13.7.20251130 618df24dfbf4 4 months ago 322MB 2026-04-28 07:53:55.952970 | orchestrator | registry.osism.tech/kolla/release/memcached 1.6.24.20251130 8a9865997707 4 months ago 266MB 2026-04-28 07:53:55.952981 | orchestrator | registry.osism.tech/kolla/release/opensearch 2.19.4.20251130 dc62f23331d2 4 months ago 1.56GB 2026-04-28 07:53:55.952991 | orchestrator | registry.osism.tech/kolla/release/keepalived 2.2.8.20251130 94862d07fc5a 4 months ago 276MB 2026-04-28 07:53:55.953003 | orchestrator | registry.osism.tech/kolla/release/opensearch-dashboards 2.19.4.20251130 3b3613dd9b1a 4 months ago 1.53GB 2026-04-28 07:53:55.953014 | orchestrator | registry.osism.tech/kolla/release/kolla-toolbox 19.7.1.20251130 314d22193a72 4 months ago 669MB 2026-04-28 07:53:55.953025 | orchestrator | registry.osism.tech/kolla/release/cron 3.0.20251130 e1e0428a330f 4 months ago 265MB 2026-04-28 07:53:55.953035 | orchestrator | registry.osism.tech/kolla/release/grafana 12.3.0.20251130 6eb3b7b1dbf2 4 months ago 1.02GB 2026-04-28 07:53:55.953046 | orchestrator | registry.osism.tech/kolla/release/proxysql 3.0.3.20251130 2c7177938c0e 4 months ago 412MB 2026-04-28 07:53:55.953057 | orchestrator | registry.osism.tech/kolla/release/haproxy 2.8.15.20251130 6d4c583df983 4 months ago 274MB 2026-04-28 07:53:55.953068 | orchestrator | registry.osism.tech/kolla/release/fluentd 5.0.8.20251130 fb3c98fc8cae 4 months ago 578MB 2026-04-28 07:53:55.953079 | orchestrator | registry.osism.tech/kolla/release/redis 7.0.15.20251130 5548a8ce5b5c 4 months ago 273MB 2026-04-28 07:53:55.953089 | orchestrator | registry.osism.tech/kolla/release/redis-sentinel 7.0.15.20251130 62d0b016058f 4 months ago 273MB 2026-04-28 07:53:55.953113 | orchestrator | registry.osism.tech/kolla/release/mariadb-server 10.11.15.20251130 77db67eebcc3 4 months ago 452MB 2026-04-28 07:53:55.953125 | orchestrator | registry.osism.tech/kolla/release/horizon 25.1.2.20251130 d7257ed845e9 4 months ago 1.15GB 2026-04-28 07:53:55.953135 | orchestrator | registry.osism.tech/kolla/release/prometheus-mysqld-exporter 0.16.0.20251130 aedc672fb472 4 months ago 301MB 2026-04-28 07:53:55.953146 | orchestrator | registry.osism.tech/kolla/release/prometheus-memcached-exporter 0.15.0.20251130 7b077076926d 4 months ago 298MB 2026-04-28 07:53:55.953157 | orchestrator | registry.osism.tech/kolla/release/prometheus-cadvisor 0.49.2.20251130 591cbce746c1 4 months ago 357MB 2026-04-28 07:53:55.953167 | orchestrator | registry.osism.tech/kolla/release/prometheus-elasticsearch-exporter 1.8.0.20251130 bcaaf5d64345 4 months ago 292MB 2026-04-28 07:53:55.953178 | orchestrator | registry.osism.tech/kolla/release/prometheus-node-exporter 1.8.2.20251130 c1ab1d07f7ef 4 months ago 305MB 2026-04-28 07:53:55.953189 | orchestrator | registry.osism.tech/kolla/release/openvswitch-db-server 3.4.3.20251130 3e6f3fe8823c 4 months ago 279MB 2026-04-28 07:53:55.953200 | orchestrator | registry.osism.tech/kolla/release/openvswitch-vswitchd 3.4.3.20251130 ad8bb4636454 4 months ago 279MB 2026-04-28 07:53:55.953218 | orchestrator | registry.osism.tech/kolla/release/placement-api 12.0.1.20251130 20317ff6dfb9 4 months ago 975MB 2026-04-28 07:53:55.953229 | orchestrator | registry.osism.tech/kolla/release/nova-novncproxy 30.2.1.20251130 99323056afa4 4 months ago 1.37GB 2026-04-28 07:53:55.953240 | orchestrator | registry.osism.tech/kolla/release/nova-conductor 30.2.1.20251130 92609e648215 4 months ago 1.21GB 2026-04-28 07:53:55.953251 | orchestrator | registry.osism.tech/kolla/release/nova-api 30.2.1.20251130 2d78e7fdfb9a 4 months ago 1.21GB 2026-04-28 07:53:55.953268 | orchestrator | registry.osism.tech/kolla/release/nova-scheduler 30.2.1.20251130 4c3c59730530 4 months ago 1.21GB 2026-04-28 07:53:55.953279 | orchestrator | registry.osism.tech/kolla/release/ceilometer-central 23.0.2.20251130 37cb6975d4a5 4 months ago 976MB 2026-04-28 07:53:55.953290 | orchestrator | registry.osism.tech/kolla/release/ceilometer-notification 23.0.2.20251130 bb2927b293dc 4 months ago 976MB 2026-04-28 07:53:55.953301 | orchestrator | registry.osism.tech/kolla/release/magnum-api 19.0.1.20251130 a85fdbb4bbba 4 months ago 1.13GB 2026-04-28 07:53:55.953312 | orchestrator | registry.osism.tech/kolla/release/magnum-conductor 19.0.1.20251130 a98ee1099aad 4 months ago 1.24GB 2026-04-28 07:53:55.953322 | orchestrator | registry.osism.tech/kolla/release/manila-share 19.1.1.20251130 df44f491f2c1 4 months ago 1.22GB 2026-04-28 07:53:55.953333 | orchestrator | registry.osism.tech/kolla/release/manila-data 19.1.1.20251130 cd8b74c8a47a 4 months ago 1.06GB 2026-04-28 07:53:55.953344 | orchestrator | registry.osism.tech/kolla/release/manila-api 19.1.1.20251130 654f9bd3c940 4 months ago 1.05GB 2026-04-28 07:53:55.953355 | orchestrator | registry.osism.tech/kolla/release/manila-scheduler 19.1.1.20251130 e0864fa03a78 4 months ago 1.05GB 2026-04-28 07:53:55.953366 | orchestrator | registry.osism.tech/kolla/release/aodh-listener 19.0.0.20251130 1e68c23a9d38 4 months ago 974MB 2026-04-28 07:53:55.953377 | orchestrator | registry.osism.tech/kolla/release/aodh-evaluator 19.0.0.20251130 1726a7592f93 4 months ago 974MB 2026-04-28 07:53:55.953388 | orchestrator | registry.osism.tech/kolla/release/aodh-notifier 19.0.0.20251130 abbd6e9f87e2 4 months ago 974MB 2026-04-28 07:53:55.953399 | orchestrator | registry.osism.tech/kolla/release/aodh-api 19.0.0.20251130 82a64f1d056d 4 months ago 973MB 2026-04-28 07:53:55.953409 | orchestrator | registry.osism.tech/kolla/release/barbican-worker 19.0.1.20251130 2cef5d51872b 4 months ago 991MB 2026-04-28 07:53:55.953420 | orchestrator | registry.osism.tech/kolla/release/barbican-keystone-listener 19.0.1.20251130 bfcd8631a126 4 months ago 991MB 2026-04-28 07:53:55.953431 | orchestrator | registry.osism.tech/kolla/release/barbican-api 19.0.1.20251130 9195ddc3e4c5 4 months ago 990MB 2026-04-28 07:53:55.953442 | orchestrator | registry.osism.tech/kolla/release/keystone 26.0.1.20251130 6c1543e94c06 4 months ago 1.09GB 2026-04-28 07:53:55.953453 | orchestrator | registry.osism.tech/kolla/release/keystone-fernet 26.0.1.20251130 36669c355898 4 months ago 1.04GB 2026-04-28 07:53:55.953464 | orchestrator | registry.osism.tech/kolla/release/keystone-ssh 26.0.1.20251130 e002cffc8eb8 4 months ago 1.04GB 2026-04-28 07:53:55.953477 | orchestrator | registry.osism.tech/kolla/release/octavia-health-manager 15.0.2.20251130 059dc6d4a159 4 months ago 1.03GB 2026-04-28 07:53:55.953489 | orchestrator | registry.osism.tech/kolla/release/octavia-housekeeping 15.0.2.20251130 c9059accdc4a 4 months ago 1.03GB 2026-04-28 07:53:55.953502 | orchestrator | registry.osism.tech/kolla/release/octavia-api 15.0.2.20251130 9375641bed7a 4 months ago 1.05GB 2026-04-28 07:53:55.953514 | orchestrator | registry.osism.tech/kolla/release/octavia-worker 15.0.2.20251130 708f50e37fa7 4 months ago 1.03GB 2026-04-28 07:53:55.953527 | orchestrator | registry.osism.tech/kolla/release/octavia-driver-agent 15.0.2.20251130 045f928baedc 4 months ago 1.05GB 2026-04-28 07:53:55.953539 | orchestrator | registry.osism.tech/kolla/release/neutron-server 25.2.2.20251130 fa71fe0a109e 4 months ago 1.16GB 2026-04-28 07:53:55.953557 | orchestrator | registry.osism.tech/kolla/release/glance-api 29.0.1.20251130 b1fcfbc49057 4 months ago 1.1GB 2026-04-28 07:53:55.953575 | orchestrator | registry.osism.tech/kolla/release/designate-central 19.0.1.20251130 00b6af03994a 4 months ago 983MB 2026-04-28 07:53:55.953588 | orchestrator | registry.osism.tech/kolla/release/designate-worker 19.0.1.20251130 18bc80370e46 4 months ago 989MB 2026-04-28 07:53:55.953601 | orchestrator | registry.osism.tech/kolla/release/designate-producer 19.0.1.20251130 eac4506bf51f 4 months ago 984MB 2026-04-28 07:53:55.953614 | orchestrator | registry.osism.tech/kolla/release/designate-api 19.0.1.20251130 ad5d5cd1392a 4 months ago 984MB 2026-04-28 07:53:55.953626 | orchestrator | registry.osism.tech/kolla/release/designate-backend-bind9 19.0.1.20251130 4e19a1dc9c8a 4 months ago 989MB 2026-04-28 07:53:55.953661 | orchestrator | registry.osism.tech/kolla/release/designate-mdns 19.0.1.20251130 4ad9e0017d6e 4 months ago 984MB 2026-04-28 07:53:55.953675 | orchestrator | registry.osism.tech/kolla/release/skyline-console 5.0.1.20251130 20430a0acd38 4 months ago 1.05GB 2026-04-28 07:53:55.953688 | orchestrator | registry.osism.tech/kolla/release/skyline-apiserver 5.0.1.20251130 20bbe1600b66 4 months ago 990MB 2026-04-28 07:53:55.953700 | orchestrator | registry.osism.tech/kolla/release/cinder-volume 25.3.1.20251130 ab7ee3c06214 4 months ago 1.72GB 2026-04-28 07:53:55.953712 | orchestrator | registry.osism.tech/kolla/release/cinder-scheduler 25.3.1.20251130 47d31cd2c25d 4 months ago 1.4GB 2026-04-28 07:53:55.953723 | orchestrator | registry.osism.tech/kolla/release/cinder-backup 25.3.1.20251130 c09074b62f18 4 months ago 1.41GB 2026-04-28 07:53:55.953734 | orchestrator | registry.osism.tech/kolla/release/cinder-api 25.3.1.20251130 ceaaac81e8af 4 months ago 1.4GB 2026-04-28 07:53:55.953745 | orchestrator | registry.osism.tech/kolla/release/ovn-nb-db-server 24.9.3.20251130 e52b6499881a 4 months ago 840MB 2026-04-28 07:53:55.953756 | orchestrator | registry.osism.tech/kolla/release/ovn-controller 24.9.3.20251130 fcd09e53d925 4 months ago 840MB 2026-04-28 07:53:55.953767 | orchestrator | registry.osism.tech/kolla/release/ovn-sb-db-server 24.9.3.20251130 2fcefdb5b030 4 months ago 840MB 2026-04-28 07:53:55.953778 | orchestrator | registry.osism.tech/kolla/release/ovn-northd 24.9.3.20251130 948e5d22de86 4 months ago 840MB 2026-04-28 07:53:55.953826 | orchestrator | registry.osism.tech/osism/ceph-daemon 18.2.7 5f92363b1f93 11 months ago 1.27GB 2026-04-28 07:53:56.130962 | orchestrator | + sh -c /opt/configuration/scripts/check-services.sh 2026-04-28 07:53:56.137340 | orchestrator | + set -e 2026-04-28 07:53:56.137399 | orchestrator | + source /opt/manager-vars.sh 2026-04-28 07:53:56.137422 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-28 07:53:56.137442 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-28 07:53:56.137457 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-28 07:53:56.137468 | orchestrator | ++ CEPH_VERSION=reef 2026-04-28 07:53:56.137480 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-28 07:53:56.137493 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-28 07:53:56.137504 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-28 07:53:56.137515 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-28 07:53:56.137526 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-28 07:53:56.137537 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-28 07:53:56.137548 | orchestrator | ++ export ARA=false 2026-04-28 07:53:56.137559 | orchestrator | ++ ARA=false 2026-04-28 07:53:56.137570 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-28 07:53:56.137581 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-28 07:53:56.137592 | orchestrator | ++ export TEMPEST=false 2026-04-28 07:53:56.137605 | orchestrator | ++ TEMPEST=false 2026-04-28 07:53:56.137626 | orchestrator | ++ export IS_ZUUL=true 2026-04-28 07:53:56.137678 | orchestrator | ++ IS_ZUUL=true 2026-04-28 07:53:56.137731 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 07:53:56.137752 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 07:53:56.137771 | orchestrator | ++ export EXTERNAL_API=false 2026-04-28 07:53:56.137791 | orchestrator | ++ EXTERNAL_API=false 2026-04-28 07:53:56.137811 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-28 07:53:56.137831 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-28 07:53:56.137868 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-28 07:53:56.137886 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-28 07:53:56.137898 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-28 07:53:56.137909 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-28 07:53:56.137922 | orchestrator | ++ export RABBITMQ3TO4=true 2026-04-28 07:53:56.137934 | orchestrator | ++ RABBITMQ3TO4=true 2026-04-28 07:53:56.137947 | orchestrator | + [[ ceph-ansible == \c\e\p\h\-\a\n\s\i\b\l\e ]] 2026-04-28 07:53:56.137959 | orchestrator | + sh -c /opt/configuration/scripts/check/100-ceph-with-ansible.sh 2026-04-28 07:53:56.140971 | orchestrator | + set -e 2026-04-28 07:53:56.141021 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-28 07:53:56.141034 | orchestrator | ++ export INTERACTIVE=false 2026-04-28 07:53:56.141046 | orchestrator | ++ INTERACTIVE=false 2026-04-28 07:53:56.141057 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-28 07:53:56.141068 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-28 07:53:56.141080 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-28 07:53:56.141478 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-28 07:53:56.144457 | orchestrator | 2026-04-28 07:53:56.144492 | orchestrator | # Ceph status 2026-04-28 07:53:56.144504 | orchestrator | 2026-04-28 07:53:56.144516 | orchestrator | ++ export MANAGER_VERSION=10.0.0 2026-04-28 07:53:56.144528 | orchestrator | ++ MANAGER_VERSION=10.0.0 2026-04-28 07:53:56.144540 | orchestrator | + echo 2026-04-28 07:53:56.144551 | orchestrator | + echo '# Ceph status' 2026-04-28 07:53:56.144562 | orchestrator | + echo 2026-04-28 07:53:56.144575 | orchestrator | + ceph -s 2026-04-28 07:53:56.776522 | orchestrator | cluster: 2026-04-28 07:53:56.776603 | orchestrator | id: 11111111-1111-1111-1111-111111111111 2026-04-28 07:53:56.776614 | orchestrator | health: HEALTH_OK 2026-04-28 07:53:56.776622 | orchestrator | 2026-04-28 07:53:56.776629 | orchestrator | services: 2026-04-28 07:53:56.776671 | orchestrator | mon: 3 daemons, quorum testbed-node-0,testbed-node-1,testbed-node-2 (age 2h) 2026-04-28 07:53:56.776681 | orchestrator | mgr: testbed-node-0(active, since 2h), standbys: testbed-node-1, testbed-node-2 2026-04-28 07:53:56.776688 | orchestrator | mds: 1/1 daemons up, 2 standby 2026-04-28 07:53:56.776694 | orchestrator | osd: 6 osds: 6 up (since 110m), 6 in (since 4h) 2026-04-28 07:53:56.776701 | orchestrator | rgw: 3 daemons active (3 hosts, 1 zones) 2026-04-28 07:53:56.776708 | orchestrator | 2026-04-28 07:53:56.776714 | orchestrator | data: 2026-04-28 07:53:56.776721 | orchestrator | volumes: 1/1 healthy 2026-04-28 07:53:56.776727 | orchestrator | pools: 14 pools, 401 pgs 2026-04-28 07:53:56.776733 | orchestrator | objects: 821 objects, 2.8 GiB 2026-04-28 07:53:56.776740 | orchestrator | usage: 7.9 GiB used, 112 GiB / 120 GiB avail 2026-04-28 07:53:56.776754 | orchestrator | pgs: 401 active+clean 2026-04-28 07:53:56.776761 | orchestrator | 2026-04-28 07:53:56.776768 | orchestrator | io: 2026-04-28 07:53:56.776774 | orchestrator | client: 12 KiB/s rd, 255 B/s wr, 12 op/s rd, 7 op/s wr 2026-04-28 07:53:56.776781 | orchestrator | 2026-04-28 07:53:56.820676 | orchestrator | 2026-04-28 07:53:56.820737 | orchestrator | # Ceph versions 2026-04-28 07:53:56.820746 | orchestrator | 2026-04-28 07:53:56.820753 | orchestrator | + echo 2026-04-28 07:53:56.820760 | orchestrator | + echo '# Ceph versions' 2026-04-28 07:53:56.820768 | orchestrator | + echo 2026-04-28 07:53:56.820774 | orchestrator | + ceph versions 2026-04-28 07:53:57.433099 | orchestrator | { 2026-04-28 07:53:57.433262 | orchestrator | "mon": { 2026-04-28 07:53:57.433292 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-28 07:53:57.434166 | orchestrator | }, 2026-04-28 07:53:57.434206 | orchestrator | "mgr": { 2026-04-28 07:53:57.434218 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-28 07:53:57.434230 | orchestrator | }, 2026-04-28 07:53:57.434240 | orchestrator | "osd": { 2026-04-28 07:53:57.434252 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 6 2026-04-28 07:53:57.434262 | orchestrator | }, 2026-04-28 07:53:57.434273 | orchestrator | "mds": { 2026-04-28 07:53:57.434284 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-28 07:53:57.434327 | orchestrator | }, 2026-04-28 07:53:57.434352 | orchestrator | "rgw": { 2026-04-28 07:53:57.434376 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 3 2026-04-28 07:53:57.434395 | orchestrator | }, 2026-04-28 07:53:57.434412 | orchestrator | "overall": { 2026-04-28 07:53:57.434432 | orchestrator | "ceph version 18.2.7 (6b0e988052ec84cf2d4a54ff9bbbc5e720b621ad) reef (stable)": 18 2026-04-28 07:53:57.434451 | orchestrator | } 2026-04-28 07:53:57.434469 | orchestrator | } 2026-04-28 07:53:57.481665 | orchestrator | 2026-04-28 07:53:57.481734 | orchestrator | # Ceph OSD tree 2026-04-28 07:53:57.481748 | orchestrator | 2026-04-28 07:53:57.481760 | orchestrator | + echo 2026-04-28 07:53:57.481771 | orchestrator | + echo '# Ceph OSD tree' 2026-04-28 07:53:57.481783 | orchestrator | + echo 2026-04-28 07:53:57.481794 | orchestrator | + ceph osd df tree 2026-04-28 07:53:58.003245 | orchestrator | ID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP META AVAIL %USE VAR PGS STATUS TYPE NAME 2026-04-28 07:53:58.003360 | orchestrator | -1 0.11691 - 120 GiB 7.9 GiB 7.6 GiB 44 KiB 313 MiB 112 GiB 6.62 1.00 - root default 2026-04-28 07:53:58.003377 | orchestrator | -3 0.03897 - 40 GiB 2.7 GiB 2.5 GiB 15 KiB 112 MiB 37 GiB 6.64 1.00 - host testbed-node-3 2026-04-28 07:53:58.003389 | orchestrator | 0 hdd 0.01949 1.00000 20 GiB 1.2 GiB 1.1 GiB 8 KiB 58 MiB 19 GiB 5.97 0.90 189 up osd.0 2026-04-28 07:53:58.003401 | orchestrator | 3 hdd 0.01949 1.00000 20 GiB 1.5 GiB 1.4 GiB 7 KiB 54 MiB 19 GiB 7.31 1.10 201 up osd.3 2026-04-28 07:53:58.003411 | orchestrator | -7 0.03897 - 40 GiB 2.6 GiB 2.5 GiB 15 KiB 100 MiB 37 GiB 6.61 1.00 - host testbed-node-4 2026-04-28 07:53:58.003422 | orchestrator | 1 hdd 0.01949 1.00000 20 GiB 1.3 GiB 1.3 GiB 7 KiB 54 MiB 19 GiB 6.74 1.02 192 up osd.1 2026-04-28 07:53:58.003433 | orchestrator | 4 hdd 0.01949 1.00000 20 GiB 1.3 GiB 1.2 GiB 8 KiB 46 MiB 19 GiB 6.47 0.98 196 up osd.4 2026-04-28 07:53:58.003443 | orchestrator | -5 0.03897 - 40 GiB 2.6 GiB 2.5 GiB 14 KiB 100 MiB 37 GiB 6.61 1.00 - host testbed-node-5 2026-04-28 07:53:58.003454 | orchestrator | 2 hdd 0.01949 1.00000 20 GiB 1.5 GiB 1.5 GiB 8 KiB 46 MiB 18 GiB 7.68 1.16 206 up osd.2 2026-04-28 07:53:58.003465 | orchestrator | 5 hdd 0.01949 1.00000 20 GiB 1.1 GiB 1.1 GiB 6 KiB 54 MiB 19 GiB 5.53 0.84 186 up osd.5 2026-04-28 07:53:58.003475 | orchestrator | TOTAL 120 GiB 7.9 GiB 7.6 GiB 48 KiB 313 MiB 112 GiB 6.62 2026-04-28 07:53:58.003487 | orchestrator | MIN/MAX VAR: 0.84/1.16 STDDEV: 0.74 2026-04-28 07:53:58.051191 | orchestrator | 2026-04-28 07:53:58.051281 | orchestrator | # Ceph monitor status 2026-04-28 07:53:58.051303 | orchestrator | 2026-04-28 07:53:58.051323 | orchestrator | + echo 2026-04-28 07:53:58.051342 | orchestrator | + echo '# Ceph monitor status' 2026-04-28 07:53:58.051361 | orchestrator | + echo 2026-04-28 07:53:58.051379 | orchestrator | + ceph mon stat 2026-04-28 07:53:58.640382 | orchestrator | e1: 3 mons at {testbed-node-0=[v2:192.168.16.10:3300/0,v1:192.168.16.10:6789/0],testbed-node-1=[v2:192.168.16.11:3300/0,v1:192.168.16.11:6789/0],testbed-node-2=[v2:192.168.16.12:3300/0,v1:192.168.16.12:6789/0]} removed_ranks: {} disallowed_leaders: {}, election epoch 36, leader 0 testbed-node-0, quorum 0,1,2 testbed-node-0,testbed-node-1,testbed-node-2 2026-04-28 07:53:58.687014 | orchestrator | 2026-04-28 07:53:58.687133 | orchestrator | # Ceph quorum status 2026-04-28 07:53:58.687160 | orchestrator | 2026-04-28 07:53:58.687180 | orchestrator | + echo 2026-04-28 07:53:58.687199 | orchestrator | + echo '# Ceph quorum status' 2026-04-28 07:53:58.687218 | orchestrator | + echo 2026-04-28 07:53:58.687465 | orchestrator | + jq 2026-04-28 07:53:58.687498 | orchestrator | + ceph quorum_status 2026-04-28 07:53:59.339317 | orchestrator | { 2026-04-28 07:53:59.339419 | orchestrator | "election_epoch": 36, 2026-04-28 07:53:59.339437 | orchestrator | "quorum": [ 2026-04-28 07:53:59.339449 | orchestrator | 0, 2026-04-28 07:53:59.339461 | orchestrator | 1, 2026-04-28 07:53:59.339472 | orchestrator | 2 2026-04-28 07:53:59.339483 | orchestrator | ], 2026-04-28 07:53:59.339494 | orchestrator | "quorum_names": [ 2026-04-28 07:53:59.339533 | orchestrator | "testbed-node-0", 2026-04-28 07:53:59.339545 | orchestrator | "testbed-node-1", 2026-04-28 07:53:59.339556 | orchestrator | "testbed-node-2" 2026-04-28 07:53:59.339567 | orchestrator | ], 2026-04-28 07:53:59.339578 | orchestrator | "quorum_leader_name": "testbed-node-0", 2026-04-28 07:53:59.339590 | orchestrator | "quorum_age": 8395, 2026-04-28 07:53:59.339601 | orchestrator | "features": { 2026-04-28 07:53:59.339631 | orchestrator | "quorum_con": "4540138322906710015", 2026-04-28 07:53:59.339672 | orchestrator | "quorum_mon": [ 2026-04-28 07:53:59.339685 | orchestrator | "kraken", 2026-04-28 07:53:59.339696 | orchestrator | "luminous", 2026-04-28 07:53:59.339707 | orchestrator | "mimic", 2026-04-28 07:53:59.339718 | orchestrator | "osdmap-prune", 2026-04-28 07:53:59.339729 | orchestrator | "nautilus", 2026-04-28 07:53:59.339740 | orchestrator | "octopus", 2026-04-28 07:53:59.339751 | orchestrator | "pacific", 2026-04-28 07:53:59.339761 | orchestrator | "elector-pinging", 2026-04-28 07:53:59.339772 | orchestrator | "quincy", 2026-04-28 07:53:59.339783 | orchestrator | "reef" 2026-04-28 07:53:59.339795 | orchestrator | ] 2026-04-28 07:53:59.339814 | orchestrator | }, 2026-04-28 07:53:59.339832 | orchestrator | "monmap": { 2026-04-28 07:53:59.339851 | orchestrator | "epoch": 1, 2026-04-28 07:53:59.339869 | orchestrator | "fsid": "11111111-1111-1111-1111-111111111111", 2026-04-28 07:53:59.339888 | orchestrator | "modified": "2026-04-28T03:04:25.035097Z", 2026-04-28 07:53:59.339906 | orchestrator | "created": "2026-04-28T03:04:25.035097Z", 2026-04-28 07:53:59.339924 | orchestrator | "min_mon_release": 18, 2026-04-28 07:53:59.339942 | orchestrator | "min_mon_release_name": "reef", 2026-04-28 07:53:59.339960 | orchestrator | "election_strategy": 1, 2026-04-28 07:53:59.339977 | orchestrator | "disallowed_leaders: ": "", 2026-04-28 07:53:59.339995 | orchestrator | "stretch_mode": false, 2026-04-28 07:53:59.340014 | orchestrator | "tiebreaker_mon": "", 2026-04-28 07:53:59.340034 | orchestrator | "removed_ranks: ": "", 2026-04-28 07:53:59.340052 | orchestrator | "features": { 2026-04-28 07:53:59.340070 | orchestrator | "persistent": [ 2026-04-28 07:53:59.340089 | orchestrator | "kraken", 2026-04-28 07:53:59.340107 | orchestrator | "luminous", 2026-04-28 07:53:59.340126 | orchestrator | "mimic", 2026-04-28 07:53:59.340139 | orchestrator | "osdmap-prune", 2026-04-28 07:53:59.340149 | orchestrator | "nautilus", 2026-04-28 07:53:59.340160 | orchestrator | "octopus", 2026-04-28 07:53:59.340171 | orchestrator | "pacific", 2026-04-28 07:53:59.340181 | orchestrator | "elector-pinging", 2026-04-28 07:53:59.340193 | orchestrator | "quincy", 2026-04-28 07:53:59.340204 | orchestrator | "reef" 2026-04-28 07:53:59.340215 | orchestrator | ], 2026-04-28 07:53:59.340226 | orchestrator | "optional": [] 2026-04-28 07:53:59.340237 | orchestrator | }, 2026-04-28 07:53:59.340248 | orchestrator | "mons": [ 2026-04-28 07:53:59.340258 | orchestrator | { 2026-04-28 07:53:59.340269 | orchestrator | "rank": 0, 2026-04-28 07:53:59.340280 | orchestrator | "name": "testbed-node-0", 2026-04-28 07:53:59.340291 | orchestrator | "public_addrs": { 2026-04-28 07:53:59.340302 | orchestrator | "addrvec": [ 2026-04-28 07:53:59.340313 | orchestrator | { 2026-04-28 07:53:59.340324 | orchestrator | "type": "v2", 2026-04-28 07:53:59.340335 | orchestrator | "addr": "192.168.16.10:3300", 2026-04-28 07:53:59.340346 | orchestrator | "nonce": 0 2026-04-28 07:53:59.340356 | orchestrator | }, 2026-04-28 07:53:59.340367 | orchestrator | { 2026-04-28 07:53:59.340378 | orchestrator | "type": "v1", 2026-04-28 07:53:59.340389 | orchestrator | "addr": "192.168.16.10:6789", 2026-04-28 07:53:59.340400 | orchestrator | "nonce": 0 2026-04-28 07:53:59.340411 | orchestrator | } 2026-04-28 07:53:59.340421 | orchestrator | ] 2026-04-28 07:53:59.340432 | orchestrator | }, 2026-04-28 07:53:59.340443 | orchestrator | "addr": "192.168.16.10:6789/0", 2026-04-28 07:53:59.340454 | orchestrator | "public_addr": "192.168.16.10:6789/0", 2026-04-28 07:53:59.340465 | orchestrator | "priority": 0, 2026-04-28 07:53:59.340476 | orchestrator | "weight": 0, 2026-04-28 07:53:59.340486 | orchestrator | "crush_location": "{}" 2026-04-28 07:53:59.340497 | orchestrator | }, 2026-04-28 07:53:59.340508 | orchestrator | { 2026-04-28 07:53:59.340519 | orchestrator | "rank": 1, 2026-04-28 07:53:59.340530 | orchestrator | "name": "testbed-node-1", 2026-04-28 07:53:59.340541 | orchestrator | "public_addrs": { 2026-04-28 07:53:59.340552 | orchestrator | "addrvec": [ 2026-04-28 07:53:59.340563 | orchestrator | { 2026-04-28 07:53:59.340574 | orchestrator | "type": "v2", 2026-04-28 07:53:59.340585 | orchestrator | "addr": "192.168.16.11:3300", 2026-04-28 07:53:59.340614 | orchestrator | "nonce": 0 2026-04-28 07:53:59.340633 | orchestrator | }, 2026-04-28 07:53:59.340681 | orchestrator | { 2026-04-28 07:53:59.340701 | orchestrator | "type": "v1", 2026-04-28 07:53:59.340720 | orchestrator | "addr": "192.168.16.11:6789", 2026-04-28 07:53:59.340738 | orchestrator | "nonce": 0 2026-04-28 07:53:59.340759 | orchestrator | } 2026-04-28 07:53:59.340776 | orchestrator | ] 2026-04-28 07:53:59.340795 | orchestrator | }, 2026-04-28 07:53:59.340807 | orchestrator | "addr": "192.168.16.11:6789/0", 2026-04-28 07:53:59.340817 | orchestrator | "public_addr": "192.168.16.11:6789/0", 2026-04-28 07:53:59.340828 | orchestrator | "priority": 0, 2026-04-28 07:53:59.340839 | orchestrator | "weight": 0, 2026-04-28 07:53:59.340850 | orchestrator | "crush_location": "{}" 2026-04-28 07:53:59.340861 | orchestrator | }, 2026-04-28 07:53:59.340871 | orchestrator | { 2026-04-28 07:53:59.340882 | orchestrator | "rank": 2, 2026-04-28 07:53:59.340893 | orchestrator | "name": "testbed-node-2", 2026-04-28 07:53:59.340904 | orchestrator | "public_addrs": { 2026-04-28 07:53:59.340915 | orchestrator | "addrvec": [ 2026-04-28 07:53:59.340926 | orchestrator | { 2026-04-28 07:53:59.340937 | orchestrator | "type": "v2", 2026-04-28 07:53:59.340948 | orchestrator | "addr": "192.168.16.12:3300", 2026-04-28 07:53:59.340958 | orchestrator | "nonce": 0 2026-04-28 07:53:59.340969 | orchestrator | }, 2026-04-28 07:53:59.340980 | orchestrator | { 2026-04-28 07:53:59.340990 | orchestrator | "type": "v1", 2026-04-28 07:53:59.341001 | orchestrator | "addr": "192.168.16.12:6789", 2026-04-28 07:53:59.341012 | orchestrator | "nonce": 0 2026-04-28 07:53:59.341023 | orchestrator | } 2026-04-28 07:53:59.341033 | orchestrator | ] 2026-04-28 07:53:59.341044 | orchestrator | }, 2026-04-28 07:53:59.341055 | orchestrator | "addr": "192.168.16.12:6789/0", 2026-04-28 07:53:59.341066 | orchestrator | "public_addr": "192.168.16.12:6789/0", 2026-04-28 07:53:59.341076 | orchestrator | "priority": 0, 2026-04-28 07:53:59.341087 | orchestrator | "weight": 0, 2026-04-28 07:53:59.341098 | orchestrator | "crush_location": "{}" 2026-04-28 07:53:59.341108 | orchestrator | } 2026-04-28 07:53:59.341119 | orchestrator | ] 2026-04-28 07:53:59.341130 | orchestrator | } 2026-04-28 07:53:59.341141 | orchestrator | } 2026-04-28 07:53:59.341152 | orchestrator | 2026-04-28 07:53:59.341163 | orchestrator | # Ceph free space status 2026-04-28 07:53:59.341174 | orchestrator | + echo 2026-04-28 07:53:59.341184 | orchestrator | + echo '# Ceph free space status' 2026-04-28 07:53:59.341195 | orchestrator | 2026-04-28 07:53:59.341206 | orchestrator | + echo 2026-04-28 07:53:59.341217 | orchestrator | + ceph df 2026-04-28 07:53:59.925446 | orchestrator | --- RAW STORAGE --- 2026-04-28 07:53:59.925536 | orchestrator | CLASS SIZE AVAIL USED RAW USED %RAW USED 2026-04-28 07:53:59.925571 | orchestrator | hdd 120 GiB 112 GiB 7.9 GiB 7.9 GiB 6.62 2026-04-28 07:53:59.925579 | orchestrator | TOTAL 120 GiB 112 GiB 7.9 GiB 7.9 GiB 6.62 2026-04-28 07:53:59.925586 | orchestrator | 2026-04-28 07:53:59.925594 | orchestrator | --- POOLS --- 2026-04-28 07:53:59.925602 | orchestrator | POOL ID PGS STORED OBJECTS USED %USED MAX AVAIL 2026-04-28 07:53:59.925610 | orchestrator | .mgr 1 1 577 KiB 2 1.1 MiB 0 52 GiB 2026-04-28 07:53:59.925617 | orchestrator | cephfs_data 2 32 0 B 0 0 B 0 35 GiB 2026-04-28 07:53:59.925623 | orchestrator | cephfs_metadata 3 16 10 KiB 22 117 KiB 0 35 GiB 2026-04-28 07:53:59.925629 | orchestrator | default.rgw.buckets.data 4 32 0 B 0 0 B 0 35 GiB 2026-04-28 07:53:59.925636 | orchestrator | default.rgw.buckets.index 5 32 0 B 0 0 B 0 35 GiB 2026-04-28 07:53:59.925694 | orchestrator | default.rgw.control 6 32 0 B 8 0 B 0 35 GiB 2026-04-28 07:53:59.925702 | orchestrator | default.rgw.log 7 32 3.6 KiB 209 408 KiB 0 35 GiB 2026-04-28 07:53:59.925708 | orchestrator | default.rgw.meta 8 32 0 B 0 0 B 0 35 GiB 2026-04-28 07:53:59.925728 | orchestrator | .rgw.root 9 32 3.9 KiB 8 64 KiB 0 52 GiB 2026-04-28 07:53:59.925735 | orchestrator | backups 10 32 19 B 2 12 KiB 0 35 GiB 2026-04-28 07:53:59.925741 | orchestrator | volumes 11 32 325 MiB 267 974 MiB 0.90 35 GiB 2026-04-28 07:53:59.925766 | orchestrator | images 12 32 2.2 GiB 299 6.7 GiB 5.98 35 GiB 2026-04-28 07:53:59.925773 | orchestrator | metrics 13 32 19 B 2 12 KiB 0 35 GiB 2026-04-28 07:53:59.925780 | orchestrator | vms 14 32 19 B 2 12 KiB 0 35 GiB 2026-04-28 07:53:59.987841 | orchestrator | ++ semver 10.0.0 5.0.0 2026-04-28 07:54:00.049905 | orchestrator | + [[ 1 -eq -1 ]] 2026-04-28 07:54:00.049996 | orchestrator | + osism apply facts 2026-04-28 07:54:01.376470 | orchestrator | 2026-04-28 07:54:01 | INFO  | Prepare task for execution of facts. 2026-04-28 07:54:01.460197 | orchestrator | 2026-04-28 07:54:01 | INFO  | Task d77eef16-de08-4ae3-909e-485a55e6410e (facts) was prepared for execution. 2026-04-28 07:54:01.460309 | orchestrator | 2026-04-28 07:54:01 | INFO  | It takes a moment until task d77eef16-de08-4ae3-909e-485a55e6410e (facts) has been started and output is visible here. 2026-04-28 07:54:25.958503 | orchestrator | 2026-04-28 07:54:25.958622 | orchestrator | PLAY [Apply role facts] ******************************************************** 2026-04-28 07:54:25.958641 | orchestrator | 2026-04-28 07:54:25.958654 | orchestrator | TASK [osism.commons.facts : Create custom facts directory] ********************* 2026-04-28 07:54:25.958667 | orchestrator | Tuesday 28 April 2026 07:54:07 +0000 (0:00:02.758) 0:00:02.758 ********* 2026-04-28 07:54:25.958740 | orchestrator | ok: [testbed-manager] 2026-04-28 07:54:25.958758 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:54:25.958769 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:54:25.958780 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:54:25.958791 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:54:25.958809 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:54:25.958827 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:54:25.958847 | orchestrator | 2026-04-28 07:54:25.958865 | orchestrator | TASK [osism.commons.facts : Copy fact files] *********************************** 2026-04-28 07:54:25.958881 | orchestrator | Tuesday 28 April 2026 07:54:12 +0000 (0:00:04.431) 0:00:07.190 ********* 2026-04-28 07:54:25.958900 | orchestrator | skipping: [testbed-manager] 2026-04-28 07:54:25.958921 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:54:25.958942 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:54:25.958961 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:54:25.958978 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:54:25.958990 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:54:25.959001 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:54:25.959012 | orchestrator | 2026-04-28 07:54:25.959026 | orchestrator | PLAY [Gather facts for all hosts] ********************************************** 2026-04-28 07:54:25.959039 | orchestrator | 2026-04-28 07:54:25.959052 | orchestrator | TASK [Gathers facts about hosts] *********************************************** 2026-04-28 07:54:25.959064 | orchestrator | Tuesday 28 April 2026 07:54:15 +0000 (0:00:03.116) 0:00:10.306 ********* 2026-04-28 07:54:25.959077 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:54:25.959090 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:54:25.959102 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:54:25.959114 | orchestrator | ok: [testbed-manager] 2026-04-28 07:54:25.959127 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:54:25.959138 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:54:25.959150 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:54:25.959163 | orchestrator | 2026-04-28 07:54:25.959202 | orchestrator | PLAY [Gather facts for all hosts if using --limit] ***************************** 2026-04-28 07:54:25.959214 | orchestrator | 2026-04-28 07:54:25.959227 | orchestrator | TASK [Gather facts for all hosts] ********************************************** 2026-04-28 07:54:25.959240 | orchestrator | Tuesday 28 April 2026 07:54:23 +0000 (0:00:07.859) 0:00:18.165 ********* 2026-04-28 07:54:25.959252 | orchestrator | skipping: [testbed-manager] 2026-04-28 07:54:25.959265 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:54:25.959277 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:54:25.959290 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:54:25.959302 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:54:25.959314 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:54:25.959355 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:54:25.959368 | orchestrator | 2026-04-28 07:54:25.959380 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 07:54:25.959393 | orchestrator | testbed-manager : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 07:54:25.959407 | orchestrator | testbed-node-0 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 07:54:25.959425 | orchestrator | testbed-node-1 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 07:54:25.959444 | orchestrator | testbed-node-2 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 07:54:25.959464 | orchestrator | testbed-node-3 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 07:54:25.959482 | orchestrator | testbed-node-4 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 07:54:25.959500 | orchestrator | testbed-node-5 : ok=2  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 07:54:25.959517 | orchestrator | 2026-04-28 07:54:25.959536 | orchestrator | 2026-04-28 07:54:25.959555 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 07:54:25.959575 | orchestrator | Tuesday 28 April 2026 07:54:25 +0000 (0:00:02.530) 0:00:20.695 ********* 2026-04-28 07:54:25.959594 | orchestrator | =============================================================================== 2026-04-28 07:54:25.959613 | orchestrator | Gathers facts about hosts ----------------------------------------------- 7.86s 2026-04-28 07:54:25.959633 | orchestrator | osism.commons.facts : Create custom facts directory --------------------- 4.43s 2026-04-28 07:54:25.959652 | orchestrator | osism.commons.facts : Copy fact files ----------------------------------- 3.12s 2026-04-28 07:54:25.959672 | orchestrator | Gather facts for all hosts ---------------------------------------------- 2.53s 2026-04-28 07:54:26.186749 | orchestrator | + osism validate ceph-mons 2026-04-28 07:54:59.632620 | orchestrator | 2026-04-28 07:54:59.632805 | orchestrator | PLAY [Ceph validate mons] ****************************************************** 2026-04-28 07:54:59.632828 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_play_start) in callback plugin 2026-04-28 07:54:59.632842 | orchestrator | (): Expecting value: line 2 column 1 (char 1) 2026-04-28 07:54:59.632865 | orchestrator | 2026-04-28 07:54:59.632877 | orchestrator | TASK [Get timestamp for report file] ******************************************* 2026-04-28 07:54:59.632887 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_task_start) in callback plugin 2026-04-28 07:54:59.632898 | orchestrator | (): 'NoneType' object is not subscriptable 2026-04-28 07:54:59.632920 | orchestrator | Tuesday 28 April 2026 07:54:42 +0000 (0:00:01.376) 0:00:01.376 ********* 2026-04-28 07:54:59.632931 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 07:54:59.632943 | orchestrator | 2026-04-28 07:54:59.632954 | orchestrator | TASK [Create report output directory] ****************************************** 2026-04-28 07:54:59.632964 | orchestrator | Tuesday 28 April 2026 07:54:44 +0000 (0:00:01.750) 0:00:03.126 ********* 2026-04-28 07:54:59.632975 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 07:54:59.632986 | orchestrator | 2026-04-28 07:54:59.632997 | orchestrator | TASK [Define report vars] ****************************************************** 2026-04-28 07:54:59.633008 | orchestrator | Tuesday 28 April 2026 07:54:45 +0000 (0:00:00.762) 0:00:03.889 ********* 2026-04-28 07:54:59.633043 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:54:59.633056 | orchestrator | 2026-04-28 07:54:59.633067 | orchestrator | TASK [Prepare test data for container existance test] ************************** 2026-04-28 07:54:59.633078 | orchestrator | Tuesday 28 April 2026 07:54:45 +0000 (0:00:00.123) 0:00:04.013 ********* 2026-04-28 07:54:59.633090 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:54:59.633117 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:54:59.633128 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:54:59.633139 | orchestrator | 2026-04-28 07:54:59.633150 | orchestrator | TASK [Get container info] ****************************************************** 2026-04-28 07:54:59.633164 | orchestrator | Tuesday 28 April 2026 07:54:45 +0000 (0:00:00.630) 0:00:04.644 ********* 2026-04-28 07:54:59.633176 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:54:59.633189 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:54:59.633202 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:54:59.633213 | orchestrator | 2026-04-28 07:54:59.633226 | orchestrator | TASK [Set test result to failed if container is missing] *********************** 2026-04-28 07:54:59.633238 | orchestrator | Tuesday 28 April 2026 07:54:47 +0000 (0:00:01.695) 0:00:06.340 ********* 2026-04-28 07:54:59.633250 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:54:59.633262 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:54:59.633275 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:54:59.633287 | orchestrator | 2026-04-28 07:54:59.633299 | orchestrator | TASK [Set test result to passed if container is existing] ********************** 2026-04-28 07:54:59.633312 | orchestrator | Tuesday 28 April 2026 07:54:47 +0000 (0:00:00.321) 0:00:06.661 ********* 2026-04-28 07:54:59.633325 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:54:59.633337 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:54:59.633349 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:54:59.633361 | orchestrator | 2026-04-28 07:54:59.633374 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-28 07:54:59.633386 | orchestrator | Tuesday 28 April 2026 07:54:48 +0000 (0:00:00.394) 0:00:07.056 ********* 2026-04-28 07:54:59.633399 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:54:59.633411 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:54:59.633423 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:54:59.633435 | orchestrator | 2026-04-28 07:54:59.633448 | orchestrator | TASK [Set test result to failed if ceph-mon is not running] ******************** 2026-04-28 07:54:59.633461 | orchestrator | Tuesday 28 April 2026 07:54:48 +0000 (0:00:00.558) 0:00:07.615 ********* 2026-04-28 07:54:59.633473 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:54:59.633485 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:54:59.633498 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:54:59.633511 | orchestrator | 2026-04-28 07:54:59.633523 | orchestrator | TASK [Set test result to passed if ceph-mon is running] ************************ 2026-04-28 07:54:59.633534 | orchestrator | Tuesday 28 April 2026 07:54:49 +0000 (0:00:00.333) 0:00:07.948 ********* 2026-04-28 07:54:59.633544 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:54:59.633555 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:54:59.633565 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:54:59.633576 | orchestrator | 2026-04-28 07:54:59.633587 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-28 07:54:59.633598 | orchestrator | Tuesday 28 April 2026 07:54:49 +0000 (0:00:00.341) 0:00:08.289 ********* 2026-04-28 07:54:59.633609 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:54:59.633620 | orchestrator | 2026-04-28 07:54:59.633630 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-28 07:54:59.633641 | orchestrator | Tuesday 28 April 2026 07:54:49 +0000 (0:00:00.304) 0:00:08.594 ********* 2026-04-28 07:54:59.633652 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:54:59.633663 | orchestrator | 2026-04-28 07:54:59.633673 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-28 07:54:59.633684 | orchestrator | Tuesday 28 April 2026 07:54:50 +0000 (0:00:00.269) 0:00:08.863 ********* 2026-04-28 07:54:59.633695 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:54:59.633713 | orchestrator | 2026-04-28 07:54:59.633746 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 07:54:59.633759 | orchestrator | Tuesday 28 April 2026 07:54:50 +0000 (0:00:00.268) 0:00:09.132 ********* 2026-04-28 07:54:59.633770 | orchestrator | 2026-04-28 07:54:59.633780 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 07:54:59.633791 | orchestrator | Tuesday 28 April 2026 07:54:50 +0000 (0:00:00.086) 0:00:09.219 ********* 2026-04-28 07:54:59.633802 | orchestrator | 2026-04-28 07:54:59.633813 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 07:54:59.633841 | orchestrator | Tuesday 28 April 2026 07:54:50 +0000 (0:00:00.319) 0:00:09.538 ********* 2026-04-28 07:54:59.633853 | orchestrator | 2026-04-28 07:54:59.633864 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-28 07:54:59.633875 | orchestrator | Tuesday 28 April 2026 07:54:50 +0000 (0:00:00.079) 0:00:09.618 ********* 2026-04-28 07:54:59.633886 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:54:59.633897 | orchestrator | 2026-04-28 07:54:59.633908 | orchestrator | TASK [Fail due to missing containers] ****************************************** 2026-04-28 07:54:59.633918 | orchestrator | Tuesday 28 April 2026 07:54:51 +0000 (0:00:00.301) 0:00:09.920 ********* 2026-04-28 07:54:59.633929 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:54:59.633940 | orchestrator | 2026-04-28 07:54:59.633950 | orchestrator | TASK [Prepare quorum test vars] ************************************************ 2026-04-28 07:54:59.633961 | orchestrator | Tuesday 28 April 2026 07:54:51 +0000 (0:00:00.279) 0:00:10.199 ********* 2026-04-28 07:54:59.633975 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:54:59.633994 | orchestrator | 2026-04-28 07:54:59.634078 | orchestrator | TASK [Get monmap info from one mon container] ********************************** 2026-04-28 07:54:59.634102 | orchestrator | Tuesday 28 April 2026 07:54:51 +0000 (0:00:00.125) 0:00:10.324 ********* 2026-04-28 07:54:59.634121 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:54:59.634140 | orchestrator | 2026-04-28 07:54:59.634158 | orchestrator | TASK [Set quorum test data] **************************************************** 2026-04-28 07:54:59.634176 | orchestrator | Tuesday 28 April 2026 07:54:53 +0000 (0:00:01.660) 0:00:11.984 ********* 2026-04-28 07:54:59.634195 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:54:59.634211 | orchestrator | 2026-04-28 07:54:59.634230 | orchestrator | TASK [Fail quorum test if not all monitors are in quorum] ********************** 2026-04-28 07:54:59.634248 | orchestrator | Tuesday 28 April 2026 07:54:53 +0000 (0:00:00.366) 0:00:12.350 ********* 2026-04-28 07:54:59.634265 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:54:59.634284 | orchestrator | 2026-04-28 07:54:59.634303 | orchestrator | TASK [Pass quorum test if all monitors are in quorum] ************************** 2026-04-28 07:54:59.634323 | orchestrator | Tuesday 28 April 2026 07:54:53 +0000 (0:00:00.140) 0:00:12.491 ********* 2026-04-28 07:54:59.634342 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:54:59.634361 | orchestrator | 2026-04-28 07:54:59.634373 | orchestrator | TASK [Set fsid test vars] ****************************************************** 2026-04-28 07:54:59.634384 | orchestrator | Tuesday 28 April 2026 07:54:53 +0000 (0:00:00.312) 0:00:12.804 ********* 2026-04-28 07:54:59.634394 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:54:59.634405 | orchestrator | 2026-04-28 07:54:59.634416 | orchestrator | TASK [Fail Cluster FSID test if FSID does not match configuration] ************* 2026-04-28 07:54:59.634427 | orchestrator | Tuesday 28 April 2026 07:54:54 +0000 (0:00:00.352) 0:00:13.157 ********* 2026-04-28 07:54:59.634437 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:54:59.634448 | orchestrator | 2026-04-28 07:54:59.634459 | orchestrator | TASK [Pass Cluster FSID test if it matches configuration] ********************** 2026-04-28 07:54:59.634469 | orchestrator | Tuesday 28 April 2026 07:54:54 +0000 (0:00:00.120) 0:00:13.277 ********* 2026-04-28 07:54:59.634480 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:54:59.634491 | orchestrator | 2026-04-28 07:54:59.634502 | orchestrator | TASK [Prepare status test vars] ************************************************ 2026-04-28 07:54:59.634512 | orchestrator | Tuesday 28 April 2026 07:54:54 +0000 (0:00:00.131) 0:00:13.409 ********* 2026-04-28 07:54:59.634533 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:54:59.634544 | orchestrator | 2026-04-28 07:54:59.634555 | orchestrator | TASK [Gather status data] ****************************************************** 2026-04-28 07:54:59.634566 | orchestrator | Tuesday 28 April 2026 07:54:54 +0000 (0:00:00.324) 0:00:13.734 ********* 2026-04-28 07:54:59.634576 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:54:59.634587 | orchestrator | 2026-04-28 07:54:59.634598 | orchestrator | TASK [Set health test data] **************************************************** 2026-04-28 07:54:59.634608 | orchestrator | Tuesday 28 April 2026 07:54:56 +0000 (0:00:01.294) 0:00:15.029 ********* 2026-04-28 07:54:59.634619 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:54:59.634630 | orchestrator | 2026-04-28 07:54:59.634641 | orchestrator | TASK [Fail cluster-health if health is not acceptable] ************************* 2026-04-28 07:54:59.634660 | orchestrator | Tuesday 28 April 2026 07:54:56 +0000 (0:00:00.337) 0:00:15.366 ********* 2026-04-28 07:54:59.634678 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:54:59.634696 | orchestrator | 2026-04-28 07:54:59.634715 | orchestrator | TASK [Pass cluster-health if health is acceptable] ***************************** 2026-04-28 07:54:59.634780 | orchestrator | Tuesday 28 April 2026 07:54:56 +0000 (0:00:00.142) 0:00:15.509 ********* 2026-04-28 07:54:59.634801 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:54:59.634815 | orchestrator | 2026-04-28 07:54:59.634827 | orchestrator | TASK [Fail cluster-health if health is not acceptable (strict)] **************** 2026-04-28 07:54:59.634838 | orchestrator | Tuesday 28 April 2026 07:54:56 +0000 (0:00:00.156) 0:00:15.666 ********* 2026-04-28 07:54:59.634848 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:54:59.634859 | orchestrator | 2026-04-28 07:54:59.634870 | orchestrator | TASK [Pass cluster-health if status is OK (strict)] **************************** 2026-04-28 07:54:59.634881 | orchestrator | Tuesday 28 April 2026 07:54:56 +0000 (0:00:00.132) 0:00:15.798 ********* 2026-04-28 07:54:59.634892 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:54:59.634903 | orchestrator | 2026-04-28 07:54:59.634914 | orchestrator | TASK [Set validation result to passed if no test failed] *********************** 2026-04-28 07:54:59.634925 | orchestrator | Tuesday 28 April 2026 07:54:57 +0000 (0:00:00.202) 0:00:16.000 ********* 2026-04-28 07:54:59.634935 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 07:54:59.634946 | orchestrator | 2026-04-28 07:54:59.634964 | orchestrator | TASK [Set validation result to failed if a test failed] ************************ 2026-04-28 07:54:59.634975 | orchestrator | Tuesday 28 April 2026 07:54:57 +0000 (0:00:00.279) 0:00:16.280 ********* 2026-04-28 07:54:59.634986 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:54:59.634997 | orchestrator | 2026-04-28 07:54:59.635008 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-28 07:54:59.635019 | orchestrator | Tuesday 28 April 2026 07:54:57 +0000 (0:00:00.259) 0:00:16.539 ********* 2026-04-28 07:54:59.635030 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 07:54:59.635041 | orchestrator | 2026-04-28 07:54:59.635062 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-28 07:55:04.106400 | orchestrator | Tuesday 28 April 2026 07:54:59 +0000 (0:00:01.930) 0:00:18.470 ********* 2026-04-28 07:55:04.106474 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 07:55:04.106484 | orchestrator | 2026-04-28 07:55:04.106493 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-28 07:55:04.106501 | orchestrator | Tuesday 28 April 2026 07:55:00 +0000 (0:00:00.497) 0:00:18.967 ********* 2026-04-28 07:55:04.106509 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 07:55:04.106516 | orchestrator | 2026-04-28 07:55:04.106525 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 07:55:04.106532 | orchestrator | Tuesday 28 April 2026 07:55:00 +0000 (0:00:00.703) 0:00:19.670 ********* 2026-04-28 07:55:04.106539 | orchestrator | 2026-04-28 07:55:04.106547 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 07:55:04.106554 | orchestrator | Tuesday 28 April 2026 07:55:00 +0000 (0:00:00.075) 0:00:19.746 ********* 2026-04-28 07:55:04.106581 | orchestrator | 2026-04-28 07:55:04.106589 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 07:55:04.106597 | orchestrator | Tuesday 28 April 2026 07:55:00 +0000 (0:00:00.074) 0:00:19.821 ********* 2026-04-28 07:55:04.106604 | orchestrator | 2026-04-28 07:55:04.106611 | orchestrator | RUNNING HANDLER [Write report file] ******************************************** 2026-04-28 07:55:04.106619 | orchestrator | [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback 2026-04-28 07:55:04.106627 | orchestrator | plugin (): 'NoneType' object is not subscriptable 2026-04-28 07:55:04.106640 | orchestrator | Tuesday 28 April 2026 07:55:01 +0000 (0:00:00.078) 0:00:19.899 ********* 2026-04-28 07:55:04.106647 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 07:55:04.106654 | orchestrator | 2026-04-28 07:55:04.106661 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-28 07:55:04.106668 | orchestrator | Tuesday 28 April 2026 07:55:02 +0000 (0:00:01.397) 0:00:21.297 ********* 2026-04-28 07:55:04.106675 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => { 2026-04-28 07:55:04.106682 | orchestrator |  "msg": [ 2026-04-28 07:55:04.106692 | orchestrator |  "Validator run completed.", 2026-04-28 07:55:04.106700 | orchestrator |  "You can find the report file here:", 2026-04-28 07:55:04.106708 | orchestrator |  "/opt/reports/validator/ceph-mons-validator-2026-04-28T07:54:43+00:00-report.json", 2026-04-28 07:55:04.106717 | orchestrator |  "on the following host:", 2026-04-28 07:55:04.106724 | orchestrator |  "testbed-manager" 2026-04-28 07:55:04.106731 | orchestrator |  ] 2026-04-28 07:55:04.106797 | orchestrator | } 2026-04-28 07:55:04.106806 | orchestrator | 2026-04-28 07:55:04.106813 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 07:55:04.106822 | orchestrator | testbed-node-0 : ok=24  changed=4  unreachable=0 failed=0 skipped=13  rescued=0 ignored=0 2026-04-28 07:55:04.106832 | orchestrator | testbed-node-1 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 07:55:04.106841 | orchestrator | testbed-node-2 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 07:55:04.106849 | orchestrator | 2026-04-28 07:55:04.106857 | orchestrator | 2026-04-28 07:55:04.106867 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 07:55:04.106875 | orchestrator | Tuesday 28 April 2026 07:55:03 +0000 (0:00:01.199) 0:00:22.496 ********* 2026-04-28 07:55:04.106885 | orchestrator | =============================================================================== 2026-04-28 07:55:04.106892 | orchestrator | Aggregate test results step one ----------------------------------------- 1.93s 2026-04-28 07:55:04.106899 | orchestrator | Get timestamp for report file ------------------------------------------- 1.75s 2026-04-28 07:55:04.106907 | orchestrator | Get container info ------------------------------------------------------ 1.70s 2026-04-28 07:55:04.106916 | orchestrator | Get monmap info from one mon container ---------------------------------- 1.66s 2026-04-28 07:55:04.106925 | orchestrator | Write report file ------------------------------------------------------- 1.40s 2026-04-28 07:55:04.106934 | orchestrator | Gather status data ------------------------------------------------------ 1.29s 2026-04-28 07:55:04.106943 | orchestrator | Print report file information ------------------------------------------- 1.20s 2026-04-28 07:55:04.106952 | orchestrator | Create report output directory ------------------------------------------ 0.76s 2026-04-28 07:55:04.106960 | orchestrator | Aggregate test results step three --------------------------------------- 0.70s 2026-04-28 07:55:04.106968 | orchestrator | Prepare test data for container existance test -------------------------- 0.63s 2026-04-28 07:55:04.106985 | orchestrator | Prepare test data ------------------------------------------------------- 0.56s 2026-04-28 07:55:04.107008 | orchestrator | Aggregate test results step two ----------------------------------------- 0.50s 2026-04-28 07:55:04.107016 | orchestrator | Flush handlers ---------------------------------------------------------- 0.49s 2026-04-28 07:55:04.107024 | orchestrator | Set test result to passed if container is existing ---------------------- 0.39s 2026-04-28 07:55:04.107032 | orchestrator | Set quorum test data ---------------------------------------------------- 0.37s 2026-04-28 07:55:04.107039 | orchestrator | Set fsid test vars ------------------------------------------------------ 0.35s 2026-04-28 07:55:04.107047 | orchestrator | Set test result to passed if ceph-mon is running ------------------------ 0.34s 2026-04-28 07:55:04.107073 | orchestrator | Set health test data ---------------------------------------------------- 0.34s 2026-04-28 07:55:04.107081 | orchestrator | Set test result to failed if ceph-mon is not running -------------------- 0.33s 2026-04-28 07:55:04.107088 | orchestrator | Prepare status test vars ------------------------------------------------ 0.33s 2026-04-28 07:55:04.328539 | orchestrator | + osism validate ceph-mgrs 2026-04-28 07:56:08.442169 | orchestrator | 2026-04-28 07:56:08.442318 | orchestrator | PLAY [Ceph validate mgrs] ****************************************************** 2026-04-28 07:56:08.442349 | orchestrator | 2026-04-28 07:56:08.442369 | orchestrator | TASK [Get timestamp for report file] ******************************************* 2026-04-28 07:56:08.442389 | orchestrator | Tuesday 28 April 2026 07:55:21 +0000 (0:00:01.780) 0:00:01.780 ********* 2026-04-28 07:56:08.442409 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 07:56:08.442427 | orchestrator | 2026-04-28 07:56:08.442445 | orchestrator | TASK [Create report output directory] ****************************************** 2026-04-28 07:56:08.442463 | orchestrator | Tuesday 28 April 2026 07:55:24 +0000 (0:00:02.922) 0:00:04.702 ********* 2026-04-28 07:56:08.442482 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 07:56:08.442498 | orchestrator | 2026-04-28 07:56:08.442516 | orchestrator | TASK [Define report vars] ****************************************************** 2026-04-28 07:56:08.442536 | orchestrator | Tuesday 28 April 2026 07:55:25 +0000 (0:00:01.712) 0:00:06.415 ********* 2026-04-28 07:56:08.442555 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:56:08.442575 | orchestrator | 2026-04-28 07:56:08.442593 | orchestrator | TASK [Prepare test data for container existance test] ************************** 2026-04-28 07:56:08.442612 | orchestrator | Tuesday 28 April 2026 07:55:27 +0000 (0:00:01.213) 0:00:07.628 ********* 2026-04-28 07:56:08.442631 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:56:08.442651 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:56:08.442670 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:56:08.442689 | orchestrator | 2026-04-28 07:56:08.442706 | orchestrator | TASK [Get container info] ****************************************************** 2026-04-28 07:56:08.442725 | orchestrator | Tuesday 28 April 2026 07:55:28 +0000 (0:00:01.720) 0:00:09.349 ********* 2026-04-28 07:56:08.442744 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:56:08.442761 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:56:08.442778 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:56:08.442795 | orchestrator | 2026-04-28 07:56:08.442812 | orchestrator | TASK [Set test result to failed if container is missing] *********************** 2026-04-28 07:56:08.442864 | orchestrator | Tuesday 28 April 2026 07:55:31 +0000 (0:00:02.582) 0:00:11.932 ********* 2026-04-28 07:56:08.442883 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:56:08.442901 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:56:08.442920 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:56:08.442939 | orchestrator | 2026-04-28 07:56:08.442957 | orchestrator | TASK [Set test result to passed if container is existing] ********************** 2026-04-28 07:56:08.442976 | orchestrator | Tuesday 28 April 2026 07:55:32 +0000 (0:00:01.338) 0:00:13.270 ********* 2026-04-28 07:56:08.442995 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:56:08.443013 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:56:08.443033 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:56:08.443051 | orchestrator | 2026-04-28 07:56:08.443070 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-28 07:56:08.443123 | orchestrator | Tuesday 28 April 2026 07:55:34 +0000 (0:00:01.348) 0:00:14.618 ********* 2026-04-28 07:56:08.443140 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:56:08.443159 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:56:08.443177 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:56:08.443194 | orchestrator | 2026-04-28 07:56:08.443214 | orchestrator | TASK [Set test result to failed if ceph-mgr is not running] ******************** 2026-04-28 07:56:08.443233 | orchestrator | Tuesday 28 April 2026 07:55:35 +0000 (0:00:01.361) 0:00:15.980 ********* 2026-04-28 07:56:08.443252 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:56:08.443271 | orchestrator | skipping: [testbed-node-1] 2026-04-28 07:56:08.443288 | orchestrator | skipping: [testbed-node-2] 2026-04-28 07:56:08.443307 | orchestrator | 2026-04-28 07:56:08.443325 | orchestrator | TASK [Set test result to passed if ceph-mgr is running] ************************ 2026-04-28 07:56:08.443342 | orchestrator | Tuesday 28 April 2026 07:55:36 +0000 (0:00:01.406) 0:00:17.386 ********* 2026-04-28 07:56:08.443360 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:56:08.443378 | orchestrator | ok: [testbed-node-1] 2026-04-28 07:56:08.443394 | orchestrator | ok: [testbed-node-2] 2026-04-28 07:56:08.443409 | orchestrator | 2026-04-28 07:56:08.443426 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-28 07:56:08.443444 | orchestrator | Tuesday 28 April 2026 07:55:38 +0000 (0:00:01.330) 0:00:18.717 ********* 2026-04-28 07:56:08.443461 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:56:08.443478 | orchestrator | 2026-04-28 07:56:08.443497 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-28 07:56:08.443513 | orchestrator | Tuesday 28 April 2026 07:55:39 +0000 (0:00:01.265) 0:00:19.983 ********* 2026-04-28 07:56:08.443528 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:56:08.443545 | orchestrator | 2026-04-28 07:56:08.443562 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-28 07:56:08.443578 | orchestrator | Tuesday 28 April 2026 07:55:40 +0000 (0:00:01.254) 0:00:21.237 ********* 2026-04-28 07:56:08.443595 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:56:08.443611 | orchestrator | 2026-04-28 07:56:08.443629 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 07:56:08.443648 | orchestrator | Tuesday 28 April 2026 07:55:41 +0000 (0:00:01.281) 0:00:22.519 ********* 2026-04-28 07:56:08.443665 | orchestrator | 2026-04-28 07:56:08.443682 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 07:56:08.443701 | orchestrator | Tuesday 28 April 2026 07:55:42 +0000 (0:00:00.474) 0:00:22.993 ********* 2026-04-28 07:56:08.443719 | orchestrator | 2026-04-28 07:56:08.443737 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 07:56:08.443755 | orchestrator | Tuesday 28 April 2026 07:55:43 +0000 (0:00:00.680) 0:00:23.674 ********* 2026-04-28 07:56:08.443772 | orchestrator | 2026-04-28 07:56:08.443790 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-28 07:56:08.443808 | orchestrator | Tuesday 28 April 2026 07:55:43 +0000 (0:00:00.792) 0:00:24.466 ********* 2026-04-28 07:56:08.443856 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:56:08.443876 | orchestrator | 2026-04-28 07:56:08.443893 | orchestrator | TASK [Fail due to missing containers] ****************************************** 2026-04-28 07:56:08.443912 | orchestrator | Tuesday 28 April 2026 07:55:45 +0000 (0:00:01.283) 0:00:25.749 ********* 2026-04-28 07:56:08.443931 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:56:08.443949 | orchestrator | 2026-04-28 07:56:08.443997 | orchestrator | TASK [Define mgr module test vars] ********************************************* 2026-04-28 07:56:08.444018 | orchestrator | Tuesday 28 April 2026 07:55:46 +0000 (0:00:01.397) 0:00:27.148 ********* 2026-04-28 07:56:08.444037 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:56:08.444056 | orchestrator | 2026-04-28 07:56:08.444073 | orchestrator | TASK [Gather list of mgr modules] ********************************************** 2026-04-28 07:56:08.444092 | orchestrator | Tuesday 28 April 2026 07:55:47 +0000 (0:00:01.141) 0:00:28.289 ********* 2026-04-28 07:56:08.444127 | orchestrator | changed: [testbed-node-0] 2026-04-28 07:56:08.444146 | orchestrator | 2026-04-28 07:56:08.444164 | orchestrator | TASK [Parse mgr module list from json] ***************************************** 2026-04-28 07:56:08.444183 | orchestrator | Tuesday 28 April 2026 07:55:50 +0000 (0:00:03.056) 0:00:31.346 ********* 2026-04-28 07:56:08.444199 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:56:08.444216 | orchestrator | 2026-04-28 07:56:08.444234 | orchestrator | TASK [Extract list of enabled mgr modules] ************************************* 2026-04-28 07:56:08.444252 | orchestrator | Tuesday 28 April 2026 07:55:52 +0000 (0:00:01.292) 0:00:32.639 ********* 2026-04-28 07:56:08.444270 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:56:08.444288 | orchestrator | 2026-04-28 07:56:08.444306 | orchestrator | TASK [Fail test if mgr modules are disabled that should be enabled] ************ 2026-04-28 07:56:08.444324 | orchestrator | Tuesday 28 April 2026 07:55:53 +0000 (0:00:01.376) 0:00:34.016 ********* 2026-04-28 07:56:08.444341 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:56:08.444357 | orchestrator | 2026-04-28 07:56:08.444375 | orchestrator | TASK [Pass test if required mgr modules are enabled] *************************** 2026-04-28 07:56:08.444392 | orchestrator | Tuesday 28 April 2026 07:55:54 +0000 (0:00:01.142) 0:00:35.159 ********* 2026-04-28 07:56:08.444410 | orchestrator | ok: [testbed-node-0] 2026-04-28 07:56:08.444428 | orchestrator | 2026-04-28 07:56:08.444446 | orchestrator | TASK [Set validation result to passed if no test failed] *********************** 2026-04-28 07:56:08.444463 | orchestrator | Tuesday 28 April 2026 07:55:55 +0000 (0:00:01.153) 0:00:36.312 ********* 2026-04-28 07:56:08.444480 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 07:56:08.444498 | orchestrator | 2026-04-28 07:56:08.444516 | orchestrator | TASK [Set validation result to failed if a test failed] ************************ 2026-04-28 07:56:08.444560 | orchestrator | Tuesday 28 April 2026 07:55:57 +0000 (0:00:01.565) 0:00:37.878 ********* 2026-04-28 07:56:08.444581 | orchestrator | skipping: [testbed-node-0] 2026-04-28 07:56:08.444600 | orchestrator | 2026-04-28 07:56:08.444618 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-28 07:56:08.444636 | orchestrator | Tuesday 28 April 2026 07:55:58 +0000 (0:00:01.493) 0:00:39.372 ********* 2026-04-28 07:56:08.444653 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 07:56:08.444672 | orchestrator | 2026-04-28 07:56:08.444691 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-28 07:56:08.444710 | orchestrator | Tuesday 28 April 2026 07:56:01 +0000 (0:00:02.322) 0:00:41.694 ********* 2026-04-28 07:56:08.444729 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 07:56:08.444746 | orchestrator | 2026-04-28 07:56:08.444764 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-28 07:56:08.444782 | orchestrator | Tuesday 28 April 2026 07:56:02 +0000 (0:00:01.307) 0:00:43.002 ********* 2026-04-28 07:56:08.444801 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 07:56:08.444881 | orchestrator | 2026-04-28 07:56:08.444906 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 07:56:08.444926 | orchestrator | Tuesday 28 April 2026 07:56:03 +0000 (0:00:01.290) 0:00:44.293 ********* 2026-04-28 07:56:08.444944 | orchestrator | 2026-04-28 07:56:08.444963 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 07:56:08.444982 | orchestrator | Tuesday 28 April 2026 07:56:04 +0000 (0:00:00.478) 0:00:44.772 ********* 2026-04-28 07:56:08.445000 | orchestrator | 2026-04-28 07:56:08.445019 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 07:56:08.445038 | orchestrator | Tuesday 28 April 2026 07:56:04 +0000 (0:00:00.483) 0:00:45.255 ********* 2026-04-28 07:56:08.445057 | orchestrator | 2026-04-28 07:56:08.445076 | orchestrator | RUNNING HANDLER [Write report file] ******************************************** 2026-04-28 07:56:08.445094 | orchestrator | Tuesday 28 April 2026 07:56:05 +0000 (0:00:00.889) 0:00:46.145 ********* 2026-04-28 07:56:08.445130 | orchestrator | changed: [testbed-node-0 -> testbed-manager(192.168.16.5)] 2026-04-28 07:56:08.445149 | orchestrator | 2026-04-28 07:56:08.445167 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-28 07:56:08.445186 | orchestrator | Tuesday 28 April 2026 07:56:08 +0000 (0:00:02.410) 0:00:48.556 ********* 2026-04-28 07:56:08.445206 | orchestrator | ok: [testbed-node-0 -> testbed-manager(192.168.16.5)] => { 2026-04-28 07:56:08.445224 | orchestrator |  "msg": [ 2026-04-28 07:56:08.445243 | orchestrator |  "Validator run completed.", 2026-04-28 07:56:08.445271 | orchestrator |  "You can find the report file here:", 2026-04-28 07:56:08.445291 | orchestrator |  "/opt/reports/validator/ceph-mgrs-validator-2026-04-28T07:55:22+00:00-report.json", 2026-04-28 07:56:08.445332 | orchestrator |  "on the following host:", 2026-04-28 07:56:08.445353 | orchestrator |  "testbed-manager" 2026-04-28 07:56:08.445373 | orchestrator |  ] 2026-04-28 07:56:08.445392 | orchestrator | } 2026-04-28 07:56:08.445411 | orchestrator | 2026-04-28 07:56:08.445429 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 07:56:08.445449 | orchestrator | testbed-node-0 : ok=19  changed=3  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-28 07:56:08.445471 | orchestrator | testbed-node-1 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 07:56:08.445507 | orchestrator | testbed-node-2 : ok=5  changed=0 unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 07:56:10.530270 | orchestrator | 2026-04-28 07:56:10.530369 | orchestrator | 2026-04-28 07:56:10.530385 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 07:56:10.530399 | orchestrator | Tuesday 28 April 2026 07:56:10 +0000 (0:00:02.048) 0:00:50.605 ********* 2026-04-28 07:56:10.530411 | orchestrator | =============================================================================== 2026-04-28 07:56:10.530422 | orchestrator | Gather list of mgr modules ---------------------------------------------- 3.06s 2026-04-28 07:56:10.530433 | orchestrator | Get timestamp for report file ------------------------------------------- 2.92s 2026-04-28 07:56:10.530444 | orchestrator | Get container info ------------------------------------------------------ 2.58s 2026-04-28 07:56:10.530455 | orchestrator | Write report file ------------------------------------------------------- 2.41s 2026-04-28 07:56:10.530465 | orchestrator | Aggregate test results step one ----------------------------------------- 2.32s 2026-04-28 07:56:10.530476 | orchestrator | Print report file information ------------------------------------------- 2.05s 2026-04-28 07:56:10.530486 | orchestrator | Flush handlers ---------------------------------------------------------- 1.95s 2026-04-28 07:56:10.530497 | orchestrator | Flush handlers ---------------------------------------------------------- 1.85s 2026-04-28 07:56:10.530508 | orchestrator | Prepare test data for container existance test -------------------------- 1.72s 2026-04-28 07:56:10.530518 | orchestrator | Create report output directory ------------------------------------------ 1.71s 2026-04-28 07:56:10.530529 | orchestrator | Set validation result to passed if no test failed ----------------------- 1.57s 2026-04-28 07:56:10.530539 | orchestrator | Set validation result to failed if a test failed ------------------------ 1.50s 2026-04-28 07:56:10.530550 | orchestrator | Set test result to failed if ceph-mgr is not running -------------------- 1.41s 2026-04-28 07:56:10.530561 | orchestrator | Fail due to missing containers ------------------------------------------ 1.40s 2026-04-28 07:56:10.530571 | orchestrator | Extract list of enabled mgr modules ------------------------------------- 1.38s 2026-04-28 07:56:10.530582 | orchestrator | Prepare test data ------------------------------------------------------- 1.36s 2026-04-28 07:56:10.530592 | orchestrator | Set test result to passed if container is existing ---------------------- 1.35s 2026-04-28 07:56:10.530604 | orchestrator | Set test result to failed if container is missing ----------------------- 1.34s 2026-04-28 07:56:10.530615 | orchestrator | Set test result to passed if ceph-mgr is running ------------------------ 1.33s 2026-04-28 07:56:10.530653 | orchestrator | Aggregate test results step two ----------------------------------------- 1.31s 2026-04-28 07:56:10.744197 | orchestrator | + osism validate ceph-osds 2026-04-28 07:56:43.459760 | orchestrator | 2026-04-28 07:56:43.459940 | orchestrator | PLAY [Ceph validate OSDs] ****************************************************** 2026-04-28 07:56:43.459961 | orchestrator | 2026-04-28 07:56:43.459974 | orchestrator | TASK [Get timestamp for report file] ******************************************* 2026-04-28 07:56:43.459986 | orchestrator | Tuesday 28 April 2026 07:56:27 +0000 (0:00:01.883) 0:00:01.883 ********* 2026-04-28 07:56:43.459998 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-28 07:56:43.460009 | orchestrator | 2026-04-28 07:56:43.460021 | orchestrator | TASK [Get extra vars for Ceph configuration] *********************************** 2026-04-28 07:56:43.460032 | orchestrator | Tuesday 28 April 2026 07:56:30 +0000 (0:00:02.884) 0:00:04.767 ********* 2026-04-28 07:56:43.460043 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-28 07:56:43.460054 | orchestrator | 2026-04-28 07:56:43.460065 | orchestrator | TASK [Create report output directory] ****************************************** 2026-04-28 07:56:43.460076 | orchestrator | Tuesday 28 April 2026 07:56:31 +0000 (0:00:01.295) 0:00:06.063 ********* 2026-04-28 07:56:43.460087 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-28 07:56:43.460098 | orchestrator | 2026-04-28 07:56:43.460108 | orchestrator | TASK [Define report vars] ****************************************************** 2026-04-28 07:56:43.460119 | orchestrator | Tuesday 28 April 2026 07:56:33 +0000 (0:00:01.798) 0:00:07.861 ********* 2026-04-28 07:56:43.460131 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:56:43.460143 | orchestrator | 2026-04-28 07:56:43.460154 | orchestrator | TASK [Define OSD test variables] *********************************************** 2026-04-28 07:56:43.460166 | orchestrator | Tuesday 28 April 2026 07:56:34 +0000 (0:00:01.132) 0:00:08.994 ********* 2026-04-28 07:56:43.460177 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:56:43.460188 | orchestrator | 2026-04-28 07:56:43.460199 | orchestrator | TASK [Calculate OSD devices for each host] ************************************* 2026-04-28 07:56:43.460210 | orchestrator | Tuesday 28 April 2026 07:56:35 +0000 (0:00:01.135) 0:00:10.130 ********* 2026-04-28 07:56:43.460221 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:56:43.460232 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:56:43.460243 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:56:43.460254 | orchestrator | 2026-04-28 07:56:43.460283 | orchestrator | TASK [Define OSD test variables] *********************************************** 2026-04-28 07:56:43.460297 | orchestrator | Tuesday 28 April 2026 07:56:37 +0000 (0:00:01.931) 0:00:12.062 ********* 2026-04-28 07:56:43.460309 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:56:43.460322 | orchestrator | 2026-04-28 07:56:43.460335 | orchestrator | TASK [Calculate OSD devices for each host] ************************************* 2026-04-28 07:56:43.460347 | orchestrator | Tuesday 28 April 2026 07:56:39 +0000 (0:00:01.155) 0:00:13.218 ********* 2026-04-28 07:56:43.460360 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:56:43.460372 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:56:43.460386 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:56:43.460398 | orchestrator | 2026-04-28 07:56:43.460410 | orchestrator | TASK [Calculate total number of OSDs in cluster] ******************************* 2026-04-28 07:56:43.460423 | orchestrator | Tuesday 28 April 2026 07:56:40 +0000 (0:00:01.398) 0:00:14.616 ********* 2026-04-28 07:56:43.460436 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:56:43.460448 | orchestrator | 2026-04-28 07:56:43.460461 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-28 07:56:43.460474 | orchestrator | Tuesday 28 April 2026 07:56:41 +0000 (0:00:01.395) 0:00:16.012 ********* 2026-04-28 07:56:43.460484 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:56:43.460496 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:56:43.460507 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:56:43.460518 | orchestrator | 2026-04-28 07:56:43.460529 | orchestrator | TASK [Get list of ceph-osd containers on host] ********************************* 2026-04-28 07:56:43.460562 | orchestrator | Tuesday 28 April 2026 07:56:43 +0000 (0:00:01.428) 0:00:17.440 ********* 2026-04-28 07:56:43.460576 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'cf8bf64a59802bfb2e4e7a33fdfa687a542138f71b722f8f269f5cca89818018', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'name': '/prometheus_libvirt_exporter', 'state': 'running', 'status': 'Up 6 minutes'})  2026-04-28 07:56:43.460591 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'f3ef203d00ca69f9b84ff95f3aac11d4d6f7c81809cda3908df98f44c41e515b', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'name': '/prometheus_cadvisor', 'state': 'running', 'status': 'Up 7 minutes'})  2026-04-28 07:56:43.460603 | orchestrator | skipping: [testbed-node-3] => (item={'id': '65283b4586614547665ed43218fb29423739fadd0ec3ffef0d4dd600c635c791', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'name': '/prometheus_node_exporter', 'state': 'running', 'status': 'Up 7 minutes'})  2026-04-28 07:56:43.460615 | orchestrator | skipping: [testbed-node-3] => (item={'id': '7fe259040ebb3b75deb8e6f62a48091476705a286f9c2347505d2ea02ff642a0', 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'name': '/ceilometer_compute', 'state': 'running', 'status': 'Up 22 minutes'})  2026-04-28 07:56:43.460626 | orchestrator | skipping: [testbed-node-3] => (item={'id': '4c297249458d94e7dcf9e723f929807fbb0087306067151e89aa331a507d84ef', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'name': '/nova_compute', 'state': 'running', 'status': 'Up 49 minutes (healthy)'})  2026-04-28 07:56:43.460655 | orchestrator | skipping: [testbed-node-3] => (item={'id': '82c90d343c31f2e0b942f246fd83047a1f6ca2256caa96dc2f0b4d5f2f1e4773', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'name': '/nova_libvirt', 'state': 'running', 'status': 'Up 58 minutes (healthy)'})  2026-04-28 07:56:43.460668 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'c98f7b80b613d68a24a006b483670a4e75c02b45888d34d0610760aec1fac4d9', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'name': '/nova_ssh', 'state': 'running', 'status': 'Up 58 minutes (healthy)'})  2026-04-28 07:56:43.460680 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'c71416f487419fb23e3a31f4974141b644679b8297371bddae35cf3d5162a21a', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'name': '/neutron_ovn_metadata_agent', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-28 07:56:43.460703 | orchestrator | skipping: [testbed-node-3] => (item={'id': '41ccff6c6982500507266bbdfdd1dd45cd2478cc5414f483659ec4843346644e', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-crash-testbed-node-3', 'state': 'running', 'status': 'Up About an hour'})  2026-04-28 07:56:43.460715 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'f2b813da43ef1ae35283842d635a6eb9f07ce5f9544fd60a9d9de62387d9ea40', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-rgw-default-testbed-node-3-rgw0', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-28 07:56:43.460731 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'c4c3ba9923c26498aa2d1a2617cd351201c0e6b133cff3427f0a972a3c269f74', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-mds-testbed-node-3', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-28 07:56:43.460745 | orchestrator | ok: [testbed-node-3] => (item={'id': '4fd4b75549de0235b38e00772cf04926a3cb62df024896f4f54bdd7268fd2277', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-3', 'state': 'running', 'status': 'Up 2 hours'}) 2026-04-28 07:56:43.460757 | orchestrator | ok: [testbed-node-3] => (item={'id': 'bc476a8d18108ed62f0acfe12f53cb3b9d17a7d9e700c8f3ffca024ebbab10d5', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-0', 'state': 'running', 'status': 'Up 2 hours'}) 2026-04-28 07:56:43.460776 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'a86c6531a534d1e21a332dcf4d23389e144501c2896673cc3792b78fd35d50c4', 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'name': '/ovn_controller', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-28 07:56:43.460788 | orchestrator | skipping: [testbed-node-3] => (item={'id': '03d4ae2fc1c3e04b9187f77b7dd39f054a1066007ba7685f41916ad9036864b0', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'name': '/openvswitch_vswitchd', 'state': 'running', 'status': 'Up 3 hours (healthy)'})  2026-04-28 07:56:43.460799 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'c555216e3a415ae248d10cec5778d88312330e12832bd34a413fc3b486aed3f9', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'name': '/openvswitch_db', 'state': 'running', 'status': 'Up 3 hours (healthy)'})  2026-04-28 07:56:43.460810 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'd1671f0adc8d3545db03fc45a2fc2ffd796039097b00c36915f69e7b975f83e5', 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'name': '/cron', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-28 07:56:43.460822 | orchestrator | skipping: [testbed-node-3] => (item={'id': '0cb06bd8336fa82101535400ebc1305feafa9ef5db1b8f5ed8176d7a3f057489', 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'name': '/kolla_toolbox', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-28 07:56:43.460833 | orchestrator | skipping: [testbed-node-3] => (item={'id': 'dc85235a37a83000bd20652af23a5e6237079b6eeb5406f81917b0dca7bcd7e5', 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'name': '/fluentd', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-28 07:56:43.460845 | orchestrator | skipping: [testbed-node-4] => (item={'id': '44344b1a2c7765df0b4946c5d1bf374f6d5953aa787d72b27d2dab83e390e224', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'name': '/prometheus_libvirt_exporter', 'state': 'running', 'status': 'Up 6 minutes'})  2026-04-28 07:56:43.460886 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'de525ed458626476a55001b887dd54ba395c0bd283f262dfbfad93676addb9d2', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'name': '/prometheus_cadvisor', 'state': 'running', 'status': 'Up 7 minutes'})  2026-04-28 07:56:43.949188 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'd3471082847b122eec8574dcad791aca127a5adf49c79aa6f421caef77448477', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'name': '/prometheus_node_exporter', 'state': 'running', 'status': 'Up 7 minutes'})  2026-04-28 07:56:43.949285 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'e7ea412cbdc8faae811ac1acf63ae0ad659224676f481ca7dc02961b42ecbd8b', 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'name': '/ceilometer_compute', 'state': 'running', 'status': 'Up 22 minutes'})  2026-04-28 07:56:43.949301 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'c3ff14ed94c6b5dd48dcdabd1686a3e61662f2a5ff2dba0951736c6738f411cc', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'name': '/nova_compute', 'state': 'running', 'status': 'Up 49 minutes (healthy)'})  2026-04-28 07:56:43.949313 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'aebe56066147f29b993d7cf970db731b7a75f68aa0b3f22f99ccc07eb4261011', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'name': '/nova_libvirt', 'state': 'running', 'status': 'Up 58 minutes (healthy)'})  2026-04-28 07:56:43.949342 | orchestrator | skipping: [testbed-node-4] => (item={'id': '4c92bb8d2c7c5de3f177ac384d7be455f16ff9bae3605ac7be3a960a10398357', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'name': '/nova_ssh', 'state': 'running', 'status': 'Up 58 minutes (healthy)'})  2026-04-28 07:56:43.949376 | orchestrator | skipping: [testbed-node-4] => (item={'id': '189732bf752e8b25c39217f360b69dea3a184c4c8360a96542a74b2b7f9795e1', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'name': '/neutron_ovn_metadata_agent', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-28 07:56:43.949390 | orchestrator | skipping: [testbed-node-4] => (item={'id': '772cf9fdf55d070f8a9e74dc565bbce03713bfb659f4ab06769e7f5c97dd50fe', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-crash-testbed-node-4', 'state': 'running', 'status': 'Up About an hour'})  2026-04-28 07:56:43.949401 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'f348edb67ffc27cde7dd4dc1e95f84a855dc6fe8b1d8f6f9485aca6984fb5512', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-rgw-default-testbed-node-4-rgw0', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-28 07:56:43.949413 | orchestrator | skipping: [testbed-node-4] => (item={'id': '735249fbcab2b819fe3b9fa147cfdd9bce66c2e838347a05a4ee7b16ffee62f0', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-mds-testbed-node-4', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-28 07:56:43.949426 | orchestrator | ok: [testbed-node-4] => (item={'id': 'f48f6f3a00a961bd8bc2e61765371876791ed03f72d8241c0278802dadb6dd24', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-1', 'state': 'running', 'status': 'Up 2 hours'}) 2026-04-28 07:56:43.949438 | orchestrator | ok: [testbed-node-4] => (item={'id': '45bda70f0cd0e41bee207c85cd2699d4e63955ea35f7acf4f51b48902dcd11b6', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-4', 'state': 'running', 'status': 'Up 2 hours'}) 2026-04-28 07:56:43.949449 | orchestrator | skipping: [testbed-node-4] => (item={'id': '5c13d14aab62aad32ebd343ebed561d0b66397bbf243c25da0f479d0db1cf983', 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'name': '/ovn_controller', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-28 07:56:43.949460 | orchestrator | skipping: [testbed-node-4] => (item={'id': '6887e942536d15da14fcb3de4fc862dfdbd4fe9d35fd4ad728ca03b0d2c71ee1', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'name': '/openvswitch_vswitchd', 'state': 'running', 'status': 'Up 3 hours (healthy)'})  2026-04-28 07:56:43.949471 | orchestrator | skipping: [testbed-node-4] => (item={'id': '42009c374cc5c2938c520253774e30d5e841094a4cc27aecb1a2876556404ac5', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'name': '/openvswitch_db', 'state': 'running', 'status': 'Up 3 hours (healthy)'})  2026-04-28 07:56:43.949498 | orchestrator | skipping: [testbed-node-4] => (item={'id': '49a6db639607d76819556b3f2b7a51e9e9a9f51fe9b64f7d0cd02a7d5f3a0faf', 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'name': '/cron', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-28 07:56:43.949510 | orchestrator | skipping: [testbed-node-4] => (item={'id': '956f4c7d9d492d5f1e5fe40495b7d0f13a7b1282eac8a82f7bff4a1b2e7958b1', 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'name': '/kolla_toolbox', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-28 07:56:43.949521 | orchestrator | skipping: [testbed-node-4] => (item={'id': 'fe3704bc390844435bb4f7b394acbd224cf21b4985a0b1cce09f8968812cdc75', 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'name': '/fluentd', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-28 07:56:43.949532 | orchestrator | skipping: [testbed-node-5] => (item={'id': '8e94edce9d5b63953098df19e791900db75e807f7fdf83d407eafff629bb0783', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-libvirt-exporter:2.2.0.20260328', 'name': '/prometheus_libvirt_exporter', 'state': 'running', 'status': 'Up 6 minutes'})  2026-04-28 07:56:43.949543 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'd45f1886a75dc1cf38d47a69127742b02ee3603a0b70be0779376d32d1644766', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-cadvisor:0.49.2.20260328', 'name': '/prometheus_cadvisor', 'state': 'running', 'status': 'Up 7 minutes'})  2026-04-28 07:56:43.949562 | orchestrator | skipping: [testbed-node-5] => (item={'id': '08a17c06e218382890a2aa392ee7b0162abe54c3bac9ac9b0c7591dbcf4a3cc5', 'image': 'registry.osism.tech/kolla/release/2025.1/prometheus-node-exporter:1.8.2.20260328', 'name': '/prometheus_node_exporter', 'state': 'running', 'status': 'Up 7 minutes'})  2026-04-28 07:56:43.949573 | orchestrator | skipping: [testbed-node-5] => (item={'id': '3480844e1aadb754148b3c7de48ddd0aac37579942cf5263e3810891b1c7fe2d', 'image': 'registry.osism.tech/kolla/release/2025.1/ceilometer-compute:24.0.1.20260328', 'name': '/ceilometer_compute', 'state': 'running', 'status': 'Up 22 minutes'})  2026-04-28 07:56:43.949591 | orchestrator | skipping: [testbed-node-5] => (item={'id': '7d3cca7c9c180f916b2ef5323fe9466b30b87e451c65f7659ab450bce2865726', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-compute:31.2.1.20260328', 'name': '/nova_compute', 'state': 'running', 'status': 'Up 49 minutes (healthy)'})  2026-04-28 07:56:43.949603 | orchestrator | skipping: [testbed-node-5] => (item={'id': '935878eda86fa2613ac3108f653b0f183cd33fee5122176068eb2b9b8801f2b3', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-libvirt:10.0.0.20260328', 'name': '/nova_libvirt', 'state': 'running', 'status': 'Up 58 minutes (healthy)'})  2026-04-28 07:56:43.949613 | orchestrator | skipping: [testbed-node-5] => (item={'id': '27c16e68788bb78e62645541e96b4f8ef601a32b71341b353f6223810cdb450b', 'image': 'registry.osism.tech/kolla/release/2025.1/nova-ssh:31.2.1.20260328', 'name': '/nova_ssh', 'state': 'running', 'status': 'Up 58 minutes (healthy)'})  2026-04-28 07:56:43.949625 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'dd1484c0111d3c0c48b0dc62e79dfb3156487a1734e62fc3d85349b7bb2846d3', 'image': 'registry.osism.tech/kolla/release/2025.1/neutron-metadata-agent:26.0.3.20260328', 'name': '/neutron_ovn_metadata_agent', 'state': 'running', 'status': 'Up About an hour (healthy)'})  2026-04-28 07:56:43.949636 | orchestrator | skipping: [testbed-node-5] => (item={'id': '12a1c3060a71b90260319aec9213d59de0fdc4a8395534ff53c4cec49785573f', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-crash-testbed-node-5', 'state': 'running', 'status': 'Up About an hour'})  2026-04-28 07:56:43.949647 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'd82d3f7a240429f17868066a488c1d8f93bec21da6b127ea0d36f9b0b7a86fa4', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-rgw-default-testbed-node-5-rgw0', 'state': 'running', 'status': 'Up About an hour'})  2026-04-28 07:56:43.949658 | orchestrator | skipping: [testbed-node-5] => (item={'id': '701fc79cc499348c6dbefc00732981f505b2a61365982b93df63330426e791b4', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-mds-testbed-node-5', 'state': 'running', 'status': 'Up 2 hours'})  2026-04-28 07:56:43.949669 | orchestrator | ok: [testbed-node-5] => (item={'id': '5579171dbdb144e4d5be9864d17adf383901390880d0e585980cb75f5baa9f54', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-5', 'state': 'running', 'status': 'Up 2 hours'}) 2026-04-28 07:56:43.949686 | orchestrator | ok: [testbed-node-5] => (item={'id': 'c40650212d7d747b5c6feae80ebeb4b13175b132c6f7217054dac62885e9dda2', 'image': 'registry.osism.tech/osism/ceph-daemon:18.2.7', 'name': '/ceph-osd-2', 'state': 'running', 'status': 'Up 2 hours'}) 2026-04-28 07:57:21.187849 | orchestrator | skipping: [testbed-node-5] => (item={'id': '7c303401a529dcd87e0061afd0c5ea5ffef4a383ef98b4efb0211f097e317c9c', 'image': 'registry.osism.tech/kolla/release/2025.1/ovn-controller:25.3.1.20260328', 'name': '/ovn_controller', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-28 07:57:21.188005 | orchestrator | skipping: [testbed-node-5] => (item={'id': '6d637f8cf7b0e99975c82dcabc8e7d47eb883884de6d00606a8200c10eb74d39', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-vswitchd:3.5.1.20260328', 'name': '/openvswitch_vswitchd', 'state': 'running', 'status': 'Up 3 hours (healthy)'})  2026-04-28 07:57:21.188049 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'bc1bb0b5dc3ca3052eb55a20ee1bc679cf0a523b6cd9a3eb390b8421ab4412a1', 'image': 'registry.osism.tech/kolla/release/2025.1/openvswitch-db-server:3.5.1.20260328', 'name': '/openvswitch_db', 'state': 'running', 'status': 'Up 3 hours (healthy)'})  2026-04-28 07:57:21.188079 | orchestrator | skipping: [testbed-node-5] => (item={'id': 'f29faf86e38d93b064a3569ab508a8eb05bd1b2e15e8aa7c9313f740fd5c87cd', 'image': 'registry.osism.tech/kolla/release/2025.1/cron:3.0.20260328', 'name': '/cron', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-28 07:57:21.188092 | orchestrator | skipping: [testbed-node-5] => (item={'id': '199bc3aa5b9e90717f64b0e1304cadd94a555e7ecf60b14bc2015f1a4fb2f35d', 'image': 'registry.osism.tech/kolla/release/2025.1/kolla-toolbox:20.3.1.20260328', 'name': '/kolla_toolbox', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-28 07:57:21.188104 | orchestrator | skipping: [testbed-node-5] => (item={'id': '566e926baaa0de612a877d4fc5c2cb32c9591ebe489d4827f559a83771043239', 'image': 'registry.osism.tech/kolla/release/2025.1/fluentd:5.0.9.20260328', 'name': '/fluentd', 'state': 'running', 'status': 'Up 3 hours'})  2026-04-28 07:57:21.188116 | orchestrator | 2026-04-28 07:57:21.188129 | orchestrator | TASK [Get count of ceph-osd containers on host] ******************************** 2026-04-28 07:57:21.188141 | orchestrator | Tuesday 28 April 2026 07:56:45 +0000 (0:00:01.835) 0:00:19.276 ********* 2026-04-28 07:57:21.188152 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:57:21.188165 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:57:21.188175 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:57:21.188186 | orchestrator | 2026-04-28 07:57:21.188197 | orchestrator | TASK [Set test result to failed when count of containers is wrong] ************* 2026-04-28 07:57:21.188208 | orchestrator | Tuesday 28 April 2026 07:56:46 +0000 (0:00:01.457) 0:00:20.733 ********* 2026-04-28 07:57:21.188219 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:57:21.188231 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:57:21.188241 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:57:21.188252 | orchestrator | 2026-04-28 07:57:21.188263 | orchestrator | TASK [Set test result to passed if count matches] ****************************** 2026-04-28 07:57:21.188273 | orchestrator | Tuesday 28 April 2026 07:56:47 +0000 (0:00:01.414) 0:00:22.148 ********* 2026-04-28 07:57:21.188284 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:57:21.188295 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:57:21.188305 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:57:21.188316 | orchestrator | 2026-04-28 07:57:21.188327 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-28 07:57:21.188337 | orchestrator | Tuesday 28 April 2026 07:56:49 +0000 (0:00:01.482) 0:00:23.631 ********* 2026-04-28 07:57:21.188348 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:57:21.188359 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:57:21.188369 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:57:21.188380 | orchestrator | 2026-04-28 07:57:21.188394 | orchestrator | TASK [Get list of ceph-osd containers that are not running] ******************** 2026-04-28 07:57:21.188406 | orchestrator | Tuesday 28 April 2026 07:56:50 +0000 (0:00:01.549) 0:00:25.181 ********* 2026-04-28 07:57:21.188419 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'ceph-osd-3', 'osd_id': '3', 'state': 'running'})  2026-04-28 07:57:21.188432 | orchestrator | skipping: [testbed-node-3] => (item={'name': 'ceph-osd-0', 'osd_id': '0', 'state': 'running'})  2026-04-28 07:57:21.188445 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:57:21.188458 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'ceph-osd-1', 'osd_id': '1', 'state': 'running'})  2026-04-28 07:57:21.188470 | orchestrator | skipping: [testbed-node-4] => (item={'name': 'ceph-osd-4', 'osd_id': '4', 'state': 'running'})  2026-04-28 07:57:21.188482 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:57:21.188493 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'ceph-osd-5', 'osd_id': '5', 'state': 'running'})  2026-04-28 07:57:21.188514 | orchestrator | skipping: [testbed-node-5] => (item={'name': 'ceph-osd-2', 'osd_id': '2', 'state': 'running'})  2026-04-28 07:57:21.188527 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:57:21.188540 | orchestrator | 2026-04-28 07:57:21.188552 | orchestrator | TASK [Get count of ceph-osd containers that are not running] ******************* 2026-04-28 07:57:21.188565 | orchestrator | Tuesday 28 April 2026 07:56:52 +0000 (0:00:01.364) 0:00:26.545 ********* 2026-04-28 07:57:21.188577 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:57:21.188590 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:57:21.188602 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:57:21.188613 | orchestrator | 2026-04-28 07:57:21.188624 | orchestrator | TASK [Set test result to failed if an OSD is not running] ********************** 2026-04-28 07:57:21.188635 | orchestrator | Tuesday 28 April 2026 07:56:53 +0000 (0:00:01.344) 0:00:27.890 ********* 2026-04-28 07:57:21.188663 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:57:21.188675 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:57:21.188686 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:57:21.188697 | orchestrator | 2026-04-28 07:57:21.188708 | orchestrator | TASK [Set test result to failed if an OSD is not running] ********************** 2026-04-28 07:57:21.188718 | orchestrator | Tuesday 28 April 2026 07:56:55 +0000 (0:00:01.448) 0:00:29.339 ********* 2026-04-28 07:57:21.188729 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:57:21.188740 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:57:21.188750 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:57:21.188761 | orchestrator | 2026-04-28 07:57:21.188772 | orchestrator | TASK [Set test result to passed if all containers are running] ***************** 2026-04-28 07:57:21.188783 | orchestrator | Tuesday 28 April 2026 07:56:56 +0000 (0:00:01.373) 0:00:30.712 ********* 2026-04-28 07:57:21.188794 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:57:21.188805 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:57:21.188815 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:57:21.188826 | orchestrator | 2026-04-28 07:57:21.188837 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-28 07:57:21.188848 | orchestrator | Tuesday 28 April 2026 07:56:57 +0000 (0:00:01.390) 0:00:32.103 ********* 2026-04-28 07:57:21.188858 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:57:21.188869 | orchestrator | 2026-04-28 07:57:21.188880 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-28 07:57:21.188891 | orchestrator | Tuesday 28 April 2026 07:56:59 +0000 (0:00:01.267) 0:00:33.371 ********* 2026-04-28 07:57:21.188922 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:57:21.188934 | orchestrator | 2026-04-28 07:57:21.188950 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-28 07:57:21.188961 | orchestrator | Tuesday 28 April 2026 07:57:00 +0000 (0:00:01.271) 0:00:34.643 ********* 2026-04-28 07:57:21.188972 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:57:21.188983 | orchestrator | 2026-04-28 07:57:21.188994 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 07:57:21.189004 | orchestrator | Tuesday 28 April 2026 07:57:01 +0000 (0:00:01.291) 0:00:35.934 ********* 2026-04-28 07:57:21.189015 | orchestrator | 2026-04-28 07:57:21.189026 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 07:57:21.189037 | orchestrator | Tuesday 28 April 2026 07:57:02 +0000 (0:00:00.458) 0:00:36.393 ********* 2026-04-28 07:57:21.189048 | orchestrator | 2026-04-28 07:57:21.189059 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 07:57:21.189069 | orchestrator | Tuesday 28 April 2026 07:57:02 +0000 (0:00:00.463) 0:00:36.856 ********* 2026-04-28 07:57:21.189080 | orchestrator | 2026-04-28 07:57:21.189091 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-28 07:57:21.189101 | orchestrator | Tuesday 28 April 2026 07:57:03 +0000 (0:00:01.019) 0:00:37.875 ********* 2026-04-28 07:57:21.189112 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:57:21.189122 | orchestrator | 2026-04-28 07:57:21.189140 | orchestrator | TASK [Fail early due to containers not running] ******************************** 2026-04-28 07:57:21.189151 | orchestrator | Tuesday 28 April 2026 07:57:04 +0000 (0:00:01.325) 0:00:39.201 ********* 2026-04-28 07:57:21.189162 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:57:21.189173 | orchestrator | 2026-04-28 07:57:21.189184 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-28 07:57:21.189194 | orchestrator | Tuesday 28 April 2026 07:57:06 +0000 (0:00:01.327) 0:00:40.528 ********* 2026-04-28 07:57:21.189205 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:57:21.189216 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:57:21.189227 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:57:21.189238 | orchestrator | 2026-04-28 07:57:21.189248 | orchestrator | TASK [Set _mon_hostname fact] ************************************************** 2026-04-28 07:57:21.189259 | orchestrator | Tuesday 28 April 2026 07:57:07 +0000 (0:00:01.376) 0:00:41.905 ********* 2026-04-28 07:57:21.189269 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:57:21.189280 | orchestrator | 2026-04-28 07:57:21.189290 | orchestrator | TASK [Get ceph osd tree] ******************************************************* 2026-04-28 07:57:21.189301 | orchestrator | Tuesday 28 April 2026 07:57:09 +0000 (0:00:01.321) 0:00:43.227 ********* 2026-04-28 07:57:21.189312 | orchestrator | changed: [testbed-node-3 -> testbed-node-0(192.168.16.10)] 2026-04-28 07:57:21.189322 | orchestrator | 2026-04-28 07:57:21.189333 | orchestrator | TASK [Parse osd tree from JSON] ************************************************ 2026-04-28 07:57:21.189344 | orchestrator | Tuesday 28 April 2026 07:57:12 +0000 (0:00:03.383) 0:00:46.610 ********* 2026-04-28 07:57:21.189354 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:57:21.189365 | orchestrator | 2026-04-28 07:57:21.189376 | orchestrator | TASK [Get OSDs that are not up or in] ****************************************** 2026-04-28 07:57:21.189386 | orchestrator | Tuesday 28 April 2026 07:57:13 +0000 (0:00:01.116) 0:00:47.726 ********* 2026-04-28 07:57:21.189397 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:57:21.189408 | orchestrator | 2026-04-28 07:57:21.189418 | orchestrator | TASK [Fail test if OSDs are not up or in] ************************************** 2026-04-28 07:57:21.189429 | orchestrator | Tuesday 28 April 2026 07:57:14 +0000 (0:00:01.326) 0:00:49.053 ********* 2026-04-28 07:57:21.189440 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:57:21.189450 | orchestrator | 2026-04-28 07:57:21.189461 | orchestrator | TASK [Pass test if OSDs are all up and in] ************************************* 2026-04-28 07:57:21.189471 | orchestrator | Tuesday 28 April 2026 07:57:15 +0000 (0:00:01.131) 0:00:50.185 ********* 2026-04-28 07:57:21.189482 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:57:21.189493 | orchestrator | 2026-04-28 07:57:21.189503 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-28 07:57:21.189514 | orchestrator | Tuesday 28 April 2026 07:57:17 +0000 (0:00:01.161) 0:00:51.346 ********* 2026-04-28 07:57:21.189525 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:57:21.189535 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:57:21.189546 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:57:21.189557 | orchestrator | 2026-04-28 07:57:21.189567 | orchestrator | TASK [List ceph LVM volumes and collect data] ********************************** 2026-04-28 07:57:21.189578 | orchestrator | Tuesday 28 April 2026 07:57:18 +0000 (0:00:01.432) 0:00:52.779 ********* 2026-04-28 07:57:21.189589 | orchestrator | changed: [testbed-node-3] 2026-04-28 07:57:21.189600 | orchestrator | changed: [testbed-node-4] 2026-04-28 07:57:21.189617 | orchestrator | changed: [testbed-node-5] 2026-04-28 07:57:54.321601 | orchestrator | 2026-04-28 07:57:54.321732 | orchestrator | TASK [Parse LVM data as JSON] ************************************************** 2026-04-28 07:57:54.321756 | orchestrator | Tuesday 28 April 2026 07:57:22 +0000 (0:00:03.717) 0:00:56.496 ********* 2026-04-28 07:57:54.321776 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:57:54.321795 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:57:54.321813 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:57:54.321832 | orchestrator | 2026-04-28 07:57:54.321853 | orchestrator | TASK [Get unencrypted and encrypted OSDs] ************************************** 2026-04-28 07:57:54.321872 | orchestrator | Tuesday 28 April 2026 07:57:23 +0000 (0:00:01.374) 0:00:57.871 ********* 2026-04-28 07:57:54.321915 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:57:54.321928 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:57:54.321994 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:57:54.322008 | orchestrator | 2026-04-28 07:57:54.322081 | orchestrator | TASK [Fail if count of encrypted OSDs does not match] ************************** 2026-04-28 07:57:54.322093 | orchestrator | Tuesday 28 April 2026 07:57:25 +0000 (0:00:01.955) 0:00:59.826 ********* 2026-04-28 07:57:54.322104 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:57:54.322117 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:57:54.322128 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:57:54.322140 | orchestrator | 2026-04-28 07:57:54.322152 | orchestrator | TASK [Pass if count of encrypted OSDs equals count of OSDs] ******************** 2026-04-28 07:57:54.322165 | orchestrator | Tuesday 28 April 2026 07:57:27 +0000 (0:00:01.392) 0:01:01.220 ********* 2026-04-28 07:57:54.322177 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:57:54.322189 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:57:54.322216 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:57:54.322229 | orchestrator | 2026-04-28 07:57:54.322242 | orchestrator | TASK [Fail if count of unencrypted OSDs does not match] ************************ 2026-04-28 07:57:54.322254 | orchestrator | Tuesday 28 April 2026 07:57:28 +0000 (0:00:01.422) 0:01:02.643 ********* 2026-04-28 07:57:54.322267 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:57:54.322279 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:57:54.322292 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:57:54.322304 | orchestrator | 2026-04-28 07:57:54.322317 | orchestrator | TASK [Pass if count of unencrypted OSDs equals count of OSDs] ****************** 2026-04-28 07:57:54.322329 | orchestrator | Tuesday 28 April 2026 07:57:29 +0000 (0:00:01.361) 0:01:04.005 ********* 2026-04-28 07:57:54.322341 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:57:54.322353 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:57:54.322366 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:57:54.322378 | orchestrator | 2026-04-28 07:57:54.322397 | orchestrator | TASK [Prepare test data] ******************************************************* 2026-04-28 07:57:54.322417 | orchestrator | Tuesday 28 April 2026 07:57:31 +0000 (0:00:01.540) 0:01:05.545 ********* 2026-04-28 07:57:54.322437 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:57:54.322456 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:57:54.322476 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:57:54.322496 | orchestrator | 2026-04-28 07:57:54.322516 | orchestrator | TASK [Get CRUSH node data of each OSD host and root node childs] *************** 2026-04-28 07:57:54.322535 | orchestrator | Tuesday 28 April 2026 07:57:32 +0000 (0:00:01.581) 0:01:07.127 ********* 2026-04-28 07:57:54.322555 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:57:54.322574 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:57:54.322591 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:57:54.322609 | orchestrator | 2026-04-28 07:57:54.322628 | orchestrator | TASK [Calculate sub test expression results] *********************************** 2026-04-28 07:57:54.322647 | orchestrator | Tuesday 28 April 2026 07:57:34 +0000 (0:00:01.634) 0:01:08.761 ********* 2026-04-28 07:57:54.322667 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:57:54.322685 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:57:54.322703 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:57:54.322714 | orchestrator | 2026-04-28 07:57:54.322725 | orchestrator | TASK [Fail test if any sub test failed] **************************************** 2026-04-28 07:57:54.322736 | orchestrator | Tuesday 28 April 2026 07:57:35 +0000 (0:00:01.369) 0:01:10.131 ********* 2026-04-28 07:57:54.322746 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:57:54.322757 | orchestrator | skipping: [testbed-node-4] 2026-04-28 07:57:54.322768 | orchestrator | skipping: [testbed-node-5] 2026-04-28 07:57:54.322778 | orchestrator | 2026-04-28 07:57:54.322789 | orchestrator | TASK [Pass test if no sub test failed] ***************************************** 2026-04-28 07:57:54.322800 | orchestrator | Tuesday 28 April 2026 07:57:37 +0000 (0:00:01.429) 0:01:11.561 ********* 2026-04-28 07:57:54.322810 | orchestrator | ok: [testbed-node-3] 2026-04-28 07:57:54.322832 | orchestrator | ok: [testbed-node-4] 2026-04-28 07:57:54.322843 | orchestrator | ok: [testbed-node-5] 2026-04-28 07:57:54.322853 | orchestrator | 2026-04-28 07:57:54.322864 | orchestrator | TASK [Set validation result to passed if no test failed] *********************** 2026-04-28 07:57:54.322875 | orchestrator | Tuesday 28 April 2026 07:57:38 +0000 (0:00:01.392) 0:01:12.953 ********* 2026-04-28 07:57:54.322885 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-28 07:57:54.322897 | orchestrator | 2026-04-28 07:57:54.322907 | orchestrator | TASK [Set validation result to failed if a test failed] ************************ 2026-04-28 07:57:54.322918 | orchestrator | Tuesday 28 April 2026 07:57:40 +0000 (0:00:01.375) 0:01:14.328 ********* 2026-04-28 07:57:54.322929 | orchestrator | skipping: [testbed-node-3] 2026-04-28 07:57:54.322966 | orchestrator | 2026-04-28 07:57:54.322978 | orchestrator | TASK [Aggregate test results step one] ***************************************** 2026-04-28 07:57:54.322989 | orchestrator | Tuesday 28 April 2026 07:57:41 +0000 (0:00:01.284) 0:01:15.613 ********* 2026-04-28 07:57:54.323000 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-28 07:57:54.323010 | orchestrator | 2026-04-28 07:57:54.323021 | orchestrator | TASK [Aggregate test results step two] ***************************************** 2026-04-28 07:57:54.323032 | orchestrator | Tuesday 28 April 2026 07:57:44 +0000 (0:00:03.302) 0:01:18.915 ********* 2026-04-28 07:57:54.323042 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-28 07:57:54.323053 | orchestrator | 2026-04-28 07:57:54.323064 | orchestrator | TASK [Aggregate test results step three] *************************************** 2026-04-28 07:57:54.323074 | orchestrator | Tuesday 28 April 2026 07:57:46 +0000 (0:00:01.584) 0:01:20.500 ********* 2026-04-28 07:57:54.323085 | orchestrator | changed: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-28 07:57:54.323096 | orchestrator | 2026-04-28 07:57:54.323127 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 07:57:54.323139 | orchestrator | Tuesday 28 April 2026 07:57:47 +0000 (0:00:01.613) 0:01:22.114 ********* 2026-04-28 07:57:54.323150 | orchestrator | 2026-04-28 07:57:54.323161 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 07:57:54.323171 | orchestrator | Tuesday 28 April 2026 07:57:48 +0000 (0:00:00.447) 0:01:22.562 ********* 2026-04-28 07:57:54.323182 | orchestrator | 2026-04-28 07:57:54.323193 | orchestrator | TASK [Flush handlers] ********************************************************** 2026-04-28 07:57:54.323203 | orchestrator | Tuesday 28 April 2026 07:57:48 +0000 (0:00:00.482) 0:01:23.044 ********* 2026-04-28 07:57:54.323214 | orchestrator | 2026-04-28 07:57:54.323225 | orchestrator | RUNNING HANDLER [Write report file] ******************************************** 2026-04-28 07:57:54.323236 | orchestrator | Tuesday 28 April 2026 07:57:49 +0000 (0:00:00.822) 0:01:23.867 ********* 2026-04-28 07:57:54.323246 | orchestrator | changed: [testbed-node-3 -> testbed-manager(192.168.16.5)] 2026-04-28 07:57:54.323257 | orchestrator | 2026-04-28 07:57:54.323268 | orchestrator | TASK [Print report file information] ******************************************* 2026-04-28 07:57:54.323278 | orchestrator | Tuesday 28 April 2026 07:57:52 +0000 (0:00:02.434) 0:01:26.302 ********* 2026-04-28 07:57:54.323289 | orchestrator | ok: [testbed-node-3 -> testbed-manager(192.168.16.5)] => { 2026-04-28 07:57:54.323300 | orchestrator |  "msg": [ 2026-04-28 07:57:54.323312 | orchestrator |  "Validator run completed.", 2026-04-28 07:57:54.323323 | orchestrator |  "You can find the report file here:", 2026-04-28 07:57:54.323341 | orchestrator |  "/opt/reports/validator/ceph-osds-validator-2026-04-28T07:56:28+00:00-report.json", 2026-04-28 07:57:54.323353 | orchestrator |  "on the following host:", 2026-04-28 07:57:54.323364 | orchestrator |  "testbed-manager" 2026-04-28 07:57:54.323376 | orchestrator |  ] 2026-04-28 07:57:54.323387 | orchestrator | } 2026-04-28 07:57:54.323398 | orchestrator | 2026-04-28 07:57:54.323409 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 07:57:54.323421 | orchestrator | testbed-node-3 : ok=35  changed=4  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026-04-28 07:57:54.323441 | orchestrator | testbed-node-4 : ok=18  changed=1  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-28 07:57:54.323452 | orchestrator | testbed-node-5 : ok=18  changed=1  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026-04-28 07:57:54.323463 | orchestrator | 2026-04-28 07:57:54.323474 | orchestrator | 2026-04-28 07:57:54.323485 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 07:57:54.323495 | orchestrator | Tuesday 28 April 2026 07:57:53 +0000 (0:00:01.714) 0:01:28.016 ********* 2026-04-28 07:57:54.323506 | orchestrator | =============================================================================== 2026-04-28 07:57:54.323517 | orchestrator | List ceph LVM volumes and collect data ---------------------------------- 3.72s 2026-04-28 07:57:54.323527 | orchestrator | Get ceph osd tree ------------------------------------------------------- 3.38s 2026-04-28 07:57:54.323538 | orchestrator | Aggregate test results step one ----------------------------------------- 3.30s 2026-04-28 07:57:54.323549 | orchestrator | Get timestamp for report file ------------------------------------------- 2.88s 2026-04-28 07:57:54.323560 | orchestrator | Write report file ------------------------------------------------------- 2.43s 2026-04-28 07:57:54.323570 | orchestrator | Get unencrypted and encrypted OSDs -------------------------------------- 1.96s 2026-04-28 07:57:54.323581 | orchestrator | Flush handlers ---------------------------------------------------------- 1.94s 2026-04-28 07:57:54.323592 | orchestrator | Calculate OSD devices for each host ------------------------------------- 1.93s 2026-04-28 07:57:54.323603 | orchestrator | Get list of ceph-osd containers on host --------------------------------- 1.83s 2026-04-28 07:57:54.323613 | orchestrator | Create report output directory ------------------------------------------ 1.80s 2026-04-28 07:57:54.323624 | orchestrator | Flush handlers ---------------------------------------------------------- 1.75s 2026-04-28 07:57:54.323635 | orchestrator | Print report file information ------------------------------------------- 1.71s 2026-04-28 07:57:54.323646 | orchestrator | Get CRUSH node data of each OSD host and root node childs --------------- 1.63s 2026-04-28 07:57:54.323656 | orchestrator | Aggregate test results step three --------------------------------------- 1.61s 2026-04-28 07:57:54.323667 | orchestrator | Aggregate test results step two ----------------------------------------- 1.58s 2026-04-28 07:57:54.323677 | orchestrator | Prepare test data ------------------------------------------------------- 1.58s 2026-04-28 07:57:54.323688 | orchestrator | Prepare test data ------------------------------------------------------- 1.55s 2026-04-28 07:57:54.323699 | orchestrator | Pass if count of unencrypted OSDs equals count of OSDs ------------------ 1.54s 2026-04-28 07:57:54.323709 | orchestrator | Set test result to passed if count matches ------------------------------ 1.48s 2026-04-28 07:57:54.323720 | orchestrator | Get count of ceph-osd containers on host -------------------------------- 1.46s 2026-04-28 07:57:54.580902 | orchestrator | + sh -c /opt/configuration/scripts/check/200-infrastructure.sh 2026-04-28 07:57:54.589074 | orchestrator | + set -e 2026-04-28 07:57:54.589147 | orchestrator | + source /opt/manager-vars.sh 2026-04-28 07:57:54.589167 | orchestrator | ++ export NUMBER_OF_NODES=6 2026-04-28 07:57:54.589182 | orchestrator | ++ NUMBER_OF_NODES=6 2026-04-28 07:57:54.589197 | orchestrator | ++ export CEPH_VERSION=reef 2026-04-28 07:57:54.589210 | orchestrator | ++ CEPH_VERSION=reef 2026-04-28 07:57:54.589224 | orchestrator | ++ export CONFIGURATION_VERSION=main 2026-04-28 07:57:54.589238 | orchestrator | ++ CONFIGURATION_VERSION=main 2026-04-28 07:57:54.589251 | orchestrator | ++ export MANAGER_VERSION=9.5.0 2026-04-28 07:57:54.589264 | orchestrator | ++ MANAGER_VERSION=9.5.0 2026-04-28 07:57:54.589276 | orchestrator | ++ export OPENSTACK_VERSION=2024.2 2026-04-28 07:57:54.589289 | orchestrator | ++ OPENSTACK_VERSION=2024.2 2026-04-28 07:57:54.589300 | orchestrator | ++ export ARA=false 2026-04-28 07:57:54.589314 | orchestrator | ++ ARA=false 2026-04-28 07:57:54.589327 | orchestrator | ++ export DEPLOY_MODE=manager 2026-04-28 07:57:54.589341 | orchestrator | ++ DEPLOY_MODE=manager 2026-04-28 07:57:54.589355 | orchestrator | ++ export TEMPEST=false 2026-04-28 07:57:54.589368 | orchestrator | ++ TEMPEST=false 2026-04-28 07:57:54.589411 | orchestrator | ++ export IS_ZUUL=true 2026-04-28 07:57:54.589426 | orchestrator | ++ IS_ZUUL=true 2026-04-28 07:57:54.589441 | orchestrator | ++ export MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 07:57:54.589456 | orchestrator | ++ MANAGER_PUBLIC_IP_ADDRESS=81.163.192.176 2026-04-28 07:57:54.589470 | orchestrator | ++ export EXTERNAL_API=false 2026-04-28 07:57:54.589484 | orchestrator | ++ EXTERNAL_API=false 2026-04-28 07:57:54.589497 | orchestrator | ++ export IMAGE_USER=ubuntu 2026-04-28 07:57:54.589510 | orchestrator | ++ IMAGE_USER=ubuntu 2026-04-28 07:57:54.589524 | orchestrator | ++ export IMAGE_NODE_USER=ubuntu 2026-04-28 07:57:54.589536 | orchestrator | ++ IMAGE_NODE_USER=ubuntu 2026-04-28 07:57:54.589549 | orchestrator | ++ export CEPH_STACK=ceph-ansible 2026-04-28 07:57:54.589563 | orchestrator | ++ CEPH_STACK=ceph-ansible 2026-04-28 07:57:54.589577 | orchestrator | ++ export RABBITMQ3TO4=true 2026-04-28 07:57:54.589590 | orchestrator | ++ RABBITMQ3TO4=true 2026-04-28 07:57:54.589604 | orchestrator | + source /etc/os-release 2026-04-28 07:57:54.589619 | orchestrator | ++ PRETTY_NAME='Ubuntu 24.04.4 LTS' 2026-04-28 07:57:54.589633 | orchestrator | ++ NAME=Ubuntu 2026-04-28 07:57:54.589650 | orchestrator | ++ VERSION_ID=24.04 2026-04-28 07:57:54.589664 | orchestrator | ++ VERSION='24.04.4 LTS (Noble Numbat)' 2026-04-28 07:57:54.589679 | orchestrator | ++ VERSION_CODENAME=noble 2026-04-28 07:57:54.589695 | orchestrator | ++ ID=ubuntu 2026-04-28 07:57:54.589710 | orchestrator | ++ ID_LIKE=debian 2026-04-28 07:57:54.589724 | orchestrator | ++ HOME_URL=https://www.ubuntu.com/ 2026-04-28 07:57:54.589739 | orchestrator | ++ SUPPORT_URL=https://help.ubuntu.com/ 2026-04-28 07:57:54.589753 | orchestrator | ++ BUG_REPORT_URL=https://bugs.launchpad.net/ubuntu/ 2026-04-28 07:57:54.589768 | orchestrator | ++ PRIVACY_POLICY_URL=https://www.ubuntu.com/legal/terms-and-policies/privacy-policy 2026-04-28 07:57:54.589784 | orchestrator | ++ UBUNTU_CODENAME=noble 2026-04-28 07:57:54.589798 | orchestrator | ++ LOGO=ubuntu-logo 2026-04-28 07:57:54.589812 | orchestrator | + [[ ubuntu == \u\b\u\n\t\u ]] 2026-04-28 07:57:54.589828 | orchestrator | + packages='libmonitoring-plugin-perl libwww-perl libjson-perl monitoring-plugins-basic mysql-client' 2026-04-28 07:57:54.589844 | orchestrator | + dpkg -s libmonitoring-plugin-perl libwww-perl libjson-perl monitoring-plugins-basic mysql-client 2026-04-28 07:57:54.611036 | orchestrator | + pushd /opt/configuration/contrib 2026-04-28 07:57:54.611097 | orchestrator | + echo 2026-04-28 07:57:54.611859 | orchestrator | 2026-04-28 07:57:54.611874 | orchestrator | # Status of Elasticsearch 2026-04-28 07:57:54.611883 | orchestrator | 2026-04-28 07:57:54.611891 | orchestrator | + echo '# Status of Elasticsearch' 2026-04-28 07:57:54.611899 | orchestrator | + echo 2026-04-28 07:57:54.611907 | orchestrator | + bash nagios-plugins/check_elasticsearch -H api-int.testbed.osism.xyz -s 2026-04-28 07:57:54.790116 | orchestrator | OK - elasticsearch (kolla_logging) is running. status: green; timed_out: false; number_of_nodes: 3; number_of_data_nodes: 3; active_primary_shards: 9; active_shards: 22; relocating_shards: 0; initializing_shards: 0; delayed_unassigned_shards: 0; unassigned_shards: 0 | 'active_primary'=9 'active'=22 'relocating'=0 'init'=0 'delay_unass'=0 'unass'=0 2026-04-28 07:57:54.790222 | orchestrator | 2026-04-28 07:57:54.790240 | orchestrator | # Status of MariaDB 2026-04-28 07:57:54.790254 | orchestrator | 2026-04-28 07:57:54.790265 | orchestrator | + echo 2026-04-28 07:57:54.790277 | orchestrator | + echo '# Status of MariaDB' 2026-04-28 07:57:54.790289 | orchestrator | + echo 2026-04-28 07:57:54.791542 | orchestrator | ++ semver 9.5.0 10.0.0-0 2026-04-28 07:57:54.848842 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-28 07:57:54.848928 | orchestrator | + [[ 9.5.0 == \l\a\t\e\s\t ]] 2026-04-28 07:57:54.849037 | orchestrator | + MARIADB_USER=root_shard_0 2026-04-28 07:57:54.849053 | orchestrator | + bash nagios-plugins/check_galera_cluster -u root_shard_0 -p password -H api-int.testbed.osism.xyz -c 1 2026-04-28 07:57:55.001210 | orchestrator | Reading package lists... 2026-04-28 07:57:55.447463 | orchestrator | Building dependency tree... 2026-04-28 07:57:55.448029 | orchestrator | Reading state information... 2026-04-28 07:57:55.915553 | orchestrator | bc is already the newest version (1.07.1-3ubuntu4). 2026-04-28 07:57:55.915645 | orchestrator | 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 2026-04-28 07:57:56.612270 | orchestrator | OK: number of NODES = 3 (wsrep_cluster_size) 2026-04-28 07:57:56.612370 | orchestrator | 2026-04-28 07:57:56.612386 | orchestrator | # Status of Prometheus 2026-04-28 07:57:56.612400 | orchestrator | 2026-04-28 07:57:56.612411 | orchestrator | + echo 2026-04-28 07:57:56.612422 | orchestrator | + echo '# Status of Prometheus' 2026-04-28 07:57:56.612434 | orchestrator | + echo 2026-04-28 07:57:56.612445 | orchestrator | + curl -s https://api-int.testbed.osism.xyz:9091/-/healthy 2026-04-28 07:57:56.682245 | orchestrator | Unauthorized 2026-04-28 07:57:56.688865 | orchestrator | + curl -s https://api-int.testbed.osism.xyz:9091/-/ready 2026-04-28 07:57:56.765462 | orchestrator | Unauthorized 2026-04-28 07:57:56.768718 | orchestrator | 2026-04-28 07:57:56.768753 | orchestrator | # Status of RabbitMQ 2026-04-28 07:57:56.768771 | orchestrator | 2026-04-28 07:57:56.768784 | orchestrator | + echo 2026-04-28 07:57:56.768795 | orchestrator | + echo '# Status of RabbitMQ' 2026-04-28 07:57:56.768807 | orchestrator | + echo 2026-04-28 07:57:56.769617 | orchestrator | ++ semver 9.5.0 10.0.0-0 2026-04-28 07:57:56.831088 | orchestrator | + [[ -1 -ge 0 ]] 2026-04-28 07:57:56.831167 | orchestrator | + [[ 9.5.0 == \l\a\t\e\s\t ]] 2026-04-28 07:57:56.831204 | orchestrator | + perl nagios-plugins/check_rabbitmq_cluster --ssl 1 -H api-int.testbed.osism.xyz -u openstack -p password 2026-04-28 07:57:57.341379 | orchestrator | RABBITMQ_CLUSTER OK - nb_running_node OK (3) nb_running_disc_node OK (3) nb_running_ram_node OK (0) 2026-04-28 07:57:57.352282 | orchestrator | 2026-04-28 07:57:57.352332 | orchestrator | # Status of Redis 2026-04-28 07:57:57.352345 | orchestrator | 2026-04-28 07:57:57.352356 | orchestrator | + echo 2026-04-28 07:57:57.352368 | orchestrator | + echo '# Status of Redis' 2026-04-28 07:57:57.352380 | orchestrator | + echo 2026-04-28 07:57:57.352393 | orchestrator | + /usr/lib/nagios/plugins/check_tcp -H 192.168.16.10 -p 6379 -A -E -s 'AUTH QHNA1SZRlOKzLADhUd5ZDgpHfQe6dNfr3bwEdY24\r\nPING\r\nINFO replication\r\nQUIT\r\n' -e PONG -e role:master -e slave0:ip=192.168.16.1 -e,port=6379 -j 2026-04-28 07:57:57.361668 | orchestrator | TCP OK - 0.002 second response time on 192.168.16.10 port 6379|time=0.001511s;;;0.000000;10.000000 2026-04-28 07:57:57.362346 | orchestrator | 2026-04-28 07:57:57.362377 | orchestrator | # Create backup of MariaDB database 2026-04-28 07:57:57.362390 | orchestrator | 2026-04-28 07:57:57.362401 | orchestrator | + popd 2026-04-28 07:57:57.362412 | orchestrator | + echo 2026-04-28 07:57:57.362423 | orchestrator | + echo '# Create backup of MariaDB database' 2026-04-28 07:57:57.362434 | orchestrator | + echo 2026-04-28 07:57:57.362446 | orchestrator | + osism apply mariadb_backup -e mariadb_backup_type=full 2026-04-28 07:57:58.789429 | orchestrator | 2026-04-28 07:57:58 | INFO  | Prepare task for execution of mariadb_backup. 2026-04-28 07:57:58.859451 | orchestrator | 2026-04-28 07:57:58 | INFO  | Task 0906a0f5-0d63-4d8d-add7-61eda2e0940a (mariadb_backup) was prepared for execution. 2026-04-28 07:57:58.859545 | orchestrator | 2026-04-28 07:57:58 | INFO  | It takes a moment until task 0906a0f5-0d63-4d8d-add7-61eda2e0940a (mariadb_backup) has been started and output is visible here. 2026-04-28 08:00:54.398740 | orchestrator | 2026-04-28 08:00:54.398880 | orchestrator | PLAY [Group hosts based on configuration] ************************************** 2026-04-28 08:00:54.398899 | orchestrator | 2026-04-28 08:00:54.398912 | orchestrator | TASK [Group hosts based on Kolla action] *************************************** 2026-04-28 08:00:54.398925 | orchestrator | Tuesday 28 April 2026 07:58:04 +0000 (0:00:01.560) 0:00:01.560 ********* 2026-04-28 08:00:54.398936 | orchestrator | ok: [testbed-node-0] 2026-04-28 08:00:54.398949 | orchestrator | ok: [testbed-node-1] 2026-04-28 08:00:54.398961 | orchestrator | ok: [testbed-node-2] 2026-04-28 08:00:54.398972 | orchestrator | 2026-04-28 08:00:54.398983 | orchestrator | TASK [Group hosts based on enabled services] *********************************** 2026-04-28 08:00:54.398994 | orchestrator | Tuesday 28 April 2026 07:58:05 +0000 (0:00:01.839) 0:00:03.399 ********* 2026-04-28 08:00:54.399005 | orchestrator | ok: [testbed-node-0] => (item=enable_mariadb_True) 2026-04-28 08:00:54.399017 | orchestrator | ok: [testbed-node-1] => (item=enable_mariadb_True) 2026-04-28 08:00:54.399027 | orchestrator | ok: [testbed-node-2] => (item=enable_mariadb_True) 2026-04-28 08:00:54.399038 | orchestrator | 2026-04-28 08:00:54.399050 | orchestrator | PLAY [Apply role mariadb] ****************************************************** 2026-04-28 08:00:54.399061 | orchestrator | 2026-04-28 08:00:54.399072 | orchestrator | TASK [mariadb : Group MariaDB hosts based on shards] *************************** 2026-04-28 08:00:54.399084 | orchestrator | Tuesday 28 April 2026 07:58:08 +0000 (0:00:02.531) 0:00:05.931 ********* 2026-04-28 08:00:54.399166 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-0) 2026-04-28 08:00:54.399180 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-1) 2026-04-28 08:00:54.399192 | orchestrator | ok: [testbed-node-0] => (item=testbed-node-2) 2026-04-28 08:00:54.399226 | orchestrator | 2026-04-28 08:00:54.399237 | orchestrator | TASK [mariadb : include_tasks] ************************************************* 2026-04-28 08:00:54.399248 | orchestrator | Tuesday 28 April 2026 07:58:10 +0000 (0:00:02.346) 0:00:08.279 ********* 2026-04-28 08:00:54.399274 | orchestrator | included: /ansible/roles/mariadb/tasks/backup.yml for testbed-node-0, testbed-node-1, testbed-node-2 2026-04-28 08:00:54.399289 | orchestrator | 2026-04-28 08:00:54.399302 | orchestrator | TASK [mariadb : Get MariaDB container facts] *********************************** 2026-04-28 08:00:54.399314 | orchestrator | Tuesday 28 April 2026 07:58:12 +0000 (0:00:01.772) 0:00:10.051 ********* 2026-04-28 08:00:54.399327 | orchestrator | ok: [testbed-node-1] 2026-04-28 08:00:54.399341 | orchestrator | ok: [testbed-node-0] 2026-04-28 08:00:54.399353 | orchestrator | ok: [testbed-node-2] 2026-04-28 08:00:54.399365 | orchestrator | 2026-04-28 08:00:54.399378 | orchestrator | TASK [mariadb : Taking full database backup via Mariabackup] ******************* 2026-04-28 08:00:54.399390 | orchestrator | Tuesday 28 April 2026 07:58:17 +0000 (0:00:04.818) 0:00:14.869 ********* 2026-04-28 08:00:54.399403 | orchestrator | skipping: [testbed-node-1] 2026-04-28 08:00:54.399418 | orchestrator | skipping: [testbed-node-2] 2026-04-28 08:00:54.399431 | orchestrator | 2026-04-28 08:00:54.399444 | orchestrator | STILL ALIVE [task 'mariadb : Taking full database backup via Mariabackup' is running] *** 2026-04-28 08:00:54.399457 | orchestrator | changed: [testbed-node-0] 2026-04-28 08:00:54.399470 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: mariadb_restart 2026-04-28 08:00:54.399482 | orchestrator | 2026-04-28 08:00:54.399495 | orchestrator | PLAY [Restart mariadb services] ************************************************ 2026-04-28 08:00:54.399508 | orchestrator | skipping: no hosts matched 2026-04-28 08:00:54.399520 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: mariadb_start 2026-04-28 08:00:54.399533 | orchestrator | 2026-04-28 08:00:54.399545 | orchestrator | PLAY [Start mariadb services] ************************************************** 2026-04-28 08:00:54.399558 | orchestrator | skipping: no hosts matched 2026-04-28 08:00:54.399571 | orchestrator | [WARNING]: Could not match supplied host pattern, ignoring: 2026-04-28 08:00:54.399584 | orchestrator | mariadb_bootstrap_restart 2026-04-28 08:00:54.399596 | orchestrator | 2026-04-28 08:00:54.399609 | orchestrator | PLAY [Restart bootstrap mariadb service] *************************************** 2026-04-28 08:00:54.399621 | orchestrator | skipping: no hosts matched 2026-04-28 08:00:54.399634 | orchestrator | 2026-04-28 08:00:54.399648 | orchestrator | PLAY [Apply mariadb post-configuration] **************************************** 2026-04-28 08:00:54.399660 | orchestrator | 2026-04-28 08:00:54.399673 | orchestrator | TASK [Include mariadb post-deploy.yml] ***************************************** 2026-04-28 08:00:54.399686 | orchestrator | Tuesday 28 April 2026 08:00:50 +0000 (0:02:33.594) 0:02:48.463 ********* 2026-04-28 08:00:54.399697 | orchestrator | skipping: [testbed-node-0] 2026-04-28 08:00:54.399708 | orchestrator | skipping: [testbed-node-1] 2026-04-28 08:00:54.399719 | orchestrator | skipping: [testbed-node-2] 2026-04-28 08:00:54.399730 | orchestrator | 2026-04-28 08:00:54.399741 | orchestrator | TASK [Include mariadb post-upgrade.yml] **************************************** 2026-04-28 08:00:54.399751 | orchestrator | Tuesday 28 April 2026 08:00:52 +0000 (0:00:01.396) 0:02:49.860 ********* 2026-04-28 08:00:54.399762 | orchestrator | skipping: [testbed-node-0] 2026-04-28 08:00:54.399773 | orchestrator | skipping: [testbed-node-1] 2026-04-28 08:00:54.399784 | orchestrator | skipping: [testbed-node-2] 2026-04-28 08:00:54.399795 | orchestrator | 2026-04-28 08:00:54.399805 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 08:00:54.399817 | orchestrator | testbed-node-0 : ok=6  changed=1  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2026-04-28 08:00:54.399830 | orchestrator | testbed-node-1 : ok=4  changed=0 unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-28 08:00:54.399841 | orchestrator | testbed-node-2 : ok=4  changed=0 unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2026-04-28 08:00:54.399860 | orchestrator | 2026-04-28 08:00:54.399871 | orchestrator | 2026-04-28 08:00:54.399882 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 08:00:54.399893 | orchestrator | Tuesday 28 April 2026 08:00:54 +0000 (0:00:01.704) 0:02:51.565 ********* 2026-04-28 08:00:54.399904 | orchestrator | =============================================================================== 2026-04-28 08:00:54.399946 | orchestrator | mariadb : Taking full database backup via Mariabackup ----------------- 153.59s 2026-04-28 08:00:54.399960 | orchestrator | mariadb : Get MariaDB container facts ----------------------------------- 4.82s 2026-04-28 08:00:54.399971 | orchestrator | Group hosts based on enabled services ----------------------------------- 2.53s 2026-04-28 08:00:54.399982 | orchestrator | mariadb : Group MariaDB hosts based on shards --------------------------- 2.35s 2026-04-28 08:00:54.399993 | orchestrator | Group hosts based on Kolla action --------------------------------------- 1.84s 2026-04-28 08:00:54.400004 | orchestrator | mariadb : include_tasks ------------------------------------------------- 1.77s 2026-04-28 08:00:54.400015 | orchestrator | Include mariadb post-upgrade.yml ---------------------------------------- 1.70s 2026-04-28 08:00:54.400026 | orchestrator | Include mariadb post-deploy.yml ----------------------------------------- 1.40s 2026-04-28 08:00:54.609318 | orchestrator | + sh -c /opt/configuration/scripts/check/300-openstack.sh 2026-04-28 08:00:54.616732 | orchestrator | + set -e 2026-04-28 08:00:54.616823 | orchestrator | + source /opt/configuration/scripts/include.sh 2026-04-28 08:00:54.616852 | orchestrator | ++ export INTERACTIVE=false 2026-04-28 08:00:54.616875 | orchestrator | ++ INTERACTIVE=false 2026-04-28 08:00:54.616895 | orchestrator | ++ export OSISM_APPLY_RETRY=1 2026-04-28 08:00:54.617396 | orchestrator | ++ OSISM_APPLY_RETRY=1 2026-04-28 08:00:54.617434 | orchestrator | + source /opt/configuration/scripts/manager-version.sh 2026-04-28 08:00:54.617827 | orchestrator | +++ awk '-F: ' '/^manager_version:/ { print $2 }' /opt/configuration/environments/manager/configuration.yml 2026-04-28 08:00:54.622325 | orchestrator | 2026-04-28 08:00:54.622419 | orchestrator | # OpenStack endpoints 2026-04-28 08:00:54.622441 | orchestrator | 2026-04-28 08:00:54.622456 | orchestrator | ++ export MANAGER_VERSION=10.0.0 2026-04-28 08:00:54.622471 | orchestrator | ++ MANAGER_VERSION=10.0.0 2026-04-28 08:00:54.622492 | orchestrator | + export OS_CLOUD=admin 2026-04-28 08:00:54.622507 | orchestrator | + OS_CLOUD=admin 2026-04-28 08:00:54.622522 | orchestrator | + echo 2026-04-28 08:00:54.622539 | orchestrator | + echo '# OpenStack endpoints' 2026-04-28 08:00:54.622555 | orchestrator | + echo 2026-04-28 08:00:54.622571 | orchestrator | + openstack endpoint list 2026-04-28 08:00:57.814978 | orchestrator | +----------------------------------+-----------+--------------+-----------------+---------+-----------+---------------------------------------------------------------------+ 2026-04-28 08:00:57.815164 | orchestrator | | ID | Region | Service Name | Service Type | Enabled | Interface | URL | 2026-04-28 08:00:57.815189 | orchestrator | +----------------------------------+-----------+--------------+-----------------+---------+-----------+---------------------------------------------------------------------+ 2026-04-28 08:00:57.815201 | orchestrator | | 0cf185a520ba45359be315f83cd9615c | RegionOne | keystone | identity | True | internal | https://api-int.testbed.osism.xyz:5000 | 2026-04-28 08:00:57.815212 | orchestrator | | 1061433da7784e6c8ab401b1bea0ff79 | RegionOne | magnum | container-infra | True | internal | https://api-int.testbed.osism.xyz:9511/v1 | 2026-04-28 08:00:57.815223 | orchestrator | | 166ba1ff0f57419280b58cdf4d451995 | RegionOne | glance | image | True | public | https://api.testbed.osism.xyz:9292 | 2026-04-28 08:00:57.815234 | orchestrator | | 1f07aa031104487b9569ee2aade040cb | RegionOne | barbican | key-manager | True | internal | https://api-int.testbed.osism.xyz:9311 | 2026-04-28 08:00:57.815245 | orchestrator | | 36f1acb4397e4dcc8ae5c4ab01512b82 | RegionOne | manilav2 | sharev2 | True | public | https://api.testbed.osism.xyz:8786/v2 | 2026-04-28 08:00:57.815317 | orchestrator | | 38c749f4ec7f4cbe92407ea8899b798b | RegionOne | nova | compute | True | internal | https://api-int.testbed.osism.xyz:8774/v2.1 | 2026-04-28 08:00:57.815331 | orchestrator | | 3a47ee2ef43b4e518f3c0017b3537862 | RegionOne | octavia | load-balancer | True | internal | https://api-int.testbed.osism.xyz:9876 | 2026-04-28 08:00:57.815342 | orchestrator | | 3dba1f3694884c2d9e409a6bf89bac59 | RegionOne | neutron | network | True | internal | https://api-int.testbed.osism.xyz:9696 | 2026-04-28 08:00:57.815353 | orchestrator | | 4210108fbfd6448191c3c613ac83671f | RegionOne | aodh | alarming | True | internal | https://api-int.testbed.osism.xyz:8042 | 2026-04-28 08:00:57.815364 | orchestrator | | 4ca7a0048d2145fb8180e0d636a2c9ae | RegionOne | nova | compute | True | public | https://api.testbed.osism.xyz:8774/v2.1 | 2026-04-28 08:00:57.815375 | orchestrator | | 4ea98bfb634346e985d130ad5f0e9179 | RegionOne | manilav2 | sharev2 | True | internal | https://api-int.testbed.osism.xyz:8786/v2 | 2026-04-28 08:00:57.815386 | orchestrator | | 6043d57f915a4da4b9bfa75e62c83699 | RegionOne | neutron | network | True | public | https://api.testbed.osism.xyz:9696 | 2026-04-28 08:00:57.815398 | orchestrator | | 61a6912cbb3841e98784c217b4c78df6 | RegionOne | swift | object-store | True | internal | https://api-int.testbed.osism.xyz:6780/swift/v1/AUTH_%(project_id)s | 2026-04-28 08:00:57.815409 | orchestrator | | 687a394942a84d74a696dd274c9d3be3 | RegionOne | keystone | identity | True | public | https://api.testbed.osism.xyz:5000 | 2026-04-28 08:00:57.815420 | orchestrator | | 704fd9bdca1b4e2c8b2f9bfd35c9108d | RegionOne | designate | dns | True | public | https://api.testbed.osism.xyz:9001 | 2026-04-28 08:00:57.815431 | orchestrator | | 72b7433133d8439d91dbe53300246b58 | RegionOne | placement | placement | True | public | https://api.testbed.osism.xyz:8780 | 2026-04-28 08:00:57.815442 | orchestrator | | 7bc01012e71e48ae9831b7d4aa08315c | RegionOne | barbican | key-manager | True | public | https://api.testbed.osism.xyz:9311 | 2026-04-28 08:00:57.815453 | orchestrator | | 7de877361a2847fb9282f575f59f7aee | RegionOne | placement | placement | True | internal | https://api-int.testbed.osism.xyz:8780 | 2026-04-28 08:00:57.815464 | orchestrator | | 7fddbde5e6414b0a89ce3dcb87069390 | RegionOne | swift | object-store | True | public | https://api.testbed.osism.xyz:6780/swift/v1/AUTH_%(project_id)s | 2026-04-28 08:00:57.815475 | orchestrator | | 86e03157e64e4ef2b924569e94c26aee | RegionOne | skyline | panel | True | internal | https://api-int.testbed.osism.xyz:9998 | 2026-04-28 08:00:57.815505 | orchestrator | | 9291ed2a486e4735b0fb0070270a7748 | RegionOne | manila | share | True | public | https://api.testbed.osism.xyz:8786/v1/%(tenant_id)s | 2026-04-28 08:00:57.815523 | orchestrator | | 997701cea5e047d6844a3e979a79c8ae | RegionOne | aodh | alarming | True | public | https://api.testbed.osism.xyz:8042 | 2026-04-28 08:00:57.815535 | orchestrator | | 9da5ae47a2e9428f81fa15cd24e20439 | RegionOne | designate | dns | True | internal | https://api-int.testbed.osism.xyz:9001 | 2026-04-28 08:00:57.815545 | orchestrator | | a85f9c418d944b27934d64ba4cbbb75f | RegionOne | cinderv3 | volumev3 | True | public | https://api.testbed.osism.xyz:8776/v3/%(tenant_id)s | 2026-04-28 08:00:57.815556 | orchestrator | | c5535f48c73e4a20aed3c3edf2507b28 | RegionOne | cinderv3 | volumev3 | True | internal | https://api-int.testbed.osism.xyz:8776/v3/%(tenant_id)s | 2026-04-28 08:00:57.815575 | orchestrator | | d8cd3d32a2d946db8a520f4ab5ca1932 | RegionOne | skyline | panel | True | public | https://api.testbed.osism.xyz:9998 | 2026-04-28 08:00:57.815586 | orchestrator | | e0747d5303e24e5baa1a2cf59d12064a | RegionOne | manila | share | True | internal | https://api-int.testbed.osism.xyz:8786/v1/%(tenant_id)s | 2026-04-28 08:00:57.815597 | orchestrator | | e9adaa09bb3d42e1b9e89be6ddc5165b | RegionOne | glance | image | True | internal | https://api-int.testbed.osism.xyz:9292 | 2026-04-28 08:00:57.815608 | orchestrator | | ef2d4dbc6c00485e9852431f8088a268 | RegionOne | octavia | load-balancer | True | public | https://api.testbed.osism.xyz:9876 | 2026-04-28 08:00:57.815619 | orchestrator | | fcb200db9da5425c8bc4fd7d2256a74f | RegionOne | magnum | container-infra | True | public | https://api.testbed.osism.xyz:9511/v1 | 2026-04-28 08:00:57.815630 | orchestrator | +----------------------------------+-----------+--------------+-----------------+---------+-----------+---------------------------------------------------------------------+ 2026-04-28 08:00:58.093870 | orchestrator | 2026-04-28 08:00:58.093953 | orchestrator | # Cinder 2026-04-28 08:00:58.093966 | orchestrator | 2026-04-28 08:00:58.093975 | orchestrator | + echo 2026-04-28 08:00:58.093984 | orchestrator | + echo '# Cinder' 2026-04-28 08:00:58.093993 | orchestrator | + echo 2026-04-28 08:00:58.094001 | orchestrator | + openstack volume service list 2026-04-28 08:01:00.662570 | orchestrator | +------------------+----------------------------+----------+---------+-------+----------------------------+ 2026-04-28 08:01:00.662679 | orchestrator | | Binary | Host | Zone | Status | State | Updated At | 2026-04-28 08:01:00.662703 | orchestrator | +------------------+----------------------------+----------+---------+-------+----------------------------+ 2026-04-28 08:01:00.662721 | orchestrator | | cinder-scheduler | testbed-node-0 | internal | enabled | up | 2026-04-28T08:00:56.000000 | 2026-04-28 08:01:00.662740 | orchestrator | | cinder-scheduler | testbed-node-1 | internal | enabled | up | 2026-04-28T08:00:55.000000 | 2026-04-28 08:01:00.662759 | orchestrator | | cinder-scheduler | testbed-node-2 | internal | enabled | up | 2026-04-28T08:00:56.000000 | 2026-04-28 08:01:00.662779 | orchestrator | | cinder-volume | testbed-node-0@rbd-volumes | nova | enabled | up | 2026-04-28T08:00:51.000000 | 2026-04-28 08:01:00.662798 | orchestrator | | cinder-volume | testbed-node-1@rbd-volumes | nova | enabled | up | 2026-04-28T08:00:58.000000 | 2026-04-28 08:01:00.662817 | orchestrator | | cinder-volume | testbed-node-2@rbd-volumes | nova | enabled | up | 2026-04-28T08:00:55.000000 | 2026-04-28 08:01:00.662835 | orchestrator | | cinder-backup | testbed-node-0 | nova | enabled | up | 2026-04-28T08:00:55.000000 | 2026-04-28 08:01:00.662855 | orchestrator | | cinder-backup | testbed-node-1 | nova | enabled | up | 2026-04-28T08:00:51.000000 | 2026-04-28 08:01:00.662867 | orchestrator | | cinder-backup | testbed-node-2 | nova | enabled | up | 2026-04-28T08:00:56.000000 | 2026-04-28 08:01:00.662878 | orchestrator | +------------------+----------------------------+----------+---------+-------+----------------------------+ 2026-04-28 08:01:00.902822 | orchestrator | 2026-04-28 08:01:00.902944 | orchestrator | # Neutron 2026-04-28 08:01:00.902971 | orchestrator | 2026-04-28 08:01:00.902991 | orchestrator | + echo 2026-04-28 08:01:00.903009 | orchestrator | + echo '# Neutron' 2026-04-28 08:01:00.903031 | orchestrator | + echo 2026-04-28 08:01:00.903049 | orchestrator | + openstack network agent list 2026-04-28 08:01:03.591025 | orchestrator | +--------------------------------------+------------------------------+----------------+-------------------+-------+-------+----------------------------+ 2026-04-28 08:01:03.591190 | orchestrator | | ID | Agent Type | Host | Availability Zone | Alive | State | Binary | 2026-04-28 08:01:03.591207 | orchestrator | +--------------------------------------+------------------------------+----------------+-------------------+-------+-------+----------------------------+ 2026-04-28 08:01:03.591254 | orchestrator | | testbed-node-4 | OVN Controller agent | testbed-node-4 | | :-) | UP | ovn-controller | 2026-04-28 08:01:03.591267 | orchestrator | | 4939696e-6092-5a33-bb73-b850064684df | OVN Metadata agent | testbed-node-4 | | :-) | UP | neutron-ovn-metadata-agent | 2026-04-28 08:01:03.591297 | orchestrator | | testbed-node-5 | OVN Controller agent | testbed-node-5 | | :-) | UP | ovn-controller | 2026-04-28 08:01:03.591309 | orchestrator | | 36b9d21c-9928-5c0a-9b27-73ac7a3e770c | OVN Metadata agent | testbed-node-5 | | :-) | UP | neutron-ovn-metadata-agent | 2026-04-28 08:01:03.591321 | orchestrator | | testbed-node-3 | OVN Controller agent | testbed-node-3 | | :-) | UP | ovn-controller | 2026-04-28 08:01:03.591343 | orchestrator | | e645415a-98f5-5758-8cd1-c47af282b5c0 | OVN Metadata agent | testbed-node-3 | | :-) | UP | neutron-ovn-metadata-agent | 2026-04-28 08:01:03.591355 | orchestrator | | testbed-node-1 | OVN Controller Gateway agent | testbed-node-1 | nova | :-) | UP | ovn-controller | 2026-04-28 08:01:03.591366 | orchestrator | | testbed-node-0 | OVN Controller Gateway agent | testbed-node-0 | nova | :-) | UP | ovn-controller | 2026-04-28 08:01:03.591377 | orchestrator | | testbed-node-2 | OVN Controller Gateway agent | testbed-node-2 | nova | :-) | UP | ovn-controller | 2026-04-28 08:01:03.591388 | orchestrator | +--------------------------------------+------------------------------+----------------+-------------------+-------+-------+----------------------------+ 2026-04-28 08:01:03.843919 | orchestrator | + openstack network service provider list 2026-04-28 08:01:06.312225 | orchestrator | +---------------+------+---------+ 2026-04-28 08:01:06.312374 | orchestrator | | Service Type | Name | Default | 2026-04-28 08:01:06.312391 | orchestrator | +---------------+------+---------+ 2026-04-28 08:01:06.312402 | orchestrator | | L3_ROUTER_NAT | ovn | True | 2026-04-28 08:01:06.312414 | orchestrator | +---------------+------+---------+ 2026-04-28 08:01:06.560356 | orchestrator | 2026-04-28 08:01:06.560458 | orchestrator | # Nova 2026-04-28 08:01:06.560474 | orchestrator | 2026-04-28 08:01:06.560486 | orchestrator | + echo 2026-04-28 08:01:06.560498 | orchestrator | + echo '# Nova' 2026-04-28 08:01:06.560511 | orchestrator | + echo 2026-04-28 08:01:06.560522 | orchestrator | + openstack compute service list 2026-04-28 08:01:09.275821 | orchestrator | +--------------------------------------+----------------+----------------+----------+---------+-------+----------------------------+ 2026-04-28 08:01:09.275950 | orchestrator | | ID | Binary | Host | Zone | Status | State | Updated At | 2026-04-28 08:01:09.275975 | orchestrator | +--------------------------------------+----------------+----------------+----------+---------+-------+----------------------------+ 2026-04-28 08:01:09.275996 | orchestrator | | f1d52eff-8836-4516-b8c0-1d5ada9eaf44 | nova-scheduler | testbed-node-0 | internal | enabled | up | 2026-04-28T08:01:06.000000 | 2026-04-28 08:01:09.276009 | orchestrator | | 59f6e554-64b3-4013-b7ef-93c67e5ab5d7 | nova-scheduler | testbed-node-1 | internal | enabled | up | 2026-04-28T08:01:07.000000 | 2026-04-28 08:01:09.276020 | orchestrator | | 8f3b264e-b971-4753-9905-44019094b8e8 | nova-scheduler | testbed-node-2 | internal | enabled | up | 2026-04-28T08:01:07.000000 | 2026-04-28 08:01:09.276031 | orchestrator | | 968c0306-85fc-4cb0-b6ad-a97ff536cbaa | nova-conductor | testbed-node-0 | internal | enabled | up | 2026-04-28T08:01:07.000000 | 2026-04-28 08:01:09.276042 | orchestrator | | ec0dc2d0-fe49-4a6d-91b9-4f02dec6638d | nova-conductor | testbed-node-1 | internal | enabled | up | 2026-04-28T08:01:03.000000 | 2026-04-28 08:01:09.276053 | orchestrator | | 7771f3c5-8cfe-4654-9275-c05a270e9a4f | nova-conductor | testbed-node-2 | internal | enabled | up | 2026-04-28T08:01:03.000000 | 2026-04-28 08:01:09.276064 | orchestrator | | 7eab1d23-c588-4be5-88dc-2d6545bd5de0 | nova-compute | testbed-node-4 | nova | enabled | up | 2026-04-28T08:01:00.000000 | 2026-04-28 08:01:09.276131 | orchestrator | | 56a396c3-5580-4498-aec1-c2fdb3cd869e | nova-compute | testbed-node-3 | nova | enabled | up | 2026-04-28T08:01:04.000000 | 2026-04-28 08:01:09.276145 | orchestrator | | e749ece8-93a4-4494-bb23-f2b9da2014a0 | nova-compute | testbed-node-5 | nova | enabled | up | 2026-04-28T08:01:06.000000 | 2026-04-28 08:01:09.276157 | orchestrator | +--------------------------------------+----------------+----------------+----------+---------+-------+----------------------------+ 2026-04-28 08:01:09.538172 | orchestrator | + openstack hypervisor list 2026-04-28 08:01:12.106877 | orchestrator | +--------------------------------------+---------------------+-----------------+---------------+-------+ 2026-04-28 08:01:12.106996 | orchestrator | | ID | Hypervisor Hostname | Hypervisor Type | Host IP | State | 2026-04-28 08:01:12.107013 | orchestrator | +--------------------------------------+---------------------+-----------------+---------------+-------+ 2026-04-28 08:01:12.107025 | orchestrator | | 002a496d-d64b-4edb-99f9-ddc868fc16bd | testbed-node-4 | QEMU | 192.168.16.14 | up | 2026-04-28 08:01:12.107036 | orchestrator | | e62fd76e-7c31-42ce-bad8-58b6eb79c589 | testbed-node-3 | QEMU | 192.168.16.13 | up | 2026-04-28 08:01:12.107048 | orchestrator | | cab64296-ea16-431e-ab95-797072768ab0 | testbed-node-5 | QEMU | 192.168.16.15 | up | 2026-04-28 08:01:12.107059 | orchestrator | +--------------------------------------+---------------------+-----------------+---------------+-------+ 2026-04-28 08:01:12.383422 | orchestrator | 2026-04-28 08:01:12.383538 | orchestrator | # Run OpenStack test play 2026-04-28 08:01:12.383564 | orchestrator | 2026-04-28 08:01:12.383585 | orchestrator | + echo 2026-04-28 08:01:12.383606 | orchestrator | + echo '# Run OpenStack test play' 2026-04-28 08:01:12.383628 | orchestrator | + echo 2026-04-28 08:01:12.383648 | orchestrator | + osism apply --environment openstack test 2026-04-28 08:01:13.675056 | orchestrator | 2026-04-28 08:01:13 | INFO  | Trying to run play test in environment openstack 2026-04-28 08:01:23.723341 | orchestrator | 2026-04-28 08:01:23 | INFO  | Prepare task for execution of test. 2026-04-28 08:01:23.799956 | orchestrator | 2026-04-28 08:01:23 | INFO  | Task 95440236-a3a5-44d0-919d-f638dd47cc46 (test) was prepared for execution. 2026-04-28 08:01:23.800051 | orchestrator | 2026-04-28 08:01:23 | INFO  | It takes a moment until task 95440236-a3a5-44d0-919d-f638dd47cc46 (test) has been started and output is visible here. 2026-04-28 08:04:02.332698 | orchestrator | 2026-04-28 08:04:02.332838 | orchestrator | PLAY [Create test project] ***************************************************** 2026-04-28 08:04:02.332856 | orchestrator | 2026-04-28 08:04:02.332869 | orchestrator | TASK [Create test domain] ****************************************************** 2026-04-28 08:04:02.332880 | orchestrator | Tuesday 28 April 2026 08:01:28 +0000 (0:00:01.442) 0:00:01.442 ********* 2026-04-28 08:04:02.332892 | orchestrator | ok: [localhost] 2026-04-28 08:04:02.333737 | orchestrator | 2026-04-28 08:04:02.333794 | orchestrator | TASK [Create test-admin user] ************************************************** 2026-04-28 08:04:02.333800 | orchestrator | Tuesday 28 April 2026 08:01:34 +0000 (0:00:06.173) 0:00:07.616 ********* 2026-04-28 08:04:02.333805 | orchestrator | ok: [localhost] 2026-04-28 08:04:02.333851 | orchestrator | 2026-04-28 08:04:02.333855 | orchestrator | TASK [Add manager role to user test-admin] ************************************* 2026-04-28 08:04:02.333860 | orchestrator | Tuesday 28 April 2026 08:01:39 +0000 (0:00:04.958) 0:00:12.574 ********* 2026-04-28 08:04:02.333864 | orchestrator | changed: [localhost] 2026-04-28 08:04:02.333875 | orchestrator | 2026-04-28 08:04:02.333879 | orchestrator | TASK [Create test project] ***************************************************** 2026-04-28 08:04:02.333890 | orchestrator | Tuesday 28 April 2026 08:01:49 +0000 (0:00:09.307) 0:00:21.882 ********* 2026-04-28 08:04:02.333894 | orchestrator | ok: [localhost] 2026-04-28 08:04:02.333898 | orchestrator | 2026-04-28 08:04:02.333902 | orchestrator | TASK [Create test user] ******************************************************** 2026-04-28 08:04:02.333906 | orchestrator | Tuesday 28 April 2026 08:01:54 +0000 (0:00:05.468) 0:00:27.350 ********* 2026-04-28 08:04:02.333928 | orchestrator | ok: [localhost] 2026-04-28 08:04:02.333933 | orchestrator | 2026-04-28 08:04:02.333936 | orchestrator | TASK [Add member roles to user test] ******************************************* 2026-04-28 08:04:02.333940 | orchestrator | Tuesday 28 April 2026 08:01:59 +0000 (0:00:05.080) 0:00:32.430 ********* 2026-04-28 08:04:02.333944 | orchestrator | changed: [localhost] => (item=load-balancer_member) 2026-04-28 08:04:02.333949 | orchestrator | ok: [localhost] => (item=member) 2026-04-28 08:04:02.333954 | orchestrator | changed: [localhost] => (item=creator) 2026-04-28 08:04:02.333958 | orchestrator | 2026-04-28 08:04:02.333962 | orchestrator | TASK [Create test server group] ************************************************ 2026-04-28 08:04:02.333966 | orchestrator | Tuesday 28 April 2026 08:02:12 +0000 (0:00:13.050) 0:00:45.481 ********* 2026-04-28 08:04:02.333970 | orchestrator | ok: [localhost] 2026-04-28 08:04:02.333974 | orchestrator | 2026-04-28 08:04:02.333978 | orchestrator | TASK [Create ssh security group] *********************************************** 2026-04-28 08:04:02.333982 | orchestrator | Tuesday 28 April 2026 08:02:18 +0000 (0:00:05.358) 0:00:50.840 ********* 2026-04-28 08:04:02.333986 | orchestrator | ok: [localhost] 2026-04-28 08:04:02.333990 | orchestrator | 2026-04-28 08:04:02.333994 | orchestrator | TASK [Add rule to ssh security group] ****************************************** 2026-04-28 08:04:02.333998 | orchestrator | Tuesday 28 April 2026 08:02:23 +0000 (0:00:05.118) 0:00:55.958 ********* 2026-04-28 08:04:02.334002 | orchestrator | ok: [localhost] 2026-04-28 08:04:02.334005 | orchestrator | 2026-04-28 08:04:02.334009 | orchestrator | TASK [Create icmp security group] ********************************************** 2026-04-28 08:04:02.334045 | orchestrator | Tuesday 28 April 2026 08:02:28 +0000 (0:00:05.173) 0:01:01.132 ********* 2026-04-28 08:04:02.334050 | orchestrator | ok: [localhost] 2026-04-28 08:04:02.334054 | orchestrator | 2026-04-28 08:04:02.334058 | orchestrator | TASK [Add rule to icmp security group] ***************************************** 2026-04-28 08:04:02.334062 | orchestrator | Tuesday 28 April 2026 08:02:33 +0000 (0:00:04.805) 0:01:05.937 ********* 2026-04-28 08:04:02.334065 | orchestrator | ok: [localhost] 2026-04-28 08:04:02.334069 | orchestrator | 2026-04-28 08:04:02.334074 | orchestrator | TASK [Create test keypair] ***************************************************** 2026-04-28 08:04:02.334081 | orchestrator | Tuesday 28 April 2026 08:02:38 +0000 (0:00:04.968) 0:01:10.906 ********* 2026-04-28 08:04:02.334089 | orchestrator | ok: [localhost] 2026-04-28 08:04:02.334093 | orchestrator | 2026-04-28 08:04:02.334097 | orchestrator | TASK [Create test networks] **************************************************** 2026-04-28 08:04:02.334100 | orchestrator | Tuesday 28 April 2026 08:02:43 +0000 (0:00:04.917) 0:01:15.823 ********* 2026-04-28 08:04:02.334104 | orchestrator | ok: [localhost] => (item={'name': 'test-1'}) 2026-04-28 08:04:02.334109 | orchestrator | ok: [localhost] => (item={'name': 'test-2'}) 2026-04-28 08:04:02.334112 | orchestrator | ok: [localhost] => (item={'name': 'test-3'}) 2026-04-28 08:04:02.334116 | orchestrator | 2026-04-28 08:04:02.334120 | orchestrator | TASK [Create test subnets] ***************************************************** 2026-04-28 08:04:02.334124 | orchestrator | Tuesday 28 April 2026 08:02:56 +0000 (0:00:13.209) 0:01:29.033 ********* 2026-04-28 08:04:02.334127 | orchestrator | ok: [localhost] => (item={'name': 'test-1', 'subnet': 'subnet-test-1', 'cidr': '192.168.200.0/24'}) 2026-04-28 08:04:02.334132 | orchestrator | ok: [localhost] => (item={'name': 'test-2', 'subnet': 'subnet-test-2', 'cidr': '192.168.201.0/24'}) 2026-04-28 08:04:02.334136 | orchestrator | ok: [localhost] => (item={'name': 'test-3', 'subnet': 'subnet-test-3', 'cidr': '192.168.202.0/24'}) 2026-04-28 08:04:02.334140 | orchestrator | 2026-04-28 08:04:02.334144 | orchestrator | TASK [Create test routers] ***************************************************** 2026-04-28 08:04:02.334148 | orchestrator | Tuesday 28 April 2026 08:03:09 +0000 (0:00:12.857) 0:01:41.890 ********* 2026-04-28 08:04:02.334151 | orchestrator | ok: [localhost] => (item={'router': 'router-test-1', 'subnet': 'subnet-test-1'}) 2026-04-28 08:04:02.334156 | orchestrator | ok: [localhost] => (item={'router': 'router-test-2', 'subnet': 'subnet-test-2'}) 2026-04-28 08:04:02.334160 | orchestrator | ok: [localhost] => (item={'router': 'router-test-3', 'subnet': 'subnet-test-3'}) 2026-04-28 08:04:02.334168 | orchestrator | 2026-04-28 08:04:02.334172 | orchestrator | PLAY [Manage test instances and volumes] *************************************** 2026-04-28 08:04:02.334176 | orchestrator | 2026-04-28 08:04:02.334180 | orchestrator | TASK [Get test server group] *************************************************** 2026-04-28 08:04:02.334184 | orchestrator | Tuesday 28 April 2026 08:03:24 +0000 (0:00:15.572) 0:01:57.464 ********* 2026-04-28 08:04:02.334188 | orchestrator | ok: [localhost] 2026-04-28 08:04:02.334192 | orchestrator | 2026-04-28 08:04:02.334211 | orchestrator | TASK [Detach test volume] ****************************************************** 2026-04-28 08:04:02.334215 | orchestrator | Tuesday 28 April 2026 08:03:30 +0000 (0:00:05.230) 0:02:02.695 ********* 2026-04-28 08:04:02.334233 | orchestrator | skipping: [localhost] 2026-04-28 08:04:02.334237 | orchestrator | 2026-04-28 08:04:02.334241 | orchestrator | TASK [Delete test volume] ****************************************************** 2026-04-28 08:04:02.334245 | orchestrator | Tuesday 28 April 2026 08:03:31 +0000 (0:00:01.117) 0:02:03.812 ********* 2026-04-28 08:04:02.334248 | orchestrator | skipping: [localhost] 2026-04-28 08:04:02.334252 | orchestrator | 2026-04-28 08:04:02.334256 | orchestrator | TASK [Delete test instances] *************************************************** 2026-04-28 08:04:02.334260 | orchestrator | Tuesday 28 April 2026 08:03:32 +0000 (0:00:01.153) 0:02:04.966 ********* 2026-04-28 08:04:02.334275 | orchestrator | skipping: [localhost] => (item={'name': 'test-4', 'network': 'test-3'})  2026-04-28 08:04:02.334279 | orchestrator | skipping: [localhost] => (item={'name': 'test-3', 'network': 'test-2'})  2026-04-28 08:04:02.334283 | orchestrator | skipping: [localhost] => (item={'name': 'test-2', 'network': 'test-2'})  2026-04-28 08:04:02.334287 | orchestrator | skipping: [localhost] => (item={'name': 'test-1', 'network': 'test-1'})  2026-04-28 08:04:02.334291 | orchestrator | skipping: [localhost] => (item={'name': 'test', 'network': 'test-1'})  2026-04-28 08:04:02.334294 | orchestrator | skipping: [localhost] 2026-04-28 08:04:02.334298 | orchestrator | 2026-04-28 08:04:02.334302 | orchestrator | TASK [Wait for instance deletion to complete] ********************************** 2026-04-28 08:04:02.334306 | orchestrator | Tuesday 28 April 2026 08:03:33 +0000 (0:00:01.213) 0:02:06.180 ********* 2026-04-28 08:04:02.334309 | orchestrator | skipping: [localhost] 2026-04-28 08:04:02.334313 | orchestrator | 2026-04-28 08:04:02.334317 | orchestrator | TASK [Create test instances] *************************************************** 2026-04-28 08:04:02.334321 | orchestrator | Tuesday 28 April 2026 08:03:34 +0000 (0:00:01.230) 0:02:07.410 ********* 2026-04-28 08:04:02.334325 | orchestrator | changed: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-28 08:04:02.334329 | orchestrator | changed: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-28 08:04:02.334334 | orchestrator | changed: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-28 08:04:02.334341 | orchestrator | changed: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-28 08:04:02.334345 | orchestrator | changed: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-28 08:04:02.334349 | orchestrator | 2026-04-28 08:04:02.334353 | orchestrator | TASK [Wait for instance creation to complete] ********************************** 2026-04-28 08:04:02.334357 | orchestrator | Tuesday 28 April 2026 08:03:40 +0000 (0:00:05.821) 0:02:13.232 ********* 2026-04-28 08:04:02.334360 | orchestrator | FAILED - RETRYING: [localhost]: Wait for instance creation to complete (60 retries left). 2026-04-28 08:04:02.334366 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j527568638043.4257', 'results_file': '/ansible/.ansible_async/j527568638043.4257', 'changed': True, 'item': {'name': 'test', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-28 08:04:02.334373 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j915278655757.4282', 'results_file': '/ansible/.ansible_async/j915278655757.4282', 'changed': True, 'item': {'name': 'test-1', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-28 08:04:02.334381 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j383231022440.4307', 'results_file': '/ansible/.ansible_async/j383231022440.4307', 'changed': True, 'item': {'name': 'test-2', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-28 08:04:02.334385 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j442522277744.4332', 'results_file': '/ansible/.ansible_async/j442522277744.4332', 'changed': True, 'item': {'name': 'test-3', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-28 08:04:02.334389 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j298498433478.4357', 'results_file': '/ansible/.ansible_async/j298498433478.4357', 'changed': True, 'item': {'name': 'test-4', 'network': 'test-3'}, 'ansible_loop_var': 'item'}) 2026-04-28 08:04:02.334393 | orchestrator | 2026-04-28 08:04:02.334396 | orchestrator | TASK [Add metadata to instances] *********************************************** 2026-04-28 08:04:02.334400 | orchestrator | Tuesday 28 April 2026 08:03:56 +0000 (0:00:15.912) 0:02:29.144 ********* 2026-04-28 08:04:02.334404 | orchestrator | changed: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-28 08:04:02.334410 | orchestrator | changed: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-28 08:04:02.334414 | orchestrator | changed: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-28 08:04:02.334418 | orchestrator | changed: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-28 08:04:02.334422 | orchestrator | changed: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-28 08:04:02.334425 | orchestrator | 2026-04-28 08:04:02.334430 | orchestrator | TASK [Wait for metadata to be added] ******************************************* 2026-04-28 08:04:02.334437 | orchestrator | Tuesday 28 April 2026 08:04:02 +0000 (0:00:05.863) 0:02:35.008 ********* 2026-04-28 08:05:08.622324 | orchestrator | FAILED - RETRYING: [localhost]: Wait for metadata to be added (30 retries left). 2026-04-28 08:05:08.622475 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j7977804427.4435', 'results_file': '/ansible/.ansible_async/j7977804427.4435', 'changed': True, 'item': {'name': 'test', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-28 08:05:08.622495 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j18152044161.4460', 'results_file': '/ansible/.ansible_async/j18152044161.4460', 'changed': True, 'item': {'name': 'test-1', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-28 08:05:08.622508 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j569971759892.4485', 'results_file': '/ansible/.ansible_async/j569971759892.4485', 'changed': True, 'item': {'name': 'test-2', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-28 08:05:08.622520 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j314896199484.4510', 'results_file': '/ansible/.ansible_async/j314896199484.4510', 'changed': True, 'item': {'name': 'test-3', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-28 08:05:08.622532 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j978643010643.4535', 'results_file': '/ansible/.ansible_async/j978643010643.4535', 'changed': True, 'item': {'name': 'test-4', 'network': 'test-3'}, 'ansible_loop_var': 'item'}) 2026-04-28 08:05:08.622543 | orchestrator | 2026-04-28 08:05:08.622556 | orchestrator | TASK [Add tag to instances] **************************************************** 2026-04-28 08:05:08.622569 | orchestrator | Tuesday 28 April 2026 08:04:13 +0000 (0:00:10.692) 0:02:45.700 ********* 2026-04-28 08:05:08.622580 | orchestrator | changed: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-28 08:05:08.622591 | orchestrator | changed: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-28 08:05:08.622629 | orchestrator | changed: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-28 08:05:08.622641 | orchestrator | changed: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-28 08:05:08.622652 | orchestrator | changed: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-28 08:05:08.622663 | orchestrator | 2026-04-28 08:05:08.622674 | orchestrator | TASK [Wait for tags to be added] *********************************************** 2026-04-28 08:05:08.622685 | orchestrator | Tuesday 28 April 2026 08:04:19 +0000 (0:00:06.018) 0:02:51.719 ********* 2026-04-28 08:05:08.622696 | orchestrator | FAILED - RETRYING: [localhost]: Wait for tags to be added (30 retries left). 2026-04-28 08:05:08.622708 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j635929182952.4606', 'results_file': '/ansible/.ansible_async/j635929182952.4606', 'changed': True, 'item': {'name': 'test', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-28 08:05:08.622719 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j93291009785.4631', 'results_file': '/ansible/.ansible_async/j93291009785.4631', 'changed': True, 'item': {'name': 'test-1', 'network': 'test-1'}, 'ansible_loop_var': 'item'}) 2026-04-28 08:05:08.622731 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j731428636197.4657', 'results_file': '/ansible/.ansible_async/j731428636197.4657', 'changed': True, 'item': {'name': 'test-2', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-28 08:05:08.622742 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j408076488395.4683', 'results_file': '/ansible/.ansible_async/j408076488395.4683', 'changed': True, 'item': {'name': 'test-3', 'network': 'test-2'}, 'ansible_loop_var': 'item'}) 2026-04-28 08:05:08.622772 | orchestrator | changed: [localhost] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j118496288127.4709', 'results_file': '/ansible/.ansible_async/j118496288127.4709', 'changed': True, 'item': {'name': 'test-4', 'network': 'test-3'}, 'ansible_loop_var': 'item'}) 2026-04-28 08:05:08.622787 | orchestrator | 2026-04-28 08:05:08.622800 | orchestrator | TASK [Create test volume] ****************************************************** 2026-04-28 08:05:08.622813 | orchestrator | Tuesday 28 April 2026 08:04:30 +0000 (0:00:11.532) 0:03:03.252 ********* 2026-04-28 08:05:08.622827 | orchestrator | ok: [localhost] 2026-04-28 08:05:08.622842 | orchestrator | 2026-04-28 08:05:08.622855 | orchestrator | TASK [Attach test volume] ****************************************************** 2026-04-28 08:05:08.622868 | orchestrator | Tuesday 28 April 2026 08:04:35 +0000 (0:00:05.041) 0:03:08.293 ********* 2026-04-28 08:05:08.622881 | orchestrator | ok: [localhost] 2026-04-28 08:05:08.622894 | orchestrator | 2026-04-28 08:05:08.622926 | orchestrator | TASK [Create floating ip addresses] ******************************************** 2026-04-28 08:05:08.622941 | orchestrator | Tuesday 28 April 2026 08:04:41 +0000 (0:00:05.893) 0:03:14.187 ********* 2026-04-28 08:05:08.622954 | orchestrator | ok: [localhost] => (item={'name': 'test', 'network': 'test-1'}) 2026-04-28 08:05:08.622967 | orchestrator | ok: [localhost] => (item={'name': 'test-1', 'network': 'test-1'}) 2026-04-28 08:05:08.622980 | orchestrator | ok: [localhost] => (item={'name': 'test-2', 'network': 'test-2'}) 2026-04-28 08:05:08.622992 | orchestrator | ok: [localhost] => (item={'name': 'test-3', 'network': 'test-2'}) 2026-04-28 08:05:08.623005 | orchestrator | ok: [localhost] => (item={'name': 'test-4', 'network': 'test-3'}) 2026-04-28 08:05:08.623018 | orchestrator | 2026-04-28 08:05:08.623031 | orchestrator | TASK [Print floating ip addresses] ********************************************* 2026-04-28 08:05:08.623044 | orchestrator | Tuesday 28 April 2026 08:05:06 +0000 (0:00:25.298) 0:03:39.486 ********* 2026-04-28 08:05:08.623057 | orchestrator | ok: [localhost] => (item=test) => { 2026-04-28 08:05:08.623071 | orchestrator |  "msg": "test: 192.168.112.192" 2026-04-28 08:05:08.623092 | orchestrator | } 2026-04-28 08:05:08.623106 | orchestrator | ok: [localhost] => (item=test-1) => { 2026-04-28 08:05:08.623119 | orchestrator |  "msg": "test-1: 192.168.112.186" 2026-04-28 08:05:08.623133 | orchestrator | } 2026-04-28 08:05:08.623146 | orchestrator | ok: [localhost] => (item=test-2) => { 2026-04-28 08:05:08.623157 | orchestrator |  "msg": "test-2: 192.168.112.153" 2026-04-28 08:05:08.623168 | orchestrator | } 2026-04-28 08:05:08.623179 | orchestrator | ok: [localhost] => (item=test-3) => { 2026-04-28 08:05:08.623189 | orchestrator |  "msg": "test-3: 192.168.112.100" 2026-04-28 08:05:08.623200 | orchestrator | } 2026-04-28 08:05:08.623211 | orchestrator | ok: [localhost] => (item=test-4) => { 2026-04-28 08:05:08.623222 | orchestrator |  "msg": "test-4: 192.168.112.145" 2026-04-28 08:05:08.623233 | orchestrator | } 2026-04-28 08:05:08.623244 | orchestrator | 2026-04-28 08:05:08.623255 | orchestrator | PLAY RECAP ********************************************************************* 2026-04-28 08:05:08.623289 | orchestrator | localhost : ok=26  changed=8  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026-04-28 08:05:08.623301 | orchestrator | 2026-04-28 08:05:08.623312 | orchestrator | 2026-04-28 08:05:08.623323 | orchestrator | TASKS RECAP ******************************************************************** 2026-04-28 08:05:08.623334 | orchestrator | Tuesday 28 April 2026 08:05:08 +0000 (0:00:01.574) 0:03:41.061 ********* 2026-04-28 08:05:08.623345 | orchestrator | =============================================================================== 2026-04-28 08:05:08.623356 | orchestrator | Create floating ip addresses ------------------------------------------- 25.30s 2026-04-28 08:05:08.623366 | orchestrator | Wait for instance creation to complete --------------------------------- 15.91s 2026-04-28 08:05:08.623377 | orchestrator | Create test routers ---------------------------------------------------- 15.57s 2026-04-28 08:05:08.623388 | orchestrator | Create test networks --------------------------------------------------- 13.21s 2026-04-28 08:05:08.623399 | orchestrator | Add member roles to user test ------------------------------------------ 13.05s 2026-04-28 08:05:08.623410 | orchestrator | Create test subnets ---------------------------------------------------- 12.86s 2026-04-28 08:05:08.623420 | orchestrator | Wait for tags to be added ---------------------------------------------- 11.53s 2026-04-28 08:05:08.623431 | orchestrator | Wait for metadata to be added ------------------------------------------ 10.69s 2026-04-28 08:05:08.623442 | orchestrator | Add manager role to user test-admin ------------------------------------- 9.31s 2026-04-28 08:05:08.623453 | orchestrator | Create test domain ------------------------------------------------------ 6.17s 2026-04-28 08:05:08.623464 | orchestrator | Add tag to instances ---------------------------------------------------- 6.02s 2026-04-28 08:05:08.623475 | orchestrator | Attach test volume ------------------------------------------------------ 5.89s 2026-04-28 08:05:08.623486 | orchestrator | Add metadata to instances ----------------------------------------------- 5.86s 2026-04-28 08:05:08.623496 | orchestrator | Create test instances --------------------------------------------------- 5.82s 2026-04-28 08:05:08.623507 | orchestrator | Create test project ----------------------------------------------------- 5.47s 2026-04-28 08:05:08.623518 | orchestrator | Create test server group ------------------------------------------------ 5.36s 2026-04-28 08:05:08.623529 | orchestrator | Get test server group --------------------------------------------------- 5.23s 2026-04-28 08:05:08.623540 | orchestrator | Add rule to ssh security group ------------------------------------------ 5.17s 2026-04-28 08:05:08.623550 | orchestrator | Create ssh security group ----------------------------------------------- 5.12s 2026-04-28 08:05:08.623561 | orchestrator | Create test user -------------------------------------------------------- 5.08s 2026-04-28 08:05:08.826054 | orchestrator | + server_list 2026-04-28 08:05:08.826166 | orchestrator | + openstack --os-cloud test server list 2026-04-28 08:05:12.610881 | orchestrator | +--------------------------------------+--------+--------+-----------------------------------------+--------------------------+----------+ 2026-04-28 08:05:12.611032 | orchestrator | | ID | Name | Status | Networks | Image | Flavor | 2026-04-28 08:05:12.611071 | orchestrator | +--------------------------------------+--------+--------+-----------------------------------------+--------------------------+----------+ 2026-04-28 08:05:12.611081 | orchestrator | | 3b98f333-de2a-4f24-b675-7df3094a053a | test-4 | ACTIVE | test-3=192.168.112.145, 192.168.202.9 | N/A (booted from volume) | SCS-1L-1 | 2026-04-28 08:05:12.611090 | orchestrator | | 4015d761-0309-45a6-b607-f3f64c2b76aa | test-3 | ACTIVE | test-2=192.168.112.100, 192.168.201.65 | N/A (booted from volume) | SCS-1L-1 | 2026-04-28 08:05:12.611099 | orchestrator | | 0b36f9e7-9e53-4847-80d0-bea26dca6a3c | test | ACTIVE | test-1=192.168.112.192, 192.168.200.245 | N/A (booted from volume) | SCS-1L-1 | 2026-04-28 08:05:12.611107 | orchestrator | | 425cac63-54d5-4b17-b7c7-322093929ccd | test-1 | ACTIVE | test-1=192.168.112.186, 192.168.200.143 | N/A (booted from volume) | SCS-1L-1 | 2026-04-28 08:05:12.611116 | orchestrator | | b718a576-bf72-4733-a15e-81732ad456a9 | test-2 | ACTIVE | test-2=192.168.112.153, 192.168.201.246 | N/A (booted from volume) | SCS-1L-1 | 2026-04-28 08:05:12.611125 | orchestrator | +--------------------------------------+--------+--------+-----------------------------------------+--------------------------+----------+ 2026-04-28 08:05:12.898601 | orchestrator | + openstack --os-cloud test server show test 2026-04-28 08:05:16.137061 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 08:05:16.137229 | orchestrator | | Field | Value | 2026-04-28 08:05:16.137246 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 08:05:16.137259 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-28 08:05:16.137347 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-28 08:05:16.137364 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-28 08:05:16.137385 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test | 2026-04-28 08:05:16.137452 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-28 08:05:16.137466 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-28 08:05:16.137501 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-28 08:05:16.137515 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-28 08:05:16.137527 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-28 08:05:16.137538 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-28 08:05:16.137552 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-28 08:05:16.137564 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-28 08:05:16.137578 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-28 08:05:16.137600 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-28 08:05:16.137619 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-28 08:05:16.137632 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-28T04:27:10.000000 | 2026-04-28 08:05:16.137654 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-28 08:05:16.137674 | orchestrator | | accessIPv4 | | 2026-04-28 08:05:16.137693 | orchestrator | | accessIPv6 | | 2026-04-28 08:05:16.137711 | orchestrator | | addresses | test-1=192.168.112.192, 192.168.200.245 | 2026-04-28 08:05:16.137730 | orchestrator | | config_drive | | 2026-04-28 08:05:16.137748 | orchestrator | | created | 2026-04-28T04:26:44Z | 2026-04-28 08:05:16.137778 | orchestrator | | description | None | 2026-04-28 08:05:16.137798 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-28 08:05:16.137816 | orchestrator | | hostId | 76db464fef8bcf34a95a14fa14980f46148158759396db2434bda2ec | 2026-04-28 08:05:16.137835 | orchestrator | | host_status | None | 2026-04-28 08:05:16.137865 | orchestrator | | id | 0b36f9e7-9e53-4847-80d0-bea26dca6a3c | 2026-04-28 08:05:16.137885 | orchestrator | | image | N/A (booted from volume) | 2026-04-28 08:05:16.137905 | orchestrator | | key_name | test | 2026-04-28 08:05:16.137925 | orchestrator | | locked | False | 2026-04-28 08:05:16.137946 | orchestrator | | locked_reason | None | 2026-04-28 08:05:16.137977 | orchestrator | | name | test | 2026-04-28 08:05:16.138597 | orchestrator | | pinned_availability_zone | None | 2026-04-28 08:05:16.138648 | orchestrator | | progress | 0 | 2026-04-28 08:05:16.138669 | orchestrator | | project_id | 3ee3aae67c9c44e9a61b3acbf06b1805 | 2026-04-28 08:05:16.138690 | orchestrator | | properties | hostname='test' | 2026-04-28 08:05:16.138721 | orchestrator | | security_groups | name='icmp' | 2026-04-28 08:05:16.138734 | orchestrator | | | name='ssh' | 2026-04-28 08:05:16.138745 | orchestrator | | server_groups | None | 2026-04-28 08:05:16.138756 | orchestrator | | status | ACTIVE | 2026-04-28 08:05:16.138768 | orchestrator | | tags | test | 2026-04-28 08:05:16.138798 | orchestrator | | trusted_image_certificates | None | 2026-04-28 08:05:16.138810 | orchestrator | | updated | 2026-04-28T08:04:03Z | 2026-04-28 08:05:16.138822 | orchestrator | | user_id | 01939d95acb94c56b03f62633390a42e | 2026-04-28 08:05:16.138833 | orchestrator | | volumes_attached | delete_on_termination='True', id='d97fef32-5bbe-437f-8dd7-3fa7e29ddcfa' | 2026-04-28 08:05:16.138844 | orchestrator | | | delete_on_termination='False', id='948e6705-2939-4d11-9772-e264b005fee2' | 2026-04-28 08:05:16.141230 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 08:05:16.407838 | orchestrator | + openstack --os-cloud test server show test-1 2026-04-28 08:05:19.335202 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 08:05:19.335333 | orchestrator | | Field | Value | 2026-04-28 08:05:19.335343 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 08:05:19.335364 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-28 08:05:19.335375 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-28 08:05:19.335381 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-28 08:05:19.335387 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-1 | 2026-04-28 08:05:19.335392 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-28 08:05:19.335397 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-28 08:05:19.335414 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-28 08:05:19.335420 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-28 08:05:19.335426 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-28 08:05:19.335435 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-28 08:05:19.335443 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-28 08:05:19.335448 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-28 08:05:19.335453 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-28 08:05:19.335459 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-28 08:05:19.335464 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-28 08:05:19.335469 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-28T04:27:09.000000 | 2026-04-28 08:05:19.335478 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-28 08:05:19.335484 | orchestrator | | accessIPv4 | | 2026-04-28 08:05:19.335492 | orchestrator | | accessIPv6 | | 2026-04-28 08:05:19.335498 | orchestrator | | addresses | test-1=192.168.112.186, 192.168.200.143 | 2026-04-28 08:05:19.335506 | orchestrator | | config_drive | | 2026-04-28 08:05:19.335511 | orchestrator | | created | 2026-04-28T04:26:44Z | 2026-04-28 08:05:19.335517 | orchestrator | | description | None | 2026-04-28 08:05:19.335522 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-28 08:05:19.335527 | orchestrator | | hostId | 76db464fef8bcf34a95a14fa14980f46148158759396db2434bda2ec | 2026-04-28 08:05:19.335533 | orchestrator | | host_status | None | 2026-04-28 08:05:19.335542 | orchestrator | | id | 425cac63-54d5-4b17-b7c7-322093929ccd | 2026-04-28 08:05:19.335550 | orchestrator | | image | N/A (booted from volume) | 2026-04-28 08:05:19.335555 | orchestrator | | key_name | test | 2026-04-28 08:05:19.335561 | orchestrator | | locked | False | 2026-04-28 08:05:19.335568 | orchestrator | | locked_reason | None | 2026-04-28 08:05:19.335573 | orchestrator | | name | test-1 | 2026-04-28 08:05:19.335579 | orchestrator | | pinned_availability_zone | None | 2026-04-28 08:05:19.335584 | orchestrator | | progress | 0 | 2026-04-28 08:05:19.335589 | orchestrator | | project_id | 3ee3aae67c9c44e9a61b3acbf06b1805 | 2026-04-28 08:05:19.335595 | orchestrator | | properties | hostname='test-1' | 2026-04-28 08:05:19.335604 | orchestrator | | security_groups | name='icmp' | 2026-04-28 08:05:19.335613 | orchestrator | | | name='ssh' | 2026-04-28 08:05:19.335618 | orchestrator | | server_groups | None | 2026-04-28 08:05:19.335624 | orchestrator | | status | ACTIVE | 2026-04-28 08:05:19.335632 | orchestrator | | tags | test | 2026-04-28 08:05:19.335638 | orchestrator | | trusted_image_certificates | None | 2026-04-28 08:05:19.335643 | orchestrator | | updated | 2026-04-28T08:04:02Z | 2026-04-28 08:05:19.335648 | orchestrator | | user_id | 01939d95acb94c56b03f62633390a42e | 2026-04-28 08:05:19.335654 | orchestrator | | volumes_attached | delete_on_termination='True', id='9d1a692b-af24-4ab6-bf18-86747834d1bd' | 2026-04-28 08:05:19.339750 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 08:05:19.586325 | orchestrator | + openstack --os-cloud test server show test-2 2026-04-28 08:05:22.522620 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 08:05:22.522748 | orchestrator | | Field | Value | 2026-04-28 08:05:22.522778 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 08:05:22.522800 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-28 08:05:22.522813 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-28 08:05:22.522825 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-28 08:05:22.522836 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-2 | 2026-04-28 08:05:22.522847 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-28 08:05:22.522858 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-28 08:05:22.523001 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-28 08:05:22.523026 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-28 08:05:22.523037 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-28 08:05:22.523051 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-28 08:05:22.523071 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-28 08:05:22.523097 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-28 08:05:22.523116 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-28 08:05:22.523134 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-28 08:05:22.523154 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-28 08:05:22.523187 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-28T04:27:12.000000 | 2026-04-28 08:05:22.523220 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-28 08:05:22.523236 | orchestrator | | accessIPv4 | | 2026-04-28 08:05:22.523247 | orchestrator | | accessIPv6 | | 2026-04-28 08:05:22.523258 | orchestrator | | addresses | test-2=192.168.112.153, 192.168.201.246 | 2026-04-28 08:05:22.523303 | orchestrator | | config_drive | | 2026-04-28 08:05:22.523321 | orchestrator | | created | 2026-04-28T04:26:44Z | 2026-04-28 08:05:22.523333 | orchestrator | | description | None | 2026-04-28 08:05:22.523344 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-28 08:05:22.523364 | orchestrator | | hostId | 4ada80ef42e3be16388b3a29f82c13bab85a7010f9aa0d0b984a7304 | 2026-04-28 08:05:22.523376 | orchestrator | | host_status | None | 2026-04-28 08:05:22.523395 | orchestrator | | id | b718a576-bf72-4733-a15e-81732ad456a9 | 2026-04-28 08:05:22.523407 | orchestrator | | image | N/A (booted from volume) | 2026-04-28 08:05:22.523419 | orchestrator | | key_name | test | 2026-04-28 08:05:22.523430 | orchestrator | | locked | False | 2026-04-28 08:05:22.523441 | orchestrator | | locked_reason | None | 2026-04-28 08:05:22.523457 | orchestrator | | name | test-2 | 2026-04-28 08:05:22.523469 | orchestrator | | pinned_availability_zone | None | 2026-04-28 08:05:22.523481 | orchestrator | | progress | 0 | 2026-04-28 08:05:22.523499 | orchestrator | | project_id | 3ee3aae67c9c44e9a61b3acbf06b1805 | 2026-04-28 08:05:22.523510 | orchestrator | | properties | hostname='test-2' | 2026-04-28 08:05:22.523528 | orchestrator | | security_groups | name='icmp' | 2026-04-28 08:05:22.523541 | orchestrator | | | name='ssh' | 2026-04-28 08:05:22.523552 | orchestrator | | server_groups | None | 2026-04-28 08:05:22.523563 | orchestrator | | status | ACTIVE | 2026-04-28 08:05:22.523580 | orchestrator | | tags | test | 2026-04-28 08:05:22.523592 | orchestrator | | trusted_image_certificates | None | 2026-04-28 08:05:22.523604 | orchestrator | | updated | 2026-04-28T08:04:03Z | 2026-04-28 08:05:22.523632 | orchestrator | | user_id | 01939d95acb94c56b03f62633390a42e | 2026-04-28 08:05:22.523653 | orchestrator | | volumes_attached | delete_on_termination='True', id='70745b11-68b2-434a-85d8-b838b55a6f78' | 2026-04-28 08:05:22.527601 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 08:05:22.798364 | orchestrator | + openstack --os-cloud test server show test-3 2026-04-28 08:05:25.648788 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 08:05:25.648903 | orchestrator | | Field | Value | 2026-04-28 08:05:25.648921 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 08:05:25.648934 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-28 08:05:25.648963 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-28 08:05:25.648976 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-28 08:05:25.649010 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-3 | 2026-04-28 08:05:25.649022 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-28 08:05:25.649034 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-28 08:05:25.649064 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-28 08:05:25.649077 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-28 08:05:25.649089 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-28 08:05:25.649100 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-28 08:05:25.649111 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-28 08:05:25.649128 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-28 08:05:25.649148 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-28 08:05:25.649159 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-28 08:05:25.649171 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-28 08:05:25.649183 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-28T04:27:11.000000 | 2026-04-28 08:05:25.649201 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-28 08:05:25.649240 | orchestrator | | accessIPv4 | | 2026-04-28 08:05:25.649253 | orchestrator | | accessIPv6 | | 2026-04-28 08:05:25.649264 | orchestrator | | addresses | test-2=192.168.112.100, 192.168.201.65 | 2026-04-28 08:05:25.649360 | orchestrator | | config_drive | | 2026-04-28 08:05:25.649380 | orchestrator | | created | 2026-04-28T04:26:45Z | 2026-04-28 08:05:25.649403 | orchestrator | | description | None | 2026-04-28 08:05:25.649416 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-28 08:05:25.649431 | orchestrator | | hostId | 4ada80ef42e3be16388b3a29f82c13bab85a7010f9aa0d0b984a7304 | 2026-04-28 08:05:25.649444 | orchestrator | | host_status | None | 2026-04-28 08:05:25.649466 | orchestrator | | id | 4015d761-0309-45a6-b607-f3f64c2b76aa | 2026-04-28 08:05:25.649480 | orchestrator | | image | N/A (booted from volume) | 2026-04-28 08:05:25.649494 | orchestrator | | key_name | test | 2026-04-28 08:05:25.649506 | orchestrator | | locked | False | 2026-04-28 08:05:25.649520 | orchestrator | | locked_reason | None | 2026-04-28 08:05:25.649539 | orchestrator | | name | test-3 | 2026-04-28 08:05:25.649554 | orchestrator | | pinned_availability_zone | None | 2026-04-28 08:05:25.649567 | orchestrator | | progress | 0 | 2026-04-28 08:05:25.649580 | orchestrator | | project_id | 3ee3aae67c9c44e9a61b3acbf06b1805 | 2026-04-28 08:05:25.649593 | orchestrator | | properties | hostname='test-3' | 2026-04-28 08:05:25.649614 | orchestrator | | security_groups | name='icmp' | 2026-04-28 08:05:25.649628 | orchestrator | | | name='ssh' | 2026-04-28 08:05:25.649641 | orchestrator | | server_groups | None | 2026-04-28 08:05:25.649654 | orchestrator | | status | ACTIVE | 2026-04-28 08:05:25.649705 | orchestrator | | tags | test | 2026-04-28 08:05:25.649721 | orchestrator | | trusted_image_certificates | None | 2026-04-28 08:05:25.649733 | orchestrator | | updated | 2026-04-28T08:04:04Z | 2026-04-28 08:05:25.649745 | orchestrator | | user_id | 01939d95acb94c56b03f62633390a42e | 2026-04-28 08:05:25.649756 | orchestrator | | volumes_attached | delete_on_termination='True', id='8c2ed2ce-3797-4892-b980-9cba2da022d9' | 2026-04-28 08:05:25.653423 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 08:05:25.901226 | orchestrator | + openstack --os-cloud test server show test-4 2026-04-28 08:05:28.930052 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 08:05:28.930122 | orchestrator | | Field | Value | 2026-04-28 08:05:28.930129 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 08:05:28.930148 | orchestrator | | OS-DCF:diskConfig | MANUAL | 2026-04-28 08:05:28.930153 | orchestrator | | OS-EXT-AZ:availability_zone | nova | 2026-04-28 08:05:28.930167 | orchestrator | | OS-EXT-SRV-ATTR:host | None | 2026-04-28 08:05:28.930172 | orchestrator | | OS-EXT-SRV-ATTR:hostname | test-4 | 2026-04-28 08:05:28.930176 | orchestrator | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | 2026-04-28 08:05:28.930181 | orchestrator | | OS-EXT-SRV-ATTR:instance_name | None | 2026-04-28 08:05:28.930195 | orchestrator | | OS-EXT-SRV-ATTR:kernel_id | None | 2026-04-28 08:05:28.930200 | orchestrator | | OS-EXT-SRV-ATTR:launch_index | None | 2026-04-28 08:05:28.930204 | orchestrator | | OS-EXT-SRV-ATTR:ramdisk_id | None | 2026-04-28 08:05:28.930212 | orchestrator | | OS-EXT-SRV-ATTR:reservation_id | None | 2026-04-28 08:05:28.930217 | orchestrator | | OS-EXT-SRV-ATTR:root_device_name | None | 2026-04-28 08:05:28.930224 | orchestrator | | OS-EXT-SRV-ATTR:user_data | None | 2026-04-28 08:05:28.930228 | orchestrator | | OS-EXT-STS:power_state | Running | 2026-04-28 08:05:28.930233 | orchestrator | | OS-EXT-STS:task_state | None | 2026-04-28 08:05:28.930237 | orchestrator | | OS-EXT-STS:vm_state | active | 2026-04-28 08:05:28.930241 | orchestrator | | OS-SRV-USG:launched_at | 2026-04-28T04:27:11.000000 | 2026-04-28 08:05:28.930249 | orchestrator | | OS-SRV-USG:terminated_at | None | 2026-04-28 08:05:28.930253 | orchestrator | | accessIPv4 | | 2026-04-28 08:05:28.930258 | orchestrator | | accessIPv6 | | 2026-04-28 08:05:28.930285 | orchestrator | | addresses | test-3=192.168.112.145, 192.168.202.9 | 2026-04-28 08:05:28.930290 | orchestrator | | config_drive | | 2026-04-28 08:05:28.930297 | orchestrator | | created | 2026-04-28T04:26:46Z | 2026-04-28 08:05:28.930301 | orchestrator | | description | None | 2026-04-28 08:05:28.930305 | orchestrator | | flavor | description=, disk='0', ephemeral='0', extra_specs.hw_rng:allowed='true', extra_specs.scs:cpu-type='crowded-core', extra_specs.scs:disk0-type='network', extra_specs.scs:name-v1='SCS-1L:1', extra_specs.scs:name-v2='SCS-1L-1', id='SCS-1L-1', is_disabled=, is_public='True', location=, name='SCS-1L-1', original_name='SCS-1L-1', ram='1024', rxtx_factor=, swap='0', vcpus='1' | 2026-04-28 08:05:28.930309 | orchestrator | | hostId | 531b8e71fa9c5a69c7d8d609cf7fe45b1eca13e44aa7c59fe4723c86 | 2026-04-28 08:05:28.930313 | orchestrator | | host_status | None | 2026-04-28 08:05:28.930322 | orchestrator | | id | 3b98f333-de2a-4f24-b675-7df3094a053a | 2026-04-28 08:05:28.930326 | orchestrator | | image | N/A (booted from volume) | 2026-04-28 08:05:28.930333 | orchestrator | | key_name | test | 2026-04-28 08:05:28.930337 | orchestrator | | locked | False | 2026-04-28 08:05:28.930342 | orchestrator | | locked_reason | None | 2026-04-28 08:05:28.930348 | orchestrator | | name | test-4 | 2026-04-28 08:05:28.930352 | orchestrator | | pinned_availability_zone | None | 2026-04-28 08:05:28.930356 | orchestrator | | progress | 0 | 2026-04-28 08:05:28.930361 | orchestrator | | project_id | 3ee3aae67c9c44e9a61b3acbf06b1805 | 2026-04-28 08:05:28.930365 | orchestrator | | properties | hostname='test-4' | 2026-04-28 08:05:28.930374 | orchestrator | | security_groups | name='icmp' | 2026-04-28 08:05:28.930381 | orchestrator | | | name='ssh' | 2026-04-28 08:05:28.930385 | orchestrator | | server_groups | None | 2026-04-28 08:05:28.930390 | orchestrator | | status | ACTIVE | 2026-04-28 08:05:28.930394 | orchestrator | | tags | test | 2026-04-28 08:05:28.930401 | orchestrator | | trusted_image_certificates | None | 2026-04-28 08:05:28.930405 | orchestrator | | updated | 2026-04-28T08:04:05Z | 2026-04-28 08:05:28.930409 | orchestrator | | user_id | 01939d95acb94c56b03f62633390a42e | 2026-04-28 08:05:28.930413 | orchestrator | | volumes_attached | delete_on_termination='True', id='bc06f08a-b2b0-4766-9278-85a30dad4a98' | 2026-04-28 08:05:28.933924 | orchestrator | +-------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2026-04-28 08:05:29.207103 | orchestrator | + server_ping 2026-04-28 08:05:29.209061 | orchestrator | ++ openstack --os-cloud test floating ip list --status ACTIVE -f value -c 'Floating IP Address' 2026-04-28 08:05:29.209113 | orchestrator | ++ tr -d '\r' 2026-04-28 08:05:32.077983 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-28 08:05:32.078149 | orchestrator | + ping -c3 192.168.112.192 2026-04-28 08:05:32.104754 | orchestrator | PING 192.168.112.192 (192.168.112.192) 56(84) bytes of data. 2026-04-28 08:05:32.104847 | orchestrator | 64 bytes from 192.168.112.192: icmp_seq=1 ttl=63 time=10.4 ms 2026-04-28 08:05:33.099003 | orchestrator | 64 bytes from 192.168.112.192: icmp_seq=2 ttl=63 time=2.60 ms 2026-04-28 08:05:34.098983 | orchestrator | 64 bytes from 192.168.112.192: icmp_seq=3 ttl=63 time=1.91 ms 2026-04-28 08:05:34.099088 | orchestrator | 2026-04-28 08:05:34.099105 | orchestrator | --- 192.168.112.192 ping statistics --- 2026-04-28 08:05:34.099118 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2003ms 2026-04-28 08:05:34.099132 | orchestrator | rtt min/avg/max/mdev = 1.911/4.968/10.389/3.843 ms 2026-04-28 08:05:34.099535 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-28 08:05:34.099560 | orchestrator | + ping -c3 192.168.112.145 2026-04-28 08:05:34.110395 | orchestrator | PING 192.168.112.145 (192.168.112.145) 56(84) bytes of data. 2026-04-28 08:05:34.110458 | orchestrator | 64 bytes from 192.168.112.145: icmp_seq=1 ttl=63 time=5.65 ms 2026-04-28 08:05:35.109698 | orchestrator | 64 bytes from 192.168.112.145: icmp_seq=2 ttl=63 time=2.45 ms 2026-04-28 08:05:36.110390 | orchestrator | 64 bytes from 192.168.112.145: icmp_seq=3 ttl=63 time=1.66 ms 2026-04-28 08:05:36.110493 | orchestrator | 2026-04-28 08:05:36.110510 | orchestrator | --- 192.168.112.145 ping statistics --- 2026-04-28 08:05:36.110523 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2004ms 2026-04-28 08:05:36.110534 | orchestrator | rtt min/avg/max/mdev = 1.664/3.251/5.645/1.722 ms 2026-04-28 08:05:36.110823 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-28 08:05:36.110847 | orchestrator | + ping -c3 192.168.112.153 2026-04-28 08:05:36.125025 | orchestrator | PING 192.168.112.153 (192.168.112.153) 56(84) bytes of data. 2026-04-28 08:05:36.125094 | orchestrator | 64 bytes from 192.168.112.153: icmp_seq=1 ttl=63 time=9.20 ms 2026-04-28 08:05:37.120145 | orchestrator | 64 bytes from 192.168.112.153: icmp_seq=2 ttl=63 time=2.33 ms 2026-04-28 08:05:38.121716 | orchestrator | 64 bytes from 192.168.112.153: icmp_seq=3 ttl=63 time=1.92 ms 2026-04-28 08:05:38.121842 | orchestrator | 2026-04-28 08:05:38.121869 | orchestrator | --- 192.168.112.153 ping statistics --- 2026-04-28 08:05:38.121890 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2003ms 2026-04-28 08:05:38.121909 | orchestrator | rtt min/avg/max/mdev = 1.915/4.482/9.197/3.338 ms 2026-04-28 08:05:38.122219 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-28 08:05:38.122255 | orchestrator | + ping -c3 192.168.112.186 2026-04-28 08:05:38.131894 | orchestrator | PING 192.168.112.186 (192.168.112.186) 56(84) bytes of data. 2026-04-28 08:05:38.131967 | orchestrator | 64 bytes from 192.168.112.186: icmp_seq=1 ttl=63 time=4.95 ms 2026-04-28 08:05:39.131038 | orchestrator | 64 bytes from 192.168.112.186: icmp_seq=2 ttl=63 time=2.52 ms 2026-04-28 08:05:40.132148 | orchestrator | 64 bytes from 192.168.112.186: icmp_seq=3 ttl=63 time=1.74 ms 2026-04-28 08:05:40.132251 | orchestrator | 2026-04-28 08:05:40.132266 | orchestrator | --- 192.168.112.186 ping statistics --- 2026-04-28 08:05:40.132338 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2003ms 2026-04-28 08:05:40.132369 | orchestrator | rtt min/avg/max/mdev = 1.737/3.065/4.945/1.366 ms 2026-04-28 08:05:40.132965 | orchestrator | + for address in $(openstack --os-cloud test floating ip list --status ACTIVE -f value -c "Floating IP Address" | tr -d '\r') 2026-04-28 08:05:40.132994 | orchestrator | + ping -c3 192.168.112.100 2026-04-28 08:05:40.147225 | orchestrator | PING 192.168.112.100 (192.168.112.100) 56(84) bytes of data. 2026-04-28 08:05:40.147327 | orchestrator | 64 bytes from 192.168.112.100: icmp_seq=1 ttl=63 time=8.01 ms 2026-04-28 08:05:41.143359 | orchestrator | 64 bytes from 192.168.112.100: icmp_seq=2 ttl=63 time=2.35 ms 2026-04-28 08:05:42.144652 | orchestrator | 64 bytes from 192.168.112.100: icmp_seq=3 ttl=63 time=2.10 ms 2026-04-28 08:05:42.144754 | orchestrator | 2026-04-28 08:05:42.144771 | orchestrator | --- 192.168.112.100 ping statistics --- 2026-04-28 08:05:42.144784 | orchestrator | 3 packets transmitted, 3 received, 0% packet loss, time 2003ms 2026-04-28 08:05:42.144795 | orchestrator | rtt min/avg/max/mdev = 2.100/4.153/8.008/2.727 ms 2026-04-28 08:05:42.145410 | orchestrator | + [[ 10.0.0 == \l\a\t\e\s\t ]] 2026-04-28 08:05:42.475549 | orchestrator | ok: Runtime: 0:12:00.444268 2026-04-28 08:05:42.521845 | 2026-04-28 08:05:42.521966 | PLAY RECAP 2026-04-28 08:05:42.522026 | orchestrator | ok: 32 changed: 13 unreachable: 0 failed: 0 skipped: 7 rescued: 0 ignored: 0 2026-04-28 08:05:42.522051 | 2026-04-28 08:05:42.807797 | RUN END RESULT_NORMAL: [untrusted : github.com/osism/testbed/playbooks/upgrade-stable.yml@main] 2026-04-28 08:05:42.810395 | POST-RUN START: [untrusted : github.com/osism/testbed/playbooks/post.yml@main] 2026-04-28 08:05:43.570343 | 2026-04-28 08:05:43.570523 | PLAY [Post output play] 2026-04-28 08:05:43.588826 | 2026-04-28 08:05:43.589053 | LOOP [stage-output : Register sources] 2026-04-28 08:05:43.670417 | 2026-04-28 08:05:43.670764 | TASK [stage-output : Check sudo] 2026-04-28 08:05:44.576344 | orchestrator | sudo: a password is required 2026-04-28 08:05:44.711497 | orchestrator | ok: Runtime: 0:00:00.017108 2026-04-28 08:05:44.727346 | 2026-04-28 08:05:44.727513 | LOOP [stage-output : Set source and destination for files and folders] 2026-04-28 08:05:44.765343 | 2026-04-28 08:05:44.765627 | TASK [stage-output : Build a list of source, dest dictionaries] 2026-04-28 08:05:44.837806 | orchestrator | ok 2026-04-28 08:05:44.844023 | 2026-04-28 08:05:44.844153 | LOOP [stage-output : Ensure target folders exist] 2026-04-28 08:05:45.326538 | orchestrator | ok: "docs" 2026-04-28 08:05:45.326917 | 2026-04-28 08:05:45.585193 | orchestrator | ok: "artifacts" 2026-04-28 08:05:45.837731 | orchestrator | ok: "logs" 2026-04-28 08:05:45.853853 | 2026-04-28 08:05:45.854029 | LOOP [stage-output : Copy files and folders to staging folder] 2026-04-28 08:05:45.894372 | 2026-04-28 08:05:45.894644 | TASK [stage-output : Make all log files readable] 2026-04-28 08:05:46.191461 | orchestrator | ok 2026-04-28 08:05:46.211701 | 2026-04-28 08:05:46.211913 | TASK [stage-output : Rename log files that match extensions_to_txt] 2026-04-28 08:05:46.248769 | orchestrator | skipping: Conditional result was False 2026-04-28 08:05:46.268288 | 2026-04-28 08:05:46.268461 | TASK [stage-output : Discover log files for compression] 2026-04-28 08:05:46.303731 | orchestrator | skipping: Conditional result was False 2026-04-28 08:05:46.316685 | 2026-04-28 08:05:46.316966 | LOOP [stage-output : Archive everything from logs] 2026-04-28 08:05:46.369600 | 2026-04-28 08:05:46.369828 | PLAY [Post cleanup play] 2026-04-28 08:05:46.386011 | 2026-04-28 08:05:46.386172 | TASK [Set cloud fact (Zuul deployment)] 2026-04-28 08:05:46.441547 | orchestrator | ok 2026-04-28 08:05:46.450546 | 2026-04-28 08:05:46.450683 | TASK [Set cloud fact (local deployment)] 2026-04-28 08:05:46.485011 | orchestrator | skipping: Conditional result was False 2026-04-28 08:05:46.494806 | 2026-04-28 08:05:46.494996 | TASK [Clean the cloud environment] 2026-04-28 08:05:47.087592 | orchestrator | 2026-04-28 08:05:47 - clean up servers 2026-04-28 08:05:47.862557 | orchestrator | 2026-04-28 08:05:47 - testbed-manager 2026-04-28 08:05:47.979391 | orchestrator | 2026-04-28 08:05:47 - testbed-node-0 2026-04-28 08:05:48.098541 | orchestrator | 2026-04-28 08:05:48 - testbed-node-1 2026-04-28 08:05:48.266525 | orchestrator | 2026-04-28 08:05:48 - testbed-node-4 2026-04-28 08:05:48.398757 | orchestrator | 2026-04-28 08:05:48 - testbed-node-3 2026-04-28 08:05:48.511621 | orchestrator | 2026-04-28 08:05:48 - testbed-node-2 2026-04-28 08:05:48.632789 | orchestrator | 2026-04-28 08:05:48 - testbed-node-5 2026-04-28 08:05:48.757149 | orchestrator | 2026-04-28 08:05:48 - clean up keypairs 2026-04-28 08:05:48.772831 | orchestrator | 2026-04-28 08:05:48 - testbed 2026-04-28 08:05:48.805429 | orchestrator | 2026-04-28 08:05:48 - wait for servers to be gone 2026-04-28 08:05:57.610765 | orchestrator | 2026-04-28 08:05:57 - clean up ports 2026-04-28 08:05:57.788017 | orchestrator | 2026-04-28 08:05:57 - 19c62469-817e-4e9a-a7f7-06c0c524f2fd 2026-04-28 08:05:58.051109 | orchestrator | 2026-04-28 08:05:58 - 36a62201-26b3-46b2-bf4e-18dca2481df1 2026-04-28 08:05:58.365272 | orchestrator | 2026-04-28 08:05:58 - 81a664d2-1c16-40cd-be9e-36388910efa9 2026-04-28 08:05:58.585239 | orchestrator | 2026-04-28 08:05:58 - 8f420148-9dd1-4921-a97f-54181205d83b 2026-04-28 08:05:58.810184 | orchestrator | 2026-04-28 08:05:58 - 98fce35f-75a6-4ef5-8dbc-c896e422703a 2026-04-28 08:05:59.049024 | orchestrator | 2026-04-28 08:05:59 - c88f9753-e3cd-4f35-a236-9a93a3aa0064 2026-04-28 08:05:59.263127 | orchestrator | 2026-04-28 08:05:59 - f4e754dc-1c5a-422e-8ce8-9e5cc9d382d3 2026-04-28 08:05:59.734902 | orchestrator | 2026-04-28 08:05:59 - clean up volumes 2026-04-28 08:05:59.870854 | orchestrator | 2026-04-28 08:05:59 - testbed-volume-5-node-base 2026-04-28 08:05:59.926572 | orchestrator | 2026-04-28 08:05:59 - testbed-volume-2-node-base 2026-04-28 08:05:59.991159 | orchestrator | 2026-04-28 08:05:59 - testbed-volume-4-node-base 2026-04-28 08:06:00.043269 | orchestrator | 2026-04-28 08:06:00 - testbed-volume-3-node-base 2026-04-28 08:06:00.103191 | orchestrator | 2026-04-28 08:06:00 - testbed-volume-1-node-base 2026-04-28 08:06:00.157806 | orchestrator | 2026-04-28 08:06:00 - testbed-volume-0-node-base 2026-04-28 08:06:00.224767 | orchestrator | 2026-04-28 08:06:00 - testbed-volume-manager-base 2026-04-28 08:06:00.290505 | orchestrator | 2026-04-28 08:06:00 - testbed-volume-3-node-3 2026-04-28 08:06:00.344027 | orchestrator | 2026-04-28 08:06:00 - testbed-volume-7-node-4 2026-04-28 08:06:00.400682 | orchestrator | 2026-04-28 08:06:00 - testbed-volume-8-node-5 2026-04-28 08:06:00.463902 | orchestrator | 2026-04-28 08:06:00 - testbed-volume-5-node-5 2026-04-28 08:06:00.524952 | orchestrator | 2026-04-28 08:06:00 - testbed-volume-1-node-4 2026-04-28 08:06:00.584577 | orchestrator | 2026-04-28 08:06:00 - testbed-volume-4-node-4 2026-04-28 08:06:00.643646 | orchestrator | 2026-04-28 08:06:00 - testbed-volume-6-node-3 2026-04-28 08:06:00.705346 | orchestrator | 2026-04-28 08:06:00 - testbed-volume-2-node-5 2026-04-28 08:06:00.762634 | orchestrator | 2026-04-28 08:06:00 - testbed-volume-0-node-3 2026-04-28 08:06:00.843828 | orchestrator | 2026-04-28 08:06:00 - disconnect routers 2026-04-28 08:06:00.962182 | orchestrator | 2026-04-28 08:06:00 - testbed 2026-04-28 08:06:02.007247 | orchestrator | 2026-04-28 08:06:02 - clean up subnets 2026-04-28 08:06:02.069720 | orchestrator | 2026-04-28 08:06:02 - subnet-testbed-management 2026-04-28 08:06:02.270724 | orchestrator | 2026-04-28 08:06:02 - clean up networks 2026-04-28 08:06:02.455202 | orchestrator | 2026-04-28 08:06:02 - net-testbed-management 2026-04-28 08:06:02.802991 | orchestrator | 2026-04-28 08:06:02 - clean up security groups 2026-04-28 08:06:02.845714 | orchestrator | 2026-04-28 08:06:02 - testbed-management 2026-04-28 08:06:02.972789 | orchestrator | 2026-04-28 08:06:02 - testbed-node 2026-04-28 08:06:03.146424 | orchestrator | 2026-04-28 08:06:03 - clean up floating ips 2026-04-28 08:06:03.179159 | orchestrator | 2026-04-28 08:06:03 - 81.163.192.176 2026-04-28 08:06:03.557428 | orchestrator | 2026-04-28 08:06:03 - clean up routers 2026-04-28 08:06:03.783364 | orchestrator | 2026-04-28 08:06:03 - testbed 2026-04-28 08:06:05.556739 | orchestrator | ok: Runtime: 0:00:18.355290 2026-04-28 08:06:05.558848 | 2026-04-28 08:06:05.558941 | PLAY RECAP 2026-04-28 08:06:05.558999 | orchestrator | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 7 rescued: 0 ignored: 0 2026-04-28 08:06:05.559024 | 2026-04-28 08:06:05.688851 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/osism/testbed/playbooks/post.yml@main] 2026-04-28 08:06:05.691864 | POST-RUN START: [untrusted : github.com/osism/testbed/playbooks/cleanup.yml@main] 2026-04-28 08:06:06.469509 | 2026-04-28 08:06:06.469706 | PLAY [Cleanup play] 2026-04-28 08:06:06.487933 | 2026-04-28 08:06:06.488116 | TASK [Set cloud fact (Zuul deployment)] 2026-04-28 08:06:06.548452 | orchestrator | ok 2026-04-28 08:06:06.560122 | 2026-04-28 08:06:06.560479 | TASK [Set cloud fact (local deployment)] 2026-04-28 08:06:06.596708 | orchestrator | skipping: Conditional result was False 2026-04-28 08:06:06.618017 | 2026-04-28 08:06:06.618234 | TASK [Clean the cloud environment] 2026-04-28 08:06:07.778214 | orchestrator | 2026-04-28 08:06:07 - clean up servers 2026-04-28 08:06:08.257816 | orchestrator | 2026-04-28 08:06:08 - clean up keypairs 2026-04-28 08:06:08.272456 | orchestrator | 2026-04-28 08:06:08 - wait for servers to be gone 2026-04-28 08:06:08.313719 | orchestrator | 2026-04-28 08:06:08 - clean up ports 2026-04-28 08:06:08.397022 | orchestrator | 2026-04-28 08:06:08 - clean up volumes 2026-04-28 08:06:08.467161 | orchestrator | 2026-04-28 08:06:08 - disconnect routers 2026-04-28 08:06:08.494149 | orchestrator | 2026-04-28 08:06:08 - clean up subnets 2026-04-28 08:06:08.511963 | orchestrator | 2026-04-28 08:06:08 - clean up networks 2026-04-28 08:06:08.699789 | orchestrator | 2026-04-28 08:06:08 - clean up security groups 2026-04-28 08:06:08.737259 | orchestrator | 2026-04-28 08:06:08 - clean up floating ips 2026-04-28 08:06:08.765672 | orchestrator | 2026-04-28 08:06:08 - clean up routers 2026-04-28 08:06:09.165362 | orchestrator | ok: Runtime: 0:00:01.383687 2026-04-28 08:06:09.169317 | 2026-04-28 08:06:09.169471 | PLAY RECAP 2026-04-28 08:06:09.169591 | orchestrator | ok: 2 changed: 1 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-28 08:06:09.169651 | 2026-04-28 08:06:09.310796 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/osism/testbed/playbooks/cleanup.yml@main] 2026-04-28 08:06:09.312671 | POST-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/post-fetch.yaml@main] 2026-04-28 08:06:10.095983 | 2026-04-28 08:06:10.096160 | PLAY [Base post-fetch] 2026-04-28 08:06:10.112528 | 2026-04-28 08:06:10.112705 | TASK [fetch-output : Set log path for multiple nodes] 2026-04-28 08:06:10.168239 | orchestrator | skipping: Conditional result was False 2026-04-28 08:06:10.181060 | 2026-04-28 08:06:10.181321 | TASK [fetch-output : Set log path for single node] 2026-04-28 08:06:10.230485 | orchestrator | ok 2026-04-28 08:06:10.238920 | 2026-04-28 08:06:10.239058 | LOOP [fetch-output : Ensure local output dirs] 2026-04-28 08:06:10.779646 | orchestrator -> localhost | ok: "/var/lib/zuul/builds/e75d3019e7a7424d9936cc0c39e3d70d/work/logs" 2026-04-28 08:06:11.084584 | orchestrator -> localhost | changed: "/var/lib/zuul/builds/e75d3019e7a7424d9936cc0c39e3d70d/work/artifacts" 2026-04-28 08:06:11.384552 | orchestrator -> localhost | changed: "/var/lib/zuul/builds/e75d3019e7a7424d9936cc0c39e3d70d/work/docs" 2026-04-28 08:06:11.405697 | 2026-04-28 08:06:11.405849 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-04-28 08:06:12.383289 | orchestrator | changed: 2026-04-28 08:06:12.383577 | orchestrator | >f+++++++++ sudo-debug.txt 2026-04-28 08:06:12.383619 | orchestrator | >f+++++++++ sudo-strace.log 2026-04-28 08:06:12.383657 | orchestrator | >f+++++++++ sudo-strace.log.time 2026-04-28 08:06:12.383707 | orchestrator | changed: All items complete 2026-04-28 08:06:12.383734 | 2026-04-28 08:06:13.091106 | orchestrator | changed: .d..t...... ./ 2026-04-28 08:06:13.844428 | orchestrator | changed: .d..t...... ./ 2026-04-28 08:06:13.860740 | 2026-04-28 08:06:13.860876 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-04-28 08:06:13.895458 | orchestrator | skipping: Conditional result was False 2026-04-28 08:06:13.898103 | orchestrator | skipping: Conditional result was False 2026-04-28 08:06:13.912829 | 2026-04-28 08:06:13.912942 | PLAY RECAP 2026-04-28 08:06:13.913016 | orchestrator | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2026-04-28 08:06:13.913054 | 2026-04-28 08:06:14.060983 | POST-RUN END RESULT_NORMAL: [trusted : github.com/osism/zuul-config/playbooks/base/post-fetch.yaml@main] 2026-04-28 08:06:14.063275 | POST-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/post.yaml@main] 2026-04-28 08:06:14.811951 | 2026-04-28 08:06:14.812111 | PLAY [Base post] 2026-04-28 08:06:14.826271 | 2026-04-28 08:06:14.826402 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-04-28 08:06:15.922257 | orchestrator | changed 2026-04-28 08:06:15.932194 | 2026-04-28 08:06:15.932337 | PLAY RECAP 2026-04-28 08:06:15.932405 | orchestrator | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-28 08:06:15.932472 | 2026-04-28 08:06:16.063519 | POST-RUN END RESULT_NORMAL: [trusted : github.com/osism/zuul-config/playbooks/base/post.yaml@main] 2026-04-28 08:06:16.064576 | POST-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/post-logs.yaml@main] 2026-04-28 08:06:16.889192 | 2026-04-28 08:06:16.889392 | PLAY [Base post-logs] 2026-04-28 08:06:16.900422 | 2026-04-28 08:06:16.900565 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-04-28 08:06:17.418871 | localhost | changed 2026-04-28 08:06:17.429024 | 2026-04-28 08:06:17.429184 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-04-28 08:06:17.454942 | localhost | ok 2026-04-28 08:06:17.458048 | 2026-04-28 08:06:17.458145 | TASK [Set zuul-log-path fact] 2026-04-28 08:06:17.473249 | localhost | ok 2026-04-28 08:06:17.482357 | 2026-04-28 08:06:17.482466 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-28 08:06:17.520162 | localhost | ok 2026-04-28 08:06:17.526260 | 2026-04-28 08:06:17.526415 | TASK [upload-logs : Create log directories] 2026-04-28 08:06:18.031590 | localhost | changed 2026-04-28 08:06:18.034417 | 2026-04-28 08:06:18.034528 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-04-28 08:06:18.544962 | localhost -> localhost | ok: Runtime: 0:00:00.007093 2026-04-28 08:06:18.549159 | 2026-04-28 08:06:18.549327 | TASK [upload-logs : Upload logs to log server] 2026-04-28 08:06:19.153977 | localhost | Output suppressed because no_log was given 2026-04-28 08:06:19.156740 | 2026-04-28 08:06:19.156893 | LOOP [upload-logs : Compress console log and json output] 2026-04-28 08:06:19.218128 | localhost | skipping: Conditional result was False 2026-04-28 08:06:19.222977 | localhost | skipping: Conditional result was False 2026-04-28 08:06:19.230705 | 2026-04-28 08:06:19.230990 | LOOP [upload-logs : Upload compressed console log and json output] 2026-04-28 08:06:19.281894 | localhost | skipping: Conditional result was False 2026-04-28 08:06:19.282573 | 2026-04-28 08:06:19.285939 | localhost | skipping: Conditional result was False 2026-04-28 08:06:19.291816 | 2026-04-28 08:06:19.292117 | LOOP [upload-logs : Upload console log and json output]